Nov 15 09:26:02 user nova-compute[75122]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=75122) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 15 09:26:02 user nova-compute[75122]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=75122) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 15 09:26:02 user nova-compute[75122]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=75122) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 15 09:26:02 user nova-compute[75122]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.017s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:26:03 user nova-compute[75122]: INFO nova.virt.driver [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] Loading compute driver 'libvirt.LibvirtDriver'
Nov 15 09:26:03 user nova-compute[75122]: INFO nova.compute.provider_config [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] Acquiring lock "singleton_lock" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] Acquired lock "singleton_lock" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] Releasing lock "singleton_lock" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] Full set of CONF: {{(pid=75122) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] ******************************************************************************** {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] Configuration options gathered from: {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] ================================================================================ {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] allow_resize_to_same_host      = True {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] arq_binding_timeout            = 300 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] backdoor_port                  = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] backdoor_socket                = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] block_device_allocate_retries  = 300 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] block_device_allocate_retries_interval = 5 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] cert                           = self.pem {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] compute_monitors               = [] {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] config_dir                     = [] {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] config_drive_format            = iso9660 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] config_source                  = [] {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] console_host                   = user {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] control_exchange               = nova {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] cpu_allocation_ratio           = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] daemon                         = False {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] debug                          = True {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] default_access_ip_network_name = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] default_availability_zone      = nova {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] default_ephemeral_format       = ext4 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] default_green_pool_size        = 1000 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] default_schedule_zone          = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] disk_allocation_ratio          = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] enable_new_services            = True {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] enabled_apis                   = ['osapi_compute'] {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] enabled_ssl_apis               = [] {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] flat_injected                  = False {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] force_config_drive             = False {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] force_raw_images               = True {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] graceful_shutdown_timeout      = 5 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] heal_instance_info_cache_interval = 60 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] host                           = user {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] initial_disk_allocation_ratio  = 1.0 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] initial_ram_allocation_ratio   = 1.0 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] instance_build_timeout         = 0 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] instance_delete_interval       = 300 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] instance_format                = [instance: %(uuid)s]  {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] instance_name_template         = instance-%08x {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] instance_usage_audit           = False {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] instance_usage_audit_period    = month {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] internal_service_availability_zone = internal {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] key                            = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] live_migration_retry_count     = 30 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] log_config_append              = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] log_dir                        = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] log_file                       = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] log_options                    = True {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] log_rotate_interval            = 1 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] log_rotate_interval_type       = days {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] log_rotation_type              = none {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] long_rpc_timeout               = 1800 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] max_concurrent_builds          = 10 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] max_concurrent_live_migrations = 1 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] max_concurrent_snapshots       = 5 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] max_local_block_devices        = 3 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] max_logfile_count              = 30 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] max_logfile_size_mb            = 200 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] maximum_instance_delete_attempts = 5 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] metadata_listen                = 0.0.0.0 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] metadata_listen_port           = 8775 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] metadata_workers               = 3 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] migrate_max_retries            = -1 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] mkisofs_cmd                    = genisoimage {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] my_block_storage_ip            = 10.0.0.210 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] my_ip                          = 10.0.0.210 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] network_allocate_retries       = 0 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] osapi_compute_listen           = 0.0.0.0 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] osapi_compute_listen_port      = 8774 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] osapi_compute_unique_server_name_scope =  {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] osapi_compute_workers          = 3 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] password_length                = 12 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] periodic_enable                = True {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] periodic_fuzzy_delay           = 60 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] pointer_model                  = ps2mouse {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] preallocate_images             = none {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] publish_errors                 = False {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] pybasedir                      = /opt/stack/nova {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] ram_allocation_ratio           = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] rate_limit_burst               = 0 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] rate_limit_except_level        = CRITICAL {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] rate_limit_interval            = 0 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] reboot_timeout                 = 0 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] reclaim_instance_interval      = 0 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] record                         = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] reimage_timeout_per_gb         = 60 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] report_interval                = 120 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] rescue_timeout                 = 0 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] reserved_host_cpus             = 0 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] reserved_host_disk_mb          = 0 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] reserved_host_memory_mb        = 512 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] reserved_huge_pages            = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] resize_confirm_window          = 0 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] resize_fs_using_block_device   = False {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] resume_guests_state_on_host_boot = False {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] rpc_response_timeout           = 60 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] run_external_periodic_tasks    = True {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] running_deleted_instance_action = reap {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] running_deleted_instance_poll_interval = 1800 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] running_deleted_instance_timeout = 0 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] scheduler_instance_sync_interval = 120 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] service_down_time              = 720 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] servicegroup_driver            = db {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] shelved_offload_time           = 0 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] shelved_poll_interval          = 3600 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] shutdown_timeout               = 0 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] source_is_ipv6                 = False {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] ssl_only                       = False {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] state_path                     = /opt/stack/data/nova {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] sync_power_state_interval      = 600 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] sync_power_state_pool_size     = 1000 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] syslog_log_facility            = LOG_USER {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] tempdir                        = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] timeout_nbd                    = 10 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] transport_url                  = **** {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] update_resources_interval      = 0 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] use_cow_images                 = True {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] use_eventlog                   = False {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] use_journal                    = False {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] use_json                       = False {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] use_rootwrap_daemon            = False {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] use_stderr                     = False {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] use_syslog                     = False {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] vcpu_pin_set                   = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] vif_plugging_is_fatal          = False {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] vif_plugging_timeout           = 0 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] virt_mkfs                      = [] {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] volume_usage_poll_interval     = 0 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] watch_log_file                 = False {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] web                            = /usr/share/spice-html5 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] oslo_concurrency.disable_process_locking = False {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] api.auth_strategy              = keystone {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] api.compute_link_prefix        = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] api.dhcp_domain                = novalocal {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] api.enable_instance_password   = True {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] api.glance_link_prefix         = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] api.instance_list_cells_batch_strategy = distributed {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] api.instance_list_per_project_cells = False {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] api.list_records_by_skipping_down_cells = True {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] api.local_metadata_per_cell    = False {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] api.max_limit                  = 1000 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] api.metadata_cache_expiration  = 15 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] api.neutron_default_tenant_id  = default {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] api.use_forwarded_for          = False {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] api.use_neutron_default_nets   = False {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] api.vendordata_dynamic_failure_fatal = False {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] api.vendordata_dynamic_targets = [] {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] api.vendordata_jsonfile_path   = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] cache.backend                  = dogpile.cache.memcached {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] cache.backend_argument         = **** {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] cache.config_prefix            = cache.oslo {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] cache.dead_timeout             = 60.0 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] cache.debug_cache_backend      = False {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] cache.enable_retry_client      = False {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] cache.enable_socket_keepalive  = False {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] cache.enabled                  = True {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] cache.expiration_time          = 600 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] cache.hashclient_retry_attempts = 2 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] cache.hashclient_retry_delay   = 1.0 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] cache.memcache_dead_retry      = 300 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] cache.memcache_password        =  {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] cache.memcache_pool_maxsize    = 10 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] cache.memcache_sasl_enabled    = False {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] cache.memcache_socket_timeout  = 1.0 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] cache.memcache_username        =  {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] cache.proxies                  = [] {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] cache.retry_attempts           = 2 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] cache.retry_delay              = 0.0 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] cache.socket_keepalive_count   = 1 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] cache.socket_keepalive_idle    = 1 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] cache.socket_keepalive_interval = 1 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] cache.tls_allowed_ciphers      = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] cache.tls_cafile               = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] cache.tls_certfile             = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] cache.tls_enabled              = False {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] cache.tls_keyfile              = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] cinder.auth_section            = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] cinder.auth_type               = password {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] cinder.cafile                  = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] cinder.catalog_info            = volumev3::publicURL {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] cinder.certfile                = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] cinder.collect_timing          = False {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] cinder.cross_az_attach         = True {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] cinder.debug                   = False {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] cinder.endpoint_template       = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] cinder.http_retries            = 3 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] cinder.insecure                = False {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] cinder.keyfile                 = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] cinder.os_region_name          = RegionOne {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] cinder.split_loggers           = False {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] cinder.timeout                 = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] compute.cpu_dedicated_set      = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] compute.cpu_shared_set         = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] compute.image_type_exclude_list = [] {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] compute.live_migration_wait_for_vif_plug = True {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] compute.max_concurrent_disk_ops = 0 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] compute.max_disk_devices_to_attach = -1 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] compute.resource_provider_association_refresh = 300 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] compute.shutdown_retry_interval = 10 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] conductor.workers              = 3 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] console.allowed_origins        = [] {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] console.ssl_ciphers            = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] console.ssl_minimum_version    = default {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] consoleauth.token_ttl          = 600 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] cyborg.cafile                  = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] cyborg.certfile                = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] cyborg.collect_timing          = False {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] cyborg.connect_retries         = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] cyborg.connect_retry_delay     = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] cyborg.endpoint_override       = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] cyborg.insecure                = False {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] cyborg.keyfile                 = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] cyborg.max_version             = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] cyborg.min_version             = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] cyborg.region_name             = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] cyborg.service_name            = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] cyborg.service_type            = accelerator {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] cyborg.split_loggers           = False {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] cyborg.status_code_retries     = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] cyborg.status_code_retry_delay = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] cyborg.timeout                 = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] cyborg.version                 = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] database.backend               = sqlalchemy {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] database.connection            = **** {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] database.connection_debug      = 0 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] database.connection_parameters =  {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] database.connection_recycle_time = 3600 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] database.connection_trace      = False {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] database.db_inc_retry_interval = True {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] database.db_max_retries        = 20 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] database.db_max_retry_interval = 10 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] database.db_retry_interval     = 1 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] database.max_overflow          = 50 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] database.max_pool_size         = 5 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] database.max_retries           = 10 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] database.mysql_wsrep_sync_wait = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] database.pool_timeout          = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] database.retry_interval        = 10 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] database.slave_connection      = **** {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] database.sqlite_synchronous    = True {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] api_database.backend           = sqlalchemy {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] api_database.connection        = **** {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] api_database.connection_debug  = 0 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] api_database.connection_parameters =  {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] api_database.connection_recycle_time = 3600 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] api_database.connection_trace  = False {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] api_database.db_inc_retry_interval = True {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] api_database.db_max_retries    = 20 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] api_database.db_max_retry_interval = 10 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] api_database.db_retry_interval = 1 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] api_database.max_overflow      = 50 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] api_database.max_pool_size     = 5 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] api_database.max_retries       = 10 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] api_database.mysql_wsrep_sync_wait = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] api_database.pool_timeout      = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] api_database.retry_interval    = 10 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] api_database.slave_connection  = **** {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] api_database.sqlite_synchronous = True {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] devices.enabled_mdev_types     = [] {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] ephemeral_storage_encryption.enabled = False {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] ephemeral_storage_encryption.key_size = 512 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] glance.api_servers             = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] glance.cafile                  = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] glance.certfile                = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] glance.collect_timing          = False {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] glance.connect_retries         = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] glance.connect_retry_delay     = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] glance.debug                   = False {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] glance.default_trusted_certificate_ids = [] {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] glance.enable_certificate_validation = False {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] glance.enable_rbd_download     = False {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] glance.endpoint_override       = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] glance.insecure                = False {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] glance.keyfile                 = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] glance.max_version             = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] glance.min_version             = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] glance.num_retries             = 3 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] glance.rbd_ceph_conf           =  {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] glance.rbd_connect_timeout     = 5 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] glance.rbd_pool                =  {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] glance.rbd_user                =  {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] glance.region_name             = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] glance.service_name            = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] glance.service_type            = image {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] glance.split_loggers           = False {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] glance.status_code_retries     = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] glance.status_code_retry_delay = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] glance.timeout                 = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] glance.verify_glance_signatures = False {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] glance.version                 = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] guestfs.debug                  = False {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] hyperv.config_drive_cdrom      = False {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] hyperv.config_drive_inject_password = False {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] hyperv.enable_instance_metrics_collection = False {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] hyperv.enable_remotefx         = False {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] hyperv.instances_path_share    =  {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] hyperv.iscsi_initiator_list    = [] {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] hyperv.limit_cpu_features      = False {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] hyperv.power_state_check_timeframe = 60 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] hyperv.power_state_event_polling_interval = 2 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] hyperv.use_multipath_io        = False {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] hyperv.volume_attach_retry_count = 10 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] hyperv.volume_attach_retry_interval = 5 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] hyperv.vswitch_name            = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] mks.enabled                    = False {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] image_cache.manager_interval   = 2400 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] image_cache.precache_concurrency = 1 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] image_cache.remove_unused_base_images = True {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] image_cache.subdirectory_name  = _base {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] ironic.api_max_retries         = 60 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] ironic.api_retry_interval      = 2 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] ironic.auth_section            = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] ironic.auth_type               = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] ironic.cafile                  = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] ironic.certfile                = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] ironic.collect_timing          = False {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] ironic.conductor_group         = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] ironic.connect_retries         = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] ironic.connect_retry_delay     = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] ironic.endpoint_override       = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] ironic.insecure                = False {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] ironic.keyfile                 = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] ironic.max_version             = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] ironic.min_version             = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] ironic.peer_list               = [] {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] ironic.region_name             = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] ironic.serial_console_state_timeout = 10 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] ironic.service_name            = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] ironic.service_type            = baremetal {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] ironic.split_loggers           = False {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] ironic.status_code_retries     = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] ironic.status_code_retry_delay = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] ironic.timeout                 = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] ironic.version                 = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] key_manager.fixed_key          = **** {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] barbican.barbican_api_version  = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] barbican.barbican_endpoint     = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] barbican.barbican_endpoint_type = public {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] barbican.barbican_region_name  = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] barbican.cafile                = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] barbican.certfile              = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] barbican.collect_timing        = False {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] barbican.insecure              = False {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] barbican.keyfile               = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] barbican.number_of_retries     = 60 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] barbican.retry_delay           = 1 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] barbican.send_service_user_token = False {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] barbican.split_loggers         = False {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] barbican.timeout               = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] barbican.verify_ssl            = True {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] barbican.verify_ssl_path       = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] barbican_service_user.auth_section = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] barbican_service_user.auth_type = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] barbican_service_user.cafile   = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] barbican_service_user.certfile = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] barbican_service_user.collect_timing = False {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] barbican_service_user.insecure = False {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] barbican_service_user.keyfile  = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] barbican_service_user.split_loggers = False {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] barbican_service_user.timeout  = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] vault.approle_role_id          = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] vault.approle_secret_id        = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] vault.cafile                   = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] vault.certfile                 = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] vault.collect_timing           = False {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] vault.insecure                 = False {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] vault.keyfile                  = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] vault.kv_mountpoint            = secret {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] vault.kv_path                  = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] vault.kv_version               = 2 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] vault.namespace                = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] vault.root_token_id            = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] vault.split_loggers            = False {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] vault.ssl_ca_crt_file          = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] vault.timeout                  = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] vault.use_ssl                  = False {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] keystone.auth_section          = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] keystone.auth_type             = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] keystone.cafile                = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] keystone.certfile              = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] keystone.collect_timing        = False {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] keystone.connect_retries       = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] keystone.connect_retry_delay   = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] keystone.endpoint_override     = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] keystone.insecure              = False {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] keystone.keyfile               = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] keystone.max_version           = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] keystone.min_version           = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] keystone.region_name           = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] keystone.service_name          = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] keystone.service_type          = identity {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] keystone.split_loggers         = False {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] keystone.status_code_retries   = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] keystone.status_code_retry_delay = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] keystone.timeout               = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] keystone.version               = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] libvirt.connection_uri         =  {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] libvirt.cpu_mode               = custom {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] libvirt.cpu_model_extra_flags  = [] {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: WARNING oslo_config.cfg [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] libvirt.cpu_power_governor_high = performance {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] libvirt.cpu_power_governor_low = powersave {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] libvirt.cpu_power_management   = False {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] libvirt.device_detach_attempts = 8 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] libvirt.device_detach_timeout  = 20 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] libvirt.disk_cachemodes        = [] {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] libvirt.disk_prefix            = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] libvirt.enabled_perf_events    = [] {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] libvirt.file_backed_memory     = 0 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] libvirt.gid_maps               = [] {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] libvirt.hw_disk_discard        = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] libvirt.hw_machine_type        = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] libvirt.images_rbd_ceph_conf   =  {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] libvirt.images_rbd_glance_store_name =  {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] libvirt.images_rbd_pool        = rbd {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] libvirt.images_type            = default {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] libvirt.images_volume_group    = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] libvirt.inject_key             = False {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] libvirt.inject_partition       = -2 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] libvirt.inject_password        = False {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] libvirt.iscsi_iface            = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] libvirt.iser_use_multipath     = False {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] libvirt.live_migration_bandwidth = 0 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] libvirt.live_migration_completion_timeout = 800 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] libvirt.live_migration_downtime = 500 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] libvirt.live_migration_downtime_delay = 75 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] libvirt.live_migration_downtime_steps = 10 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] libvirt.live_migration_inbound_addr = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] libvirt.live_migration_permit_auto_converge = False {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] libvirt.live_migration_permit_post_copy = False {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] libvirt.live_migration_scheme  = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] libvirt.live_migration_timeout_action = abort {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] libvirt.live_migration_tunnelled = False {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: WARNING oslo_config.cfg [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Nov 15 09:26:03 user nova-compute[75122]: live_migration_uri is deprecated for removal in favor of two other options that
Nov 15 09:26:03 user nova-compute[75122]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Nov 15 09:26:03 user nova-compute[75122]: and ``live_migration_inbound_addr`` respectively.
Nov 15 09:26:03 user nova-compute[75122]: ).  Its value may be silently ignored in the future.
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] libvirt.live_migration_with_native_tls = False {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] libvirt.max_queues             = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] libvirt.mem_stats_period_seconds = 10 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] libvirt.nfs_mount_options      = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] libvirt.num_aoe_discover_tries = 3 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] libvirt.num_iser_scan_tries    = 5 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] libvirt.num_memory_encrypted_guests = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] libvirt.num_nvme_discover_tries = 5 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] libvirt.num_pcie_ports         = 0 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] libvirt.num_volume_scan_tries  = 5 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] libvirt.pmem_namespaces        = [] {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] libvirt.quobyte_client_cfg     = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] libvirt.rbd_connect_timeout    = 5 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] libvirt.rbd_secret_uuid        = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] libvirt.rbd_user               = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] libvirt.realtime_scheduler_priority = 1 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] libvirt.remote_filesystem_transport = ssh {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] libvirt.rescue_image_id        = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] libvirt.rescue_kernel_id       = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] libvirt.rescue_ramdisk_id      = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] libvirt.rx_queue_size          = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] libvirt.smbfs_mount_options    =  {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] libvirt.snapshot_compression   = False {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] libvirt.snapshot_image_format  = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] libvirt.sparse_logical_volumes = False {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] libvirt.swtpm_enabled          = False {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] libvirt.swtpm_group            = tss {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] libvirt.swtpm_user             = tss {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] libvirt.sysinfo_serial         = unique {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] libvirt.tb_cache_size          = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] libvirt.tx_queue_size          = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] libvirt.uid_maps               = [] {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] libvirt.use_virtio_for_bridges = True {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] libvirt.virt_type              = kvm {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] libvirt.volume_clear           = zero {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] libvirt.volume_clear_size      = 0 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] libvirt.volume_use_multipath   = False {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] libvirt.vzstorage_cache_path   = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] libvirt.vzstorage_mount_group  = qemu {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] libvirt.vzstorage_mount_opts   = [] {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] libvirt.vzstorage_mount_user   = stack {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] neutron.auth_section           = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] neutron.auth_type              = password {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] neutron.cafile                 = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] neutron.certfile               = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] neutron.collect_timing         = False {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] neutron.connect_retries        = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] neutron.connect_retry_delay    = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] neutron.default_floating_pool  = public {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] neutron.endpoint_override      = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] neutron.extension_sync_interval = 600 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] neutron.http_retries           = 3 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] neutron.insecure               = False {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] neutron.keyfile                = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] neutron.max_version            = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] neutron.metadata_proxy_shared_secret = **** {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] neutron.min_version            = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] neutron.ovs_bridge             = br-int {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] neutron.physnets               = [] {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] neutron.region_name            = RegionOne {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] neutron.service_metadata_proxy = True {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] neutron.service_name           = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] neutron.service_type           = network {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] neutron.split_loggers          = False {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] neutron.status_code_retries    = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] neutron.status_code_retry_delay = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] neutron.timeout                = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] neutron.version                = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] notifications.bdms_in_notifications = False {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] notifications.default_level    = INFO {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] notifications.notification_format = unversioned {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] notifications.notify_on_state_change = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] pci.alias                      = [] {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] pci.device_spec                = [] {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] pci.report_in_placement        = False {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] placement.auth_section         = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] placement.auth_type            = password {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] placement.cafile               = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] placement.certfile             = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] placement.collect_timing       = False {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] placement.connect_retries      = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] placement.connect_retry_delay  = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] placement.default_domain_id    = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] placement.default_domain_name  = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] placement.domain_id            = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] placement.domain_name          = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] placement.endpoint_override    = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] placement.insecure             = False {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] placement.keyfile              = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] placement.max_version          = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] placement.min_version          = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] placement.password             = **** {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] placement.project_domain_id    = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] placement.project_domain_name  = Default {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] placement.project_id           = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] placement.project_name         = service {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] placement.region_name          = RegionOne {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] placement.service_name         = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] placement.service_type         = placement {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] placement.split_loggers        = False {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] placement.status_code_retries  = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] placement.status_code_retry_delay = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] placement.system_scope         = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] placement.timeout              = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] placement.trust_id             = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] placement.user_domain_id       = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] placement.user_domain_name     = Default {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] placement.user_id              = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] placement.username             = placement {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] placement.version              = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] quota.cores                    = 20 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] quota.count_usage_from_placement = False {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] quota.injected_file_content_bytes = 10240 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] quota.injected_file_path_length = 255 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] quota.injected_files           = 5 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] quota.instances                = 10 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] quota.key_pairs                = 100 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] quota.metadata_items           = 128 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] quota.ram                      = 51200 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] quota.recheck_quota            = True {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] quota.server_group_members     = 10 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] quota.server_groups            = 10 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] rdp.enabled                    = False {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] scheduler.image_metadata_prefilter = False {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] scheduler.max_attempts         = 3 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] scheduler.max_placement_results = 1000 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] scheduler.query_placement_for_image_type_support = False {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] scheduler.workers              = 3 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] filter_scheduler.host_subset_size = 1 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] filter_scheduler.image_properties_default_architecture = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] filter_scheduler.isolated_hosts = [] {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] filter_scheduler.isolated_images = [] {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] filter_scheduler.max_instances_per_host = 50 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] filter_scheduler.num_instances_weight_multiplier = 0.0 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] filter_scheduler.pci_in_placement = False {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] filter_scheduler.track_instance_changes = False {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] metrics.required               = True {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] metrics.weight_multiplier      = 1.0 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] metrics.weight_setting         = [] {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] serial_console.enabled         = False {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] serial_console.port_range      = 10000:20000 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] serial_console.serialproxy_port = 6083 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] service_user.auth_section      = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] service_user.auth_type         = password {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] service_user.cafile            = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] service_user.certfile          = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] service_user.collect_timing    = False {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] service_user.insecure          = False {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] service_user.keyfile           = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] service_user.send_service_user_token = True {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] service_user.split_loggers     = False {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] service_user.timeout           = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] spice.agent_enabled            = True {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] spice.enabled                  = False {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] spice.html5proxy_port          = 6082 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] spice.image_compression        = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] spice.jpeg_compression         = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] spice.playback_compression     = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] spice.server_listen            = 127.0.0.1 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] spice.streaming_mode           = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] spice.zlib_compression         = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] upgrade_levels.baseapi         = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] upgrade_levels.cert            = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] upgrade_levels.compute         = auto {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] upgrade_levels.conductor       = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] upgrade_levels.scheduler       = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] vendordata_dynamic_auth.auth_section = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] vendordata_dynamic_auth.auth_type = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] vendordata_dynamic_auth.cafile = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] vendordata_dynamic_auth.certfile = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] vendordata_dynamic_auth.collect_timing = False {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] vendordata_dynamic_auth.insecure = False {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] vendordata_dynamic_auth.keyfile = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] vendordata_dynamic_auth.split_loggers = False {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] vendordata_dynamic_auth.timeout = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] vmware.api_retry_count         = 10 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] vmware.ca_file                 = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] vmware.cache_prefix            = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] vmware.cluster_name            = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] vmware.connection_pool_size    = 10 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] vmware.console_delay_seconds   = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] vmware.datastore_regex         = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] vmware.host_ip                 = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] vmware.host_password           = **** {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] vmware.host_port               = 443 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] vmware.host_username           = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] vmware.insecure                = False {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] vmware.integration_bridge      = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] vmware.maximum_objects         = 100 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] vmware.pbm_default_policy      = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] vmware.pbm_enabled             = False {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] vmware.pbm_wsdl_location       = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] vmware.serial_port_proxy_uri   = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] vmware.serial_port_service_uri = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] vmware.task_poll_interval      = 0.5 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] vmware.use_linked_clone        = True {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] vmware.vnc_keymap              = en-us {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] vmware.vnc_port                = 5900 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] vmware.vnc_port_total          = 10000 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] vnc.auth_schemes               = ['none'] {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] vnc.enabled                    = True {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] vnc.novncproxy_port            = 6080 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] vnc.server_listen              = 0.0.0.0 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] vnc.vencrypt_ca_certs          = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] vnc.vencrypt_client_cert       = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] vnc.vencrypt_client_key        = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] workarounds.disable_fallback_pcpu_query = False {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] workarounds.disable_group_policy_check_upcall = True {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] workarounds.disable_rootwrap   = False {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] workarounds.enable_numa_live_migration = False {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] workarounds.handle_virt_lifecycle_events = True {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] workarounds.libvirt_disable_apic = False {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] workarounds.never_download_image_if_on_rbd = False {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] wsgi.client_socket_timeout     = 900 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] wsgi.default_pool_size         = 1000 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] wsgi.keep_alive                = True {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] wsgi.max_header_line           = 16384 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] wsgi.secure_proxy_ssl_header   = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] wsgi.ssl_ca_file               = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] wsgi.ssl_cert_file             = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] wsgi.ssl_key_file              = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] wsgi.tcp_keepidle              = 600 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] zvm.ca_file                    = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] zvm.cloud_connector_url        = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] zvm.reachable_timeout          = 300 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] oslo_policy.enforce_new_defaults = True {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] oslo_policy.enforce_scope      = True {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] oslo_policy.policy_default_rule = default {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] oslo_policy.policy_file        = policy.yaml {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] profiler.connection_string     = messaging:// {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] profiler.enabled               = False {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] profiler.es_doc_type           = notification {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] profiler.es_scroll_size        = 10000 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] profiler.es_scroll_time        = 2m {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] profiler.filter_error_trace    = False {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] profiler.hmac_keys             = **** {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] profiler.sentinel_service_name = mymaster {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] profiler.socket_timeout        = 0.1 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] profiler.trace_requests        = False {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] profiler.trace_sqlalchemy      = False {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] profiler_jaeger.process_tags   = {} {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] profiler_jaeger.service_name_prefix = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] profiler_otlp.service_name_prefix = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] remote_debug.host              = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] remote_debug.port              = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] oslo_messaging_rabbit.ssl      = False {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] oslo_messaging_rabbit.ssl_version =  {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] oslo_messaging_notifications.retry = -1 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] oslo_messaging_notifications.transport_url = **** {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] oslo_limit.auth_section        = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] oslo_limit.auth_type           = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] oslo_limit.cafile              = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] oslo_limit.certfile            = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] oslo_limit.collect_timing      = False {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] oslo_limit.connect_retries     = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] oslo_limit.connect_retry_delay = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] oslo_limit.endpoint_id         = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] oslo_limit.endpoint_override   = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] oslo_limit.insecure            = False {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] oslo_limit.keyfile             = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] oslo_limit.max_version         = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] oslo_limit.min_version         = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] oslo_limit.region_name         = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] oslo_limit.service_name        = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] oslo_limit.service_type        = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] oslo_limit.split_loggers       = False {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] oslo_limit.status_code_retries = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] oslo_limit.status_code_retry_delay = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] oslo_limit.timeout             = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] oslo_limit.valid_interfaces    = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] oslo_limit.version             = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] oslo_reports.file_event_handler = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] oslo_reports.log_dir           = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] vif_plug_linux_bridge_privileged.group = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] vif_plug_linux_bridge_privileged.user = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] vif_plug_ovs_privileged.group  = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] vif_plug_ovs_privileged.helper_command = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] vif_plug_ovs_privileged.user   = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] os_vif_linux_bridge.flat_interface = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] os_vif_linux_bridge.vlan_interface = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] os_vif_ovs.default_qos_type    = linux-noop {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] os_vif_ovs.isolate_vif         = False {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] os_vif_ovs.ovsdb_interface     = native {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] os_vif_ovs.per_port_bridge     = False {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] os_brick.lock_path             = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] privsep_osbrick.capabilities   = [21] {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] privsep_osbrick.group          = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] privsep_osbrick.helper_command = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] privsep_osbrick.thread_pool_size = 12 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] privsep_osbrick.user           = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] nova_sys_admin.group           = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] nova_sys_admin.helper_command  = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] nova_sys_admin.thread_pool_size = 12 {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] nova_sys_admin.user            = None {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG oslo_service.service [None req-c5298bf8-0bb8-4b30-aa3c-a5a486e8adcf None None] ******************************************************************************** {{(pid=75122) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Nov 15 09:26:03 user nova-compute[75122]: INFO nova.service [-] Starting compute node (version 0.0.0)
Nov 15 09:26:03 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-e8ea3e7f-0f31-4ed5-bb91-0a8586257ac0 None None] Connecting to libvirt: qemu:///system {{(pid=75122) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:506}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-e8ea3e7f-0f31-4ed5-bb91-0a8586257ac0 None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7ffa0568afe0> {{(pid=75122) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:512}}
Nov 15 09:26:03 user nova-compute[75122]: libvirt:  error : internal error: could not initialize domain event timer
Nov 15 09:26:03 user nova-compute[75122]: WARNING nova.virt.libvirt.host [None req-e8ea3e7f-0f31-4ed5-bb91-0a8586257ac0 None None] URI qemu:///system does not support events: internal error: could not initialize domain event timer: libvirt.libvirtError: internal error: could not initialize domain event timer
Nov 15 09:26:03 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-e8ea3e7f-0f31-4ed5-bb91-0a8586257ac0 None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7ffa0568afe0> {{(pid=75122) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:533}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-e8ea3e7f-0f31-4ed5-bb91-0a8586257ac0 None None] Starting native event thread {{(pid=75122) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-e8ea3e7f-0f31-4ed5-bb91-0a8586257ac0 None None] Starting green dispatch thread {{(pid=75122) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Nov 15 09:26:03 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-e8ea3e7f-0f31-4ed5-bb91-0a8586257ac0 None None] Starting connection event dispatch thread {{(pid=75122) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:501}}
Nov 15 09:26:03 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-e8ea3e7f-0f31-4ed5-bb91-0a8586257ac0 None None] Connection event '1' reason 'None'
Nov 15 09:26:03 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-e8ea3e7f-0f31-4ed5-bb91-0a8586257ac0 None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 15 09:26:03 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.mount [None req-e8ea3e7f-0f31-4ed5-bb91-0a8586257ac0 None None] Initialising _HostMountState generation 0 {{(pid=75122) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Nov 15 09:26:10 user nova-compute[75122]: INFO nova.virt.libvirt.host [None req-e8ea3e7f-0f31-4ed5-bb91-0a8586257ac0 None None] Libvirt host capabilities <capabilities>
Nov 15 09:26:10 user nova-compute[75122]:   <host>
Nov 15 09:26:10 user nova-compute[75122]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Nov 15 09:26:10 user nova-compute[75122]:     <cpu>
Nov 15 09:26:10 user nova-compute[75122]:       <arch>x86_64</arch>
Nov 15 09:26:10 user nova-compute[75122]:       <model>IvyBridge-IBRS</model>
Nov 15 09:26:10 user nova-compute[75122]:       <vendor>Intel</vendor>
Nov 15 09:26:10 user nova-compute[75122]:       <microcode version='1070'/>
Nov 15 09:26:10 user nova-compute[75122]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Nov 15 09:26:10 user nova-compute[75122]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Nov 15 09:26:10 user nova-compute[75122]:       <feature name='ss'/>
Nov 15 09:26:10 user nova-compute[75122]:       <feature name='vmx'/>
Nov 15 09:26:10 user nova-compute[75122]:       <feature name='pcid'/>
Nov 15 09:26:10 user nova-compute[75122]:       <feature name='osxsave'/>
Nov 15 09:26:10 user nova-compute[75122]:       <feature name='hypervisor'/>
Nov 15 09:26:10 user nova-compute[75122]:       <feature name='arat'/>
Nov 15 09:26:10 user nova-compute[75122]:       <feature name='tsc_adjust'/>
Nov 15 09:26:10 user nova-compute[75122]:       <feature name='md-clear'/>
Nov 15 09:26:10 user nova-compute[75122]:       <feature name='stibp'/>
Nov 15 09:26:10 user nova-compute[75122]:       <feature name='arch-capabilities'/>
Nov 15 09:26:10 user nova-compute[75122]:       <feature name='ssbd'/>
Nov 15 09:26:10 user nova-compute[75122]:       <feature name='invtsc'/>
Nov 15 09:26:10 user nova-compute[75122]:       <feature name='rsba'/>
Nov 15 09:26:10 user nova-compute[75122]:       <feature name='skip-l1dfl-vmentry'/>
Nov 15 09:26:10 user nova-compute[75122]:       <pages unit='KiB' size='4'/>
Nov 15 09:26:10 user nova-compute[75122]:       <pages unit='KiB' size='2048'/>
Nov 15 09:26:10 user nova-compute[75122]:     </cpu>
Nov 15 09:26:10 user nova-compute[75122]:     <power_management>
Nov 15 09:26:10 user nova-compute[75122]:       <suspend_mem/>
Nov 15 09:26:10 user nova-compute[75122]:       <suspend_disk/>
Nov 15 09:26:10 user nova-compute[75122]:       <suspend_hybrid/>
Nov 15 09:26:10 user nova-compute[75122]:     </power_management>
Nov 15 09:26:10 user nova-compute[75122]:     <iommu support='no'/>
Nov 15 09:26:10 user nova-compute[75122]:     <migration_features>
Nov 15 09:26:10 user nova-compute[75122]:       <live/>
Nov 15 09:26:10 user nova-compute[75122]:       <uri_transports>
Nov 15 09:26:10 user nova-compute[75122]:         <uri_transport>tcp</uri_transport>
Nov 15 09:26:10 user nova-compute[75122]:         <uri_transport>rdma</uri_transport>
Nov 15 09:26:10 user nova-compute[75122]:       </uri_transports>
Nov 15 09:26:10 user nova-compute[75122]:     </migration_features>
Nov 15 09:26:10 user nova-compute[75122]:     <topology>
Nov 15 09:26:10 user nova-compute[75122]:       <cells num='2'>
Nov 15 09:26:10 user nova-compute[75122]:         <cell id='0'>
Nov 15 09:26:10 user nova-compute[75122]:           <memory unit='KiB'>8140616</memory>
Nov 15 09:26:10 user nova-compute[75122]:           <pages unit='KiB' size='4'>2035154</pages>
Nov 15 09:26:10 user nova-compute[75122]:           <pages unit='KiB' size='2048'>0</pages>
Nov 15 09:26:10 user nova-compute[75122]:           <distances>
Nov 15 09:26:10 user nova-compute[75122]:             <sibling id='0' value='10'/>
Nov 15 09:26:10 user nova-compute[75122]:             <sibling id='1' value='20'/>
Nov 15 09:26:10 user nova-compute[75122]:           </distances>
Nov 15 09:26:10 user nova-compute[75122]:           <cpus num='6'>
Nov 15 09:26:10 user nova-compute[75122]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Nov 15 09:26:10 user nova-compute[75122]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Nov 15 09:26:10 user nova-compute[75122]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Nov 15 09:26:10 user nova-compute[75122]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Nov 15 09:26:10 user nova-compute[75122]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Nov 15 09:26:10 user nova-compute[75122]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Nov 15 09:26:10 user nova-compute[75122]:           </cpus>
Nov 15 09:26:10 user nova-compute[75122]:         </cell>
Nov 15 09:26:10 user nova-compute[75122]:         <cell id='1'>
Nov 15 09:26:10 user nova-compute[75122]:           <memory unit='KiB'>8255100</memory>
Nov 15 09:26:10 user nova-compute[75122]:           <pages unit='KiB' size='4'>2063775</pages>
Nov 15 09:26:10 user nova-compute[75122]:           <pages unit='KiB' size='2048'>0</pages>
Nov 15 09:26:10 user nova-compute[75122]:           <distances>
Nov 15 09:26:10 user nova-compute[75122]:             <sibling id='0' value='20'/>
Nov 15 09:26:10 user nova-compute[75122]:             <sibling id='1' value='10'/>
Nov 15 09:26:10 user nova-compute[75122]:           </distances>
Nov 15 09:26:10 user nova-compute[75122]:           <cpus num='6'>
Nov 15 09:26:10 user nova-compute[75122]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Nov 15 09:26:10 user nova-compute[75122]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Nov 15 09:26:10 user nova-compute[75122]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Nov 15 09:26:10 user nova-compute[75122]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Nov 15 09:26:10 user nova-compute[75122]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Nov 15 09:26:10 user nova-compute[75122]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Nov 15 09:26:10 user nova-compute[75122]:           </cpus>
Nov 15 09:26:10 user nova-compute[75122]:         </cell>
Nov 15 09:26:10 user nova-compute[75122]:       </cells>
Nov 15 09:26:10 user nova-compute[75122]:     </topology>
Nov 15 09:26:10 user nova-compute[75122]:     <cache>
Nov 15 09:26:10 user nova-compute[75122]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Nov 15 09:26:10 user nova-compute[75122]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Nov 15 09:26:10 user nova-compute[75122]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Nov 15 09:26:10 user nova-compute[75122]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Nov 15 09:26:10 user nova-compute[75122]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Nov 15 09:26:10 user nova-compute[75122]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Nov 15 09:26:10 user nova-compute[75122]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Nov 15 09:26:10 user nova-compute[75122]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Nov 15 09:26:10 user nova-compute[75122]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Nov 15 09:26:10 user nova-compute[75122]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Nov 15 09:26:10 user nova-compute[75122]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Nov 15 09:26:10 user nova-compute[75122]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Nov 15 09:26:10 user nova-compute[75122]:     </cache>
Nov 15 09:26:10 user nova-compute[75122]:     <secmodel>
Nov 15 09:26:10 user nova-compute[75122]:       <model>apparmor</model>
Nov 15 09:26:10 user nova-compute[75122]:       <doi>0</doi>
Nov 15 09:26:10 user nova-compute[75122]:     </secmodel>
Nov 15 09:26:10 user nova-compute[75122]:     <secmodel>
Nov 15 09:26:10 user nova-compute[75122]:       <model>dac</model>
Nov 15 09:26:10 user nova-compute[75122]:       <doi>0</doi>
Nov 15 09:26:10 user nova-compute[75122]:       <baselabel type='kvm'>+64055:+108</baselabel>
Nov 15 09:26:10 user nova-compute[75122]:       <baselabel type='qemu'>+64055:+108</baselabel>
Nov 15 09:26:10 user nova-compute[75122]:     </secmodel>
Nov 15 09:26:10 user nova-compute[75122]:   </host>
Nov 15 09:26:10 user nova-compute[75122]:   <guest>
Nov 15 09:26:10 user nova-compute[75122]:     <os_type>hvm</os_type>
Nov 15 09:26:10 user nova-compute[75122]:     <arch name='alpha'>
Nov 15 09:26:10 user nova-compute[75122]:       <wordsize>64</wordsize>
Nov 15 09:26:10 user nova-compute[75122]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='4'>clipper</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <domain type='qemu'/>
Nov 15 09:26:10 user nova-compute[75122]:     </arch>
Nov 15 09:26:10 user nova-compute[75122]:     <features>
Nov 15 09:26:10 user nova-compute[75122]:       <cpuselection/>
Nov 15 09:26:10 user nova-compute[75122]:       <deviceboot/>
Nov 15 09:26:10 user nova-compute[75122]:       <disksnapshot default='on' toggle='no'/>
Nov 15 09:26:10 user nova-compute[75122]:     </features>
Nov 15 09:26:10 user nova-compute[75122]:   </guest>
Nov 15 09:26:10 user nova-compute[75122]:   <guest>
Nov 15 09:26:10 user nova-compute[75122]:     <os_type>hvm</os_type>
Nov 15 09:26:10 user nova-compute[75122]:     <arch name='armv6l'>
Nov 15 09:26:10 user nova-compute[75122]:       <wordsize>32</wordsize>
Nov 15 09:26:10 user nova-compute[75122]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>integratorcp</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>borzoi</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>spitz</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='2'>nuri</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='2'>musca-b1</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>versatileab</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>kzm</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='2'>musca-a</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='2'>smdkc210</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>sx1</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>z2</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>tosa</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='4'>sabrelite</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>realview-eb</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>n810</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>n800</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>versatilepb</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>terrier</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>mainstone</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='4'>midway</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>musicpal</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>microbit</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>cubieboard</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>verdex</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>netduino2</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='4'>raspi2b</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>cheetah</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='4'>highbank</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>akita</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>connex</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>collie</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>raspi0</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <domain type='qemu'/>
Nov 15 09:26:10 user nova-compute[75122]:     </arch>
Nov 15 09:26:10 user nova-compute[75122]:     <features>
Nov 15 09:26:10 user nova-compute[75122]:       <cpuselection/>
Nov 15 09:26:10 user nova-compute[75122]:       <deviceboot/>
Nov 15 09:26:10 user nova-compute[75122]:       <disksnapshot default='on' toggle='no'/>
Nov 15 09:26:10 user nova-compute[75122]:     </features>
Nov 15 09:26:10 user nova-compute[75122]:   </guest>
Nov 15 09:26:10 user nova-compute[75122]:   <guest>
Nov 15 09:26:10 user nova-compute[75122]:     <os_type>hvm</os_type>
Nov 15 09:26:10 user nova-compute[75122]:     <arch name='armv7l'>
Nov 15 09:26:10 user nova-compute[75122]:       <wordsize>32</wordsize>
Nov 15 09:26:10 user nova-compute[75122]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>integratorcp</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>borzoi</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>spitz</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='2'>nuri</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='2'>musca-b1</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>versatileab</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>kzm</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='2'>musca-a</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='2'>smdkc210</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>sx1</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>z2</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>tosa</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='4'>sabrelite</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>realview-eb</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>n810</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>n800</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>versatilepb</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>terrier</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>mainstone</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='4'>midway</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>musicpal</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>microbit</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>cubieboard</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>verdex</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>netduino2</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='4'>raspi2b</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>cheetah</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='4'>highbank</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>akita</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>connex</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>collie</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>raspi0</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <domain type='qemu'/>
Nov 15 09:26:10 user nova-compute[75122]:     </arch>
Nov 15 09:26:10 user nova-compute[75122]:     <features>
Nov 15 09:26:10 user nova-compute[75122]:       <cpuselection/>
Nov 15 09:26:10 user nova-compute[75122]:       <deviceboot/>
Nov 15 09:26:10 user nova-compute[75122]:       <disksnapshot default='on' toggle='no'/>
Nov 15 09:26:10 user nova-compute[75122]:     </features>
Nov 15 09:26:10 user nova-compute[75122]:   </guest>
Nov 15 09:26:10 user nova-compute[75122]:   <guest>
Nov 15 09:26:10 user nova-compute[75122]:     <os_type>hvm</os_type>
Nov 15 09:26:10 user nova-compute[75122]:     <arch name='aarch64'>
Nov 15 09:26:10 user nova-compute[75122]:       <wordsize>64</wordsize>
Nov 15 09:26:10 user nova-compute[75122]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>integratorcp</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>borzoi</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>spitz</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='2'>nuri</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='2'>musca-b1</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>versatileab</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>kzm</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='2'>musca-a</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='2'>smdkc210</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>sx1</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>z2</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>tosa</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='4'>sabrelite</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>realview-eb</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='512'>sbsa-ref</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>n810</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>n800</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>versatilepb</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>terrier</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>mainstone</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='4'>midway</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>musicpal</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>microbit</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='4'>raspi3ap</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>cubieboard</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>verdex</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>netduino2</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='4'>raspi3b</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='4'>raspi2b</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>cheetah</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='4'>highbank</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>akita</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>connex</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>collie</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>raspi0</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <domain type='qemu'/>
Nov 15 09:26:10 user nova-compute[75122]:     </arch>
Nov 15 09:26:10 user nova-compute[75122]:     <features>
Nov 15 09:26:10 user nova-compute[75122]:       <acpi default='on' toggle='yes'/>
Nov 15 09:26:10 user nova-compute[75122]:       <cpuselection/>
Nov 15 09:26:10 user nova-compute[75122]:       <deviceboot/>
Nov 15 09:26:10 user nova-compute[75122]:       <disksnapshot default='on' toggle='no'/>
Nov 15 09:26:10 user nova-compute[75122]:     </features>
Nov 15 09:26:10 user nova-compute[75122]:   </guest>
Nov 15 09:26:10 user nova-compute[75122]:   <guest>
Nov 15 09:26:10 user nova-compute[75122]:     <os_type>hvm</os_type>
Nov 15 09:26:10 user nova-compute[75122]:     <arch name='cris'>
Nov 15 09:26:10 user nova-compute[75122]:       <wordsize>32</wordsize>
Nov 15 09:26:10 user nova-compute[75122]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>axis-dev88</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <domain type='qemu'/>
Nov 15 09:26:10 user nova-compute[75122]:     </arch>
Nov 15 09:26:10 user nova-compute[75122]:     <features>
Nov 15 09:26:10 user nova-compute[75122]:       <cpuselection/>
Nov 15 09:26:10 user nova-compute[75122]:       <deviceboot/>
Nov 15 09:26:10 user nova-compute[75122]:       <disksnapshot default='on' toggle='no'/>
Nov 15 09:26:10 user nova-compute[75122]:     </features>
Nov 15 09:26:10 user nova-compute[75122]:   </guest>
Nov 15 09:26:10 user nova-compute[75122]:   <guest>
Nov 15 09:26:10 user nova-compute[75122]:     <os_type>hvm</os_type>
Nov 15 09:26:10 user nova-compute[75122]:     <arch name='i686'>
Nov 15 09:26:10 user nova-compute[75122]:       <wordsize>32</wordsize>
Nov 15 09:26:10 user nova-compute[75122]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>x-remote</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>isapc</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='288'>microvm</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <domain type='qemu'/>
Nov 15 09:26:10 user nova-compute[75122]:       <domain type='kvm'/>
Nov 15 09:26:10 user nova-compute[75122]:     </arch>
Nov 15 09:26:10 user nova-compute[75122]:     <features>
Nov 15 09:26:10 user nova-compute[75122]:       <pae/>
Nov 15 09:26:10 user nova-compute[75122]:       <nonpae/>
Nov 15 09:26:10 user nova-compute[75122]:       <acpi default='on' toggle='yes'/>
Nov 15 09:26:10 user nova-compute[75122]:       <apic default='on' toggle='no'/>
Nov 15 09:26:10 user nova-compute[75122]:       <cpuselection/>
Nov 15 09:26:10 user nova-compute[75122]:       <deviceboot/>
Nov 15 09:26:10 user nova-compute[75122]:       <disksnapshot default='on' toggle='no'/>
Nov 15 09:26:10 user nova-compute[75122]:     </features>
Nov 15 09:26:10 user nova-compute[75122]:   </guest>
Nov 15 09:26:10 user nova-compute[75122]:   <guest>
Nov 15 09:26:10 user nova-compute[75122]:     <os_type>hvm</os_type>
Nov 15 09:26:10 user nova-compute[75122]:     <arch name='m68k'>
Nov 15 09:26:10 user nova-compute[75122]:       <wordsize>32</wordsize>
Nov 15 09:26:10 user nova-compute[75122]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>mcf5208evb</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>an5206</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>virt-6.0</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>q800</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>virt-6.2</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>next-cube</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>virt-6.1</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <domain type='qemu'/>
Nov 15 09:26:10 user nova-compute[75122]:     </arch>
Nov 15 09:26:10 user nova-compute[75122]:     <features>
Nov 15 09:26:10 user nova-compute[75122]:       <cpuselection/>
Nov 15 09:26:10 user nova-compute[75122]:       <deviceboot/>
Nov 15 09:26:10 user nova-compute[75122]:       <disksnapshot default='on' toggle='no'/>
Nov 15 09:26:10 user nova-compute[75122]:     </features>
Nov 15 09:26:10 user nova-compute[75122]:   </guest>
Nov 15 09:26:10 user nova-compute[75122]:   <guest>
Nov 15 09:26:10 user nova-compute[75122]:     <os_type>hvm</os_type>
Nov 15 09:26:10 user nova-compute[75122]:     <arch name='microblaze'>
Nov 15 09:26:10 user nova-compute[75122]:       <wordsize>32</wordsize>
Nov 15 09:26:10 user nova-compute[75122]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <domain type='qemu'/>
Nov 15 09:26:10 user nova-compute[75122]:     </arch>
Nov 15 09:26:10 user nova-compute[75122]:     <features>
Nov 15 09:26:10 user nova-compute[75122]:       <cpuselection/>
Nov 15 09:26:10 user nova-compute[75122]:       <deviceboot/>
Nov 15 09:26:10 user nova-compute[75122]:       <disksnapshot default='on' toggle='no'/>
Nov 15 09:26:10 user nova-compute[75122]:     </features>
Nov 15 09:26:10 user nova-compute[75122]:   </guest>
Nov 15 09:26:10 user nova-compute[75122]:   <guest>
Nov 15 09:26:10 user nova-compute[75122]:     <os_type>hvm</os_type>
Nov 15 09:26:10 user nova-compute[75122]:     <arch name='microblazeel'>
Nov 15 09:26:10 user nova-compute[75122]:       <wordsize>32</wordsize>
Nov 15 09:26:10 user nova-compute[75122]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <domain type='qemu'/>
Nov 15 09:26:10 user nova-compute[75122]:     </arch>
Nov 15 09:26:10 user nova-compute[75122]:     <features>
Nov 15 09:26:10 user nova-compute[75122]:       <cpuselection/>
Nov 15 09:26:10 user nova-compute[75122]:       <deviceboot/>
Nov 15 09:26:10 user nova-compute[75122]:       <disksnapshot default='on' toggle='no'/>
Nov 15 09:26:10 user nova-compute[75122]:     </features>
Nov 15 09:26:10 user nova-compute[75122]:   </guest>
Nov 15 09:26:10 user nova-compute[75122]:   <guest>
Nov 15 09:26:10 user nova-compute[75122]:     <os_type>hvm</os_type>
Nov 15 09:26:10 user nova-compute[75122]:     <arch name='mips'>
Nov 15 09:26:10 user nova-compute[75122]:       <wordsize>32</wordsize>
Nov 15 09:26:10 user nova-compute[75122]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='16'>malta</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>mipssim</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <domain type='qemu'/>
Nov 15 09:26:10 user nova-compute[75122]:     </arch>
Nov 15 09:26:10 user nova-compute[75122]:     <features>
Nov 15 09:26:10 user nova-compute[75122]:       <cpuselection/>
Nov 15 09:26:10 user nova-compute[75122]:       <deviceboot/>
Nov 15 09:26:10 user nova-compute[75122]:       <disksnapshot default='on' toggle='no'/>
Nov 15 09:26:10 user nova-compute[75122]:     </features>
Nov 15 09:26:10 user nova-compute[75122]:   </guest>
Nov 15 09:26:10 user nova-compute[75122]:   <guest>
Nov 15 09:26:10 user nova-compute[75122]:     <os_type>hvm</os_type>
Nov 15 09:26:10 user nova-compute[75122]:     <arch name='mipsel'>
Nov 15 09:26:10 user nova-compute[75122]:       <wordsize>32</wordsize>
Nov 15 09:26:10 user nova-compute[75122]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='16'>malta</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>mipssim</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <domain type='qemu'/>
Nov 15 09:26:10 user nova-compute[75122]:     </arch>
Nov 15 09:26:10 user nova-compute[75122]:     <features>
Nov 15 09:26:10 user nova-compute[75122]:       <cpuselection/>
Nov 15 09:26:10 user nova-compute[75122]:       <deviceboot/>
Nov 15 09:26:10 user nova-compute[75122]:       <disksnapshot default='on' toggle='no'/>
Nov 15 09:26:10 user nova-compute[75122]:     </features>
Nov 15 09:26:10 user nova-compute[75122]:   </guest>
Nov 15 09:26:10 user nova-compute[75122]:   <guest>
Nov 15 09:26:10 user nova-compute[75122]:     <os_type>hvm</os_type>
Nov 15 09:26:10 user nova-compute[75122]:     <arch name='mips64'>
Nov 15 09:26:10 user nova-compute[75122]:       <wordsize>64</wordsize>
Nov 15 09:26:10 user nova-compute[75122]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='16'>malta</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>mipssim</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>pica61</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>magnum</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <domain type='qemu'/>
Nov 15 09:26:10 user nova-compute[75122]:     </arch>
Nov 15 09:26:10 user nova-compute[75122]:     <features>
Nov 15 09:26:10 user nova-compute[75122]:       <cpuselection/>
Nov 15 09:26:10 user nova-compute[75122]:       <deviceboot/>
Nov 15 09:26:10 user nova-compute[75122]:       <disksnapshot default='on' toggle='no'/>
Nov 15 09:26:10 user nova-compute[75122]:     </features>
Nov 15 09:26:10 user nova-compute[75122]:   </guest>
Nov 15 09:26:10 user nova-compute[75122]:   <guest>
Nov 15 09:26:10 user nova-compute[75122]:     <os_type>hvm</os_type>
Nov 15 09:26:10 user nova-compute[75122]:     <arch name='mips64el'>
Nov 15 09:26:10 user nova-compute[75122]:       <wordsize>64</wordsize>
Nov 15 09:26:10 user nova-compute[75122]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='16'>malta</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='16'>loongson3-virt</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>mipssim</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>pica61</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>magnum</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='16'>boston</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>fuloong2e</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <domain type='qemu'/>
Nov 15 09:26:10 user nova-compute[75122]:     </arch>
Nov 15 09:26:10 user nova-compute[75122]:     <features>
Nov 15 09:26:10 user nova-compute[75122]:       <cpuselection/>
Nov 15 09:26:10 user nova-compute[75122]:       <deviceboot/>
Nov 15 09:26:10 user nova-compute[75122]:       <disksnapshot default='on' toggle='no'/>
Nov 15 09:26:10 user nova-compute[75122]:     </features>
Nov 15 09:26:10 user nova-compute[75122]:   </guest>
Nov 15 09:26:10 user nova-compute[75122]:   <guest>
Nov 15 09:26:10 user nova-compute[75122]:     <os_type>hvm</os_type>
Nov 15 09:26:10 user nova-compute[75122]:     <arch name='ppc'>
Nov 15 09:26:10 user nova-compute[75122]:       <wordsize>32</wordsize>
Nov 15 09:26:10 user nova-compute[75122]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>g3beige</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>mac99</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='32'>ppce500</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>pegasos2</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>sam460ex</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>bamboo</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>40p</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>ref405ep</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>taihu</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <domain type='qemu'/>
Nov 15 09:26:10 user nova-compute[75122]:     </arch>
Nov 15 09:26:10 user nova-compute[75122]:     <features>
Nov 15 09:26:10 user nova-compute[75122]:       <cpuselection/>
Nov 15 09:26:10 user nova-compute[75122]:       <deviceboot/>
Nov 15 09:26:10 user nova-compute[75122]:       <disksnapshot default='on' toggle='no'/>
Nov 15 09:26:10 user nova-compute[75122]:     </features>
Nov 15 09:26:10 user nova-compute[75122]:   </guest>
Nov 15 09:26:10 user nova-compute[75122]:   <guest>
Nov 15 09:26:10 user nova-compute[75122]:     <os_type>hvm</os_type>
Nov 15 09:26:10 user nova-compute[75122]:     <arch name='ppc64'>
Nov 15 09:26:10 user nova-compute[75122]:       <wordsize>64</wordsize>
Nov 15 09:26:10 user nova-compute[75122]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='2048'>powernv9</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>taihu</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='2048'>powernv10</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='32'>ppce500</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>40p</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>pegasos2</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>bamboo</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>g3beige</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>mac99</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>sam460ex</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>ref405ep</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='2048'>powernv8</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <domain type='qemu'/>
Nov 15 09:26:10 user nova-compute[75122]:     </arch>
Nov 15 09:26:10 user nova-compute[75122]:     <features>
Nov 15 09:26:10 user nova-compute[75122]:       <cpuselection/>
Nov 15 09:26:10 user nova-compute[75122]:       <deviceboot/>
Nov 15 09:26:10 user nova-compute[75122]:       <disksnapshot default='on' toggle='no'/>
Nov 15 09:26:10 user nova-compute[75122]:     </features>
Nov 15 09:26:10 user nova-compute[75122]:   </guest>
Nov 15 09:26:10 user nova-compute[75122]:   <guest>
Nov 15 09:26:10 user nova-compute[75122]:     <os_type>hvm</os_type>
Nov 15 09:26:10 user nova-compute[75122]:     <arch name='ppc64le'>
Nov 15 09:26:10 user nova-compute[75122]:       <wordsize>64</wordsize>
Nov 15 09:26:10 user nova-compute[75122]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='2048'>powernv9</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>taihu</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='2048'>powernv10</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='32'>ppce500</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>40p</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>pegasos2</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>bamboo</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>g3beige</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>mac99</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>sam460ex</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>ref405ep</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='2048'>powernv8</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <domain type='qemu'/>
Nov 15 09:26:10 user nova-compute[75122]:     </arch>
Nov 15 09:26:10 user nova-compute[75122]:     <features>
Nov 15 09:26:10 user nova-compute[75122]:       <cpuselection/>
Nov 15 09:26:10 user nova-compute[75122]:       <deviceboot/>
Nov 15 09:26:10 user nova-compute[75122]:       <disksnapshot default='on' toggle='no'/>
Nov 15 09:26:10 user nova-compute[75122]:     </features>
Nov 15 09:26:10 user nova-compute[75122]:   </guest>
Nov 15 09:26:10 user nova-compute[75122]:   <guest>
Nov 15 09:26:10 user nova-compute[75122]:     <os_type>hvm</os_type>
Nov 15 09:26:10 user nova-compute[75122]:     <arch name='riscv32'>
Nov 15 09:26:10 user nova-compute[75122]:       <wordsize>32</wordsize>
Nov 15 09:26:10 user nova-compute[75122]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='8'>spike</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>opentitan</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='5'>sifive_u</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>sifive_e</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='8'>virt</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <domain type='qemu'/>
Nov 15 09:26:10 user nova-compute[75122]:     </arch>
Nov 15 09:26:10 user nova-compute[75122]:     <features>
Nov 15 09:26:10 user nova-compute[75122]:       <cpuselection/>
Nov 15 09:26:10 user nova-compute[75122]:       <deviceboot/>
Nov 15 09:26:10 user nova-compute[75122]:       <disksnapshot default='on' toggle='no'/>
Nov 15 09:26:10 user nova-compute[75122]:     </features>
Nov 15 09:26:10 user nova-compute[75122]:   </guest>
Nov 15 09:26:10 user nova-compute[75122]:   <guest>
Nov 15 09:26:10 user nova-compute[75122]:     <os_type>hvm</os_type>
Nov 15 09:26:10 user nova-compute[75122]:     <arch name='riscv64'>
Nov 15 09:26:10 user nova-compute[75122]:       <wordsize>64</wordsize>
Nov 15 09:26:10 user nova-compute[75122]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='8'>spike</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='5'>sifive_u</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>shakti_c</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>sifive_e</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='8'>virt</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <domain type='qemu'/>
Nov 15 09:26:10 user nova-compute[75122]:     </arch>
Nov 15 09:26:10 user nova-compute[75122]:     <features>
Nov 15 09:26:10 user nova-compute[75122]:       <cpuselection/>
Nov 15 09:26:10 user nova-compute[75122]:       <deviceboot/>
Nov 15 09:26:10 user nova-compute[75122]:       <disksnapshot default='on' toggle='no'/>
Nov 15 09:26:10 user nova-compute[75122]:     </features>
Nov 15 09:26:10 user nova-compute[75122]:   </guest>
Nov 15 09:26:10 user nova-compute[75122]:   <guest>
Nov 15 09:26:10 user nova-compute[75122]:     <os_type>hvm</os_type>
Nov 15 09:26:10 user nova-compute[75122]:     <arch name='s390x'>
Nov 15 09:26:10 user nova-compute[75122]:       <wordsize>64</wordsize>
Nov 15 09:26:10 user nova-compute[75122]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <domain type='qemu'/>
Nov 15 09:26:10 user nova-compute[75122]:     </arch>
Nov 15 09:26:10 user nova-compute[75122]:     <features>
Nov 15 09:26:10 user nova-compute[75122]:       <cpuselection/>
Nov 15 09:26:10 user nova-compute[75122]:       <deviceboot/>
Nov 15 09:26:10 user nova-compute[75122]:       <disksnapshot default='on' toggle='no'/>
Nov 15 09:26:10 user nova-compute[75122]:     </features>
Nov 15 09:26:10 user nova-compute[75122]:   </guest>
Nov 15 09:26:10 user nova-compute[75122]:   <guest>
Nov 15 09:26:10 user nova-compute[75122]:     <os_type>hvm</os_type>
Nov 15 09:26:10 user nova-compute[75122]:     <arch name='sh4'>
Nov 15 09:26:10 user nova-compute[75122]:       <wordsize>32</wordsize>
Nov 15 09:26:10 user nova-compute[75122]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>shix</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>r2d</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <domain type='qemu'/>
Nov 15 09:26:10 user nova-compute[75122]:     </arch>
Nov 15 09:26:10 user nova-compute[75122]:     <features>
Nov 15 09:26:10 user nova-compute[75122]:       <cpuselection/>
Nov 15 09:26:10 user nova-compute[75122]:       <deviceboot/>
Nov 15 09:26:10 user nova-compute[75122]:       <disksnapshot default='on' toggle='no'/>
Nov 15 09:26:10 user nova-compute[75122]:     </features>
Nov 15 09:26:10 user nova-compute[75122]:   </guest>
Nov 15 09:26:10 user nova-compute[75122]:   <guest>
Nov 15 09:26:10 user nova-compute[75122]:     <os_type>hvm</os_type>
Nov 15 09:26:10 user nova-compute[75122]:     <arch name='sh4eb'>
Nov 15 09:26:10 user nova-compute[75122]:       <wordsize>64</wordsize>
Nov 15 09:26:10 user nova-compute[75122]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>shix</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>r2d</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <domain type='qemu'/>
Nov 15 09:26:10 user nova-compute[75122]:     </arch>
Nov 15 09:26:10 user nova-compute[75122]:     <features>
Nov 15 09:26:10 user nova-compute[75122]:       <cpuselection/>
Nov 15 09:26:10 user nova-compute[75122]:       <deviceboot/>
Nov 15 09:26:10 user nova-compute[75122]:       <disksnapshot default='on' toggle='no'/>
Nov 15 09:26:10 user nova-compute[75122]:     </features>
Nov 15 09:26:10 user nova-compute[75122]:   </guest>
Nov 15 09:26:10 user nova-compute[75122]:   <guest>
Nov 15 09:26:10 user nova-compute[75122]:     <os_type>hvm</os_type>
Nov 15 09:26:10 user nova-compute[75122]:     <arch name='sparc'>
Nov 15 09:26:10 user nova-compute[75122]:       <wordsize>32</wordsize>
Nov 15 09:26:10 user nova-compute[75122]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>SS-5</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='4'>SS-20</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>LX</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>SPARCClassic</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>leon3_generic</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>SPARCbook</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>SS-4</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='4'>SS-600MP</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='4'>SS-10</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>Voyager</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <domain type='qemu'/>
Nov 15 09:26:10 user nova-compute[75122]:     </arch>
Nov 15 09:26:10 user nova-compute[75122]:     <features>
Nov 15 09:26:10 user nova-compute[75122]:       <cpuselection/>
Nov 15 09:26:10 user nova-compute[75122]:       <deviceboot/>
Nov 15 09:26:10 user nova-compute[75122]:       <disksnapshot default='on' toggle='no'/>
Nov 15 09:26:10 user nova-compute[75122]:     </features>
Nov 15 09:26:10 user nova-compute[75122]:   </guest>
Nov 15 09:26:10 user nova-compute[75122]:   <guest>
Nov 15 09:26:10 user nova-compute[75122]:     <os_type>hvm</os_type>
Nov 15 09:26:10 user nova-compute[75122]:     <arch name='sparc64'>
Nov 15 09:26:10 user nova-compute[75122]:       <wordsize>64</wordsize>
Nov 15 09:26:10 user nova-compute[75122]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>sun4u</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>niagara</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>sun4v</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <domain type='qemu'/>
Nov 15 09:26:10 user nova-compute[75122]:     </arch>
Nov 15 09:26:10 user nova-compute[75122]:     <features>
Nov 15 09:26:10 user nova-compute[75122]:       <cpuselection/>
Nov 15 09:26:10 user nova-compute[75122]:       <deviceboot/>
Nov 15 09:26:10 user nova-compute[75122]:       <disksnapshot default='on' toggle='no'/>
Nov 15 09:26:10 user nova-compute[75122]:     </features>
Nov 15 09:26:10 user nova-compute[75122]:   </guest>
Nov 15 09:26:10 user nova-compute[75122]:   <guest>
Nov 15 09:26:10 user nova-compute[75122]:     <os_type>hvm</os_type>
Nov 15 09:26:10 user nova-compute[75122]:     <arch name='x86_64'>
Nov 15 09:26:10 user nova-compute[75122]:       <wordsize>64</wordsize>
Nov 15 09:26:10 user nova-compute[75122]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>x-remote</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='1'>isapc</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='288'>microvm</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <domain type='qemu'/>
Nov 15 09:26:10 user nova-compute[75122]:       <domain type='kvm'/>
Nov 15 09:26:10 user nova-compute[75122]:     </arch>
Nov 15 09:26:10 user nova-compute[75122]:     <features>
Nov 15 09:26:10 user nova-compute[75122]:       <acpi default='on' toggle='yes'/>
Nov 15 09:26:10 user nova-compute[75122]:       <apic default='on' toggle='no'/>
Nov 15 09:26:10 user nova-compute[75122]:       <cpuselection/>
Nov 15 09:26:10 user nova-compute[75122]:       <deviceboot/>
Nov 15 09:26:10 user nova-compute[75122]:       <disksnapshot default='on' toggle='no'/>
Nov 15 09:26:10 user nova-compute[75122]:     </features>
Nov 15 09:26:10 user nova-compute[75122]:   </guest>
Nov 15 09:26:10 user nova-compute[75122]:   <guest>
Nov 15 09:26:10 user nova-compute[75122]:     <os_type>hvm</os_type>
Nov 15 09:26:10 user nova-compute[75122]:     <arch name='xtensa'>
Nov 15 09:26:10 user nova-compute[75122]:       <wordsize>32</wordsize>
Nov 15 09:26:10 user nova-compute[75122]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='4'>sim</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='32'>kc705</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='32'>ml605</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='32'>virt</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='32'>lx200</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='32'>lx60</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <domain type='qemu'/>
Nov 15 09:26:10 user nova-compute[75122]:     </arch>
Nov 15 09:26:10 user nova-compute[75122]:     <features>
Nov 15 09:26:10 user nova-compute[75122]:       <cpuselection/>
Nov 15 09:26:10 user nova-compute[75122]:       <deviceboot/>
Nov 15 09:26:10 user nova-compute[75122]:       <disksnapshot default='on' toggle='no'/>
Nov 15 09:26:10 user nova-compute[75122]:     </features>
Nov 15 09:26:10 user nova-compute[75122]:   </guest>
Nov 15 09:26:10 user nova-compute[75122]:   <guest>
Nov 15 09:26:10 user nova-compute[75122]:     <os_type>hvm</os_type>
Nov 15 09:26:10 user nova-compute[75122]:     <arch name='xtensaeb'>
Nov 15 09:26:10 user nova-compute[75122]:       <wordsize>32</wordsize>
Nov 15 09:26:10 user nova-compute[75122]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='4'>sim</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='32'>kc705</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='32'>ml605</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='32'>virt</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='32'>lx200</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='32'>lx60</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 15 09:26:10 user nova-compute[75122]:       <domain type='qemu'/>
Nov 15 09:26:10 user nova-compute[75122]:     </arch>
Nov 15 09:26:10 user nova-compute[75122]:     <features>
Nov 15 09:26:10 user nova-compute[75122]:       <cpuselection/>
Nov 15 09:26:10 user nova-compute[75122]:       <deviceboot/>
Nov 15 09:26:10 user nova-compute[75122]:       <disksnapshot default='on' toggle='no'/>
Nov 15 09:26:10 user nova-compute[75122]:     </features>
Nov 15 09:26:10 user nova-compute[75122]:   </guest>
Nov 15 09:26:10 user nova-compute[75122]: </capabilities>
Nov 15 09:26:10 user nova-compute[75122]: 
Nov 15 09:26:10 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-e8ea3e7f-0f31-4ed5-bb91-0a8586257ac0 None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=75122) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 09:26:10 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-e8ea3e7f-0f31-4ed5-bb91-0a8586257ac0 None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=75122) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 09:26:10 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-e8ea3e7f-0f31-4ed5-bb91-0a8586257ac0 None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=75122) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 09:26:10 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-e8ea3e7f-0f31-4ed5-bb91-0a8586257ac0 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75122) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 09:26:10 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-e8ea3e7f-0f31-4ed5-bb91-0a8586257ac0 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75122) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 09:26:10 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-e8ea3e7f-0f31-4ed5-bb91-0a8586257ac0 None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=75122) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 09:26:10 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-e8ea3e7f-0f31-4ed5-bb91-0a8586257ac0 None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75122) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 09:26:10 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-e8ea3e7f-0f31-4ed5-bb91-0a8586257ac0 None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=75122) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 09:26:10 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-e8ea3e7f-0f31-4ed5-bb91-0a8586257ac0 None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=75122) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 09:26:10 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-e8ea3e7f-0f31-4ed5-bb91-0a8586257ac0 None None] Getting domain capabilities for cris via machine types: {None} {{(pid=75122) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 09:26:10 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-e8ea3e7f-0f31-4ed5-bb91-0a8586257ac0 None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=75122) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 09:26:10 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-e8ea3e7f-0f31-4ed5-bb91-0a8586257ac0 None None] Getting domain capabilities for i686 via machine types: {'pc', 'ubuntu', 'ubuntu-q35', 'q35'} {{(pid=75122) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 09:26:10 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-e8ea3e7f-0f31-4ed5-bb91-0a8586257ac0 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Nov 15 09:26:10 user nova-compute[75122]: <domainCapabilities>
Nov 15 09:26:10 user nova-compute[75122]:   <path>/usr/bin/qemu-system-i386</path>
Nov 15 09:26:10 user nova-compute[75122]:   <domain>kvm</domain>
Nov 15 09:26:10 user nova-compute[75122]:   <machine>pc-i440fx-6.2</machine>
Nov 15 09:26:10 user nova-compute[75122]:   <arch>i686</arch>
Nov 15 09:26:10 user nova-compute[75122]:   <vcpu max='255'/>
Nov 15 09:26:10 user nova-compute[75122]:   <iothreads supported='yes'/>
Nov 15 09:26:10 user nova-compute[75122]:   <os supported='yes'>
Nov 15 09:26:10 user nova-compute[75122]:     <enum name='firmware'/>
Nov 15 09:26:10 user nova-compute[75122]:     <loader supported='yes'>
Nov 15 09:26:10 user nova-compute[75122]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 15 09:26:10 user nova-compute[75122]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 15 09:26:10 user nova-compute[75122]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 15 09:26:10 user nova-compute[75122]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 15 09:26:10 user nova-compute[75122]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 15 09:26:10 user nova-compute[75122]:       <enum name='type'>
Nov 15 09:26:10 user nova-compute[75122]:         <value>rom</value>
Nov 15 09:26:10 user nova-compute[75122]:         <value>pflash</value>
Nov 15 09:26:10 user nova-compute[75122]:       </enum>
Nov 15 09:26:10 user nova-compute[75122]:       <enum name='readonly'>
Nov 15 09:26:10 user nova-compute[75122]:         <value>yes</value>
Nov 15 09:26:10 user nova-compute[75122]:         <value>no</value>
Nov 15 09:26:10 user nova-compute[75122]:       </enum>
Nov 15 09:26:10 user nova-compute[75122]:       <enum name='secure'>
Nov 15 09:26:10 user nova-compute[75122]:         <value>no</value>
Nov 15 09:26:10 user nova-compute[75122]:       </enum>
Nov 15 09:26:10 user nova-compute[75122]:     </loader>
Nov 15 09:26:10 user nova-compute[75122]:   </os>
Nov 15 09:26:10 user nova-compute[75122]:   <cpu>
Nov 15 09:26:10 user nova-compute[75122]:     <mode name='host-passthrough' supported='yes'>
Nov 15 09:26:10 user nova-compute[75122]:       <enum name='hostPassthroughMigratable'>
Nov 15 09:26:10 user nova-compute[75122]:         <value>off</value>
Nov 15 09:26:10 user nova-compute[75122]:       </enum>
Nov 15 09:26:10 user nova-compute[75122]:     </mode>
Nov 15 09:26:10 user nova-compute[75122]:     <mode name='maximum' supported='yes'>
Nov 15 09:26:10 user nova-compute[75122]:       <enum name='maximumMigratable'>
Nov 15 09:26:10 user nova-compute[75122]:         <value>on</value>
Nov 15 09:26:10 user nova-compute[75122]:         <value>off</value>
Nov 15 09:26:10 user nova-compute[75122]:       </enum>
Nov 15 09:26:10 user nova-compute[75122]:     </mode>
Nov 15 09:26:10 user nova-compute[75122]:     <mode name='host-model' supported='yes'>
Nov 15 09:26:10 user nova-compute[75122]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 15 09:26:10 user nova-compute[75122]:       <vendor>Intel</vendor>
Nov 15 09:26:10 user nova-compute[75122]:       <feature policy='require' name='ss'/>
Nov 15 09:26:10 user nova-compute[75122]:       <feature policy='require' name='vmx'/>
Nov 15 09:26:10 user nova-compute[75122]:       <feature policy='require' name='pcid'/>
Nov 15 09:26:10 user nova-compute[75122]:       <feature policy='require' name='hypervisor'/>
Nov 15 09:26:10 user nova-compute[75122]:       <feature policy='require' name='arat'/>
Nov 15 09:26:10 user nova-compute[75122]:       <feature policy='require' name='tsc_adjust'/>
Nov 15 09:26:10 user nova-compute[75122]:       <feature policy='require' name='umip'/>
Nov 15 09:26:10 user nova-compute[75122]:       <feature policy='require' name='md-clear'/>
Nov 15 09:26:10 user nova-compute[75122]:       <feature policy='require' name='stibp'/>
Nov 15 09:26:10 user nova-compute[75122]:       <feature policy='require' name='arch-capabilities'/>
Nov 15 09:26:10 user nova-compute[75122]:       <feature policy='require' name='ssbd'/>
Nov 15 09:26:10 user nova-compute[75122]:       <feature policy='require' name='ibpb'/>
Nov 15 09:26:10 user nova-compute[75122]:       <feature policy='require' name='ibrs'/>
Nov 15 09:26:10 user nova-compute[75122]:       <feature policy='require' name='amd-stibp'/>
Nov 15 09:26:10 user nova-compute[75122]:       <feature policy='require' name='amd-ssbd'/>
Nov 15 09:26:10 user nova-compute[75122]:       <feature policy='disable' name='erms'/>
Nov 15 09:26:10 user nova-compute[75122]:       <feature policy='disable' name='xsaveopt'/>
Nov 15 09:26:10 user nova-compute[75122]:       <feature policy='disable' name='lm'/>
Nov 15 09:26:10 user nova-compute[75122]:     </mode>
Nov 15 09:26:10 user nova-compute[75122]:     <mode name='custom' supported='yes'>
Nov 15 09:26:10 user nova-compute[75122]:       <model usable='no'>qemu64</model>
Nov 15 09:26:10 user nova-compute[75122]:       <model usable='yes'>qemu32</model>
Nov 15 09:26:10 user nova-compute[75122]:       <model usable='no'>phenom</model>
Nov 15 09:26:10 user nova-compute[75122]:       <model usable='yes'>pentium3</model>
Nov 15 09:26:10 user nova-compute[75122]:       <model usable='yes'>pentium2</model>
Nov 15 09:26:10 user nova-compute[75122]:       <model usable='yes'>pentium</model>
Nov 15 09:26:10 user nova-compute[75122]:       <model usable='no'>n270</model>
Nov 15 09:26:10 user nova-compute[75122]:       <model usable='no'>kvm64</model>
Nov 15 09:26:10 user nova-compute[75122]:       <model usable='yes'>kvm32</model>
Nov 15 09:26:10 user nova-compute[75122]:       <model usable='yes'>coreduo</model>
Nov 15 09:26:10 user nova-compute[75122]:       <model usable='no'>core2duo</model>
Nov 15 09:26:10 user nova-compute[75122]:       <model usable='no'>athlon</model>
Nov 15 09:26:10 user nova-compute[75122]:       <model usable='no'>Westmere-IBRS</model>
Nov 15 09:26:10 user nova-compute[75122]:       <model usable='no'>Westmere</model>
Nov 15 09:26:10 user nova-compute[75122]:       <model usable='no'>Snowridge</model>
Nov 15 09:26:10 user nova-compute[75122]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 15 09:26:10 user nova-compute[75122]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 15 09:26:10 user nova-compute[75122]:       <model usable='no'>Skylake-Server</model>
Nov 15 09:26:10 user nova-compute[75122]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 15 09:26:10 user nova-compute[75122]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 15 09:26:10 user nova-compute[75122]:       <model usable='no'>Skylake-Client</model>
Nov 15 09:26:10 user nova-compute[75122]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 15 09:26:10 user nova-compute[75122]:       <model usable='no'>SandyBridge</model>
Nov 15 09:26:10 user nova-compute[75122]:       <model usable='no'>Penryn</model>
Nov 15 09:26:10 user nova-compute[75122]:       <model usable='no'>Opteron_G5</model>
Nov 15 09:26:10 user nova-compute[75122]:       <model usable='no'>Opteron_G4</model>
Nov 15 09:26:10 user nova-compute[75122]:       <model usable='no'>Opteron_G3</model>
Nov 15 09:26:10 user nova-compute[75122]:       <model usable='no'>Opteron_G2</model>
Nov 15 09:26:10 user nova-compute[75122]:       <model usable='no'>Opteron_G1</model>
Nov 15 09:26:10 user nova-compute[75122]:       <model usable='no'>Nehalem-IBRS</model>
Nov 15 09:26:10 user nova-compute[75122]:       <model usable='no'>Nehalem</model>
Nov 15 09:26:10 user nova-compute[75122]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 15 09:26:10 user nova-compute[75122]:       <model usable='no'>IvyBridge</model>
Nov 15 09:26:10 user nova-compute[75122]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 15 09:26:10 user nova-compute[75122]:       <model usable='no'>Icelake-Server</model>
Nov 15 09:26:10 user nova-compute[75122]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 15 09:26:10 user nova-compute[75122]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 15 09:26:10 user nova-compute[75122]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 15 09:26:10 user nova-compute[75122]:       <model usable='no'>Haswell-noTSX</model>
Nov 15 09:26:10 user nova-compute[75122]:       <model usable='no'>Haswell-IBRS</model>
Nov 15 09:26:10 user nova-compute[75122]:       <model usable='no'>Haswell</model>
Nov 15 09:26:10 user nova-compute[75122]:       <model usable='no'>EPYC-Rome</model>
Nov 15 09:26:10 user nova-compute[75122]:       <model usable='no'>EPYC-Milan</model>
Nov 15 09:26:10 user nova-compute[75122]:       <model usable='no'>EPYC-IBPB</model>
Nov 15 09:26:10 user nova-compute[75122]:       <model usable='no'>EPYC</model>
Nov 15 09:26:10 user nova-compute[75122]:       <model usable='no'>Dhyana</model>
Nov 15 09:26:10 user nova-compute[75122]:       <model usable='no'>Cooperlake</model>
Nov 15 09:26:10 user nova-compute[75122]:       <model usable='no'>Conroe</model>
Nov 15 09:26:10 user nova-compute[75122]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 15 09:26:10 user nova-compute[75122]:       <model usable='no'>Cascadelake-Server</model>
Nov 15 09:26:10 user nova-compute[75122]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 15 09:26:10 user nova-compute[75122]:       <model usable='no'>Broadwell-noTSX</model>
Nov 15 09:26:10 user nova-compute[75122]:       <model usable='no'>Broadwell-IBRS</model>
Nov 15 09:26:10 user nova-compute[75122]:       <model usable='no'>Broadwell</model>
Nov 15 09:26:10 user nova-compute[75122]:       <model usable='yes'>486</model>
Nov 15 09:26:10 user nova-compute[75122]:     </mode>
Nov 15 09:26:10 user nova-compute[75122]:   </cpu>
Nov 15 09:26:10 user nova-compute[75122]:   <memoryBacking supported='yes'>
Nov 15 09:26:10 user nova-compute[75122]:     <enum name='sourceType'>
Nov 15 09:26:10 user nova-compute[75122]:       <value>file</value>
Nov 15 09:26:10 user nova-compute[75122]:       <value>anonymous</value>
Nov 15 09:26:10 user nova-compute[75122]:       <value>memfd</value>
Nov 15 09:26:10 user nova-compute[75122]:     </enum>
Nov 15 09:26:10 user nova-compute[75122]:   </memoryBacking>
Nov 15 09:26:10 user nova-compute[75122]:   <devices>
Nov 15 09:26:10 user nova-compute[75122]:     <disk supported='yes'>
Nov 15 09:26:10 user nova-compute[75122]:       <enum name='diskDevice'>
Nov 15 09:26:10 user nova-compute[75122]:         <value>disk</value>
Nov 15 09:26:10 user nova-compute[75122]:         <value>cdrom</value>
Nov 15 09:26:10 user nova-compute[75122]:         <value>floppy</value>
Nov 15 09:26:10 user nova-compute[75122]:         <value>lun</value>
Nov 15 09:26:10 user nova-compute[75122]:       </enum>
Nov 15 09:26:10 user nova-compute[75122]:       <enum name='bus'>
Nov 15 09:26:10 user nova-compute[75122]:         <value>ide</value>
Nov 15 09:26:10 user nova-compute[75122]:         <value>fdc</value>
Nov 15 09:26:10 user nova-compute[75122]:         <value>scsi</value>
Nov 15 09:26:10 user nova-compute[75122]:         <value>virtio</value>
Nov 15 09:26:10 user nova-compute[75122]:         <value>usb</value>
Nov 15 09:26:10 user nova-compute[75122]:         <value>sata</value>
Nov 15 09:26:10 user nova-compute[75122]:       </enum>
Nov 15 09:26:10 user nova-compute[75122]:       <enum name='model'>
Nov 15 09:26:10 user nova-compute[75122]:         <value>virtio</value>
Nov 15 09:26:10 user nova-compute[75122]:         <value>virtio-transitional</value>
Nov 15 09:26:10 user nova-compute[75122]:         <value>virtio-non-transitional</value>
Nov 15 09:26:10 user nova-compute[75122]:       </enum>
Nov 15 09:26:10 user nova-compute[75122]:     </disk>
Nov 15 09:26:10 user nova-compute[75122]:     <graphics supported='yes'>
Nov 15 09:26:10 user nova-compute[75122]:       <enum name='type'>
Nov 15 09:26:10 user nova-compute[75122]:         <value>sdl</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>vnc</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>spice</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>egl-headless</value>
Nov 15 09:26:11 user nova-compute[75122]:       </enum>
Nov 15 09:26:11 user nova-compute[75122]:     </graphics>
Nov 15 09:26:11 user nova-compute[75122]:     <video supported='yes'>
Nov 15 09:26:11 user nova-compute[75122]:       <enum name='modelType'>
Nov 15 09:26:11 user nova-compute[75122]:         <value>vga</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>cirrus</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>vmvga</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>qxl</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>virtio</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>none</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>bochs</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>ramfb</value>
Nov 15 09:26:11 user nova-compute[75122]:       </enum>
Nov 15 09:26:11 user nova-compute[75122]:     </video>
Nov 15 09:26:11 user nova-compute[75122]:     <hostdev supported='yes'>
Nov 15 09:26:11 user nova-compute[75122]:       <enum name='mode'>
Nov 15 09:26:11 user nova-compute[75122]:         <value>subsystem</value>
Nov 15 09:26:11 user nova-compute[75122]:       </enum>
Nov 15 09:26:11 user nova-compute[75122]:       <enum name='startupPolicy'>
Nov 15 09:26:11 user nova-compute[75122]:         <value>default</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>mandatory</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>requisite</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>optional</value>
Nov 15 09:26:11 user nova-compute[75122]:       </enum>
Nov 15 09:26:11 user nova-compute[75122]:       <enum name='subsysType'>
Nov 15 09:26:11 user nova-compute[75122]:         <value>usb</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>pci</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>scsi</value>
Nov 15 09:26:11 user nova-compute[75122]:       </enum>
Nov 15 09:26:11 user nova-compute[75122]:       <enum name='capsType'/>
Nov 15 09:26:11 user nova-compute[75122]:       <enum name='pciBackend'/>
Nov 15 09:26:11 user nova-compute[75122]:     </hostdev>
Nov 15 09:26:11 user nova-compute[75122]:     <rng supported='yes'>
Nov 15 09:26:11 user nova-compute[75122]:       <enum name='model'>
Nov 15 09:26:11 user nova-compute[75122]:         <value>virtio</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>virtio-transitional</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>virtio-non-transitional</value>
Nov 15 09:26:11 user nova-compute[75122]:       </enum>
Nov 15 09:26:11 user nova-compute[75122]:       <enum name='backendModel'>
Nov 15 09:26:11 user nova-compute[75122]:         <value>random</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>egd</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>builtin</value>
Nov 15 09:26:11 user nova-compute[75122]:       </enum>
Nov 15 09:26:11 user nova-compute[75122]:     </rng>
Nov 15 09:26:11 user nova-compute[75122]:     <filesystem supported='yes'>
Nov 15 09:26:11 user nova-compute[75122]:       <enum name='driverType'>
Nov 15 09:26:11 user nova-compute[75122]:         <value>path</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>handle</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>virtiofs</value>
Nov 15 09:26:11 user nova-compute[75122]:       </enum>
Nov 15 09:26:11 user nova-compute[75122]:     </filesystem>
Nov 15 09:26:11 user nova-compute[75122]:     <tpm supported='yes'>
Nov 15 09:26:11 user nova-compute[75122]:       <enum name='model'>
Nov 15 09:26:11 user nova-compute[75122]:         <value>tpm-tis</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>tpm-crb</value>
Nov 15 09:26:11 user nova-compute[75122]:       </enum>
Nov 15 09:26:11 user nova-compute[75122]:       <enum name='backendModel'>
Nov 15 09:26:11 user nova-compute[75122]:         <value>passthrough</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>emulator</value>
Nov 15 09:26:11 user nova-compute[75122]:       </enum>
Nov 15 09:26:11 user nova-compute[75122]:     </tpm>
Nov 15 09:26:11 user nova-compute[75122]:   </devices>
Nov 15 09:26:11 user nova-compute[75122]:   <features>
Nov 15 09:26:11 user nova-compute[75122]:     <gic supported='no'/>
Nov 15 09:26:11 user nova-compute[75122]:     <vmcoreinfo supported='yes'/>
Nov 15 09:26:11 user nova-compute[75122]:     <genid supported='yes'/>
Nov 15 09:26:11 user nova-compute[75122]:     <backingStoreInput supported='yes'/>
Nov 15 09:26:11 user nova-compute[75122]:     <backup supported='yes'/>
Nov 15 09:26:11 user nova-compute[75122]:     <sev supported='no'/>
Nov 15 09:26:11 user nova-compute[75122]:   </features>
Nov 15 09:26:11 user nova-compute[75122]: </domainCapabilities>
Nov 15 09:26:11 user nova-compute[75122]:  {{(pid=75122) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 15 09:26:11 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-e8ea3e7f-0f31-4ed5-bb91-0a8586257ac0 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Nov 15 09:26:11 user nova-compute[75122]: <domainCapabilities>
Nov 15 09:26:11 user nova-compute[75122]:   <path>/usr/bin/qemu-system-i386</path>
Nov 15 09:26:11 user nova-compute[75122]:   <domain>kvm</domain>
Nov 15 09:26:11 user nova-compute[75122]:   <machine>pc-i440fx-jammy</machine>
Nov 15 09:26:11 user nova-compute[75122]:   <arch>i686</arch>
Nov 15 09:26:11 user nova-compute[75122]:   <vcpu max='255'/>
Nov 15 09:26:11 user nova-compute[75122]:   <iothreads supported='yes'/>
Nov 15 09:26:11 user nova-compute[75122]:   <os supported='yes'>
Nov 15 09:26:11 user nova-compute[75122]:     <enum name='firmware'/>
Nov 15 09:26:11 user nova-compute[75122]:     <loader supported='yes'>
Nov 15 09:26:11 user nova-compute[75122]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 15 09:26:11 user nova-compute[75122]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 15 09:26:11 user nova-compute[75122]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 15 09:26:11 user nova-compute[75122]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 15 09:26:11 user nova-compute[75122]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 15 09:26:11 user nova-compute[75122]:       <enum name='type'>
Nov 15 09:26:11 user nova-compute[75122]:         <value>rom</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>pflash</value>
Nov 15 09:26:11 user nova-compute[75122]:       </enum>
Nov 15 09:26:11 user nova-compute[75122]:       <enum name='readonly'>
Nov 15 09:26:11 user nova-compute[75122]:         <value>yes</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>no</value>
Nov 15 09:26:11 user nova-compute[75122]:       </enum>
Nov 15 09:26:11 user nova-compute[75122]:       <enum name='secure'>
Nov 15 09:26:11 user nova-compute[75122]:         <value>no</value>
Nov 15 09:26:11 user nova-compute[75122]:       </enum>
Nov 15 09:26:11 user nova-compute[75122]:     </loader>
Nov 15 09:26:11 user nova-compute[75122]:   </os>
Nov 15 09:26:11 user nova-compute[75122]:   <cpu>
Nov 15 09:26:11 user nova-compute[75122]:     <mode name='host-passthrough' supported='yes'>
Nov 15 09:26:11 user nova-compute[75122]:       <enum name='hostPassthroughMigratable'>
Nov 15 09:26:11 user nova-compute[75122]:         <value>off</value>
Nov 15 09:26:11 user nova-compute[75122]:       </enum>
Nov 15 09:26:11 user nova-compute[75122]:     </mode>
Nov 15 09:26:11 user nova-compute[75122]:     <mode name='maximum' supported='yes'>
Nov 15 09:26:11 user nova-compute[75122]:       <enum name='maximumMigratable'>
Nov 15 09:26:11 user nova-compute[75122]:         <value>on</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>off</value>
Nov 15 09:26:11 user nova-compute[75122]:       </enum>
Nov 15 09:26:11 user nova-compute[75122]:     </mode>
Nov 15 09:26:11 user nova-compute[75122]:     <mode name='host-model' supported='yes'>
Nov 15 09:26:11 user nova-compute[75122]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 15 09:26:11 user nova-compute[75122]:       <vendor>Intel</vendor>
Nov 15 09:26:11 user nova-compute[75122]:       <feature policy='require' name='ss'/>
Nov 15 09:26:11 user nova-compute[75122]:       <feature policy='require' name='vmx'/>
Nov 15 09:26:11 user nova-compute[75122]:       <feature policy='require' name='pcid'/>
Nov 15 09:26:11 user nova-compute[75122]:       <feature policy='require' name='hypervisor'/>
Nov 15 09:26:11 user nova-compute[75122]:       <feature policy='require' name='arat'/>
Nov 15 09:26:11 user nova-compute[75122]:       <feature policy='require' name='tsc_adjust'/>
Nov 15 09:26:11 user nova-compute[75122]:       <feature policy='require' name='umip'/>
Nov 15 09:26:11 user nova-compute[75122]:       <feature policy='require' name='md-clear'/>
Nov 15 09:26:11 user nova-compute[75122]:       <feature policy='require' name='stibp'/>
Nov 15 09:26:11 user nova-compute[75122]:       <feature policy='require' name='arch-capabilities'/>
Nov 15 09:26:11 user nova-compute[75122]:       <feature policy='require' name='ssbd'/>
Nov 15 09:26:11 user nova-compute[75122]:       <feature policy='require' name='ibpb'/>
Nov 15 09:26:11 user nova-compute[75122]:       <feature policy='require' name='ibrs'/>
Nov 15 09:26:11 user nova-compute[75122]:       <feature policy='require' name='amd-stibp'/>
Nov 15 09:26:11 user nova-compute[75122]:       <feature policy='require' name='amd-ssbd'/>
Nov 15 09:26:11 user nova-compute[75122]:       <feature policy='disable' name='erms'/>
Nov 15 09:26:11 user nova-compute[75122]:       <feature policy='disable' name='xsaveopt'/>
Nov 15 09:26:11 user nova-compute[75122]:       <feature policy='disable' name='lm'/>
Nov 15 09:26:11 user nova-compute[75122]:     </mode>
Nov 15 09:26:11 user nova-compute[75122]:     <mode name='custom' supported='yes'>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>qemu64</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='yes'>qemu32</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>phenom</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='yes'>pentium3</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='yes'>pentium2</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='yes'>pentium</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>n270</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>kvm64</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='yes'>kvm32</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='yes'>coreduo</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>core2duo</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>athlon</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>Westmere-IBRS</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>Westmere</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>Snowridge</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>Skylake-Server</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>Skylake-Client</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>SandyBridge</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>Penryn</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>Opteron_G5</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>Opteron_G4</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>Opteron_G3</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>Opteron_G2</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>Opteron_G1</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>Nehalem-IBRS</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>Nehalem</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>IvyBridge</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>Icelake-Server</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>Haswell-noTSX</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>Haswell-IBRS</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>Haswell</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>EPYC-Rome</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>EPYC-Milan</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>EPYC-IBPB</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>EPYC</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>Dhyana</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>Cooperlake</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>Conroe</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>Cascadelake-Server</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>Broadwell-noTSX</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>Broadwell-IBRS</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>Broadwell</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='yes'>486</model>
Nov 15 09:26:11 user nova-compute[75122]:     </mode>
Nov 15 09:26:11 user nova-compute[75122]:   </cpu>
Nov 15 09:26:11 user nova-compute[75122]:   <memoryBacking supported='yes'>
Nov 15 09:26:11 user nova-compute[75122]:     <enum name='sourceType'>
Nov 15 09:26:11 user nova-compute[75122]:       <value>file</value>
Nov 15 09:26:11 user nova-compute[75122]:       <value>anonymous</value>
Nov 15 09:26:11 user nova-compute[75122]:       <value>memfd</value>
Nov 15 09:26:11 user nova-compute[75122]:     </enum>
Nov 15 09:26:11 user nova-compute[75122]:   </memoryBacking>
Nov 15 09:26:11 user nova-compute[75122]:   <devices>
Nov 15 09:26:11 user nova-compute[75122]:     <disk supported='yes'>
Nov 15 09:26:11 user nova-compute[75122]:       <enum name='diskDevice'>
Nov 15 09:26:11 user nova-compute[75122]:         <value>disk</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>cdrom</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>floppy</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>lun</value>
Nov 15 09:26:11 user nova-compute[75122]:       </enum>
Nov 15 09:26:11 user nova-compute[75122]:       <enum name='bus'>
Nov 15 09:26:11 user nova-compute[75122]:         <value>ide</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>fdc</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>scsi</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>virtio</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>usb</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>sata</value>
Nov 15 09:26:11 user nova-compute[75122]:       </enum>
Nov 15 09:26:11 user nova-compute[75122]:       <enum name='model'>
Nov 15 09:26:11 user nova-compute[75122]:         <value>virtio</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>virtio-transitional</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>virtio-non-transitional</value>
Nov 15 09:26:11 user nova-compute[75122]:       </enum>
Nov 15 09:26:11 user nova-compute[75122]:     </disk>
Nov 15 09:26:11 user nova-compute[75122]:     <graphics supported='yes'>
Nov 15 09:26:11 user nova-compute[75122]:       <enum name='type'>
Nov 15 09:26:11 user nova-compute[75122]:         <value>sdl</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>vnc</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>spice</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>egl-headless</value>
Nov 15 09:26:11 user nova-compute[75122]:       </enum>
Nov 15 09:26:11 user nova-compute[75122]:     </graphics>
Nov 15 09:26:11 user nova-compute[75122]:     <video supported='yes'>
Nov 15 09:26:11 user nova-compute[75122]:       <enum name='modelType'>
Nov 15 09:26:11 user nova-compute[75122]:         <value>vga</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>cirrus</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>vmvga</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>qxl</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>virtio</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>none</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>bochs</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>ramfb</value>
Nov 15 09:26:11 user nova-compute[75122]:       </enum>
Nov 15 09:26:11 user nova-compute[75122]:     </video>
Nov 15 09:26:11 user nova-compute[75122]:     <hostdev supported='yes'>
Nov 15 09:26:11 user nova-compute[75122]:       <enum name='mode'>
Nov 15 09:26:11 user nova-compute[75122]:         <value>subsystem</value>
Nov 15 09:26:11 user nova-compute[75122]:       </enum>
Nov 15 09:26:11 user nova-compute[75122]:       <enum name='startupPolicy'>
Nov 15 09:26:11 user nova-compute[75122]:         <value>default</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>mandatory</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>requisite</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>optional</value>
Nov 15 09:26:11 user nova-compute[75122]:       </enum>
Nov 15 09:26:11 user nova-compute[75122]:       <enum name='subsysType'>
Nov 15 09:26:11 user nova-compute[75122]:         <value>usb</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>pci</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>scsi</value>
Nov 15 09:26:11 user nova-compute[75122]:       </enum>
Nov 15 09:26:11 user nova-compute[75122]:       <enum name='capsType'/>
Nov 15 09:26:11 user nova-compute[75122]:       <enum name='pciBackend'/>
Nov 15 09:26:11 user nova-compute[75122]:     </hostdev>
Nov 15 09:26:11 user nova-compute[75122]:     <rng supported='yes'>
Nov 15 09:26:11 user nova-compute[75122]:       <enum name='model'>
Nov 15 09:26:11 user nova-compute[75122]:         <value>virtio</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>virtio-transitional</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>virtio-non-transitional</value>
Nov 15 09:26:11 user nova-compute[75122]:       </enum>
Nov 15 09:26:11 user nova-compute[75122]:       <enum name='backendModel'>
Nov 15 09:26:11 user nova-compute[75122]:         <value>random</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>egd</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>builtin</value>
Nov 15 09:26:11 user nova-compute[75122]:       </enum>
Nov 15 09:26:11 user nova-compute[75122]:     </rng>
Nov 15 09:26:11 user nova-compute[75122]:     <filesystem supported='yes'>
Nov 15 09:26:11 user nova-compute[75122]:       <enum name='driverType'>
Nov 15 09:26:11 user nova-compute[75122]:         <value>path</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>handle</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>virtiofs</value>
Nov 15 09:26:11 user nova-compute[75122]:       </enum>
Nov 15 09:26:11 user nova-compute[75122]:     </filesystem>
Nov 15 09:26:11 user nova-compute[75122]:     <tpm supported='yes'>
Nov 15 09:26:11 user nova-compute[75122]:       <enum name='model'>
Nov 15 09:26:11 user nova-compute[75122]:         <value>tpm-tis</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>tpm-crb</value>
Nov 15 09:26:11 user nova-compute[75122]:       </enum>
Nov 15 09:26:11 user nova-compute[75122]:       <enum name='backendModel'>
Nov 15 09:26:11 user nova-compute[75122]:         <value>passthrough</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>emulator</value>
Nov 15 09:26:11 user nova-compute[75122]:       </enum>
Nov 15 09:26:11 user nova-compute[75122]:     </tpm>
Nov 15 09:26:11 user nova-compute[75122]:   </devices>
Nov 15 09:26:11 user nova-compute[75122]:   <features>
Nov 15 09:26:11 user nova-compute[75122]:     <gic supported='no'/>
Nov 15 09:26:11 user nova-compute[75122]:     <vmcoreinfo supported='yes'/>
Nov 15 09:26:11 user nova-compute[75122]:     <genid supported='yes'/>
Nov 15 09:26:11 user nova-compute[75122]:     <backingStoreInput supported='yes'/>
Nov 15 09:26:11 user nova-compute[75122]:     <backup supported='yes'/>
Nov 15 09:26:11 user nova-compute[75122]:     <sev supported='no'/>
Nov 15 09:26:11 user nova-compute[75122]:   </features>
Nov 15 09:26:11 user nova-compute[75122]: </domainCapabilities>
Nov 15 09:26:11 user nova-compute[75122]:  {{(pid=75122) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 15 09:26:11 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-e8ea3e7f-0f31-4ed5-bb91-0a8586257ac0 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Nov 15 09:26:11 user nova-compute[75122]: <domainCapabilities>
Nov 15 09:26:11 user nova-compute[75122]:   <path>/usr/bin/qemu-system-i386</path>
Nov 15 09:26:11 user nova-compute[75122]:   <domain>kvm</domain>
Nov 15 09:26:11 user nova-compute[75122]:   <machine>pc-q35-jammy</machine>
Nov 15 09:26:11 user nova-compute[75122]:   <arch>i686</arch>
Nov 15 09:26:11 user nova-compute[75122]:   <vcpu max='288'/>
Nov 15 09:26:11 user nova-compute[75122]:   <iothreads supported='yes'/>
Nov 15 09:26:11 user nova-compute[75122]:   <os supported='yes'>
Nov 15 09:26:11 user nova-compute[75122]:     <enum name='firmware'/>
Nov 15 09:26:11 user nova-compute[75122]:     <loader supported='yes'>
Nov 15 09:26:11 user nova-compute[75122]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 15 09:26:11 user nova-compute[75122]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 15 09:26:11 user nova-compute[75122]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 15 09:26:11 user nova-compute[75122]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 15 09:26:11 user nova-compute[75122]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 15 09:26:11 user nova-compute[75122]:       <enum name='type'>
Nov 15 09:26:11 user nova-compute[75122]:         <value>rom</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>pflash</value>
Nov 15 09:26:11 user nova-compute[75122]:       </enum>
Nov 15 09:26:11 user nova-compute[75122]:       <enum name='readonly'>
Nov 15 09:26:11 user nova-compute[75122]:         <value>yes</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>no</value>
Nov 15 09:26:11 user nova-compute[75122]:       </enum>
Nov 15 09:26:11 user nova-compute[75122]:       <enum name='secure'>
Nov 15 09:26:11 user nova-compute[75122]:         <value>no</value>
Nov 15 09:26:11 user nova-compute[75122]:       </enum>
Nov 15 09:26:11 user nova-compute[75122]:     </loader>
Nov 15 09:26:11 user nova-compute[75122]:   </os>
Nov 15 09:26:11 user nova-compute[75122]:   <cpu>
Nov 15 09:26:11 user nova-compute[75122]:     <mode name='host-passthrough' supported='yes'>
Nov 15 09:26:11 user nova-compute[75122]:       <enum name='hostPassthroughMigratable'>
Nov 15 09:26:11 user nova-compute[75122]:         <value>off</value>
Nov 15 09:26:11 user nova-compute[75122]:       </enum>
Nov 15 09:26:11 user nova-compute[75122]:     </mode>
Nov 15 09:26:11 user nova-compute[75122]:     <mode name='maximum' supported='yes'>
Nov 15 09:26:11 user nova-compute[75122]:       <enum name='maximumMigratable'>
Nov 15 09:26:11 user nova-compute[75122]:         <value>on</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>off</value>
Nov 15 09:26:11 user nova-compute[75122]:       </enum>
Nov 15 09:26:11 user nova-compute[75122]:     </mode>
Nov 15 09:26:11 user nova-compute[75122]:     <mode name='host-model' supported='yes'>
Nov 15 09:26:11 user nova-compute[75122]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 15 09:26:11 user nova-compute[75122]:       <vendor>Intel</vendor>
Nov 15 09:26:11 user nova-compute[75122]:       <feature policy='require' name='ss'/>
Nov 15 09:26:11 user nova-compute[75122]:       <feature policy='require' name='vmx'/>
Nov 15 09:26:11 user nova-compute[75122]:       <feature policy='require' name='pcid'/>
Nov 15 09:26:11 user nova-compute[75122]:       <feature policy='require' name='hypervisor'/>
Nov 15 09:26:11 user nova-compute[75122]:       <feature policy='require' name='arat'/>
Nov 15 09:26:11 user nova-compute[75122]:       <feature policy='require' name='tsc_adjust'/>
Nov 15 09:26:11 user nova-compute[75122]:       <feature policy='require' name='umip'/>
Nov 15 09:26:11 user nova-compute[75122]:       <feature policy='require' name='md-clear'/>
Nov 15 09:26:11 user nova-compute[75122]:       <feature policy='require' name='stibp'/>
Nov 15 09:26:11 user nova-compute[75122]:       <feature policy='require' name='arch-capabilities'/>
Nov 15 09:26:11 user nova-compute[75122]:       <feature policy='require' name='ssbd'/>
Nov 15 09:26:11 user nova-compute[75122]:       <feature policy='require' name='ibpb'/>
Nov 15 09:26:11 user nova-compute[75122]:       <feature policy='require' name='ibrs'/>
Nov 15 09:26:11 user nova-compute[75122]:       <feature policy='require' name='amd-stibp'/>
Nov 15 09:26:11 user nova-compute[75122]:       <feature policy='require' name='amd-ssbd'/>
Nov 15 09:26:11 user nova-compute[75122]:       <feature policy='disable' name='erms'/>
Nov 15 09:26:11 user nova-compute[75122]:       <feature policy='disable' name='xsaveopt'/>
Nov 15 09:26:11 user nova-compute[75122]:       <feature policy='disable' name='lm'/>
Nov 15 09:26:11 user nova-compute[75122]:     </mode>
Nov 15 09:26:11 user nova-compute[75122]:     <mode name='custom' supported='yes'>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>qemu64</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='yes'>qemu32</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>phenom</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='yes'>pentium3</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='yes'>pentium2</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='yes'>pentium</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>n270</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>kvm64</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='yes'>kvm32</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='yes'>coreduo</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>core2duo</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>athlon</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>Westmere-IBRS</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>Westmere</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>Snowridge</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>Skylake-Server</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>Skylake-Client</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>SandyBridge</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>Penryn</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>Opteron_G5</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>Opteron_G4</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>Opteron_G3</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>Opteron_G2</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>Opteron_G1</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>Nehalem-IBRS</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>Nehalem</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>IvyBridge</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>Icelake-Server</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>Haswell-noTSX</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>Haswell-IBRS</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>Haswell</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>EPYC-Rome</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>EPYC-Milan</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>EPYC-IBPB</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>EPYC</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>Dhyana</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>Cooperlake</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>Conroe</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>Cascadelake-Server</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>Broadwell-noTSX</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>Broadwell-IBRS</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>Broadwell</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='yes'>486</model>
Nov 15 09:26:11 user nova-compute[75122]:     </mode>
Nov 15 09:26:11 user nova-compute[75122]:   </cpu>
Nov 15 09:26:11 user nova-compute[75122]:   <memoryBacking supported='yes'>
Nov 15 09:26:11 user nova-compute[75122]:     <enum name='sourceType'>
Nov 15 09:26:11 user nova-compute[75122]:       <value>file</value>
Nov 15 09:26:11 user nova-compute[75122]:       <value>anonymous</value>
Nov 15 09:26:11 user nova-compute[75122]:       <value>memfd</value>
Nov 15 09:26:11 user nova-compute[75122]:     </enum>
Nov 15 09:26:11 user nova-compute[75122]:   </memoryBacking>
Nov 15 09:26:11 user nova-compute[75122]:   <devices>
Nov 15 09:26:11 user nova-compute[75122]:     <disk supported='yes'>
Nov 15 09:26:11 user nova-compute[75122]:       <enum name='diskDevice'>
Nov 15 09:26:11 user nova-compute[75122]:         <value>disk</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>cdrom</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>floppy</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>lun</value>
Nov 15 09:26:11 user nova-compute[75122]:       </enum>
Nov 15 09:26:11 user nova-compute[75122]:       <enum name='bus'>
Nov 15 09:26:11 user nova-compute[75122]:         <value>fdc</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>scsi</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>virtio</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>usb</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>sata</value>
Nov 15 09:26:11 user nova-compute[75122]:       </enum>
Nov 15 09:26:11 user nova-compute[75122]:       <enum name='model'>
Nov 15 09:26:11 user nova-compute[75122]:         <value>virtio</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>virtio-transitional</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>virtio-non-transitional</value>
Nov 15 09:26:11 user nova-compute[75122]:       </enum>
Nov 15 09:26:11 user nova-compute[75122]:     </disk>
Nov 15 09:26:11 user nova-compute[75122]:     <graphics supported='yes'>
Nov 15 09:26:11 user nova-compute[75122]:       <enum name='type'>
Nov 15 09:26:11 user nova-compute[75122]:         <value>sdl</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>vnc</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>spice</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>egl-headless</value>
Nov 15 09:26:11 user nova-compute[75122]:       </enum>
Nov 15 09:26:11 user nova-compute[75122]:     </graphics>
Nov 15 09:26:11 user nova-compute[75122]:     <video supported='yes'>
Nov 15 09:26:11 user nova-compute[75122]:       <enum name='modelType'>
Nov 15 09:26:11 user nova-compute[75122]:         <value>vga</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>cirrus</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>vmvga</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>qxl</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>virtio</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>none</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>bochs</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>ramfb</value>
Nov 15 09:26:11 user nova-compute[75122]:       </enum>
Nov 15 09:26:11 user nova-compute[75122]:     </video>
Nov 15 09:26:11 user nova-compute[75122]:     <hostdev supported='yes'>
Nov 15 09:26:11 user nova-compute[75122]:       <enum name='mode'>
Nov 15 09:26:11 user nova-compute[75122]:         <value>subsystem</value>
Nov 15 09:26:11 user nova-compute[75122]:       </enum>
Nov 15 09:26:11 user nova-compute[75122]:       <enum name='startupPolicy'>
Nov 15 09:26:11 user nova-compute[75122]:         <value>default</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>mandatory</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>requisite</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>optional</value>
Nov 15 09:26:11 user nova-compute[75122]:       </enum>
Nov 15 09:26:11 user nova-compute[75122]:       <enum name='subsysType'>
Nov 15 09:26:11 user nova-compute[75122]:         <value>usb</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>pci</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>scsi</value>
Nov 15 09:26:11 user nova-compute[75122]:       </enum>
Nov 15 09:26:11 user nova-compute[75122]:       <enum name='capsType'/>
Nov 15 09:26:11 user nova-compute[75122]:       <enum name='pciBackend'/>
Nov 15 09:26:11 user nova-compute[75122]:     </hostdev>
Nov 15 09:26:11 user nova-compute[75122]:     <rng supported='yes'>
Nov 15 09:26:11 user nova-compute[75122]:       <enum name='model'>
Nov 15 09:26:11 user nova-compute[75122]:         <value>virtio</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>virtio-transitional</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>virtio-non-transitional</value>
Nov 15 09:26:11 user nova-compute[75122]:       </enum>
Nov 15 09:26:11 user nova-compute[75122]:       <enum name='backendModel'>
Nov 15 09:26:11 user nova-compute[75122]:         <value>random</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>egd</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>builtin</value>
Nov 15 09:26:11 user nova-compute[75122]:       </enum>
Nov 15 09:26:11 user nova-compute[75122]:     </rng>
Nov 15 09:26:11 user nova-compute[75122]:     <filesystem supported='yes'>
Nov 15 09:26:11 user nova-compute[75122]:       <enum name='driverType'>
Nov 15 09:26:11 user nova-compute[75122]:         <value>path</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>handle</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>virtiofs</value>
Nov 15 09:26:11 user nova-compute[75122]:       </enum>
Nov 15 09:26:11 user nova-compute[75122]:     </filesystem>
Nov 15 09:26:11 user nova-compute[75122]:     <tpm supported='yes'>
Nov 15 09:26:11 user nova-compute[75122]:       <enum name='model'>
Nov 15 09:26:11 user nova-compute[75122]:         <value>tpm-tis</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>tpm-crb</value>
Nov 15 09:26:11 user nova-compute[75122]:       </enum>
Nov 15 09:26:11 user nova-compute[75122]:       <enum name='backendModel'>
Nov 15 09:26:11 user nova-compute[75122]:         <value>passthrough</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>emulator</value>
Nov 15 09:26:11 user nova-compute[75122]:       </enum>
Nov 15 09:26:11 user nova-compute[75122]:     </tpm>
Nov 15 09:26:11 user nova-compute[75122]:   </devices>
Nov 15 09:26:11 user nova-compute[75122]:   <features>
Nov 15 09:26:11 user nova-compute[75122]:     <gic supported='no'/>
Nov 15 09:26:11 user nova-compute[75122]:     <vmcoreinfo supported='yes'/>
Nov 15 09:26:11 user nova-compute[75122]:     <genid supported='yes'/>
Nov 15 09:26:11 user nova-compute[75122]:     <backingStoreInput supported='yes'/>
Nov 15 09:26:11 user nova-compute[75122]:     <backup supported='yes'/>
Nov 15 09:26:11 user nova-compute[75122]:     <sev supported='no'/>
Nov 15 09:26:11 user nova-compute[75122]:   </features>
Nov 15 09:26:11 user nova-compute[75122]: </domainCapabilities>
Nov 15 09:26:11 user nova-compute[75122]:  {{(pid=75122) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 15 09:26:11 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-e8ea3e7f-0f31-4ed5-bb91-0a8586257ac0 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Nov 15 09:26:11 user nova-compute[75122]: <domainCapabilities>
Nov 15 09:26:11 user nova-compute[75122]:   <path>/usr/bin/qemu-system-i386</path>
Nov 15 09:26:11 user nova-compute[75122]:   <domain>kvm</domain>
Nov 15 09:26:11 user nova-compute[75122]:   <machine>pc-q35-6.2</machine>
Nov 15 09:26:11 user nova-compute[75122]:   <arch>i686</arch>
Nov 15 09:26:11 user nova-compute[75122]:   <vcpu max='288'/>
Nov 15 09:26:11 user nova-compute[75122]:   <iothreads supported='yes'/>
Nov 15 09:26:11 user nova-compute[75122]:   <os supported='yes'>
Nov 15 09:26:11 user nova-compute[75122]:     <enum name='firmware'/>
Nov 15 09:26:11 user nova-compute[75122]:     <loader supported='yes'>
Nov 15 09:26:11 user nova-compute[75122]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 15 09:26:11 user nova-compute[75122]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 15 09:26:11 user nova-compute[75122]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 15 09:26:11 user nova-compute[75122]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 15 09:26:11 user nova-compute[75122]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 15 09:26:11 user nova-compute[75122]:       <enum name='type'>
Nov 15 09:26:11 user nova-compute[75122]:         <value>rom</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>pflash</value>
Nov 15 09:26:11 user nova-compute[75122]:       </enum>
Nov 15 09:26:11 user nova-compute[75122]:       <enum name='readonly'>
Nov 15 09:26:11 user nova-compute[75122]:         <value>yes</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>no</value>
Nov 15 09:26:11 user nova-compute[75122]:       </enum>
Nov 15 09:26:11 user nova-compute[75122]:       <enum name='secure'>
Nov 15 09:26:11 user nova-compute[75122]:         <value>no</value>
Nov 15 09:26:11 user nova-compute[75122]:       </enum>
Nov 15 09:26:11 user nova-compute[75122]:     </loader>
Nov 15 09:26:11 user nova-compute[75122]:   </os>
Nov 15 09:26:11 user nova-compute[75122]:   <cpu>
Nov 15 09:26:11 user nova-compute[75122]:     <mode name='host-passthrough' supported='yes'>
Nov 15 09:26:11 user nova-compute[75122]:       <enum name='hostPassthroughMigratable'>
Nov 15 09:26:11 user nova-compute[75122]:         <value>off</value>
Nov 15 09:26:11 user nova-compute[75122]:       </enum>
Nov 15 09:26:11 user nova-compute[75122]:     </mode>
Nov 15 09:26:11 user nova-compute[75122]:     <mode name='maximum' supported='yes'>
Nov 15 09:26:11 user nova-compute[75122]:       <enum name='maximumMigratable'>
Nov 15 09:26:11 user nova-compute[75122]:         <value>on</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>off</value>
Nov 15 09:26:11 user nova-compute[75122]:       </enum>
Nov 15 09:26:11 user nova-compute[75122]:     </mode>
Nov 15 09:26:11 user nova-compute[75122]:     <mode name='host-model' supported='yes'>
Nov 15 09:26:11 user nova-compute[75122]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 15 09:26:11 user nova-compute[75122]:       <vendor>Intel</vendor>
Nov 15 09:26:11 user nova-compute[75122]:       <feature policy='require' name='ss'/>
Nov 15 09:26:11 user nova-compute[75122]:       <feature policy='require' name='vmx'/>
Nov 15 09:26:11 user nova-compute[75122]:       <feature policy='require' name='pcid'/>
Nov 15 09:26:11 user nova-compute[75122]:       <feature policy='require' name='hypervisor'/>
Nov 15 09:26:11 user nova-compute[75122]:       <feature policy='require' name='arat'/>
Nov 15 09:26:11 user nova-compute[75122]:       <feature policy='require' name='tsc_adjust'/>
Nov 15 09:26:11 user nova-compute[75122]:       <feature policy='require' name='umip'/>
Nov 15 09:26:11 user nova-compute[75122]:       <feature policy='require' name='md-clear'/>
Nov 15 09:26:11 user nova-compute[75122]:       <feature policy='require' name='stibp'/>
Nov 15 09:26:11 user nova-compute[75122]:       <feature policy='require' name='arch-capabilities'/>
Nov 15 09:26:11 user nova-compute[75122]:       <feature policy='require' name='ssbd'/>
Nov 15 09:26:11 user nova-compute[75122]:       <feature policy='require' name='ibpb'/>
Nov 15 09:26:11 user nova-compute[75122]:       <feature policy='require' name='ibrs'/>
Nov 15 09:26:11 user nova-compute[75122]:       <feature policy='require' name='amd-stibp'/>
Nov 15 09:26:11 user nova-compute[75122]:       <feature policy='require' name='amd-ssbd'/>
Nov 15 09:26:11 user nova-compute[75122]:       <feature policy='disable' name='erms'/>
Nov 15 09:26:11 user nova-compute[75122]:       <feature policy='disable' name='xsaveopt'/>
Nov 15 09:26:11 user nova-compute[75122]:       <feature policy='disable' name='lm'/>
Nov 15 09:26:11 user nova-compute[75122]:     </mode>
Nov 15 09:26:11 user nova-compute[75122]:     <mode name='custom' supported='yes'>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>qemu64</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='yes'>qemu32</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>phenom</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='yes'>pentium3</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='yes'>pentium2</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='yes'>pentium</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>n270</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>kvm64</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='yes'>kvm32</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='yes'>coreduo</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>core2duo</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>athlon</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>Westmere-IBRS</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>Westmere</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>Snowridge</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>Skylake-Server</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>Skylake-Client</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>SandyBridge</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>Penryn</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>Opteron_G5</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>Opteron_G4</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>Opteron_G3</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>Opteron_G2</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>Opteron_G1</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>Nehalem-IBRS</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>Nehalem</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>IvyBridge</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>Icelake-Server</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>Haswell-noTSX</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>Haswell-IBRS</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>Haswell</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>EPYC-Rome</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>EPYC-Milan</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>EPYC-IBPB</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>EPYC</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>Dhyana</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>Cooperlake</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>Conroe</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>Cascadelake-Server</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>Broadwell-noTSX</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>Broadwell-IBRS</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>Broadwell</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='yes'>486</model>
Nov 15 09:26:11 user nova-compute[75122]:     </mode>
Nov 15 09:26:11 user nova-compute[75122]:   </cpu>
Nov 15 09:26:11 user nova-compute[75122]:   <memoryBacking supported='yes'>
Nov 15 09:26:11 user nova-compute[75122]:     <enum name='sourceType'>
Nov 15 09:26:11 user nova-compute[75122]:       <value>file</value>
Nov 15 09:26:11 user nova-compute[75122]:       <value>anonymous</value>
Nov 15 09:26:11 user nova-compute[75122]:       <value>memfd</value>
Nov 15 09:26:11 user nova-compute[75122]:     </enum>
Nov 15 09:26:11 user nova-compute[75122]:   </memoryBacking>
Nov 15 09:26:11 user nova-compute[75122]:   <devices>
Nov 15 09:26:11 user nova-compute[75122]:     <disk supported='yes'>
Nov 15 09:26:11 user nova-compute[75122]:       <enum name='diskDevice'>
Nov 15 09:26:11 user nova-compute[75122]:         <value>disk</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>cdrom</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>floppy</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>lun</value>
Nov 15 09:26:11 user nova-compute[75122]:       </enum>
Nov 15 09:26:11 user nova-compute[75122]:       <enum name='bus'>
Nov 15 09:26:11 user nova-compute[75122]:         <value>fdc</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>scsi</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>virtio</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>usb</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>sata</value>
Nov 15 09:26:11 user nova-compute[75122]:       </enum>
Nov 15 09:26:11 user nova-compute[75122]:       <enum name='model'>
Nov 15 09:26:11 user nova-compute[75122]:         <value>virtio</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>virtio-transitional</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>virtio-non-transitional</value>
Nov 15 09:26:11 user nova-compute[75122]:       </enum>
Nov 15 09:26:11 user nova-compute[75122]:     </disk>
Nov 15 09:26:11 user nova-compute[75122]:     <graphics supported='yes'>
Nov 15 09:26:11 user nova-compute[75122]:       <enum name='type'>
Nov 15 09:26:11 user nova-compute[75122]:         <value>sdl</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>vnc</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>spice</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>egl-headless</value>
Nov 15 09:26:11 user nova-compute[75122]:       </enum>
Nov 15 09:26:11 user nova-compute[75122]:     </graphics>
Nov 15 09:26:11 user nova-compute[75122]:     <video supported='yes'>
Nov 15 09:26:11 user nova-compute[75122]:       <enum name='modelType'>
Nov 15 09:26:11 user nova-compute[75122]:         <value>vga</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>cirrus</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>vmvga</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>qxl</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>virtio</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>none</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>bochs</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>ramfb</value>
Nov 15 09:26:11 user nova-compute[75122]:       </enum>
Nov 15 09:26:11 user nova-compute[75122]:     </video>
Nov 15 09:26:11 user nova-compute[75122]:     <hostdev supported='yes'>
Nov 15 09:26:11 user nova-compute[75122]:       <enum name='mode'>
Nov 15 09:26:11 user nova-compute[75122]:         <value>subsystem</value>
Nov 15 09:26:11 user nova-compute[75122]:       </enum>
Nov 15 09:26:11 user nova-compute[75122]:       <enum name='startupPolicy'>
Nov 15 09:26:11 user nova-compute[75122]:         <value>default</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>mandatory</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>requisite</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>optional</value>
Nov 15 09:26:11 user nova-compute[75122]:       </enum>
Nov 15 09:26:11 user nova-compute[75122]:       <enum name='subsysType'>
Nov 15 09:26:11 user nova-compute[75122]:         <value>usb</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>pci</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>scsi</value>
Nov 15 09:26:11 user nova-compute[75122]:       </enum>
Nov 15 09:26:11 user nova-compute[75122]:       <enum name='capsType'/>
Nov 15 09:26:11 user nova-compute[75122]:       <enum name='pciBackend'/>
Nov 15 09:26:11 user nova-compute[75122]:     </hostdev>
Nov 15 09:26:11 user nova-compute[75122]:     <rng supported='yes'>
Nov 15 09:26:11 user nova-compute[75122]:       <enum name='model'>
Nov 15 09:26:11 user nova-compute[75122]:         <value>virtio</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>virtio-transitional</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>virtio-non-transitional</value>
Nov 15 09:26:11 user nova-compute[75122]:       </enum>
Nov 15 09:26:11 user nova-compute[75122]:       <enum name='backendModel'>
Nov 15 09:26:11 user nova-compute[75122]:         <value>random</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>egd</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>builtin</value>
Nov 15 09:26:11 user nova-compute[75122]:       </enum>
Nov 15 09:26:11 user nova-compute[75122]:     </rng>
Nov 15 09:26:11 user nova-compute[75122]:     <filesystem supported='yes'>
Nov 15 09:26:11 user nova-compute[75122]:       <enum name='driverType'>
Nov 15 09:26:11 user nova-compute[75122]:         <value>path</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>handle</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>virtiofs</value>
Nov 15 09:26:11 user nova-compute[75122]:       </enum>
Nov 15 09:26:11 user nova-compute[75122]:     </filesystem>
Nov 15 09:26:11 user nova-compute[75122]:     <tpm supported='yes'>
Nov 15 09:26:11 user nova-compute[75122]:       <enum name='model'>
Nov 15 09:26:11 user nova-compute[75122]:         <value>tpm-tis</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>tpm-crb</value>
Nov 15 09:26:11 user nova-compute[75122]:       </enum>
Nov 15 09:26:11 user nova-compute[75122]:       <enum name='backendModel'>
Nov 15 09:26:11 user nova-compute[75122]:         <value>passthrough</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>emulator</value>
Nov 15 09:26:11 user nova-compute[75122]:       </enum>
Nov 15 09:26:11 user nova-compute[75122]:     </tpm>
Nov 15 09:26:11 user nova-compute[75122]:   </devices>
Nov 15 09:26:11 user nova-compute[75122]:   <features>
Nov 15 09:26:11 user nova-compute[75122]:     <gic supported='no'/>
Nov 15 09:26:11 user nova-compute[75122]:     <vmcoreinfo supported='yes'/>
Nov 15 09:26:11 user nova-compute[75122]:     <genid supported='yes'/>
Nov 15 09:26:11 user nova-compute[75122]:     <backingStoreInput supported='yes'/>
Nov 15 09:26:11 user nova-compute[75122]:     <backup supported='yes'/>
Nov 15 09:26:11 user nova-compute[75122]:     <sev supported='no'/>
Nov 15 09:26:11 user nova-compute[75122]:   </features>
Nov 15 09:26:11 user nova-compute[75122]: </domainCapabilities>
Nov 15 09:26:11 user nova-compute[75122]:  {{(pid=75122) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 15 09:26:11 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-e8ea3e7f-0f31-4ed5-bb91-0a8586257ac0 None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=75122) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 09:26:11 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-e8ea3e7f-0f31-4ed5-bb91-0a8586257ac0 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=75122) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 09:26:11 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-e8ea3e7f-0f31-4ed5-bb91-0a8586257ac0 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=75122) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 09:26:11 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-e8ea3e7f-0f31-4ed5-bb91-0a8586257ac0 None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=75122) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 09:26:11 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-e8ea3e7f-0f31-4ed5-bb91-0a8586257ac0 None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=75122) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 09:26:11 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-e8ea3e7f-0f31-4ed5-bb91-0a8586257ac0 None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=75122) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 09:26:11 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-e8ea3e7f-0f31-4ed5-bb91-0a8586257ac0 None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=75122) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 09:26:11 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-e8ea3e7f-0f31-4ed5-bb91-0a8586257ac0 None None] Getting domain capabilities for mips via machine types: {None} {{(pid=75122) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 09:26:11 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-e8ea3e7f-0f31-4ed5-bb91-0a8586257ac0 None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=75122) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 09:26:11 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-e8ea3e7f-0f31-4ed5-bb91-0a8586257ac0 None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=75122) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 09:26:11 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-e8ea3e7f-0f31-4ed5-bb91-0a8586257ac0 None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=75122) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 09:26:11 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-e8ea3e7f-0f31-4ed5-bb91-0a8586257ac0 None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=75122) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 09:26:11 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-e8ea3e7f-0f31-4ed5-bb91-0a8586257ac0 None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=75122) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 09:26:11 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-e8ea3e7f-0f31-4ed5-bb91-0a8586257ac0 None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=75122) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 09:26:11 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-e8ea3e7f-0f31-4ed5-bb91-0a8586257ac0 None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=75122) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 09:26:11 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-e8ea3e7f-0f31-4ed5-bb91-0a8586257ac0 None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=75122) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 09:26:11 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-e8ea3e7f-0f31-4ed5-bb91-0a8586257ac0 None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=75122) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 09:26:11 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-e8ea3e7f-0f31-4ed5-bb91-0a8586257ac0 None None] Getting domain capabilities for ppc64 via machine types: {'pseries', None, 'powernv'} {{(pid=75122) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 09:26:11 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-e8ea3e7f-0f31-4ed5-bb91-0a8586257ac0 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75122) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 09:26:11 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-e8ea3e7f-0f31-4ed5-bb91-0a8586257ac0 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75122) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 09:26:11 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-e8ea3e7f-0f31-4ed5-bb91-0a8586257ac0 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75122) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 09:26:11 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-e8ea3e7f-0f31-4ed5-bb91-0a8586257ac0 None None] Getting domain capabilities for ppc64le via machine types: {'pseries', 'powernv'} {{(pid=75122) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 09:26:11 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-e8ea3e7f-0f31-4ed5-bb91-0a8586257ac0 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=75122) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 09:26:11 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-e8ea3e7f-0f31-4ed5-bb91-0a8586257ac0 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=75122) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 09:26:11 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-e8ea3e7f-0f31-4ed5-bb91-0a8586257ac0 None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=75122) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 09:26:11 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-e8ea3e7f-0f31-4ed5-bb91-0a8586257ac0 None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=75122) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 09:26:11 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-e8ea3e7f-0f31-4ed5-bb91-0a8586257ac0 None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=75122) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 09:26:11 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-e8ea3e7f-0f31-4ed5-bb91-0a8586257ac0 None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=75122) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 09:26:11 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-e8ea3e7f-0f31-4ed5-bb91-0a8586257ac0 None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=75122) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 09:26:11 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-e8ea3e7f-0f31-4ed5-bb91-0a8586257ac0 None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=75122) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 09:26:11 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-e8ea3e7f-0f31-4ed5-bb91-0a8586257ac0 None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=75122) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 09:26:11 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-e8ea3e7f-0f31-4ed5-bb91-0a8586257ac0 None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=75122) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 09:26:11 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-e8ea3e7f-0f31-4ed5-bb91-0a8586257ac0 None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=75122) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 09:26:11 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-e8ea3e7f-0f31-4ed5-bb91-0a8586257ac0 None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=75122) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 09:26:11 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-e8ea3e7f-0f31-4ed5-bb91-0a8586257ac0 None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=75122) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 09:26:11 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-e8ea3e7f-0f31-4ed5-bb91-0a8586257ac0 None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=75122) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 09:26:11 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-e8ea3e7f-0f31-4ed5-bb91-0a8586257ac0 None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=75122) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 09:26:11 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-e8ea3e7f-0f31-4ed5-bb91-0a8586257ac0 None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=75122) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 09:26:11 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-e8ea3e7f-0f31-4ed5-bb91-0a8586257ac0 None None] Getting domain capabilities for x86_64 via machine types: {'pc', 'ubuntu', 'ubuntu-q35', 'q35'} {{(pid=75122) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 09:26:11 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-e8ea3e7f-0f31-4ed5-bb91-0a8586257ac0 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Nov 15 09:26:11 user nova-compute[75122]: <domainCapabilities>
Nov 15 09:26:11 user nova-compute[75122]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 15 09:26:11 user nova-compute[75122]:   <domain>kvm</domain>
Nov 15 09:26:11 user nova-compute[75122]:   <machine>pc-i440fx-6.2</machine>
Nov 15 09:26:11 user nova-compute[75122]:   <arch>x86_64</arch>
Nov 15 09:26:11 user nova-compute[75122]:   <vcpu max='255'/>
Nov 15 09:26:11 user nova-compute[75122]:   <iothreads supported='yes'/>
Nov 15 09:26:11 user nova-compute[75122]:   <os supported='yes'>
Nov 15 09:26:11 user nova-compute[75122]:     <enum name='firmware'>
Nov 15 09:26:11 user nova-compute[75122]:       <value>efi</value>
Nov 15 09:26:11 user nova-compute[75122]:     </enum>
Nov 15 09:26:11 user nova-compute[75122]:     <loader supported='yes'>
Nov 15 09:26:11 user nova-compute[75122]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 15 09:26:11 user nova-compute[75122]:       <enum name='type'>
Nov 15 09:26:11 user nova-compute[75122]:         <value>rom</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>pflash</value>
Nov 15 09:26:11 user nova-compute[75122]:       </enum>
Nov 15 09:26:11 user nova-compute[75122]:       <enum name='readonly'>
Nov 15 09:26:11 user nova-compute[75122]:         <value>yes</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>no</value>
Nov 15 09:26:11 user nova-compute[75122]:       </enum>
Nov 15 09:26:11 user nova-compute[75122]:       <enum name='secure'>
Nov 15 09:26:11 user nova-compute[75122]:         <value>no</value>
Nov 15 09:26:11 user nova-compute[75122]:       </enum>
Nov 15 09:26:11 user nova-compute[75122]:     </loader>
Nov 15 09:26:11 user nova-compute[75122]:   </os>
Nov 15 09:26:11 user nova-compute[75122]:   <cpu>
Nov 15 09:26:11 user nova-compute[75122]:     <mode name='host-passthrough' supported='yes'>
Nov 15 09:26:11 user nova-compute[75122]:       <enum name='hostPassthroughMigratable'>
Nov 15 09:26:11 user nova-compute[75122]:         <value>on</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>off</value>
Nov 15 09:26:11 user nova-compute[75122]:       </enum>
Nov 15 09:26:11 user nova-compute[75122]:     </mode>
Nov 15 09:26:11 user nova-compute[75122]:     <mode name='maximum' supported='yes'>
Nov 15 09:26:11 user nova-compute[75122]:       <enum name='maximumMigratable'>
Nov 15 09:26:11 user nova-compute[75122]:         <value>on</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>off</value>
Nov 15 09:26:11 user nova-compute[75122]:       </enum>
Nov 15 09:26:11 user nova-compute[75122]:     </mode>
Nov 15 09:26:11 user nova-compute[75122]:     <mode name='host-model' supported='yes'>
Nov 15 09:26:11 user nova-compute[75122]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 15 09:26:11 user nova-compute[75122]:       <vendor>Intel</vendor>
Nov 15 09:26:11 user nova-compute[75122]:       <feature policy='require' name='ss'/>
Nov 15 09:26:11 user nova-compute[75122]:       <feature policy='require' name='vmx'/>
Nov 15 09:26:11 user nova-compute[75122]:       <feature policy='require' name='pcid'/>
Nov 15 09:26:11 user nova-compute[75122]:       <feature policy='require' name='hypervisor'/>
Nov 15 09:26:11 user nova-compute[75122]:       <feature policy='require' name='arat'/>
Nov 15 09:26:11 user nova-compute[75122]:       <feature policy='require' name='tsc_adjust'/>
Nov 15 09:26:11 user nova-compute[75122]:       <feature policy='require' name='umip'/>
Nov 15 09:26:11 user nova-compute[75122]:       <feature policy='require' name='md-clear'/>
Nov 15 09:26:11 user nova-compute[75122]:       <feature policy='require' name='stibp'/>
Nov 15 09:26:11 user nova-compute[75122]:       <feature policy='require' name='arch-capabilities'/>
Nov 15 09:26:11 user nova-compute[75122]:       <feature policy='require' name='ssbd'/>
Nov 15 09:26:11 user nova-compute[75122]:       <feature policy='require' name='invtsc'/>
Nov 15 09:26:11 user nova-compute[75122]:       <feature policy='require' name='ibpb'/>
Nov 15 09:26:11 user nova-compute[75122]:       <feature policy='require' name='ibrs'/>
Nov 15 09:26:11 user nova-compute[75122]:       <feature policy='require' name='amd-stibp'/>
Nov 15 09:26:11 user nova-compute[75122]:       <feature policy='require' name='amd-ssbd'/>
Nov 15 09:26:11 user nova-compute[75122]:       <feature policy='require' name='rsba'/>
Nov 15 09:26:11 user nova-compute[75122]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 15 09:26:11 user nova-compute[75122]:       <feature policy='require' name='pschange-mc-no'/>
Nov 15 09:26:11 user nova-compute[75122]:       <feature policy='disable' name='erms'/>
Nov 15 09:26:11 user nova-compute[75122]:       <feature policy='disable' name='xsaveopt'/>
Nov 15 09:26:11 user nova-compute[75122]:     </mode>
Nov 15 09:26:11 user nova-compute[75122]:     <mode name='custom' supported='yes'>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>qemu64</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='yes'>qemu32</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>phenom</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='yes'>pentium3</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='yes'>pentium2</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='yes'>pentium</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>n270</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='yes'>kvm64</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='yes'>kvm32</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='yes'>coreduo</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='yes'>core2duo</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>athlon</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='yes'>Westmere-IBRS</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='yes'>Westmere</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>Snowridge</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>Skylake-Server</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>Skylake-Client</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>SandyBridge</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='yes'>Penryn</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>Opteron_G5</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>Opteron_G4</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>Opteron_G3</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>Opteron_G2</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='yes'>Opteron_G1</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='yes'>Nehalem</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>IvyBridge</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>Icelake-Server</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>Haswell-noTSX</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>Haswell-IBRS</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>Haswell</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>EPYC-Rome</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>EPYC-Milan</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>EPYC-IBPB</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>EPYC</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>Dhyana</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>Cooperlake</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='yes'>Conroe</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>Cascadelake-Server</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>Broadwell-noTSX</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>Broadwell-IBRS</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>Broadwell</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='yes'>486</model>
Nov 15 09:26:11 user nova-compute[75122]:     </mode>
Nov 15 09:26:11 user nova-compute[75122]:   </cpu>
Nov 15 09:26:11 user nova-compute[75122]:   <memoryBacking supported='yes'>
Nov 15 09:26:11 user nova-compute[75122]:     <enum name='sourceType'>
Nov 15 09:26:11 user nova-compute[75122]:       <value>file</value>
Nov 15 09:26:11 user nova-compute[75122]:       <value>anonymous</value>
Nov 15 09:26:11 user nova-compute[75122]:       <value>memfd</value>
Nov 15 09:26:11 user nova-compute[75122]:     </enum>
Nov 15 09:26:11 user nova-compute[75122]:   </memoryBacking>
Nov 15 09:26:11 user nova-compute[75122]:   <devices>
Nov 15 09:26:11 user nova-compute[75122]:     <disk supported='yes'>
Nov 15 09:26:11 user nova-compute[75122]:       <enum name='diskDevice'>
Nov 15 09:26:11 user nova-compute[75122]:         <value>disk</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>cdrom</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>floppy</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>lun</value>
Nov 15 09:26:11 user nova-compute[75122]:       </enum>
Nov 15 09:26:11 user nova-compute[75122]:       <enum name='bus'>
Nov 15 09:26:11 user nova-compute[75122]:         <value>ide</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>fdc</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>scsi</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>virtio</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>usb</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>sata</value>
Nov 15 09:26:11 user nova-compute[75122]:       </enum>
Nov 15 09:26:11 user nova-compute[75122]:       <enum name='model'>
Nov 15 09:26:11 user nova-compute[75122]:         <value>virtio</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>virtio-transitional</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>virtio-non-transitional</value>
Nov 15 09:26:11 user nova-compute[75122]:       </enum>
Nov 15 09:26:11 user nova-compute[75122]:     </disk>
Nov 15 09:26:11 user nova-compute[75122]:     <graphics supported='yes'>
Nov 15 09:26:11 user nova-compute[75122]:       <enum name='type'>
Nov 15 09:26:11 user nova-compute[75122]:         <value>sdl</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>vnc</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>spice</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>egl-headless</value>
Nov 15 09:26:11 user nova-compute[75122]:       </enum>
Nov 15 09:26:11 user nova-compute[75122]:     </graphics>
Nov 15 09:26:11 user nova-compute[75122]:     <video supported='yes'>
Nov 15 09:26:11 user nova-compute[75122]:       <enum name='modelType'>
Nov 15 09:26:11 user nova-compute[75122]:         <value>vga</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>cirrus</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>vmvga</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>qxl</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>virtio</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>none</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>bochs</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>ramfb</value>
Nov 15 09:26:11 user nova-compute[75122]:       </enum>
Nov 15 09:26:11 user nova-compute[75122]:     </video>
Nov 15 09:26:11 user nova-compute[75122]:     <hostdev supported='yes'>
Nov 15 09:26:11 user nova-compute[75122]:       <enum name='mode'>
Nov 15 09:26:11 user nova-compute[75122]:         <value>subsystem</value>
Nov 15 09:26:11 user nova-compute[75122]:       </enum>
Nov 15 09:26:11 user nova-compute[75122]:       <enum name='startupPolicy'>
Nov 15 09:26:11 user nova-compute[75122]:         <value>default</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>mandatory</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>requisite</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>optional</value>
Nov 15 09:26:11 user nova-compute[75122]:       </enum>
Nov 15 09:26:11 user nova-compute[75122]:       <enum name='subsysType'>
Nov 15 09:26:11 user nova-compute[75122]:         <value>usb</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>pci</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>scsi</value>
Nov 15 09:26:11 user nova-compute[75122]:       </enum>
Nov 15 09:26:11 user nova-compute[75122]:       <enum name='capsType'/>
Nov 15 09:26:11 user nova-compute[75122]:       <enum name='pciBackend'/>
Nov 15 09:26:11 user nova-compute[75122]:     </hostdev>
Nov 15 09:26:11 user nova-compute[75122]:     <rng supported='yes'>
Nov 15 09:26:11 user nova-compute[75122]:       <enum name='model'>
Nov 15 09:26:11 user nova-compute[75122]:         <value>virtio</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>virtio-transitional</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>virtio-non-transitional</value>
Nov 15 09:26:11 user nova-compute[75122]:       </enum>
Nov 15 09:26:11 user nova-compute[75122]:       <enum name='backendModel'>
Nov 15 09:26:11 user nova-compute[75122]:         <value>random</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>egd</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>builtin</value>
Nov 15 09:26:11 user nova-compute[75122]:       </enum>
Nov 15 09:26:11 user nova-compute[75122]:     </rng>
Nov 15 09:26:11 user nova-compute[75122]:     <filesystem supported='yes'>
Nov 15 09:26:11 user nova-compute[75122]:       <enum name='driverType'>
Nov 15 09:26:11 user nova-compute[75122]:         <value>path</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>handle</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>virtiofs</value>
Nov 15 09:26:11 user nova-compute[75122]:       </enum>
Nov 15 09:26:11 user nova-compute[75122]:     </filesystem>
Nov 15 09:26:11 user nova-compute[75122]:     <tpm supported='yes'>
Nov 15 09:26:11 user nova-compute[75122]:       <enum name='model'>
Nov 15 09:26:11 user nova-compute[75122]:         <value>tpm-tis</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>tpm-crb</value>
Nov 15 09:26:11 user nova-compute[75122]:       </enum>
Nov 15 09:26:11 user nova-compute[75122]:       <enum name='backendModel'>
Nov 15 09:26:11 user nova-compute[75122]:         <value>passthrough</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>emulator</value>
Nov 15 09:26:11 user nova-compute[75122]:       </enum>
Nov 15 09:26:11 user nova-compute[75122]:     </tpm>
Nov 15 09:26:11 user nova-compute[75122]:   </devices>
Nov 15 09:26:11 user nova-compute[75122]:   <features>
Nov 15 09:26:11 user nova-compute[75122]:     <gic supported='no'/>
Nov 15 09:26:11 user nova-compute[75122]:     <vmcoreinfo supported='yes'/>
Nov 15 09:26:11 user nova-compute[75122]:     <genid supported='yes'/>
Nov 15 09:26:11 user nova-compute[75122]:     <backingStoreInput supported='yes'/>
Nov 15 09:26:11 user nova-compute[75122]:     <backup supported='yes'/>
Nov 15 09:26:11 user nova-compute[75122]:     <sev supported='no'/>
Nov 15 09:26:11 user nova-compute[75122]:   </features>
Nov 15 09:26:11 user nova-compute[75122]: </domainCapabilities>
Nov 15 09:26:11 user nova-compute[75122]:  {{(pid=75122) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 15 09:26:11 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-e8ea3e7f-0f31-4ed5-bb91-0a8586257ac0 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Nov 15 09:26:11 user nova-compute[75122]: <domainCapabilities>
Nov 15 09:26:11 user nova-compute[75122]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 15 09:26:11 user nova-compute[75122]:   <domain>kvm</domain>
Nov 15 09:26:11 user nova-compute[75122]:   <machine>pc-i440fx-jammy</machine>
Nov 15 09:26:11 user nova-compute[75122]:   <arch>x86_64</arch>
Nov 15 09:26:11 user nova-compute[75122]:   <vcpu max='255'/>
Nov 15 09:26:11 user nova-compute[75122]:   <iothreads supported='yes'/>
Nov 15 09:26:11 user nova-compute[75122]:   <os supported='yes'>
Nov 15 09:26:11 user nova-compute[75122]:     <enum name='firmware'>
Nov 15 09:26:11 user nova-compute[75122]:       <value>efi</value>
Nov 15 09:26:11 user nova-compute[75122]:     </enum>
Nov 15 09:26:11 user nova-compute[75122]:     <loader supported='yes'>
Nov 15 09:26:11 user nova-compute[75122]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 15 09:26:11 user nova-compute[75122]:       <enum name='type'>
Nov 15 09:26:11 user nova-compute[75122]:         <value>rom</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>pflash</value>
Nov 15 09:26:11 user nova-compute[75122]:       </enum>
Nov 15 09:26:11 user nova-compute[75122]:       <enum name='readonly'>
Nov 15 09:26:11 user nova-compute[75122]:         <value>yes</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>no</value>
Nov 15 09:26:11 user nova-compute[75122]:       </enum>
Nov 15 09:26:11 user nova-compute[75122]:       <enum name='secure'>
Nov 15 09:26:11 user nova-compute[75122]:         <value>no</value>
Nov 15 09:26:11 user nova-compute[75122]:       </enum>
Nov 15 09:26:11 user nova-compute[75122]:     </loader>
Nov 15 09:26:11 user nova-compute[75122]:   </os>
Nov 15 09:26:11 user nova-compute[75122]:   <cpu>
Nov 15 09:26:11 user nova-compute[75122]:     <mode name='host-passthrough' supported='yes'>
Nov 15 09:26:11 user nova-compute[75122]:       <enum name='hostPassthroughMigratable'>
Nov 15 09:26:11 user nova-compute[75122]:         <value>on</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>off</value>
Nov 15 09:26:11 user nova-compute[75122]:       </enum>
Nov 15 09:26:11 user nova-compute[75122]:     </mode>
Nov 15 09:26:11 user nova-compute[75122]:     <mode name='maximum' supported='yes'>
Nov 15 09:26:11 user nova-compute[75122]:       <enum name='maximumMigratable'>
Nov 15 09:26:11 user nova-compute[75122]:         <value>on</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>off</value>
Nov 15 09:26:11 user nova-compute[75122]:       </enum>
Nov 15 09:26:11 user nova-compute[75122]:     </mode>
Nov 15 09:26:11 user nova-compute[75122]:     <mode name='host-model' supported='yes'>
Nov 15 09:26:11 user nova-compute[75122]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 15 09:26:11 user nova-compute[75122]:       <vendor>Intel</vendor>
Nov 15 09:26:11 user nova-compute[75122]:       <feature policy='require' name='ss'/>
Nov 15 09:26:11 user nova-compute[75122]:       <feature policy='require' name='vmx'/>
Nov 15 09:26:11 user nova-compute[75122]:       <feature policy='require' name='pcid'/>
Nov 15 09:26:11 user nova-compute[75122]:       <feature policy='require' name='hypervisor'/>
Nov 15 09:26:11 user nova-compute[75122]:       <feature policy='require' name='arat'/>
Nov 15 09:26:11 user nova-compute[75122]:       <feature policy='require' name='tsc_adjust'/>
Nov 15 09:26:11 user nova-compute[75122]:       <feature policy='require' name='umip'/>
Nov 15 09:26:11 user nova-compute[75122]:       <feature policy='require' name='md-clear'/>
Nov 15 09:26:11 user nova-compute[75122]:       <feature policy='require' name='stibp'/>
Nov 15 09:26:11 user nova-compute[75122]:       <feature policy='require' name='arch-capabilities'/>
Nov 15 09:26:11 user nova-compute[75122]:       <feature policy='require' name='ssbd'/>
Nov 15 09:26:11 user nova-compute[75122]:       <feature policy='require' name='invtsc'/>
Nov 15 09:26:11 user nova-compute[75122]:       <feature policy='require' name='ibpb'/>
Nov 15 09:26:11 user nova-compute[75122]:       <feature policy='require' name='ibrs'/>
Nov 15 09:26:11 user nova-compute[75122]:       <feature policy='require' name='amd-stibp'/>
Nov 15 09:26:11 user nova-compute[75122]:       <feature policy='require' name='amd-ssbd'/>
Nov 15 09:26:11 user nova-compute[75122]:       <feature policy='require' name='rsba'/>
Nov 15 09:26:11 user nova-compute[75122]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 15 09:26:11 user nova-compute[75122]:       <feature policy='require' name='pschange-mc-no'/>
Nov 15 09:26:11 user nova-compute[75122]:       <feature policy='disable' name='erms'/>
Nov 15 09:26:11 user nova-compute[75122]:       <feature policy='disable' name='xsaveopt'/>
Nov 15 09:26:11 user nova-compute[75122]:     </mode>
Nov 15 09:26:11 user nova-compute[75122]:     <mode name='custom' supported='yes'>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>qemu64</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='yes'>qemu32</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>phenom</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='yes'>pentium3</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='yes'>pentium2</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='yes'>pentium</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>n270</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='yes'>kvm64</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='yes'>kvm32</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='yes'>coreduo</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='yes'>core2duo</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>athlon</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='yes'>Westmere-IBRS</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='yes'>Westmere</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>Snowridge</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>Skylake-Server</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>Skylake-Client</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>SandyBridge</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='yes'>Penryn</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>Opteron_G5</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>Opteron_G4</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>Opteron_G3</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>Opteron_G2</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='yes'>Opteron_G1</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='yes'>Nehalem</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>IvyBridge</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>Icelake-Server</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>Haswell-noTSX</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>Haswell-IBRS</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>Haswell</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>EPYC-Rome</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>EPYC-Milan</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>EPYC-IBPB</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>EPYC</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>Dhyana</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>Cooperlake</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='yes'>Conroe</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>Cascadelake-Server</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>Broadwell-noTSX</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>Broadwell-IBRS</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>Broadwell</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='yes'>486</model>
Nov 15 09:26:11 user nova-compute[75122]:     </mode>
Nov 15 09:26:11 user nova-compute[75122]:   </cpu>
Nov 15 09:26:11 user nova-compute[75122]:   <memoryBacking supported='yes'>
Nov 15 09:26:11 user nova-compute[75122]:     <enum name='sourceType'>
Nov 15 09:26:11 user nova-compute[75122]:       <value>file</value>
Nov 15 09:26:11 user nova-compute[75122]:       <value>anonymous</value>
Nov 15 09:26:11 user nova-compute[75122]:       <value>memfd</value>
Nov 15 09:26:11 user nova-compute[75122]:     </enum>
Nov 15 09:26:11 user nova-compute[75122]:   </memoryBacking>
Nov 15 09:26:11 user nova-compute[75122]:   <devices>
Nov 15 09:26:11 user nova-compute[75122]:     <disk supported='yes'>
Nov 15 09:26:11 user nova-compute[75122]:       <enum name='diskDevice'>
Nov 15 09:26:11 user nova-compute[75122]:         <value>disk</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>cdrom</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>floppy</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>lun</value>
Nov 15 09:26:11 user nova-compute[75122]:       </enum>
Nov 15 09:26:11 user nova-compute[75122]:       <enum name='bus'>
Nov 15 09:26:11 user nova-compute[75122]:         <value>ide</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>fdc</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>scsi</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>virtio</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>usb</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>sata</value>
Nov 15 09:26:11 user nova-compute[75122]:       </enum>
Nov 15 09:26:11 user nova-compute[75122]:       <enum name='model'>
Nov 15 09:26:11 user nova-compute[75122]:         <value>virtio</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>virtio-transitional</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>virtio-non-transitional</value>
Nov 15 09:26:11 user nova-compute[75122]:       </enum>
Nov 15 09:26:11 user nova-compute[75122]:     </disk>
Nov 15 09:26:11 user nova-compute[75122]:     <graphics supported='yes'>
Nov 15 09:26:11 user nova-compute[75122]:       <enum name='type'>
Nov 15 09:26:11 user nova-compute[75122]:         <value>sdl</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>vnc</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>spice</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>egl-headless</value>
Nov 15 09:26:11 user nova-compute[75122]:       </enum>
Nov 15 09:26:11 user nova-compute[75122]:     </graphics>
Nov 15 09:26:11 user nova-compute[75122]:     <video supported='yes'>
Nov 15 09:26:11 user nova-compute[75122]:       <enum name='modelType'>
Nov 15 09:26:11 user nova-compute[75122]:         <value>vga</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>cirrus</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>vmvga</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>qxl</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>virtio</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>none</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>bochs</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>ramfb</value>
Nov 15 09:26:11 user nova-compute[75122]:       </enum>
Nov 15 09:26:11 user nova-compute[75122]:     </video>
Nov 15 09:26:11 user nova-compute[75122]:     <hostdev supported='yes'>
Nov 15 09:26:11 user nova-compute[75122]:       <enum name='mode'>
Nov 15 09:26:11 user nova-compute[75122]:         <value>subsystem</value>
Nov 15 09:26:11 user nova-compute[75122]:       </enum>
Nov 15 09:26:11 user nova-compute[75122]:       <enum name='startupPolicy'>
Nov 15 09:26:11 user nova-compute[75122]:         <value>default</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>mandatory</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>requisite</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>optional</value>
Nov 15 09:26:11 user nova-compute[75122]:       </enum>
Nov 15 09:26:11 user nova-compute[75122]:       <enum name='subsysType'>
Nov 15 09:26:11 user nova-compute[75122]:         <value>usb</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>pci</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>scsi</value>
Nov 15 09:26:11 user nova-compute[75122]:       </enum>
Nov 15 09:26:11 user nova-compute[75122]:       <enum name='capsType'/>
Nov 15 09:26:11 user nova-compute[75122]:       <enum name='pciBackend'/>
Nov 15 09:26:11 user nova-compute[75122]:     </hostdev>
Nov 15 09:26:11 user nova-compute[75122]:     <rng supported='yes'>
Nov 15 09:26:11 user nova-compute[75122]:       <enum name='model'>
Nov 15 09:26:11 user nova-compute[75122]:         <value>virtio</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>virtio-transitional</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>virtio-non-transitional</value>
Nov 15 09:26:11 user nova-compute[75122]:       </enum>
Nov 15 09:26:11 user nova-compute[75122]:       <enum name='backendModel'>
Nov 15 09:26:11 user nova-compute[75122]:         <value>random</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>egd</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>builtin</value>
Nov 15 09:26:11 user nova-compute[75122]:       </enum>
Nov 15 09:26:11 user nova-compute[75122]:     </rng>
Nov 15 09:26:11 user nova-compute[75122]:     <filesystem supported='yes'>
Nov 15 09:26:11 user nova-compute[75122]:       <enum name='driverType'>
Nov 15 09:26:11 user nova-compute[75122]:         <value>path</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>handle</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>virtiofs</value>
Nov 15 09:26:11 user nova-compute[75122]:       </enum>
Nov 15 09:26:11 user nova-compute[75122]:     </filesystem>
Nov 15 09:26:11 user nova-compute[75122]:     <tpm supported='yes'>
Nov 15 09:26:11 user nova-compute[75122]:       <enum name='model'>
Nov 15 09:26:11 user nova-compute[75122]:         <value>tpm-tis</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>tpm-crb</value>
Nov 15 09:26:11 user nova-compute[75122]:       </enum>
Nov 15 09:26:11 user nova-compute[75122]:       <enum name='backendModel'>
Nov 15 09:26:11 user nova-compute[75122]:         <value>passthrough</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>emulator</value>
Nov 15 09:26:11 user nova-compute[75122]:       </enum>
Nov 15 09:26:11 user nova-compute[75122]:     </tpm>
Nov 15 09:26:11 user nova-compute[75122]:   </devices>
Nov 15 09:26:11 user nova-compute[75122]:   <features>
Nov 15 09:26:11 user nova-compute[75122]:     <gic supported='no'/>
Nov 15 09:26:11 user nova-compute[75122]:     <vmcoreinfo supported='yes'/>
Nov 15 09:26:11 user nova-compute[75122]:     <genid supported='yes'/>
Nov 15 09:26:11 user nova-compute[75122]:     <backingStoreInput supported='yes'/>
Nov 15 09:26:11 user nova-compute[75122]:     <backup supported='yes'/>
Nov 15 09:26:11 user nova-compute[75122]:     <sev supported='no'/>
Nov 15 09:26:11 user nova-compute[75122]:   </features>
Nov 15 09:26:11 user nova-compute[75122]: </domainCapabilities>
Nov 15 09:26:11 user nova-compute[75122]:  {{(pid=75122) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 15 09:26:11 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-e8ea3e7f-0f31-4ed5-bb91-0a8586257ac0 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Nov 15 09:26:11 user nova-compute[75122]: <domainCapabilities>
Nov 15 09:26:11 user nova-compute[75122]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 15 09:26:11 user nova-compute[75122]:   <domain>kvm</domain>
Nov 15 09:26:11 user nova-compute[75122]:   <machine>pc-q35-jammy</machine>
Nov 15 09:26:11 user nova-compute[75122]:   <arch>x86_64</arch>
Nov 15 09:26:11 user nova-compute[75122]:   <vcpu max='288'/>
Nov 15 09:26:11 user nova-compute[75122]:   <iothreads supported='yes'/>
Nov 15 09:26:11 user nova-compute[75122]:   <os supported='yes'>
Nov 15 09:26:11 user nova-compute[75122]:     <enum name='firmware'>
Nov 15 09:26:11 user nova-compute[75122]:       <value>efi</value>
Nov 15 09:26:11 user nova-compute[75122]:     </enum>
Nov 15 09:26:11 user nova-compute[75122]:     <loader supported='yes'>
Nov 15 09:26:11 user nova-compute[75122]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 15 09:26:11 user nova-compute[75122]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 15 09:26:11 user nova-compute[75122]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 15 09:26:11 user nova-compute[75122]:       <enum name='type'>
Nov 15 09:26:11 user nova-compute[75122]:         <value>rom</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>pflash</value>
Nov 15 09:26:11 user nova-compute[75122]:       </enum>
Nov 15 09:26:11 user nova-compute[75122]:       <enum name='readonly'>
Nov 15 09:26:11 user nova-compute[75122]:         <value>yes</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>no</value>
Nov 15 09:26:11 user nova-compute[75122]:       </enum>
Nov 15 09:26:11 user nova-compute[75122]:       <enum name='secure'>
Nov 15 09:26:11 user nova-compute[75122]:         <value>yes</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>no</value>
Nov 15 09:26:11 user nova-compute[75122]:       </enum>
Nov 15 09:26:11 user nova-compute[75122]:     </loader>
Nov 15 09:26:11 user nova-compute[75122]:   </os>
Nov 15 09:26:11 user nova-compute[75122]:   <cpu>
Nov 15 09:26:11 user nova-compute[75122]:     <mode name='host-passthrough' supported='yes'>
Nov 15 09:26:11 user nova-compute[75122]:       <enum name='hostPassthroughMigratable'>
Nov 15 09:26:11 user nova-compute[75122]:         <value>on</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>off</value>
Nov 15 09:26:11 user nova-compute[75122]:       </enum>
Nov 15 09:26:11 user nova-compute[75122]:     </mode>
Nov 15 09:26:11 user nova-compute[75122]:     <mode name='maximum' supported='yes'>
Nov 15 09:26:11 user nova-compute[75122]:       <enum name='maximumMigratable'>
Nov 15 09:26:11 user nova-compute[75122]:         <value>on</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>off</value>
Nov 15 09:26:11 user nova-compute[75122]:       </enum>
Nov 15 09:26:11 user nova-compute[75122]:     </mode>
Nov 15 09:26:11 user nova-compute[75122]:     <mode name='host-model' supported='yes'>
Nov 15 09:26:11 user nova-compute[75122]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 15 09:26:11 user nova-compute[75122]:       <vendor>Intel</vendor>
Nov 15 09:26:11 user nova-compute[75122]:       <feature policy='require' name='ss'/>
Nov 15 09:26:11 user nova-compute[75122]:       <feature policy='require' name='vmx'/>
Nov 15 09:26:11 user nova-compute[75122]:       <feature policy='require' name='pcid'/>
Nov 15 09:26:11 user nova-compute[75122]:       <feature policy='require' name='hypervisor'/>
Nov 15 09:26:11 user nova-compute[75122]:       <feature policy='require' name='arat'/>
Nov 15 09:26:11 user nova-compute[75122]:       <feature policy='require' name='tsc_adjust'/>
Nov 15 09:26:11 user nova-compute[75122]:       <feature policy='require' name='umip'/>
Nov 15 09:26:11 user nova-compute[75122]:       <feature policy='require' name='md-clear'/>
Nov 15 09:26:11 user nova-compute[75122]:       <feature policy='require' name='stibp'/>
Nov 15 09:26:11 user nova-compute[75122]:       <feature policy='require' name='arch-capabilities'/>
Nov 15 09:26:11 user nova-compute[75122]:       <feature policy='require' name='ssbd'/>
Nov 15 09:26:11 user nova-compute[75122]:       <feature policy='require' name='invtsc'/>
Nov 15 09:26:11 user nova-compute[75122]:       <feature policy='require' name='ibpb'/>
Nov 15 09:26:11 user nova-compute[75122]:       <feature policy='require' name='ibrs'/>
Nov 15 09:26:11 user nova-compute[75122]:       <feature policy='require' name='amd-stibp'/>
Nov 15 09:26:11 user nova-compute[75122]:       <feature policy='require' name='amd-ssbd'/>
Nov 15 09:26:11 user nova-compute[75122]:       <feature policy='require' name='rsba'/>
Nov 15 09:26:11 user nova-compute[75122]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 15 09:26:11 user nova-compute[75122]:       <feature policy='require' name='pschange-mc-no'/>
Nov 15 09:26:11 user nova-compute[75122]:       <feature policy='disable' name='erms'/>
Nov 15 09:26:11 user nova-compute[75122]:       <feature policy='disable' name='xsaveopt'/>
Nov 15 09:26:11 user nova-compute[75122]:     </mode>
Nov 15 09:26:11 user nova-compute[75122]:     <mode name='custom' supported='yes'>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>qemu64</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='yes'>qemu32</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>phenom</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='yes'>pentium3</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='yes'>pentium2</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='yes'>pentium</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>n270</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='yes'>kvm64</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='yes'>kvm32</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='yes'>coreduo</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='yes'>core2duo</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>athlon</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='yes'>Westmere-IBRS</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='yes'>Westmere</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>Snowridge</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>Skylake-Server</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>Skylake-Client</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>SandyBridge</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='yes'>Penryn</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>Opteron_G5</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>Opteron_G4</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>Opteron_G3</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>Opteron_G2</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='yes'>Opteron_G1</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='yes'>Nehalem</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>IvyBridge</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>Icelake-Server</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>Haswell-noTSX</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>Haswell-IBRS</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>Haswell</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>EPYC-Rome</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>EPYC-Milan</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>EPYC-IBPB</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>EPYC</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>Dhyana</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>Cooperlake</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='yes'>Conroe</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>Cascadelake-Server</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>Broadwell-noTSX</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>Broadwell-IBRS</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>Broadwell</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='yes'>486</model>
Nov 15 09:26:11 user nova-compute[75122]:     </mode>
Nov 15 09:26:11 user nova-compute[75122]:   </cpu>
Nov 15 09:26:11 user nova-compute[75122]:   <memoryBacking supported='yes'>
Nov 15 09:26:11 user nova-compute[75122]:     <enum name='sourceType'>
Nov 15 09:26:11 user nova-compute[75122]:       <value>file</value>
Nov 15 09:26:11 user nova-compute[75122]:       <value>anonymous</value>
Nov 15 09:26:11 user nova-compute[75122]:       <value>memfd</value>
Nov 15 09:26:11 user nova-compute[75122]:     </enum>
Nov 15 09:26:11 user nova-compute[75122]:   </memoryBacking>
Nov 15 09:26:11 user nova-compute[75122]:   <devices>
Nov 15 09:26:11 user nova-compute[75122]:     <disk supported='yes'>
Nov 15 09:26:11 user nova-compute[75122]:       <enum name='diskDevice'>
Nov 15 09:26:11 user nova-compute[75122]:         <value>disk</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>cdrom</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>floppy</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>lun</value>
Nov 15 09:26:11 user nova-compute[75122]:       </enum>
Nov 15 09:26:11 user nova-compute[75122]:       <enum name='bus'>
Nov 15 09:26:11 user nova-compute[75122]:         <value>fdc</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>scsi</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>virtio</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>usb</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>sata</value>
Nov 15 09:26:11 user nova-compute[75122]:       </enum>
Nov 15 09:26:11 user nova-compute[75122]:       <enum name='model'>
Nov 15 09:26:11 user nova-compute[75122]:         <value>virtio</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>virtio-transitional</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>virtio-non-transitional</value>
Nov 15 09:26:11 user nova-compute[75122]:       </enum>
Nov 15 09:26:11 user nova-compute[75122]:     </disk>
Nov 15 09:26:11 user nova-compute[75122]:     <graphics supported='yes'>
Nov 15 09:26:11 user nova-compute[75122]:       <enum name='type'>
Nov 15 09:26:11 user nova-compute[75122]:         <value>sdl</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>vnc</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>spice</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>egl-headless</value>
Nov 15 09:26:11 user nova-compute[75122]:       </enum>
Nov 15 09:26:11 user nova-compute[75122]:     </graphics>
Nov 15 09:26:11 user nova-compute[75122]:     <video supported='yes'>
Nov 15 09:26:11 user nova-compute[75122]:       <enum name='modelType'>
Nov 15 09:26:11 user nova-compute[75122]:         <value>vga</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>cirrus</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>vmvga</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>qxl</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>virtio</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>none</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>bochs</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>ramfb</value>
Nov 15 09:26:11 user nova-compute[75122]:       </enum>
Nov 15 09:26:11 user nova-compute[75122]:     </video>
Nov 15 09:26:11 user nova-compute[75122]:     <hostdev supported='yes'>
Nov 15 09:26:11 user nova-compute[75122]:       <enum name='mode'>
Nov 15 09:26:11 user nova-compute[75122]:         <value>subsystem</value>
Nov 15 09:26:11 user nova-compute[75122]:       </enum>
Nov 15 09:26:11 user nova-compute[75122]:       <enum name='startupPolicy'>
Nov 15 09:26:11 user nova-compute[75122]:         <value>default</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>mandatory</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>requisite</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>optional</value>
Nov 15 09:26:11 user nova-compute[75122]:       </enum>
Nov 15 09:26:11 user nova-compute[75122]:       <enum name='subsysType'>
Nov 15 09:26:11 user nova-compute[75122]:         <value>usb</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>pci</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>scsi</value>
Nov 15 09:26:11 user nova-compute[75122]:       </enum>
Nov 15 09:26:11 user nova-compute[75122]:       <enum name='capsType'/>
Nov 15 09:26:11 user nova-compute[75122]:       <enum name='pciBackend'/>
Nov 15 09:26:11 user nova-compute[75122]:     </hostdev>
Nov 15 09:26:11 user nova-compute[75122]:     <rng supported='yes'>
Nov 15 09:26:11 user nova-compute[75122]:       <enum name='model'>
Nov 15 09:26:11 user nova-compute[75122]:         <value>virtio</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>virtio-transitional</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>virtio-non-transitional</value>
Nov 15 09:26:11 user nova-compute[75122]:       </enum>
Nov 15 09:26:11 user nova-compute[75122]:       <enum name='backendModel'>
Nov 15 09:26:11 user nova-compute[75122]:         <value>random</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>egd</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>builtin</value>
Nov 15 09:26:11 user nova-compute[75122]:       </enum>
Nov 15 09:26:11 user nova-compute[75122]:     </rng>
Nov 15 09:26:11 user nova-compute[75122]:     <filesystem supported='yes'>
Nov 15 09:26:11 user nova-compute[75122]:       <enum name='driverType'>
Nov 15 09:26:11 user nova-compute[75122]:         <value>path</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>handle</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>virtiofs</value>
Nov 15 09:26:11 user nova-compute[75122]:       </enum>
Nov 15 09:26:11 user nova-compute[75122]:     </filesystem>
Nov 15 09:26:11 user nova-compute[75122]:     <tpm supported='yes'>
Nov 15 09:26:11 user nova-compute[75122]:       <enum name='model'>
Nov 15 09:26:11 user nova-compute[75122]:         <value>tpm-tis</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>tpm-crb</value>
Nov 15 09:26:11 user nova-compute[75122]:       </enum>
Nov 15 09:26:11 user nova-compute[75122]:       <enum name='backendModel'>
Nov 15 09:26:11 user nova-compute[75122]:         <value>passthrough</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>emulator</value>
Nov 15 09:26:11 user nova-compute[75122]:       </enum>
Nov 15 09:26:11 user nova-compute[75122]:     </tpm>
Nov 15 09:26:11 user nova-compute[75122]:   </devices>
Nov 15 09:26:11 user nova-compute[75122]:   <features>
Nov 15 09:26:11 user nova-compute[75122]:     <gic supported='no'/>
Nov 15 09:26:11 user nova-compute[75122]:     <vmcoreinfo supported='yes'/>
Nov 15 09:26:11 user nova-compute[75122]:     <genid supported='yes'/>
Nov 15 09:26:11 user nova-compute[75122]:     <backingStoreInput supported='yes'/>
Nov 15 09:26:11 user nova-compute[75122]:     <backup supported='yes'/>
Nov 15 09:26:11 user nova-compute[75122]:     <sev supported='no'/>
Nov 15 09:26:11 user nova-compute[75122]:   </features>
Nov 15 09:26:11 user nova-compute[75122]: </domainCapabilities>
Nov 15 09:26:11 user nova-compute[75122]:  {{(pid=75122) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 15 09:26:11 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-e8ea3e7f-0f31-4ed5-bb91-0a8586257ac0 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Nov 15 09:26:11 user nova-compute[75122]: <domainCapabilities>
Nov 15 09:26:11 user nova-compute[75122]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 15 09:26:11 user nova-compute[75122]:   <domain>kvm</domain>
Nov 15 09:26:11 user nova-compute[75122]:   <machine>pc-q35-6.2</machine>
Nov 15 09:26:11 user nova-compute[75122]:   <arch>x86_64</arch>
Nov 15 09:26:11 user nova-compute[75122]:   <vcpu max='288'/>
Nov 15 09:26:11 user nova-compute[75122]:   <iothreads supported='yes'/>
Nov 15 09:26:11 user nova-compute[75122]:   <os supported='yes'>
Nov 15 09:26:11 user nova-compute[75122]:     <enum name='firmware'>
Nov 15 09:26:11 user nova-compute[75122]:       <value>efi</value>
Nov 15 09:26:11 user nova-compute[75122]:     </enum>
Nov 15 09:26:11 user nova-compute[75122]:     <loader supported='yes'>
Nov 15 09:26:11 user nova-compute[75122]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 15 09:26:11 user nova-compute[75122]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 15 09:26:11 user nova-compute[75122]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 15 09:26:11 user nova-compute[75122]:       <enum name='type'>
Nov 15 09:26:11 user nova-compute[75122]:         <value>rom</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>pflash</value>
Nov 15 09:26:11 user nova-compute[75122]:       </enum>
Nov 15 09:26:11 user nova-compute[75122]:       <enum name='readonly'>
Nov 15 09:26:11 user nova-compute[75122]:         <value>yes</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>no</value>
Nov 15 09:26:11 user nova-compute[75122]:       </enum>
Nov 15 09:26:11 user nova-compute[75122]:       <enum name='secure'>
Nov 15 09:26:11 user nova-compute[75122]:         <value>yes</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>no</value>
Nov 15 09:26:11 user nova-compute[75122]:       </enum>
Nov 15 09:26:11 user nova-compute[75122]:     </loader>
Nov 15 09:26:11 user nova-compute[75122]:   </os>
Nov 15 09:26:11 user nova-compute[75122]:   <cpu>
Nov 15 09:26:11 user nova-compute[75122]:     <mode name='host-passthrough' supported='yes'>
Nov 15 09:26:11 user nova-compute[75122]:       <enum name='hostPassthroughMigratable'>
Nov 15 09:26:11 user nova-compute[75122]:         <value>on</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>off</value>
Nov 15 09:26:11 user nova-compute[75122]:       </enum>
Nov 15 09:26:11 user nova-compute[75122]:     </mode>
Nov 15 09:26:11 user nova-compute[75122]:     <mode name='maximum' supported='yes'>
Nov 15 09:26:11 user nova-compute[75122]:       <enum name='maximumMigratable'>
Nov 15 09:26:11 user nova-compute[75122]:         <value>on</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>off</value>
Nov 15 09:26:11 user nova-compute[75122]:       </enum>
Nov 15 09:26:11 user nova-compute[75122]:     </mode>
Nov 15 09:26:11 user nova-compute[75122]:     <mode name='host-model' supported='yes'>
Nov 15 09:26:11 user nova-compute[75122]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 15 09:26:11 user nova-compute[75122]:       <vendor>Intel</vendor>
Nov 15 09:26:11 user nova-compute[75122]:       <feature policy='require' name='ss'/>
Nov 15 09:26:11 user nova-compute[75122]:       <feature policy='require' name='vmx'/>
Nov 15 09:26:11 user nova-compute[75122]:       <feature policy='require' name='pcid'/>
Nov 15 09:26:11 user nova-compute[75122]:       <feature policy='require' name='hypervisor'/>
Nov 15 09:26:11 user nova-compute[75122]:       <feature policy='require' name='arat'/>
Nov 15 09:26:11 user nova-compute[75122]:       <feature policy='require' name='tsc_adjust'/>
Nov 15 09:26:11 user nova-compute[75122]:       <feature policy='require' name='umip'/>
Nov 15 09:26:11 user nova-compute[75122]:       <feature policy='require' name='md-clear'/>
Nov 15 09:26:11 user nova-compute[75122]:       <feature policy='require' name='stibp'/>
Nov 15 09:26:11 user nova-compute[75122]:       <feature policy='require' name='arch-capabilities'/>
Nov 15 09:26:11 user nova-compute[75122]:       <feature policy='require' name='ssbd'/>
Nov 15 09:26:11 user nova-compute[75122]:       <feature policy='require' name='invtsc'/>
Nov 15 09:26:11 user nova-compute[75122]:       <feature policy='require' name='ibpb'/>
Nov 15 09:26:11 user nova-compute[75122]:       <feature policy='require' name='ibrs'/>
Nov 15 09:26:11 user nova-compute[75122]:       <feature policy='require' name='amd-stibp'/>
Nov 15 09:26:11 user nova-compute[75122]:       <feature policy='require' name='amd-ssbd'/>
Nov 15 09:26:11 user nova-compute[75122]:       <feature policy='require' name='rsba'/>
Nov 15 09:26:11 user nova-compute[75122]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 15 09:26:11 user nova-compute[75122]:       <feature policy='require' name='pschange-mc-no'/>
Nov 15 09:26:11 user nova-compute[75122]:       <feature policy='disable' name='erms'/>
Nov 15 09:26:11 user nova-compute[75122]:       <feature policy='disable' name='xsaveopt'/>
Nov 15 09:26:11 user nova-compute[75122]:     </mode>
Nov 15 09:26:11 user nova-compute[75122]:     <mode name='custom' supported='yes'>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>qemu64</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='yes'>qemu32</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>phenom</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='yes'>pentium3</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='yes'>pentium2</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='yes'>pentium</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>n270</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='yes'>kvm64</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='yes'>kvm32</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='yes'>coreduo</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='yes'>core2duo</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>athlon</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='yes'>Westmere-IBRS</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='yes'>Westmere</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>Snowridge</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>Skylake-Server</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>Skylake-Client</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>SandyBridge</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='yes'>Penryn</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>Opteron_G5</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>Opteron_G4</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>Opteron_G3</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>Opteron_G2</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='yes'>Opteron_G1</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='yes'>Nehalem</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>IvyBridge</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>Icelake-Server</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>Haswell-noTSX</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>Haswell-IBRS</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>Haswell</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>EPYC-Rome</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>EPYC-Milan</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>EPYC-IBPB</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>EPYC</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>Dhyana</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>Cooperlake</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='yes'>Conroe</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>Cascadelake-Server</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>Broadwell-noTSX</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>Broadwell-IBRS</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='no'>Broadwell</model>
Nov 15 09:26:11 user nova-compute[75122]:       <model usable='yes'>486</model>
Nov 15 09:26:11 user nova-compute[75122]:     </mode>
Nov 15 09:26:11 user nova-compute[75122]:   </cpu>
Nov 15 09:26:11 user nova-compute[75122]:   <memoryBacking supported='yes'>
Nov 15 09:26:11 user nova-compute[75122]:     <enum name='sourceType'>
Nov 15 09:26:11 user nova-compute[75122]:       <value>file</value>
Nov 15 09:26:11 user nova-compute[75122]:       <value>anonymous</value>
Nov 15 09:26:11 user nova-compute[75122]:       <value>memfd</value>
Nov 15 09:26:11 user nova-compute[75122]:     </enum>
Nov 15 09:26:11 user nova-compute[75122]:   </memoryBacking>
Nov 15 09:26:11 user nova-compute[75122]:   <devices>
Nov 15 09:26:11 user nova-compute[75122]:     <disk supported='yes'>
Nov 15 09:26:11 user nova-compute[75122]:       <enum name='diskDevice'>
Nov 15 09:26:11 user nova-compute[75122]:         <value>disk</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>cdrom</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>floppy</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>lun</value>
Nov 15 09:26:11 user nova-compute[75122]:       </enum>
Nov 15 09:26:11 user nova-compute[75122]:       <enum name='bus'>
Nov 15 09:26:11 user nova-compute[75122]:         <value>fdc</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>scsi</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>virtio</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>usb</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>sata</value>
Nov 15 09:26:11 user nova-compute[75122]:       </enum>
Nov 15 09:26:11 user nova-compute[75122]:       <enum name='model'>
Nov 15 09:26:11 user nova-compute[75122]:         <value>virtio</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>virtio-transitional</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>virtio-non-transitional</value>
Nov 15 09:26:11 user nova-compute[75122]:       </enum>
Nov 15 09:26:11 user nova-compute[75122]:     </disk>
Nov 15 09:26:11 user nova-compute[75122]:     <graphics supported='yes'>
Nov 15 09:26:11 user nova-compute[75122]:       <enum name='type'>
Nov 15 09:26:11 user nova-compute[75122]:         <value>sdl</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>vnc</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>spice</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>egl-headless</value>
Nov 15 09:26:11 user nova-compute[75122]:       </enum>
Nov 15 09:26:11 user nova-compute[75122]:     </graphics>
Nov 15 09:26:11 user nova-compute[75122]:     <video supported='yes'>
Nov 15 09:26:11 user nova-compute[75122]:       <enum name='modelType'>
Nov 15 09:26:11 user nova-compute[75122]:         <value>vga</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>cirrus</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>vmvga</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>qxl</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>virtio</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>none</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>bochs</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>ramfb</value>
Nov 15 09:26:11 user nova-compute[75122]:       </enum>
Nov 15 09:26:11 user nova-compute[75122]:     </video>
Nov 15 09:26:11 user nova-compute[75122]:     <hostdev supported='yes'>
Nov 15 09:26:11 user nova-compute[75122]:       <enum name='mode'>
Nov 15 09:26:11 user nova-compute[75122]:         <value>subsystem</value>
Nov 15 09:26:11 user nova-compute[75122]:       </enum>
Nov 15 09:26:11 user nova-compute[75122]:       <enum name='startupPolicy'>
Nov 15 09:26:11 user nova-compute[75122]:         <value>default</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>mandatory</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>requisite</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>optional</value>
Nov 15 09:26:11 user nova-compute[75122]:       </enum>
Nov 15 09:26:11 user nova-compute[75122]:       <enum name='subsysType'>
Nov 15 09:26:11 user nova-compute[75122]:         <value>usb</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>pci</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>scsi</value>
Nov 15 09:26:11 user nova-compute[75122]:       </enum>
Nov 15 09:26:11 user nova-compute[75122]:       <enum name='capsType'/>
Nov 15 09:26:11 user nova-compute[75122]:       <enum name='pciBackend'/>
Nov 15 09:26:11 user nova-compute[75122]:     </hostdev>
Nov 15 09:26:11 user nova-compute[75122]:     <rng supported='yes'>
Nov 15 09:26:11 user nova-compute[75122]:       <enum name='model'>
Nov 15 09:26:11 user nova-compute[75122]:         <value>virtio</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>virtio-transitional</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>virtio-non-transitional</value>
Nov 15 09:26:11 user nova-compute[75122]:       </enum>
Nov 15 09:26:11 user nova-compute[75122]:       <enum name='backendModel'>
Nov 15 09:26:11 user nova-compute[75122]:         <value>random</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>egd</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>builtin</value>
Nov 15 09:26:11 user nova-compute[75122]:       </enum>
Nov 15 09:26:11 user nova-compute[75122]:     </rng>
Nov 15 09:26:11 user nova-compute[75122]:     <filesystem supported='yes'>
Nov 15 09:26:11 user nova-compute[75122]:       <enum name='driverType'>
Nov 15 09:26:11 user nova-compute[75122]:         <value>path</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>handle</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>virtiofs</value>
Nov 15 09:26:11 user nova-compute[75122]:       </enum>
Nov 15 09:26:11 user nova-compute[75122]:     </filesystem>
Nov 15 09:26:11 user nova-compute[75122]:     <tpm supported='yes'>
Nov 15 09:26:11 user nova-compute[75122]:       <enum name='model'>
Nov 15 09:26:11 user nova-compute[75122]:         <value>tpm-tis</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>tpm-crb</value>
Nov 15 09:26:11 user nova-compute[75122]:       </enum>
Nov 15 09:26:11 user nova-compute[75122]:       <enum name='backendModel'>
Nov 15 09:26:11 user nova-compute[75122]:         <value>passthrough</value>
Nov 15 09:26:11 user nova-compute[75122]:         <value>emulator</value>
Nov 15 09:26:11 user nova-compute[75122]:       </enum>
Nov 15 09:26:11 user nova-compute[75122]:     </tpm>
Nov 15 09:26:11 user nova-compute[75122]:   </devices>
Nov 15 09:26:11 user nova-compute[75122]:   <features>
Nov 15 09:26:11 user nova-compute[75122]:     <gic supported='no'/>
Nov 15 09:26:11 user nova-compute[75122]:     <vmcoreinfo supported='yes'/>
Nov 15 09:26:11 user nova-compute[75122]:     <genid supported='yes'/>
Nov 15 09:26:11 user nova-compute[75122]:     <backingStoreInput supported='yes'/>
Nov 15 09:26:11 user nova-compute[75122]:     <backup supported='yes'/>
Nov 15 09:26:11 user nova-compute[75122]:     <sev supported='no'/>
Nov 15 09:26:11 user nova-compute[75122]:   </features>
Nov 15 09:26:11 user nova-compute[75122]: </domainCapabilities>
Nov 15 09:26:11 user nova-compute[75122]:  {{(pid=75122) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 15 09:26:11 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-e8ea3e7f-0f31-4ed5-bb91-0a8586257ac0 None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=75122) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 09:26:11 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-e8ea3e7f-0f31-4ed5-bb91-0a8586257ac0 None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=75122) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 09:26:11 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-e8ea3e7f-0f31-4ed5-bb91-0a8586257ac0 None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=75122) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 09:26:11 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-e8ea3e7f-0f31-4ed5-bb91-0a8586257ac0 None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=75122) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 09:26:11 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-e8ea3e7f-0f31-4ed5-bb91-0a8586257ac0 None None] Checking secure boot support for host arch (x86_64) {{(pid=75122) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 15 09:26:11 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-e8ea3e7f-0f31-4ed5-bb91-0a8586257ac0 None None] Checking secure boot support for host arch (x86_64) {{(pid=75122) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 15 09:26:11 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-e8ea3e7f-0f31-4ed5-bb91-0a8586257ac0 None None] Checking secure boot support for host arch (x86_64) {{(pid=75122) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 15 09:26:11 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-e8ea3e7f-0f31-4ed5-bb91-0a8586257ac0 None None] Checking secure boot support for host arch (x86_64) {{(pid=75122) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 15 09:26:11 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-e8ea3e7f-0f31-4ed5-bb91-0a8586257ac0 None None] Checking secure boot support for host arch (x86_64) {{(pid=75122) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 15 09:26:11 user nova-compute[75122]: INFO nova.virt.libvirt.host [None req-e8ea3e7f-0f31-4ed5-bb91-0a8586257ac0 None None] Secure Boot support detected
Nov 15 09:26:11 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-e8ea3e7f-0f31-4ed5-bb91-0a8586257ac0 None None] cpu compare xml: <cpu match="exact">
Nov 15 09:26:11 user nova-compute[75122]:   <model>Nehalem</model>
Nov 15 09:26:11 user nova-compute[75122]: </cpu>
Nov 15 09:26:11 user nova-compute[75122]:  {{(pid=75122) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Nov 15 09:26:11 user nova-compute[75122]: INFO nova.virt.node [None req-e8ea3e7f-0f31-4ed5-bb91-0a8586257ac0 None None] Generated node identity 69a3da65-47be-44c6-b67c-c692b58284ef
Nov 15 09:26:11 user nova-compute[75122]: INFO nova.virt.node [None req-e8ea3e7f-0f31-4ed5-bb91-0a8586257ac0 None None] Wrote node identity 69a3da65-47be-44c6-b67c-c692b58284ef to /opt/stack/data/nova/compute_id
Nov 15 09:26:11 user nova-compute[75122]: WARNING nova.compute.manager [None req-e8ea3e7f-0f31-4ed5-bb91-0a8586257ac0 None None] Compute nodes ['69a3da65-47be-44c6-b67c-c692b58284ef'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Nov 15 09:26:11 user nova-compute[75122]: INFO nova.compute.manager [None req-e8ea3e7f-0f31-4ed5-bb91-0a8586257ac0 None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Nov 15 09:26:11 user nova-compute[75122]: WARNING nova.compute.manager [None req-e8ea3e7f-0f31-4ed5-bb91-0a8586257ac0 None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 15 09:26:11 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-e8ea3e7f-0f31-4ed5-bb91-0a8586257ac0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:26:11 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-e8ea3e7f-0f31-4ed5-bb91-0a8586257ac0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:26:11 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-e8ea3e7f-0f31-4ed5-bb91-0a8586257ac0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:26:11 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-e8ea3e7f-0f31-4ed5-bb91-0a8586257ac0 None None] Auditing locally available compute resources for user (node: user) {{(pid=75122) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 09:26:11 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-e8ea3e7f-0f31-4ed5-bb91-0a8586257ac0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 09:26:11 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-e8ea3e7f-0f31-4ed5-bb91-0a8586257ac0 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 09:26:11 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-e8ea3e7f-0f31-4ed5-bb91-0a8586257ac0 None None] Hypervisor/Node resource view: name=user free_ram=10967MB free_disk=26.18337631225586GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75122) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 09:26:11 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-e8ea3e7f-0f31-4ed5-bb91-0a8586257ac0 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:26:11 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-e8ea3e7f-0f31-4ed5-bb91-0a8586257ac0 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:26:11 user nova-compute[75122]: WARNING nova.compute.resource_tracker [None req-e8ea3e7f-0f31-4ed5-bb91-0a8586257ac0 None None] No compute node record for user:69a3da65-47be-44c6-b67c-c692b58284ef: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host 69a3da65-47be-44c6-b67c-c692b58284ef could not be found.
Nov 15 09:26:11 user nova-compute[75122]: INFO nova.compute.resource_tracker [None req-e8ea3e7f-0f31-4ed5-bb91-0a8586257ac0 None None] Compute node record created for user:user with uuid: 69a3da65-47be-44c6-b67c-c692b58284ef
Nov 15 09:26:11 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-e8ea3e7f-0f31-4ed5-bb91-0a8586257ac0 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75122) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 09:26:11 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-e8ea3e7f-0f31-4ed5-bb91-0a8586257ac0 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75122) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 09:26:11 user nova-compute[75122]: INFO nova.scheduler.client.report [None req-e8ea3e7f-0f31-4ed5-bb91-0a8586257ac0 None None] [req-daad0959-9453-4377-b46c-8d82f6581cdf] Created resource provider record via placement API for resource provider with UUID 69a3da65-47be-44c6-b67c-c692b58284ef and name user.
Nov 15 09:26:11 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-e8ea3e7f-0f31-4ed5-bb91-0a8586257ac0 None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=75122) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Nov 15 09:26:11 user nova-compute[75122]: INFO nova.virt.libvirt.host [None req-e8ea3e7f-0f31-4ed5-bb91-0a8586257ac0 None None] kernel doesn't support AMD SEV
Nov 15 09:26:11 user nova-compute[75122]: DEBUG nova.compute.provider_tree [None req-e8ea3e7f-0f31-4ed5-bb91-0a8586257ac0 None None] Updating inventory in ProviderTree for provider 69a3da65-47be-44c6-b67c-c692b58284ef with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=75122) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 15 09:26:11 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-e8ea3e7f-0f31-4ed5-bb91-0a8586257ac0 None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75122) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 09:26:11 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-e8ea3e7f-0f31-4ed5-bb91-0a8586257ac0 None None] Libvirt baseline CPU <cpu>
Nov 15 09:26:11 user nova-compute[75122]:   <arch>x86_64</arch>
Nov 15 09:26:11 user nova-compute[75122]:   <model>Nehalem</model>
Nov 15 09:26:11 user nova-compute[75122]:   <vendor>Intel</vendor>
Nov 15 09:26:11 user nova-compute[75122]:   <topology sockets="6" cores="1" threads="1"/>
Nov 15 09:26:11 user nova-compute[75122]: </cpu>
Nov 15 09:26:11 user nova-compute[75122]:  {{(pid=75122) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Nov 15 09:26:11 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-e8ea3e7f-0f31-4ed5-bb91-0a8586257ac0 None None] Updated inventory for provider 69a3da65-47be-44c6-b67c-c692b58284ef with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=75122) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Nov 15 09:26:11 user nova-compute[75122]: DEBUG nova.compute.provider_tree [None req-e8ea3e7f-0f31-4ed5-bb91-0a8586257ac0 None None] Updating resource provider 69a3da65-47be-44c6-b67c-c692b58284ef generation from 0 to 1 during operation: update_inventory {{(pid=75122) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 15 09:26:11 user nova-compute[75122]: DEBUG nova.compute.provider_tree [None req-e8ea3e7f-0f31-4ed5-bb91-0a8586257ac0 None None] Updating inventory in ProviderTree for provider 69a3da65-47be-44c6-b67c-c692b58284ef with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 15 09:26:12 user nova-compute[75122]: DEBUG nova.compute.provider_tree [None req-e8ea3e7f-0f31-4ed5-bb91-0a8586257ac0 None None] Updating resource provider 69a3da65-47be-44c6-b67c-c692b58284ef generation from 1 to 2 during operation: update_traits {{(pid=75122) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 15 09:26:12 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-e8ea3e7f-0f31-4ed5-bb91-0a8586257ac0 None None] Compute_service record updated for user:user {{(pid=75122) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 09:26:12 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-e8ea3e7f-0f31-4ed5-bb91-0a8586257ac0 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.618s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:26:12 user nova-compute[75122]: DEBUG nova.service [None req-e8ea3e7f-0f31-4ed5-bb91-0a8586257ac0 None None] Creating RPC server for service compute {{(pid=75122) start /opt/stack/nova/nova/service.py:182}}
Nov 15 09:26:12 user nova-compute[75122]: DEBUG nova.service [None req-e8ea3e7f-0f31-4ed5-bb91-0a8586257ac0 None None] Join ServiceGroup membership for this service compute {{(pid=75122) start /opt/stack/nova/nova/service.py:199}}
Nov 15 09:26:12 user nova-compute[75122]: DEBUG nova.servicegroup.drivers.db [None req-e8ea3e7f-0f31-4ed5-bb91-0a8586257ac0 None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=75122) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Nov 15 09:26:32 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:26:32 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:27:03 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:27:03 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:27:03 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Starting heal instance info cache {{(pid=75122) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 09:27:03 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Rebuilding the list of instances to heal {{(pid=75122) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 09:27:03 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Didn't find any instances for network info cache update. {{(pid=75122) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 15 09:27:03 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:27:03 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:27:03 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:27:03 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:27:03 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:27:03 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:27:03 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75122) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 09:27:03 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:27:03 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:27:03 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:27:03 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:27:03 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75122) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 09:27:03 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 09:27:03 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 09:27:03 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Hypervisor/Node resource view: name=user free_ram=10389MB free_disk=26.08724594116211GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75122) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 09:27:03 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:27:03 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:27:03 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75122) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 09:27:03 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75122) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 09:27:03 user nova-compute[75122]: DEBUG nova.compute.provider_tree [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Inventory has not changed in ProviderTree for provider: 69a3da65-47be-44c6-b67c-c692b58284ef {{(pid=75122) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 09:27:03 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Inventory has not changed for provider 69a3da65-47be-44c6-b67c-c692b58284ef based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 09:27:03 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Compute_service record updated for user:user {{(pid=75122) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 09:27:03 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.176s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:28:03 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:28:03 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:28:03 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:28:03 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75122) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 09:28:04 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:28:04 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:28:04 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:28:04 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:28:04 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:28:04 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75122) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 09:28:04 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 09:28:04 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 09:28:04 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Hypervisor/Node resource view: name=user free_ram=10312MB free_disk=26.140419006347656GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75122) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 09:28:04 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:28:04 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:28:04 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75122) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 09:28:04 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75122) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 09:28:04 user nova-compute[75122]: DEBUG nova.compute.provider_tree [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Inventory has not changed in ProviderTree for provider: 69a3da65-47be-44c6-b67c-c692b58284ef {{(pid=75122) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 09:28:04 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Inventory has not changed for provider 69a3da65-47be-44c6-b67c-c692b58284ef based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 09:28:04 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Compute_service record updated for user:user {{(pid=75122) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 09:28:04 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.150s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:28:05 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:28:05 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:28:05 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Starting heal instance info cache {{(pid=75122) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 09:28:05 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Rebuilding the list of instances to heal {{(pid=75122) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 09:28:05 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Didn't find any instances for network info cache update. {{(pid=75122) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 15 09:28:05 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:28:05 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:28:05 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:29:04 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:29:04 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75122) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 09:29:05 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:29:05 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:29:05 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:29:05 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:29:05 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:29:05 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:29:05 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75122) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 09:29:05 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 09:29:05 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 09:29:05 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Hypervisor/Node resource view: name=user free_ram=10293MB free_disk=25.90398406982422GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75122) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 09:29:05 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:29:05 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:29:05 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75122) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 09:29:05 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75122) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 09:29:05 user nova-compute[75122]: DEBUG nova.compute.provider_tree [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Inventory has not changed in ProviderTree for provider: 69a3da65-47be-44c6-b67c-c692b58284ef {{(pid=75122) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 09:29:05 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Inventory has not changed for provider 69a3da65-47be-44c6-b67c-c692b58284ef based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 09:29:05 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Compute_service record updated for user:user {{(pid=75122) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 09:29:05 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.150s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:29:06 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:29:06 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Starting heal instance info cache {{(pid=75122) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 09:29:06 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Rebuilding the list of instances to heal {{(pid=75122) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 09:29:06 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Didn't find any instances for network info cache update. {{(pid=75122) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 15 09:29:06 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:29:06 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:29:07 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:29:07 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:30:03 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:30:05 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:30:06 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:30:06 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:30:06 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75122) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 09:30:06 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:30:06 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:30:06 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:30:06 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:30:06 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75122) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 09:30:06 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 09:30:06 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 09:30:06 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Hypervisor/Node resource view: name=user free_ram=9584MB free_disk=25.922378540039062GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75122) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 09:30:06 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:30:06 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:30:06 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75122) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 09:30:06 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75122) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 09:30:06 user nova-compute[75122]: DEBUG nova.compute.provider_tree [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Inventory has not changed in ProviderTree for provider: 69a3da65-47be-44c6-b67c-c692b58284ef {{(pid=75122) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 09:30:06 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Inventory has not changed for provider 69a3da65-47be-44c6-b67c-c692b58284ef based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 09:30:06 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Compute_service record updated for user:user {{(pid=75122) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 09:30:06 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.198s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:30:07 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:30:07 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Starting heal instance info cache {{(pid=75122) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 09:30:07 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Rebuilding the list of instances to heal {{(pid=75122) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 09:30:07 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Didn't find any instances for network info cache update. {{(pid=75122) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 15 09:30:07 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:30:08 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:30:08 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:30:08 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-7f3b21af-05a6-4b9c-b229-3d5c62bbc307 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] Acquiring lock "4b582e5d-eef1-41f6-84b5-102efe3bf3f8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:30:08 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-7f3b21af-05a6-4b9c-b229-3d5c62bbc307 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] Lock "4b582e5d-eef1-41f6-84b5-102efe3bf3f8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:30:08 user nova-compute[75122]: DEBUG nova.compute.manager [None req-7f3b21af-05a6-4b9c-b229-3d5c62bbc307 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] [instance: 4b582e5d-eef1-41f6-84b5-102efe3bf3f8] Starting instance... {{(pid=75122) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 09:30:08 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-7f3b21af-05a6-4b9c-b229-3d5c62bbc307 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:30:08 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-7f3b21af-05a6-4b9c-b229-3d5c62bbc307 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:30:08 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-7f3b21af-05a6-4b9c-b229-3d5c62bbc307 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75122) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 09:30:08 user nova-compute[75122]: INFO nova.compute.claims [None req-7f3b21af-05a6-4b9c-b229-3d5c62bbc307 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] [instance: 4b582e5d-eef1-41f6-84b5-102efe3bf3f8] Claim successful on node user
Nov 15 09:30:09 user nova-compute[75122]: DEBUG nova.compute.provider_tree [None req-7f3b21af-05a6-4b9c-b229-3d5c62bbc307 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] Inventory has not changed in ProviderTree for provider: 69a3da65-47be-44c6-b67c-c692b58284ef {{(pid=75122) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 09:30:09 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-7f3b21af-05a6-4b9c-b229-3d5c62bbc307 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] Inventory has not changed for provider 69a3da65-47be-44c6-b67c-c692b58284ef based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 09:30:09 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-7f3b21af-05a6-4b9c-b229-3d5c62bbc307 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.374s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:30:09 user nova-compute[75122]: DEBUG nova.compute.manager [None req-7f3b21af-05a6-4b9c-b229-3d5c62bbc307 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] [instance: 4b582e5d-eef1-41f6-84b5-102efe3bf3f8] Start building networks asynchronously for instance. {{(pid=75122) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 09:30:09 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:30:09 user nova-compute[75122]: DEBUG nova.compute.manager [None req-7f3b21af-05a6-4b9c-b229-3d5c62bbc307 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] [instance: 4b582e5d-eef1-41f6-84b5-102efe3bf3f8] Allocating IP information in the background. {{(pid=75122) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 09:30:09 user nova-compute[75122]: DEBUG nova.network.neutron [None req-7f3b21af-05a6-4b9c-b229-3d5c62bbc307 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] [instance: 4b582e5d-eef1-41f6-84b5-102efe3bf3f8] allocate_for_instance() {{(pid=75122) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 09:30:09 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-7f3b21af-05a6-4b9c-b229-3d5c62bbc307 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] [instance: 4b582e5d-eef1-41f6-84b5-102efe3bf3f8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 09:30:09 user nova-compute[75122]: DEBUG nova.compute.manager [None req-7f3b21af-05a6-4b9c-b229-3d5c62bbc307 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] [instance: 4b582e5d-eef1-41f6-84b5-102efe3bf3f8] Start building block device mappings for instance. {{(pid=75122) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 09:30:09 user nova-compute[75122]: DEBUG nova.compute.manager [None req-7f3b21af-05a6-4b9c-b229-3d5c62bbc307 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] [instance: 4b582e5d-eef1-41f6-84b5-102efe3bf3f8] Start spawning the instance on the hypervisor. {{(pid=75122) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 09:30:09 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-7f3b21af-05a6-4b9c-b229-3d5c62bbc307 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] [instance: 4b582e5d-eef1-41f6-84b5-102efe3bf3f8] Creating instance directory {{(pid=75122) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 09:30:09 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-7f3b21af-05a6-4b9c-b229-3d5c62bbc307 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] [instance: 4b582e5d-eef1-41f6-84b5-102efe3bf3f8] Creating image(s)
Nov 15 09:30:09 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-7f3b21af-05a6-4b9c-b229-3d5c62bbc307 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] Acquiring lock "/opt/stack/data/nova/instances/4b582e5d-eef1-41f6-84b5-102efe3bf3f8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:30:09 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-7f3b21af-05a6-4b9c-b229-3d5c62bbc307 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] Lock "/opt/stack/data/nova/instances/4b582e5d-eef1-41f6-84b5-102efe3bf3f8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:30:09 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-7f3b21af-05a6-4b9c-b229-3d5c62bbc307 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] Lock "/opt/stack/data/nova/instances/4b582e5d-eef1-41f6-84b5-102efe3bf3f8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:30:09 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-7f3b21af-05a6-4b9c-b229-3d5c62bbc307 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] Acquiring lock "95d6e29f74d5408f818e32f3bc29bc8270a4c665" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:30:09 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-7f3b21af-05a6-4b9c-b229-3d5c62bbc307 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] Lock "95d6e29f74d5408f818e32f3bc29bc8270a4c665" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:30:09 user nova-compute[75122]: DEBUG nova.policy [None req-7f3b21af-05a6-4b9c-b229-3d5c62bbc307 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b3d18894e4e044b3ac1bca5d58231d05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59cfb5df524a4094a303619fb04ccbd4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75122) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 09:30:10 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-7f3b21af-05a6-4b9c-b229-3d5c62bbc307 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665.part --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:30:10 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-7f3b21af-05a6-4b9c-b229-3d5c62bbc307 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665.part --force-share --output=json" returned: 0 in 0.185s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:30:10 user nova-compute[75122]: DEBUG nova.virt.images [None req-7f3b21af-05a6-4b9c-b229-3d5c62bbc307 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] 5e862cfe-47b8-4725-8292-65761ee6d0f5 was qcow2, converting to raw {{(pid=75122) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 15 09:30:10 user nova-compute[75122]: DEBUG nova.privsep.utils [None req-7f3b21af-05a6-4b9c-b229-3d5c62bbc307 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75122) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 09:30:10 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-7f3b21af-05a6-4b9c-b229-3d5c62bbc307 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665.part /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665.converted {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:30:10 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-7f3b21af-05a6-4b9c-b229-3d5c62bbc307 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665.part /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665.converted" returned: 0 in 0.169s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:30:10 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-7f3b21af-05a6-4b9c-b229-3d5c62bbc307 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665.converted --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:30:10 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-7f3b21af-05a6-4b9c-b229-3d5c62bbc307 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665.converted --force-share --output=json" returned: 0 in 0.164s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:30:10 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-7f3b21af-05a6-4b9c-b229-3d5c62bbc307 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] Lock "95d6e29f74d5408f818e32f3bc29bc8270a4c665" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.427s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:30:10 user nova-compute[75122]: INFO oslo.privsep.daemon [None req-7f3b21af-05a6-4b9c-b229-3d5c62bbc307 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmptb9nzpa4/privsep.sock']
Nov 15 09:30:10 user sudo[84371]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmptb9nzpa4/privsep.sock
Nov 15 09:30:10 user sudo[84371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 15 09:30:11 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0dd63a3d-853a-4790-8ee1-7bbf2f8d29cb tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Acquiring lock "ee961d5a-e0d1-4931-9293-eefbe638097a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:30:11 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0dd63a3d-853a-4790-8ee1-7bbf2f8d29cb tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Lock "ee961d5a-e0d1-4931-9293-eefbe638097a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:30:11 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0dd63a3d-853a-4790-8ee1-7bbf2f8d29cb tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] [instance: ee961d5a-e0d1-4931-9293-eefbe638097a] Starting instance... {{(pid=75122) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 09:30:11 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0dd63a3d-853a-4790-8ee1-7bbf2f8d29cb tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:30:11 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0dd63a3d-853a-4790-8ee1-7bbf2f8d29cb tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:30:11 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-0dd63a3d-853a-4790-8ee1-7bbf2f8d29cb tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75122) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 09:30:11 user nova-compute[75122]: INFO nova.compute.claims [None req-0dd63a3d-853a-4790-8ee1-7bbf2f8d29cb tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] [instance: ee961d5a-e0d1-4931-9293-eefbe638097a] Claim successful on node user
Nov 15 09:30:11 user nova-compute[75122]: DEBUG nova.compute.provider_tree [None req-0dd63a3d-853a-4790-8ee1-7bbf2f8d29cb tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Inventory has not changed in ProviderTree for provider: 69a3da65-47be-44c6-b67c-c692b58284ef {{(pid=75122) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 09:30:11 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-0dd63a3d-853a-4790-8ee1-7bbf2f8d29cb tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Inventory has not changed for provider 69a3da65-47be-44c6-b67c-c692b58284ef based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 09:30:11 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0dd63a3d-853a-4790-8ee1-7bbf2f8d29cb tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.266s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:30:11 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0dd63a3d-853a-4790-8ee1-7bbf2f8d29cb tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] [instance: ee961d5a-e0d1-4931-9293-eefbe638097a] Start building networks asynchronously for instance. {{(pid=75122) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 09:30:11 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0dd63a3d-853a-4790-8ee1-7bbf2f8d29cb tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] [instance: ee961d5a-e0d1-4931-9293-eefbe638097a] Allocating IP information in the background. {{(pid=75122) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 09:30:11 user nova-compute[75122]: DEBUG nova.network.neutron [None req-0dd63a3d-853a-4790-8ee1-7bbf2f8d29cb tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] [instance: ee961d5a-e0d1-4931-9293-eefbe638097a] allocate_for_instance() {{(pid=75122) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 09:30:11 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-0dd63a3d-853a-4790-8ee1-7bbf2f8d29cb tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] [instance: ee961d5a-e0d1-4931-9293-eefbe638097a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 09:30:11 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0dd63a3d-853a-4790-8ee1-7bbf2f8d29cb tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] [instance: ee961d5a-e0d1-4931-9293-eefbe638097a] Start building block device mappings for instance. {{(pid=75122) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 09:30:11 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0dd63a3d-853a-4790-8ee1-7bbf2f8d29cb tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] [instance: ee961d5a-e0d1-4931-9293-eefbe638097a] Start spawning the instance on the hypervisor. {{(pid=75122) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 09:30:11 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-0dd63a3d-853a-4790-8ee1-7bbf2f8d29cb tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] [instance: ee961d5a-e0d1-4931-9293-eefbe638097a] Creating instance directory {{(pid=75122) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 09:30:11 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-0dd63a3d-853a-4790-8ee1-7bbf2f8d29cb tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] [instance: ee961d5a-e0d1-4931-9293-eefbe638097a] Creating image(s)
Nov 15 09:30:11 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0dd63a3d-853a-4790-8ee1-7bbf2f8d29cb tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Acquiring lock "/opt/stack/data/nova/instances/ee961d5a-e0d1-4931-9293-eefbe638097a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:30:11 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0dd63a3d-853a-4790-8ee1-7bbf2f8d29cb tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Lock "/opt/stack/data/nova/instances/ee961d5a-e0d1-4931-9293-eefbe638097a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:30:11 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0dd63a3d-853a-4790-8ee1-7bbf2f8d29cb tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Lock "/opt/stack/data/nova/instances/ee961d5a-e0d1-4931-9293-eefbe638097a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:30:11 user nova-compute[75122]: DEBUG nova.policy [None req-0dd63a3d-853a-4790-8ee1-7bbf2f8d29cb tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c9bf6f2e607842889cd6593ba114cfc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd672b8845fa849d99e328521d3d1715b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75122) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 09:30:12 user sudo[84371]: pam_unix(sudo:session): session closed for user root
Nov 15 09:30:12 user nova-compute[75122]: INFO oslo.privsep.daemon [None req-7f3b21af-05a6-4b9c-b229-3d5c62bbc307 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] Spawned new privsep daemon via rootwrap
Nov 15 09:30:12 user nova-compute[75122]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 15 09:30:12 user nova-compute[75122]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 15 09:30:12 user nova-compute[75122]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Nov 15 09:30:12 user nova-compute[75122]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84375
Nov 15 09:30:12 user nova-compute[75122]: WARNING oslo_privsep.priv_context [None req-0dd63a3d-853a-4790-8ee1-7bbf2f8d29cb tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] privsep daemon already running
Nov 15 09:30:12 user nova-compute[75122]: DEBUG nova.network.neutron [None req-7f3b21af-05a6-4b9c-b229-3d5c62bbc307 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] [instance: 4b582e5d-eef1-41f6-84b5-102efe3bf3f8] Successfully created port: 43e5af96-fffc-4d74-bbed-5a78ce800158 {{(pid=75122) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 09:30:12 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0dd63a3d-853a-4790-8ee1-7bbf2f8d29cb tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:30:12 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-7f3b21af-05a6-4b9c-b229-3d5c62bbc307 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:30:12 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-7f3b21af-05a6-4b9c-b229-3d5c62bbc307 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json" returned: 0 in 0.191s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:30:12 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-7f3b21af-05a6-4b9c-b229-3d5c62bbc307 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] Acquiring lock "95d6e29f74d5408f818e32f3bc29bc8270a4c665" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:30:12 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-7f3b21af-05a6-4b9c-b229-3d5c62bbc307 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] Lock "95d6e29f74d5408f818e32f3bc29bc8270a4c665" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:30:12 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-7f3b21af-05a6-4b9c-b229-3d5c62bbc307 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:30:12 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0dd63a3d-853a-4790-8ee1-7bbf2f8d29cb tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json" returned: 0 in 0.256s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:30:12 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0dd63a3d-853a-4790-8ee1-7bbf2f8d29cb tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Acquiring lock "95d6e29f74d5408f818e32f3bc29bc8270a4c665" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:30:12 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-7f3b21af-05a6-4b9c-b229-3d5c62bbc307 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json" returned: 0 in 0.190s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:30:12 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-7f3b21af-05a6-4b9c-b229-3d5c62bbc307 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665,backing_fmt=raw /opt/stack/data/nova/instances/4b582e5d-eef1-41f6-84b5-102efe3bf3f8/disk 1073741824 {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:30:13 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-7f3b21af-05a6-4b9c-b229-3d5c62bbc307 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665,backing_fmt=raw /opt/stack/data/nova/instances/4b582e5d-eef1-41f6-84b5-102efe3bf3f8/disk 1073741824" returned: 0 in 0.062s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:30:13 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-7f3b21af-05a6-4b9c-b229-3d5c62bbc307 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] Lock "95d6e29f74d5408f818e32f3bc29bc8270a4c665" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.256s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:30:13 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-7f3b21af-05a6-4b9c-b229-3d5c62bbc307 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:30:13 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0dd63a3d-853a-4790-8ee1-7bbf2f8d29cb tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Lock "95d6e29f74d5408f818e32f3bc29bc8270a4c665" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.253s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:30:13 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0dd63a3d-853a-4790-8ee1-7bbf2f8d29cb tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:30:13 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-7f3b21af-05a6-4b9c-b229-3d5c62bbc307 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json" returned: 0 in 0.188s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:30:13 user nova-compute[75122]: DEBUG nova.virt.disk.api [None req-7f3b21af-05a6-4b9c-b229-3d5c62bbc307 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4b582e5d-eef1-41f6-84b5-102efe3bf3f8/disk. size=1073741824 {{(pid=75122) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 09:30:13 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-7f3b21af-05a6-4b9c-b229-3d5c62bbc307 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b582e5d-eef1-41f6-84b5-102efe3bf3f8/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:30:13 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0dd63a3d-853a-4790-8ee1-7bbf2f8d29cb tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json" returned: 0 in 0.201s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:30:13 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0dd63a3d-853a-4790-8ee1-7bbf2f8d29cb tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665,backing_fmt=raw /opt/stack/data/nova/instances/ee961d5a-e0d1-4931-9293-eefbe638097a/disk 1073741824 {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:30:13 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0dd63a3d-853a-4790-8ee1-7bbf2f8d29cb tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665,backing_fmt=raw /opt/stack/data/nova/instances/ee961d5a-e0d1-4931-9293-eefbe638097a/disk 1073741824" returned: 0 in 0.067s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:30:13 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0dd63a3d-853a-4790-8ee1-7bbf2f8d29cb tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Lock "95d6e29f74d5408f818e32f3bc29bc8270a4c665" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.276s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:30:13 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0dd63a3d-853a-4790-8ee1-7bbf2f8d29cb tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:30:13 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-7f3b21af-05a6-4b9c-b229-3d5c62bbc307 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b582e5d-eef1-41f6-84b5-102efe3bf3f8/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:30:13 user nova-compute[75122]: DEBUG nova.virt.disk.api [None req-7f3b21af-05a6-4b9c-b229-3d5c62bbc307 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] Cannot resize image /opt/stack/data/nova/instances/4b582e5d-eef1-41f6-84b5-102efe3bf3f8/disk to a smaller size. {{(pid=75122) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 09:30:13 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-7f3b21af-05a6-4b9c-b229-3d5c62bbc307 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] [instance: 4b582e5d-eef1-41f6-84b5-102efe3bf3f8] Created local disks {{(pid=75122) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 09:30:13 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-7f3b21af-05a6-4b9c-b229-3d5c62bbc307 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] [instance: 4b582e5d-eef1-41f6-84b5-102efe3bf3f8] Ensure instance console log exists: /opt/stack/data/nova/instances/4b582e5d-eef1-41f6-84b5-102efe3bf3f8/console.log {{(pid=75122) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 09:30:13 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-7f3b21af-05a6-4b9c-b229-3d5c62bbc307 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:30:13 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-7f3b21af-05a6-4b9c-b229-3d5c62bbc307 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:30:13 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-7f3b21af-05a6-4b9c-b229-3d5c62bbc307 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:30:13 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0dd63a3d-853a-4790-8ee1-7bbf2f8d29cb tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json" returned: 0 in 0.187s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:30:13 user nova-compute[75122]: DEBUG nova.virt.disk.api [None req-0dd63a3d-853a-4790-8ee1-7bbf2f8d29cb tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ee961d5a-e0d1-4931-9293-eefbe638097a/disk. size=1073741824 {{(pid=75122) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 09:30:13 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0dd63a3d-853a-4790-8ee1-7bbf2f8d29cb tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee961d5a-e0d1-4931-9293-eefbe638097a/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:30:13 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0dd63a3d-853a-4790-8ee1-7bbf2f8d29cb tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee961d5a-e0d1-4931-9293-eefbe638097a/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:30:13 user nova-compute[75122]: DEBUG nova.virt.disk.api [None req-0dd63a3d-853a-4790-8ee1-7bbf2f8d29cb tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Cannot resize image /opt/stack/data/nova/instances/ee961d5a-e0d1-4931-9293-eefbe638097a/disk to a smaller size. {{(pid=75122) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 09:30:13 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-0dd63a3d-853a-4790-8ee1-7bbf2f8d29cb tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] [instance: ee961d5a-e0d1-4931-9293-eefbe638097a] Created local disks {{(pid=75122) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 09:30:13 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-0dd63a3d-853a-4790-8ee1-7bbf2f8d29cb tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] [instance: ee961d5a-e0d1-4931-9293-eefbe638097a] Ensure instance console log exists: /opt/stack/data/nova/instances/ee961d5a-e0d1-4931-9293-eefbe638097a/console.log {{(pid=75122) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 09:30:13 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0dd63a3d-853a-4790-8ee1-7bbf2f8d29cb tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:30:13 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0dd63a3d-853a-4790-8ee1-7bbf2f8d29cb tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:30:13 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0dd63a3d-853a-4790-8ee1-7bbf2f8d29cb tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:30:14 user nova-compute[75122]: DEBUG nova.network.neutron [None req-0dd63a3d-853a-4790-8ee1-7bbf2f8d29cb tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] [instance: ee961d5a-e0d1-4931-9293-eefbe638097a] Successfully created port: ae8a9c5e-17d1-4aa9-b3fa-b829d1dc6fd2 {{(pid=75122) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 09:30:14 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-7d8ec1fe-2300-4585-85c6-883eba42e35b tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Acquiring lock "131142fd-e8ec-42d1-a518-aa21c7bb7cb1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:30:14 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-7d8ec1fe-2300-4585-85c6-883eba42e35b tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Lock "131142fd-e8ec-42d1-a518-aa21c7bb7cb1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:30:14 user nova-compute[75122]: DEBUG nova.compute.manager [None req-7d8ec1fe-2300-4585-85c6-883eba42e35b tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] [instance: 131142fd-e8ec-42d1-a518-aa21c7bb7cb1] Starting instance... {{(pid=75122) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 09:30:14 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-7d8ec1fe-2300-4585-85c6-883eba42e35b tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:30:14 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-7d8ec1fe-2300-4585-85c6-883eba42e35b tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:30:14 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-7d8ec1fe-2300-4585-85c6-883eba42e35b tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75122) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 09:30:14 user nova-compute[75122]: INFO nova.compute.claims [None req-7d8ec1fe-2300-4585-85c6-883eba42e35b tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] [instance: 131142fd-e8ec-42d1-a518-aa21c7bb7cb1] Claim successful on node user
Nov 15 09:30:14 user nova-compute[75122]: DEBUG nova.network.neutron [None req-7f3b21af-05a6-4b9c-b229-3d5c62bbc307 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] [instance: 4b582e5d-eef1-41f6-84b5-102efe3bf3f8] Successfully updated port: 43e5af96-fffc-4d74-bbed-5a78ce800158 {{(pid=75122) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 09:30:14 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-7f3b21af-05a6-4b9c-b229-3d5c62bbc307 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] Acquiring lock "refresh_cache-4b582e5d-eef1-41f6-84b5-102efe3bf3f8" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 09:30:14 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-7f3b21af-05a6-4b9c-b229-3d5c62bbc307 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] Acquired lock "refresh_cache-4b582e5d-eef1-41f6-84b5-102efe3bf3f8" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 09:30:14 user nova-compute[75122]: DEBUG nova.network.neutron [None req-7f3b21af-05a6-4b9c-b229-3d5c62bbc307 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] [instance: 4b582e5d-eef1-41f6-84b5-102efe3bf3f8] Building network info cache for instance {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 09:30:14 user nova-compute[75122]: DEBUG nova.network.neutron [None req-7f3b21af-05a6-4b9c-b229-3d5c62bbc307 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] [instance: 4b582e5d-eef1-41f6-84b5-102efe3bf3f8] Instance cache missing network info. {{(pid=75122) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 09:30:15 user nova-compute[75122]: DEBUG nova.compute.provider_tree [None req-7d8ec1fe-2300-4585-85c6-883eba42e35b tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Inventory has not changed in ProviderTree for provider: 69a3da65-47be-44c6-b67c-c692b58284ef {{(pid=75122) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 09:30:15 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-7d8ec1fe-2300-4585-85c6-883eba42e35b tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Inventory has not changed for provider 69a3da65-47be-44c6-b67c-c692b58284ef based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 09:30:15 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-7d8ec1fe-2300-4585-85c6-883eba42e35b tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.698s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:30:15 user nova-compute[75122]: DEBUG nova.compute.manager [None req-7d8ec1fe-2300-4585-85c6-883eba42e35b tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] [instance: 131142fd-e8ec-42d1-a518-aa21c7bb7cb1] Start building networks asynchronously for instance. {{(pid=75122) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 09:30:15 user nova-compute[75122]: DEBUG nova.compute.manager [None req-7d8ec1fe-2300-4585-85c6-883eba42e35b tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] [instance: 131142fd-e8ec-42d1-a518-aa21c7bb7cb1] Allocating IP information in the background. {{(pid=75122) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 09:30:15 user nova-compute[75122]: DEBUG nova.network.neutron [None req-7d8ec1fe-2300-4585-85c6-883eba42e35b tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] [instance: 131142fd-e8ec-42d1-a518-aa21c7bb7cb1] allocate_for_instance() {{(pid=75122) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 09:30:15 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-7d8ec1fe-2300-4585-85c6-883eba42e35b tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] [instance: 131142fd-e8ec-42d1-a518-aa21c7bb7cb1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 09:30:15 user nova-compute[75122]: DEBUG nova.compute.manager [None req-7d8ec1fe-2300-4585-85c6-883eba42e35b tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] [instance: 131142fd-e8ec-42d1-a518-aa21c7bb7cb1] Start building block device mappings for instance. {{(pid=75122) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 09:30:15 user nova-compute[75122]: DEBUG nova.compute.manager [req-bc7788b0-a721-4e4e-8967-0895528743b5 req-89a402c3-f4ba-461f-9749-bfeb5e57bf85 service nova] [instance: 4b582e5d-eef1-41f6-84b5-102efe3bf3f8] Received event network-changed-43e5af96-fffc-4d74-bbed-5a78ce800158 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:30:15 user nova-compute[75122]: DEBUG nova.compute.manager [req-bc7788b0-a721-4e4e-8967-0895528743b5 req-89a402c3-f4ba-461f-9749-bfeb5e57bf85 service nova] [instance: 4b582e5d-eef1-41f6-84b5-102efe3bf3f8] Refreshing instance network info cache due to event network-changed-43e5af96-fffc-4d74-bbed-5a78ce800158. {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 09:30:15 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-bc7788b0-a721-4e4e-8967-0895528743b5 req-89a402c3-f4ba-461f-9749-bfeb5e57bf85 service nova] Acquiring lock "refresh_cache-4b582e5d-eef1-41f6-84b5-102efe3bf3f8" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 09:30:15 user nova-compute[75122]: DEBUG nova.policy [None req-7d8ec1fe-2300-4585-85c6-883eba42e35b tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '91f1469b2c7c45d6ac27f2b64fd5cefe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8e67f8a66a4930be3fb65c397cbeb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75122) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 09:30:15 user nova-compute[75122]: DEBUG nova.compute.manager [None req-7d8ec1fe-2300-4585-85c6-883eba42e35b tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] [instance: 131142fd-e8ec-42d1-a518-aa21c7bb7cb1] Start spawning the instance on the hypervisor. {{(pid=75122) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 09:30:15 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-7d8ec1fe-2300-4585-85c6-883eba42e35b tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] [instance: 131142fd-e8ec-42d1-a518-aa21c7bb7cb1] Creating instance directory {{(pid=75122) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 09:30:15 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-7d8ec1fe-2300-4585-85c6-883eba42e35b tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] [instance: 131142fd-e8ec-42d1-a518-aa21c7bb7cb1] Creating image(s)
Nov 15 09:30:15 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-7d8ec1fe-2300-4585-85c6-883eba42e35b tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Acquiring lock "/opt/stack/data/nova/instances/131142fd-e8ec-42d1-a518-aa21c7bb7cb1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:30:15 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-7d8ec1fe-2300-4585-85c6-883eba42e35b tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Lock "/opt/stack/data/nova/instances/131142fd-e8ec-42d1-a518-aa21c7bb7cb1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:30:15 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-7d8ec1fe-2300-4585-85c6-883eba42e35b tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Lock "/opt/stack/data/nova/instances/131142fd-e8ec-42d1-a518-aa21c7bb7cb1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.026s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:30:15 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-7d8ec1fe-2300-4585-85c6-883eba42e35b tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:30:15 user nova-compute[75122]: DEBUG nova.network.neutron [None req-7f3b21af-05a6-4b9c-b229-3d5c62bbc307 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] [instance: 4b582e5d-eef1-41f6-84b5-102efe3bf3f8] Updating instance_info_cache with network_info: [{"id": "43e5af96-fffc-4d74-bbed-5a78ce800158", "address": "fa:16:3e:0d:bc:bc", "network": {"id": "0701c672-3bc3-4a49-afd0-6b439abd2956", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1112570222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59cfb5df524a4094a303619fb04ccbd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43e5af96-ff", "ovs_interfaceid": "43e5af96-fffc-4d74-bbed-5a78ce800158", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:30:15 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-7f3b21af-05a6-4b9c-b229-3d5c62bbc307 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] Releasing lock "refresh_cache-4b582e5d-eef1-41f6-84b5-102efe3bf3f8" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 09:30:15 user nova-compute[75122]: DEBUG nova.compute.manager [None req-7f3b21af-05a6-4b9c-b229-3d5c62bbc307 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] [instance: 4b582e5d-eef1-41f6-84b5-102efe3bf3f8] Instance network_info: |[{"id": "43e5af96-fffc-4d74-bbed-5a78ce800158", "address": "fa:16:3e:0d:bc:bc", "network": {"id": "0701c672-3bc3-4a49-afd0-6b439abd2956", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1112570222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59cfb5df524a4094a303619fb04ccbd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43e5af96-ff", "ovs_interfaceid": "43e5af96-fffc-4d74-bbed-5a78ce800158", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75122) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 09:30:15 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-bc7788b0-a721-4e4e-8967-0895528743b5 req-89a402c3-f4ba-461f-9749-bfeb5e57bf85 service nova] Acquired lock "refresh_cache-4b582e5d-eef1-41f6-84b5-102efe3bf3f8" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 09:30:15 user nova-compute[75122]: DEBUG nova.network.neutron [req-bc7788b0-a721-4e4e-8967-0895528743b5 req-89a402c3-f4ba-461f-9749-bfeb5e57bf85 service nova] [instance: 4b582e5d-eef1-41f6-84b5-102efe3bf3f8] Refreshing network info cache for port 43e5af96-fffc-4d74-bbed-5a78ce800158 {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 09:30:15 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-7f3b21af-05a6-4b9c-b229-3d5c62bbc307 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] [instance: 4b582e5d-eef1-41f6-84b5-102efe3bf3f8] Start _get_guest_xml network_info=[{"id": "43e5af96-fffc-4d74-bbed-5a78ce800158", "address": "fa:16:3e:0d:bc:bc", "network": {"id": "0701c672-3bc3-4a49-afd0-6b439abd2956", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1112570222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59cfb5df524a4094a303619fb04ccbd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43e5af96-ff", "ovs_interfaceid": "43e5af96-fffc-4d74-bbed-5a78ce800158", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T09:26:31Z,direct_url=<?>,disk_format='qcow2',id=5e862cfe-47b8-4725-8292-65761ee6d0f5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9c57733cb41847c0b4ad31519c382e5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T09:26:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '5e862cfe-47b8-4725-8292-65761ee6d0f5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75122) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 09:30:15 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-7f3b21af-05a6-4b9c-b229-3d5c62bbc307 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 09:30:15 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-7f3b21af-05a6-4b9c-b229-3d5c62bbc307 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 09:30:15 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-7f3b21af-05a6-4b9c-b229-3d5c62bbc307 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75122) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 09:30:15 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-7f3b21af-05a6-4b9c-b229-3d5c62bbc307 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] CPU controller missing on host. {{(pid=75122) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 09:30:15 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-7f3b21af-05a6-4b9c-b229-3d5c62bbc307 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75122) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 09:30:15 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-7f3b21af-05a6-4b9c-b229-3d5c62bbc307 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] CPU controller found on host. {{(pid=75122) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 09:30:15 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-7f3b21af-05a6-4b9c-b229-3d5c62bbc307 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75122) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 09:30:15 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-7f3b21af-05a6-4b9c-b229-3d5c62bbc307 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T09:26:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T09:26:31Z,direct_url=<?>,disk_format='qcow2',id=5e862cfe-47b8-4725-8292-65761ee6d0f5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9c57733cb41847c0b4ad31519c382e5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T09:26:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 09:30:15 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-7f3b21af-05a6-4b9c-b229-3d5c62bbc307 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] Flavor limits 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 09:30:15 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-7f3b21af-05a6-4b9c-b229-3d5c62bbc307 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] Image limits 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 09:30:15 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-7f3b21af-05a6-4b9c-b229-3d5c62bbc307 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] Flavor pref 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 09:30:15 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-7f3b21af-05a6-4b9c-b229-3d5c62bbc307 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] Image pref 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 09:30:15 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-7f3b21af-05a6-4b9c-b229-3d5c62bbc307 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 09:30:15 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-7f3b21af-05a6-4b9c-b229-3d5c62bbc307 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 09:30:15 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-7f3b21af-05a6-4b9c-b229-3d5c62bbc307 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75122) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 09:30:15 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-7f3b21af-05a6-4b9c-b229-3d5c62bbc307 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] Got 1 possible topologies {{(pid=75122) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 09:30:15 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-7f3b21af-05a6-4b9c-b229-3d5c62bbc307 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 09:30:15 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-7f3b21af-05a6-4b9c-b229-3d5c62bbc307 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 09:30:16 user nova-compute[75122]: DEBUG nova.privsep.utils [None req-7f3b21af-05a6-4b9c-b229-3d5c62bbc307 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75122) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 09:30:16 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-7f3b21af-05a6-4b9c-b229-3d5c62bbc307 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T09:30:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1275384859',display_name='tempest-DeleteServersTestJSON-server-1275384859',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1275384859',id=1,image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='59cfb5df524a4094a303619fb04ccbd4',ramdisk_id='',reservation_id='r-fexdbayg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1876319053',owner_user_name='tempest-DeleteServersTestJSON-1876319053-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T09:30:09Z,user_data=None,user_id='b3d18894e4e044b3ac1bca5d58231d05',uuid=4b582e5d-eef1-41f6-84b5-102efe3bf3f8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "43e5af96-fffc-4d74-bbed-5a78ce800158", "address": "fa:16:3e:0d:bc:bc", "network": {"id": "0701c672-3bc3-4a49-afd0-6b439abd2956", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1112570222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59cfb5df524a4094a303619fb04ccbd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43e5af96-ff", "ovs_interfaceid": "43e5af96-fffc-4d74-bbed-5a78ce800158", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75122) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 09:30:16 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-7f3b21af-05a6-4b9c-b229-3d5c62bbc307 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] Converting VIF {"id": "43e5af96-fffc-4d74-bbed-5a78ce800158", "address": "fa:16:3e:0d:bc:bc", "network": {"id": "0701c672-3bc3-4a49-afd0-6b439abd2956", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1112570222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59cfb5df524a4094a303619fb04ccbd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43e5af96-ff", "ovs_interfaceid": "43e5af96-fffc-4d74-bbed-5a78ce800158", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 09:30:16 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-7f3b21af-05a6-4b9c-b229-3d5c62bbc307 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:bc:bc,bridge_name='br-int',has_traffic_filtering=True,id=43e5af96-fffc-4d74-bbed-5a78ce800158,network=Network(0701c672-3bc3-4a49-afd0-6b439abd2956),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43e5af96-ff') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 09:30:16 user nova-compute[75122]: DEBUG nova.objects.instance [None req-7f3b21af-05a6-4b9c-b229-3d5c62bbc307 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] Lazy-loading 'pci_devices' on Instance uuid 4b582e5d-eef1-41f6-84b5-102efe3bf3f8 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:30:16 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-7f3b21af-05a6-4b9c-b229-3d5c62bbc307 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] [instance: 4b582e5d-eef1-41f6-84b5-102efe3bf3f8] End _get_guest_xml xml=<domain type="kvm">
Nov 15 09:30:16 user nova-compute[75122]:   <uuid>4b582e5d-eef1-41f6-84b5-102efe3bf3f8</uuid>
Nov 15 09:30:16 user nova-compute[75122]:   <name>instance-00000001</name>
Nov 15 09:30:16 user nova-compute[75122]:   <memory>524288</memory>
Nov 15 09:30:16 user nova-compute[75122]:   <vcpu>1</vcpu>
Nov 15 09:30:16 user nova-compute[75122]:   <metadata>
Nov 15 09:30:16 user nova-compute[75122]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 09:30:16 user nova-compute[75122]:       <nova:package version="0.0.0"/>
Nov 15 09:30:16 user nova-compute[75122]:       <nova:name>tempest-DeleteServersTestJSON-server-1275384859</nova:name>
Nov 15 09:30:16 user nova-compute[75122]:       <nova:creationTime>2023-11-15 09:30:15</nova:creationTime>
Nov 15 09:30:16 user nova-compute[75122]:       <nova:flavor name="m1.tiny">
Nov 15 09:30:16 user nova-compute[75122]:         <nova:memory>512</nova:memory>
Nov 15 09:30:16 user nova-compute[75122]:         <nova:disk>1</nova:disk>
Nov 15 09:30:16 user nova-compute[75122]:         <nova:swap>0</nova:swap>
Nov 15 09:30:16 user nova-compute[75122]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 09:30:16 user nova-compute[75122]:         <nova:vcpus>1</nova:vcpus>
Nov 15 09:30:16 user nova-compute[75122]:       </nova:flavor>
Nov 15 09:30:16 user nova-compute[75122]:       <nova:owner>
Nov 15 09:30:16 user nova-compute[75122]:         <nova:user uuid="b3d18894e4e044b3ac1bca5d58231d05">tempest-DeleteServersTestJSON-1876319053-project-member</nova:user>
Nov 15 09:30:16 user nova-compute[75122]:         <nova:project uuid="59cfb5df524a4094a303619fb04ccbd4">tempest-DeleteServersTestJSON-1876319053</nova:project>
Nov 15 09:30:16 user nova-compute[75122]:       </nova:owner>
Nov 15 09:30:16 user nova-compute[75122]:       <nova:root type="image" uuid="5e862cfe-47b8-4725-8292-65761ee6d0f5"/>
Nov 15 09:30:16 user nova-compute[75122]:       <nova:ports>
Nov 15 09:30:16 user nova-compute[75122]:         <nova:port uuid="43e5af96-fffc-4d74-bbed-5a78ce800158">
Nov 15 09:30:16 user nova-compute[75122]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 15 09:30:16 user nova-compute[75122]:         </nova:port>
Nov 15 09:30:16 user nova-compute[75122]:       </nova:ports>
Nov 15 09:30:16 user nova-compute[75122]:     </nova:instance>
Nov 15 09:30:16 user nova-compute[75122]:   </metadata>
Nov 15 09:30:16 user nova-compute[75122]:   <sysinfo type="smbios">
Nov 15 09:30:16 user nova-compute[75122]:     <system>
Nov 15 09:30:16 user nova-compute[75122]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 09:30:16 user nova-compute[75122]:       <entry name="product">OpenStack Nova</entry>
Nov 15 09:30:16 user nova-compute[75122]:       <entry name="version">0.0.0</entry>
Nov 15 09:30:16 user nova-compute[75122]:       <entry name="serial">4b582e5d-eef1-41f6-84b5-102efe3bf3f8</entry>
Nov 15 09:30:16 user nova-compute[75122]:       <entry name="uuid">4b582e5d-eef1-41f6-84b5-102efe3bf3f8</entry>
Nov 15 09:30:16 user nova-compute[75122]:       <entry name="family">Virtual Machine</entry>
Nov 15 09:30:16 user nova-compute[75122]:     </system>
Nov 15 09:30:16 user nova-compute[75122]:   </sysinfo>
Nov 15 09:30:16 user nova-compute[75122]:   <os>
Nov 15 09:30:16 user nova-compute[75122]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 09:30:16 user nova-compute[75122]:     <boot dev="hd"/>
Nov 15 09:30:16 user nova-compute[75122]:     <smbios mode="sysinfo"/>
Nov 15 09:30:16 user nova-compute[75122]:   </os>
Nov 15 09:30:16 user nova-compute[75122]:   <features>
Nov 15 09:30:16 user nova-compute[75122]:     <acpi/>
Nov 15 09:30:16 user nova-compute[75122]:     <apic/>
Nov 15 09:30:16 user nova-compute[75122]:     <vmcoreinfo/>
Nov 15 09:30:16 user nova-compute[75122]:   </features>
Nov 15 09:30:16 user nova-compute[75122]:   <clock offset="utc">
Nov 15 09:30:16 user nova-compute[75122]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 09:30:16 user nova-compute[75122]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 09:30:16 user nova-compute[75122]:     <timer name="hpet" present="no"/>
Nov 15 09:30:16 user nova-compute[75122]:   </clock>
Nov 15 09:30:16 user nova-compute[75122]:   <cpu mode="custom" match="exact">
Nov 15 09:30:16 user nova-compute[75122]:     <model>Nehalem</model>
Nov 15 09:30:16 user nova-compute[75122]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 09:30:16 user nova-compute[75122]:   </cpu>
Nov 15 09:30:16 user nova-compute[75122]:   <devices>
Nov 15 09:30:16 user nova-compute[75122]:     <disk type="file" device="disk">
Nov 15 09:30:16 user nova-compute[75122]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 09:30:16 user nova-compute[75122]:       <source file="/opt/stack/data/nova/instances/4b582e5d-eef1-41f6-84b5-102efe3bf3f8/disk"/>
Nov 15 09:30:16 user nova-compute[75122]:       <target dev="vda" bus="virtio"/>
Nov 15 09:30:16 user nova-compute[75122]:     </disk>
Nov 15 09:30:16 user nova-compute[75122]:     <interface type="ethernet">
Nov 15 09:30:16 user nova-compute[75122]:       <mac address="fa:16:3e:0d:bc:bc"/>
Nov 15 09:30:16 user nova-compute[75122]:       <model type="virtio"/>
Nov 15 09:30:16 user nova-compute[75122]:       <mtu size="1442"/>
Nov 15 09:30:16 user nova-compute[75122]:       <target dev="tap43e5af96-ff"/>
Nov 15 09:30:16 user nova-compute[75122]:     </interface>
Nov 15 09:30:16 user nova-compute[75122]:     <serial type="pty">
Nov 15 09:30:16 user nova-compute[75122]:       <log file="/opt/stack/data/nova/instances/4b582e5d-eef1-41f6-84b5-102efe3bf3f8/console.log" append="off"/>
Nov 15 09:30:16 user nova-compute[75122]:     </serial>
Nov 15 09:30:16 user nova-compute[75122]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 09:30:16 user nova-compute[75122]:     <video>
Nov 15 09:30:16 user nova-compute[75122]:       <model type="virtio"/>
Nov 15 09:30:16 user nova-compute[75122]:     </video>
Nov 15 09:30:16 user nova-compute[75122]:     <rng model="virtio">
Nov 15 09:30:16 user nova-compute[75122]:       <backend model="random">/dev/urandom</backend>
Nov 15 09:30:16 user nova-compute[75122]:     </rng>
Nov 15 09:30:16 user nova-compute[75122]:     <controller type="usb" index="0" model="none"/>
Nov 15 09:30:16 user nova-compute[75122]:     <memballoon model="virtio">
Nov 15 09:30:16 user nova-compute[75122]:       <stats period="10"/>
Nov 15 09:30:16 user nova-compute[75122]:     </memballoon>
Nov 15 09:30:16 user nova-compute[75122]:   </devices>
Nov 15 09:30:16 user nova-compute[75122]: </domain>
Nov 15 09:30:16 user nova-compute[75122]:  {{(pid=75122) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 09:30:16 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-7f3b21af-05a6-4b9c-b229-3d5c62bbc307 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T09:30:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1275384859',display_name='tempest-DeleteServersTestJSON-server-1275384859',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1275384859',id=1,image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='59cfb5df524a4094a303619fb04ccbd4',ramdisk_id='',reservation_id='r-fexdbayg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1876319053',owner_user_name='tempest-DeleteServersTestJSON-1876319053-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T09:30:09Z,user_data=None,user_id='b3d18894e4e044b3ac1bca5d58231d05',uuid=4b582e5d-eef1-41f6-84b5-102efe3bf3f8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "43e5af96-fffc-4d74-bbed-5a78ce800158", "address": "fa:16:3e:0d:bc:bc", "network": {"id": "0701c672-3bc3-4a49-afd0-6b439abd2956", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1112570222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59cfb5df524a4094a303619fb04ccbd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43e5af96-ff", "ovs_interfaceid": "43e5af96-fffc-4d74-bbed-5a78ce800158", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 09:30:16 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-7f3b21af-05a6-4b9c-b229-3d5c62bbc307 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] Converting VIF {"id": "43e5af96-fffc-4d74-bbed-5a78ce800158", "address": "fa:16:3e:0d:bc:bc", "network": {"id": "0701c672-3bc3-4a49-afd0-6b439abd2956", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1112570222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59cfb5df524a4094a303619fb04ccbd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43e5af96-ff", "ovs_interfaceid": "43e5af96-fffc-4d74-bbed-5a78ce800158", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 09:30:16 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-7f3b21af-05a6-4b9c-b229-3d5c62bbc307 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:bc:bc,bridge_name='br-int',has_traffic_filtering=True,id=43e5af96-fffc-4d74-bbed-5a78ce800158,network=Network(0701c672-3bc3-4a49-afd0-6b439abd2956),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43e5af96-ff') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 09:30:16 user nova-compute[75122]: DEBUG os_vif [None req-7f3b21af-05a6-4b9c-b229-3d5c62bbc307 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:bc:bc,bridge_name='br-int',has_traffic_filtering=True,id=43e5af96-fffc-4d74-bbed-5a78ce800158,network=Network(0701c672-3bc3-4a49-afd0-6b439abd2956),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43e5af96-ff') {{(pid=75122) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 09:30:16 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-7d8ec1fe-2300-4585-85c6-883eba42e35b tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json" returned: 0 in 0.240s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:30:16 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-7d8ec1fe-2300-4585-85c6-883eba42e35b tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Acquiring lock "95d6e29f74d5408f818e32f3bc29bc8270a4c665" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:30:16 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-7d8ec1fe-2300-4585-85c6-883eba42e35b tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Lock "95d6e29f74d5408f818e32f3bc29bc8270a4c665" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:30:16 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-7d8ec1fe-2300-4585-85c6-883eba42e35b tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:30:16 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl [None req-7f3b21af-05a6-4b9c-b229-3d5c62bbc307 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] Created schema index Interface.name {{(pid=75122) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 15 09:30:16 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl [None req-7f3b21af-05a6-4b9c-b229-3d5c62bbc307 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] Created schema index Port.name {{(pid=75122) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 15 09:30:16 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl [None req-7f3b21af-05a6-4b9c-b229-3d5c62bbc307 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] Created schema index Bridge.name {{(pid=75122) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 15 09:30:16 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-7f3b21af-05a6-4b9c-b229-3d5c62bbc307 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=75122) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 09:30:16 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-7f3b21af-05a6-4b9c-b229-3d5c62bbc307 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] [POLLOUT] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:30:16 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-7f3b21af-05a6-4b9c-b229-3d5c62bbc307 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75122) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 09:30:16 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-7f3b21af-05a6-4b9c-b229-3d5c62bbc307 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:30:16 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-7f3b21af-05a6-4b9c-b229-3d5c62bbc307 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:30:16 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-7f3b21af-05a6-4b9c-b229-3d5c62bbc307 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:30:16 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:30:16 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:30:16 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 09:30:16 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:30:16 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9d4cd0e6-7299-536b-bccf-4646e9a774c9', '_type': 'linux-noop'}}, row=False) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:30:16 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:30:16 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:30:16 user nova-compute[75122]: INFO oslo.privsep.daemon [None req-7f3b21af-05a6-4b9c-b229-3d5c62bbc307 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmprjmsg_7a/privsep.sock']
Nov 15 09:30:16 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-7d8ec1fe-2300-4585-85c6-883eba42e35b tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json" returned: 0 in 0.190s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:30:16 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-7d8ec1fe-2300-4585-85c6-883eba42e35b tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665,backing_fmt=raw /opt/stack/data/nova/instances/131142fd-e8ec-42d1-a518-aa21c7bb7cb1/disk 1073741824 {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:30:16 user sudo[84456]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmprjmsg_7a/privsep.sock
Nov 15 09:30:16 user sudo[84456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 15 09:30:16 user nova-compute[75122]: DEBUG nova.network.neutron [None req-0dd63a3d-853a-4790-8ee1-7bbf2f8d29cb tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] [instance: ee961d5a-e0d1-4931-9293-eefbe638097a] Successfully updated port: ae8a9c5e-17d1-4aa9-b3fa-b829d1dc6fd2 {{(pid=75122) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 09:30:16 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-7d8ec1fe-2300-4585-85c6-883eba42e35b tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665,backing_fmt=raw /opt/stack/data/nova/instances/131142fd-e8ec-42d1-a518-aa21c7bb7cb1/disk 1073741824" returned: 0 in 0.060s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:30:16 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-7d8ec1fe-2300-4585-85c6-883eba42e35b tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Lock "95d6e29f74d5408f818e32f3bc29bc8270a4c665" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.253s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:30:16 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-7d8ec1fe-2300-4585-85c6-883eba42e35b tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:30:16 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:30:16 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0dd63a3d-853a-4790-8ee1-7bbf2f8d29cb tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Acquiring lock "refresh_cache-ee961d5a-e0d1-4931-9293-eefbe638097a" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 09:30:16 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0dd63a3d-853a-4790-8ee1-7bbf2f8d29cb tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Acquired lock "refresh_cache-ee961d5a-e0d1-4931-9293-eefbe638097a" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 09:30:16 user nova-compute[75122]: DEBUG nova.network.neutron [None req-0dd63a3d-853a-4790-8ee1-7bbf2f8d29cb tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] [instance: ee961d5a-e0d1-4931-9293-eefbe638097a] Building network info cache for instance {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 09:30:16 user nova-compute[75122]: DEBUG nova.network.neutron [None req-0dd63a3d-853a-4790-8ee1-7bbf2f8d29cb tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] [instance: ee961d5a-e0d1-4931-9293-eefbe638097a] Instance cache missing network info. {{(pid=75122) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 09:30:16 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-7d8ec1fe-2300-4585-85c6-883eba42e35b tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json" returned: 0 in 0.225s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:30:16 user nova-compute[75122]: DEBUG nova.virt.disk.api [None req-7d8ec1fe-2300-4585-85c6-883eba42e35b tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Checking if we can resize image /opt/stack/data/nova/instances/131142fd-e8ec-42d1-a518-aa21c7bb7cb1/disk. size=1073741824 {{(pid=75122) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 09:30:16 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-7d8ec1fe-2300-4585-85c6-883eba42e35b tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/131142fd-e8ec-42d1-a518-aa21c7bb7cb1/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:30:16 user nova-compute[75122]: DEBUG nova.network.neutron [req-bc7788b0-a721-4e4e-8967-0895528743b5 req-89a402c3-f4ba-461f-9749-bfeb5e57bf85 service nova] [instance: 4b582e5d-eef1-41f6-84b5-102efe3bf3f8] Updated VIF entry in instance network info cache for port 43e5af96-fffc-4d74-bbed-5a78ce800158. {{(pid=75122) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 09:30:16 user nova-compute[75122]: DEBUG nova.network.neutron [req-bc7788b0-a721-4e4e-8967-0895528743b5 req-89a402c3-f4ba-461f-9749-bfeb5e57bf85 service nova] [instance: 4b582e5d-eef1-41f6-84b5-102efe3bf3f8] Updating instance_info_cache with network_info: [{"id": "43e5af96-fffc-4d74-bbed-5a78ce800158", "address": "fa:16:3e:0d:bc:bc", "network": {"id": "0701c672-3bc3-4a49-afd0-6b439abd2956", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1112570222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59cfb5df524a4094a303619fb04ccbd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43e5af96-ff", "ovs_interfaceid": "43e5af96-fffc-4d74-bbed-5a78ce800158", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:30:16 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-bc7788b0-a721-4e4e-8967-0895528743b5 req-89a402c3-f4ba-461f-9749-bfeb5e57bf85 service nova] Releasing lock "refresh_cache-4b582e5d-eef1-41f6-84b5-102efe3bf3f8" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 09:30:16 user nova-compute[75122]: DEBUG nova.compute.manager [req-9766f3f8-baed-465e-b395-dd0d8a38207b req-3035b955-365d-4269-b8f9-702f6c682f3e service nova] [instance: ee961d5a-e0d1-4931-9293-eefbe638097a] Received event network-changed-ae8a9c5e-17d1-4aa9-b3fa-b829d1dc6fd2 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:30:16 user nova-compute[75122]: DEBUG nova.compute.manager [req-9766f3f8-baed-465e-b395-dd0d8a38207b req-3035b955-365d-4269-b8f9-702f6c682f3e service nova] [instance: ee961d5a-e0d1-4931-9293-eefbe638097a] Refreshing instance network info cache due to event network-changed-ae8a9c5e-17d1-4aa9-b3fa-b829d1dc6fd2. {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 09:30:16 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-9766f3f8-baed-465e-b395-dd0d8a38207b req-3035b955-365d-4269-b8f9-702f6c682f3e service nova] Acquiring lock "refresh_cache-ee961d5a-e0d1-4931-9293-eefbe638097a" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 09:30:16 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-7d8ec1fe-2300-4585-85c6-883eba42e35b tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/131142fd-e8ec-42d1-a518-aa21c7bb7cb1/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:30:16 user nova-compute[75122]: DEBUG nova.virt.disk.api [None req-7d8ec1fe-2300-4585-85c6-883eba42e35b tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Cannot resize image /opt/stack/data/nova/instances/131142fd-e8ec-42d1-a518-aa21c7bb7cb1/disk to a smaller size. {{(pid=75122) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 09:30:16 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-7d8ec1fe-2300-4585-85c6-883eba42e35b tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] [instance: 131142fd-e8ec-42d1-a518-aa21c7bb7cb1] Created local disks {{(pid=75122) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 09:30:16 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-7d8ec1fe-2300-4585-85c6-883eba42e35b tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] [instance: 131142fd-e8ec-42d1-a518-aa21c7bb7cb1] Ensure instance console log exists: /opt/stack/data/nova/instances/131142fd-e8ec-42d1-a518-aa21c7bb7cb1/console.log {{(pid=75122) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 09:30:16 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-7d8ec1fe-2300-4585-85c6-883eba42e35b tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:30:16 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-7d8ec1fe-2300-4585-85c6-883eba42e35b tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:30:16 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-7d8ec1fe-2300-4585-85c6-883eba42e35b tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:30:16 user nova-compute[75122]: DEBUG nova.network.neutron [None req-7d8ec1fe-2300-4585-85c6-883eba42e35b tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] [instance: 131142fd-e8ec-42d1-a518-aa21c7bb7cb1] Successfully created port: f8302d0d-f140-479c-96da-b21516385381 {{(pid=75122) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 09:30:17 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:30:17 user nova-compute[75122]: DEBUG nova.network.neutron [None req-0dd63a3d-853a-4790-8ee1-7bbf2f8d29cb tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] [instance: ee961d5a-e0d1-4931-9293-eefbe638097a] Updating instance_info_cache with network_info: [{"id": "ae8a9c5e-17d1-4aa9-b3fa-b829d1dc6fd2", "address": "fa:16:3e:7d:98:85", "network": {"id": "44caed16-406b-4a76-966a-0dc42b26f133", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-465582303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d672b8845fa849d99e328521d3d1715b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae8a9c5e-17", "ovs_interfaceid": "ae8a9c5e-17d1-4aa9-b3fa-b829d1dc6fd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:30:17 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0dd63a3d-853a-4790-8ee1-7bbf2f8d29cb tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Releasing lock "refresh_cache-ee961d5a-e0d1-4931-9293-eefbe638097a" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 09:30:17 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0dd63a3d-853a-4790-8ee1-7bbf2f8d29cb tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] [instance: ee961d5a-e0d1-4931-9293-eefbe638097a] Instance network_info: |[{"id": "ae8a9c5e-17d1-4aa9-b3fa-b829d1dc6fd2", "address": "fa:16:3e:7d:98:85", "network": {"id": "44caed16-406b-4a76-966a-0dc42b26f133", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-465582303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d672b8845fa849d99e328521d3d1715b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae8a9c5e-17", "ovs_interfaceid": "ae8a9c5e-17d1-4aa9-b3fa-b829d1dc6fd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75122) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 09:30:17 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-9766f3f8-baed-465e-b395-dd0d8a38207b req-3035b955-365d-4269-b8f9-702f6c682f3e service nova] Acquired lock "refresh_cache-ee961d5a-e0d1-4931-9293-eefbe638097a" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 09:30:17 user nova-compute[75122]: DEBUG nova.network.neutron [req-9766f3f8-baed-465e-b395-dd0d8a38207b req-3035b955-365d-4269-b8f9-702f6c682f3e service nova] [instance: ee961d5a-e0d1-4931-9293-eefbe638097a] Refreshing network info cache for port ae8a9c5e-17d1-4aa9-b3fa-b829d1dc6fd2 {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 09:30:17 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-0dd63a3d-853a-4790-8ee1-7bbf2f8d29cb tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] [instance: ee961d5a-e0d1-4931-9293-eefbe638097a] Start _get_guest_xml network_info=[{"id": "ae8a9c5e-17d1-4aa9-b3fa-b829d1dc6fd2", "address": "fa:16:3e:7d:98:85", "network": {"id": "44caed16-406b-4a76-966a-0dc42b26f133", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-465582303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d672b8845fa849d99e328521d3d1715b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae8a9c5e-17", "ovs_interfaceid": "ae8a9c5e-17d1-4aa9-b3fa-b829d1dc6fd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T09:26:31Z,direct_url=<?>,disk_format='qcow2',id=5e862cfe-47b8-4725-8292-65761ee6d0f5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9c57733cb41847c0b4ad31519c382e5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T09:26:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '5e862cfe-47b8-4725-8292-65761ee6d0f5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75122) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 09:30:17 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-0dd63a3d-853a-4790-8ee1-7bbf2f8d29cb tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 09:30:17 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-0dd63a3d-853a-4790-8ee1-7bbf2f8d29cb tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 09:30:17 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-0dd63a3d-853a-4790-8ee1-7bbf2f8d29cb tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75122) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 09:30:17 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-0dd63a3d-853a-4790-8ee1-7bbf2f8d29cb tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] CPU controller missing on host. {{(pid=75122) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 09:30:17 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-0dd63a3d-853a-4790-8ee1-7bbf2f8d29cb tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75122) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 09:30:17 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-0dd63a3d-853a-4790-8ee1-7bbf2f8d29cb tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] CPU controller found on host. {{(pid=75122) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 09:30:17 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-0dd63a3d-853a-4790-8ee1-7bbf2f8d29cb tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75122) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 09:30:17 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-0dd63a3d-853a-4790-8ee1-7bbf2f8d29cb tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T09:26:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T09:26:31Z,direct_url=<?>,disk_format='qcow2',id=5e862cfe-47b8-4725-8292-65761ee6d0f5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9c57733cb41847c0b4ad31519c382e5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T09:26:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 09:30:17 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-0dd63a3d-853a-4790-8ee1-7bbf2f8d29cb tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Flavor limits 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 09:30:17 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-0dd63a3d-853a-4790-8ee1-7bbf2f8d29cb tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Image limits 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 09:30:17 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-0dd63a3d-853a-4790-8ee1-7bbf2f8d29cb tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Flavor pref 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 09:30:17 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-0dd63a3d-853a-4790-8ee1-7bbf2f8d29cb tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Image pref 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 09:30:17 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-0dd63a3d-853a-4790-8ee1-7bbf2f8d29cb tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 09:30:17 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-0dd63a3d-853a-4790-8ee1-7bbf2f8d29cb tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 09:30:17 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-0dd63a3d-853a-4790-8ee1-7bbf2f8d29cb tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75122) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 09:30:17 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-0dd63a3d-853a-4790-8ee1-7bbf2f8d29cb tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Got 1 possible topologies {{(pid=75122) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 09:30:17 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-0dd63a3d-853a-4790-8ee1-7bbf2f8d29cb tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 09:30:17 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-0dd63a3d-853a-4790-8ee1-7bbf2f8d29cb tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 09:30:17 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-0dd63a3d-853a-4790-8ee1-7bbf2f8d29cb tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T09:30:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-79968674',display_name='tempest-ServerActionsTestOtherB-server-79968674',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-79968674',id=2,image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJiK6B7/Kn/Opurq4zSOmiWq8yh0HkUVgNM/DkoeYxKo1kQJMVcwOjFbHB9+CscyIIndFz0uf8CUeGmaOLp83QTM6njH0bbr1gC12yHMNGMet8mqfmXy8CIGmj4KMayIOw==',key_name='tempest-keypair-1064498524',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d672b8845fa849d99e328521d3d1715b',ramdisk_id='',reservation_id='r-32nlhypw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-279691748',owner_user_name='tempest-ServerActionsTestOtherB-279691748-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T09:30:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c9bf6f2e607842889cd6593ba114cfc3',uuid=ee961d5a-e0d1-4931-9293-eefbe638097a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ae8a9c5e-17d1-4aa9-b3fa-b829d1dc6fd2", "address": "fa:16:3e:7d:98:85", "network": {"id": "44caed16-406b-4a76-966a-0dc42b26f133", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-465582303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d672b8845fa849d99e328521d3d1715b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae8a9c5e-17", "ovs_interfaceid": "ae8a9c5e-17d1-4aa9-b3fa-b829d1dc6fd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75122) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 09:30:17 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-0dd63a3d-853a-4790-8ee1-7bbf2f8d29cb tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Converting VIF {"id": "ae8a9c5e-17d1-4aa9-b3fa-b829d1dc6fd2", "address": "fa:16:3e:7d:98:85", "network": {"id": "44caed16-406b-4a76-966a-0dc42b26f133", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-465582303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d672b8845fa849d99e328521d3d1715b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae8a9c5e-17", "ovs_interfaceid": "ae8a9c5e-17d1-4aa9-b3fa-b829d1dc6fd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 09:30:17 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-0dd63a3d-853a-4790-8ee1-7bbf2f8d29cb tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:98:85,bridge_name='br-int',has_traffic_filtering=True,id=ae8a9c5e-17d1-4aa9-b3fa-b829d1dc6fd2,network=Network(44caed16-406b-4a76-966a-0dc42b26f133),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae8a9c5e-17') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 09:30:17 user nova-compute[75122]: DEBUG nova.objects.instance [None req-0dd63a3d-853a-4790-8ee1-7bbf2f8d29cb tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Lazy-loading 'pci_devices' on Instance uuid ee961d5a-e0d1-4931-9293-eefbe638097a {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:30:17 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-0dd63a3d-853a-4790-8ee1-7bbf2f8d29cb tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] [instance: ee961d5a-e0d1-4931-9293-eefbe638097a] End _get_guest_xml xml=<domain type="kvm">
Nov 15 09:30:17 user nova-compute[75122]:   <uuid>ee961d5a-e0d1-4931-9293-eefbe638097a</uuid>
Nov 15 09:30:17 user nova-compute[75122]:   <name>instance-00000002</name>
Nov 15 09:30:17 user nova-compute[75122]:   <memory>524288</memory>
Nov 15 09:30:17 user nova-compute[75122]:   <vcpu>1</vcpu>
Nov 15 09:30:17 user nova-compute[75122]:   <metadata>
Nov 15 09:30:17 user nova-compute[75122]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 09:30:17 user nova-compute[75122]:       <nova:package version="0.0.0"/>
Nov 15 09:30:17 user nova-compute[75122]:       <nova:name>tempest-ServerActionsTestOtherB-server-79968674</nova:name>
Nov 15 09:30:17 user nova-compute[75122]:       <nova:creationTime>2023-11-15 09:30:17</nova:creationTime>
Nov 15 09:30:17 user nova-compute[75122]:       <nova:flavor name="m1.tiny">
Nov 15 09:30:17 user nova-compute[75122]:         <nova:memory>512</nova:memory>
Nov 15 09:30:17 user nova-compute[75122]:         <nova:disk>1</nova:disk>
Nov 15 09:30:17 user nova-compute[75122]:         <nova:swap>0</nova:swap>
Nov 15 09:30:17 user nova-compute[75122]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 09:30:17 user nova-compute[75122]:         <nova:vcpus>1</nova:vcpus>
Nov 15 09:30:17 user nova-compute[75122]:       </nova:flavor>
Nov 15 09:30:17 user nova-compute[75122]:       <nova:owner>
Nov 15 09:30:17 user nova-compute[75122]:         <nova:user uuid="c9bf6f2e607842889cd6593ba114cfc3">tempest-ServerActionsTestOtherB-279691748-project-member</nova:user>
Nov 15 09:30:17 user nova-compute[75122]:         <nova:project uuid="d672b8845fa849d99e328521d3d1715b">tempest-ServerActionsTestOtherB-279691748</nova:project>
Nov 15 09:30:17 user nova-compute[75122]:       </nova:owner>
Nov 15 09:30:17 user nova-compute[75122]:       <nova:root type="image" uuid="5e862cfe-47b8-4725-8292-65761ee6d0f5"/>
Nov 15 09:30:17 user nova-compute[75122]:       <nova:ports>
Nov 15 09:30:17 user nova-compute[75122]:         <nova:port uuid="ae8a9c5e-17d1-4aa9-b3fa-b829d1dc6fd2">
Nov 15 09:30:17 user nova-compute[75122]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 15 09:30:17 user nova-compute[75122]:         </nova:port>
Nov 15 09:30:17 user nova-compute[75122]:       </nova:ports>
Nov 15 09:30:17 user nova-compute[75122]:     </nova:instance>
Nov 15 09:30:17 user nova-compute[75122]:   </metadata>
Nov 15 09:30:17 user nova-compute[75122]:   <sysinfo type="smbios">
Nov 15 09:30:17 user nova-compute[75122]:     <system>
Nov 15 09:30:17 user nova-compute[75122]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 09:30:17 user nova-compute[75122]:       <entry name="product">OpenStack Nova</entry>
Nov 15 09:30:17 user nova-compute[75122]:       <entry name="version">0.0.0</entry>
Nov 15 09:30:17 user nova-compute[75122]:       <entry name="serial">ee961d5a-e0d1-4931-9293-eefbe638097a</entry>
Nov 15 09:30:17 user nova-compute[75122]:       <entry name="uuid">ee961d5a-e0d1-4931-9293-eefbe638097a</entry>
Nov 15 09:30:17 user nova-compute[75122]:       <entry name="family">Virtual Machine</entry>
Nov 15 09:30:17 user nova-compute[75122]:     </system>
Nov 15 09:30:17 user nova-compute[75122]:   </sysinfo>
Nov 15 09:30:17 user nova-compute[75122]:   <os>
Nov 15 09:30:17 user nova-compute[75122]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 09:30:17 user nova-compute[75122]:     <boot dev="hd"/>
Nov 15 09:30:17 user nova-compute[75122]:     <smbios mode="sysinfo"/>
Nov 15 09:30:17 user nova-compute[75122]:   </os>
Nov 15 09:30:17 user nova-compute[75122]:   <features>
Nov 15 09:30:17 user nova-compute[75122]:     <acpi/>
Nov 15 09:30:17 user nova-compute[75122]:     <apic/>
Nov 15 09:30:17 user nova-compute[75122]:     <vmcoreinfo/>
Nov 15 09:30:17 user nova-compute[75122]:   </features>
Nov 15 09:30:17 user nova-compute[75122]:   <clock offset="utc">
Nov 15 09:30:17 user nova-compute[75122]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 09:30:17 user nova-compute[75122]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 09:30:17 user nova-compute[75122]:     <timer name="hpet" present="no"/>
Nov 15 09:30:17 user nova-compute[75122]:   </clock>
Nov 15 09:30:17 user nova-compute[75122]:   <cpu mode="custom" match="exact">
Nov 15 09:30:17 user nova-compute[75122]:     <model>Nehalem</model>
Nov 15 09:30:17 user nova-compute[75122]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 09:30:17 user nova-compute[75122]:   </cpu>
Nov 15 09:30:17 user nova-compute[75122]:   <devices>
Nov 15 09:30:17 user nova-compute[75122]:     <disk type="file" device="disk">
Nov 15 09:30:17 user nova-compute[75122]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 09:30:17 user nova-compute[75122]:       <source file="/opt/stack/data/nova/instances/ee961d5a-e0d1-4931-9293-eefbe638097a/disk"/>
Nov 15 09:30:17 user nova-compute[75122]:       <target dev="vda" bus="virtio"/>
Nov 15 09:30:17 user nova-compute[75122]:     </disk>
Nov 15 09:30:17 user nova-compute[75122]:     <interface type="ethernet">
Nov 15 09:30:17 user nova-compute[75122]:       <mac address="fa:16:3e:7d:98:85"/>
Nov 15 09:30:17 user nova-compute[75122]:       <model type="virtio"/>
Nov 15 09:30:17 user nova-compute[75122]:       <mtu size="1442"/>
Nov 15 09:30:17 user nova-compute[75122]:       <target dev="tapae8a9c5e-17"/>
Nov 15 09:30:17 user nova-compute[75122]:     </interface>
Nov 15 09:30:17 user nova-compute[75122]:     <serial type="pty">
Nov 15 09:30:17 user nova-compute[75122]:       <log file="/opt/stack/data/nova/instances/ee961d5a-e0d1-4931-9293-eefbe638097a/console.log" append="off"/>
Nov 15 09:30:17 user nova-compute[75122]:     </serial>
Nov 15 09:30:17 user nova-compute[75122]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 09:30:17 user nova-compute[75122]:     <video>
Nov 15 09:30:17 user nova-compute[75122]:       <model type="virtio"/>
Nov 15 09:30:17 user nova-compute[75122]:     </video>
Nov 15 09:30:17 user nova-compute[75122]:     <rng model="virtio">
Nov 15 09:30:17 user nova-compute[75122]:       <backend model="random">/dev/urandom</backend>
Nov 15 09:30:17 user nova-compute[75122]:     </rng>
Nov 15 09:30:17 user nova-compute[75122]:     <controller type="usb" index="0" model="none"/>
Nov 15 09:30:17 user nova-compute[75122]:     <memballoon model="virtio">
Nov 15 09:30:17 user nova-compute[75122]:       <stats period="10"/>
Nov 15 09:30:17 user nova-compute[75122]:     </memballoon>
Nov 15 09:30:17 user nova-compute[75122]:   </devices>
Nov 15 09:30:17 user nova-compute[75122]: </domain>
Nov 15 09:30:17 user nova-compute[75122]:  {{(pid=75122) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 09:30:17 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-0dd63a3d-853a-4790-8ee1-7bbf2f8d29cb tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T09:30:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-79968674',display_name='tempest-ServerActionsTestOtherB-server-79968674',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-79968674',id=2,image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJiK6B7/Kn/Opurq4zSOmiWq8yh0HkUVgNM/DkoeYxKo1kQJMVcwOjFbHB9+CscyIIndFz0uf8CUeGmaOLp83QTM6njH0bbr1gC12yHMNGMet8mqfmXy8CIGmj4KMayIOw==',key_name='tempest-keypair-1064498524',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d672b8845fa849d99e328521d3d1715b',ramdisk_id='',reservation_id='r-32nlhypw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-279691748',owner_user_name='tempest-ServerActionsTestOtherB-279691748-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T09:30:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c9bf6f2e607842889cd6593ba114cfc3',uuid=ee961d5a-e0d1-4931-9293-eefbe638097a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ae8a9c5e-17d1-4aa9-b3fa-b829d1dc6fd2", "address": "fa:16:3e:7d:98:85", "network": {"id": "44caed16-406b-4a76-966a-0dc42b26f133", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-465582303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d672b8845fa849d99e328521d3d1715b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae8a9c5e-17", "ovs_interfaceid": "ae8a9c5e-17d1-4aa9-b3fa-b829d1dc6fd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 09:30:17 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-0dd63a3d-853a-4790-8ee1-7bbf2f8d29cb tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Converting VIF {"id": "ae8a9c5e-17d1-4aa9-b3fa-b829d1dc6fd2", "address": "fa:16:3e:7d:98:85", "network": {"id": "44caed16-406b-4a76-966a-0dc42b26f133", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-465582303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d672b8845fa849d99e328521d3d1715b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae8a9c5e-17", "ovs_interfaceid": "ae8a9c5e-17d1-4aa9-b3fa-b829d1dc6fd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 09:30:17 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-0dd63a3d-853a-4790-8ee1-7bbf2f8d29cb tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:98:85,bridge_name='br-int',has_traffic_filtering=True,id=ae8a9c5e-17d1-4aa9-b3fa-b829d1dc6fd2,network=Network(44caed16-406b-4a76-966a-0dc42b26f133),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae8a9c5e-17') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 09:30:17 user nova-compute[75122]: DEBUG os_vif [None req-0dd63a3d-853a-4790-8ee1-7bbf2f8d29cb tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:98:85,bridge_name='br-int',has_traffic_filtering=True,id=ae8a9c5e-17d1-4aa9-b3fa-b829d1dc6fd2,network=Network(44caed16-406b-4a76-966a-0dc42b26f133),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae8a9c5e-17') {{(pid=75122) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 09:30:17 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:30:17 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:30:17 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 09:30:17 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:30:17 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3609e1c0-55d8-546a-b83f-6084bd8a23e9', '_type': 'linux-noop'}}, row=False) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:30:17 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:30:17 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:30:17 user sudo[84456]: pam_unix(sudo:session): session closed for user root
Nov 15 09:30:17 user nova-compute[75122]: INFO oslo.privsep.daemon [None req-7f3b21af-05a6-4b9c-b229-3d5c62bbc307 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] Spawned new privsep daemon via rootwrap
Nov 15 09:30:17 user nova-compute[75122]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 15 09:30:17 user nova-compute[75122]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 15 09:30:17 user nova-compute[75122]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Nov 15 09:30:17 user nova-compute[75122]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84469
Nov 15 09:30:17 user nova-compute[75122]: WARNING oslo_privsep.priv_context [None req-0dd63a3d-853a-4790-8ee1-7bbf2f8d29cb tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] privsep daemon already running
Nov 15 09:30:17 user nova-compute[75122]: DEBUG nova.network.neutron [None req-7d8ec1fe-2300-4585-85c6-883eba42e35b tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] [instance: 131142fd-e8ec-42d1-a518-aa21c7bb7cb1] Successfully updated port: f8302d0d-f140-479c-96da-b21516385381 {{(pid=75122) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 09:30:17 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-7d8ec1fe-2300-4585-85c6-883eba42e35b tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Acquiring lock "refresh_cache-131142fd-e8ec-42d1-a518-aa21c7bb7cb1" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 09:30:17 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-7d8ec1fe-2300-4585-85c6-883eba42e35b tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Acquired lock "refresh_cache-131142fd-e8ec-42d1-a518-aa21c7bb7cb1" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 09:30:17 user nova-compute[75122]: DEBUG nova.network.neutron [None req-7d8ec1fe-2300-4585-85c6-883eba42e35b tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] [instance: 131142fd-e8ec-42d1-a518-aa21c7bb7cb1] Building network info cache for instance {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 09:30:18 user nova-compute[75122]: DEBUG nova.compute.manager [req-061d1864-978d-43ce-9e46-d487ba3e7778 req-991f204c-ee72-4824-aa17-13694255cbf0 service nova] [instance: 131142fd-e8ec-42d1-a518-aa21c7bb7cb1] Received event network-changed-f8302d0d-f140-479c-96da-b21516385381 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:30:18 user nova-compute[75122]: DEBUG nova.compute.manager [req-061d1864-978d-43ce-9e46-d487ba3e7778 req-991f204c-ee72-4824-aa17-13694255cbf0 service nova] [instance: 131142fd-e8ec-42d1-a518-aa21c7bb7cb1] Refreshing instance network info cache due to event network-changed-f8302d0d-f140-479c-96da-b21516385381. {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 09:30:18 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-061d1864-978d-43ce-9e46-d487ba3e7778 req-991f204c-ee72-4824-aa17-13694255cbf0 service nova] Acquiring lock "refresh_cache-131142fd-e8ec-42d1-a518-aa21c7bb7cb1" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 09:30:18 user nova-compute[75122]: DEBUG nova.network.neutron [None req-7d8ec1fe-2300-4585-85c6-883eba42e35b tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] [instance: 131142fd-e8ec-42d1-a518-aa21c7bb7cb1] Instance cache missing network info. {{(pid=75122) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 09:30:18 user nova-compute[75122]: DEBUG nova.network.neutron [None req-7d8ec1fe-2300-4585-85c6-883eba42e35b tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] [instance: 131142fd-e8ec-42d1-a518-aa21c7bb7cb1] Updating instance_info_cache with network_info: [{"id": "f8302d0d-f140-479c-96da-b21516385381", "address": "fa:16:3e:06:1e:34", "network": {"id": "6e846655-a6f8-4339-a239-65d2f94c8b74", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1923452032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b8e67f8a66a4930be3fb65c397cbeb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8302d0d-f1", "ovs_interfaceid": "f8302d0d-f140-479c-96da-b21516385381", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:30:18 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-7d8ec1fe-2300-4585-85c6-883eba42e35b tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Releasing lock "refresh_cache-131142fd-e8ec-42d1-a518-aa21c7bb7cb1" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 09:30:18 user nova-compute[75122]: DEBUG nova.compute.manager [None req-7d8ec1fe-2300-4585-85c6-883eba42e35b tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] [instance: 131142fd-e8ec-42d1-a518-aa21c7bb7cb1] Instance network_info: |[{"id": "f8302d0d-f140-479c-96da-b21516385381", "address": "fa:16:3e:06:1e:34", "network": {"id": "6e846655-a6f8-4339-a239-65d2f94c8b74", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1923452032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b8e67f8a66a4930be3fb65c397cbeb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8302d0d-f1", "ovs_interfaceid": "f8302d0d-f140-479c-96da-b21516385381", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75122) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 09:30:18 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-061d1864-978d-43ce-9e46-d487ba3e7778 req-991f204c-ee72-4824-aa17-13694255cbf0 service nova] Acquired lock "refresh_cache-131142fd-e8ec-42d1-a518-aa21c7bb7cb1" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 09:30:18 user nova-compute[75122]: DEBUG nova.network.neutron [req-061d1864-978d-43ce-9e46-d487ba3e7778 req-991f204c-ee72-4824-aa17-13694255cbf0 service nova] [instance: 131142fd-e8ec-42d1-a518-aa21c7bb7cb1] Refreshing network info cache for port f8302d0d-f140-479c-96da-b21516385381 {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 09:30:18 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-7d8ec1fe-2300-4585-85c6-883eba42e35b tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] [instance: 131142fd-e8ec-42d1-a518-aa21c7bb7cb1] Start _get_guest_xml network_info=[{"id": "f8302d0d-f140-479c-96da-b21516385381", "address": "fa:16:3e:06:1e:34", "network": {"id": "6e846655-a6f8-4339-a239-65d2f94c8b74", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1923452032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b8e67f8a66a4930be3fb65c397cbeb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8302d0d-f1", "ovs_interfaceid": "f8302d0d-f140-479c-96da-b21516385381", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T09:26:31Z,direct_url=<?>,disk_format='qcow2',id=5e862cfe-47b8-4725-8292-65761ee6d0f5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9c57733cb41847c0b4ad31519c382e5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T09:26:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '5e862cfe-47b8-4725-8292-65761ee6d0f5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75122) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 09:30:18 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-7d8ec1fe-2300-4585-85c6-883eba42e35b tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 09:30:18 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-7d8ec1fe-2300-4585-85c6-883eba42e35b tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 09:30:18 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-7d8ec1fe-2300-4585-85c6-883eba42e35b tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75122) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 09:30:18 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-7d8ec1fe-2300-4585-85c6-883eba42e35b tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] CPU controller missing on host. {{(pid=75122) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 09:30:18 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-7d8ec1fe-2300-4585-85c6-883eba42e35b tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75122) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 09:30:18 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-7d8ec1fe-2300-4585-85c6-883eba42e35b tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] CPU controller found on host. {{(pid=75122) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 09:30:18 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-7d8ec1fe-2300-4585-85c6-883eba42e35b tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75122) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 09:30:18 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-7d8ec1fe-2300-4585-85c6-883eba42e35b tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T09:26:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T09:26:31Z,direct_url=<?>,disk_format='qcow2',id=5e862cfe-47b8-4725-8292-65761ee6d0f5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9c57733cb41847c0b4ad31519c382e5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T09:26:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 09:30:18 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-7d8ec1fe-2300-4585-85c6-883eba42e35b tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Flavor limits 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 09:30:18 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-7d8ec1fe-2300-4585-85c6-883eba42e35b tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Image limits 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 09:30:18 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-7d8ec1fe-2300-4585-85c6-883eba42e35b tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Flavor pref 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 09:30:18 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-7d8ec1fe-2300-4585-85c6-883eba42e35b tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Image pref 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 09:30:18 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-7d8ec1fe-2300-4585-85c6-883eba42e35b tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 09:30:18 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-7d8ec1fe-2300-4585-85c6-883eba42e35b tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 09:30:18 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-7d8ec1fe-2300-4585-85c6-883eba42e35b tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75122) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 09:30:18 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-7d8ec1fe-2300-4585-85c6-883eba42e35b tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Got 1 possible topologies {{(pid=75122) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 09:30:18 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-7d8ec1fe-2300-4585-85c6-883eba42e35b tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 09:30:18 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-7d8ec1fe-2300-4585-85c6-883eba42e35b tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 09:30:18 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-7d8ec1fe-2300-4585-85c6-883eba42e35b tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T09:30:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1475115621',display_name='tempest-ServerActionsTestOtherA-server-1475115621',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1475115621',id=3,image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOjee/3FY3+bQUxkeNPW0HfKU2TS7/WwlSdJA5dC2LRbPtr2GAllBrZqAcx+1wIVC2pqAFLTFeo/KsxadKKcxACsVLYL8LB97mDl41CXm0aq5TWX4fm1S5aOkZSs0D2eNA==',key_name='tempest-keypair-686734186',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8b8e67f8a66a4930be3fb65c397cbeb2',ramdisk_id='',reservation_id='r-v7hru7rf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1521412552',owner_user_name='tempest-ServerActionsTestOtherA-1521412552-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T09:30:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='91f1469b2c7c45d6ac27f2b64fd5cefe',uuid=131142fd-e8ec-42d1-a518-aa21c7bb7cb1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f8302d0d-f140-479c-96da-b21516385381", "address": "fa:16:3e:06:1e:34", "network": {"id": "6e846655-a6f8-4339-a239-65d2f94c8b74", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1923452032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b8e67f8a66a4930be3fb65c397cbeb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8302d0d-f1", "ovs_interfaceid": "f8302d0d-f140-479c-96da-b21516385381", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75122) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 09:30:18 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-7d8ec1fe-2300-4585-85c6-883eba42e35b tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Converting VIF {"id": "f8302d0d-f140-479c-96da-b21516385381", "address": "fa:16:3e:06:1e:34", "network": {"id": "6e846655-a6f8-4339-a239-65d2f94c8b74", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1923452032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b8e67f8a66a4930be3fb65c397cbeb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8302d0d-f1", "ovs_interfaceid": "f8302d0d-f140-479c-96da-b21516385381", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 09:30:18 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-7d8ec1fe-2300-4585-85c6-883eba42e35b tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:06:1e:34,bridge_name='br-int',has_traffic_filtering=True,id=f8302d0d-f140-479c-96da-b21516385381,network=Network(6e846655-a6f8-4339-a239-65d2f94c8b74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8302d0d-f1') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 09:30:18 user nova-compute[75122]: DEBUG nova.objects.instance [None req-7d8ec1fe-2300-4585-85c6-883eba42e35b tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Lazy-loading 'pci_devices' on Instance uuid 131142fd-e8ec-42d1-a518-aa21c7bb7cb1 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:30:18 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:30:18 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap43e5af96-ff, may_exist=True, interface_attrs={}) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:30:18 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap43e5af96-ff, col_values=(('qos', UUID('758c9d82-0460-43d6-8df5-1397db9f02c1')),), if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:30:18 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap43e5af96-ff, col_values=(('external_ids', {'iface-id': '43e5af96-fffc-4d74-bbed-5a78ce800158', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0d:bc:bc', 'vm-uuid': '4b582e5d-eef1-41f6-84b5-102efe3bf3f8'}),), if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:30:18 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:30:18 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-7d8ec1fe-2300-4585-85c6-883eba42e35b tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] [instance: 131142fd-e8ec-42d1-a518-aa21c7bb7cb1] End _get_guest_xml xml=<domain type="kvm">
Nov 15 09:30:18 user nova-compute[75122]:   <uuid>131142fd-e8ec-42d1-a518-aa21c7bb7cb1</uuid>
Nov 15 09:30:18 user nova-compute[75122]:   <name>instance-00000003</name>
Nov 15 09:30:18 user nova-compute[75122]:   <memory>524288</memory>
Nov 15 09:30:18 user nova-compute[75122]:   <vcpu>1</vcpu>
Nov 15 09:30:18 user nova-compute[75122]:   <metadata>
Nov 15 09:30:18 user nova-compute[75122]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 09:30:18 user nova-compute[75122]:       <nova:package version="0.0.0"/>
Nov 15 09:30:18 user nova-compute[75122]:       <nova:name>tempest-ServerActionsTestOtherA-server-1475115621</nova:name>
Nov 15 09:30:18 user nova-compute[75122]:       <nova:creationTime>2023-11-15 09:30:18</nova:creationTime>
Nov 15 09:30:18 user nova-compute[75122]:       <nova:flavor name="m1.tiny">
Nov 15 09:30:18 user nova-compute[75122]:         <nova:memory>512</nova:memory>
Nov 15 09:30:18 user nova-compute[75122]:         <nova:disk>1</nova:disk>
Nov 15 09:30:18 user nova-compute[75122]:         <nova:swap>0</nova:swap>
Nov 15 09:30:18 user nova-compute[75122]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 09:30:18 user nova-compute[75122]:         <nova:vcpus>1</nova:vcpus>
Nov 15 09:30:18 user nova-compute[75122]:       </nova:flavor>
Nov 15 09:30:18 user nova-compute[75122]:       <nova:owner>
Nov 15 09:30:18 user nova-compute[75122]:         <nova:user uuid="91f1469b2c7c45d6ac27f2b64fd5cefe">tempest-ServerActionsTestOtherA-1521412552-project-member</nova:user>
Nov 15 09:30:18 user nova-compute[75122]:         <nova:project uuid="8b8e67f8a66a4930be3fb65c397cbeb2">tempest-ServerActionsTestOtherA-1521412552</nova:project>
Nov 15 09:30:18 user nova-compute[75122]:       </nova:owner>
Nov 15 09:30:18 user nova-compute[75122]:       <nova:root type="image" uuid="5e862cfe-47b8-4725-8292-65761ee6d0f5"/>
Nov 15 09:30:18 user nova-compute[75122]:       <nova:ports>
Nov 15 09:30:18 user nova-compute[75122]:         <nova:port uuid="f8302d0d-f140-479c-96da-b21516385381">
Nov 15 09:30:18 user nova-compute[75122]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 15 09:30:18 user nova-compute[75122]:         </nova:port>
Nov 15 09:30:18 user nova-compute[75122]:       </nova:ports>
Nov 15 09:30:18 user nova-compute[75122]:     </nova:instance>
Nov 15 09:30:18 user nova-compute[75122]:   </metadata>
Nov 15 09:30:18 user nova-compute[75122]:   <sysinfo type="smbios">
Nov 15 09:30:18 user nova-compute[75122]:     <system>
Nov 15 09:30:18 user nova-compute[75122]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 09:30:18 user nova-compute[75122]:       <entry name="product">OpenStack Nova</entry>
Nov 15 09:30:18 user nova-compute[75122]:       <entry name="version">0.0.0</entry>
Nov 15 09:30:18 user nova-compute[75122]:       <entry name="serial">131142fd-e8ec-42d1-a518-aa21c7bb7cb1</entry>
Nov 15 09:30:18 user nova-compute[75122]:       <entry name="uuid">131142fd-e8ec-42d1-a518-aa21c7bb7cb1</entry>
Nov 15 09:30:18 user nova-compute[75122]:       <entry name="family">Virtual Machine</entry>
Nov 15 09:30:18 user nova-compute[75122]:     </system>
Nov 15 09:30:18 user nova-compute[75122]:   </sysinfo>
Nov 15 09:30:18 user nova-compute[75122]:   <os>
Nov 15 09:30:18 user nova-compute[75122]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 09:30:18 user nova-compute[75122]:     <boot dev="hd"/>
Nov 15 09:30:18 user nova-compute[75122]:     <smbios mode="sysinfo"/>
Nov 15 09:30:18 user nova-compute[75122]:   </os>
Nov 15 09:30:18 user nova-compute[75122]:   <features>
Nov 15 09:30:18 user nova-compute[75122]:     <acpi/>
Nov 15 09:30:18 user nova-compute[75122]:     <apic/>
Nov 15 09:30:18 user nova-compute[75122]:     <vmcoreinfo/>
Nov 15 09:30:18 user nova-compute[75122]:   </features>
Nov 15 09:30:18 user nova-compute[75122]:   <clock offset="utc">
Nov 15 09:30:18 user nova-compute[75122]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 09:30:18 user nova-compute[75122]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 09:30:18 user nova-compute[75122]:     <timer name="hpet" present="no"/>
Nov 15 09:30:18 user nova-compute[75122]:   </clock>
Nov 15 09:30:18 user nova-compute[75122]:   <cpu mode="custom" match="exact">
Nov 15 09:30:18 user nova-compute[75122]:     <model>Nehalem</model>
Nov 15 09:30:18 user nova-compute[75122]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 09:30:18 user nova-compute[75122]:   </cpu>
Nov 15 09:30:18 user nova-compute[75122]:   <devices>
Nov 15 09:30:18 user nova-compute[75122]:     <disk type="file" device="disk">
Nov 15 09:30:18 user nova-compute[75122]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 09:30:18 user nova-compute[75122]:       <source file="/opt/stack/data/nova/instances/131142fd-e8ec-42d1-a518-aa21c7bb7cb1/disk"/>
Nov 15 09:30:18 user nova-compute[75122]:       <target dev="vda" bus="virtio"/>
Nov 15 09:30:18 user nova-compute[75122]:     </disk>
Nov 15 09:30:18 user nova-compute[75122]:     <interface type="ethernet">
Nov 15 09:30:18 user nova-compute[75122]:       <mac address="fa:16:3e:06:1e:34"/>
Nov 15 09:30:18 user nova-compute[75122]:       <model type="virtio"/>
Nov 15 09:30:18 user nova-compute[75122]:       <mtu size="1442"/>
Nov 15 09:30:18 user nova-compute[75122]:       <target dev="tapf8302d0d-f1"/>
Nov 15 09:30:18 user nova-compute[75122]:     </interface>
Nov 15 09:30:18 user nova-compute[75122]:     <serial type="pty">
Nov 15 09:30:18 user nova-compute[75122]:       <log file="/opt/stack/data/nova/instances/131142fd-e8ec-42d1-a518-aa21c7bb7cb1/console.log" append="off"/>
Nov 15 09:30:18 user nova-compute[75122]:     </serial>
Nov 15 09:30:18 user nova-compute[75122]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 09:30:18 user nova-compute[75122]:     <video>
Nov 15 09:30:18 user nova-compute[75122]:       <model type="virtio"/>
Nov 15 09:30:18 user nova-compute[75122]:     </video>
Nov 15 09:30:18 user nova-compute[75122]:     <rng model="virtio">
Nov 15 09:30:18 user nova-compute[75122]:       <backend model="random">/dev/urandom</backend>
Nov 15 09:30:18 user nova-compute[75122]:     </rng>
Nov 15 09:30:18 user nova-compute[75122]:     <controller type="usb" index="0" model="none"/>
Nov 15 09:30:18 user nova-compute[75122]:     <memballoon model="virtio">
Nov 15 09:30:18 user nova-compute[75122]:       <stats period="10"/>
Nov 15 09:30:18 user nova-compute[75122]:     </memballoon>
Nov 15 09:30:18 user nova-compute[75122]:   </devices>
Nov 15 09:30:18 user nova-compute[75122]: </domain>
Nov 15 09:30:18 user nova-compute[75122]:  {{(pid=75122) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 09:30:18 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-7d8ec1fe-2300-4585-85c6-883eba42e35b tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T09:30:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1475115621',display_name='tempest-ServerActionsTestOtherA-server-1475115621',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1475115621',id=3,image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOjee/3FY3+bQUxkeNPW0HfKU2TS7/WwlSdJA5dC2LRbPtr2GAllBrZqAcx+1wIVC2pqAFLTFeo/KsxadKKcxACsVLYL8LB97mDl41CXm0aq5TWX4fm1S5aOkZSs0D2eNA==',key_name='tempest-keypair-686734186',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8b8e67f8a66a4930be3fb65c397cbeb2',ramdisk_id='',reservation_id='r-v7hru7rf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1521412552',owner_user_name='tempest-ServerActionsTestOtherA-1521412552-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T09:30:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='91f1469b2c7c45d6ac27f2b64fd5cefe',uuid=131142fd-e8ec-42d1-a518-aa21c7bb7cb1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f8302d0d-f140-479c-96da-b21516385381", "address": "fa:16:3e:06:1e:34", "network": {"id": "6e846655-a6f8-4339-a239-65d2f94c8b74", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1923452032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b8e67f8a66a4930be3fb65c397cbeb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8302d0d-f1", "ovs_interfaceid": "f8302d0d-f140-479c-96da-b21516385381", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 09:30:18 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-7d8ec1fe-2300-4585-85c6-883eba42e35b tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Converting VIF {"id": "f8302d0d-f140-479c-96da-b21516385381", "address": "fa:16:3e:06:1e:34", "network": {"id": "6e846655-a6f8-4339-a239-65d2f94c8b74", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1923452032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b8e67f8a66a4930be3fb65c397cbeb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8302d0d-f1", "ovs_interfaceid": "f8302d0d-f140-479c-96da-b21516385381", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 09:30:18 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-7d8ec1fe-2300-4585-85c6-883eba42e35b tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:06:1e:34,bridge_name='br-int',has_traffic_filtering=True,id=f8302d0d-f140-479c-96da-b21516385381,network=Network(6e846655-a6f8-4339-a239-65d2f94c8b74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8302d0d-f1') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 09:30:18 user nova-compute[75122]: DEBUG os_vif [None req-7d8ec1fe-2300-4585-85c6-883eba42e35b tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:1e:34,bridge_name='br-int',has_traffic_filtering=True,id=f8302d0d-f140-479c-96da-b21516385381,network=Network(6e846655-a6f8-4339-a239-65d2f94c8b74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8302d0d-f1') {{(pid=75122) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 09:30:18 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:30:18 user nova-compute[75122]: INFO os_vif [None req-7f3b21af-05a6-4b9c-b229-3d5c62bbc307 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:bc:bc,bridge_name='br-int',has_traffic_filtering=True,id=43e5af96-fffc-4d74-bbed-5a78ce800158,network=Network(0701c672-3bc3-4a49-afd0-6b439abd2956),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43e5af96-ff')
Nov 15 09:30:18 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:30:18 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapae8a9c5e-17, may_exist=True, interface_attrs={}) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:30:18 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapae8a9c5e-17, col_values=(('qos', UUID('dccc8f98-98fd-4781-a0df-30515ea0b610')),), if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:30:18 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapae8a9c5e-17, col_values=(('external_ids', {'iface-id': 'ae8a9c5e-17d1-4aa9-b3fa-b829d1dc6fd2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7d:98:85', 'vm-uuid': 'ee961d5a-e0d1-4931-9293-eefbe638097a'}),), if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:30:18 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:30:18 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:30:18 user nova-compute[75122]: INFO os_vif [None req-0dd63a3d-853a-4790-8ee1-7bbf2f8d29cb tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:98:85,bridge_name='br-int',has_traffic_filtering=True,id=ae8a9c5e-17d1-4aa9-b3fa-b829d1dc6fd2,network=Network(44caed16-406b-4a76-966a-0dc42b26f133),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae8a9c5e-17')
Nov 15 09:30:18 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:30:18 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:30:18 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 09:30:18 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:30:18 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5de00ba4-8519-50ed-841b-30bc9dd5b576', '_type': 'linux-noop'}}, row=False) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:30:18 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:30:18 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:30:18 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:30:18 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:30:18 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf8302d0d-f1, may_exist=True, interface_attrs={}) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:30:18 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf8302d0d-f1, col_values=(('qos', UUID('6094add3-5323-4b6f-acfd-5c2b2805c6cc')),), if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:30:18 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf8302d0d-f1, col_values=(('external_ids', {'iface-id': 'f8302d0d-f140-479c-96da-b21516385381', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:06:1e:34', 'vm-uuid': '131142fd-e8ec-42d1-a518-aa21c7bb7cb1'}),), if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:30:18 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:30:18 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:30:18 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:30:18 user nova-compute[75122]: INFO os_vif [None req-7d8ec1fe-2300-4585-85c6-883eba42e35b tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:1e:34,bridge_name='br-int',has_traffic_filtering=True,id=f8302d0d-f140-479c-96da-b21516385381,network=Network(6e846655-a6f8-4339-a239-65d2f94c8b74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8302d0d-f1')
Nov 15 09:30:18 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-0dd63a3d-853a-4790-8ee1-7bbf2f8d29cb tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] No BDM found with device name vda, not building metadata. {{(pid=75122) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 09:30:18 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-0dd63a3d-853a-4790-8ee1-7bbf2f8d29cb tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] No VIF found with MAC fa:16:3e:7d:98:85, not building metadata {{(pid=75122) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 09:30:18 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-7f3b21af-05a6-4b9c-b229-3d5c62bbc307 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] No BDM found with device name vda, not building metadata. {{(pid=75122) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 09:30:18 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-7f3b21af-05a6-4b9c-b229-3d5c62bbc307 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] No VIF found with MAC fa:16:3e:0d:bc:bc, not building metadata {{(pid=75122) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 09:30:18 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-7d8ec1fe-2300-4585-85c6-883eba42e35b tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] No BDM found with device name vda, not building metadata. {{(pid=75122) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 09:30:18 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-7d8ec1fe-2300-4585-85c6-883eba42e35b tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] No VIF found with MAC fa:16:3e:06:1e:34, not building metadata {{(pid=75122) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 09:30:18 user nova-compute[75122]: DEBUG nova.network.neutron [req-9766f3f8-baed-465e-b395-dd0d8a38207b req-3035b955-365d-4269-b8f9-702f6c682f3e service nova] [instance: ee961d5a-e0d1-4931-9293-eefbe638097a] Updated VIF entry in instance network info cache for port ae8a9c5e-17d1-4aa9-b3fa-b829d1dc6fd2. {{(pid=75122) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 09:30:18 user nova-compute[75122]: DEBUG nova.network.neutron [req-9766f3f8-baed-465e-b395-dd0d8a38207b req-3035b955-365d-4269-b8f9-702f6c682f3e service nova] [instance: ee961d5a-e0d1-4931-9293-eefbe638097a] Updating instance_info_cache with network_info: [{"id": "ae8a9c5e-17d1-4aa9-b3fa-b829d1dc6fd2", "address": "fa:16:3e:7d:98:85", "network": {"id": "44caed16-406b-4a76-966a-0dc42b26f133", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-465582303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d672b8845fa849d99e328521d3d1715b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae8a9c5e-17", "ovs_interfaceid": "ae8a9c5e-17d1-4aa9-b3fa-b829d1dc6fd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:30:18 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-9766f3f8-baed-465e-b395-dd0d8a38207b req-3035b955-365d-4269-b8f9-702f6c682f3e service nova] Releasing lock "refresh_cache-ee961d5a-e0d1-4931-9293-eefbe638097a" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 09:30:19 user nova-compute[75122]: DEBUG nova.network.neutron [req-061d1864-978d-43ce-9e46-d487ba3e7778 req-991f204c-ee72-4824-aa17-13694255cbf0 service nova] [instance: 131142fd-e8ec-42d1-a518-aa21c7bb7cb1] Updated VIF entry in instance network info cache for port f8302d0d-f140-479c-96da-b21516385381. {{(pid=75122) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 09:30:19 user nova-compute[75122]: DEBUG nova.network.neutron [req-061d1864-978d-43ce-9e46-d487ba3e7778 req-991f204c-ee72-4824-aa17-13694255cbf0 service nova] [instance: 131142fd-e8ec-42d1-a518-aa21c7bb7cb1] Updating instance_info_cache with network_info: [{"id": "f8302d0d-f140-479c-96da-b21516385381", "address": "fa:16:3e:06:1e:34", "network": {"id": "6e846655-a6f8-4339-a239-65d2f94c8b74", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1923452032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b8e67f8a66a4930be3fb65c397cbeb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8302d0d-f1", "ovs_interfaceid": "f8302d0d-f140-479c-96da-b21516385381", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:30:19 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-061d1864-978d-43ce-9e46-d487ba3e7778 req-991f204c-ee72-4824-aa17-13694255cbf0 service nova] Releasing lock "refresh_cache-131142fd-e8ec-42d1-a518-aa21c7bb7cb1" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 09:30:19 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:30:21 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:30:22 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:30:22 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:30:22 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:30:22 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:30:22 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:30:22 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:30:22 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-a3ff7621-15f0-402e-90a7-7e3cf0feaad5 tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] Acquiring lock "bcb58c79-f6b3-44d9-a80f-1a4cf580379f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:30:22 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-a3ff7621-15f0-402e-90a7-7e3cf0feaad5 tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] Lock "bcb58c79-f6b3-44d9-a80f-1a4cf580379f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:30:22 user nova-compute[75122]: DEBUG nova.compute.manager [None req-a3ff7621-15f0-402e-90a7-7e3cf0feaad5 tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] [instance: bcb58c79-f6b3-44d9-a80f-1a4cf580379f] Starting instance... {{(pid=75122) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 09:30:22 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-a3ff7621-15f0-402e-90a7-7e3cf0feaad5 tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:30:22 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-a3ff7621-15f0-402e-90a7-7e3cf0feaad5 tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:30:23 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-a3ff7621-15f0-402e-90a7-7e3cf0feaad5 tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75122) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 09:30:23 user nova-compute[75122]: INFO nova.compute.claims [None req-a3ff7621-15f0-402e-90a7-7e3cf0feaad5 tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] [instance: bcb58c79-f6b3-44d9-a80f-1a4cf580379f] Claim successful on node user
Nov 15 09:30:23 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:30:23 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:30:23 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:30:23 user nova-compute[75122]: DEBUG nova.compute.provider_tree [None req-a3ff7621-15f0-402e-90a7-7e3cf0feaad5 tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] Inventory has not changed in ProviderTree for provider: 69a3da65-47be-44c6-b67c-c692b58284ef {{(pid=75122) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 09:30:23 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-a3ff7621-15f0-402e-90a7-7e3cf0feaad5 tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] Inventory has not changed for provider 69a3da65-47be-44c6-b67c-c692b58284ef based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 09:30:23 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-a3ff7621-15f0-402e-90a7-7e3cf0feaad5 tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.548s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:30:23 user nova-compute[75122]: DEBUG nova.compute.manager [None req-a3ff7621-15f0-402e-90a7-7e3cf0feaad5 tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] [instance: bcb58c79-f6b3-44d9-a80f-1a4cf580379f] Start building networks asynchronously for instance. {{(pid=75122) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 09:30:23 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:30:23 user nova-compute[75122]: DEBUG nova.compute.manager [None req-a3ff7621-15f0-402e-90a7-7e3cf0feaad5 tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] [instance: bcb58c79-f6b3-44d9-a80f-1a4cf580379f] Allocating IP information in the background. {{(pid=75122) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 09:30:23 user nova-compute[75122]: DEBUG nova.network.neutron [None req-a3ff7621-15f0-402e-90a7-7e3cf0feaad5 tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] [instance: bcb58c79-f6b3-44d9-a80f-1a4cf580379f] allocate_for_instance() {{(pid=75122) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 09:30:23 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-a3ff7621-15f0-402e-90a7-7e3cf0feaad5 tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] [instance: bcb58c79-f6b3-44d9-a80f-1a4cf580379f] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Nov 15 09:30:23 user nova-compute[75122]: DEBUG nova.compute.manager [None req-a3ff7621-15f0-402e-90a7-7e3cf0feaad5 tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] [instance: bcb58c79-f6b3-44d9-a80f-1a4cf580379f] Start building block device mappings for instance. {{(pid=75122) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 09:30:23 user nova-compute[75122]: DEBUG nova.compute.manager [req-d18551ec-3754-4013-aab2-3fe8081381f2 req-26de63d5-2ffa-4012-923d-4d99be328c3d service nova] [instance: ee961d5a-e0d1-4931-9293-eefbe638097a] Received event network-vif-plugged-ae8a9c5e-17d1-4aa9-b3fa-b829d1dc6fd2 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:30:23 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-d18551ec-3754-4013-aab2-3fe8081381f2 req-26de63d5-2ffa-4012-923d-4d99be328c3d service nova] Acquiring lock "ee961d5a-e0d1-4931-9293-eefbe638097a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:30:23 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-d18551ec-3754-4013-aab2-3fe8081381f2 req-26de63d5-2ffa-4012-923d-4d99be328c3d service nova] Lock "ee961d5a-e0d1-4931-9293-eefbe638097a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:30:23 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-d18551ec-3754-4013-aab2-3fe8081381f2 req-26de63d5-2ffa-4012-923d-4d99be328c3d service nova] Lock "ee961d5a-e0d1-4931-9293-eefbe638097a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:30:23 user nova-compute[75122]: DEBUG nova.compute.manager [req-d18551ec-3754-4013-aab2-3fe8081381f2 req-26de63d5-2ffa-4012-923d-4d99be328c3d service nova] [instance: ee961d5a-e0d1-4931-9293-eefbe638097a] No waiting events found dispatching network-vif-plugged-ae8a9c5e-17d1-4aa9-b3fa-b829d1dc6fd2 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:30:23 user nova-compute[75122]: WARNING nova.compute.manager [req-d18551ec-3754-4013-aab2-3fe8081381f2 req-26de63d5-2ffa-4012-923d-4d99be328c3d service nova] [instance: ee961d5a-e0d1-4931-9293-eefbe638097a] Received unexpected event network-vif-plugged-ae8a9c5e-17d1-4aa9-b3fa-b829d1dc6fd2 for instance with vm_state building and task_state spawning.
Nov 15 09:30:23 user nova-compute[75122]: DEBUG nova.compute.manager [None req-a3ff7621-15f0-402e-90a7-7e3cf0feaad5 tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] [instance: bcb58c79-f6b3-44d9-a80f-1a4cf580379f] Start spawning the instance on the hypervisor. {{(pid=75122) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 09:30:23 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-a3ff7621-15f0-402e-90a7-7e3cf0feaad5 tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] [instance: bcb58c79-f6b3-44d9-a80f-1a4cf580379f] Creating instance directory {{(pid=75122) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 09:30:23 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-a3ff7621-15f0-402e-90a7-7e3cf0feaad5 tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] [instance: bcb58c79-f6b3-44d9-a80f-1a4cf580379f] Creating image(s)
Nov 15 09:30:23 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-a3ff7621-15f0-402e-90a7-7e3cf0feaad5 tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] Acquiring lock "/opt/stack/data/nova/instances/bcb58c79-f6b3-44d9-a80f-1a4cf580379f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:30:23 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-a3ff7621-15f0-402e-90a7-7e3cf0feaad5 tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] Lock "/opt/stack/data/nova/instances/bcb58c79-f6b3-44d9-a80f-1a4cf580379f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:30:23 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-a3ff7621-15f0-402e-90a7-7e3cf0feaad5 tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] Lock "/opt/stack/data/nova/instances/bcb58c79-f6b3-44d9-a80f-1a4cf580379f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:30:23 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-a3ff7621-15f0-402e-90a7-7e3cf0feaad5 tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] Acquiring lock "bd08f74a930a151a3dc56141e9442c690ebe8595" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:30:23 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-a3ff7621-15f0-402e-90a7-7e3cf0feaad5 tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] Lock "bd08f74a930a151a3dc56141e9442c690ebe8595" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:30:23 user nova-compute[75122]: DEBUG nova.policy [None req-a3ff7621-15f0-402e-90a7-7e3cf0feaad5 tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '28f162a709924363b99b617bb7f3f190', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81b94e91587545a59312e374914b4526', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75122) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 09:30:24 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-a3ff7621-15f0-402e-90a7-7e3cf0feaad5 tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd08f74a930a151a3dc56141e9442c690ebe8595.part --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:30:24 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-a3ff7621-15f0-402e-90a7-7e3cf0feaad5 tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd08f74a930a151a3dc56141e9442c690ebe8595.part --force-share --output=json" returned: 0 in 0.201s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:30:24 user nova-compute[75122]: DEBUG nova.virt.images [None req-a3ff7621-15f0-402e-90a7-7e3cf0feaad5 tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] 75853f1a-dd9a-4068-800e-7e935c28bad0 was qcow2, converting to raw {{(pid=75122) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 15 09:30:24 user nova-compute[75122]: DEBUG nova.privsep.utils [None req-a3ff7621-15f0-402e-90a7-7e3cf0feaad5 tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75122) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 09:30:24 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-a3ff7621-15f0-402e-90a7-7e3cf0feaad5 tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/bd08f74a930a151a3dc56141e9442c690ebe8595.part /opt/stack/data/nova/instances/_base/bd08f74a930a151a3dc56141e9442c690ebe8595.converted {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:30:24 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:30:24 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-a3ff7621-15f0-402e-90a7-7e3cf0feaad5 tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/bd08f74a930a151a3dc56141e9442c690ebe8595.part /opt/stack/data/nova/instances/_base/bd08f74a930a151a3dc56141e9442c690ebe8595.converted" returned: 0 in 0.255s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:30:24 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-a3ff7621-15f0-402e-90a7-7e3cf0feaad5 tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd08f74a930a151a3dc56141e9442c690ebe8595.converted --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:30:25 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-a3ff7621-15f0-402e-90a7-7e3cf0feaad5 tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd08f74a930a151a3dc56141e9442c690ebe8595.converted --force-share --output=json" returned: 0 in 0.217s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:30:25 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-a3ff7621-15f0-402e-90a7-7e3cf0feaad5 tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] Lock "bd08f74a930a151a3dc56141e9442c690ebe8595" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.249s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:30:25 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-a3ff7621-15f0-402e-90a7-7e3cf0feaad5 tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd08f74a930a151a3dc56141e9442c690ebe8595 --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:30:25 user nova-compute[75122]: DEBUG nova.compute.manager [None req-7d8ec1fe-2300-4585-85c6-883eba42e35b tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] [instance: 131142fd-e8ec-42d1-a518-aa21c7bb7cb1] Instance event wait completed in 0 seconds for  {{(pid=75122) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 09:30:25 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-7d8ec1fe-2300-4585-85c6-883eba42e35b tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] [instance: 131142fd-e8ec-42d1-a518-aa21c7bb7cb1] Guest created on hypervisor {{(pid=75122) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 09:30:25 user nova-compute[75122]: DEBUG nova.compute.manager [None req-7f3b21af-05a6-4b9c-b229-3d5c62bbc307 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] [instance: 4b582e5d-eef1-41f6-84b5-102efe3bf3f8] Instance event wait completed in 0 seconds for  {{(pid=75122) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 09:30:25 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-7f3b21af-05a6-4b9c-b229-3d5c62bbc307 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] [instance: 4b582e5d-eef1-41f6-84b5-102efe3bf3f8] Guest created on hypervisor {{(pid=75122) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 09:30:25 user nova-compute[75122]: INFO nova.virt.libvirt.driver [-] [instance: 131142fd-e8ec-42d1-a518-aa21c7bb7cb1] Instance spawned successfully.
Nov 15 09:30:25 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-7d8ec1fe-2300-4585-85c6-883eba42e35b tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] [instance: 131142fd-e8ec-42d1-a518-aa21c7bb7cb1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 09:30:25 user nova-compute[75122]: INFO nova.virt.libvirt.driver [-] [instance: 4b582e5d-eef1-41f6-84b5-102efe3bf3f8] Instance spawned successfully.
Nov 15 09:30:25 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-7f3b21af-05a6-4b9c-b229-3d5c62bbc307 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] [instance: 4b582e5d-eef1-41f6-84b5-102efe3bf3f8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 09:30:25 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-7d8ec1fe-2300-4585-85c6-883eba42e35b tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] [instance: 131142fd-e8ec-42d1-a518-aa21c7bb7cb1] Found default for hw_cdrom_bus of ide {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:30:25 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-7d8ec1fe-2300-4585-85c6-883eba42e35b tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] [instance: 131142fd-e8ec-42d1-a518-aa21c7bb7cb1] Found default for hw_disk_bus of virtio {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:30:25 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-7d8ec1fe-2300-4585-85c6-883eba42e35b tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] [instance: 131142fd-e8ec-42d1-a518-aa21c7bb7cb1] Found default for hw_input_bus of None {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:30:25 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-7d8ec1fe-2300-4585-85c6-883eba42e35b tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] [instance: 131142fd-e8ec-42d1-a518-aa21c7bb7cb1] Found default for hw_pointer_model of None {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:30:25 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-7d8ec1fe-2300-4585-85c6-883eba42e35b tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] [instance: 131142fd-e8ec-42d1-a518-aa21c7bb7cb1] Found default for hw_video_model of virtio {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:30:25 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-7d8ec1fe-2300-4585-85c6-883eba42e35b tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] [instance: 131142fd-e8ec-42d1-a518-aa21c7bb7cb1] Found default for hw_vif_model of virtio {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:30:25 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-7f3b21af-05a6-4b9c-b229-3d5c62bbc307 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] [instance: 4b582e5d-eef1-41f6-84b5-102efe3bf3f8] Found default for hw_cdrom_bus of ide {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:30:25 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-7f3b21af-05a6-4b9c-b229-3d5c62bbc307 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] [instance: 4b582e5d-eef1-41f6-84b5-102efe3bf3f8] Found default for hw_disk_bus of virtio {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:30:25 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-7f3b21af-05a6-4b9c-b229-3d5c62bbc307 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] [instance: 4b582e5d-eef1-41f6-84b5-102efe3bf3f8] Found default for hw_input_bus of None {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:30:25 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-7f3b21af-05a6-4b9c-b229-3d5c62bbc307 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] [instance: 4b582e5d-eef1-41f6-84b5-102efe3bf3f8] Found default for hw_pointer_model of None {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:30:25 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-7f3b21af-05a6-4b9c-b229-3d5c62bbc307 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] [instance: 4b582e5d-eef1-41f6-84b5-102efe3bf3f8] Found default for hw_video_model of virtio {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:30:25 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-7f3b21af-05a6-4b9c-b229-3d5c62bbc307 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] [instance: 4b582e5d-eef1-41f6-84b5-102efe3bf3f8] Found default for hw_vif_model of virtio {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:30:25 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-a3ff7621-15f0-402e-90a7-7e3cf0feaad5 tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd08f74a930a151a3dc56141e9442c690ebe8595 --force-share --output=json" returned: 0 in 0.261s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:30:25 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-a3ff7621-15f0-402e-90a7-7e3cf0feaad5 tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] Acquiring lock "bd08f74a930a151a3dc56141e9442c690ebe8595" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:30:25 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-a3ff7621-15f0-402e-90a7-7e3cf0feaad5 tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] Lock "bd08f74a930a151a3dc56141e9442c690ebe8595" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:30:25 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-a3ff7621-15f0-402e-90a7-7e3cf0feaad5 tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd08f74a930a151a3dc56141e9442c690ebe8595 --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:30:25 user nova-compute[75122]: INFO nova.compute.manager [None req-7d8ec1fe-2300-4585-85c6-883eba42e35b tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] [instance: 131142fd-e8ec-42d1-a518-aa21c7bb7cb1] Took 9.60 seconds to spawn the instance on the hypervisor.
Nov 15 09:30:25 user nova-compute[75122]: DEBUG nova.compute.manager [None req-7d8ec1fe-2300-4585-85c6-883eba42e35b tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] [instance: 131142fd-e8ec-42d1-a518-aa21c7bb7cb1] Checking state {{(pid=75122) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 09:30:25 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0dd63a3d-853a-4790-8ee1-7bbf2f8d29cb tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] [instance: ee961d5a-e0d1-4931-9293-eefbe638097a] Instance event wait completed in 0 seconds for  {{(pid=75122) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 09:30:25 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-0dd63a3d-853a-4790-8ee1-7bbf2f8d29cb tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] [instance: ee961d5a-e0d1-4931-9293-eefbe638097a] Guest created on hypervisor {{(pid=75122) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 09:30:25 user nova-compute[75122]: INFO nova.compute.manager [None req-7f3b21af-05a6-4b9c-b229-3d5c62bbc307 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] [instance: 4b582e5d-eef1-41f6-84b5-102efe3bf3f8] Took 16.08 seconds to spawn the instance on the hypervisor.
Nov 15 09:30:25 user nova-compute[75122]: DEBUG nova.compute.manager [None req-7f3b21af-05a6-4b9c-b229-3d5c62bbc307 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] [instance: 4b582e5d-eef1-41f6-84b5-102efe3bf3f8] Checking state {{(pid=75122) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 09:30:25 user nova-compute[75122]: INFO nova.virt.libvirt.driver [-] [instance: ee961d5a-e0d1-4931-9293-eefbe638097a] Instance spawned successfully.
Nov 15 09:30:25 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-0dd63a3d-853a-4790-8ee1-7bbf2f8d29cb tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] [instance: ee961d5a-e0d1-4931-9293-eefbe638097a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 09:30:25 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-a3ff7621-15f0-402e-90a7-7e3cf0feaad5 tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd08f74a930a151a3dc56141e9442c690ebe8595 --force-share --output=json" returned: 0 in 0.388s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:30:25 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-a3ff7621-15f0-402e-90a7-7e3cf0feaad5 tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bd08f74a930a151a3dc56141e9442c690ebe8595,backing_fmt=raw /opt/stack/data/nova/instances/bcb58c79-f6b3-44d9-a80f-1a4cf580379f/disk 1073741824 {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:30:25 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-0dd63a3d-853a-4790-8ee1-7bbf2f8d29cb tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] [instance: ee961d5a-e0d1-4931-9293-eefbe638097a] Found default for hw_cdrom_bus of ide {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:30:25 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-0dd63a3d-853a-4790-8ee1-7bbf2f8d29cb tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] [instance: ee961d5a-e0d1-4931-9293-eefbe638097a] Found default for hw_disk_bus of virtio {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:30:25 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-0dd63a3d-853a-4790-8ee1-7bbf2f8d29cb tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] [instance: ee961d5a-e0d1-4931-9293-eefbe638097a] Found default for hw_input_bus of None {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:30:25 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-0dd63a3d-853a-4790-8ee1-7bbf2f8d29cb tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] [instance: ee961d5a-e0d1-4931-9293-eefbe638097a] Found default for hw_pointer_model of None {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:30:25 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-0dd63a3d-853a-4790-8ee1-7bbf2f8d29cb tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] [instance: ee961d5a-e0d1-4931-9293-eefbe638097a] Found default for hw_video_model of virtio {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:30:25 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-0dd63a3d-853a-4790-8ee1-7bbf2f8d29cb tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] [instance: ee961d5a-e0d1-4931-9293-eefbe638097a] Found default for hw_vif_model of virtio {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:30:25 user nova-compute[75122]: INFO nova.compute.manager [None req-7d8ec1fe-2300-4585-85c6-883eba42e35b tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] [instance: 131142fd-e8ec-42d1-a518-aa21c7bb7cb1] Took 11.38 seconds to build instance.
Nov 15 09:30:25 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-a3ff7621-15f0-402e-90a7-7e3cf0feaad5 tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bd08f74a930a151a3dc56141e9442c690ebe8595,backing_fmt=raw /opt/stack/data/nova/instances/bcb58c79-f6b3-44d9-a80f-1a4cf580379f/disk 1073741824" returned: 0 in 0.197s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:30:25 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-a3ff7621-15f0-402e-90a7-7e3cf0feaad5 tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] Lock "bd08f74a930a151a3dc56141e9442c690ebe8595" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.625s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:30:25 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-a3ff7621-15f0-402e-90a7-7e3cf0feaad5 tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd08f74a930a151a3dc56141e9442c690ebe8595 --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:30:26 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-7d8ec1fe-2300-4585-85c6-883eba42e35b tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Lock "131142fd-e8ec-42d1-a518-aa21c7bb7cb1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.622s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:30:26 user nova-compute[75122]: INFO nova.compute.manager [None req-7f3b21af-05a6-4b9c-b229-3d5c62bbc307 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] [instance: 4b582e5d-eef1-41f6-84b5-102efe3bf3f8] Took 17.42 seconds to build instance.
Nov 15 09:30:26 user nova-compute[75122]: DEBUG nova.compute.manager [req-c3fe3e7d-0668-4769-9bed-a7db28e8ef0d req-76883815-1e04-473c-aeda-8b97b6458a8e service nova] [instance: ee961d5a-e0d1-4931-9293-eefbe638097a] Received event network-vif-plugged-ae8a9c5e-17d1-4aa9-b3fa-b829d1dc6fd2 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:30:26 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-c3fe3e7d-0668-4769-9bed-a7db28e8ef0d req-76883815-1e04-473c-aeda-8b97b6458a8e service nova] Acquiring lock "ee961d5a-e0d1-4931-9293-eefbe638097a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:30:26 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-c3fe3e7d-0668-4769-9bed-a7db28e8ef0d req-76883815-1e04-473c-aeda-8b97b6458a8e service nova] Lock "ee961d5a-e0d1-4931-9293-eefbe638097a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:30:26 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-c3fe3e7d-0668-4769-9bed-a7db28e8ef0d req-76883815-1e04-473c-aeda-8b97b6458a8e service nova] Lock "ee961d5a-e0d1-4931-9293-eefbe638097a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:30:26 user nova-compute[75122]: DEBUG nova.compute.manager [req-c3fe3e7d-0668-4769-9bed-a7db28e8ef0d req-76883815-1e04-473c-aeda-8b97b6458a8e service nova] [instance: ee961d5a-e0d1-4931-9293-eefbe638097a] No waiting events found dispatching network-vif-plugged-ae8a9c5e-17d1-4aa9-b3fa-b829d1dc6fd2 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:30:26 user nova-compute[75122]: WARNING nova.compute.manager [req-c3fe3e7d-0668-4769-9bed-a7db28e8ef0d req-76883815-1e04-473c-aeda-8b97b6458a8e service nova] [instance: ee961d5a-e0d1-4931-9293-eefbe638097a] Received unexpected event network-vif-plugged-ae8a9c5e-17d1-4aa9-b3fa-b829d1dc6fd2 for instance with vm_state building and task_state spawning.
Nov 15 09:30:26 user nova-compute[75122]: INFO nova.compute.manager [None req-0dd63a3d-853a-4790-8ee1-7bbf2f8d29cb tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] [instance: ee961d5a-e0d1-4931-9293-eefbe638097a] Took 14.18 seconds to spawn the instance on the hypervisor.
Nov 15 09:30:26 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0dd63a3d-853a-4790-8ee1-7bbf2f8d29cb tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] [instance: ee961d5a-e0d1-4931-9293-eefbe638097a] Checking state {{(pid=75122) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 09:30:26 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-7f3b21af-05a6-4b9c-b229-3d5c62bbc307 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] Lock "4b582e5d-eef1-41f6-84b5-102efe3bf3f8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.828s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:30:26 user nova-compute[75122]: INFO nova.compute.manager [None req-0dd63a3d-853a-4790-8ee1-7bbf2f8d29cb tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] [instance: ee961d5a-e0d1-4931-9293-eefbe638097a] Took 14.98 seconds to build instance.
Nov 15 09:30:26 user nova-compute[75122]: DEBUG nova.network.neutron [None req-a3ff7621-15f0-402e-90a7-7e3cf0feaad5 tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] [instance: bcb58c79-f6b3-44d9-a80f-1a4cf580379f] Successfully created port: 364a329a-8a90-43f6-9927-0c07dc1d6cbe {{(pid=75122) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 09:30:26 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-494d6f86-6bef-4228-a2b1-ce7dff7ab430 tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] Acquiring lock "e0f32160-7130-4b9c-aa9c-84123f3a6b32" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:30:26 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-494d6f86-6bef-4228-a2b1-ce7dff7ab430 tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] Lock "e0f32160-7130-4b9c-aa9c-84123f3a6b32" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:30:26 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0dd63a3d-853a-4790-8ee1-7bbf2f8d29cb tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Lock "ee961d5a-e0d1-4931-9293-eefbe638097a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.164s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:30:26 user nova-compute[75122]: DEBUG nova.compute.manager [None req-494d6f86-6bef-4228-a2b1-ce7dff7ab430 tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] [instance: e0f32160-7130-4b9c-aa9c-84123f3a6b32] Starting instance... {{(pid=75122) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 09:30:26 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-a3ff7621-15f0-402e-90a7-7e3cf0feaad5 tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bd08f74a930a151a3dc56141e9442c690ebe8595 --force-share --output=json" returned: 0 in 0.410s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:30:26 user nova-compute[75122]: DEBUG nova.virt.disk.api [None req-a3ff7621-15f0-402e-90a7-7e3cf0feaad5 tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bcb58c79-f6b3-44d9-a80f-1a4cf580379f/disk. size=1073741824 {{(pid=75122) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 09:30:26 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-a3ff7621-15f0-402e-90a7-7e3cf0feaad5 tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcb58c79-f6b3-44d9-a80f-1a4cf580379f/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:30:26 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-494d6f86-6bef-4228-a2b1-ce7dff7ab430 tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:30:26 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-494d6f86-6bef-4228-a2b1-ce7dff7ab430 tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:30:26 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-494d6f86-6bef-4228-a2b1-ce7dff7ab430 tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75122) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 09:30:26 user nova-compute[75122]: INFO nova.compute.claims [None req-494d6f86-6bef-4228-a2b1-ce7dff7ab430 tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] [instance: e0f32160-7130-4b9c-aa9c-84123f3a6b32] Claim successful on node user
Nov 15 09:30:26 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-a3ff7621-15f0-402e-90a7-7e3cf0feaad5 tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcb58c79-f6b3-44d9-a80f-1a4cf580379f/disk --force-share --output=json" returned: 0 in 0.257s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:30:26 user nova-compute[75122]: DEBUG nova.virt.disk.api [None req-a3ff7621-15f0-402e-90a7-7e3cf0feaad5 tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] Cannot resize image /opt/stack/data/nova/instances/bcb58c79-f6b3-44d9-a80f-1a4cf580379f/disk to a smaller size. {{(pid=75122) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 09:30:26 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-a3ff7621-15f0-402e-90a7-7e3cf0feaad5 tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] [instance: bcb58c79-f6b3-44d9-a80f-1a4cf580379f] Created local disks {{(pid=75122) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 09:30:26 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-a3ff7621-15f0-402e-90a7-7e3cf0feaad5 tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] [instance: bcb58c79-f6b3-44d9-a80f-1a4cf580379f] Ensure instance console log exists: /opt/stack/data/nova/instances/bcb58c79-f6b3-44d9-a80f-1a4cf580379f/console.log {{(pid=75122) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 09:30:26 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-a3ff7621-15f0-402e-90a7-7e3cf0feaad5 tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:30:26 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-a3ff7621-15f0-402e-90a7-7e3cf0feaad5 tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:30:26 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-a3ff7621-15f0-402e-90a7-7e3cf0feaad5 tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:30:27 user nova-compute[75122]: DEBUG nova.compute.manager [req-b2bdfd9d-33a6-4b19-9f9e-253a11c34a78 req-224b505c-b71e-457a-989c-f50ad30473bf service nova] [instance: 4b582e5d-eef1-41f6-84b5-102efe3bf3f8] Received event network-vif-plugged-43e5af96-fffc-4d74-bbed-5a78ce800158 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:30:27 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-b2bdfd9d-33a6-4b19-9f9e-253a11c34a78 req-224b505c-b71e-457a-989c-f50ad30473bf service nova] Acquiring lock "4b582e5d-eef1-41f6-84b5-102efe3bf3f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:30:27 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-b2bdfd9d-33a6-4b19-9f9e-253a11c34a78 req-224b505c-b71e-457a-989c-f50ad30473bf service nova] Lock "4b582e5d-eef1-41f6-84b5-102efe3bf3f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:30:27 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-b2bdfd9d-33a6-4b19-9f9e-253a11c34a78 req-224b505c-b71e-457a-989c-f50ad30473bf service nova] Lock "4b582e5d-eef1-41f6-84b5-102efe3bf3f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:30:27 user nova-compute[75122]: DEBUG nova.compute.manager [req-b2bdfd9d-33a6-4b19-9f9e-253a11c34a78 req-224b505c-b71e-457a-989c-f50ad30473bf service nova] [instance: 4b582e5d-eef1-41f6-84b5-102efe3bf3f8] No waiting events found dispatching network-vif-plugged-43e5af96-fffc-4d74-bbed-5a78ce800158 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:30:27 user nova-compute[75122]: WARNING nova.compute.manager [req-b2bdfd9d-33a6-4b19-9f9e-253a11c34a78 req-224b505c-b71e-457a-989c-f50ad30473bf service nova] [instance: 4b582e5d-eef1-41f6-84b5-102efe3bf3f8] Received unexpected event network-vif-plugged-43e5af96-fffc-4d74-bbed-5a78ce800158 for instance with vm_state active and task_state None.
Nov 15 09:30:27 user nova-compute[75122]: DEBUG nova.compute.provider_tree [None req-494d6f86-6bef-4228-a2b1-ce7dff7ab430 tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] Inventory has not changed in ProviderTree for provider: 69a3da65-47be-44c6-b67c-c692b58284ef {{(pid=75122) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 09:30:27 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-494d6f86-6bef-4228-a2b1-ce7dff7ab430 tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] Inventory has not changed for provider 69a3da65-47be-44c6-b67c-c692b58284ef based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 09:30:27 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-494d6f86-6bef-4228-a2b1-ce7dff7ab430 tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.940s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:30:27 user nova-compute[75122]: DEBUG nova.compute.manager [None req-494d6f86-6bef-4228-a2b1-ce7dff7ab430 tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] [instance: e0f32160-7130-4b9c-aa9c-84123f3a6b32] Start building networks asynchronously for instance. {{(pid=75122) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 09:30:27 user nova-compute[75122]: DEBUG nova.compute.manager [None req-494d6f86-6bef-4228-a2b1-ce7dff7ab430 tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] [instance: e0f32160-7130-4b9c-aa9c-84123f3a6b32] Allocating IP information in the background. {{(pid=75122) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 09:30:27 user nova-compute[75122]: DEBUG nova.network.neutron [None req-494d6f86-6bef-4228-a2b1-ce7dff7ab430 tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] [instance: e0f32160-7130-4b9c-aa9c-84123f3a6b32] allocate_for_instance() {{(pid=75122) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 09:30:27 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-494d6f86-6bef-4228-a2b1-ce7dff7ab430 tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] [instance: e0f32160-7130-4b9c-aa9c-84123f3a6b32] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 09:30:27 user nova-compute[75122]: DEBUG nova.compute.manager [None req-494d6f86-6bef-4228-a2b1-ce7dff7ab430 tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] [instance: e0f32160-7130-4b9c-aa9c-84123f3a6b32] Start building block device mappings for instance. {{(pid=75122) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 09:30:27 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:30:28 user nova-compute[75122]: DEBUG nova.policy [None req-494d6f86-6bef-4228-a2b1-ce7dff7ab430 tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd2529e19d29e4120b6e8ae75e16bb5b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6082a9c95d70462586e1f1195b43a383', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75122) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 09:30:28 user nova-compute[75122]: DEBUG nova.compute.manager [None req-494d6f86-6bef-4228-a2b1-ce7dff7ab430 tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] [instance: e0f32160-7130-4b9c-aa9c-84123f3a6b32] Start spawning the instance on the hypervisor. {{(pid=75122) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 09:30:28 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-494d6f86-6bef-4228-a2b1-ce7dff7ab430 tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] [instance: e0f32160-7130-4b9c-aa9c-84123f3a6b32] Creating instance directory {{(pid=75122) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 09:30:28 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-494d6f86-6bef-4228-a2b1-ce7dff7ab430 tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] [instance: e0f32160-7130-4b9c-aa9c-84123f3a6b32] Creating image(s)
Nov 15 09:30:28 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-494d6f86-6bef-4228-a2b1-ce7dff7ab430 tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] Acquiring lock "/opt/stack/data/nova/instances/e0f32160-7130-4b9c-aa9c-84123f3a6b32/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:30:28 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-494d6f86-6bef-4228-a2b1-ce7dff7ab430 tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] Lock "/opt/stack/data/nova/instances/e0f32160-7130-4b9c-aa9c-84123f3a6b32/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:30:28 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-494d6f86-6bef-4228-a2b1-ce7dff7ab430 tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] Lock "/opt/stack/data/nova/instances/e0f32160-7130-4b9c-aa9c-84123f3a6b32/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:30:28 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-494d6f86-6bef-4228-a2b1-ce7dff7ab430 tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:30:28 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-494d6f86-6bef-4228-a2b1-ce7dff7ab430 tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json" returned: 0 in 0.364s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:30:28 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-494d6f86-6bef-4228-a2b1-ce7dff7ab430 tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] Acquiring lock "95d6e29f74d5408f818e32f3bc29bc8270a4c665" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:30:28 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-494d6f86-6bef-4228-a2b1-ce7dff7ab430 tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] Lock "95d6e29f74d5408f818e32f3bc29bc8270a4c665" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:30:28 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-494d6f86-6bef-4228-a2b1-ce7dff7ab430 tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:30:28 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:30:28 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-494d6f86-6bef-4228-a2b1-ce7dff7ab430 tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json" returned: 0 in 0.289s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:30:28 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-494d6f86-6bef-4228-a2b1-ce7dff7ab430 tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665,backing_fmt=raw /opt/stack/data/nova/instances/e0f32160-7130-4b9c-aa9c-84123f3a6b32/disk 1073741824 {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:30:28 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-494d6f86-6bef-4228-a2b1-ce7dff7ab430 tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665,backing_fmt=raw /opt/stack/data/nova/instances/e0f32160-7130-4b9c-aa9c-84123f3a6b32/disk 1073741824" returned: 0 in 0.084s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:30:28 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-494d6f86-6bef-4228-a2b1-ce7dff7ab430 tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] Lock "95d6e29f74d5408f818e32f3bc29bc8270a4c665" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.389s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:30:28 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-494d6f86-6bef-4228-a2b1-ce7dff7ab430 tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:30:29 user nova-compute[75122]: DEBUG nova.network.neutron [None req-a3ff7621-15f0-402e-90a7-7e3cf0feaad5 tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] [instance: bcb58c79-f6b3-44d9-a80f-1a4cf580379f] Successfully updated port: 364a329a-8a90-43f6-9927-0c07dc1d6cbe {{(pid=75122) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 09:30:29 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-494d6f86-6bef-4228-a2b1-ce7dff7ab430 tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json" returned: 0 in 0.357s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:30:29 user nova-compute[75122]: DEBUG nova.virt.disk.api [None req-494d6f86-6bef-4228-a2b1-ce7dff7ab430 tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e0f32160-7130-4b9c-aa9c-84123f3a6b32/disk. size=1073741824 {{(pid=75122) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 09:30:29 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-494d6f86-6bef-4228-a2b1-ce7dff7ab430 tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0f32160-7130-4b9c-aa9c-84123f3a6b32/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:30:29 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-a3ff7621-15f0-402e-90a7-7e3cf0feaad5 tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] Acquiring lock "refresh_cache-bcb58c79-f6b3-44d9-a80f-1a4cf580379f" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 09:30:29 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-a3ff7621-15f0-402e-90a7-7e3cf0feaad5 tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] Acquired lock "refresh_cache-bcb58c79-f6b3-44d9-a80f-1a4cf580379f" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 09:30:29 user nova-compute[75122]: DEBUG nova.network.neutron [None req-a3ff7621-15f0-402e-90a7-7e3cf0feaad5 tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] [instance: bcb58c79-f6b3-44d9-a80f-1a4cf580379f] Building network info cache for instance {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 09:30:29 user nova-compute[75122]: DEBUG nova.compute.manager [req-8ac5fb1f-6d7a-45cc-b4df-1753af0af9b0 req-531d2249-cd3a-4522-b588-d2d3142fc9ea service nova] [instance: bcb58c79-f6b3-44d9-a80f-1a4cf580379f] Received event network-changed-364a329a-8a90-43f6-9927-0c07dc1d6cbe {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:30:29 user nova-compute[75122]: DEBUG nova.compute.manager [req-8ac5fb1f-6d7a-45cc-b4df-1753af0af9b0 req-531d2249-cd3a-4522-b588-d2d3142fc9ea service nova] [instance: bcb58c79-f6b3-44d9-a80f-1a4cf580379f] Refreshing instance network info cache due to event network-changed-364a329a-8a90-43f6-9927-0c07dc1d6cbe. {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 09:30:29 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-8ac5fb1f-6d7a-45cc-b4df-1753af0af9b0 req-531d2249-cd3a-4522-b588-d2d3142fc9ea service nova] Acquiring lock "refresh_cache-bcb58c79-f6b3-44d9-a80f-1a4cf580379f" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 09:30:29 user nova-compute[75122]: DEBUG nova.compute.manager [req-0a08c557-93d8-43d4-a935-09534ddedddb req-6a8d4415-dbfe-4f31-a1d4-1ef5b7087b7e service nova] [instance: 4b582e5d-eef1-41f6-84b5-102efe3bf3f8] Received event network-vif-plugged-43e5af96-fffc-4d74-bbed-5a78ce800158 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:30:29 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-0a08c557-93d8-43d4-a935-09534ddedddb req-6a8d4415-dbfe-4f31-a1d4-1ef5b7087b7e service nova] Acquiring lock "4b582e5d-eef1-41f6-84b5-102efe3bf3f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:30:29 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-0a08c557-93d8-43d4-a935-09534ddedddb req-6a8d4415-dbfe-4f31-a1d4-1ef5b7087b7e service nova] Lock "4b582e5d-eef1-41f6-84b5-102efe3bf3f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.005s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:30:29 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-0a08c557-93d8-43d4-a935-09534ddedddb req-6a8d4415-dbfe-4f31-a1d4-1ef5b7087b7e service nova] Lock "4b582e5d-eef1-41f6-84b5-102efe3bf3f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:30:29 user nova-compute[75122]: DEBUG nova.compute.manager [req-0a08c557-93d8-43d4-a935-09534ddedddb req-6a8d4415-dbfe-4f31-a1d4-1ef5b7087b7e service nova] [instance: 4b582e5d-eef1-41f6-84b5-102efe3bf3f8] No waiting events found dispatching network-vif-plugged-43e5af96-fffc-4d74-bbed-5a78ce800158 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:30:29 user nova-compute[75122]: WARNING nova.compute.manager [req-0a08c557-93d8-43d4-a935-09534ddedddb req-6a8d4415-dbfe-4f31-a1d4-1ef5b7087b7e service nova] [instance: 4b582e5d-eef1-41f6-84b5-102efe3bf3f8] Received unexpected event network-vif-plugged-43e5af96-fffc-4d74-bbed-5a78ce800158 for instance with vm_state active and task_state None.
Nov 15 09:30:29 user nova-compute[75122]: DEBUG nova.network.neutron [None req-a3ff7621-15f0-402e-90a7-7e3cf0feaad5 tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] [instance: bcb58c79-f6b3-44d9-a80f-1a4cf580379f] Instance cache missing network info. {{(pid=75122) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 09:30:29 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-494d6f86-6bef-4228-a2b1-ce7dff7ab430 tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0f32160-7130-4b9c-aa9c-84123f3a6b32/disk --force-share --output=json" returned: 0 in 0.386s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:30:29 user nova-compute[75122]: DEBUG nova.virt.disk.api [None req-494d6f86-6bef-4228-a2b1-ce7dff7ab430 tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] Cannot resize image /opt/stack/data/nova/instances/e0f32160-7130-4b9c-aa9c-84123f3a6b32/disk to a smaller size. {{(pid=75122) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 09:30:29 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-494d6f86-6bef-4228-a2b1-ce7dff7ab430 tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] [instance: e0f32160-7130-4b9c-aa9c-84123f3a6b32] Created local disks {{(pid=75122) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 09:30:29 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-494d6f86-6bef-4228-a2b1-ce7dff7ab430 tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] [instance: e0f32160-7130-4b9c-aa9c-84123f3a6b32] Ensure instance console log exists: /opt/stack/data/nova/instances/e0f32160-7130-4b9c-aa9c-84123f3a6b32/console.log {{(pid=75122) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 09:30:29 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-494d6f86-6bef-4228-a2b1-ce7dff7ab430 tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:30:29 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-494d6f86-6bef-4228-a2b1-ce7dff7ab430 tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:30:29 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-494d6f86-6bef-4228-a2b1-ce7dff7ab430 tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.002s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:30:29 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:30:29 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:30:30 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:30:30 user nova-compute[75122]: DEBUG nova.network.neutron [None req-a3ff7621-15f0-402e-90a7-7e3cf0feaad5 tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] [instance: bcb58c79-f6b3-44d9-a80f-1a4cf580379f] Updating instance_info_cache with network_info: [{"id": "364a329a-8a90-43f6-9927-0c07dc1d6cbe", "address": "fa:16:3e:aa:38:2f", "network": {"id": "d1bb497f-e1d4-4f70-9e5c-263b91c0b4ea", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-246917524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81b94e91587545a59312e374914b4526", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap364a329a-8a", "ovs_interfaceid": "364a329a-8a90-43f6-9927-0c07dc1d6cbe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:30:30 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:30:30 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-a3ff7621-15f0-402e-90a7-7e3cf0feaad5 tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] Releasing lock "refresh_cache-bcb58c79-f6b3-44d9-a80f-1a4cf580379f" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 09:30:30 user nova-compute[75122]: DEBUG nova.compute.manager [None req-a3ff7621-15f0-402e-90a7-7e3cf0feaad5 tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] [instance: bcb58c79-f6b3-44d9-a80f-1a4cf580379f] Instance network_info: |[{"id": "364a329a-8a90-43f6-9927-0c07dc1d6cbe", "address": "fa:16:3e:aa:38:2f", "network": {"id": "d1bb497f-e1d4-4f70-9e5c-263b91c0b4ea", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-246917524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81b94e91587545a59312e374914b4526", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap364a329a-8a", "ovs_interfaceid": "364a329a-8a90-43f6-9927-0c07dc1d6cbe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75122) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 09:30:30 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-8ac5fb1f-6d7a-45cc-b4df-1753af0af9b0 req-531d2249-cd3a-4522-b588-d2d3142fc9ea service nova] Acquired lock "refresh_cache-bcb58c79-f6b3-44d9-a80f-1a4cf580379f" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 09:30:30 user nova-compute[75122]: DEBUG nova.network.neutron [req-8ac5fb1f-6d7a-45cc-b4df-1753af0af9b0 req-531d2249-cd3a-4522-b588-d2d3142fc9ea service nova] [instance: bcb58c79-f6b3-44d9-a80f-1a4cf580379f] Refreshing network info cache for port 364a329a-8a90-43f6-9927-0c07dc1d6cbe {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 09:30:30 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-a3ff7621-15f0-402e-90a7-7e3cf0feaad5 tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] [instance: bcb58c79-f6b3-44d9-a80f-1a4cf580379f] Start _get_guest_xml network_info=[{"id": "364a329a-8a90-43f6-9927-0c07dc1d6cbe", "address": "fa:16:3e:aa:38:2f", "network": {"id": "d1bb497f-e1d4-4f70-9e5c-263b91c0b4ea", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-246917524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81b94e91587545a59312e374914b4526", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap364a329a-8a", "ovs_interfaceid": "364a329a-8a90-43f6-9927-0c07dc1d6cbe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T09:30:17Z,direct_url=<?>,disk_format='qcow2',id=75853f1a-dd9a-4068-800e-7e935c28bad0,min_disk=0,min_ram=0,name='',owner='00190351c8c54b54b1de16d3ad5a7f2a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T09:30:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'guest_format': None, 'boot_index': 0, 'disk_bus': 'scsi', 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'encrypted': False, 'device_name': '/dev/sda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '75853f1a-dd9a-4068-800e-7e935c28bad0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75122) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 09:30:30 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-a3ff7621-15f0-402e-90a7-7e3cf0feaad5 tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 09:30:30 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-a3ff7621-15f0-402e-90a7-7e3cf0feaad5 tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 09:30:30 user nova-compute[75122]: DEBUG nova.network.neutron [None req-494d6f86-6bef-4228-a2b1-ce7dff7ab430 tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] [instance: e0f32160-7130-4b9c-aa9c-84123f3a6b32] Successfully created port: 0d48c0d7-8a0f-4bfa-b8b7-290f122c3f4a {{(pid=75122) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 09:30:30 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-a3ff7621-15f0-402e-90a7-7e3cf0feaad5 tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75122) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 09:30:30 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-a3ff7621-15f0-402e-90a7-7e3cf0feaad5 tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] CPU controller missing on host. {{(pid=75122) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 09:30:30 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-a3ff7621-15f0-402e-90a7-7e3cf0feaad5 tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75122) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 09:30:30 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-a3ff7621-15f0-402e-90a7-7e3cf0feaad5 tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] CPU controller found on host. {{(pid=75122) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 09:30:30 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-a3ff7621-15f0-402e-90a7-7e3cf0feaad5 tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75122) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 09:30:30 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-a3ff7621-15f0-402e-90a7-7e3cf0feaad5 tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T09:26:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T09:30:17Z,direct_url=<?>,disk_format='qcow2',id=75853f1a-dd9a-4068-800e-7e935c28bad0,min_disk=0,min_ram=0,name='',owner='00190351c8c54b54b1de16d3ad5a7f2a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T09:30:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 09:30:30 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-a3ff7621-15f0-402e-90a7-7e3cf0feaad5 tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] Flavor limits 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 09:30:30 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-a3ff7621-15f0-402e-90a7-7e3cf0feaad5 tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] Image limits 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 09:30:30 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-a3ff7621-15f0-402e-90a7-7e3cf0feaad5 tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] Flavor pref 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 09:30:30 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-a3ff7621-15f0-402e-90a7-7e3cf0feaad5 tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] Image pref 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 09:30:30 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-a3ff7621-15f0-402e-90a7-7e3cf0feaad5 tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 09:30:30 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-a3ff7621-15f0-402e-90a7-7e3cf0feaad5 tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 09:30:30 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-a3ff7621-15f0-402e-90a7-7e3cf0feaad5 tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75122) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 09:30:30 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-a3ff7621-15f0-402e-90a7-7e3cf0feaad5 tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] Got 1 possible topologies {{(pid=75122) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 09:30:30 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-a3ff7621-15f0-402e-90a7-7e3cf0feaad5 tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 09:30:30 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-a3ff7621-15f0-402e-90a7-7e3cf0feaad5 tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 09:30:30 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-a3ff7621-15f0-402e-90a7-7e3cf0feaad5 tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T09:30:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1969522198',display_name='tempest-AttachSCSIVolumeTestJSON-server-1969522198',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1969522198',id=4,image_ref='75853f1a-dd9a-4068-800e-7e935c28bad0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBANV6BO+yY0KWtP3r8GkA1x27UssuspIxpxVP+u7hAmnzu4GcPNf01/BZMqfxn7bzNFUkcFkO/PDv6HZ31XNDrjTRwkRbJPk54jlt1gUGyPyhkvdOaN1qrYPtb+zv7YDbA==',key_name='tempest-keypair-1727153420',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='81b94e91587545a59312e374914b4526',ramdisk_id='',reservation_id='r-m2a6ud81',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='75853f1a-dd9a-4068-800e-7e935c28bad0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-348091286',owner_user_name='tempest-AttachSCSIVolumeTestJSON-348091286-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T09:30:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='28f162a709924363b99b617bb7f3f190',uuid=bcb58c79-f6b3-44d9-a80f-1a4cf580379f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "364a329a-8a90-43f6-9927-0c07dc1d6cbe", "address": "fa:16:3e:aa:38:2f", "network": {"id": "d1bb497f-e1d4-4f70-9e5c-263b91c0b4ea", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-246917524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81b94e91587545a59312e374914b4526", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap364a329a-8a", "ovs_interfaceid": "364a329a-8a90-43f6-9927-0c07dc1d6cbe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75122) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 09:30:30 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-a3ff7621-15f0-402e-90a7-7e3cf0feaad5 tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] Converting VIF {"id": "364a329a-8a90-43f6-9927-0c07dc1d6cbe", "address": "fa:16:3e:aa:38:2f", "network": {"id": "d1bb497f-e1d4-4f70-9e5c-263b91c0b4ea", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-246917524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81b94e91587545a59312e374914b4526", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap364a329a-8a", "ovs_interfaceid": "364a329a-8a90-43f6-9927-0c07dc1d6cbe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 09:30:30 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-a3ff7621-15f0-402e-90a7-7e3cf0feaad5 tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:aa:38:2f,bridge_name='br-int',has_traffic_filtering=True,id=364a329a-8a90-43f6-9927-0c07dc1d6cbe,network=Network(d1bb497f-e1d4-4f70-9e5c-263b91c0b4ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap364a329a-8a') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 09:30:30 user nova-compute[75122]: DEBUG nova.objects.instance [None req-a3ff7621-15f0-402e-90a7-7e3cf0feaad5 tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] Lazy-loading 'pci_devices' on Instance uuid bcb58c79-f6b3-44d9-a80f-1a4cf580379f {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:30:30 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-a3ff7621-15f0-402e-90a7-7e3cf0feaad5 tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] [instance: bcb58c79-f6b3-44d9-a80f-1a4cf580379f] End _get_guest_xml xml=<domain type="kvm">
Nov 15 09:30:30 user nova-compute[75122]:   <uuid>bcb58c79-f6b3-44d9-a80f-1a4cf580379f</uuid>
Nov 15 09:30:30 user nova-compute[75122]:   <name>instance-00000004</name>
Nov 15 09:30:30 user nova-compute[75122]:   <memory>524288</memory>
Nov 15 09:30:30 user nova-compute[75122]:   <vcpu>1</vcpu>
Nov 15 09:30:30 user nova-compute[75122]:   <metadata>
Nov 15 09:30:30 user nova-compute[75122]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 09:30:30 user nova-compute[75122]:       <nova:package version="0.0.0"/>
Nov 15 09:30:30 user nova-compute[75122]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-1969522198</nova:name>
Nov 15 09:30:30 user nova-compute[75122]:       <nova:creationTime>2023-11-15 09:30:30</nova:creationTime>
Nov 15 09:30:30 user nova-compute[75122]:       <nova:flavor name="m1.tiny">
Nov 15 09:30:30 user nova-compute[75122]:         <nova:memory>512</nova:memory>
Nov 15 09:30:30 user nova-compute[75122]:         <nova:disk>1</nova:disk>
Nov 15 09:30:30 user nova-compute[75122]:         <nova:swap>0</nova:swap>
Nov 15 09:30:30 user nova-compute[75122]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 09:30:30 user nova-compute[75122]:         <nova:vcpus>1</nova:vcpus>
Nov 15 09:30:30 user nova-compute[75122]:       </nova:flavor>
Nov 15 09:30:30 user nova-compute[75122]:       <nova:owner>
Nov 15 09:30:30 user nova-compute[75122]:         <nova:user uuid="28f162a709924363b99b617bb7f3f190">tempest-AttachSCSIVolumeTestJSON-348091286-project-member</nova:user>
Nov 15 09:30:30 user nova-compute[75122]:         <nova:project uuid="81b94e91587545a59312e374914b4526">tempest-AttachSCSIVolumeTestJSON-348091286</nova:project>
Nov 15 09:30:30 user nova-compute[75122]:       </nova:owner>
Nov 15 09:30:30 user nova-compute[75122]:       <nova:root type="image" uuid="75853f1a-dd9a-4068-800e-7e935c28bad0"/>
Nov 15 09:30:30 user nova-compute[75122]:       <nova:ports>
Nov 15 09:30:30 user nova-compute[75122]:         <nova:port uuid="364a329a-8a90-43f6-9927-0c07dc1d6cbe">
Nov 15 09:30:30 user nova-compute[75122]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 15 09:30:30 user nova-compute[75122]:         </nova:port>
Nov 15 09:30:30 user nova-compute[75122]:       </nova:ports>
Nov 15 09:30:30 user nova-compute[75122]:     </nova:instance>
Nov 15 09:30:30 user nova-compute[75122]:   </metadata>
Nov 15 09:30:30 user nova-compute[75122]:   <sysinfo type="smbios">
Nov 15 09:30:30 user nova-compute[75122]:     <system>
Nov 15 09:30:30 user nova-compute[75122]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 09:30:30 user nova-compute[75122]:       <entry name="product">OpenStack Nova</entry>
Nov 15 09:30:30 user nova-compute[75122]:       <entry name="version">0.0.0</entry>
Nov 15 09:30:30 user nova-compute[75122]:       <entry name="serial">bcb58c79-f6b3-44d9-a80f-1a4cf580379f</entry>
Nov 15 09:30:30 user nova-compute[75122]:       <entry name="uuid">bcb58c79-f6b3-44d9-a80f-1a4cf580379f</entry>
Nov 15 09:30:30 user nova-compute[75122]:       <entry name="family">Virtual Machine</entry>
Nov 15 09:30:30 user nova-compute[75122]:     </system>
Nov 15 09:30:30 user nova-compute[75122]:   </sysinfo>
Nov 15 09:30:30 user nova-compute[75122]:   <os>
Nov 15 09:30:30 user nova-compute[75122]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 09:30:30 user nova-compute[75122]:     <boot dev="hd"/>
Nov 15 09:30:30 user nova-compute[75122]:     <smbios mode="sysinfo"/>
Nov 15 09:30:30 user nova-compute[75122]:   </os>
Nov 15 09:30:30 user nova-compute[75122]:   <features>
Nov 15 09:30:30 user nova-compute[75122]:     <acpi/>
Nov 15 09:30:30 user nova-compute[75122]:     <apic/>
Nov 15 09:30:30 user nova-compute[75122]:     <vmcoreinfo/>
Nov 15 09:30:30 user nova-compute[75122]:   </features>
Nov 15 09:30:30 user nova-compute[75122]:   <clock offset="utc">
Nov 15 09:30:30 user nova-compute[75122]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 09:30:30 user nova-compute[75122]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 09:30:30 user nova-compute[75122]:     <timer name="hpet" present="no"/>
Nov 15 09:30:30 user nova-compute[75122]:   </clock>
Nov 15 09:30:30 user nova-compute[75122]:   <cpu mode="custom" match="exact">
Nov 15 09:30:30 user nova-compute[75122]:     <model>Nehalem</model>
Nov 15 09:30:30 user nova-compute[75122]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 09:30:30 user nova-compute[75122]:   </cpu>
Nov 15 09:30:30 user nova-compute[75122]:   <devices>
Nov 15 09:30:30 user nova-compute[75122]:     <disk type="file" device="disk">
Nov 15 09:30:30 user nova-compute[75122]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 09:30:30 user nova-compute[75122]:       <source file="/opt/stack/data/nova/instances/bcb58c79-f6b3-44d9-a80f-1a4cf580379f/disk"/>
Nov 15 09:30:30 user nova-compute[75122]:       <target dev="sda" bus="scsi"/>
Nov 15 09:30:30 user nova-compute[75122]:       <address type="drive" controller="0" unit="0"/>
Nov 15 09:30:30 user nova-compute[75122]:     </disk>
Nov 15 09:30:30 user nova-compute[75122]:     <disk type="file" device="cdrom">
Nov 15 09:30:30 user nova-compute[75122]:       <driver name="qemu" type="raw" cache="none"/>
Nov 15 09:30:30 user nova-compute[75122]:       <source file="/opt/stack/data/nova/instances/bcb58c79-f6b3-44d9-a80f-1a4cf580379f/disk.config"/>
Nov 15 09:30:30 user nova-compute[75122]:       <target dev="sdb" bus="scsi"/>
Nov 15 09:30:30 user nova-compute[75122]:       <address type="drive" controller="0" unit="1"/>
Nov 15 09:30:30 user nova-compute[75122]:     </disk>
Nov 15 09:30:30 user nova-compute[75122]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Nov 15 09:30:30 user nova-compute[75122]:     <interface type="ethernet">
Nov 15 09:30:30 user nova-compute[75122]:       <mac address="fa:16:3e:aa:38:2f"/>
Nov 15 09:30:30 user nova-compute[75122]:       <model type="virtio"/>
Nov 15 09:30:30 user nova-compute[75122]:       <mtu size="1442"/>
Nov 15 09:30:30 user nova-compute[75122]:       <target dev="tap364a329a-8a"/>
Nov 15 09:30:30 user nova-compute[75122]:     </interface>
Nov 15 09:30:30 user nova-compute[75122]:     <serial type="pty">
Nov 15 09:30:30 user nova-compute[75122]:       <log file="/opt/stack/data/nova/instances/bcb58c79-f6b3-44d9-a80f-1a4cf580379f/console.log" append="off"/>
Nov 15 09:30:30 user nova-compute[75122]:     </serial>
Nov 15 09:30:30 user nova-compute[75122]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 09:30:30 user nova-compute[75122]:     <video>
Nov 15 09:30:30 user nova-compute[75122]:       <model type="virtio"/>
Nov 15 09:30:30 user nova-compute[75122]:     </video>
Nov 15 09:30:30 user nova-compute[75122]:     <rng model="virtio">
Nov 15 09:30:30 user nova-compute[75122]:       <backend model="random">/dev/urandom</backend>
Nov 15 09:30:30 user nova-compute[75122]:     </rng>
Nov 15 09:30:30 user nova-compute[75122]:     <controller type="usb" index="0" model="none"/>
Nov 15 09:30:30 user nova-compute[75122]:     <memballoon model="virtio">
Nov 15 09:30:30 user nova-compute[75122]:       <stats period="10"/>
Nov 15 09:30:30 user nova-compute[75122]:     </memballoon>
Nov 15 09:30:30 user nova-compute[75122]:   </devices>
Nov 15 09:30:30 user nova-compute[75122]: </domain>
Nov 15 09:30:30 user nova-compute[75122]:  {{(pid=75122) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 09:30:30 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-a3ff7621-15f0-402e-90a7-7e3cf0feaad5 tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T09:30:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1969522198',display_name='tempest-AttachSCSIVolumeTestJSON-server-1969522198',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1969522198',id=4,image_ref='75853f1a-dd9a-4068-800e-7e935c28bad0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBANV6BO+yY0KWtP3r8GkA1x27UssuspIxpxVP+u7hAmnzu4GcPNf01/BZMqfxn7bzNFUkcFkO/PDv6HZ31XNDrjTRwkRbJPk54jlt1gUGyPyhkvdOaN1qrYPtb+zv7YDbA==',key_name='tempest-keypair-1727153420',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='81b94e91587545a59312e374914b4526',ramdisk_id='',reservation_id='r-m2a6ud81',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='75853f1a-dd9a-4068-800e-7e935c28bad0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-348091286',owner_user_name='tempest-AttachSCSIVolumeTestJSON-348091286-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T09:30:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='28f162a709924363b99b617bb7f3f190',uuid=bcb58c79-f6b3-44d9-a80f-1a4cf580379f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "364a329a-8a90-43f6-9927-0c07dc1d6cbe", "address": "fa:16:3e:aa:38:2f", "network": {"id": "d1bb497f-e1d4-4f70-9e5c-263b91c0b4ea", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-246917524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81b94e91587545a59312e374914b4526", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap364a329a-8a", "ovs_interfaceid": "364a329a-8a90-43f6-9927-0c07dc1d6cbe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 09:30:30 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-a3ff7621-15f0-402e-90a7-7e3cf0feaad5 tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] Converting VIF {"id": "364a329a-8a90-43f6-9927-0c07dc1d6cbe", "address": "fa:16:3e:aa:38:2f", "network": {"id": "d1bb497f-e1d4-4f70-9e5c-263b91c0b4ea", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-246917524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81b94e91587545a59312e374914b4526", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap364a329a-8a", "ovs_interfaceid": "364a329a-8a90-43f6-9927-0c07dc1d6cbe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 09:30:30 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-a3ff7621-15f0-402e-90a7-7e3cf0feaad5 tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:aa:38:2f,bridge_name='br-int',has_traffic_filtering=True,id=364a329a-8a90-43f6-9927-0c07dc1d6cbe,network=Network(d1bb497f-e1d4-4f70-9e5c-263b91c0b4ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap364a329a-8a') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 09:30:30 user nova-compute[75122]: DEBUG os_vif [None req-a3ff7621-15f0-402e-90a7-7e3cf0feaad5 tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:38:2f,bridge_name='br-int',has_traffic_filtering=True,id=364a329a-8a90-43f6-9927-0c07dc1d6cbe,network=Network(d1bb497f-e1d4-4f70-9e5c-263b91c0b4ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap364a329a-8a') {{(pid=75122) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 09:30:30 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:30:30 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:30:30 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 09:30:30 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:30:30 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2020cd36-ab9f-5d8d-8787-5cda870eacc7', '_type': 'linux-noop'}}, row=False) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:30:30 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:30:30 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:30:30 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:30:30 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap364a329a-8a, may_exist=True, interface_attrs={}) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:30:30 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap364a329a-8a, col_values=(('qos', UUID('9055668c-4041-46bb-b20b-b8b1050eea15')),), if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:30:30 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap364a329a-8a, col_values=(('external_ids', {'iface-id': '364a329a-8a90-43f6-9927-0c07dc1d6cbe', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:aa:38:2f', 'vm-uuid': 'bcb58c79-f6b3-44d9-a80f-1a4cf580379f'}),), if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:30:30 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:30:30 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:30:30 user nova-compute[75122]: INFO os_vif [None req-a3ff7621-15f0-402e-90a7-7e3cf0feaad5 tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:aa:38:2f,bridge_name='br-int',has_traffic_filtering=True,id=364a329a-8a90-43f6-9927-0c07dc1d6cbe,network=Network(d1bb497f-e1d4-4f70-9e5c-263b91c0b4ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap364a329a-8a')
Nov 15 09:30:30 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-a3ff7621-15f0-402e-90a7-7e3cf0feaad5 tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] No BDM found with device name sda, not building metadata. {{(pid=75122) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 09:30:30 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-a3ff7621-15f0-402e-90a7-7e3cf0feaad5 tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] No BDM found with device name sdb, not building metadata. {{(pid=75122) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 09:30:30 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-a3ff7621-15f0-402e-90a7-7e3cf0feaad5 tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] No VIF found with MAC fa:16:3e:aa:38:2f, not building metadata {{(pid=75122) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 09:30:30 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-a3ff7621-15f0-402e-90a7-7e3cf0feaad5 tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] [instance: bcb58c79-f6b3-44d9-a80f-1a4cf580379f] Using config drive
Nov 15 09:30:30 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:30:32 user nova-compute[75122]: DEBUG nova.network.neutron [req-8ac5fb1f-6d7a-45cc-b4df-1753af0af9b0 req-531d2249-cd3a-4522-b588-d2d3142fc9ea service nova] [instance: bcb58c79-f6b3-44d9-a80f-1a4cf580379f] Updated VIF entry in instance network info cache for port 364a329a-8a90-43f6-9927-0c07dc1d6cbe. {{(pid=75122) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 09:30:32 user nova-compute[75122]: DEBUG nova.network.neutron [req-8ac5fb1f-6d7a-45cc-b4df-1753af0af9b0 req-531d2249-cd3a-4522-b588-d2d3142fc9ea service nova] [instance: bcb58c79-f6b3-44d9-a80f-1a4cf580379f] Updating instance_info_cache with network_info: [{"id": "364a329a-8a90-43f6-9927-0c07dc1d6cbe", "address": "fa:16:3e:aa:38:2f", "network": {"id": "d1bb497f-e1d4-4f70-9e5c-263b91c0b4ea", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-246917524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81b94e91587545a59312e374914b4526", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap364a329a-8a", "ovs_interfaceid": "364a329a-8a90-43f6-9927-0c07dc1d6cbe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:30:32 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-8ac5fb1f-6d7a-45cc-b4df-1753af0af9b0 req-531d2249-cd3a-4522-b588-d2d3142fc9ea service nova] Releasing lock "refresh_cache-bcb58c79-f6b3-44d9-a80f-1a4cf580379f" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 09:30:32 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:30:32 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:30:32 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:30:32 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-a3ff7621-15f0-402e-90a7-7e3cf0feaad5 tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] [instance: bcb58c79-f6b3-44d9-a80f-1a4cf580379f] Creating config drive at /opt/stack/data/nova/instances/bcb58c79-f6b3-44d9-a80f-1a4cf580379f/disk.config
Nov 15 09:30:32 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-a3ff7621-15f0-402e-90a7-7e3cf0feaad5 tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/bcb58c79-f6b3-44d9-a80f-1a4cf580379f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpbd5vfxmv {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:30:32 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:30:32 user nova-compute[75122]: DEBUG nova.network.neutron [None req-494d6f86-6bef-4228-a2b1-ce7dff7ab430 tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] [instance: e0f32160-7130-4b9c-aa9c-84123f3a6b32] Successfully updated port: 0d48c0d7-8a0f-4bfa-b8b7-290f122c3f4a {{(pid=75122) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 09:30:32 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-a3ff7621-15f0-402e-90a7-7e3cf0feaad5 tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/bcb58c79-f6b3-44d9-a80f-1a4cf580379f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpbd5vfxmv" returned: 0 in 0.080s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:30:32 user nova-compute[75122]: DEBUG nova.compute.manager [req-885ea5c3-fe8d-4d5e-bade-e2d8a9044fda req-3e2a189b-8867-4d0f-bc92-39a66017a2ad service nova] [instance: e0f32160-7130-4b9c-aa9c-84123f3a6b32] Received event network-changed-0d48c0d7-8a0f-4bfa-b8b7-290f122c3f4a {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:30:32 user nova-compute[75122]: DEBUG nova.compute.manager [req-885ea5c3-fe8d-4d5e-bade-e2d8a9044fda req-3e2a189b-8867-4d0f-bc92-39a66017a2ad service nova] [instance: e0f32160-7130-4b9c-aa9c-84123f3a6b32] Refreshing instance network info cache due to event network-changed-0d48c0d7-8a0f-4bfa-b8b7-290f122c3f4a. {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 09:30:32 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-885ea5c3-fe8d-4d5e-bade-e2d8a9044fda req-3e2a189b-8867-4d0f-bc92-39a66017a2ad service nova] Acquiring lock "refresh_cache-e0f32160-7130-4b9c-aa9c-84123f3a6b32" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 09:30:32 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-885ea5c3-fe8d-4d5e-bade-e2d8a9044fda req-3e2a189b-8867-4d0f-bc92-39a66017a2ad service nova] Acquired lock "refresh_cache-e0f32160-7130-4b9c-aa9c-84123f3a6b32" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 09:30:32 user nova-compute[75122]: DEBUG nova.network.neutron [req-885ea5c3-fe8d-4d5e-bade-e2d8a9044fda req-3e2a189b-8867-4d0f-bc92-39a66017a2ad service nova] [instance: e0f32160-7130-4b9c-aa9c-84123f3a6b32] Refreshing network info cache for port 0d48c0d7-8a0f-4bfa-b8b7-290f122c3f4a {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 09:30:32 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-494d6f86-6bef-4228-a2b1-ce7dff7ab430 tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] Acquiring lock "refresh_cache-e0f32160-7130-4b9c-aa9c-84123f3a6b32" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 09:30:33 user nova-compute[75122]: DEBUG nova.network.neutron [req-885ea5c3-fe8d-4d5e-bade-e2d8a9044fda req-3e2a189b-8867-4d0f-bc92-39a66017a2ad service nova] [instance: e0f32160-7130-4b9c-aa9c-84123f3a6b32] Instance cache missing network info. {{(pid=75122) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 09:30:33 user nova-compute[75122]: DEBUG nova.network.neutron [req-885ea5c3-fe8d-4d5e-bade-e2d8a9044fda req-3e2a189b-8867-4d0f-bc92-39a66017a2ad service nova] [instance: e0f32160-7130-4b9c-aa9c-84123f3a6b32] Updating instance_info_cache with network_info: [] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:30:33 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-885ea5c3-fe8d-4d5e-bade-e2d8a9044fda req-3e2a189b-8867-4d0f-bc92-39a66017a2ad service nova] Releasing lock "refresh_cache-e0f32160-7130-4b9c-aa9c-84123f3a6b32" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 09:30:33 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-494d6f86-6bef-4228-a2b1-ce7dff7ab430 tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] Acquired lock "refresh_cache-e0f32160-7130-4b9c-aa9c-84123f3a6b32" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 09:30:33 user nova-compute[75122]: DEBUG nova.network.neutron [None req-494d6f86-6bef-4228-a2b1-ce7dff7ab430 tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] [instance: e0f32160-7130-4b9c-aa9c-84123f3a6b32] Building network info cache for instance {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 09:30:33 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:30:33 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:30:33 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:30:33 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:30:33 user nova-compute[75122]: DEBUG nova.network.neutron [None req-494d6f86-6bef-4228-a2b1-ce7dff7ab430 tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] [instance: e0f32160-7130-4b9c-aa9c-84123f3a6b32] Instance cache missing network info. {{(pid=75122) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 09:30:34 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:30:34 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:30:34 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:30:34 user nova-compute[75122]: DEBUG nova.network.neutron [None req-494d6f86-6bef-4228-a2b1-ce7dff7ab430 tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] [instance: e0f32160-7130-4b9c-aa9c-84123f3a6b32] Updating instance_info_cache with network_info: [{"id": "0d48c0d7-8a0f-4bfa-b8b7-290f122c3f4a", "address": "fa:16:3e:fd:20:4e", "network": {"id": "46853cd4-ee0a-44fe-b185-8ef14e956701", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1452664326-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6082a9c95d70462586e1f1195b43a383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d48c0d7-8a", "ovs_interfaceid": "0d48c0d7-8a0f-4bfa-b8b7-290f122c3f4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:30:34 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-494d6f86-6bef-4228-a2b1-ce7dff7ab430 tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] Releasing lock "refresh_cache-e0f32160-7130-4b9c-aa9c-84123f3a6b32" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 09:30:34 user nova-compute[75122]: DEBUG nova.compute.manager [None req-494d6f86-6bef-4228-a2b1-ce7dff7ab430 tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] [instance: e0f32160-7130-4b9c-aa9c-84123f3a6b32] Instance network_info: |[{"id": "0d48c0d7-8a0f-4bfa-b8b7-290f122c3f4a", "address": "fa:16:3e:fd:20:4e", "network": {"id": "46853cd4-ee0a-44fe-b185-8ef14e956701", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1452664326-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6082a9c95d70462586e1f1195b43a383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d48c0d7-8a", "ovs_interfaceid": "0d48c0d7-8a0f-4bfa-b8b7-290f122c3f4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75122) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 09:30:34 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-494d6f86-6bef-4228-a2b1-ce7dff7ab430 tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] [instance: e0f32160-7130-4b9c-aa9c-84123f3a6b32] Start _get_guest_xml network_info=[{"id": "0d48c0d7-8a0f-4bfa-b8b7-290f122c3f4a", "address": "fa:16:3e:fd:20:4e", "network": {"id": "46853cd4-ee0a-44fe-b185-8ef14e956701", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1452664326-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6082a9c95d70462586e1f1195b43a383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d48c0d7-8a", "ovs_interfaceid": "0d48c0d7-8a0f-4bfa-b8b7-290f122c3f4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T09:26:31Z,direct_url=<?>,disk_format='qcow2',id=5e862cfe-47b8-4725-8292-65761ee6d0f5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9c57733cb41847c0b4ad31519c382e5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T09:26:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '5e862cfe-47b8-4725-8292-65761ee6d0f5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75122) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 09:30:34 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-494d6f86-6bef-4228-a2b1-ce7dff7ab430 tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 09:30:34 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-494d6f86-6bef-4228-a2b1-ce7dff7ab430 tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 09:30:34 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-494d6f86-6bef-4228-a2b1-ce7dff7ab430 tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75122) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 09:30:34 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-494d6f86-6bef-4228-a2b1-ce7dff7ab430 tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] CPU controller missing on host. {{(pid=75122) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 09:30:34 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-494d6f86-6bef-4228-a2b1-ce7dff7ab430 tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75122) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 09:30:34 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-494d6f86-6bef-4228-a2b1-ce7dff7ab430 tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] CPU controller found on host. {{(pid=75122) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 09:30:34 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-494d6f86-6bef-4228-a2b1-ce7dff7ab430 tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75122) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 09:30:34 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-494d6f86-6bef-4228-a2b1-ce7dff7ab430 tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T09:26:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T09:26:31Z,direct_url=<?>,disk_format='qcow2',id=5e862cfe-47b8-4725-8292-65761ee6d0f5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9c57733cb41847c0b4ad31519c382e5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T09:26:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 09:30:34 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-494d6f86-6bef-4228-a2b1-ce7dff7ab430 tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] Flavor limits 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 09:30:34 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-494d6f86-6bef-4228-a2b1-ce7dff7ab430 tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] Image limits 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 09:30:34 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-494d6f86-6bef-4228-a2b1-ce7dff7ab430 tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] Flavor pref 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 09:30:34 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-494d6f86-6bef-4228-a2b1-ce7dff7ab430 tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] Image pref 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 09:30:34 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-494d6f86-6bef-4228-a2b1-ce7dff7ab430 tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 09:30:34 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-494d6f86-6bef-4228-a2b1-ce7dff7ab430 tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 09:30:34 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-494d6f86-6bef-4228-a2b1-ce7dff7ab430 tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75122) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 09:30:34 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-494d6f86-6bef-4228-a2b1-ce7dff7ab430 tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] Got 1 possible topologies {{(pid=75122) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 09:30:34 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-494d6f86-6bef-4228-a2b1-ce7dff7ab430 tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 09:30:34 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-494d6f86-6bef-4228-a2b1-ce7dff7ab430 tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 09:30:34 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-494d6f86-6bef-4228-a2b1-ce7dff7ab430 tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T09:30:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-650907307',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-650907307',id=5,image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEs+MsbbhvkEM+SFSEAT1XChvfwYG6LS4xClecFc1s5hPTjvnawfxaNFAntQJzNhhhBe9ISEtvpo31FTBvmrG/LNlyB/uvXRpPMaH35dzVkZDJmlCiGv/MxZIKKpRxaHLw==',key_name='tempest-keypair-2107215481',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6082a9c95d70462586e1f1195b43a383',ramdisk_id='',reservation_id='r-j04j8rw4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-2027876138',owner_user_name='tempest-TaggedAttachmentsTest-2027876138-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T09:30:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d2529e19d29e4120b6e8ae75e16bb5b6',uuid=e0f32160-7130-4b9c-aa9c-84123f3a6b32,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0d48c0d7-8a0f-4bfa-b8b7-290f122c3f4a", "address": "fa:16:3e:fd:20:4e", "network": {"id": "46853cd4-ee0a-44fe-b185-8ef14e956701", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1452664326-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6082a9c95d70462586e1f1195b43a383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d48c0d7-8a", "ovs_interfaceid": "0d48c0d7-8a0f-4bfa-b8b7-290f122c3f4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75122) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 09:30:34 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-494d6f86-6bef-4228-a2b1-ce7dff7ab430 tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] Converting VIF {"id": "0d48c0d7-8a0f-4bfa-b8b7-290f122c3f4a", "address": "fa:16:3e:fd:20:4e", "network": {"id": "46853cd4-ee0a-44fe-b185-8ef14e956701", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1452664326-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6082a9c95d70462586e1f1195b43a383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d48c0d7-8a", "ovs_interfaceid": "0d48c0d7-8a0f-4bfa-b8b7-290f122c3f4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 09:30:34 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-494d6f86-6bef-4228-a2b1-ce7dff7ab430 tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:20:4e,bridge_name='br-int',has_traffic_filtering=True,id=0d48c0d7-8a0f-4bfa-b8b7-290f122c3f4a,network=Network(46853cd4-ee0a-44fe-b185-8ef14e956701),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d48c0d7-8a') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 09:30:34 user nova-compute[75122]: DEBUG nova.objects.instance [None req-494d6f86-6bef-4228-a2b1-ce7dff7ab430 tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] Lazy-loading 'pci_devices' on Instance uuid e0f32160-7130-4b9c-aa9c-84123f3a6b32 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:30:34 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-494d6f86-6bef-4228-a2b1-ce7dff7ab430 tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] [instance: e0f32160-7130-4b9c-aa9c-84123f3a6b32] End _get_guest_xml xml=<domain type="kvm">
Nov 15 09:30:34 user nova-compute[75122]:   <uuid>e0f32160-7130-4b9c-aa9c-84123f3a6b32</uuid>
Nov 15 09:30:34 user nova-compute[75122]:   <name>instance-00000005</name>
Nov 15 09:30:34 user nova-compute[75122]:   <memory>524288</memory>
Nov 15 09:30:34 user nova-compute[75122]:   <vcpu>1</vcpu>
Nov 15 09:30:34 user nova-compute[75122]:   <metadata>
Nov 15 09:30:34 user nova-compute[75122]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 09:30:34 user nova-compute[75122]:       <nova:package version="0.0.0"/>
Nov 15 09:30:34 user nova-compute[75122]:       <nova:name>tempest-device-tagging-server-650907307</nova:name>
Nov 15 09:30:34 user nova-compute[75122]:       <nova:creationTime>2023-11-15 09:30:34</nova:creationTime>
Nov 15 09:30:34 user nova-compute[75122]:       <nova:flavor name="m1.tiny">
Nov 15 09:30:34 user nova-compute[75122]:         <nova:memory>512</nova:memory>
Nov 15 09:30:34 user nova-compute[75122]:         <nova:disk>1</nova:disk>
Nov 15 09:30:34 user nova-compute[75122]:         <nova:swap>0</nova:swap>
Nov 15 09:30:34 user nova-compute[75122]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 09:30:34 user nova-compute[75122]:         <nova:vcpus>1</nova:vcpus>
Nov 15 09:30:34 user nova-compute[75122]:       </nova:flavor>
Nov 15 09:30:34 user nova-compute[75122]:       <nova:owner>
Nov 15 09:30:34 user nova-compute[75122]:         <nova:user uuid="d2529e19d29e4120b6e8ae75e16bb5b6">tempest-TaggedAttachmentsTest-2027876138-project-member</nova:user>
Nov 15 09:30:34 user nova-compute[75122]:         <nova:project uuid="6082a9c95d70462586e1f1195b43a383">tempest-TaggedAttachmentsTest-2027876138</nova:project>
Nov 15 09:30:34 user nova-compute[75122]:       </nova:owner>
Nov 15 09:30:34 user nova-compute[75122]:       <nova:root type="image" uuid="5e862cfe-47b8-4725-8292-65761ee6d0f5"/>
Nov 15 09:30:34 user nova-compute[75122]:       <nova:ports>
Nov 15 09:30:34 user nova-compute[75122]:         <nova:port uuid="0d48c0d7-8a0f-4bfa-b8b7-290f122c3f4a">
Nov 15 09:30:34 user nova-compute[75122]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 15 09:30:34 user nova-compute[75122]:         </nova:port>
Nov 15 09:30:34 user nova-compute[75122]:       </nova:ports>
Nov 15 09:30:34 user nova-compute[75122]:     </nova:instance>
Nov 15 09:30:34 user nova-compute[75122]:   </metadata>
Nov 15 09:30:34 user nova-compute[75122]:   <sysinfo type="smbios">
Nov 15 09:30:34 user nova-compute[75122]:     <system>
Nov 15 09:30:34 user nova-compute[75122]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 09:30:34 user nova-compute[75122]:       <entry name="product">OpenStack Nova</entry>
Nov 15 09:30:34 user nova-compute[75122]:       <entry name="version">0.0.0</entry>
Nov 15 09:30:34 user nova-compute[75122]:       <entry name="serial">e0f32160-7130-4b9c-aa9c-84123f3a6b32</entry>
Nov 15 09:30:34 user nova-compute[75122]:       <entry name="uuid">e0f32160-7130-4b9c-aa9c-84123f3a6b32</entry>
Nov 15 09:30:34 user nova-compute[75122]:       <entry name="family">Virtual Machine</entry>
Nov 15 09:30:34 user nova-compute[75122]:     </system>
Nov 15 09:30:34 user nova-compute[75122]:   </sysinfo>
Nov 15 09:30:34 user nova-compute[75122]:   <os>
Nov 15 09:30:34 user nova-compute[75122]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 09:30:34 user nova-compute[75122]:     <boot dev="hd"/>
Nov 15 09:30:34 user nova-compute[75122]:     <smbios mode="sysinfo"/>
Nov 15 09:30:34 user nova-compute[75122]:   </os>
Nov 15 09:30:34 user nova-compute[75122]:   <features>
Nov 15 09:30:34 user nova-compute[75122]:     <acpi/>
Nov 15 09:30:34 user nova-compute[75122]:     <apic/>
Nov 15 09:30:34 user nova-compute[75122]:     <vmcoreinfo/>
Nov 15 09:30:34 user nova-compute[75122]:   </features>
Nov 15 09:30:34 user nova-compute[75122]:   <clock offset="utc">
Nov 15 09:30:34 user nova-compute[75122]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 09:30:34 user nova-compute[75122]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 09:30:34 user nova-compute[75122]:     <timer name="hpet" present="no"/>
Nov 15 09:30:34 user nova-compute[75122]:   </clock>
Nov 15 09:30:34 user nova-compute[75122]:   <cpu mode="custom" match="exact">
Nov 15 09:30:34 user nova-compute[75122]:     <model>Nehalem</model>
Nov 15 09:30:34 user nova-compute[75122]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 09:30:34 user nova-compute[75122]:   </cpu>
Nov 15 09:30:34 user nova-compute[75122]:   <devices>
Nov 15 09:30:34 user nova-compute[75122]:     <disk type="file" device="disk">
Nov 15 09:30:34 user nova-compute[75122]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 09:30:34 user nova-compute[75122]:       <source file="/opt/stack/data/nova/instances/e0f32160-7130-4b9c-aa9c-84123f3a6b32/disk"/>
Nov 15 09:30:34 user nova-compute[75122]:       <target dev="vda" bus="virtio"/>
Nov 15 09:30:34 user nova-compute[75122]:     </disk>
Nov 15 09:30:34 user nova-compute[75122]:     <disk type="file" device="cdrom">
Nov 15 09:30:34 user nova-compute[75122]:       <driver name="qemu" type="raw" cache="none"/>
Nov 15 09:30:34 user nova-compute[75122]:       <source file="/opt/stack/data/nova/instances/e0f32160-7130-4b9c-aa9c-84123f3a6b32/disk.config"/>
Nov 15 09:30:34 user nova-compute[75122]:       <target dev="hda" bus="ide"/>
Nov 15 09:30:34 user nova-compute[75122]:     </disk>
Nov 15 09:30:34 user nova-compute[75122]:     <interface type="ethernet">
Nov 15 09:30:34 user nova-compute[75122]:       <mac address="fa:16:3e:fd:20:4e"/>
Nov 15 09:30:34 user nova-compute[75122]:       <model type="virtio"/>
Nov 15 09:30:34 user nova-compute[75122]:       <mtu size="1442"/>
Nov 15 09:30:34 user nova-compute[75122]:       <target dev="tap0d48c0d7-8a"/>
Nov 15 09:30:34 user nova-compute[75122]:     </interface>
Nov 15 09:30:34 user nova-compute[75122]:     <serial type="pty">
Nov 15 09:30:34 user nova-compute[75122]:       <log file="/opt/stack/data/nova/instances/e0f32160-7130-4b9c-aa9c-84123f3a6b32/console.log" append="off"/>
Nov 15 09:30:34 user nova-compute[75122]:     </serial>
Nov 15 09:30:34 user nova-compute[75122]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 09:30:34 user nova-compute[75122]:     <video>
Nov 15 09:30:34 user nova-compute[75122]:       <model type="virtio"/>
Nov 15 09:30:34 user nova-compute[75122]:     </video>
Nov 15 09:30:34 user nova-compute[75122]:     <rng model="virtio">
Nov 15 09:30:34 user nova-compute[75122]:       <backend model="random">/dev/urandom</backend>
Nov 15 09:30:34 user nova-compute[75122]:     </rng>
Nov 15 09:30:34 user nova-compute[75122]:     <controller type="usb" index="0" model="none"/>
Nov 15 09:30:34 user nova-compute[75122]:     <memballoon model="virtio">
Nov 15 09:30:34 user nova-compute[75122]:       <stats period="10"/>
Nov 15 09:30:34 user nova-compute[75122]:     </memballoon>
Nov 15 09:30:34 user nova-compute[75122]:   </devices>
Nov 15 09:30:34 user nova-compute[75122]: </domain>
Nov 15 09:30:34 user nova-compute[75122]:  {{(pid=75122) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 09:30:34 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-494d6f86-6bef-4228-a2b1-ce7dff7ab430 tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T09:30:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-650907307',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-650907307',id=5,image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEs+MsbbhvkEM+SFSEAT1XChvfwYG6LS4xClecFc1s5hPTjvnawfxaNFAntQJzNhhhBe9ISEtvpo31FTBvmrG/LNlyB/uvXRpPMaH35dzVkZDJmlCiGv/MxZIKKpRxaHLw==',key_name='tempest-keypair-2107215481',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6082a9c95d70462586e1f1195b43a383',ramdisk_id='',reservation_id='r-j04j8rw4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-2027876138',owner_user_name='tempest-TaggedAttachmentsTest-2027876138-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T09:30:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d2529e19d29e4120b6e8ae75e16bb5b6',uuid=e0f32160-7130-4b9c-aa9c-84123f3a6b32,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0d48c0d7-8a0f-4bfa-b8b7-290f122c3f4a", "address": "fa:16:3e:fd:20:4e", "network": {"id": "46853cd4-ee0a-44fe-b185-8ef14e956701", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1452664326-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6082a9c95d70462586e1f1195b43a383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d48c0d7-8a", "ovs_interfaceid": "0d48c0d7-8a0f-4bfa-b8b7-290f122c3f4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 09:30:34 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-494d6f86-6bef-4228-a2b1-ce7dff7ab430 tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] Converting VIF {"id": "0d48c0d7-8a0f-4bfa-b8b7-290f122c3f4a", "address": "fa:16:3e:fd:20:4e", "network": {"id": "46853cd4-ee0a-44fe-b185-8ef14e956701", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1452664326-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6082a9c95d70462586e1f1195b43a383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d48c0d7-8a", "ovs_interfaceid": "0d48c0d7-8a0f-4bfa-b8b7-290f122c3f4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 09:30:34 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-494d6f86-6bef-4228-a2b1-ce7dff7ab430 tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:20:4e,bridge_name='br-int',has_traffic_filtering=True,id=0d48c0d7-8a0f-4bfa-b8b7-290f122c3f4a,network=Network(46853cd4-ee0a-44fe-b185-8ef14e956701),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d48c0d7-8a') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 09:30:34 user nova-compute[75122]: DEBUG os_vif [None req-494d6f86-6bef-4228-a2b1-ce7dff7ab430 tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:20:4e,bridge_name='br-int',has_traffic_filtering=True,id=0d48c0d7-8a0f-4bfa-b8b7-290f122c3f4a,network=Network(46853cd4-ee0a-44fe-b185-8ef14e956701),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d48c0d7-8a') {{(pid=75122) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 09:30:34 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:30:34 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:30:34 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 09:30:34 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:30:34 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6fb9d8d0-a328-5ece-ac73-9479a6341e6e', '_type': 'linux-noop'}}, row=False) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:30:34 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:30:34 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:30:34 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:30:34 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0d48c0d7-8a, may_exist=True, interface_attrs={}) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:30:34 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0d48c0d7-8a, col_values=(('qos', UUID('203c5fe0-b2cd-4b1e-906a-461c61a8eb62')),), if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:30:34 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0d48c0d7-8a, col_values=(('external_ids', {'iface-id': '0d48c0d7-8a0f-4bfa-b8b7-290f122c3f4a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fd:20:4e', 'vm-uuid': 'e0f32160-7130-4b9c-aa9c-84123f3a6b32'}),), if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:30:34 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:30:34 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:30:34 user nova-compute[75122]: INFO os_vif [None req-494d6f86-6bef-4228-a2b1-ce7dff7ab430 tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:20:4e,bridge_name='br-int',has_traffic_filtering=True,id=0d48c0d7-8a0f-4bfa-b8b7-290f122c3f4a,network=Network(46853cd4-ee0a-44fe-b185-8ef14e956701),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d48c0d7-8a')
Nov 15 09:30:34 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:30:34 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-494d6f86-6bef-4228-a2b1-ce7dff7ab430 tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] No BDM found with device name vda, not building metadata. {{(pid=75122) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 09:30:34 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-494d6f86-6bef-4228-a2b1-ce7dff7ab430 tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] No BDM found with device name hda, not building metadata. {{(pid=75122) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 09:30:34 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-494d6f86-6bef-4228-a2b1-ce7dff7ab430 tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] No VIF found with MAC fa:16:3e:fd:20:4e, not building metadata {{(pid=75122) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 09:30:34 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-494d6f86-6bef-4228-a2b1-ce7dff7ab430 tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] [instance: e0f32160-7130-4b9c-aa9c-84123f3a6b32] Using config drive
Nov 15 09:30:35 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-494d6f86-6bef-4228-a2b1-ce7dff7ab430 tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] [instance: e0f32160-7130-4b9c-aa9c-84123f3a6b32] Creating config drive at /opt/stack/data/nova/instances/e0f32160-7130-4b9c-aa9c-84123f3a6b32/disk.config
Nov 15 09:30:35 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-494d6f86-6bef-4228-a2b1-ce7dff7ab430 tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/e0f32160-7130-4b9c-aa9c-84123f3a6b32/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpbj9xss1_ {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:30:35 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:30:35 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:30:35 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-494d6f86-6bef-4228-a2b1-ce7dff7ab430 tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/e0f32160-7130-4b9c-aa9c-84123f3a6b32/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpbj9xss1_" returned: 0 in 0.082s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:30:35 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:30:36 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-050994fc-5329-4990-a334-913056b1b2a6 tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] Acquiring lock "d24a189e-2de9-404e-b281-224c150a5bbf" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:30:36 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-050994fc-5329-4990-a334-913056b1b2a6 tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] Lock "d24a189e-2de9-404e-b281-224c150a5bbf" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:30:36 user nova-compute[75122]: DEBUG nova.compute.manager [None req-050994fc-5329-4990-a334-913056b1b2a6 tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] [instance: d24a189e-2de9-404e-b281-224c150a5bbf] Starting instance... {{(pid=75122) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 09:30:36 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-050994fc-5329-4990-a334-913056b1b2a6 tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:30:36 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-050994fc-5329-4990-a334-913056b1b2a6 tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:30:36 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-050994fc-5329-4990-a334-913056b1b2a6 tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75122) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 09:30:36 user nova-compute[75122]: INFO nova.compute.claims [None req-050994fc-5329-4990-a334-913056b1b2a6 tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] [instance: d24a189e-2de9-404e-b281-224c150a5bbf] Claim successful on node user
Nov 15 09:30:36 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:30:36 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:30:36 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:30:37 user nova-compute[75122]: DEBUG nova.compute.provider_tree [None req-050994fc-5329-4990-a334-913056b1b2a6 tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] Inventory has not changed in ProviderTree for provider: 69a3da65-47be-44c6-b67c-c692b58284ef {{(pid=75122) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 09:30:37 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-050994fc-5329-4990-a334-913056b1b2a6 tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] Inventory has not changed for provider 69a3da65-47be-44c6-b67c-c692b58284ef based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 09:30:37 user nova-compute[75122]: DEBUG nova.compute.manager [None req-a3ff7621-15f0-402e-90a7-7e3cf0feaad5 tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] [instance: bcb58c79-f6b3-44d9-a80f-1a4cf580379f] Instance event wait completed in 0 seconds for  {{(pid=75122) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 09:30:37 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-a3ff7621-15f0-402e-90a7-7e3cf0feaad5 tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] [instance: bcb58c79-f6b3-44d9-a80f-1a4cf580379f] Guest created on hypervisor {{(pid=75122) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 09:30:37 user nova-compute[75122]: DEBUG nova.compute.manager [req-1dbfa38d-f2f8-4c9e-8260-da105699ab04 req-03e6a3e9-3e8f-49a6-9d77-fb17392780db service nova] [instance: e0f32160-7130-4b9c-aa9c-84123f3a6b32] Received event network-vif-plugged-0d48c0d7-8a0f-4bfa-b8b7-290f122c3f4a {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:30:37 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-1dbfa38d-f2f8-4c9e-8260-da105699ab04 req-03e6a3e9-3e8f-49a6-9d77-fb17392780db service nova] Acquiring lock "e0f32160-7130-4b9c-aa9c-84123f3a6b32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:30:37 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-1dbfa38d-f2f8-4c9e-8260-da105699ab04 req-03e6a3e9-3e8f-49a6-9d77-fb17392780db service nova] Lock "e0f32160-7130-4b9c-aa9c-84123f3a6b32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:30:37 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-1dbfa38d-f2f8-4c9e-8260-da105699ab04 req-03e6a3e9-3e8f-49a6-9d77-fb17392780db service nova] Lock "e0f32160-7130-4b9c-aa9c-84123f3a6b32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:30:37 user nova-compute[75122]: DEBUG nova.compute.manager [req-1dbfa38d-f2f8-4c9e-8260-da105699ab04 req-03e6a3e9-3e8f-49a6-9d77-fb17392780db service nova] [instance: e0f32160-7130-4b9c-aa9c-84123f3a6b32] No waiting events found dispatching network-vif-plugged-0d48c0d7-8a0f-4bfa-b8b7-290f122c3f4a {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:30:37 user nova-compute[75122]: WARNING nova.compute.manager [req-1dbfa38d-f2f8-4c9e-8260-da105699ab04 req-03e6a3e9-3e8f-49a6-9d77-fb17392780db service nova] [instance: e0f32160-7130-4b9c-aa9c-84123f3a6b32] Received unexpected event network-vif-plugged-0d48c0d7-8a0f-4bfa-b8b7-290f122c3f4a for instance with vm_state building and task_state spawning.
Nov 15 09:30:37 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-050994fc-5329-4990-a334-913056b1b2a6 tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.698s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:30:37 user nova-compute[75122]: DEBUG nova.compute.manager [None req-050994fc-5329-4990-a334-913056b1b2a6 tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] [instance: d24a189e-2de9-404e-b281-224c150a5bbf] Start building networks asynchronously for instance. {{(pid=75122) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 09:30:37 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:30:37 user nova-compute[75122]: INFO nova.virt.libvirt.driver [-] [instance: bcb58c79-f6b3-44d9-a80f-1a4cf580379f] Instance spawned successfully.
Nov 15 09:30:37 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-a3ff7621-15f0-402e-90a7-7e3cf0feaad5 tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] [instance: bcb58c79-f6b3-44d9-a80f-1a4cf580379f] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 09:30:37 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-a3ff7621-15f0-402e-90a7-7e3cf0feaad5 tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] [instance: bcb58c79-f6b3-44d9-a80f-1a4cf580379f] Found default for hw_input_bus of None {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:30:37 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-a3ff7621-15f0-402e-90a7-7e3cf0feaad5 tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] [instance: bcb58c79-f6b3-44d9-a80f-1a4cf580379f] Found default for hw_pointer_model of None {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:30:37 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-a3ff7621-15f0-402e-90a7-7e3cf0feaad5 tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] [instance: bcb58c79-f6b3-44d9-a80f-1a4cf580379f] Found default for hw_video_model of virtio {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:30:37 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-a3ff7621-15f0-402e-90a7-7e3cf0feaad5 tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] [instance: bcb58c79-f6b3-44d9-a80f-1a4cf580379f] Found default for hw_vif_model of virtio {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:30:37 user nova-compute[75122]: DEBUG nova.compute.manager [None req-050994fc-5329-4990-a334-913056b1b2a6 tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] [instance: d24a189e-2de9-404e-b281-224c150a5bbf] Allocating IP information in the background. {{(pid=75122) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 09:30:37 user nova-compute[75122]: DEBUG nova.network.neutron [None req-050994fc-5329-4990-a334-913056b1b2a6 tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] [instance: d24a189e-2de9-404e-b281-224c150a5bbf] allocate_for_instance() {{(pid=75122) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 09:30:37 user nova-compute[75122]: INFO nova.compute.manager [None req-a3ff7621-15f0-402e-90a7-7e3cf0feaad5 tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] [instance: bcb58c79-f6b3-44d9-a80f-1a4cf580379f] Took 13.70 seconds to spawn the instance on the hypervisor.
Nov 15 09:30:37 user nova-compute[75122]: DEBUG nova.compute.manager [None req-a3ff7621-15f0-402e-90a7-7e3cf0feaad5 tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] [instance: bcb58c79-f6b3-44d9-a80f-1a4cf580379f] Checking state {{(pid=75122) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 09:30:37 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-050994fc-5329-4990-a334-913056b1b2a6 tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] [instance: d24a189e-2de9-404e-b281-224c150a5bbf] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 09:30:37 user nova-compute[75122]: DEBUG nova.compute.manager [None req-050994fc-5329-4990-a334-913056b1b2a6 tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] [instance: d24a189e-2de9-404e-b281-224c150a5bbf] Start building block device mappings for instance. {{(pid=75122) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 09:30:37 user nova-compute[75122]: INFO nova.compute.manager [None req-a3ff7621-15f0-402e-90a7-7e3cf0feaad5 tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] [instance: bcb58c79-f6b3-44d9-a80f-1a4cf580379f] Took 14.72 seconds to build instance.
Nov 15 09:30:37 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-a3ff7621-15f0-402e-90a7-7e3cf0feaad5 tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] Lock "bcb58c79-f6b3-44d9-a80f-1a4cf580379f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.912s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:30:37 user nova-compute[75122]: DEBUG nova.compute.manager [None req-050994fc-5329-4990-a334-913056b1b2a6 tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] [instance: d24a189e-2de9-404e-b281-224c150a5bbf] Start spawning the instance on the hypervisor. {{(pid=75122) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 09:30:37 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-050994fc-5329-4990-a334-913056b1b2a6 tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] [instance: d24a189e-2de9-404e-b281-224c150a5bbf] Creating instance directory {{(pid=75122) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 09:30:37 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-050994fc-5329-4990-a334-913056b1b2a6 tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] [instance: d24a189e-2de9-404e-b281-224c150a5bbf] Creating image(s)
Nov 15 09:30:37 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-050994fc-5329-4990-a334-913056b1b2a6 tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] Acquiring lock "/opt/stack/data/nova/instances/d24a189e-2de9-404e-b281-224c150a5bbf/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:30:37 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-050994fc-5329-4990-a334-913056b1b2a6 tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] Lock "/opt/stack/data/nova/instances/d24a189e-2de9-404e-b281-224c150a5bbf/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:30:37 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-050994fc-5329-4990-a334-913056b1b2a6 tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] Lock "/opt/stack/data/nova/instances/d24a189e-2de9-404e-b281-224c150a5bbf/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.017s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:30:37 user nova-compute[75122]: DEBUG nova.policy [None req-050994fc-5329-4990-a334-913056b1b2a6 tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '015d0c9a02d247b9afec711822f2dc2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0044b15c211422c8fe109af97ce4082', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75122) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 09:30:37 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-050994fc-5329-4990-a334-913056b1b2a6 tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:30:38 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:30:38 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:30:38 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:30:38 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-050994fc-5329-4990-a334-913056b1b2a6 tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json" returned: 0 in 0.268s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:30:38 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-050994fc-5329-4990-a334-913056b1b2a6 tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] Acquiring lock "95d6e29f74d5408f818e32f3bc29bc8270a4c665" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:30:38 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-050994fc-5329-4990-a334-913056b1b2a6 tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] Lock "95d6e29f74d5408f818e32f3bc29bc8270a4c665" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.005s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:30:38 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-050994fc-5329-4990-a334-913056b1b2a6 tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:30:38 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-050994fc-5329-4990-a334-913056b1b2a6 tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json" returned: 0 in 0.234s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:30:38 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-050994fc-5329-4990-a334-913056b1b2a6 tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665,backing_fmt=raw /opt/stack/data/nova/instances/d24a189e-2de9-404e-b281-224c150a5bbf/disk 1073741824 {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:30:38 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-050994fc-5329-4990-a334-913056b1b2a6 tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665,backing_fmt=raw /opt/stack/data/nova/instances/d24a189e-2de9-404e-b281-224c150a5bbf/disk 1073741824" returned: 0 in 0.069s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:30:38 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-050994fc-5329-4990-a334-913056b1b2a6 tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] Lock "95d6e29f74d5408f818e32f3bc29bc8270a4c665" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.312s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:30:38 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-050994fc-5329-4990-a334-913056b1b2a6 tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:30:38 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-050994fc-5329-4990-a334-913056b1b2a6 tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json" returned: 0 in 0.372s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:30:38 user nova-compute[75122]: DEBUG nova.virt.disk.api [None req-050994fc-5329-4990-a334-913056b1b2a6 tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d24a189e-2de9-404e-b281-224c150a5bbf/disk. size=1073741824 {{(pid=75122) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 09:30:38 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-050994fc-5329-4990-a334-913056b1b2a6 tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d24a189e-2de9-404e-b281-224c150a5bbf/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:30:39 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-050994fc-5329-4990-a334-913056b1b2a6 tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d24a189e-2de9-404e-b281-224c150a5bbf/disk --force-share --output=json" returned: 0 in 0.283s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:30:39 user nova-compute[75122]: DEBUG nova.virt.disk.api [None req-050994fc-5329-4990-a334-913056b1b2a6 tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] Cannot resize image /opt/stack/data/nova/instances/d24a189e-2de9-404e-b281-224c150a5bbf/disk to a smaller size. {{(pid=75122) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 09:30:39 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-050994fc-5329-4990-a334-913056b1b2a6 tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] [instance: d24a189e-2de9-404e-b281-224c150a5bbf] Created local disks {{(pid=75122) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 09:30:39 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-050994fc-5329-4990-a334-913056b1b2a6 tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] [instance: d24a189e-2de9-404e-b281-224c150a5bbf] Ensure instance console log exists: /opt/stack/data/nova/instances/d24a189e-2de9-404e-b281-224c150a5bbf/console.log {{(pid=75122) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 09:30:39 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-050994fc-5329-4990-a334-913056b1b2a6 tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:30:39 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-050994fc-5329-4990-a334-913056b1b2a6 tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:30:39 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-050994fc-5329-4990-a334-913056b1b2a6 tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:30:39 user nova-compute[75122]: DEBUG nova.network.neutron [None req-050994fc-5329-4990-a334-913056b1b2a6 tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] [instance: d24a189e-2de9-404e-b281-224c150a5bbf] Successfully created port: 5439a285-9a24-4c8e-a9d0-4e7c773f9e60 {{(pid=75122) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 09:30:39 user nova-compute[75122]: DEBUG nova.compute.manager [req-c62ca387-ab9a-48a5-abc4-231d587ca2a0 req-d05aa42a-8bc0-4ab5-a950-d43f264f9d66 service nova] [instance: e0f32160-7130-4b9c-aa9c-84123f3a6b32] Received event network-vif-plugged-0d48c0d7-8a0f-4bfa-b8b7-290f122c3f4a {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:30:39 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-c62ca387-ab9a-48a5-abc4-231d587ca2a0 req-d05aa42a-8bc0-4ab5-a950-d43f264f9d66 service nova] Acquiring lock "e0f32160-7130-4b9c-aa9c-84123f3a6b32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:30:39 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-c62ca387-ab9a-48a5-abc4-231d587ca2a0 req-d05aa42a-8bc0-4ab5-a950-d43f264f9d66 service nova] Lock "e0f32160-7130-4b9c-aa9c-84123f3a6b32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:30:39 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-c62ca387-ab9a-48a5-abc4-231d587ca2a0 req-d05aa42a-8bc0-4ab5-a950-d43f264f9d66 service nova] Lock "e0f32160-7130-4b9c-aa9c-84123f3a6b32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:30:39 user nova-compute[75122]: DEBUG nova.compute.manager [req-c62ca387-ab9a-48a5-abc4-231d587ca2a0 req-d05aa42a-8bc0-4ab5-a950-d43f264f9d66 service nova] [instance: e0f32160-7130-4b9c-aa9c-84123f3a6b32] No waiting events found dispatching network-vif-plugged-0d48c0d7-8a0f-4bfa-b8b7-290f122c3f4a {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:30:39 user nova-compute[75122]: WARNING nova.compute.manager [req-c62ca387-ab9a-48a5-abc4-231d587ca2a0 req-d05aa42a-8bc0-4ab5-a950-d43f264f9d66 service nova] [instance: e0f32160-7130-4b9c-aa9c-84123f3a6b32] Received unexpected event network-vif-plugged-0d48c0d7-8a0f-4bfa-b8b7-290f122c3f4a for instance with vm_state building and task_state spawning.
Nov 15 09:30:39 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:30:39 user nova-compute[75122]: DEBUG nova.compute.manager [None req-494d6f86-6bef-4228-a2b1-ce7dff7ab430 tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] [instance: e0f32160-7130-4b9c-aa9c-84123f3a6b32] Instance event wait completed in 0 seconds for  {{(pid=75122) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 09:30:39 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-494d6f86-6bef-4228-a2b1-ce7dff7ab430 tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] [instance: e0f32160-7130-4b9c-aa9c-84123f3a6b32] Guest created on hypervisor {{(pid=75122) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 09:30:39 user nova-compute[75122]: INFO nova.virt.libvirt.driver [-] [instance: e0f32160-7130-4b9c-aa9c-84123f3a6b32] Instance spawned successfully.
Nov 15 09:30:39 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-494d6f86-6bef-4228-a2b1-ce7dff7ab430 tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] [instance: e0f32160-7130-4b9c-aa9c-84123f3a6b32] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 09:30:39 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:30:39 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-494d6f86-6bef-4228-a2b1-ce7dff7ab430 tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] [instance: e0f32160-7130-4b9c-aa9c-84123f3a6b32] Found default for hw_cdrom_bus of ide {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:30:39 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-494d6f86-6bef-4228-a2b1-ce7dff7ab430 tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] [instance: e0f32160-7130-4b9c-aa9c-84123f3a6b32] Found default for hw_disk_bus of virtio {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:30:39 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-494d6f86-6bef-4228-a2b1-ce7dff7ab430 tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] [instance: e0f32160-7130-4b9c-aa9c-84123f3a6b32] Found default for hw_input_bus of None {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:30:39 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-494d6f86-6bef-4228-a2b1-ce7dff7ab430 tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] [instance: e0f32160-7130-4b9c-aa9c-84123f3a6b32] Found default for hw_pointer_model of None {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:30:39 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-494d6f86-6bef-4228-a2b1-ce7dff7ab430 tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] [instance: e0f32160-7130-4b9c-aa9c-84123f3a6b32] Found default for hw_video_model of virtio {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:30:39 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-494d6f86-6bef-4228-a2b1-ce7dff7ab430 tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] [instance: e0f32160-7130-4b9c-aa9c-84123f3a6b32] Found default for hw_vif_model of virtio {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:30:40 user nova-compute[75122]: INFO nova.compute.manager [None req-494d6f86-6bef-4228-a2b1-ce7dff7ab430 tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] [instance: e0f32160-7130-4b9c-aa9c-84123f3a6b32] Took 12.06 seconds to spawn the instance on the hypervisor.
Nov 15 09:30:40 user nova-compute[75122]: DEBUG nova.compute.manager [None req-494d6f86-6bef-4228-a2b1-ce7dff7ab430 tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] [instance: e0f32160-7130-4b9c-aa9c-84123f3a6b32] Checking state {{(pid=75122) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 09:30:40 user nova-compute[75122]: INFO nova.compute.manager [None req-494d6f86-6bef-4228-a2b1-ce7dff7ab430 tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] [instance: e0f32160-7130-4b9c-aa9c-84123f3a6b32] Took 13.89 seconds to build instance.
Nov 15 09:30:40 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-494d6f86-6bef-4228-a2b1-ce7dff7ab430 tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] Lock "e0f32160-7130-4b9c-aa9c-84123f3a6b32" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.066s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:30:40 user nova-compute[75122]: DEBUG nova.network.neutron [None req-050994fc-5329-4990-a334-913056b1b2a6 tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] [instance: d24a189e-2de9-404e-b281-224c150a5bbf] Successfully updated port: 5439a285-9a24-4c8e-a9d0-4e7c773f9e60 {{(pid=75122) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 09:30:40 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-050994fc-5329-4990-a334-913056b1b2a6 tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] Acquiring lock "refresh_cache-d24a189e-2de9-404e-b281-224c150a5bbf" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 09:30:40 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-050994fc-5329-4990-a334-913056b1b2a6 tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] Acquired lock "refresh_cache-d24a189e-2de9-404e-b281-224c150a5bbf" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 09:30:40 user nova-compute[75122]: DEBUG nova.network.neutron [None req-050994fc-5329-4990-a334-913056b1b2a6 tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] [instance: d24a189e-2de9-404e-b281-224c150a5bbf] Building network info cache for instance {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 09:30:40 user nova-compute[75122]: DEBUG nova.compute.manager [req-23a1f479-4f21-466b-aa71-4b552ab960fc req-94a228fe-d0da-4d1f-80ce-f2fa38e192cf service nova] [instance: d24a189e-2de9-404e-b281-224c150a5bbf] Received event network-changed-5439a285-9a24-4c8e-a9d0-4e7c773f9e60 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:30:40 user nova-compute[75122]: DEBUG nova.compute.manager [req-23a1f479-4f21-466b-aa71-4b552ab960fc req-94a228fe-d0da-4d1f-80ce-f2fa38e192cf service nova] [instance: d24a189e-2de9-404e-b281-224c150a5bbf] Refreshing instance network info cache due to event network-changed-5439a285-9a24-4c8e-a9d0-4e7c773f9e60. {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 09:30:40 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-23a1f479-4f21-466b-aa71-4b552ab960fc req-94a228fe-d0da-4d1f-80ce-f2fa38e192cf service nova] Acquiring lock "refresh_cache-d24a189e-2de9-404e-b281-224c150a5bbf" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 09:30:40 user nova-compute[75122]: DEBUG nova.network.neutron [None req-050994fc-5329-4990-a334-913056b1b2a6 tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] [instance: d24a189e-2de9-404e-b281-224c150a5bbf] Instance cache missing network info. {{(pid=75122) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 09:30:40 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-578a8905-0cc1-4a64-b7ad-18c4ce3f60f8 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] Acquiring lock "fa52b2a0-e5a0-4f93-a1cf-fef4a8313368" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:30:40 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-578a8905-0cc1-4a64-b7ad-18c4ce3f60f8 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] Lock "fa52b2a0-e5a0-4f93-a1cf-fef4a8313368" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:30:41 user nova-compute[75122]: DEBUG nova.compute.manager [None req-578a8905-0cc1-4a64-b7ad-18c4ce3f60f8 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] [instance: fa52b2a0-e5a0-4f93-a1cf-fef4a8313368] Starting instance... {{(pid=75122) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 09:30:41 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-578a8905-0cc1-4a64-b7ad-18c4ce3f60f8 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:30:41 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-578a8905-0cc1-4a64-b7ad-18c4ce3f60f8 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:30:41 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-578a8905-0cc1-4a64-b7ad-18c4ce3f60f8 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75122) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 09:30:41 user nova-compute[75122]: INFO nova.compute.claims [None req-578a8905-0cc1-4a64-b7ad-18c4ce3f60f8 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] [instance: fa52b2a0-e5a0-4f93-a1cf-fef4a8313368] Claim successful on node user
Nov 15 09:30:41 user nova-compute[75122]: DEBUG nova.network.neutron [None req-050994fc-5329-4990-a334-913056b1b2a6 tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] [instance: d24a189e-2de9-404e-b281-224c150a5bbf] Updating instance_info_cache with network_info: [{"id": "5439a285-9a24-4c8e-a9d0-4e7c773f9e60", "address": "fa:16:3e:bd:9c:6c", "network": {"id": "7c08103d-8c2a-4613-8c0b-e3ed4568332a", "bridge": "br-int", "label": "tempest-TestVolumeSwap-36009092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0044b15c211422c8fe109af97ce4082", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5439a285-9a", "ovs_interfaceid": "5439a285-9a24-4c8e-a9d0-4e7c773f9e60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:30:41 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-050994fc-5329-4990-a334-913056b1b2a6 tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] Releasing lock "refresh_cache-d24a189e-2de9-404e-b281-224c150a5bbf" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 09:30:41 user nova-compute[75122]: DEBUG nova.compute.manager [None req-050994fc-5329-4990-a334-913056b1b2a6 tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] [instance: d24a189e-2de9-404e-b281-224c150a5bbf] Instance network_info: |[{"id": "5439a285-9a24-4c8e-a9d0-4e7c773f9e60", "address": "fa:16:3e:bd:9c:6c", "network": {"id": "7c08103d-8c2a-4613-8c0b-e3ed4568332a", "bridge": "br-int", "label": "tempest-TestVolumeSwap-36009092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0044b15c211422c8fe109af97ce4082", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5439a285-9a", "ovs_interfaceid": "5439a285-9a24-4c8e-a9d0-4e7c773f9e60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75122) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 09:30:41 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-23a1f479-4f21-466b-aa71-4b552ab960fc req-94a228fe-d0da-4d1f-80ce-f2fa38e192cf service nova] Acquired lock "refresh_cache-d24a189e-2de9-404e-b281-224c150a5bbf" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 09:30:41 user nova-compute[75122]: DEBUG nova.network.neutron [req-23a1f479-4f21-466b-aa71-4b552ab960fc req-94a228fe-d0da-4d1f-80ce-f2fa38e192cf service nova] [instance: d24a189e-2de9-404e-b281-224c150a5bbf] Refreshing network info cache for port 5439a285-9a24-4c8e-a9d0-4e7c773f9e60 {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 09:30:41 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-050994fc-5329-4990-a334-913056b1b2a6 tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] [instance: d24a189e-2de9-404e-b281-224c150a5bbf] Start _get_guest_xml network_info=[{"id": "5439a285-9a24-4c8e-a9d0-4e7c773f9e60", "address": "fa:16:3e:bd:9c:6c", "network": {"id": "7c08103d-8c2a-4613-8c0b-e3ed4568332a", "bridge": "br-int", "label": "tempest-TestVolumeSwap-36009092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0044b15c211422c8fe109af97ce4082", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5439a285-9a", "ovs_interfaceid": "5439a285-9a24-4c8e-a9d0-4e7c773f9e60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T09:26:31Z,direct_url=<?>,disk_format='qcow2',id=5e862cfe-47b8-4725-8292-65761ee6d0f5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9c57733cb41847c0b4ad31519c382e5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T09:26:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '5e862cfe-47b8-4725-8292-65761ee6d0f5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75122) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 09:30:41 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-050994fc-5329-4990-a334-913056b1b2a6 tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 09:30:41 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-050994fc-5329-4990-a334-913056b1b2a6 tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 09:30:41 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-050994fc-5329-4990-a334-913056b1b2a6 tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75122) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 09:30:41 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-050994fc-5329-4990-a334-913056b1b2a6 tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] CPU controller missing on host. {{(pid=75122) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 09:30:41 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-050994fc-5329-4990-a334-913056b1b2a6 tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75122) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 09:30:41 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-050994fc-5329-4990-a334-913056b1b2a6 tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] CPU controller found on host. {{(pid=75122) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 09:30:41 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-050994fc-5329-4990-a334-913056b1b2a6 tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75122) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 09:30:41 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-050994fc-5329-4990-a334-913056b1b2a6 tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T09:26:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T09:26:31Z,direct_url=<?>,disk_format='qcow2',id=5e862cfe-47b8-4725-8292-65761ee6d0f5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9c57733cb41847c0b4ad31519c382e5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T09:26:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 09:30:41 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-050994fc-5329-4990-a334-913056b1b2a6 tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] Flavor limits 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 09:30:41 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-050994fc-5329-4990-a334-913056b1b2a6 tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] Image limits 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 09:30:41 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-050994fc-5329-4990-a334-913056b1b2a6 tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] Flavor pref 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 09:30:41 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-050994fc-5329-4990-a334-913056b1b2a6 tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] Image pref 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 09:30:41 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-050994fc-5329-4990-a334-913056b1b2a6 tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 09:30:41 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-050994fc-5329-4990-a334-913056b1b2a6 tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 09:30:41 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-050994fc-5329-4990-a334-913056b1b2a6 tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75122) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 09:30:41 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-050994fc-5329-4990-a334-913056b1b2a6 tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] Got 1 possible topologies {{(pid=75122) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 09:30:41 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-050994fc-5329-4990-a334-913056b1b2a6 tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 09:30:41 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-050994fc-5329-4990-a334-913056b1b2a6 tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 09:30:41 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-050994fc-5329-4990-a334-913056b1b2a6 tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T09:30:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-109023246',display_name='tempest-TestVolumeSwap-server-109023246',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-109023246',id=6,image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPjVTLKp57X6oorWlUoavF2XMowkDqBXUpMMJ2lneVFHzF0SZygQDqW0l8RTdum5zUM8oBkAi/pdcjiyjyhsBVRhHsPo9kc6bVi2kAo27F+RdsXfEDR4KbXMJLn1mCjAMQ==',key_name='tempest-keypair-1858606583',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e0044b15c211422c8fe109af97ce4082',ramdisk_id='',reservation_id='r-gxgcihbz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-819573102',owner_user_name='tempest-TestVolumeSwap-819573102-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T09:30:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='015d0c9a02d247b9afec711822f2dc2d',uuid=d24a189e-2de9-404e-b281-224c150a5bbf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5439a285-9a24-4c8e-a9d0-4e7c773f9e60", "address": "fa:16:3e:bd:9c:6c", "network": {"id": "7c08103d-8c2a-4613-8c0b-e3ed4568332a", "bridge": "br-int", "label": "tempest-TestVolumeSwap-36009092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0044b15c211422c8fe109af97ce4082", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5439a285-9a", "ovs_interfaceid": "5439a285-9a24-4c8e-a9d0-4e7c773f9e60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75122) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 09:30:41 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-050994fc-5329-4990-a334-913056b1b2a6 tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] Converting VIF {"id": "5439a285-9a24-4c8e-a9d0-4e7c773f9e60", "address": "fa:16:3e:bd:9c:6c", "network": {"id": "7c08103d-8c2a-4613-8c0b-e3ed4568332a", "bridge": "br-int", "label": "tempest-TestVolumeSwap-36009092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0044b15c211422c8fe109af97ce4082", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5439a285-9a", "ovs_interfaceid": "5439a285-9a24-4c8e-a9d0-4e7c773f9e60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 09:30:41 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-050994fc-5329-4990-a334-913056b1b2a6 tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:9c:6c,bridge_name='br-int',has_traffic_filtering=True,id=5439a285-9a24-4c8e-a9d0-4e7c773f9e60,network=Network(7c08103d-8c2a-4613-8c0b-e3ed4568332a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5439a285-9a') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 09:30:41 user nova-compute[75122]: DEBUG nova.objects.instance [None req-050994fc-5329-4990-a334-913056b1b2a6 tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] Lazy-loading 'pci_devices' on Instance uuid d24a189e-2de9-404e-b281-224c150a5bbf {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:30:41 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-050994fc-5329-4990-a334-913056b1b2a6 tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] [instance: d24a189e-2de9-404e-b281-224c150a5bbf] End _get_guest_xml xml=<domain type="kvm">
Nov 15 09:30:41 user nova-compute[75122]:   <uuid>d24a189e-2de9-404e-b281-224c150a5bbf</uuid>
Nov 15 09:30:41 user nova-compute[75122]:   <name>instance-00000006</name>
Nov 15 09:30:41 user nova-compute[75122]:   <memory>524288</memory>
Nov 15 09:30:41 user nova-compute[75122]:   <vcpu>1</vcpu>
Nov 15 09:30:41 user nova-compute[75122]:   <metadata>
Nov 15 09:30:41 user nova-compute[75122]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 09:30:41 user nova-compute[75122]:       <nova:package version="0.0.0"/>
Nov 15 09:30:41 user nova-compute[75122]:       <nova:name>tempest-TestVolumeSwap-server-109023246</nova:name>
Nov 15 09:30:41 user nova-compute[75122]:       <nova:creationTime>2023-11-15 09:30:41</nova:creationTime>
Nov 15 09:30:41 user nova-compute[75122]:       <nova:flavor name="m1.tiny">
Nov 15 09:30:41 user nova-compute[75122]:         <nova:memory>512</nova:memory>
Nov 15 09:30:41 user nova-compute[75122]:         <nova:disk>1</nova:disk>
Nov 15 09:30:41 user nova-compute[75122]:         <nova:swap>0</nova:swap>
Nov 15 09:30:41 user nova-compute[75122]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 09:30:41 user nova-compute[75122]:         <nova:vcpus>1</nova:vcpus>
Nov 15 09:30:41 user nova-compute[75122]:       </nova:flavor>
Nov 15 09:30:41 user nova-compute[75122]:       <nova:owner>
Nov 15 09:30:41 user nova-compute[75122]:         <nova:user uuid="015d0c9a02d247b9afec711822f2dc2d">tempest-TestVolumeSwap-819573102-project-member</nova:user>
Nov 15 09:30:41 user nova-compute[75122]:         <nova:project uuid="e0044b15c211422c8fe109af97ce4082">tempest-TestVolumeSwap-819573102</nova:project>
Nov 15 09:30:41 user nova-compute[75122]:       </nova:owner>
Nov 15 09:30:41 user nova-compute[75122]:       <nova:root type="image" uuid="5e862cfe-47b8-4725-8292-65761ee6d0f5"/>
Nov 15 09:30:41 user nova-compute[75122]:       <nova:ports>
Nov 15 09:30:41 user nova-compute[75122]:         <nova:port uuid="5439a285-9a24-4c8e-a9d0-4e7c773f9e60">
Nov 15 09:30:41 user nova-compute[75122]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 15 09:30:41 user nova-compute[75122]:         </nova:port>
Nov 15 09:30:41 user nova-compute[75122]:       </nova:ports>
Nov 15 09:30:41 user nova-compute[75122]:     </nova:instance>
Nov 15 09:30:41 user nova-compute[75122]:   </metadata>
Nov 15 09:30:41 user nova-compute[75122]:   <sysinfo type="smbios">
Nov 15 09:30:41 user nova-compute[75122]:     <system>
Nov 15 09:30:41 user nova-compute[75122]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 09:30:41 user nova-compute[75122]:       <entry name="product">OpenStack Nova</entry>
Nov 15 09:30:41 user nova-compute[75122]:       <entry name="version">0.0.0</entry>
Nov 15 09:30:41 user nova-compute[75122]:       <entry name="serial">d24a189e-2de9-404e-b281-224c150a5bbf</entry>
Nov 15 09:30:41 user nova-compute[75122]:       <entry name="uuid">d24a189e-2de9-404e-b281-224c150a5bbf</entry>
Nov 15 09:30:41 user nova-compute[75122]:       <entry name="family">Virtual Machine</entry>
Nov 15 09:30:41 user nova-compute[75122]:     </system>
Nov 15 09:30:41 user nova-compute[75122]:   </sysinfo>
Nov 15 09:30:41 user nova-compute[75122]:   <os>
Nov 15 09:30:41 user nova-compute[75122]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 09:30:41 user nova-compute[75122]:     <boot dev="hd"/>
Nov 15 09:30:41 user nova-compute[75122]:     <smbios mode="sysinfo"/>
Nov 15 09:30:41 user nova-compute[75122]:   </os>
Nov 15 09:30:41 user nova-compute[75122]:   <features>
Nov 15 09:30:41 user nova-compute[75122]:     <acpi/>
Nov 15 09:30:41 user nova-compute[75122]:     <apic/>
Nov 15 09:30:41 user nova-compute[75122]:     <vmcoreinfo/>
Nov 15 09:30:41 user nova-compute[75122]:   </features>
Nov 15 09:30:41 user nova-compute[75122]:   <clock offset="utc">
Nov 15 09:30:41 user nova-compute[75122]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 09:30:41 user nova-compute[75122]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 09:30:41 user nova-compute[75122]:     <timer name="hpet" present="no"/>
Nov 15 09:30:41 user nova-compute[75122]:   </clock>
Nov 15 09:30:41 user nova-compute[75122]:   <cpu mode="custom" match="exact">
Nov 15 09:30:41 user nova-compute[75122]:     <model>Nehalem</model>
Nov 15 09:30:41 user nova-compute[75122]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 09:30:41 user nova-compute[75122]:   </cpu>
Nov 15 09:30:41 user nova-compute[75122]:   <devices>
Nov 15 09:30:41 user nova-compute[75122]:     <disk type="file" device="disk">
Nov 15 09:30:41 user nova-compute[75122]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 09:30:41 user nova-compute[75122]:       <source file="/opt/stack/data/nova/instances/d24a189e-2de9-404e-b281-224c150a5bbf/disk"/>
Nov 15 09:30:41 user nova-compute[75122]:       <target dev="vda" bus="virtio"/>
Nov 15 09:30:41 user nova-compute[75122]:     </disk>
Nov 15 09:30:41 user nova-compute[75122]:     <interface type="ethernet">
Nov 15 09:30:41 user nova-compute[75122]:       <mac address="fa:16:3e:bd:9c:6c"/>
Nov 15 09:30:41 user nova-compute[75122]:       <model type="virtio"/>
Nov 15 09:30:41 user nova-compute[75122]:       <mtu size="1442"/>
Nov 15 09:30:41 user nova-compute[75122]:       <target dev="tap5439a285-9a"/>
Nov 15 09:30:41 user nova-compute[75122]:     </interface>
Nov 15 09:30:41 user nova-compute[75122]:     <serial type="pty">
Nov 15 09:30:41 user nova-compute[75122]:       <log file="/opt/stack/data/nova/instances/d24a189e-2de9-404e-b281-224c150a5bbf/console.log" append="off"/>
Nov 15 09:30:41 user nova-compute[75122]:     </serial>
Nov 15 09:30:41 user nova-compute[75122]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 09:30:41 user nova-compute[75122]:     <video>
Nov 15 09:30:41 user nova-compute[75122]:       <model type="virtio"/>
Nov 15 09:30:41 user nova-compute[75122]:     </video>
Nov 15 09:30:41 user nova-compute[75122]:     <rng model="virtio">
Nov 15 09:30:41 user nova-compute[75122]:       <backend model="random">/dev/urandom</backend>
Nov 15 09:30:41 user nova-compute[75122]:     </rng>
Nov 15 09:30:41 user nova-compute[75122]:     <controller type="usb" index="0" model="none"/>
Nov 15 09:30:41 user nova-compute[75122]:     <memballoon model="virtio">
Nov 15 09:30:41 user nova-compute[75122]:       <stats period="10"/>
Nov 15 09:30:41 user nova-compute[75122]:     </memballoon>
Nov 15 09:30:41 user nova-compute[75122]:   </devices>
Nov 15 09:30:41 user nova-compute[75122]: </domain>
Nov 15 09:30:41 user nova-compute[75122]:  {{(pid=75122) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 09:30:41 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-050994fc-5329-4990-a334-913056b1b2a6 tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T09:30:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-109023246',display_name='tempest-TestVolumeSwap-server-109023246',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-109023246',id=6,image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPjVTLKp57X6oorWlUoavF2XMowkDqBXUpMMJ2lneVFHzF0SZygQDqW0l8RTdum5zUM8oBkAi/pdcjiyjyhsBVRhHsPo9kc6bVi2kAo27F+RdsXfEDR4KbXMJLn1mCjAMQ==',key_name='tempest-keypair-1858606583',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e0044b15c211422c8fe109af97ce4082',ramdisk_id='',reservation_id='r-gxgcihbz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-819573102',owner_user_name='tempest-TestVolumeSwap-819573102-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T09:30:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='015d0c9a02d247b9afec711822f2dc2d',uuid=d24a189e-2de9-404e-b281-224c150a5bbf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5439a285-9a24-4c8e-a9d0-4e7c773f9e60", "address": "fa:16:3e:bd:9c:6c", "network": {"id": "7c08103d-8c2a-4613-8c0b-e3ed4568332a", "bridge": "br-int", "label": "tempest-TestVolumeSwap-36009092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0044b15c211422c8fe109af97ce4082", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5439a285-9a", "ovs_interfaceid": "5439a285-9a24-4c8e-a9d0-4e7c773f9e60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 09:30:41 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-050994fc-5329-4990-a334-913056b1b2a6 tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] Converting VIF {"id": "5439a285-9a24-4c8e-a9d0-4e7c773f9e60", "address": "fa:16:3e:bd:9c:6c", "network": {"id": "7c08103d-8c2a-4613-8c0b-e3ed4568332a", "bridge": "br-int", "label": "tempest-TestVolumeSwap-36009092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0044b15c211422c8fe109af97ce4082", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5439a285-9a", "ovs_interfaceid": "5439a285-9a24-4c8e-a9d0-4e7c773f9e60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 09:30:41 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-050994fc-5329-4990-a334-913056b1b2a6 tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:9c:6c,bridge_name='br-int',has_traffic_filtering=True,id=5439a285-9a24-4c8e-a9d0-4e7c773f9e60,network=Network(7c08103d-8c2a-4613-8c0b-e3ed4568332a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5439a285-9a') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 09:30:41 user nova-compute[75122]: DEBUG os_vif [None req-050994fc-5329-4990-a334-913056b1b2a6 tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:9c:6c,bridge_name='br-int',has_traffic_filtering=True,id=5439a285-9a24-4c8e-a9d0-4e7c773f9e60,network=Network(7c08103d-8c2a-4613-8c0b-e3ed4568332a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5439a285-9a') {{(pid=75122) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 09:30:41 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:30:41 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:30:41 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 09:30:41 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:30:41 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5b104bd8-c6b3-53e0-be5c-cb08d59ce6bc', '_type': 'linux-noop'}}, row=False) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:30:41 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:30:41 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:30:41 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:30:41 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5439a285-9a, may_exist=True, interface_attrs={}) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:30:41 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5439a285-9a, col_values=(('qos', UUID('15638ecf-f84d-45a1-9b10-837e0b83578c')),), if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:30:41 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5439a285-9a, col_values=(('external_ids', {'iface-id': '5439a285-9a24-4c8e-a9d0-4e7c773f9e60', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bd:9c:6c', 'vm-uuid': 'd24a189e-2de9-404e-b281-224c150a5bbf'}),), if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:30:41 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:30:41 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:30:41 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:30:41 user nova-compute[75122]: INFO os_vif [None req-050994fc-5329-4990-a334-913056b1b2a6 tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:9c:6c,bridge_name='br-int',has_traffic_filtering=True,id=5439a285-9a24-4c8e-a9d0-4e7c773f9e60,network=Network(7c08103d-8c2a-4613-8c0b-e3ed4568332a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5439a285-9a')
Nov 15 09:30:42 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-050994fc-5329-4990-a334-913056b1b2a6 tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] No BDM found with device name vda, not building metadata. {{(pid=75122) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 09:30:42 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-050994fc-5329-4990-a334-913056b1b2a6 tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] No VIF found with MAC fa:16:3e:bd:9c:6c, not building metadata {{(pid=75122) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 09:30:42 user nova-compute[75122]: DEBUG nova.compute.provider_tree [None req-578a8905-0cc1-4a64-b7ad-18c4ce3f60f8 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] Inventory has not changed in ProviderTree for provider: 69a3da65-47be-44c6-b67c-c692b58284ef {{(pid=75122) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 09:30:42 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-578a8905-0cc1-4a64-b7ad-18c4ce3f60f8 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] Inventory has not changed for provider 69a3da65-47be-44c6-b67c-c692b58284ef based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 09:30:42 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-578a8905-0cc1-4a64-b7ad-18c4ce3f60f8 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.874s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:30:42 user nova-compute[75122]: DEBUG nova.compute.manager [None req-578a8905-0cc1-4a64-b7ad-18c4ce3f60f8 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] [instance: fa52b2a0-e5a0-4f93-a1cf-fef4a8313368] Start building networks asynchronously for instance. {{(pid=75122) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 09:30:42 user nova-compute[75122]: DEBUG nova.compute.manager [None req-578a8905-0cc1-4a64-b7ad-18c4ce3f60f8 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] [instance: fa52b2a0-e5a0-4f93-a1cf-fef4a8313368] Allocating IP information in the background. {{(pid=75122) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 09:30:42 user nova-compute[75122]: DEBUG nova.network.neutron [None req-578a8905-0cc1-4a64-b7ad-18c4ce3f60f8 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] [instance: fa52b2a0-e5a0-4f93-a1cf-fef4a8313368] allocate_for_instance() {{(pid=75122) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 09:30:42 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-578a8905-0cc1-4a64-b7ad-18c4ce3f60f8 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] [instance: fa52b2a0-e5a0-4f93-a1cf-fef4a8313368] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 09:30:42 user nova-compute[75122]: DEBUG nova.compute.manager [None req-578a8905-0cc1-4a64-b7ad-18c4ce3f60f8 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] [instance: fa52b2a0-e5a0-4f93-a1cf-fef4a8313368] Start building block device mappings for instance. {{(pid=75122) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 09:30:42 user nova-compute[75122]: DEBUG nova.network.neutron [req-23a1f479-4f21-466b-aa71-4b552ab960fc req-94a228fe-d0da-4d1f-80ce-f2fa38e192cf service nova] [instance: d24a189e-2de9-404e-b281-224c150a5bbf] Updated VIF entry in instance network info cache for port 5439a285-9a24-4c8e-a9d0-4e7c773f9e60. {{(pid=75122) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 09:30:42 user nova-compute[75122]: DEBUG nova.network.neutron [req-23a1f479-4f21-466b-aa71-4b552ab960fc req-94a228fe-d0da-4d1f-80ce-f2fa38e192cf service nova] [instance: d24a189e-2de9-404e-b281-224c150a5bbf] Updating instance_info_cache with network_info: [{"id": "5439a285-9a24-4c8e-a9d0-4e7c773f9e60", "address": "fa:16:3e:bd:9c:6c", "network": {"id": "7c08103d-8c2a-4613-8c0b-e3ed4568332a", "bridge": "br-int", "label": "tempest-TestVolumeSwap-36009092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0044b15c211422c8fe109af97ce4082", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5439a285-9a", "ovs_interfaceid": "5439a285-9a24-4c8e-a9d0-4e7c773f9e60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:30:42 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-23a1f479-4f21-466b-aa71-4b552ab960fc req-94a228fe-d0da-4d1f-80ce-f2fa38e192cf service nova] Releasing lock "refresh_cache-d24a189e-2de9-404e-b281-224c150a5bbf" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 09:30:42 user nova-compute[75122]: DEBUG nova.policy [None req-578a8905-0cc1-4a64-b7ad-18c4ce3f60f8 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a3ce318b93394200a80ba72ec74c321e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af984d06e5340f8a65a54a806c7c88a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75122) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 09:30:42 user nova-compute[75122]: DEBUG nova.compute.manager [None req-578a8905-0cc1-4a64-b7ad-18c4ce3f60f8 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] [instance: fa52b2a0-e5a0-4f93-a1cf-fef4a8313368] Start spawning the instance on the hypervisor. {{(pid=75122) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 09:30:42 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-578a8905-0cc1-4a64-b7ad-18c4ce3f60f8 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] [instance: fa52b2a0-e5a0-4f93-a1cf-fef4a8313368] Creating instance directory {{(pid=75122) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 09:30:42 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-578a8905-0cc1-4a64-b7ad-18c4ce3f60f8 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] [instance: fa52b2a0-e5a0-4f93-a1cf-fef4a8313368] Creating image(s)
Nov 15 09:30:42 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-578a8905-0cc1-4a64-b7ad-18c4ce3f60f8 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] Acquiring lock "/opt/stack/data/nova/instances/fa52b2a0-e5a0-4f93-a1cf-fef4a8313368/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:30:42 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-578a8905-0cc1-4a64-b7ad-18c4ce3f60f8 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] Lock "/opt/stack/data/nova/instances/fa52b2a0-e5a0-4f93-a1cf-fef4a8313368/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:30:42 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-578a8905-0cc1-4a64-b7ad-18c4ce3f60f8 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] Lock "/opt/stack/data/nova/instances/fa52b2a0-e5a0-4f93-a1cf-fef4a8313368/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:30:42 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-578a8905-0cc1-4a64-b7ad-18c4ce3f60f8 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:30:42 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-578a8905-0cc1-4a64-b7ad-18c4ce3f60f8 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json" returned: 0 in 0.251s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:30:42 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-578a8905-0cc1-4a64-b7ad-18c4ce3f60f8 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] Acquiring lock "95d6e29f74d5408f818e32f3bc29bc8270a4c665" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:30:42 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-578a8905-0cc1-4a64-b7ad-18c4ce3f60f8 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] Lock "95d6e29f74d5408f818e32f3bc29bc8270a4c665" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:30:42 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-578a8905-0cc1-4a64-b7ad-18c4ce3f60f8 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:30:43 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-578a8905-0cc1-4a64-b7ad-18c4ce3f60f8 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json" returned: 0 in 0.309s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:30:43 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-578a8905-0cc1-4a64-b7ad-18c4ce3f60f8 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665,backing_fmt=raw /opt/stack/data/nova/instances/fa52b2a0-e5a0-4f93-a1cf-fef4a8313368/disk 1073741824 {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:30:43 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-578a8905-0cc1-4a64-b7ad-18c4ce3f60f8 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665,backing_fmt=raw /opt/stack/data/nova/instances/fa52b2a0-e5a0-4f93-a1cf-fef4a8313368/disk 1073741824" returned: 0 in 0.073s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:30:43 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-578a8905-0cc1-4a64-b7ad-18c4ce3f60f8 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] Lock "95d6e29f74d5408f818e32f3bc29bc8270a4c665" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.395s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:30:43 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-578a8905-0cc1-4a64-b7ad-18c4ce3f60f8 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:30:43 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-578a8905-0cc1-4a64-b7ad-18c4ce3f60f8 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json" returned: 0 in 0.322s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:30:43 user nova-compute[75122]: DEBUG nova.virt.disk.api [None req-578a8905-0cc1-4a64-b7ad-18c4ce3f60f8 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fa52b2a0-e5a0-4f93-a1cf-fef4a8313368/disk. size=1073741824 {{(pid=75122) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 09:30:43 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-578a8905-0cc1-4a64-b7ad-18c4ce3f60f8 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa52b2a0-e5a0-4f93-a1cf-fef4a8313368/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:30:43 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:30:43 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:30:43 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:30:43 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-578a8905-0cc1-4a64-b7ad-18c4ce3f60f8 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa52b2a0-e5a0-4f93-a1cf-fef4a8313368/disk --force-share --output=json" returned: 0 in 0.277s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:30:43 user nova-compute[75122]: DEBUG nova.virt.disk.api [None req-578a8905-0cc1-4a64-b7ad-18c4ce3f60f8 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] Cannot resize image /opt/stack/data/nova/instances/fa52b2a0-e5a0-4f93-a1cf-fef4a8313368/disk to a smaller size. {{(pid=75122) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 09:30:43 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-578a8905-0cc1-4a64-b7ad-18c4ce3f60f8 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] [instance: fa52b2a0-e5a0-4f93-a1cf-fef4a8313368] Created local disks {{(pid=75122) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 09:30:43 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-578a8905-0cc1-4a64-b7ad-18c4ce3f60f8 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] [instance: fa52b2a0-e5a0-4f93-a1cf-fef4a8313368] Ensure instance console log exists: /opt/stack/data/nova/instances/fa52b2a0-e5a0-4f93-a1cf-fef4a8313368/console.log {{(pid=75122) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 09:30:43 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-578a8905-0cc1-4a64-b7ad-18c4ce3f60f8 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:30:43 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-578a8905-0cc1-4a64-b7ad-18c4ce3f60f8 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:30:43 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-578a8905-0cc1-4a64-b7ad-18c4ce3f60f8 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:30:43 user nova-compute[75122]: DEBUG nova.network.neutron [None req-578a8905-0cc1-4a64-b7ad-18c4ce3f60f8 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] [instance: fa52b2a0-e5a0-4f93-a1cf-fef4a8313368] Successfully created port: 942f4024-43e2-4488-a7fd-c9de9bab7162 {{(pid=75122) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 09:30:44 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:30:44 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:30:44 user nova-compute[75122]: DEBUG nova.compute.manager [req-e423472c-5ecf-4e59-8938-43777fbe6ae1 req-a47ccc1e-a158-47de-b0f8-8a0bb40318b4 service nova] [instance: d24a189e-2de9-404e-b281-224c150a5bbf] Received event network-vif-plugged-5439a285-9a24-4c8e-a9d0-4e7c773f9e60 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:30:44 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-e423472c-5ecf-4e59-8938-43777fbe6ae1 req-a47ccc1e-a158-47de-b0f8-8a0bb40318b4 service nova] Acquiring lock "d24a189e-2de9-404e-b281-224c150a5bbf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:30:44 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-e423472c-5ecf-4e59-8938-43777fbe6ae1 req-a47ccc1e-a158-47de-b0f8-8a0bb40318b4 service nova] Lock "d24a189e-2de9-404e-b281-224c150a5bbf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:30:44 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-e423472c-5ecf-4e59-8938-43777fbe6ae1 req-a47ccc1e-a158-47de-b0f8-8a0bb40318b4 service nova] Lock "d24a189e-2de9-404e-b281-224c150a5bbf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:30:44 user nova-compute[75122]: DEBUG nova.compute.manager [req-e423472c-5ecf-4e59-8938-43777fbe6ae1 req-a47ccc1e-a158-47de-b0f8-8a0bb40318b4 service nova] [instance: d24a189e-2de9-404e-b281-224c150a5bbf] No waiting events found dispatching network-vif-plugged-5439a285-9a24-4c8e-a9d0-4e7c773f9e60 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:30:44 user nova-compute[75122]: WARNING nova.compute.manager [req-e423472c-5ecf-4e59-8938-43777fbe6ae1 req-a47ccc1e-a158-47de-b0f8-8a0bb40318b4 service nova] [instance: d24a189e-2de9-404e-b281-224c150a5bbf] Received unexpected event network-vif-plugged-5439a285-9a24-4c8e-a9d0-4e7c773f9e60 for instance with vm_state building and task_state spawning.
Nov 15 09:30:44 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:30:44 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:30:45 user nova-compute[75122]: DEBUG nova.network.neutron [None req-578a8905-0cc1-4a64-b7ad-18c4ce3f60f8 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] [instance: fa52b2a0-e5a0-4f93-a1cf-fef4a8313368] Successfully updated port: 942f4024-43e2-4488-a7fd-c9de9bab7162 {{(pid=75122) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 09:30:45 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-578a8905-0cc1-4a64-b7ad-18c4ce3f60f8 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] Acquiring lock "refresh_cache-fa52b2a0-e5a0-4f93-a1cf-fef4a8313368" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 09:30:45 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-578a8905-0cc1-4a64-b7ad-18c4ce3f60f8 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] Acquired lock "refresh_cache-fa52b2a0-e5a0-4f93-a1cf-fef4a8313368" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 09:30:45 user nova-compute[75122]: DEBUG nova.network.neutron [None req-578a8905-0cc1-4a64-b7ad-18c4ce3f60f8 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] [instance: fa52b2a0-e5a0-4f93-a1cf-fef4a8313368] Building network info cache for instance {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 09:30:45 user nova-compute[75122]: DEBUG nova.compute.manager [req-d22e8183-6e6d-450f-838d-417224bdc4cc req-24d4547a-9c01-4aef-b24b-3eef2fc27c80 service nova] [instance: fa52b2a0-e5a0-4f93-a1cf-fef4a8313368] Received event network-changed-942f4024-43e2-4488-a7fd-c9de9bab7162 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:30:45 user nova-compute[75122]: DEBUG nova.compute.manager [req-d22e8183-6e6d-450f-838d-417224bdc4cc req-24d4547a-9c01-4aef-b24b-3eef2fc27c80 service nova] [instance: fa52b2a0-e5a0-4f93-a1cf-fef4a8313368] Refreshing instance network info cache due to event network-changed-942f4024-43e2-4488-a7fd-c9de9bab7162. {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 09:30:45 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-d22e8183-6e6d-450f-838d-417224bdc4cc req-24d4547a-9c01-4aef-b24b-3eef2fc27c80 service nova] Acquiring lock "refresh_cache-fa52b2a0-e5a0-4f93-a1cf-fef4a8313368" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 09:30:45 user nova-compute[75122]: DEBUG nova.network.neutron [None req-578a8905-0cc1-4a64-b7ad-18c4ce3f60f8 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] [instance: fa52b2a0-e5a0-4f93-a1cf-fef4a8313368] Instance cache missing network info. {{(pid=75122) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 09:30:45 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:30:46 user nova-compute[75122]: DEBUG nova.network.neutron [None req-578a8905-0cc1-4a64-b7ad-18c4ce3f60f8 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] [instance: fa52b2a0-e5a0-4f93-a1cf-fef4a8313368] Updating instance_info_cache with network_info: [{"id": "942f4024-43e2-4488-a7fd-c9de9bab7162", "address": "fa:16:3e:3a:68:1c", "network": {"id": "48c8af75-6a89-441b-8e4a-8c7186006537", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2172147-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9af984d06e5340f8a65a54a806c7c88a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap942f4024-43", "ovs_interfaceid": "942f4024-43e2-4488-a7fd-c9de9bab7162", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:30:46 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-578a8905-0cc1-4a64-b7ad-18c4ce3f60f8 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] Releasing lock "refresh_cache-fa52b2a0-e5a0-4f93-a1cf-fef4a8313368" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 09:30:46 user nova-compute[75122]: DEBUG nova.compute.manager [None req-578a8905-0cc1-4a64-b7ad-18c4ce3f60f8 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] [instance: fa52b2a0-e5a0-4f93-a1cf-fef4a8313368] Instance network_info: |[{"id": "942f4024-43e2-4488-a7fd-c9de9bab7162", "address": "fa:16:3e:3a:68:1c", "network": {"id": "48c8af75-6a89-441b-8e4a-8c7186006537", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2172147-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9af984d06e5340f8a65a54a806c7c88a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap942f4024-43", "ovs_interfaceid": "942f4024-43e2-4488-a7fd-c9de9bab7162", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75122) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 09:30:46 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-d22e8183-6e6d-450f-838d-417224bdc4cc req-24d4547a-9c01-4aef-b24b-3eef2fc27c80 service nova] Acquired lock "refresh_cache-fa52b2a0-e5a0-4f93-a1cf-fef4a8313368" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 09:30:46 user nova-compute[75122]: DEBUG nova.network.neutron [req-d22e8183-6e6d-450f-838d-417224bdc4cc req-24d4547a-9c01-4aef-b24b-3eef2fc27c80 service nova] [instance: fa52b2a0-e5a0-4f93-a1cf-fef4a8313368] Refreshing network info cache for port 942f4024-43e2-4488-a7fd-c9de9bab7162 {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 09:30:46 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-578a8905-0cc1-4a64-b7ad-18c4ce3f60f8 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] [instance: fa52b2a0-e5a0-4f93-a1cf-fef4a8313368] Start _get_guest_xml network_info=[{"id": "942f4024-43e2-4488-a7fd-c9de9bab7162", "address": "fa:16:3e:3a:68:1c", "network": {"id": "48c8af75-6a89-441b-8e4a-8c7186006537", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2172147-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9af984d06e5340f8a65a54a806c7c88a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap942f4024-43", "ovs_interfaceid": "942f4024-43e2-4488-a7fd-c9de9bab7162", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T09:26:31Z,direct_url=<?>,disk_format='qcow2',id=5e862cfe-47b8-4725-8292-65761ee6d0f5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9c57733cb41847c0b4ad31519c382e5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T09:26:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '5e862cfe-47b8-4725-8292-65761ee6d0f5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75122) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 09:30:46 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-578a8905-0cc1-4a64-b7ad-18c4ce3f60f8 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 09:30:46 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-578a8905-0cc1-4a64-b7ad-18c4ce3f60f8 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 09:30:46 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-578a8905-0cc1-4a64-b7ad-18c4ce3f60f8 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75122) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 09:30:46 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-578a8905-0cc1-4a64-b7ad-18c4ce3f60f8 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] CPU controller missing on host. {{(pid=75122) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 09:30:46 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-578a8905-0cc1-4a64-b7ad-18c4ce3f60f8 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75122) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 09:30:46 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-578a8905-0cc1-4a64-b7ad-18c4ce3f60f8 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] CPU controller found on host. {{(pid=75122) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 09:30:46 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-578a8905-0cc1-4a64-b7ad-18c4ce3f60f8 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75122) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 09:30:46 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-578a8905-0cc1-4a64-b7ad-18c4ce3f60f8 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T09:26:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T09:26:31Z,direct_url=<?>,disk_format='qcow2',id=5e862cfe-47b8-4725-8292-65761ee6d0f5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9c57733cb41847c0b4ad31519c382e5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T09:26:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 09:30:46 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-578a8905-0cc1-4a64-b7ad-18c4ce3f60f8 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] Flavor limits 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 09:30:46 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-578a8905-0cc1-4a64-b7ad-18c4ce3f60f8 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] Image limits 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 09:30:46 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-578a8905-0cc1-4a64-b7ad-18c4ce3f60f8 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] Flavor pref 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 09:30:46 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-578a8905-0cc1-4a64-b7ad-18c4ce3f60f8 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] Image pref 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 09:30:46 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-578a8905-0cc1-4a64-b7ad-18c4ce3f60f8 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 09:30:46 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-578a8905-0cc1-4a64-b7ad-18c4ce3f60f8 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 09:30:46 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-578a8905-0cc1-4a64-b7ad-18c4ce3f60f8 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75122) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 09:30:46 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-578a8905-0cc1-4a64-b7ad-18c4ce3f60f8 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] Got 1 possible topologies {{(pid=75122) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 09:30:46 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-578a8905-0cc1-4a64-b7ad-18c4ce3f60f8 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 09:30:46 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-578a8905-0cc1-4a64-b7ad-18c4ce3f60f8 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 09:30:46 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-578a8905-0cc1-4a64-b7ad-18c4ce3f60f8 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T09:30:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-577581546',display_name='tempest-VolumesActionsTest-instance-577581546',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-577581546',id=7,image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9af984d06e5340f8a65a54a806c7c88a',ramdisk_id='',reservation_id='r-9jf7aepj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-915673420',owner_user_name='tempest-VolumesActionsTest-915673420-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T09:30:42Z,user_data=None,user_id='a3ce318b93394200a80ba72ec74c321e',uuid=fa52b2a0-e5a0-4f93-a1cf-fef4a8313368,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "942f4024-43e2-4488-a7fd-c9de9bab7162", "address": "fa:16:3e:3a:68:1c", "network": {"id": "48c8af75-6a89-441b-8e4a-8c7186006537", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2172147-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9af984d06e5340f8a65a54a806c7c88a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap942f4024-43", "ovs_interfaceid": "942f4024-43e2-4488-a7fd-c9de9bab7162", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75122) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 09:30:46 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-578a8905-0cc1-4a64-b7ad-18c4ce3f60f8 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] Converting VIF {"id": "942f4024-43e2-4488-a7fd-c9de9bab7162", "address": "fa:16:3e:3a:68:1c", "network": {"id": "48c8af75-6a89-441b-8e4a-8c7186006537", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2172147-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9af984d06e5340f8a65a54a806c7c88a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap942f4024-43", "ovs_interfaceid": "942f4024-43e2-4488-a7fd-c9de9bab7162", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 09:30:46 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-578a8905-0cc1-4a64-b7ad-18c4ce3f60f8 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:68:1c,bridge_name='br-int',has_traffic_filtering=True,id=942f4024-43e2-4488-a7fd-c9de9bab7162,network=Network(48c8af75-6a89-441b-8e4a-8c7186006537),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap942f4024-43') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 09:30:46 user nova-compute[75122]: DEBUG nova.objects.instance [None req-578a8905-0cc1-4a64-b7ad-18c4ce3f60f8 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] Lazy-loading 'pci_devices' on Instance uuid fa52b2a0-e5a0-4f93-a1cf-fef4a8313368 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:30:46 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-578a8905-0cc1-4a64-b7ad-18c4ce3f60f8 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] [instance: fa52b2a0-e5a0-4f93-a1cf-fef4a8313368] End _get_guest_xml xml=<domain type="kvm">
Nov 15 09:30:46 user nova-compute[75122]:   <uuid>fa52b2a0-e5a0-4f93-a1cf-fef4a8313368</uuid>
Nov 15 09:30:46 user nova-compute[75122]:   <name>instance-00000007</name>
Nov 15 09:30:46 user nova-compute[75122]:   <memory>524288</memory>
Nov 15 09:30:46 user nova-compute[75122]:   <vcpu>1</vcpu>
Nov 15 09:30:46 user nova-compute[75122]:   <metadata>
Nov 15 09:30:46 user nova-compute[75122]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 09:30:46 user nova-compute[75122]:       <nova:package version="0.0.0"/>
Nov 15 09:30:46 user nova-compute[75122]:       <nova:name>tempest-VolumesActionsTest-instance-577581546</nova:name>
Nov 15 09:30:46 user nova-compute[75122]:       <nova:creationTime>2023-11-15 09:30:46</nova:creationTime>
Nov 15 09:30:46 user nova-compute[75122]:       <nova:flavor name="m1.tiny">
Nov 15 09:30:46 user nova-compute[75122]:         <nova:memory>512</nova:memory>
Nov 15 09:30:46 user nova-compute[75122]:         <nova:disk>1</nova:disk>
Nov 15 09:30:46 user nova-compute[75122]:         <nova:swap>0</nova:swap>
Nov 15 09:30:46 user nova-compute[75122]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 09:30:46 user nova-compute[75122]:         <nova:vcpus>1</nova:vcpus>
Nov 15 09:30:46 user nova-compute[75122]:       </nova:flavor>
Nov 15 09:30:46 user nova-compute[75122]:       <nova:owner>
Nov 15 09:30:46 user nova-compute[75122]:         <nova:user uuid="a3ce318b93394200a80ba72ec74c321e">tempest-VolumesActionsTest-915673420-project-member</nova:user>
Nov 15 09:30:46 user nova-compute[75122]:         <nova:project uuid="9af984d06e5340f8a65a54a806c7c88a">tempest-VolumesActionsTest-915673420</nova:project>
Nov 15 09:30:46 user nova-compute[75122]:       </nova:owner>
Nov 15 09:30:46 user nova-compute[75122]:       <nova:root type="image" uuid="5e862cfe-47b8-4725-8292-65761ee6d0f5"/>
Nov 15 09:30:46 user nova-compute[75122]:       <nova:ports>
Nov 15 09:30:46 user nova-compute[75122]:         <nova:port uuid="942f4024-43e2-4488-a7fd-c9de9bab7162">
Nov 15 09:30:46 user nova-compute[75122]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 15 09:30:46 user nova-compute[75122]:         </nova:port>
Nov 15 09:30:46 user nova-compute[75122]:       </nova:ports>
Nov 15 09:30:46 user nova-compute[75122]:     </nova:instance>
Nov 15 09:30:46 user nova-compute[75122]:   </metadata>
Nov 15 09:30:46 user nova-compute[75122]:   <sysinfo type="smbios">
Nov 15 09:30:46 user nova-compute[75122]:     <system>
Nov 15 09:30:46 user nova-compute[75122]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 09:30:46 user nova-compute[75122]:       <entry name="product">OpenStack Nova</entry>
Nov 15 09:30:46 user nova-compute[75122]:       <entry name="version">0.0.0</entry>
Nov 15 09:30:46 user nova-compute[75122]:       <entry name="serial">fa52b2a0-e5a0-4f93-a1cf-fef4a8313368</entry>
Nov 15 09:30:46 user nova-compute[75122]:       <entry name="uuid">fa52b2a0-e5a0-4f93-a1cf-fef4a8313368</entry>
Nov 15 09:30:46 user nova-compute[75122]:       <entry name="family">Virtual Machine</entry>
Nov 15 09:30:46 user nova-compute[75122]:     </system>
Nov 15 09:30:46 user nova-compute[75122]:   </sysinfo>
Nov 15 09:30:46 user nova-compute[75122]:   <os>
Nov 15 09:30:46 user nova-compute[75122]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 09:30:46 user nova-compute[75122]:     <boot dev="hd"/>
Nov 15 09:30:46 user nova-compute[75122]:     <smbios mode="sysinfo"/>
Nov 15 09:30:46 user nova-compute[75122]:   </os>
Nov 15 09:30:46 user nova-compute[75122]:   <features>
Nov 15 09:30:46 user nova-compute[75122]:     <acpi/>
Nov 15 09:30:46 user nova-compute[75122]:     <apic/>
Nov 15 09:30:46 user nova-compute[75122]:     <vmcoreinfo/>
Nov 15 09:30:46 user nova-compute[75122]:   </features>
Nov 15 09:30:46 user nova-compute[75122]:   <clock offset="utc">
Nov 15 09:30:46 user nova-compute[75122]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 09:30:46 user nova-compute[75122]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 09:30:46 user nova-compute[75122]:     <timer name="hpet" present="no"/>
Nov 15 09:30:46 user nova-compute[75122]:   </clock>
Nov 15 09:30:46 user nova-compute[75122]:   <cpu mode="custom" match="exact">
Nov 15 09:30:46 user nova-compute[75122]:     <model>Nehalem</model>
Nov 15 09:30:46 user nova-compute[75122]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 09:30:46 user nova-compute[75122]:   </cpu>
Nov 15 09:30:46 user nova-compute[75122]:   <devices>
Nov 15 09:30:46 user nova-compute[75122]:     <disk type="file" device="disk">
Nov 15 09:30:46 user nova-compute[75122]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 09:30:46 user nova-compute[75122]:       <source file="/opt/stack/data/nova/instances/fa52b2a0-e5a0-4f93-a1cf-fef4a8313368/disk"/>
Nov 15 09:30:46 user nova-compute[75122]:       <target dev="vda" bus="virtio"/>
Nov 15 09:30:46 user nova-compute[75122]:     </disk>
Nov 15 09:30:46 user nova-compute[75122]:     <interface type="ethernet">
Nov 15 09:30:46 user nova-compute[75122]:       <mac address="fa:16:3e:3a:68:1c"/>
Nov 15 09:30:46 user nova-compute[75122]:       <model type="virtio"/>
Nov 15 09:30:46 user nova-compute[75122]:       <mtu size="1442"/>
Nov 15 09:30:46 user nova-compute[75122]:       <target dev="tap942f4024-43"/>
Nov 15 09:30:46 user nova-compute[75122]:     </interface>
Nov 15 09:30:46 user nova-compute[75122]:     <serial type="pty">
Nov 15 09:30:46 user nova-compute[75122]:       <log file="/opt/stack/data/nova/instances/fa52b2a0-e5a0-4f93-a1cf-fef4a8313368/console.log" append="off"/>
Nov 15 09:30:46 user nova-compute[75122]:     </serial>
Nov 15 09:30:46 user nova-compute[75122]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 09:30:46 user nova-compute[75122]:     <video>
Nov 15 09:30:46 user nova-compute[75122]:       <model type="virtio"/>
Nov 15 09:30:46 user nova-compute[75122]:     </video>
Nov 15 09:30:46 user nova-compute[75122]:     <rng model="virtio">
Nov 15 09:30:46 user nova-compute[75122]:       <backend model="random">/dev/urandom</backend>
Nov 15 09:30:46 user nova-compute[75122]:     </rng>
Nov 15 09:30:46 user nova-compute[75122]:     <controller type="usb" index="0" model="none"/>
Nov 15 09:30:46 user nova-compute[75122]:     <memballoon model="virtio">
Nov 15 09:30:46 user nova-compute[75122]:       <stats period="10"/>
Nov 15 09:30:46 user nova-compute[75122]:     </memballoon>
Nov 15 09:30:46 user nova-compute[75122]:   </devices>
Nov 15 09:30:46 user nova-compute[75122]: </domain>
Nov 15 09:30:46 user nova-compute[75122]:  {{(pid=75122) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 09:30:46 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-578a8905-0cc1-4a64-b7ad-18c4ce3f60f8 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T09:30:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-577581546',display_name='tempest-VolumesActionsTest-instance-577581546',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-577581546',id=7,image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9af984d06e5340f8a65a54a806c7c88a',ramdisk_id='',reservation_id='r-9jf7aepj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-915673420',owner_user_name='tempest-VolumesActionsTest-915673420-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T09:30:42Z,user_data=None,user_id='a3ce318b93394200a80ba72ec74c321e',uuid=fa52b2a0-e5a0-4f93-a1cf-fef4a8313368,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "942f4024-43e2-4488-a7fd-c9de9bab7162", "address": "fa:16:3e:3a:68:1c", "network": {"id": "48c8af75-6a89-441b-8e4a-8c7186006537", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2172147-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9af984d06e5340f8a65a54a806c7c88a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap942f4024-43", "ovs_interfaceid": "942f4024-43e2-4488-a7fd-c9de9bab7162", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 09:30:46 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-578a8905-0cc1-4a64-b7ad-18c4ce3f60f8 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] Converting VIF {"id": "942f4024-43e2-4488-a7fd-c9de9bab7162", "address": "fa:16:3e:3a:68:1c", "network": {"id": "48c8af75-6a89-441b-8e4a-8c7186006537", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2172147-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9af984d06e5340f8a65a54a806c7c88a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap942f4024-43", "ovs_interfaceid": "942f4024-43e2-4488-a7fd-c9de9bab7162", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 09:30:46 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-578a8905-0cc1-4a64-b7ad-18c4ce3f60f8 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:68:1c,bridge_name='br-int',has_traffic_filtering=True,id=942f4024-43e2-4488-a7fd-c9de9bab7162,network=Network(48c8af75-6a89-441b-8e4a-8c7186006537),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap942f4024-43') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 09:30:46 user nova-compute[75122]: DEBUG os_vif [None req-578a8905-0cc1-4a64-b7ad-18c4ce3f60f8 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:68:1c,bridge_name='br-int',has_traffic_filtering=True,id=942f4024-43e2-4488-a7fd-c9de9bab7162,network=Network(48c8af75-6a89-441b-8e4a-8c7186006537),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap942f4024-43') {{(pid=75122) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 09:30:46 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:30:46 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:30:46 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 09:30:46 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:30:46 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '762dcf7d-f65e-5953-8425-a69f0f310106', '_type': 'linux-noop'}}, row=False) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:30:46 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:30:46 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:30:46 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:30:46 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap942f4024-43, may_exist=True, interface_attrs={}) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:30:46 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap942f4024-43, col_values=(('qos', UUID('02d57141-e004-43b3-8ea9-f262dd6ab19c')),), if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:30:46 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap942f4024-43, col_values=(('external_ids', {'iface-id': '942f4024-43e2-4488-a7fd-c9de9bab7162', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3a:68:1c', 'vm-uuid': 'fa52b2a0-e5a0-4f93-a1cf-fef4a8313368'}),), if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:30:46 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:30:46 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:30:46 user nova-compute[75122]: INFO os_vif [None req-578a8905-0cc1-4a64-b7ad-18c4ce3f60f8 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:68:1c,bridge_name='br-int',has_traffic_filtering=True,id=942f4024-43e2-4488-a7fd-c9de9bab7162,network=Network(48c8af75-6a89-441b-8e4a-8c7186006537),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap942f4024-43')
Nov 15 09:30:46 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-05409caf-c46b-453b-8ce4-ee7350683e22 tempest-VolumesAssistedSnapshotsTest-203861085 tempest-VolumesAssistedSnapshotsTest-203861085-project-member] Acquiring lock "9cfb60cb-011e-4537-9f28-55ea7d6dfc13" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:30:46 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-05409caf-c46b-453b-8ce4-ee7350683e22 tempest-VolumesAssistedSnapshotsTest-203861085 tempest-VolumesAssistedSnapshotsTest-203861085-project-member] Lock "9cfb60cb-011e-4537-9f28-55ea7d6dfc13" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:30:46 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-578a8905-0cc1-4a64-b7ad-18c4ce3f60f8 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] No BDM found with device name vda, not building metadata. {{(pid=75122) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 09:30:46 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-578a8905-0cc1-4a64-b7ad-18c4ce3f60f8 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] No VIF found with MAC fa:16:3e:3a:68:1c, not building metadata {{(pid=75122) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 09:30:46 user nova-compute[75122]: DEBUG nova.compute.manager [None req-05409caf-c46b-453b-8ce4-ee7350683e22 tempest-VolumesAssistedSnapshotsTest-203861085 tempest-VolumesAssistedSnapshotsTest-203861085-project-member] [instance: 9cfb60cb-011e-4537-9f28-55ea7d6dfc13] Starting instance... {{(pid=75122) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 09:30:46 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-05409caf-c46b-453b-8ce4-ee7350683e22 tempest-VolumesAssistedSnapshotsTest-203861085 tempest-VolumesAssistedSnapshotsTest-203861085-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:30:46 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-05409caf-c46b-453b-8ce4-ee7350683e22 tempest-VolumesAssistedSnapshotsTest-203861085 tempest-VolumesAssistedSnapshotsTest-203861085-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:30:46 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-05409caf-c46b-453b-8ce4-ee7350683e22 tempest-VolumesAssistedSnapshotsTest-203861085 tempest-VolumesAssistedSnapshotsTest-203861085-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75122) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 09:30:46 user nova-compute[75122]: INFO nova.compute.claims [None req-05409caf-c46b-453b-8ce4-ee7350683e22 tempest-VolumesAssistedSnapshotsTest-203861085 tempest-VolumesAssistedSnapshotsTest-203861085-project-member] [instance: 9cfb60cb-011e-4537-9f28-55ea7d6dfc13] Claim successful on node user
Nov 15 09:30:46 user nova-compute[75122]: DEBUG nova.compute.manager [req-5be4eca1-5916-46e1-86fb-e8363cad4b8f req-5e7782d0-d418-43e8-9424-b49934fece15 service nova] [instance: d24a189e-2de9-404e-b281-224c150a5bbf] Received event network-vif-plugged-5439a285-9a24-4c8e-a9d0-4e7c773f9e60 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:30:46 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-5be4eca1-5916-46e1-86fb-e8363cad4b8f req-5e7782d0-d418-43e8-9424-b49934fece15 service nova] Acquiring lock "d24a189e-2de9-404e-b281-224c150a5bbf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:30:46 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-5be4eca1-5916-46e1-86fb-e8363cad4b8f req-5e7782d0-d418-43e8-9424-b49934fece15 service nova] Lock "d24a189e-2de9-404e-b281-224c150a5bbf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:30:46 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-5be4eca1-5916-46e1-86fb-e8363cad4b8f req-5e7782d0-d418-43e8-9424-b49934fece15 service nova] Lock "d24a189e-2de9-404e-b281-224c150a5bbf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:30:46 user nova-compute[75122]: DEBUG nova.compute.manager [req-5be4eca1-5916-46e1-86fb-e8363cad4b8f req-5e7782d0-d418-43e8-9424-b49934fece15 service nova] [instance: d24a189e-2de9-404e-b281-224c150a5bbf] No waiting events found dispatching network-vif-plugged-5439a285-9a24-4c8e-a9d0-4e7c773f9e60 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:30:46 user nova-compute[75122]: WARNING nova.compute.manager [req-5be4eca1-5916-46e1-86fb-e8363cad4b8f req-5e7782d0-d418-43e8-9424-b49934fece15 service nova] [instance: d24a189e-2de9-404e-b281-224c150a5bbf] Received unexpected event network-vif-plugged-5439a285-9a24-4c8e-a9d0-4e7c773f9e60 for instance with vm_state building and task_state spawning.
Nov 15 09:30:46 user nova-compute[75122]: DEBUG nova.network.neutron [req-d22e8183-6e6d-450f-838d-417224bdc4cc req-24d4547a-9c01-4aef-b24b-3eef2fc27c80 service nova] [instance: fa52b2a0-e5a0-4f93-a1cf-fef4a8313368] Updated VIF entry in instance network info cache for port 942f4024-43e2-4488-a7fd-c9de9bab7162. {{(pid=75122) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 09:30:46 user nova-compute[75122]: DEBUG nova.network.neutron [req-d22e8183-6e6d-450f-838d-417224bdc4cc req-24d4547a-9c01-4aef-b24b-3eef2fc27c80 service nova] [instance: fa52b2a0-e5a0-4f93-a1cf-fef4a8313368] Updating instance_info_cache with network_info: [{"id": "942f4024-43e2-4488-a7fd-c9de9bab7162", "address": "fa:16:3e:3a:68:1c", "network": {"id": "48c8af75-6a89-441b-8e4a-8c7186006537", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2172147-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9af984d06e5340f8a65a54a806c7c88a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap942f4024-43", "ovs_interfaceid": "942f4024-43e2-4488-a7fd-c9de9bab7162", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:30:46 user nova-compute[75122]: DEBUG nova.compute.manager [None req-050994fc-5329-4990-a334-913056b1b2a6 tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] [instance: d24a189e-2de9-404e-b281-224c150a5bbf] Instance event wait completed in 0 seconds for  {{(pid=75122) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 09:30:46 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-050994fc-5329-4990-a334-913056b1b2a6 tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] [instance: d24a189e-2de9-404e-b281-224c150a5bbf] Guest created on hypervisor {{(pid=75122) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 09:30:47 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-d22e8183-6e6d-450f-838d-417224bdc4cc req-24d4547a-9c01-4aef-b24b-3eef2fc27c80 service nova] Releasing lock "refresh_cache-fa52b2a0-e5a0-4f93-a1cf-fef4a8313368" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 09:30:47 user nova-compute[75122]: INFO nova.virt.libvirt.driver [-] [instance: d24a189e-2de9-404e-b281-224c150a5bbf] Instance spawned successfully.
Nov 15 09:30:47 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-050994fc-5329-4990-a334-913056b1b2a6 tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] [instance: d24a189e-2de9-404e-b281-224c150a5bbf] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 09:30:47 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-050994fc-5329-4990-a334-913056b1b2a6 tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] [instance: d24a189e-2de9-404e-b281-224c150a5bbf] Found default for hw_cdrom_bus of ide {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:30:47 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-050994fc-5329-4990-a334-913056b1b2a6 tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] [instance: d24a189e-2de9-404e-b281-224c150a5bbf] Found default for hw_disk_bus of virtio {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:30:47 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-050994fc-5329-4990-a334-913056b1b2a6 tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] [instance: d24a189e-2de9-404e-b281-224c150a5bbf] Found default for hw_input_bus of None {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:30:47 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-050994fc-5329-4990-a334-913056b1b2a6 tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] [instance: d24a189e-2de9-404e-b281-224c150a5bbf] Found default for hw_pointer_model of None {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:30:47 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-050994fc-5329-4990-a334-913056b1b2a6 tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] [instance: d24a189e-2de9-404e-b281-224c150a5bbf] Found default for hw_video_model of virtio {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:30:47 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-050994fc-5329-4990-a334-913056b1b2a6 tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] [instance: d24a189e-2de9-404e-b281-224c150a5bbf] Found default for hw_vif_model of virtio {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:30:47 user nova-compute[75122]: INFO nova.compute.manager [None req-050994fc-5329-4990-a334-913056b1b2a6 tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] [instance: d24a189e-2de9-404e-b281-224c150a5bbf] Took 9.44 seconds to spawn the instance on the hypervisor.
Nov 15 09:30:47 user nova-compute[75122]: DEBUG nova.compute.manager [None req-050994fc-5329-4990-a334-913056b1b2a6 tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] [instance: d24a189e-2de9-404e-b281-224c150a5bbf] Checking state {{(pid=75122) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 09:30:47 user nova-compute[75122]: DEBUG nova.compute.provider_tree [None req-05409caf-c46b-453b-8ce4-ee7350683e22 tempest-VolumesAssistedSnapshotsTest-203861085 tempest-VolumesAssistedSnapshotsTest-203861085-project-member] Inventory has not changed in ProviderTree for provider: 69a3da65-47be-44c6-b67c-c692b58284ef {{(pid=75122) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 09:30:47 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-05409caf-c46b-453b-8ce4-ee7350683e22 tempest-VolumesAssistedSnapshotsTest-203861085 tempest-VolumesAssistedSnapshotsTest-203861085-project-member] Inventory has not changed for provider 69a3da65-47be-44c6-b67c-c692b58284ef based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 09:30:47 user nova-compute[75122]: INFO nova.compute.manager [None req-050994fc-5329-4990-a334-913056b1b2a6 tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] [instance: d24a189e-2de9-404e-b281-224c150a5bbf] Took 10.78 seconds to build instance.
Nov 15 09:30:47 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-05409caf-c46b-453b-8ce4-ee7350683e22 tempest-VolumesAssistedSnapshotsTest-203861085 tempest-VolumesAssistedSnapshotsTest-203861085-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.767s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:30:47 user nova-compute[75122]: DEBUG nova.compute.manager [None req-05409caf-c46b-453b-8ce4-ee7350683e22 tempest-VolumesAssistedSnapshotsTest-203861085 tempest-VolumesAssistedSnapshotsTest-203861085-project-member] [instance: 9cfb60cb-011e-4537-9f28-55ea7d6dfc13] Start building networks asynchronously for instance. {{(pid=75122) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 09:30:47 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-050994fc-5329-4990-a334-913056b1b2a6 tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] Lock "d24a189e-2de9-404e-b281-224c150a5bbf" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.924s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:30:47 user nova-compute[75122]: DEBUG nova.compute.manager [None req-05409caf-c46b-453b-8ce4-ee7350683e22 tempest-VolumesAssistedSnapshotsTest-203861085 tempest-VolumesAssistedSnapshotsTest-203861085-project-member] [instance: 9cfb60cb-011e-4537-9f28-55ea7d6dfc13] Allocating IP information in the background. {{(pid=75122) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 09:30:47 user nova-compute[75122]: DEBUG nova.network.neutron [None req-05409caf-c46b-453b-8ce4-ee7350683e22 tempest-VolumesAssistedSnapshotsTest-203861085 tempest-VolumesAssistedSnapshotsTest-203861085-project-member] [instance: 9cfb60cb-011e-4537-9f28-55ea7d6dfc13] allocate_for_instance() {{(pid=75122) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 09:30:47 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-05409caf-c46b-453b-8ce4-ee7350683e22 tempest-VolumesAssistedSnapshotsTest-203861085 tempest-VolumesAssistedSnapshotsTest-203861085-project-member] [instance: 9cfb60cb-011e-4537-9f28-55ea7d6dfc13] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 09:30:47 user nova-compute[75122]: DEBUG nova.compute.manager [None req-05409caf-c46b-453b-8ce4-ee7350683e22 tempest-VolumesAssistedSnapshotsTest-203861085 tempest-VolumesAssistedSnapshotsTest-203861085-project-member] [instance: 9cfb60cb-011e-4537-9f28-55ea7d6dfc13] Start building block device mappings for instance. {{(pid=75122) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 09:30:47 user nova-compute[75122]: DEBUG nova.policy [None req-05409caf-c46b-453b-8ce4-ee7350683e22 tempest-VolumesAssistedSnapshotsTest-203861085 tempest-VolumesAssistedSnapshotsTest-203861085-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '823d33bbfb544e18ac0a37b233563d79', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2823e154de6e4ffc9b965f6b5036cc17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75122) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 09:30:47 user nova-compute[75122]: DEBUG nova.compute.manager [None req-05409caf-c46b-453b-8ce4-ee7350683e22 tempest-VolumesAssistedSnapshotsTest-203861085 tempest-VolumesAssistedSnapshotsTest-203861085-project-member] [instance: 9cfb60cb-011e-4537-9f28-55ea7d6dfc13] Start spawning the instance on the hypervisor. {{(pid=75122) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 09:30:47 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-05409caf-c46b-453b-8ce4-ee7350683e22 tempest-VolumesAssistedSnapshotsTest-203861085 tempest-VolumesAssistedSnapshotsTest-203861085-project-member] [instance: 9cfb60cb-011e-4537-9f28-55ea7d6dfc13] Creating instance directory {{(pid=75122) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 09:30:47 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-05409caf-c46b-453b-8ce4-ee7350683e22 tempest-VolumesAssistedSnapshotsTest-203861085 tempest-VolumesAssistedSnapshotsTest-203861085-project-member] [instance: 9cfb60cb-011e-4537-9f28-55ea7d6dfc13] Creating image(s)
Nov 15 09:30:47 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-05409caf-c46b-453b-8ce4-ee7350683e22 tempest-VolumesAssistedSnapshotsTest-203861085 tempest-VolumesAssistedSnapshotsTest-203861085-project-member] Acquiring lock "/opt/stack/data/nova/instances/9cfb60cb-011e-4537-9f28-55ea7d6dfc13/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:30:47 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-05409caf-c46b-453b-8ce4-ee7350683e22 tempest-VolumesAssistedSnapshotsTest-203861085 tempest-VolumesAssistedSnapshotsTest-203861085-project-member] Lock "/opt/stack/data/nova/instances/9cfb60cb-011e-4537-9f28-55ea7d6dfc13/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:30:47 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-05409caf-c46b-453b-8ce4-ee7350683e22 tempest-VolumesAssistedSnapshotsTest-203861085 tempest-VolumesAssistedSnapshotsTest-203861085-project-member] Lock "/opt/stack/data/nova/instances/9cfb60cb-011e-4537-9f28-55ea7d6dfc13/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:30:47 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-05409caf-c46b-453b-8ce4-ee7350683e22 tempest-VolumesAssistedSnapshotsTest-203861085 tempest-VolumesAssistedSnapshotsTest-203861085-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:30:47 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-05409caf-c46b-453b-8ce4-ee7350683e22 tempest-VolumesAssistedSnapshotsTest-203861085 tempest-VolumesAssistedSnapshotsTest-203861085-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json" returned: 0 in 0.219s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:30:47 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-05409caf-c46b-453b-8ce4-ee7350683e22 tempest-VolumesAssistedSnapshotsTest-203861085 tempest-VolumesAssistedSnapshotsTest-203861085-project-member] Acquiring lock "95d6e29f74d5408f818e32f3bc29bc8270a4c665" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:30:47 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-05409caf-c46b-453b-8ce4-ee7350683e22 tempest-VolumesAssistedSnapshotsTest-203861085 tempest-VolumesAssistedSnapshotsTest-203861085-project-member] Lock "95d6e29f74d5408f818e32f3bc29bc8270a4c665" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.004s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:30:47 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-05409caf-c46b-453b-8ce4-ee7350683e22 tempest-VolumesAssistedSnapshotsTest-203861085 tempest-VolumesAssistedSnapshotsTest-203861085-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:30:48 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:30:48 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-05409caf-c46b-453b-8ce4-ee7350683e22 tempest-VolumesAssistedSnapshotsTest-203861085 tempest-VolumesAssistedSnapshotsTest-203861085-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json" returned: 0 in 0.220s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:30:48 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-05409caf-c46b-453b-8ce4-ee7350683e22 tempest-VolumesAssistedSnapshotsTest-203861085 tempest-VolumesAssistedSnapshotsTest-203861085-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665,backing_fmt=raw /opt/stack/data/nova/instances/9cfb60cb-011e-4537-9f28-55ea7d6dfc13/disk 1073741824 {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:30:48 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-05409caf-c46b-453b-8ce4-ee7350683e22 tempest-VolumesAssistedSnapshotsTest-203861085 tempest-VolumesAssistedSnapshotsTest-203861085-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665,backing_fmt=raw /opt/stack/data/nova/instances/9cfb60cb-011e-4537-9f28-55ea7d6dfc13/disk 1073741824" returned: 0 in 0.086s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:30:48 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-05409caf-c46b-453b-8ce4-ee7350683e22 tempest-VolumesAssistedSnapshotsTest-203861085 tempest-VolumesAssistedSnapshotsTest-203861085-project-member] Lock "95d6e29f74d5408f818e32f3bc29bc8270a4c665" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.314s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:30:48 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-05409caf-c46b-453b-8ce4-ee7350683e22 tempest-VolumesAssistedSnapshotsTest-203861085 tempest-VolumesAssistedSnapshotsTest-203861085-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:30:48 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-05409caf-c46b-453b-8ce4-ee7350683e22 tempest-VolumesAssistedSnapshotsTest-203861085 tempest-VolumesAssistedSnapshotsTest-203861085-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json" returned: 0 in 0.236s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:30:48 user nova-compute[75122]: DEBUG nova.virt.disk.api [None req-05409caf-c46b-453b-8ce4-ee7350683e22 tempest-VolumesAssistedSnapshotsTest-203861085 tempest-VolumesAssistedSnapshotsTest-203861085-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9cfb60cb-011e-4537-9f28-55ea7d6dfc13/disk. size=1073741824 {{(pid=75122) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 09:30:48 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-05409caf-c46b-453b-8ce4-ee7350683e22 tempest-VolumesAssistedSnapshotsTest-203861085 tempest-VolumesAssistedSnapshotsTest-203861085-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cfb60cb-011e-4537-9f28-55ea7d6dfc13/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:30:48 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-05409caf-c46b-453b-8ce4-ee7350683e22 tempest-VolumesAssistedSnapshotsTest-203861085 tempest-VolumesAssistedSnapshotsTest-203861085-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cfb60cb-011e-4537-9f28-55ea7d6dfc13/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:30:48 user nova-compute[75122]: DEBUG nova.virt.disk.api [None req-05409caf-c46b-453b-8ce4-ee7350683e22 tempest-VolumesAssistedSnapshotsTest-203861085 tempest-VolumesAssistedSnapshotsTest-203861085-project-member] Cannot resize image /opt/stack/data/nova/instances/9cfb60cb-011e-4537-9f28-55ea7d6dfc13/disk to a smaller size. {{(pid=75122) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 09:30:48 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-05409caf-c46b-453b-8ce4-ee7350683e22 tempest-VolumesAssistedSnapshotsTest-203861085 tempest-VolumesAssistedSnapshotsTest-203861085-project-member] [instance: 9cfb60cb-011e-4537-9f28-55ea7d6dfc13] Created local disks {{(pid=75122) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 09:30:48 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-05409caf-c46b-453b-8ce4-ee7350683e22 tempest-VolumesAssistedSnapshotsTest-203861085 tempest-VolumesAssistedSnapshotsTest-203861085-project-member] [instance: 9cfb60cb-011e-4537-9f28-55ea7d6dfc13] Ensure instance console log exists: /opt/stack/data/nova/instances/9cfb60cb-011e-4537-9f28-55ea7d6dfc13/console.log {{(pid=75122) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 09:30:48 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-05409caf-c46b-453b-8ce4-ee7350683e22 tempest-VolumesAssistedSnapshotsTest-203861085 tempest-VolumesAssistedSnapshotsTest-203861085-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:30:48 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-05409caf-c46b-453b-8ce4-ee7350683e22 tempest-VolumesAssistedSnapshotsTest-203861085 tempest-VolumesAssistedSnapshotsTest-203861085-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:30:48 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-05409caf-c46b-453b-8ce4-ee7350683e22 tempest-VolumesAssistedSnapshotsTest-203861085 tempest-VolumesAssistedSnapshotsTest-203861085-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:30:48 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:30:48 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:30:49 user nova-compute[75122]: DEBUG nova.network.neutron [None req-05409caf-c46b-453b-8ce4-ee7350683e22 tempest-VolumesAssistedSnapshotsTest-203861085 tempest-VolumesAssistedSnapshotsTest-203861085-project-member] [instance: 9cfb60cb-011e-4537-9f28-55ea7d6dfc13] Successfully created port: f46032a9-bba1-47d0-aa79-dc66f360bc46 {{(pid=75122) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 09:30:49 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:30:50 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:30:50 user nova-compute[75122]: DEBUG nova.network.neutron [None req-05409caf-c46b-453b-8ce4-ee7350683e22 tempest-VolumesAssistedSnapshotsTest-203861085 tempest-VolumesAssistedSnapshotsTest-203861085-project-member] [instance: 9cfb60cb-011e-4537-9f28-55ea7d6dfc13] Successfully updated port: f46032a9-bba1-47d0-aa79-dc66f360bc46 {{(pid=75122) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 09:30:50 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-05409caf-c46b-453b-8ce4-ee7350683e22 tempest-VolumesAssistedSnapshotsTest-203861085 tempest-VolumesAssistedSnapshotsTest-203861085-project-member] Acquiring lock "refresh_cache-9cfb60cb-011e-4537-9f28-55ea7d6dfc13" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 09:30:50 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-05409caf-c46b-453b-8ce4-ee7350683e22 tempest-VolumesAssistedSnapshotsTest-203861085 tempest-VolumesAssistedSnapshotsTest-203861085-project-member] Acquired lock "refresh_cache-9cfb60cb-011e-4537-9f28-55ea7d6dfc13" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 09:30:50 user nova-compute[75122]: DEBUG nova.network.neutron [None req-05409caf-c46b-453b-8ce4-ee7350683e22 tempest-VolumesAssistedSnapshotsTest-203861085 tempest-VolumesAssistedSnapshotsTest-203861085-project-member] [instance: 9cfb60cb-011e-4537-9f28-55ea7d6dfc13] Building network info cache for instance {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 09:30:50 user nova-compute[75122]: DEBUG nova.compute.manager [req-faaf40f9-425d-4165-91f6-cf3a6a29676a req-1eed59fd-3570-4a21-b0b5-f9b3efcabad6 service nova] [instance: 9cfb60cb-011e-4537-9f28-55ea7d6dfc13] Received event network-changed-f46032a9-bba1-47d0-aa79-dc66f360bc46 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:30:50 user nova-compute[75122]: DEBUG nova.compute.manager [req-faaf40f9-425d-4165-91f6-cf3a6a29676a req-1eed59fd-3570-4a21-b0b5-f9b3efcabad6 service nova] [instance: 9cfb60cb-011e-4537-9f28-55ea7d6dfc13] Refreshing instance network info cache due to event network-changed-f46032a9-bba1-47d0-aa79-dc66f360bc46. {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 09:30:50 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-faaf40f9-425d-4165-91f6-cf3a6a29676a req-1eed59fd-3570-4a21-b0b5-f9b3efcabad6 service nova] Acquiring lock "refresh_cache-9cfb60cb-011e-4537-9f28-55ea7d6dfc13" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 09:30:50 user nova-compute[75122]: DEBUG nova.network.neutron [None req-05409caf-c46b-453b-8ce4-ee7350683e22 tempest-VolumesAssistedSnapshotsTest-203861085 tempest-VolumesAssistedSnapshotsTest-203861085-project-member] [instance: 9cfb60cb-011e-4537-9f28-55ea7d6dfc13] Instance cache missing network info. {{(pid=75122) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 09:30:50 user nova-compute[75122]: DEBUG nova.compute.manager [None req-578a8905-0cc1-4a64-b7ad-18c4ce3f60f8 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] [instance: fa52b2a0-e5a0-4f93-a1cf-fef4a8313368] Instance event wait completed in 0 seconds for  {{(pid=75122) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 09:30:50 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-578a8905-0cc1-4a64-b7ad-18c4ce3f60f8 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] [instance: fa52b2a0-e5a0-4f93-a1cf-fef4a8313368] Guest created on hypervisor {{(pid=75122) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 09:30:50 user nova-compute[75122]: INFO nova.virt.libvirt.driver [-] [instance: fa52b2a0-e5a0-4f93-a1cf-fef4a8313368] Instance spawned successfully.
Nov 15 09:30:50 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-578a8905-0cc1-4a64-b7ad-18c4ce3f60f8 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] [instance: fa52b2a0-e5a0-4f93-a1cf-fef4a8313368] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 09:30:50 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-578a8905-0cc1-4a64-b7ad-18c4ce3f60f8 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] [instance: fa52b2a0-e5a0-4f93-a1cf-fef4a8313368] Found default for hw_cdrom_bus of ide {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:30:50 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-578a8905-0cc1-4a64-b7ad-18c4ce3f60f8 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] [instance: fa52b2a0-e5a0-4f93-a1cf-fef4a8313368] Found default for hw_disk_bus of virtio {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:30:50 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-578a8905-0cc1-4a64-b7ad-18c4ce3f60f8 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] [instance: fa52b2a0-e5a0-4f93-a1cf-fef4a8313368] Found default for hw_input_bus of None {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:30:50 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-578a8905-0cc1-4a64-b7ad-18c4ce3f60f8 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] [instance: fa52b2a0-e5a0-4f93-a1cf-fef4a8313368] Found default for hw_pointer_model of None {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:30:50 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-578a8905-0cc1-4a64-b7ad-18c4ce3f60f8 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] [instance: fa52b2a0-e5a0-4f93-a1cf-fef4a8313368] Found default for hw_video_model of virtio {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:30:50 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-578a8905-0cc1-4a64-b7ad-18c4ce3f60f8 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] [instance: fa52b2a0-e5a0-4f93-a1cf-fef4a8313368] Found default for hw_vif_model of virtio {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:30:50 user nova-compute[75122]: INFO nova.compute.manager [None req-578a8905-0cc1-4a64-b7ad-18c4ce3f60f8 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] [instance: fa52b2a0-e5a0-4f93-a1cf-fef4a8313368] Took 8.37 seconds to spawn the instance on the hypervisor.
Nov 15 09:30:50 user nova-compute[75122]: DEBUG nova.compute.manager [None req-578a8905-0cc1-4a64-b7ad-18c4ce3f60f8 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] [instance: fa52b2a0-e5a0-4f93-a1cf-fef4a8313368] Checking state {{(pid=75122) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 09:30:51 user nova-compute[75122]: DEBUG nova.network.neutron [None req-05409caf-c46b-453b-8ce4-ee7350683e22 tempest-VolumesAssistedSnapshotsTest-203861085 tempest-VolumesAssistedSnapshotsTest-203861085-project-member] [instance: 9cfb60cb-011e-4537-9f28-55ea7d6dfc13] Updating instance_info_cache with network_info: [{"id": "f46032a9-bba1-47d0-aa79-dc66f360bc46", "address": "fa:16:3e:95:5c:e0", "network": {"id": "360c0d80-0116-44d9-a9b0-c95257b58658", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1507264907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2823e154de6e4ffc9b965f6b5036cc17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf46032a9-bb", "ovs_interfaceid": "f46032a9-bba1-47d0-aa79-dc66f360bc46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:30:51 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-05409caf-c46b-453b-8ce4-ee7350683e22 tempest-VolumesAssistedSnapshotsTest-203861085 tempest-VolumesAssistedSnapshotsTest-203861085-project-member] Releasing lock "refresh_cache-9cfb60cb-011e-4537-9f28-55ea7d6dfc13" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 09:30:51 user nova-compute[75122]: DEBUG nova.compute.manager [None req-05409caf-c46b-453b-8ce4-ee7350683e22 tempest-VolumesAssistedSnapshotsTest-203861085 tempest-VolumesAssistedSnapshotsTest-203861085-project-member] [instance: 9cfb60cb-011e-4537-9f28-55ea7d6dfc13] Instance network_info: |[{"id": "f46032a9-bba1-47d0-aa79-dc66f360bc46", "address": "fa:16:3e:95:5c:e0", "network": {"id": "360c0d80-0116-44d9-a9b0-c95257b58658", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1507264907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2823e154de6e4ffc9b965f6b5036cc17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf46032a9-bb", "ovs_interfaceid": "f46032a9-bba1-47d0-aa79-dc66f360bc46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75122) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 09:30:51 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-faaf40f9-425d-4165-91f6-cf3a6a29676a req-1eed59fd-3570-4a21-b0b5-f9b3efcabad6 service nova] Acquired lock "refresh_cache-9cfb60cb-011e-4537-9f28-55ea7d6dfc13" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 09:30:51 user nova-compute[75122]: DEBUG nova.network.neutron [req-faaf40f9-425d-4165-91f6-cf3a6a29676a req-1eed59fd-3570-4a21-b0b5-f9b3efcabad6 service nova] [instance: 9cfb60cb-011e-4537-9f28-55ea7d6dfc13] Refreshing network info cache for port f46032a9-bba1-47d0-aa79-dc66f360bc46 {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 09:30:51 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-05409caf-c46b-453b-8ce4-ee7350683e22 tempest-VolumesAssistedSnapshotsTest-203861085 tempest-VolumesAssistedSnapshotsTest-203861085-project-member] [instance: 9cfb60cb-011e-4537-9f28-55ea7d6dfc13] Start _get_guest_xml network_info=[{"id": "f46032a9-bba1-47d0-aa79-dc66f360bc46", "address": "fa:16:3e:95:5c:e0", "network": {"id": "360c0d80-0116-44d9-a9b0-c95257b58658", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1507264907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2823e154de6e4ffc9b965f6b5036cc17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf46032a9-bb", "ovs_interfaceid": "f46032a9-bba1-47d0-aa79-dc66f360bc46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T09:26:31Z,direct_url=<?>,disk_format='qcow2',id=5e862cfe-47b8-4725-8292-65761ee6d0f5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9c57733cb41847c0b4ad31519c382e5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T09:26:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '5e862cfe-47b8-4725-8292-65761ee6d0f5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75122) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 09:30:51 user nova-compute[75122]: INFO nova.compute.manager [None req-578a8905-0cc1-4a64-b7ad-18c4ce3f60f8 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] [instance: fa52b2a0-e5a0-4f93-a1cf-fef4a8313368] Took 9.81 seconds to build instance.
Nov 15 09:30:51 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-05409caf-c46b-453b-8ce4-ee7350683e22 tempest-VolumesAssistedSnapshotsTest-203861085 tempest-VolumesAssistedSnapshotsTest-203861085-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 09:30:51 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-05409caf-c46b-453b-8ce4-ee7350683e22 tempest-VolumesAssistedSnapshotsTest-203861085 tempest-VolumesAssistedSnapshotsTest-203861085-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 09:30:51 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-05409caf-c46b-453b-8ce4-ee7350683e22 tempest-VolumesAssistedSnapshotsTest-203861085 tempest-VolumesAssistedSnapshotsTest-203861085-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75122) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 09:30:51 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-05409caf-c46b-453b-8ce4-ee7350683e22 tempest-VolumesAssistedSnapshotsTest-203861085 tempest-VolumesAssistedSnapshotsTest-203861085-project-member] CPU controller missing on host. {{(pid=75122) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 09:30:51 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-578a8905-0cc1-4a64-b7ad-18c4ce3f60f8 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] Lock "fa52b2a0-e5a0-4f93-a1cf-fef4a8313368" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.166s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:30:51 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-05409caf-c46b-453b-8ce4-ee7350683e22 tempest-VolumesAssistedSnapshotsTest-203861085 tempest-VolumesAssistedSnapshotsTest-203861085-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75122) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 09:30:51 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-05409caf-c46b-453b-8ce4-ee7350683e22 tempest-VolumesAssistedSnapshotsTest-203861085 tempest-VolumesAssistedSnapshotsTest-203861085-project-member] CPU controller found on host. {{(pid=75122) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 09:30:51 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-05409caf-c46b-453b-8ce4-ee7350683e22 tempest-VolumesAssistedSnapshotsTest-203861085 tempest-VolumesAssistedSnapshotsTest-203861085-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75122) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 09:30:51 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-05409caf-c46b-453b-8ce4-ee7350683e22 tempest-VolumesAssistedSnapshotsTest-203861085 tempest-VolumesAssistedSnapshotsTest-203861085-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T09:26:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T09:26:31Z,direct_url=<?>,disk_format='qcow2',id=5e862cfe-47b8-4725-8292-65761ee6d0f5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9c57733cb41847c0b4ad31519c382e5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T09:26:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 09:30:51 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-05409caf-c46b-453b-8ce4-ee7350683e22 tempest-VolumesAssistedSnapshotsTest-203861085 tempest-VolumesAssistedSnapshotsTest-203861085-project-member] Flavor limits 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 09:30:51 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-05409caf-c46b-453b-8ce4-ee7350683e22 tempest-VolumesAssistedSnapshotsTest-203861085 tempest-VolumesAssistedSnapshotsTest-203861085-project-member] Image limits 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 09:30:51 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-05409caf-c46b-453b-8ce4-ee7350683e22 tempest-VolumesAssistedSnapshotsTest-203861085 tempest-VolumesAssistedSnapshotsTest-203861085-project-member] Flavor pref 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 09:30:51 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-05409caf-c46b-453b-8ce4-ee7350683e22 tempest-VolumesAssistedSnapshotsTest-203861085 tempest-VolumesAssistedSnapshotsTest-203861085-project-member] Image pref 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 09:30:51 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-05409caf-c46b-453b-8ce4-ee7350683e22 tempest-VolumesAssistedSnapshotsTest-203861085 tempest-VolumesAssistedSnapshotsTest-203861085-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 09:30:51 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-05409caf-c46b-453b-8ce4-ee7350683e22 tempest-VolumesAssistedSnapshotsTest-203861085 tempest-VolumesAssistedSnapshotsTest-203861085-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 09:30:51 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-05409caf-c46b-453b-8ce4-ee7350683e22 tempest-VolumesAssistedSnapshotsTest-203861085 tempest-VolumesAssistedSnapshotsTest-203861085-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75122) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 09:30:51 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-05409caf-c46b-453b-8ce4-ee7350683e22 tempest-VolumesAssistedSnapshotsTest-203861085 tempest-VolumesAssistedSnapshotsTest-203861085-project-member] Got 1 possible topologies {{(pid=75122) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 09:30:51 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-05409caf-c46b-453b-8ce4-ee7350683e22 tempest-VolumesAssistedSnapshotsTest-203861085 tempest-VolumesAssistedSnapshotsTest-203861085-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 09:30:51 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-05409caf-c46b-453b-8ce4-ee7350683e22 tempest-VolumesAssistedSnapshotsTest-203861085 tempest-VolumesAssistedSnapshotsTest-203861085-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 09:30:51 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-05409caf-c46b-453b-8ce4-ee7350683e22 tempest-VolumesAssistedSnapshotsTest-203861085 tempest-VolumesAssistedSnapshotsTest-203861085-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T09:30:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-610720395',display_name='tempest-VolumesAssistedSnapshotsTest-server-610720395',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-610720395',id=8,image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJhDSNEHoW2umlgLV7FRPLk273n8s/V55zW/wyu6CZh6q+6ypjDncZ4/8OV4RAxxZB9g01VzA0OBHG1H9nyjIf0SARXKgqswx9rEW8zRi9CXgxDQlbWVeIXqnKJTfc8yDQ==',key_name='tempest-keypair-1669140798',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2823e154de6e4ffc9b965f6b5036cc17',ramdisk_id='',reservation_id='r-ibnq8utf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-203861085',owner_user_name='tempest-VolumesAssistedSnapshotsTest-203861085-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T09:30:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='823d33bbfb544e18ac0a37b233563d79',uuid=9cfb60cb-011e-4537-9f28-55ea7d6dfc13,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f46032a9-bba1-47d0-aa79-dc66f360bc46", "address": "fa:16:3e:95:5c:e0", "network": {"id": "360c0d80-0116-44d9-a9b0-c95257b58658", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1507264907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2823e154de6e4ffc9b965f6b5036cc17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf46032a9-bb", "ovs_interfaceid": "f46032a9-bba1-47d0-aa79-dc66f360bc46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75122) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 09:30:51 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-05409caf-c46b-453b-8ce4-ee7350683e22 tempest-VolumesAssistedSnapshotsTest-203861085 tempest-VolumesAssistedSnapshotsTest-203861085-project-member] Converting VIF {"id": "f46032a9-bba1-47d0-aa79-dc66f360bc46", "address": "fa:16:3e:95:5c:e0", "network": {"id": "360c0d80-0116-44d9-a9b0-c95257b58658", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1507264907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2823e154de6e4ffc9b965f6b5036cc17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf46032a9-bb", "ovs_interfaceid": "f46032a9-bba1-47d0-aa79-dc66f360bc46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 09:30:51 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-05409caf-c46b-453b-8ce4-ee7350683e22 tempest-VolumesAssistedSnapshotsTest-203861085 tempest-VolumesAssistedSnapshotsTest-203861085-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:5c:e0,bridge_name='br-int',has_traffic_filtering=True,id=f46032a9-bba1-47d0-aa79-dc66f360bc46,network=Network(360c0d80-0116-44d9-a9b0-c95257b58658),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf46032a9-bb') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 09:30:51 user nova-compute[75122]: DEBUG nova.objects.instance [None req-05409caf-c46b-453b-8ce4-ee7350683e22 tempest-VolumesAssistedSnapshotsTest-203861085 tempest-VolumesAssistedSnapshotsTest-203861085-project-member] Lazy-loading 'pci_devices' on Instance uuid 9cfb60cb-011e-4537-9f28-55ea7d6dfc13 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:30:51 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-05409caf-c46b-453b-8ce4-ee7350683e22 tempest-VolumesAssistedSnapshotsTest-203861085 tempest-VolumesAssistedSnapshotsTest-203861085-project-member] [instance: 9cfb60cb-011e-4537-9f28-55ea7d6dfc13] End _get_guest_xml xml=<domain type="kvm">
Nov 15 09:30:51 user nova-compute[75122]:   <uuid>9cfb60cb-011e-4537-9f28-55ea7d6dfc13</uuid>
Nov 15 09:30:51 user nova-compute[75122]:   <name>instance-00000008</name>
Nov 15 09:30:51 user nova-compute[75122]:   <memory>524288</memory>
Nov 15 09:30:51 user nova-compute[75122]:   <vcpu>1</vcpu>
Nov 15 09:30:51 user nova-compute[75122]:   <metadata>
Nov 15 09:30:51 user nova-compute[75122]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 09:30:51 user nova-compute[75122]:       <nova:package version="0.0.0"/>
Nov 15 09:30:51 user nova-compute[75122]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-610720395</nova:name>
Nov 15 09:30:51 user nova-compute[75122]:       <nova:creationTime>2023-11-15 09:30:51</nova:creationTime>
Nov 15 09:30:51 user nova-compute[75122]:       <nova:flavor name="m1.tiny">
Nov 15 09:30:51 user nova-compute[75122]:         <nova:memory>512</nova:memory>
Nov 15 09:30:51 user nova-compute[75122]:         <nova:disk>1</nova:disk>
Nov 15 09:30:51 user nova-compute[75122]:         <nova:swap>0</nova:swap>
Nov 15 09:30:51 user nova-compute[75122]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 09:30:51 user nova-compute[75122]:         <nova:vcpus>1</nova:vcpus>
Nov 15 09:30:51 user nova-compute[75122]:       </nova:flavor>
Nov 15 09:30:51 user nova-compute[75122]:       <nova:owner>
Nov 15 09:30:51 user nova-compute[75122]:         <nova:user uuid="823d33bbfb544e18ac0a37b233563d79">tempest-VolumesAssistedSnapshotsTest-203861085-project-member</nova:user>
Nov 15 09:30:51 user nova-compute[75122]:         <nova:project uuid="2823e154de6e4ffc9b965f6b5036cc17">tempest-VolumesAssistedSnapshotsTest-203861085</nova:project>
Nov 15 09:30:51 user nova-compute[75122]:       </nova:owner>
Nov 15 09:30:51 user nova-compute[75122]:       <nova:root type="image" uuid="5e862cfe-47b8-4725-8292-65761ee6d0f5"/>
Nov 15 09:30:51 user nova-compute[75122]:       <nova:ports>
Nov 15 09:30:51 user nova-compute[75122]:         <nova:port uuid="f46032a9-bba1-47d0-aa79-dc66f360bc46">
Nov 15 09:30:51 user nova-compute[75122]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 15 09:30:51 user nova-compute[75122]:         </nova:port>
Nov 15 09:30:51 user nova-compute[75122]:       </nova:ports>
Nov 15 09:30:51 user nova-compute[75122]:     </nova:instance>
Nov 15 09:30:51 user nova-compute[75122]:   </metadata>
Nov 15 09:30:51 user nova-compute[75122]:   <sysinfo type="smbios">
Nov 15 09:30:51 user nova-compute[75122]:     <system>
Nov 15 09:30:51 user nova-compute[75122]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 09:30:51 user nova-compute[75122]:       <entry name="product">OpenStack Nova</entry>
Nov 15 09:30:51 user nova-compute[75122]:       <entry name="version">0.0.0</entry>
Nov 15 09:30:51 user nova-compute[75122]:       <entry name="serial">9cfb60cb-011e-4537-9f28-55ea7d6dfc13</entry>
Nov 15 09:30:51 user nova-compute[75122]:       <entry name="uuid">9cfb60cb-011e-4537-9f28-55ea7d6dfc13</entry>
Nov 15 09:30:51 user nova-compute[75122]:       <entry name="family">Virtual Machine</entry>
Nov 15 09:30:51 user nova-compute[75122]:     </system>
Nov 15 09:30:51 user nova-compute[75122]:   </sysinfo>
Nov 15 09:30:51 user nova-compute[75122]:   <os>
Nov 15 09:30:51 user nova-compute[75122]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 09:30:51 user nova-compute[75122]:     <boot dev="hd"/>
Nov 15 09:30:51 user nova-compute[75122]:     <smbios mode="sysinfo"/>
Nov 15 09:30:51 user nova-compute[75122]:   </os>
Nov 15 09:30:51 user nova-compute[75122]:   <features>
Nov 15 09:30:51 user nova-compute[75122]:     <acpi/>
Nov 15 09:30:51 user nova-compute[75122]:     <apic/>
Nov 15 09:30:51 user nova-compute[75122]:     <vmcoreinfo/>
Nov 15 09:30:51 user nova-compute[75122]:   </features>
Nov 15 09:30:51 user nova-compute[75122]:   <clock offset="utc">
Nov 15 09:30:51 user nova-compute[75122]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 09:30:51 user nova-compute[75122]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 09:30:51 user nova-compute[75122]:     <timer name="hpet" present="no"/>
Nov 15 09:30:51 user nova-compute[75122]:   </clock>
Nov 15 09:30:51 user nova-compute[75122]:   <cpu mode="custom" match="exact">
Nov 15 09:30:51 user nova-compute[75122]:     <model>Nehalem</model>
Nov 15 09:30:51 user nova-compute[75122]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 09:30:51 user nova-compute[75122]:   </cpu>
Nov 15 09:30:51 user nova-compute[75122]:   <devices>
Nov 15 09:30:51 user nova-compute[75122]:     <disk type="file" device="disk">
Nov 15 09:30:51 user nova-compute[75122]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 09:30:51 user nova-compute[75122]:       <source file="/opt/stack/data/nova/instances/9cfb60cb-011e-4537-9f28-55ea7d6dfc13/disk"/>
Nov 15 09:30:51 user nova-compute[75122]:       <target dev="vda" bus="virtio"/>
Nov 15 09:30:51 user nova-compute[75122]:     </disk>
Nov 15 09:30:51 user nova-compute[75122]:     <interface type="ethernet">
Nov 15 09:30:51 user nova-compute[75122]:       <mac address="fa:16:3e:95:5c:e0"/>
Nov 15 09:30:51 user nova-compute[75122]:       <model type="virtio"/>
Nov 15 09:30:51 user nova-compute[75122]:       <mtu size="1442"/>
Nov 15 09:30:51 user nova-compute[75122]:       <target dev="tapf46032a9-bb"/>
Nov 15 09:30:51 user nova-compute[75122]:     </interface>
Nov 15 09:30:51 user nova-compute[75122]:     <serial type="pty">
Nov 15 09:30:51 user nova-compute[75122]:       <log file="/opt/stack/data/nova/instances/9cfb60cb-011e-4537-9f28-55ea7d6dfc13/console.log" append="off"/>
Nov 15 09:30:51 user nova-compute[75122]:     </serial>
Nov 15 09:30:51 user nova-compute[75122]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 09:30:51 user nova-compute[75122]:     <video>
Nov 15 09:30:51 user nova-compute[75122]:       <model type="virtio"/>
Nov 15 09:30:51 user nova-compute[75122]:     </video>
Nov 15 09:30:51 user nova-compute[75122]:     <rng model="virtio">
Nov 15 09:30:51 user nova-compute[75122]:       <backend model="random">/dev/urandom</backend>
Nov 15 09:30:51 user nova-compute[75122]:     </rng>
Nov 15 09:30:51 user nova-compute[75122]:     <controller type="usb" index="0" model="none"/>
Nov 15 09:30:51 user nova-compute[75122]:     <memballoon model="virtio">
Nov 15 09:30:51 user nova-compute[75122]:       <stats period="10"/>
Nov 15 09:30:51 user nova-compute[75122]:     </memballoon>
Nov 15 09:30:51 user nova-compute[75122]:   </devices>
Nov 15 09:30:51 user nova-compute[75122]: </domain>
Nov 15 09:30:51 user nova-compute[75122]:  {{(pid=75122) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 09:30:51 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-05409caf-c46b-453b-8ce4-ee7350683e22 tempest-VolumesAssistedSnapshotsTest-203861085 tempest-VolumesAssistedSnapshotsTest-203861085-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T09:30:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-610720395',display_name='tempest-VolumesAssistedSnapshotsTest-server-610720395',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-610720395',id=8,image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJhDSNEHoW2umlgLV7FRPLk273n8s/V55zW/wyu6CZh6q+6ypjDncZ4/8OV4RAxxZB9g01VzA0OBHG1H9nyjIf0SARXKgqswx9rEW8zRi9CXgxDQlbWVeIXqnKJTfc8yDQ==',key_name='tempest-keypair-1669140798',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2823e154de6e4ffc9b965f6b5036cc17',ramdisk_id='',reservation_id='r-ibnq8utf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-203861085',owner_user_name='tempest-VolumesAssistedSnapshotsTest-203861085-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T09:30:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='823d33bbfb544e18ac0a37b233563d79',uuid=9cfb60cb-011e-4537-9f28-55ea7d6dfc13,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f46032a9-bba1-47d0-aa79-dc66f360bc46", "address": "fa:16:3e:95:5c:e0", "network": {"id": "360c0d80-0116-44d9-a9b0-c95257b58658", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1507264907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2823e154de6e4ffc9b965f6b5036cc17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf46032a9-bb", "ovs_interfaceid": "f46032a9-bba1-47d0-aa79-dc66f360bc46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 09:30:51 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-05409caf-c46b-453b-8ce4-ee7350683e22 tempest-VolumesAssistedSnapshotsTest-203861085 tempest-VolumesAssistedSnapshotsTest-203861085-project-member] Converting VIF {"id": "f46032a9-bba1-47d0-aa79-dc66f360bc46", "address": "fa:16:3e:95:5c:e0", "network": {"id": "360c0d80-0116-44d9-a9b0-c95257b58658", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1507264907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2823e154de6e4ffc9b965f6b5036cc17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf46032a9-bb", "ovs_interfaceid": "f46032a9-bba1-47d0-aa79-dc66f360bc46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 09:30:51 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-05409caf-c46b-453b-8ce4-ee7350683e22 tempest-VolumesAssistedSnapshotsTest-203861085 tempest-VolumesAssistedSnapshotsTest-203861085-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:5c:e0,bridge_name='br-int',has_traffic_filtering=True,id=f46032a9-bba1-47d0-aa79-dc66f360bc46,network=Network(360c0d80-0116-44d9-a9b0-c95257b58658),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf46032a9-bb') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 09:30:51 user nova-compute[75122]: DEBUG os_vif [None req-05409caf-c46b-453b-8ce4-ee7350683e22 tempest-VolumesAssistedSnapshotsTest-203861085 tempest-VolumesAssistedSnapshotsTest-203861085-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:5c:e0,bridge_name='br-int',has_traffic_filtering=True,id=f46032a9-bba1-47d0-aa79-dc66f360bc46,network=Network(360c0d80-0116-44d9-a9b0-c95257b58658),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf46032a9-bb') {{(pid=75122) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 09:30:51 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:30:51 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:30:51 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 09:30:51 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:30:51 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e2be998f-db06-571d-9c54-51d39076ad12', '_type': 'linux-noop'}}, row=False) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:30:51 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:30:51 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:30:51 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:30:51 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf46032a9-bb, may_exist=True, interface_attrs={}) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:30:51 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf46032a9-bb, col_values=(('qos', UUID('d61fceec-f2d3-47c1-b571-d51e11a0e64e')),), if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:30:51 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf46032a9-bb, col_values=(('external_ids', {'iface-id': 'f46032a9-bba1-47d0-aa79-dc66f360bc46', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:95:5c:e0', 'vm-uuid': '9cfb60cb-011e-4537-9f28-55ea7d6dfc13'}),), if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:30:51 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:30:51 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:30:51 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:30:51 user nova-compute[75122]: INFO os_vif [None req-05409caf-c46b-453b-8ce4-ee7350683e22 tempest-VolumesAssistedSnapshotsTest-203861085 tempest-VolumesAssistedSnapshotsTest-203861085-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:5c:e0,bridge_name='br-int',has_traffic_filtering=True,id=f46032a9-bba1-47d0-aa79-dc66f360bc46,network=Network(360c0d80-0116-44d9-a9b0-c95257b58658),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf46032a9-bb')
Nov 15 09:30:51 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-05409caf-c46b-453b-8ce4-ee7350683e22 tempest-VolumesAssistedSnapshotsTest-203861085 tempest-VolumesAssistedSnapshotsTest-203861085-project-member] No BDM found with device name vda, not building metadata. {{(pid=75122) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 09:30:51 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-05409caf-c46b-453b-8ce4-ee7350683e22 tempest-VolumesAssistedSnapshotsTest-203861085 tempest-VolumesAssistedSnapshotsTest-203861085-project-member] No VIF found with MAC fa:16:3e:95:5c:e0, not building metadata {{(pid=75122) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 09:30:51 user nova-compute[75122]: DEBUG nova.network.neutron [req-faaf40f9-425d-4165-91f6-cf3a6a29676a req-1eed59fd-3570-4a21-b0b5-f9b3efcabad6 service nova] [instance: 9cfb60cb-011e-4537-9f28-55ea7d6dfc13] Updated VIF entry in instance network info cache for port f46032a9-bba1-47d0-aa79-dc66f360bc46. {{(pid=75122) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 09:30:51 user nova-compute[75122]: DEBUG nova.network.neutron [req-faaf40f9-425d-4165-91f6-cf3a6a29676a req-1eed59fd-3570-4a21-b0b5-f9b3efcabad6 service nova] [instance: 9cfb60cb-011e-4537-9f28-55ea7d6dfc13] Updating instance_info_cache with network_info: [{"id": "f46032a9-bba1-47d0-aa79-dc66f360bc46", "address": "fa:16:3e:95:5c:e0", "network": {"id": "360c0d80-0116-44d9-a9b0-c95257b58658", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1507264907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2823e154de6e4ffc9b965f6b5036cc17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf46032a9-bb", "ovs_interfaceid": "f46032a9-bba1-47d0-aa79-dc66f360bc46", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:30:51 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-faaf40f9-425d-4165-91f6-cf3a6a29676a req-1eed59fd-3570-4a21-b0b5-f9b3efcabad6 service nova] Releasing lock "refresh_cache-9cfb60cb-011e-4537-9f28-55ea7d6dfc13" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 09:30:52 user nova-compute[75122]: DEBUG nova.compute.manager [req-9ceeafa1-4325-44b8-bc02-1d1f477ad2e5 req-fba5c505-fae4-4d6e-9cdb-9eb20a34bd69 service nova] [instance: 131142fd-e8ec-42d1-a518-aa21c7bb7cb1] Received event network-vif-plugged-f8302d0d-f140-479c-96da-b21516385381 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:30:52 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-9ceeafa1-4325-44b8-bc02-1d1f477ad2e5 req-fba5c505-fae4-4d6e-9cdb-9eb20a34bd69 service nova] Acquiring lock "131142fd-e8ec-42d1-a518-aa21c7bb7cb1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:30:52 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-9ceeafa1-4325-44b8-bc02-1d1f477ad2e5 req-fba5c505-fae4-4d6e-9cdb-9eb20a34bd69 service nova] Lock "131142fd-e8ec-42d1-a518-aa21c7bb7cb1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:30:52 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-9ceeafa1-4325-44b8-bc02-1d1f477ad2e5 req-fba5c505-fae4-4d6e-9cdb-9eb20a34bd69 service nova] Lock "131142fd-e8ec-42d1-a518-aa21c7bb7cb1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:30:52 user nova-compute[75122]: DEBUG nova.compute.manager [req-9ceeafa1-4325-44b8-bc02-1d1f477ad2e5 req-fba5c505-fae4-4d6e-9cdb-9eb20a34bd69 service nova] [instance: 131142fd-e8ec-42d1-a518-aa21c7bb7cb1] No waiting events found dispatching network-vif-plugged-f8302d0d-f140-479c-96da-b21516385381 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:30:52 user nova-compute[75122]: WARNING nova.compute.manager [req-9ceeafa1-4325-44b8-bc02-1d1f477ad2e5 req-fba5c505-fae4-4d6e-9cdb-9eb20a34bd69 service nova] [instance: 131142fd-e8ec-42d1-a518-aa21c7bb7cb1] Received unexpected event network-vif-plugged-f8302d0d-f140-479c-96da-b21516385381 for instance with vm_state active and task_state None.
Nov 15 09:30:53 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:30:53 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:30:53 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:30:53 user nova-compute[75122]: DEBUG nova.compute.manager [req-196fdacd-d8ac-4550-9ad2-f311b311ffc7 req-2f485c5d-52fa-4262-a23f-24e425459903 service nova] [instance: 9cfb60cb-011e-4537-9f28-55ea7d6dfc13] Received event network-vif-plugged-f46032a9-bba1-47d0-aa79-dc66f360bc46 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:30:53 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-196fdacd-d8ac-4550-9ad2-f311b311ffc7 req-2f485c5d-52fa-4262-a23f-24e425459903 service nova] Acquiring lock "9cfb60cb-011e-4537-9f28-55ea7d6dfc13-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:30:53 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-196fdacd-d8ac-4550-9ad2-f311b311ffc7 req-2f485c5d-52fa-4262-a23f-24e425459903 service nova] Lock "9cfb60cb-011e-4537-9f28-55ea7d6dfc13-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:30:53 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-196fdacd-d8ac-4550-9ad2-f311b311ffc7 req-2f485c5d-52fa-4262-a23f-24e425459903 service nova] Lock "9cfb60cb-011e-4537-9f28-55ea7d6dfc13-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:30:53 user nova-compute[75122]: DEBUG nova.compute.manager [req-196fdacd-d8ac-4550-9ad2-f311b311ffc7 req-2f485c5d-52fa-4262-a23f-24e425459903 service nova] [instance: 9cfb60cb-011e-4537-9f28-55ea7d6dfc13] No waiting events found dispatching network-vif-plugged-f46032a9-bba1-47d0-aa79-dc66f360bc46 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:30:53 user nova-compute[75122]: WARNING nova.compute.manager [req-196fdacd-d8ac-4550-9ad2-f311b311ffc7 req-2f485c5d-52fa-4262-a23f-24e425459903 service nova] [instance: 9cfb60cb-011e-4537-9f28-55ea7d6dfc13] Received unexpected event network-vif-plugged-f46032a9-bba1-47d0-aa79-dc66f360bc46 for instance with vm_state building and task_state spawning.
Nov 15 09:30:54 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:30:54 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:30:54 user nova-compute[75122]: DEBUG nova.compute.manager [req-a9a685c2-ebc9-49f1-936f-e31a95b321f2 req-fc705855-41ff-4ad2-ab39-27609a50157b service nova] [instance: 131142fd-e8ec-42d1-a518-aa21c7bb7cb1] Received event network-vif-plugged-f8302d0d-f140-479c-96da-b21516385381 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:30:54 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-a9a685c2-ebc9-49f1-936f-e31a95b321f2 req-fc705855-41ff-4ad2-ab39-27609a50157b service nova] Acquiring lock "131142fd-e8ec-42d1-a518-aa21c7bb7cb1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:30:54 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-a9a685c2-ebc9-49f1-936f-e31a95b321f2 req-fc705855-41ff-4ad2-ab39-27609a50157b service nova] Lock "131142fd-e8ec-42d1-a518-aa21c7bb7cb1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:30:54 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-a9a685c2-ebc9-49f1-936f-e31a95b321f2 req-fc705855-41ff-4ad2-ab39-27609a50157b service nova] Lock "131142fd-e8ec-42d1-a518-aa21c7bb7cb1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:30:54 user nova-compute[75122]: DEBUG nova.compute.manager [req-a9a685c2-ebc9-49f1-936f-e31a95b321f2 req-fc705855-41ff-4ad2-ab39-27609a50157b service nova] [instance: 131142fd-e8ec-42d1-a518-aa21c7bb7cb1] No waiting events found dispatching network-vif-plugged-f8302d0d-f140-479c-96da-b21516385381 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:30:54 user nova-compute[75122]: WARNING nova.compute.manager [req-a9a685c2-ebc9-49f1-936f-e31a95b321f2 req-fc705855-41ff-4ad2-ab39-27609a50157b service nova] [instance: 131142fd-e8ec-42d1-a518-aa21c7bb7cb1] Received unexpected event network-vif-plugged-f8302d0d-f140-479c-96da-b21516385381 for instance with vm_state active and task_state None.
Nov 15 09:30:54 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:30:55 user nova-compute[75122]: DEBUG nova.compute.manager [req-57ef7a4d-ef75-4b00-9865-56ddb06e5a7b req-b7cf5583-1413-4b2f-b49b-bd6bea95b2a8 service nova] [instance: 9cfb60cb-011e-4537-9f28-55ea7d6dfc13] Received event network-vif-plugged-f46032a9-bba1-47d0-aa79-dc66f360bc46 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:30:55 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-57ef7a4d-ef75-4b00-9865-56ddb06e5a7b req-b7cf5583-1413-4b2f-b49b-bd6bea95b2a8 service nova] Acquiring lock "9cfb60cb-011e-4537-9f28-55ea7d6dfc13-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:30:55 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-57ef7a4d-ef75-4b00-9865-56ddb06e5a7b req-b7cf5583-1413-4b2f-b49b-bd6bea95b2a8 service nova] Lock "9cfb60cb-011e-4537-9f28-55ea7d6dfc13-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:30:55 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-57ef7a4d-ef75-4b00-9865-56ddb06e5a7b req-b7cf5583-1413-4b2f-b49b-bd6bea95b2a8 service nova] Lock "9cfb60cb-011e-4537-9f28-55ea7d6dfc13-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:30:55 user nova-compute[75122]: DEBUG nova.compute.manager [req-57ef7a4d-ef75-4b00-9865-56ddb06e5a7b req-b7cf5583-1413-4b2f-b49b-bd6bea95b2a8 service nova] [instance: 9cfb60cb-011e-4537-9f28-55ea7d6dfc13] No waiting events found dispatching network-vif-plugged-f46032a9-bba1-47d0-aa79-dc66f360bc46 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:30:55 user nova-compute[75122]: WARNING nova.compute.manager [req-57ef7a4d-ef75-4b00-9865-56ddb06e5a7b req-b7cf5583-1413-4b2f-b49b-bd6bea95b2a8 service nova] [instance: 9cfb60cb-011e-4537-9f28-55ea7d6dfc13] Received unexpected event network-vif-plugged-f46032a9-bba1-47d0-aa79-dc66f360bc46 for instance with vm_state building and task_state spawning.
Nov 15 09:30:55 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:30:56 user nova-compute[75122]: DEBUG nova.compute.manager [None req-05409caf-c46b-453b-8ce4-ee7350683e22 tempest-VolumesAssistedSnapshotsTest-203861085 tempest-VolumesAssistedSnapshotsTest-203861085-project-member] [instance: 9cfb60cb-011e-4537-9f28-55ea7d6dfc13] Instance event wait completed in 0 seconds for  {{(pid=75122) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 09:30:56 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-05409caf-c46b-453b-8ce4-ee7350683e22 tempest-VolumesAssistedSnapshotsTest-203861085 tempest-VolumesAssistedSnapshotsTest-203861085-project-member] [instance: 9cfb60cb-011e-4537-9f28-55ea7d6dfc13] Guest created on hypervisor {{(pid=75122) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 09:30:56 user nova-compute[75122]: INFO nova.virt.libvirt.driver [-] [instance: 9cfb60cb-011e-4537-9f28-55ea7d6dfc13] Instance spawned successfully.
Nov 15 09:30:56 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-05409caf-c46b-453b-8ce4-ee7350683e22 tempest-VolumesAssistedSnapshotsTest-203861085 tempest-VolumesAssistedSnapshotsTest-203861085-project-member] [instance: 9cfb60cb-011e-4537-9f28-55ea7d6dfc13] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 09:30:56 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-05409caf-c46b-453b-8ce4-ee7350683e22 tempest-VolumesAssistedSnapshotsTest-203861085 tempest-VolumesAssistedSnapshotsTest-203861085-project-member] [instance: 9cfb60cb-011e-4537-9f28-55ea7d6dfc13] Found default for hw_cdrom_bus of ide {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:30:56 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-05409caf-c46b-453b-8ce4-ee7350683e22 tempest-VolumesAssistedSnapshotsTest-203861085 tempest-VolumesAssistedSnapshotsTest-203861085-project-member] [instance: 9cfb60cb-011e-4537-9f28-55ea7d6dfc13] Found default for hw_disk_bus of virtio {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:30:56 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-05409caf-c46b-453b-8ce4-ee7350683e22 tempest-VolumesAssistedSnapshotsTest-203861085 tempest-VolumesAssistedSnapshotsTest-203861085-project-member] [instance: 9cfb60cb-011e-4537-9f28-55ea7d6dfc13] Found default for hw_input_bus of None {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:30:56 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-05409caf-c46b-453b-8ce4-ee7350683e22 tempest-VolumesAssistedSnapshotsTest-203861085 tempest-VolumesAssistedSnapshotsTest-203861085-project-member] [instance: 9cfb60cb-011e-4537-9f28-55ea7d6dfc13] Found default for hw_pointer_model of None {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:30:56 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-05409caf-c46b-453b-8ce4-ee7350683e22 tempest-VolumesAssistedSnapshotsTest-203861085 tempest-VolumesAssistedSnapshotsTest-203861085-project-member] [instance: 9cfb60cb-011e-4537-9f28-55ea7d6dfc13] Found default for hw_video_model of virtio {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:30:56 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-05409caf-c46b-453b-8ce4-ee7350683e22 tempest-VolumesAssistedSnapshotsTest-203861085 tempest-VolumesAssistedSnapshotsTest-203861085-project-member] [instance: 9cfb60cb-011e-4537-9f28-55ea7d6dfc13] Found default for hw_vif_model of virtio {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:30:56 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:30:56 user nova-compute[75122]: INFO nova.compute.manager [None req-05409caf-c46b-453b-8ce4-ee7350683e22 tempest-VolumesAssistedSnapshotsTest-203861085 tempest-VolumesAssistedSnapshotsTest-203861085-project-member] [instance: 9cfb60cb-011e-4537-9f28-55ea7d6dfc13] Took 8.66 seconds to spawn the instance on the hypervisor.
Nov 15 09:30:56 user nova-compute[75122]: DEBUG nova.compute.manager [None req-05409caf-c46b-453b-8ce4-ee7350683e22 tempest-VolumesAssistedSnapshotsTest-203861085 tempest-VolumesAssistedSnapshotsTest-203861085-project-member] [instance: 9cfb60cb-011e-4537-9f28-55ea7d6dfc13] Checking state {{(pid=75122) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 09:30:56 user nova-compute[75122]: INFO nova.compute.manager [None req-05409caf-c46b-453b-8ce4-ee7350683e22 tempest-VolumesAssistedSnapshotsTest-203861085 tempest-VolumesAssistedSnapshotsTest-203861085-project-member] [instance: 9cfb60cb-011e-4537-9f28-55ea7d6dfc13] Took 9.94 seconds to build instance.
Nov 15 09:30:56 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-05409caf-c46b-453b-8ce4-ee7350683e22 tempest-VolumesAssistedSnapshotsTest-203861085 tempest-VolumesAssistedSnapshotsTest-203861085-project-member] Lock "9cfb60cb-011e-4537-9f28-55ea7d6dfc13" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.097s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:30:58 user nova-compute[75122]: DEBUG nova.compute.manager [req-adda3597-fbc3-4054-aa50-0a3eb46db7ca req-f82fc4ca-7b78-4302-9e86-7fc1b2d8dfa8 service nova] [instance: bcb58c79-f6b3-44d9-a80f-1a4cf580379f] Received event network-vif-plugged-364a329a-8a90-43f6-9927-0c07dc1d6cbe {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:30:58 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-adda3597-fbc3-4054-aa50-0a3eb46db7ca req-f82fc4ca-7b78-4302-9e86-7fc1b2d8dfa8 service nova] Acquiring lock "bcb58c79-f6b3-44d9-a80f-1a4cf580379f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:30:58 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-adda3597-fbc3-4054-aa50-0a3eb46db7ca req-f82fc4ca-7b78-4302-9e86-7fc1b2d8dfa8 service nova] Lock "bcb58c79-f6b3-44d9-a80f-1a4cf580379f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:30:58 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-adda3597-fbc3-4054-aa50-0a3eb46db7ca req-f82fc4ca-7b78-4302-9e86-7fc1b2d8dfa8 service nova] Lock "bcb58c79-f6b3-44d9-a80f-1a4cf580379f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:30:58 user nova-compute[75122]: DEBUG nova.compute.manager [req-adda3597-fbc3-4054-aa50-0a3eb46db7ca req-f82fc4ca-7b78-4302-9e86-7fc1b2d8dfa8 service nova] [instance: bcb58c79-f6b3-44d9-a80f-1a4cf580379f] No waiting events found dispatching network-vif-plugged-364a329a-8a90-43f6-9927-0c07dc1d6cbe {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:30:58 user nova-compute[75122]: WARNING nova.compute.manager [req-adda3597-fbc3-4054-aa50-0a3eb46db7ca req-f82fc4ca-7b78-4302-9e86-7fc1b2d8dfa8 service nova] [instance: bcb58c79-f6b3-44d9-a80f-1a4cf580379f] Received unexpected event network-vif-plugged-364a329a-8a90-43f6-9927-0c07dc1d6cbe for instance with vm_state active and task_state None.
Nov 15 09:30:58 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:30:59 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:31:00 user nova-compute[75122]: DEBUG nova.compute.manager [req-ddfa0f60-5954-487a-b9b6-7998e93065ef req-2aa6e426-5d4d-4ae6-8932-ff7c3c8c0381 service nova] [instance: bcb58c79-f6b3-44d9-a80f-1a4cf580379f] Received event network-vif-plugged-364a329a-8a90-43f6-9927-0c07dc1d6cbe {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:31:00 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-ddfa0f60-5954-487a-b9b6-7998e93065ef req-2aa6e426-5d4d-4ae6-8932-ff7c3c8c0381 service nova] Acquiring lock "bcb58c79-f6b3-44d9-a80f-1a4cf580379f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:31:00 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-ddfa0f60-5954-487a-b9b6-7998e93065ef req-2aa6e426-5d4d-4ae6-8932-ff7c3c8c0381 service nova] Lock "bcb58c79-f6b3-44d9-a80f-1a4cf580379f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:31:00 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-ddfa0f60-5954-487a-b9b6-7998e93065ef req-2aa6e426-5d4d-4ae6-8932-ff7c3c8c0381 service nova] Lock "bcb58c79-f6b3-44d9-a80f-1a4cf580379f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:31:00 user nova-compute[75122]: DEBUG nova.compute.manager [req-ddfa0f60-5954-487a-b9b6-7998e93065ef req-2aa6e426-5d4d-4ae6-8932-ff7c3c8c0381 service nova] [instance: bcb58c79-f6b3-44d9-a80f-1a4cf580379f] No waiting events found dispatching network-vif-plugged-364a329a-8a90-43f6-9927-0c07dc1d6cbe {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:31:00 user nova-compute[75122]: WARNING nova.compute.manager [req-ddfa0f60-5954-487a-b9b6-7998e93065ef req-2aa6e426-5d4d-4ae6-8932-ff7c3c8c0381 service nova] [instance: bcb58c79-f6b3-44d9-a80f-1a4cf580379f] Received unexpected event network-vif-plugged-364a329a-8a90-43f6-9927-0c07dc1d6cbe for instance with vm_state active and task_state None.
Nov 15 09:31:00 user nova-compute[75122]: DEBUG nova.compute.manager [req-ddfa0f60-5954-487a-b9b6-7998e93065ef req-2aa6e426-5d4d-4ae6-8932-ff7c3c8c0381 service nova] [instance: fa52b2a0-e5a0-4f93-a1cf-fef4a8313368] Received event network-vif-plugged-942f4024-43e2-4488-a7fd-c9de9bab7162 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:31:00 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-ddfa0f60-5954-487a-b9b6-7998e93065ef req-2aa6e426-5d4d-4ae6-8932-ff7c3c8c0381 service nova] Acquiring lock "fa52b2a0-e5a0-4f93-a1cf-fef4a8313368-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:31:00 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-ddfa0f60-5954-487a-b9b6-7998e93065ef req-2aa6e426-5d4d-4ae6-8932-ff7c3c8c0381 service nova] Lock "fa52b2a0-e5a0-4f93-a1cf-fef4a8313368-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:31:00 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-ddfa0f60-5954-487a-b9b6-7998e93065ef req-2aa6e426-5d4d-4ae6-8932-ff7c3c8c0381 service nova] Lock "fa52b2a0-e5a0-4f93-a1cf-fef4a8313368-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:31:00 user nova-compute[75122]: DEBUG nova.compute.manager [req-ddfa0f60-5954-487a-b9b6-7998e93065ef req-2aa6e426-5d4d-4ae6-8932-ff7c3c8c0381 service nova] [instance: fa52b2a0-e5a0-4f93-a1cf-fef4a8313368] No waiting events found dispatching network-vif-plugged-942f4024-43e2-4488-a7fd-c9de9bab7162 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:31:00 user nova-compute[75122]: WARNING nova.compute.manager [req-ddfa0f60-5954-487a-b9b6-7998e93065ef req-2aa6e426-5d4d-4ae6-8932-ff7c3c8c0381 service nova] [instance: fa52b2a0-e5a0-4f93-a1cf-fef4a8313368] Received unexpected event network-vif-plugged-942f4024-43e2-4488-a7fd-c9de9bab7162 for instance with vm_state active and task_state None.
Nov 15 09:31:00 user nova-compute[75122]: DEBUG nova.compute.manager [req-ddfa0f60-5954-487a-b9b6-7998e93065ef req-2aa6e426-5d4d-4ae6-8932-ff7c3c8c0381 service nova] [instance: fa52b2a0-e5a0-4f93-a1cf-fef4a8313368] Received event network-vif-plugged-942f4024-43e2-4488-a7fd-c9de9bab7162 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:31:00 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-ddfa0f60-5954-487a-b9b6-7998e93065ef req-2aa6e426-5d4d-4ae6-8932-ff7c3c8c0381 service nova] Acquiring lock "fa52b2a0-e5a0-4f93-a1cf-fef4a8313368-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:31:00 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-ddfa0f60-5954-487a-b9b6-7998e93065ef req-2aa6e426-5d4d-4ae6-8932-ff7c3c8c0381 service nova] Lock "fa52b2a0-e5a0-4f93-a1cf-fef4a8313368-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:31:00 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-ddfa0f60-5954-487a-b9b6-7998e93065ef req-2aa6e426-5d4d-4ae6-8932-ff7c3c8c0381 service nova] Lock "fa52b2a0-e5a0-4f93-a1cf-fef4a8313368-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:31:00 user nova-compute[75122]: DEBUG nova.compute.manager [req-ddfa0f60-5954-487a-b9b6-7998e93065ef req-2aa6e426-5d4d-4ae6-8932-ff7c3c8c0381 service nova] [instance: fa52b2a0-e5a0-4f93-a1cf-fef4a8313368] No waiting events found dispatching network-vif-plugged-942f4024-43e2-4488-a7fd-c9de9bab7162 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:31:00 user nova-compute[75122]: WARNING nova.compute.manager [req-ddfa0f60-5954-487a-b9b6-7998e93065ef req-2aa6e426-5d4d-4ae6-8932-ff7c3c8c0381 service nova] [instance: fa52b2a0-e5a0-4f93-a1cf-fef4a8313368] Received unexpected event network-vif-plugged-942f4024-43e2-4488-a7fd-c9de9bab7162 for instance with vm_state active and task_state None.
Nov 15 09:31:01 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:31:03 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:31:03 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Cleaning up deleted instances {{(pid=75122) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 15 09:31:03 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] There are 0 instances to clean {{(pid=75122) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 15 09:31:03 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:31:03 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75122) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 15 09:31:03 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:31:04 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:31:06 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:31:06 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:31:06 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75122) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 09:31:06 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:31:07 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:31:07 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:31:07 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-6b5822fe-6577-4aad-ae29-c7e5976dd4f6 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] Acquiring lock "f7d1a157-3228-490e-a6a0-68f6bd2b52ba" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:31:07 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-6b5822fe-6577-4aad-ae29-c7e5976dd4f6 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] Lock "f7d1a157-3228-490e-a6a0-68f6bd2b52ba" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:31:07 user nova-compute[75122]: DEBUG nova.compute.manager [None req-6b5822fe-6577-4aad-ae29-c7e5976dd4f6 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] [instance: f7d1a157-3228-490e-a6a0-68f6bd2b52ba] Starting instance... {{(pid=75122) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 09:31:07 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-6b5822fe-6577-4aad-ae29-c7e5976dd4f6 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:31:07 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-6b5822fe-6577-4aad-ae29-c7e5976dd4f6 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:31:07 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-6b5822fe-6577-4aad-ae29-c7e5976dd4f6 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75122) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 09:31:07 user nova-compute[75122]: INFO nova.compute.claims [None req-6b5822fe-6577-4aad-ae29-c7e5976dd4f6 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] [instance: f7d1a157-3228-490e-a6a0-68f6bd2b52ba] Claim successful on node user
Nov 15 09:31:07 user nova-compute[75122]: DEBUG nova.compute.provider_tree [None req-6b5822fe-6577-4aad-ae29-c7e5976dd4f6 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] Inventory has not changed in ProviderTree for provider: 69a3da65-47be-44c6-b67c-c692b58284ef {{(pid=75122) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 09:31:07 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-6b5822fe-6577-4aad-ae29-c7e5976dd4f6 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] Inventory has not changed for provider 69a3da65-47be-44c6-b67c-c692b58284ef based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 09:31:07 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-6b5822fe-6577-4aad-ae29-c7e5976dd4f6 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.393s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:31:07 user nova-compute[75122]: DEBUG nova.compute.manager [None req-6b5822fe-6577-4aad-ae29-c7e5976dd4f6 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] [instance: f7d1a157-3228-490e-a6a0-68f6bd2b52ba] Start building networks asynchronously for instance. {{(pid=75122) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 09:31:08 user nova-compute[75122]: DEBUG nova.compute.manager [None req-6b5822fe-6577-4aad-ae29-c7e5976dd4f6 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] [instance: f7d1a157-3228-490e-a6a0-68f6bd2b52ba] Allocating IP information in the background. {{(pid=75122) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 09:31:08 user nova-compute[75122]: DEBUG nova.network.neutron [None req-6b5822fe-6577-4aad-ae29-c7e5976dd4f6 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] [instance: f7d1a157-3228-490e-a6a0-68f6bd2b52ba] allocate_for_instance() {{(pid=75122) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 09:31:08 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-6b5822fe-6577-4aad-ae29-c7e5976dd4f6 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] [instance: f7d1a157-3228-490e-a6a0-68f6bd2b52ba] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 09:31:08 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:31:08 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:31:08 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:31:08 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:31:08 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:31:08 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75122) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 09:31:08 user nova-compute[75122]: DEBUG nova.compute.manager [None req-6b5822fe-6577-4aad-ae29-c7e5976dd4f6 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] [instance: f7d1a157-3228-490e-a6a0-68f6bd2b52ba] Start building block device mappings for instance. {{(pid=75122) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 09:31:08 user nova-compute[75122]: DEBUG nova.policy [None req-6b5822fe-6577-4aad-ae29-c7e5976dd4f6 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f9f813d56e87487498cb9f8454ea1651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea59215474b04143951de2b9453a33ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75122) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 09:31:08 user nova-compute[75122]: INFO nova.virt.block_device [None req-6b5822fe-6577-4aad-ae29-c7e5976dd4f6 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] [instance: f7d1a157-3228-490e-a6a0-68f6bd2b52ba] Booting with volume d1b088a7-71ac-43f7-8ee4-c9a32a33681e at /dev/vda
Nov 15 09:31:08 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee961d5a-e0d1-4931-9293-eefbe638097a/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:31:08 user nova-compute[75122]: DEBUG os_brick.utils [None req-6b5822fe-6577-4aad-ae29-c7e5976dd4f6 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 09:31:08 user nova-compute[75122]: INFO oslo.privsep.daemon [None req-6b5822fe-6577-4aad-ae29-c7e5976dd4f6 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmpe45vcw2z/privsep.sock']
Nov 15 09:31:08 user sudo[85976]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmpe45vcw2z/privsep.sock
Nov 15 09:31:08 user sudo[85976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 15 09:31:08 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee961d5a-e0d1-4931-9293-eefbe638097a/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:31:08 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee961d5a-e0d1-4931-9293-eefbe638097a/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:31:08 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee961d5a-e0d1-4931-9293-eefbe638097a/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:31:08 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b582e5d-eef1-41f6-84b5-102efe3bf3f8/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:31:08 user nova-compute[75122]: DEBUG nova.network.neutron [None req-6b5822fe-6577-4aad-ae29-c7e5976dd4f6 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] [instance: f7d1a157-3228-490e-a6a0-68f6bd2b52ba] Successfully created port: caf104ef-b652-4038-8203-76f14e4b666b {{(pid=75122) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 09:31:09 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b582e5d-eef1-41f6-84b5-102efe3bf3f8/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:31:09 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b582e5d-eef1-41f6-84b5-102efe3bf3f8/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:31:09 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b582e5d-eef1-41f6-84b5-102efe3bf3f8/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:31:09 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcb58c79-f6b3-44d9-a80f-1a4cf580379f/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:31:09 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcb58c79-f6b3-44d9-a80f-1a4cf580379f/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:31:09 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcb58c79-f6b3-44d9-a80f-1a4cf580379f/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:31:09 user nova-compute[75122]: DEBUG nova.network.neutron [None req-6b5822fe-6577-4aad-ae29-c7e5976dd4f6 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] [instance: f7d1a157-3228-490e-a6a0-68f6bd2b52ba] Successfully updated port: caf104ef-b652-4038-8203-76f14e4b666b {{(pid=75122) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 09:31:09 user nova-compute[75122]: DEBUG nova.compute.manager [req-db5c4e93-078e-4218-b168-b6302988e461 req-8f03dee2-7afb-45eb-8843-8141c8bd347c service nova] [instance: f7d1a157-3228-490e-a6a0-68f6bd2b52ba] Received event network-changed-caf104ef-b652-4038-8203-76f14e4b666b {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:31:09 user nova-compute[75122]: DEBUG nova.compute.manager [req-db5c4e93-078e-4218-b168-b6302988e461 req-8f03dee2-7afb-45eb-8843-8141c8bd347c service nova] [instance: f7d1a157-3228-490e-a6a0-68f6bd2b52ba] Refreshing instance network info cache due to event network-changed-caf104ef-b652-4038-8203-76f14e4b666b. {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 09:31:09 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-db5c4e93-078e-4218-b168-b6302988e461 req-8f03dee2-7afb-45eb-8843-8141c8bd347c service nova] Acquiring lock "refresh_cache-f7d1a157-3228-490e-a6a0-68f6bd2b52ba" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 09:31:09 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-db5c4e93-078e-4218-b168-b6302988e461 req-8f03dee2-7afb-45eb-8843-8141c8bd347c service nova] Acquired lock "refresh_cache-f7d1a157-3228-490e-a6a0-68f6bd2b52ba" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 09:31:09 user nova-compute[75122]: DEBUG nova.network.neutron [req-db5c4e93-078e-4218-b168-b6302988e461 req-8f03dee2-7afb-45eb-8843-8141c8bd347c service nova] [instance: f7d1a157-3228-490e-a6a0-68f6bd2b52ba] Refreshing network info cache for port caf104ef-b652-4038-8203-76f14e4b666b {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 09:31:09 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-6b5822fe-6577-4aad-ae29-c7e5976dd4f6 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] Acquiring lock "refresh_cache-f7d1a157-3228-490e-a6a0-68f6bd2b52ba" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 09:31:09 user nova-compute[75122]: DEBUG nova.network.neutron [req-db5c4e93-078e-4218-b168-b6302988e461 req-8f03dee2-7afb-45eb-8843-8141c8bd347c service nova] [instance: f7d1a157-3228-490e-a6a0-68f6bd2b52ba] Instance cache missing network info. {{(pid=75122) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 09:31:09 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcb58c79-f6b3-44d9-a80f-1a4cf580379f/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:31:09 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cfb60cb-011e-4537-9f28-55ea7d6dfc13/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:31:09 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:31:09 user nova-compute[75122]: DEBUG nova.network.neutron [req-db5c4e93-078e-4218-b168-b6302988e461 req-8f03dee2-7afb-45eb-8843-8141c8bd347c service nova] [instance: f7d1a157-3228-490e-a6a0-68f6bd2b52ba] Updating instance_info_cache with network_info: [] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:31:09 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cfb60cb-011e-4537-9f28-55ea7d6dfc13/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:31:09 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cfb60cb-011e-4537-9f28-55ea7d6dfc13/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:31:09 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-db5c4e93-078e-4218-b168-b6302988e461 req-8f03dee2-7afb-45eb-8843-8141c8bd347c service nova] Releasing lock "refresh_cache-f7d1a157-3228-490e-a6a0-68f6bd2b52ba" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 09:31:09 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-6b5822fe-6577-4aad-ae29-c7e5976dd4f6 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] Acquired lock "refresh_cache-f7d1a157-3228-490e-a6a0-68f6bd2b52ba" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 09:31:09 user nova-compute[75122]: DEBUG nova.network.neutron [None req-6b5822fe-6577-4aad-ae29-c7e5976dd4f6 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] [instance: f7d1a157-3228-490e-a6a0-68f6bd2b52ba] Building network info cache for instance {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 09:31:09 user nova-compute[75122]: DEBUG nova.network.neutron [None req-6b5822fe-6577-4aad-ae29-c7e5976dd4f6 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] [instance: f7d1a157-3228-490e-a6a0-68f6bd2b52ba] Instance cache missing network info. {{(pid=75122) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 09:31:10 user sudo[85976]: pam_unix(sudo:session): session closed for user root
Nov 15 09:31:10 user nova-compute[75122]: INFO oslo.privsep.daemon [None req-6b5822fe-6577-4aad-ae29-c7e5976dd4f6 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] Spawned new privsep daemon via rootwrap
Nov 15 09:31:10 user nova-compute[75122]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 15 09:31:10 user nova-compute[75122]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 15 09:31:10 user nova-compute[75122]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Nov 15 09:31:10 user nova-compute[75122]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 85998
Nov 15 09:31:10 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cfb60cb-011e-4537-9f28-55ea7d6dfc13/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:31:10 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d323d39-518d-41dd-8c07-42ff71280223]: (2,) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:31:10 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa52b2a0-e5a0-4f93-a1cf-fef4a8313368/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:31:10 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:31:10 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa52b2a0-e5a0-4f93-a1cf-fef4a8313368/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:31:10 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa52b2a0-e5a0-4f93-a1cf-fef4a8313368/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:31:10 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:31:10 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce00016c-b3cb-4d3a-b812-953572f8724c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:742fb64b3587\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:31:10 user nova-compute[75122]: DEBUG nova.network.neutron [None req-6b5822fe-6577-4aad-ae29-c7e5976dd4f6 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] [instance: f7d1a157-3228-490e-a6a0-68f6bd2b52ba] Updating instance_info_cache with network_info: [{"id": "caf104ef-b652-4038-8203-76f14e4b666b", "address": "fa:16:3e:6f:84:74", "network": {"id": "a2e4fc06-5a74-45cd-b530-6dd240bfd068", "bridge": "br-int", "label": "tempest-TestShelveInstance-1307896814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea59215474b04143951de2b9453a33ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcaf104ef-b6", "ovs_interfaceid": "caf104ef-b652-4038-8203-76f14e4b666b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:31:10 user nova-compute[75122]: WARNING os_brick.initiator.connectors.nvmeof [None req-6b5822fe-6577-4aad-ae29-c7e5976dd4f6 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Nov 15 09:31:10 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:31:10 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:31:10 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[16c82b0d-e769-40c7-839a-9fb537cc6fdf]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:31:10 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-6b5822fe-6577-4aad-ae29-c7e5976dd4f6 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] Releasing lock "refresh_cache-f7d1a157-3228-490e-a6a0-68f6bd2b52ba" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 09:31:10 user nova-compute[75122]: DEBUG nova.compute.manager [None req-6b5822fe-6577-4aad-ae29-c7e5976dd4f6 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] [instance: f7d1a157-3228-490e-a6a0-68f6bd2b52ba] Instance network_info: |[{"id": "caf104ef-b652-4038-8203-76f14e4b666b", "address": "fa:16:3e:6f:84:74", "network": {"id": "a2e4fc06-5a74-45cd-b530-6dd240bfd068", "bridge": "br-int", "label": "tempest-TestShelveInstance-1307896814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea59215474b04143951de2b9453a33ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcaf104ef-b6", "ovs_interfaceid": "caf104ef-b652-4038-8203-76f14e4b666b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75122) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 09:31:10 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:31:10 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:31:10 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[60c505a4-fc91-44e1-b723-4e986767c298]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:31:10 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[06d02b61-3dc3-4744-8f65-e87943bfedb5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:31:10 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-6b5822fe-6577-4aad-ae29-c7e5976dd4f6 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] Running cmd (subprocess): nvme version {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:31:10 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-6b5822fe-6577-4aad-ae29-c7e5976dd4f6 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] 'nvme version' failed. Not Retrying. {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 09:31:10 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6b5822fe-6577-4aad-ae29-c7e5976dd4f6 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] nvme not present on system {{(pid=75122) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 09:31:10 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:31:10 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 09:31:10 user nova-compute[75122]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 09:31:10 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eb0ae29-3fb9-48dd-9529-b56cf421d36c]: (4, '') {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:31:10 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.lightos [None req-6b5822fe-6577-4aad-ae29-c7e5976dd4f6 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75122) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 09:31:10 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.lightos [None req-6b5822fe-6577-4aad-ae29-c7e5976dd4f6 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75122) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 09:31:10 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.lightos [None req-6b5822fe-6577-4aad-ae29-c7e5976dd4f6 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] LIGHTOS: no hostnqn found. {{(pid=75122) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 09:31:10 user nova-compute[75122]: DEBUG os_brick.utils [None req-6b5822fe-6577-4aad-ae29-c7e5976dd4f6 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] <== get_connector_properties: return (1902ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:742fb64b3587', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 09:31:10 user nova-compute[75122]: DEBUG nova.virt.block_device [None req-6b5822fe-6577-4aad-ae29-c7e5976dd4f6 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] [instance: f7d1a157-3228-490e-a6a0-68f6bd2b52ba] Updating existing volume attachment record: ea7cab76-0770-407b-bc1e-c7977cdf60fb {{(pid=75122) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 09:31:10 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa52b2a0-e5a0-4f93-a1cf-fef4a8313368/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:31:10 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/131142fd-e8ec-42d1-a518-aa21c7bb7cb1/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:31:10 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/131142fd-e8ec-42d1-a518-aa21c7bb7cb1/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:31:10 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/131142fd-e8ec-42d1-a518-aa21c7bb7cb1/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:31:10 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/131142fd-e8ec-42d1-a518-aa21c7bb7cb1/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:31:10 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d24a189e-2de9-404e-b281-224c150a5bbf/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:31:11 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d24a189e-2de9-404e-b281-224c150a5bbf/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:31:11 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d24a189e-2de9-404e-b281-224c150a5bbf/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:31:11 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d24a189e-2de9-404e-b281-224c150a5bbf/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:31:11 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:31:11 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0f32160-7130-4b9c-aa9c-84123f3a6b32/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:31:11 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0f32160-7130-4b9c-aa9c-84123f3a6b32/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:31:11 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0f32160-7130-4b9c-aa9c-84123f3a6b32/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:31:11 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0f32160-7130-4b9c-aa9c-84123f3a6b32/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:31:12 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 09:31:12 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 09:31:12 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Hypervisor/Node resource view: name=user free_ram=7452MB free_disk=25.593196868896484GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75122) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 09:31:12 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:31:12 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:31:12 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance 4b582e5d-eef1-41f6-84b5-102efe3bf3f8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:31:12 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance ee961d5a-e0d1-4931-9293-eefbe638097a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:31:12 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance 131142fd-e8ec-42d1-a518-aa21c7bb7cb1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:31:12 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance bcb58c79-f6b3-44d9-a80f-1a4cf580379f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:31:12 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance e0f32160-7130-4b9c-aa9c-84123f3a6b32 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:31:12 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance d24a189e-2de9-404e-b281-224c150a5bbf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:31:12 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance fa52b2a0-e5a0-4f93-a1cf-fef4a8313368 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:31:12 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance 9cfb60cb-011e-4537-9f28-55ea7d6dfc13 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:31:12 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance f7d1a157-3228-490e-a6a0-68f6bd2b52ba actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:31:12 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75122) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 09:31:12 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75122) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 09:31:12 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Refreshing inventories for resource provider 69a3da65-47be-44c6-b67c-c692b58284ef {{(pid=75122) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 15 09:31:12 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Updating ProviderTree inventory for provider 69a3da65-47be-44c6-b67c-c692b58284ef from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 15 09:31:12 user nova-compute[75122]: DEBUG nova.compute.provider_tree [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Updating inventory in ProviderTree for provider 69a3da65-47be-44c6-b67c-c692b58284ef with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 15 09:31:12 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Refreshing aggregate associations for resource provider 69a3da65-47be-44c6-b67c-c692b58284ef, aggregates: None {{(pid=75122) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 15 09:31:12 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Refreshing trait associations for resource provider 69a3da65-47be-44c6-b67c-c692b58284ef, traits: COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_RESCUE_BFV,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE,COMPUTE_NODE,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_ACCELERATORS,HW_CPU_X86_MMX {{(pid=75122) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 15 09:31:12 user nova-compute[75122]: DEBUG nova.compute.provider_tree [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Inventory has not changed in ProviderTree for provider: 69a3da65-47be-44c6-b67c-c692b58284ef {{(pid=75122) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 09:31:12 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Inventory has not changed for provider 69a3da65-47be-44c6-b67c-c692b58284ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 09:31:12 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Compute_service record updated for user:user {{(pid=75122) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 09:31:12 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.714s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:31:13 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:31:13 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:31:13 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Starting heal instance info cache {{(pid=75122) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 09:31:13 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Rebuilding the list of instances to heal {{(pid=75122) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 09:31:13 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] [instance: f7d1a157-3228-490e-a6a0-68f6bd2b52ba] Skipping network cache update for instance because it is Building. {{(pid=75122) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 15 09:31:13 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "refresh_cache-4b582e5d-eef1-41f6-84b5-102efe3bf3f8" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 09:31:13 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquired lock "refresh_cache-4b582e5d-eef1-41f6-84b5-102efe3bf3f8" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 09:31:13 user nova-compute[75122]: DEBUG nova.network.neutron [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] [instance: 4b582e5d-eef1-41f6-84b5-102efe3bf3f8] Forcefully refreshing network info cache for instance {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 09:31:13 user nova-compute[75122]: DEBUG nova.objects.instance [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lazy-loading 'info_cache' on Instance uuid 4b582e5d-eef1-41f6-84b5-102efe3bf3f8 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:31:14 user nova-compute[75122]: DEBUG nova.network.neutron [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] [instance: 4b582e5d-eef1-41f6-84b5-102efe3bf3f8] Updating instance_info_cache with network_info: [{"id": "43e5af96-fffc-4d74-bbed-5a78ce800158", "address": "fa:16:3e:0d:bc:bc", "network": {"id": "0701c672-3bc3-4a49-afd0-6b439abd2956", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1112570222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59cfb5df524a4094a303619fb04ccbd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43e5af96-ff", "ovs_interfaceid": "43e5af96-fffc-4d74-bbed-5a78ce800158", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:31:14 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Releasing lock "refresh_cache-4b582e5d-eef1-41f6-84b5-102efe3bf3f8" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 09:31:14 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] [instance: 4b582e5d-eef1-41f6-84b5-102efe3bf3f8] Updated the network info_cache for instance {{(pid=75122) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 09:31:14 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:31:14 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:31:15 user nova-compute[75122]: DEBUG nova.compute.manager [None req-6b5822fe-6577-4aad-ae29-c7e5976dd4f6 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] [instance: f7d1a157-3228-490e-a6a0-68f6bd2b52ba] Start spawning the instance on the hypervisor. {{(pid=75122) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 09:31:15 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-6b5822fe-6577-4aad-ae29-c7e5976dd4f6 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] [instance: f7d1a157-3228-490e-a6a0-68f6bd2b52ba] Creating instance directory {{(pid=75122) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 09:31:15 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-6b5822fe-6577-4aad-ae29-c7e5976dd4f6 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] [instance: f7d1a157-3228-490e-a6a0-68f6bd2b52ba] Creating image(s)
Nov 15 09:31:15 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-6b5822fe-6577-4aad-ae29-c7e5976dd4f6 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] [instance: f7d1a157-3228-490e-a6a0-68f6bd2b52ba] Did not create local disks {{(pid=75122) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 09:31:15 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-6b5822fe-6577-4aad-ae29-c7e5976dd4f6 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] [instance: f7d1a157-3228-490e-a6a0-68f6bd2b52ba] Ensure instance console log exists: /opt/stack/data/nova/instances/f7d1a157-3228-490e-a6a0-68f6bd2b52ba/console.log {{(pid=75122) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 09:31:15 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-6b5822fe-6577-4aad-ae29-c7e5976dd4f6 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:31:15 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-6b5822fe-6577-4aad-ae29-c7e5976dd4f6 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:31:15 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-6b5822fe-6577-4aad-ae29-c7e5976dd4f6 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:31:15 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-6b5822fe-6577-4aad-ae29-c7e5976dd4f6 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] [instance: f7d1a157-3228-490e-a6a0-68f6bd2b52ba] Start _get_guest_xml network_info=[{"id": "caf104ef-b652-4038-8203-76f14e4b666b", "address": "fa:16:3e:6f:84:74", "network": {"id": "a2e4fc06-5a74-45cd-b530-6dd240bfd068", "bridge": "br-int", "label": "tempest-TestShelveInstance-1307896814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea59215474b04143951de2b9453a33ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcaf104ef-b6", "ovs_interfaceid": "caf104ef-b652-4038-8203-76f14e4b666b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pufAUkHv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f7d1a157-3228-490e-a6a0-68f6bd2b52ba', 'attached_at': '', 'detached_at': '', 'volume_id': 'd1b088a7-71ac-43f7-8ee4-c9a32a33681e', 'serial': 'd1b088a7-71ac-43f7-8ee4-c9a32a33681e'}, 'guest_format': None, 'delete_on_termination': True, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vda', 'attachment_id': 'ea7cab76-0770-407b-bc1e-c7977cdf60fb', 'volume_type': None} {{(pid=75122) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 09:31:15 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-6b5822fe-6577-4aad-ae29-c7e5976dd4f6 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 09:31:15 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-6b5822fe-6577-4aad-ae29-c7e5976dd4f6 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 09:31:15 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-6b5822fe-6577-4aad-ae29-c7e5976dd4f6 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75122) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 09:31:15 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-6b5822fe-6577-4aad-ae29-c7e5976dd4f6 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] CPU controller missing on host. {{(pid=75122) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 09:31:15 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-6b5822fe-6577-4aad-ae29-c7e5976dd4f6 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75122) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 09:31:15 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-6b5822fe-6577-4aad-ae29-c7e5976dd4f6 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] CPU controller found on host. {{(pid=75122) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 09:31:15 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-6b5822fe-6577-4aad-ae29-c7e5976dd4f6 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75122) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 09:31:15 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-6b5822fe-6577-4aad-ae29-c7e5976dd4f6 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T09:26:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 09:31:15 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-6b5822fe-6577-4aad-ae29-c7e5976dd4f6 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] Flavor limits 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 09:31:15 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-6b5822fe-6577-4aad-ae29-c7e5976dd4f6 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] Image limits 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 09:31:15 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-6b5822fe-6577-4aad-ae29-c7e5976dd4f6 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] Flavor pref 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 09:31:15 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-6b5822fe-6577-4aad-ae29-c7e5976dd4f6 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] Image pref 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 09:31:15 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-6b5822fe-6577-4aad-ae29-c7e5976dd4f6 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 09:31:15 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-6b5822fe-6577-4aad-ae29-c7e5976dd4f6 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 09:31:15 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-6b5822fe-6577-4aad-ae29-c7e5976dd4f6 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75122) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 09:31:15 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-6b5822fe-6577-4aad-ae29-c7e5976dd4f6 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] Got 1 possible topologies {{(pid=75122) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 09:31:15 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-6b5822fe-6577-4aad-ae29-c7e5976dd4f6 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 09:31:15 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-6b5822fe-6577-4aad-ae29-c7e5976dd4f6 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 09:31:15 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-6b5822fe-6577-4aad-ae29-c7e5976dd4f6 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:31:15 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-6b5822fe-6577-4aad-ae29-c7e5976dd4f6 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:31:15 user nova-compute[75122]: DEBUG os_brick.initiator.connector [None req-6b5822fe-6577-4aad-ae29-c7e5976dd4f6 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] Factory for ISCSI on None {{(pid=75122) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Nov 15 09:31:15 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-6b5822fe-6577-4aad-ae29-c7e5976dd4f6 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.005s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:31:15 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b5822fe-6577-4aad-ae29-c7e5976dd4f6 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] [instance: f7d1a157-3228-490e-a6a0-68f6bd2b52ba] Calling os-brick to attach iSCSI Volume {{(pid=75122) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 09:31:15 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b5822fe-6577-4aad-ae29-c7e5976dd4f6 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffa04060b80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pufAUkHv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 09:31:15 user nova-compute[75122]: WARNING os_brick.initiator.connectors.base [None req-6b5822fe-6577-4aad-ae29-c7e5976dd4f6 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 09:31:15 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-6b5822fe-6577-4aad-ae29-c7e5976dd4f6 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 09:31:15 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-6b5822fe-6577-4aad-ae29-c7e5976dd4f6 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 09:31:15 user nova-compute[75122]: WARNING os_brick.initiator.connectors.base [None req-6b5822fe-6577-4aad-ae29-c7e5976dd4f6 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 09:31:15 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-6b5822fe-6577-4aad-ae29-c7e5976dd4f6 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 09:31:15 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-6b5822fe-6577-4aad-ae29-c7e5976dd4f6 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 09:31:15 user nova-compute[75122]: INFO os_brick.initiator.connectors.iscsi [None req-6b5822fe-6577-4aad-ae29-c7e5976dd4f6 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 09:31:15 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e -p 172.16.0.220:3260 {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:31:15 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:31:15 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[df3774ac-1a5b-4aaf-a70c-02183fdb8f6d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:31:15 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b5822fe-6577-4aad-ae29-c7e5976dd4f6 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 09:31:15 user nova-compute[75122]:  {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:31:15 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e -p 172.16.0.220:3260 --interface default --op new {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:31:15 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:31:15 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaf65110-0f33-4e75-b9f6-97bd58e0a601]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e] added\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:31:15 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b5822fe-6577-4aad-ae29-c7e5976dd4f6 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e] added
Nov 15 09:31:15 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:31:15 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:31:15 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:31:15 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[26bc0263-5bf5-4999-9bef-f79ebc8807d8]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:31:15 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b5822fe-6577-4aad-ae29-c7e5976dd4f6 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:31:15 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:31:15 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:31:15 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4625f62-1a3b-4a6d-950b-2762a0bcfc2f]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:31:15 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b5822fe-6577-4aad-ae29-c7e5976dd4f6 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:31:15 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pufAUkHv {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:31:15 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pufAUkHv" returned: 0 in 0.019s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:31:15 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6ca3eec-ea72-4785-980d-7f1564487a61]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:31:15 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b5822fe-6577-4aad-ae29-c7e5976dd4f6 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pufAUkHv'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:31:15 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:31:15 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:31:15 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[8964360d-2c89-4c28-ba34-45580a53316f]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:31:15 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b5822fe-6577-4aad-ae29-c7e5976dd4f6 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:31:15 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:31:15 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:31:15 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7dea59b-c218-42cc-8991-397f2c87c67d]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:31:15 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b5822fe-6577-4aad-ae29-c7e5976dd4f6 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 15 09:31:15 user nova-compute[75122]:  {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 09:31:15 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b5822fe-6577-4aad-ae29-c7e5976dd4f6 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 15 09:31:15 user nova-compute[75122]:  {{(pid=75122) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 09:31:15 user nova-compute[75122]: WARNING os_brick.initiator.connectors.iscsi [None req-6b5822fe-6577-4aad-ae29-c7e5976dd4f6 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 15 09:31:15 user nova-compute[75122]: 
Nov 15 09:31:15 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e -p 172.16.0.220:3260 --login {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:31:15 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:31:15 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[69ca8587-2477-49a8-bd02-0ef9c0ce2198]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:31:15 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b5822fe-6577-4aad-ae29-c7e5976dd4f6 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e, portal: 172.16.0.220,3260]
Nov 15 09:31:15 user nova-compute[75122]: Login to [iface: default, target: iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e, portal: 172.16.0.220,3260] successful.
Nov 15 09:31:15 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:31:15 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:31:15 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:31:15 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6e8361a-24c4-49d5-a860-fab4a9f76b06]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:31:15 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b5822fe-6577-4aad-ae29-c7e5976dd4f6 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:31:15 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:31:15 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:31:15 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[29dd628a-f375-4584-b002-cddfa52fa8d7]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e (non-flash)\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:31:15 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b5822fe-6577-4aad-ae29-c7e5976dd4f6 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e (non-flash)
Nov 15 09:31:15 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 09:31:15 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b5822fe-6577-4aad-ae29-c7e5976dd4f6 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e (non-flash)
Nov 15 09:31:15 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 09:31:15 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-6b5822fe-6577-4aad-ae29-c7e5976dd4f6 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.263s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 09:31:15 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b5822fe-6577-4aad-ae29-c7e5976dd4f6 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] Connected to 172.16.0.220:3260 {{(pid=75122) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 09:31:15 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-6b5822fe-6577-4aad-ae29-c7e5976dd4f6 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=75122) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 09:31:15 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-6b5822fe-6577-4aad-ae29-c7e5976dd4f6 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75122) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 09:31:15 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:31:15 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.022s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:31:15 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1e5823b-70ed-4b9d-b080-0460c2ca549f]: (4, ('- - 0', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:31:15 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-6b5822fe-6577-4aad-ae29-c7e5976dd4f6 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: None {{(pid=75122) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 09:31:16 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:31:16 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-6b5822fe-6577-4aad-ae29-c7e5976dd4f6 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75122) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 09:31:16 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b5822fe-6577-4aad-ae29-c7e5976dd4f6 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pufAUkHv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75122) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 09:31:16 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-6b5822fe-6577-4aad-ae29-c7e5976dd4f6 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.301s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 09:31:16 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b5822fe-6577-4aad-ae29-c7e5976dd4f6 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] <== connect_volume: return (1302ms) {'type': 'block', 'scsi_wwn': '23239313437666239', 'path': '/dev/sdb'} {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 09:31:16 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b5822fe-6577-4aad-ae29-c7e5976dd4f6 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] [instance: f7d1a157-3228-490e-a6a0-68f6bd2b52ba] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23239313437666239', 'path': '/dev/sdb'} {{(pid=75122) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 09:31:16 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-6b5822fe-6577-4aad-ae29-c7e5976dd4f6 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T09:31:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-603494418',display_name='tempest-TestShelveInstance-server-603494418',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-603494418',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM1TXRuKGvJllPKsSM4nK/OBu35HIJIsxtD/v6uaAXCLNb3zEXMlSeDAMlpm1t/haK5aaWNbGgYXswqBLiz9PJ0GAIgGVUKBoNe3Kg7RG2viWDF+pHu6wjy1e1B8GyF19A==',key_name='tempest-TestShelveInstance-571538458',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ea59215474b04143951de2b9453a33ad',ramdisk_id='',reservation_id='r-rwg3hjam',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1849491535',owner_user_name='tempest-TestShelveInstance-1849491535-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T09:31:08Z,user_data=None,user_id='f9f813d56e87487498cb9f8454ea1651',uuid=f7d1a157-3228-490e-a6a0-68f6bd2b52ba,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "caf104ef-b652-4038-8203-76f14e4b666b", "address": "fa:16:3e:6f:84:74", "network": {"id": "a2e4fc06-5a74-45cd-b530-6dd240bfd068", "bridge": "br-int", "label": "tempest-TestShelveInstance-1307896814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea59215474b04143951de2b9453a33ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcaf104ef-b6", "ovs_interfaceid": "caf104ef-b652-4038-8203-76f14e4b666b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75122) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 09:31:16 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-6b5822fe-6577-4aad-ae29-c7e5976dd4f6 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] Converting VIF {"id": "caf104ef-b652-4038-8203-76f14e4b666b", "address": "fa:16:3e:6f:84:74", "network": {"id": "a2e4fc06-5a74-45cd-b530-6dd240bfd068", "bridge": "br-int", "label": "tempest-TestShelveInstance-1307896814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea59215474b04143951de2b9453a33ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcaf104ef-b6", "ovs_interfaceid": "caf104ef-b652-4038-8203-76f14e4b666b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 09:31:16 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-6b5822fe-6577-4aad-ae29-c7e5976dd4f6 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:84:74,bridge_name='br-int',has_traffic_filtering=True,id=caf104ef-b652-4038-8203-76f14e4b666b,network=Network(a2e4fc06-5a74-45cd-b530-6dd240bfd068),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcaf104ef-b6') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 09:31:16 user nova-compute[75122]: DEBUG nova.objects.instance [None req-6b5822fe-6577-4aad-ae29-c7e5976dd4f6 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] Lazy-loading 'pci_devices' on Instance uuid f7d1a157-3228-490e-a6a0-68f6bd2b52ba {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:31:17 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-6b5822fe-6577-4aad-ae29-c7e5976dd4f6 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] [instance: f7d1a157-3228-490e-a6a0-68f6bd2b52ba] End _get_guest_xml xml=<domain type="kvm">
Nov 15 09:31:17 user nova-compute[75122]:   <uuid>f7d1a157-3228-490e-a6a0-68f6bd2b52ba</uuid>
Nov 15 09:31:17 user nova-compute[75122]:   <name>instance-00000009</name>
Nov 15 09:31:17 user nova-compute[75122]:   <memory>524288</memory>
Nov 15 09:31:17 user nova-compute[75122]:   <vcpu>1</vcpu>
Nov 15 09:31:17 user nova-compute[75122]:   <metadata>
Nov 15 09:31:17 user nova-compute[75122]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 09:31:17 user nova-compute[75122]:       <nova:package version="0.0.0"/>
Nov 15 09:31:17 user nova-compute[75122]:       <nova:name>tempest-TestShelveInstance-server-603494418</nova:name>
Nov 15 09:31:17 user nova-compute[75122]:       <nova:creationTime>2023-11-15 09:31:15</nova:creationTime>
Nov 15 09:31:17 user nova-compute[75122]:       <nova:flavor name="m1.tiny">
Nov 15 09:31:17 user nova-compute[75122]:         <nova:memory>512</nova:memory>
Nov 15 09:31:17 user nova-compute[75122]:         <nova:disk>1</nova:disk>
Nov 15 09:31:17 user nova-compute[75122]:         <nova:swap>0</nova:swap>
Nov 15 09:31:17 user nova-compute[75122]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 09:31:17 user nova-compute[75122]:         <nova:vcpus>1</nova:vcpus>
Nov 15 09:31:17 user nova-compute[75122]:       </nova:flavor>
Nov 15 09:31:17 user nova-compute[75122]:       <nova:owner>
Nov 15 09:31:17 user nova-compute[75122]:         <nova:user uuid="f9f813d56e87487498cb9f8454ea1651">tempest-TestShelveInstance-1849491535-project-member</nova:user>
Nov 15 09:31:17 user nova-compute[75122]:         <nova:project uuid="ea59215474b04143951de2b9453a33ad">tempest-TestShelveInstance-1849491535</nova:project>
Nov 15 09:31:17 user nova-compute[75122]:       </nova:owner>
Nov 15 09:31:17 user nova-compute[75122]:       <nova:ports>
Nov 15 09:31:17 user nova-compute[75122]:         <nova:port uuid="caf104ef-b652-4038-8203-76f14e4b666b">
Nov 15 09:31:17 user nova-compute[75122]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 15 09:31:17 user nova-compute[75122]:         </nova:port>
Nov 15 09:31:17 user nova-compute[75122]:       </nova:ports>
Nov 15 09:31:17 user nova-compute[75122]:     </nova:instance>
Nov 15 09:31:17 user nova-compute[75122]:   </metadata>
Nov 15 09:31:17 user nova-compute[75122]:   <sysinfo type="smbios">
Nov 15 09:31:17 user nova-compute[75122]:     <system>
Nov 15 09:31:17 user nova-compute[75122]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 09:31:17 user nova-compute[75122]:       <entry name="product">OpenStack Nova</entry>
Nov 15 09:31:17 user nova-compute[75122]:       <entry name="version">0.0.0</entry>
Nov 15 09:31:17 user nova-compute[75122]:       <entry name="serial">f7d1a157-3228-490e-a6a0-68f6bd2b52ba</entry>
Nov 15 09:31:17 user nova-compute[75122]:       <entry name="uuid">f7d1a157-3228-490e-a6a0-68f6bd2b52ba</entry>
Nov 15 09:31:17 user nova-compute[75122]:       <entry name="family">Virtual Machine</entry>
Nov 15 09:31:17 user nova-compute[75122]:     </system>
Nov 15 09:31:17 user nova-compute[75122]:   </sysinfo>
Nov 15 09:31:17 user nova-compute[75122]:   <os>
Nov 15 09:31:17 user nova-compute[75122]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 09:31:17 user nova-compute[75122]:     <boot dev="hd"/>
Nov 15 09:31:17 user nova-compute[75122]:     <smbios mode="sysinfo"/>
Nov 15 09:31:17 user nova-compute[75122]:   </os>
Nov 15 09:31:17 user nova-compute[75122]:   <features>
Nov 15 09:31:17 user nova-compute[75122]:     <acpi/>
Nov 15 09:31:17 user nova-compute[75122]:     <apic/>
Nov 15 09:31:17 user nova-compute[75122]:     <vmcoreinfo/>
Nov 15 09:31:17 user nova-compute[75122]:   </features>
Nov 15 09:31:17 user nova-compute[75122]:   <clock offset="utc">
Nov 15 09:31:17 user nova-compute[75122]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 09:31:17 user nova-compute[75122]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 09:31:17 user nova-compute[75122]:     <timer name="hpet" present="no"/>
Nov 15 09:31:17 user nova-compute[75122]:   </clock>
Nov 15 09:31:17 user nova-compute[75122]:   <cpu mode="custom" match="exact">
Nov 15 09:31:17 user nova-compute[75122]:     <model>Nehalem</model>
Nov 15 09:31:17 user nova-compute[75122]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 09:31:17 user nova-compute[75122]:   </cpu>
Nov 15 09:31:17 user nova-compute[75122]:   <devices>
Nov 15 09:31:17 user nova-compute[75122]:     <disk type="block" device="disk">
Nov 15 09:31:17 user nova-compute[75122]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 09:31:17 user nova-compute[75122]:       <source dev="/dev/sdb"/>
Nov 15 09:31:17 user nova-compute[75122]:       <target dev="vda" bus="virtio"/>
Nov 15 09:31:17 user nova-compute[75122]:       <serial>d1b088a7-71ac-43f7-8ee4-c9a32a33681e</serial>
Nov 15 09:31:17 user nova-compute[75122]:     </disk>
Nov 15 09:31:17 user nova-compute[75122]:     <interface type="ethernet">
Nov 15 09:31:17 user nova-compute[75122]:       <mac address="fa:16:3e:6f:84:74"/>
Nov 15 09:31:17 user nova-compute[75122]:       <model type="virtio"/>
Nov 15 09:31:17 user nova-compute[75122]:       <mtu size="1442"/>
Nov 15 09:31:17 user nova-compute[75122]:       <target dev="tapcaf104ef-b6"/>
Nov 15 09:31:17 user nova-compute[75122]:     </interface>
Nov 15 09:31:17 user nova-compute[75122]:     <serial type="pty">
Nov 15 09:31:17 user nova-compute[75122]:       <log file="/opt/stack/data/nova/instances/f7d1a157-3228-490e-a6a0-68f6bd2b52ba/console.log" append="off"/>
Nov 15 09:31:17 user nova-compute[75122]:     </serial>
Nov 15 09:31:17 user nova-compute[75122]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 09:31:17 user nova-compute[75122]:     <video>
Nov 15 09:31:17 user nova-compute[75122]:       <model type="virtio"/>
Nov 15 09:31:17 user nova-compute[75122]:     </video>
Nov 15 09:31:17 user nova-compute[75122]:     <rng model="virtio">
Nov 15 09:31:17 user nova-compute[75122]:       <backend model="random">/dev/urandom</backend>
Nov 15 09:31:17 user nova-compute[75122]:     </rng>
Nov 15 09:31:17 user nova-compute[75122]:     <controller type="usb" index="0" model="none"/>
Nov 15 09:31:17 user nova-compute[75122]:     <memballoon model="virtio">
Nov 15 09:31:17 user nova-compute[75122]:       <stats period="10"/>
Nov 15 09:31:17 user nova-compute[75122]:     </memballoon>
Nov 15 09:31:17 user nova-compute[75122]:   </devices>
Nov 15 09:31:17 user nova-compute[75122]: </domain>
Nov 15 09:31:17 user nova-compute[75122]:  {{(pid=75122) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 09:31:17 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-6b5822fe-6577-4aad-ae29-c7e5976dd4f6 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T09:31:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-603494418',display_name='tempest-TestShelveInstance-server-603494418',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-603494418',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM1TXRuKGvJllPKsSM4nK/OBu35HIJIsxtD/v6uaAXCLNb3zEXMlSeDAMlpm1t/haK5aaWNbGgYXswqBLiz9PJ0GAIgGVUKBoNe3Kg7RG2viWDF+pHu6wjy1e1B8GyF19A==',key_name='tempest-TestShelveInstance-571538458',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ea59215474b04143951de2b9453a33ad',ramdisk_id='',reservation_id='r-rwg3hjam',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1849491535',owner_user_name='tempest-TestShelveInstance-1849491535-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T09:31:08Z,user_data=None,user_id='f9f813d56e87487498cb9f8454ea1651',uuid=f7d1a157-3228-490e-a6a0-68f6bd2b52ba,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "caf104ef-b652-4038-8203-76f14e4b666b", "address": "fa:16:3e:6f:84:74", "network": {"id": "a2e4fc06-5a74-45cd-b530-6dd240bfd068", "bridge": "br-int", "label": "tempest-TestShelveInstance-1307896814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea59215474b04143951de2b9453a33ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcaf104ef-b6", "ovs_interfaceid": "caf104ef-b652-4038-8203-76f14e4b666b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 09:31:17 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-6b5822fe-6577-4aad-ae29-c7e5976dd4f6 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] Converting VIF {"id": "caf104ef-b652-4038-8203-76f14e4b666b", "address": "fa:16:3e:6f:84:74", "network": {"id": "a2e4fc06-5a74-45cd-b530-6dd240bfd068", "bridge": "br-int", "label": "tempest-TestShelveInstance-1307896814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea59215474b04143951de2b9453a33ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcaf104ef-b6", "ovs_interfaceid": "caf104ef-b652-4038-8203-76f14e4b666b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 09:31:17 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-6b5822fe-6577-4aad-ae29-c7e5976dd4f6 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:84:74,bridge_name='br-int',has_traffic_filtering=True,id=caf104ef-b652-4038-8203-76f14e4b666b,network=Network(a2e4fc06-5a74-45cd-b530-6dd240bfd068),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcaf104ef-b6') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 09:31:17 user nova-compute[75122]: DEBUG os_vif [None req-6b5822fe-6577-4aad-ae29-c7e5976dd4f6 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:84:74,bridge_name='br-int',has_traffic_filtering=True,id=caf104ef-b652-4038-8203-76f14e4b666b,network=Network(a2e4fc06-5a74-45cd-b530-6dd240bfd068),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcaf104ef-b6') {{(pid=75122) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 09:31:17 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:31:17 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:31:17 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 09:31:17 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:31:17 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'affc42db-29a4-5ea3-b0fe-a3a73781f070', '_type': 'linux-noop'}}, row=False) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:31:17 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:31:17 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:31:17 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:31:17 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcaf104ef-b6, may_exist=True, interface_attrs={}) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:31:17 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcaf104ef-b6, col_values=(('qos', UUID('f4400662-c0f3-429c-9648-8e4aa5a25e93')),), if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:31:17 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcaf104ef-b6, col_values=(('external_ids', {'iface-id': 'caf104ef-b652-4038-8203-76f14e4b666b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6f:84:74', 'vm-uuid': 'f7d1a157-3228-490e-a6a0-68f6bd2b52ba'}),), if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:31:17 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:31:17 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:31:17 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:31:17 user nova-compute[75122]: INFO os_vif [None req-6b5822fe-6577-4aad-ae29-c7e5976dd4f6 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:84:74,bridge_name='br-int',has_traffic_filtering=True,id=caf104ef-b652-4038-8203-76f14e4b666b,network=Network(a2e4fc06-5a74-45cd-b530-6dd240bfd068),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcaf104ef-b6')
Nov 15 09:31:17 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-6b5822fe-6577-4aad-ae29-c7e5976dd4f6 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] No BDM found with device name vda, not building metadata. {{(pid=75122) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 09:31:17 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-6b5822fe-6577-4aad-ae29-c7e5976dd4f6 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] No VIF found with MAC fa:16:3e:6f:84:74, not building metadata {{(pid=75122) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 09:31:18 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:31:18 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:31:18 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:31:18 user nova-compute[75122]: DEBUG nova.compute.manager [req-73cb4920-ba7c-44c4-9487-5a5abbf9b583 req-fb4f6905-dac2-4738-be37-e2b0287863b3 service nova] [instance: f7d1a157-3228-490e-a6a0-68f6bd2b52ba] Received event network-vif-plugged-caf104ef-b652-4038-8203-76f14e4b666b {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:31:18 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-73cb4920-ba7c-44c4-9487-5a5abbf9b583 req-fb4f6905-dac2-4738-be37-e2b0287863b3 service nova] Acquiring lock "f7d1a157-3228-490e-a6a0-68f6bd2b52ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:31:18 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-73cb4920-ba7c-44c4-9487-5a5abbf9b583 req-fb4f6905-dac2-4738-be37-e2b0287863b3 service nova] Lock "f7d1a157-3228-490e-a6a0-68f6bd2b52ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:31:18 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-73cb4920-ba7c-44c4-9487-5a5abbf9b583 req-fb4f6905-dac2-4738-be37-e2b0287863b3 service nova] Lock "f7d1a157-3228-490e-a6a0-68f6bd2b52ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:31:18 user nova-compute[75122]: DEBUG nova.compute.manager [req-73cb4920-ba7c-44c4-9487-5a5abbf9b583 req-fb4f6905-dac2-4738-be37-e2b0287863b3 service nova] [instance: f7d1a157-3228-490e-a6a0-68f6bd2b52ba] No waiting events found dispatching network-vif-plugged-caf104ef-b652-4038-8203-76f14e4b666b {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:31:18 user nova-compute[75122]: WARNING nova.compute.manager [req-73cb4920-ba7c-44c4-9487-5a5abbf9b583 req-fb4f6905-dac2-4738-be37-e2b0287863b3 service nova] [instance: f7d1a157-3228-490e-a6a0-68f6bd2b52ba] Received unexpected event network-vif-plugged-caf104ef-b652-4038-8203-76f14e4b666b for instance with vm_state building and task_state spawning.
Nov 15 09:31:18 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:31:18 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:31:19 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:31:19 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:31:20 user nova-compute[75122]: DEBUG nova.compute.manager [None req-6b5822fe-6577-4aad-ae29-c7e5976dd4f6 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] [instance: f7d1a157-3228-490e-a6a0-68f6bd2b52ba] Instance event wait completed in 0 seconds for  {{(pid=75122) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 09:31:20 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-6b5822fe-6577-4aad-ae29-c7e5976dd4f6 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] [instance: f7d1a157-3228-490e-a6a0-68f6bd2b52ba] Guest created on hypervisor {{(pid=75122) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 09:31:20 user nova-compute[75122]: INFO nova.virt.libvirt.driver [-] [instance: f7d1a157-3228-490e-a6a0-68f6bd2b52ba] Instance spawned successfully.
Nov 15 09:31:20 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-6b5822fe-6577-4aad-ae29-c7e5976dd4f6 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] [instance: f7d1a157-3228-490e-a6a0-68f6bd2b52ba] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 09:31:20 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-6b5822fe-6577-4aad-ae29-c7e5976dd4f6 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] [instance: f7d1a157-3228-490e-a6a0-68f6bd2b52ba] Found default for hw_cdrom_bus of ide {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:31:20 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-6b5822fe-6577-4aad-ae29-c7e5976dd4f6 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] [instance: f7d1a157-3228-490e-a6a0-68f6bd2b52ba] Found default for hw_disk_bus of virtio {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:31:20 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-6b5822fe-6577-4aad-ae29-c7e5976dd4f6 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] [instance: f7d1a157-3228-490e-a6a0-68f6bd2b52ba] Found default for hw_input_bus of None {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:31:20 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-6b5822fe-6577-4aad-ae29-c7e5976dd4f6 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] [instance: f7d1a157-3228-490e-a6a0-68f6bd2b52ba] Found default for hw_pointer_model of None {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:31:20 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-6b5822fe-6577-4aad-ae29-c7e5976dd4f6 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] [instance: f7d1a157-3228-490e-a6a0-68f6bd2b52ba] Found default for hw_video_model of virtio {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:31:20 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-6b5822fe-6577-4aad-ae29-c7e5976dd4f6 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] [instance: f7d1a157-3228-490e-a6a0-68f6bd2b52ba] Found default for hw_vif_model of virtio {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:31:20 user nova-compute[75122]: INFO nova.compute.manager [None req-6b5822fe-6577-4aad-ae29-c7e5976dd4f6 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] [instance: f7d1a157-3228-490e-a6a0-68f6bd2b52ba] Took 5.05 seconds to spawn the instance on the hypervisor.
Nov 15 09:31:20 user nova-compute[75122]: DEBUG nova.compute.manager [None req-6b5822fe-6577-4aad-ae29-c7e5976dd4f6 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] [instance: f7d1a157-3228-490e-a6a0-68f6bd2b52ba] Checking state {{(pid=75122) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 09:31:20 user nova-compute[75122]: DEBUG nova.compute.manager [req-63e2437e-df32-44d7-a8eb-e3d8ba6eda2a req-5c2d09a3-5736-4131-a462-3563e3c0bb8d service nova] [instance: f7d1a157-3228-490e-a6a0-68f6bd2b52ba] Received event network-vif-plugged-caf104ef-b652-4038-8203-76f14e4b666b {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:31:20 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-63e2437e-df32-44d7-a8eb-e3d8ba6eda2a req-5c2d09a3-5736-4131-a462-3563e3c0bb8d service nova] Acquiring lock "f7d1a157-3228-490e-a6a0-68f6bd2b52ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:31:20 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-63e2437e-df32-44d7-a8eb-e3d8ba6eda2a req-5c2d09a3-5736-4131-a462-3563e3c0bb8d service nova] Lock "f7d1a157-3228-490e-a6a0-68f6bd2b52ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:31:20 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-63e2437e-df32-44d7-a8eb-e3d8ba6eda2a req-5c2d09a3-5736-4131-a462-3563e3c0bb8d service nova] Lock "f7d1a157-3228-490e-a6a0-68f6bd2b52ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:31:20 user nova-compute[75122]: DEBUG nova.compute.manager [req-63e2437e-df32-44d7-a8eb-e3d8ba6eda2a req-5c2d09a3-5736-4131-a462-3563e3c0bb8d service nova] [instance: f7d1a157-3228-490e-a6a0-68f6bd2b52ba] No waiting events found dispatching network-vif-plugged-caf104ef-b652-4038-8203-76f14e4b666b {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:31:20 user nova-compute[75122]: WARNING nova.compute.manager [req-63e2437e-df32-44d7-a8eb-e3d8ba6eda2a req-5c2d09a3-5736-4131-a462-3563e3c0bb8d service nova] [instance: f7d1a157-3228-490e-a6a0-68f6bd2b52ba] Received unexpected event network-vif-plugged-caf104ef-b652-4038-8203-76f14e4b666b for instance with vm_state building and task_state spawning.
Nov 15 09:31:20 user nova-compute[75122]: INFO nova.compute.manager [None req-6b5822fe-6577-4aad-ae29-c7e5976dd4f6 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] [instance: f7d1a157-3228-490e-a6a0-68f6bd2b52ba] Took 13.25 seconds to build instance.
Nov 15 09:31:20 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-6b5822fe-6577-4aad-ae29-c7e5976dd4f6 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] Lock "f7d1a157-3228-490e-a6a0-68f6bd2b52ba" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.356s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:31:22 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:31:24 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:31:27 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:31:29 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:31:32 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:31:34 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:31:37 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:31:39 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:31:42 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:31:44 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:31:47 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:31:49 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:31:52 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:31:57 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:31:57 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:31:57 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75122) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 09:31:57 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75122) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 09:31:57 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75122) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 09:31:57 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:32:01 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-4955c5dc-f4b5-49c9-9b75-a71cff34b135 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] Acquiring lock "4b582e5d-eef1-41f6-84b5-102efe3bf3f8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:32:01 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-4955c5dc-f4b5-49c9-9b75-a71cff34b135 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] Lock "4b582e5d-eef1-41f6-84b5-102efe3bf3f8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:32:01 user nova-compute[75122]: DEBUG nova.objects.instance [None req-4955c5dc-f4b5-49c9-9b75-a71cff34b135 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] Lazy-loading 'flavor' on Instance uuid 4b582e5d-eef1-41f6-84b5-102efe3bf3f8 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:32:01 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-4955c5dc-f4b5-49c9-9b75-a71cff34b135 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] Lock "4b582e5d-eef1-41f6-84b5-102efe3bf3f8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.096s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:32:01 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-4955c5dc-f4b5-49c9-9b75-a71cff34b135 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] Acquiring lock "4b582e5d-eef1-41f6-84b5-102efe3bf3f8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:32:01 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-4955c5dc-f4b5-49c9-9b75-a71cff34b135 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] Lock "4b582e5d-eef1-41f6-84b5-102efe3bf3f8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:32:01 user nova-compute[75122]: INFO nova.compute.manager [None req-4955c5dc-f4b5-49c9-9b75-a71cff34b135 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] [instance: 4b582e5d-eef1-41f6-84b5-102efe3bf3f8] Attaching volume baba5eb3-57fa-42e8-8087-c9eec64c0de6 to /dev/vdb
Nov 15 09:32:01 user nova-compute[75122]: DEBUG os_brick.utils [None req-4955c5dc-f4b5-49c9-9b75-a71cff34b135 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 09:32:01 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:32:01 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:32:01 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d232051-a036-4f11-b3aa-260e8d175969]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:742fb64b3587\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:32:01 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:32:02 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:32:02 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ee78e44-089d-401a-a964-bf0dc2cd9a1f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:32:02 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:32:02 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.028s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:32:02 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[412c4bfa-6e48-4259-8c92-8bc4b2bdaed2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:32:02 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[c79dff66-921f-491d-85a8-cab4ef17cf7e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:32:02 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-4955c5dc-f4b5-49c9-9b75-a71cff34b135 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] Running cmd (subprocess): nvme version {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:32:02 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-4955c5dc-f4b5-49c9-9b75-a71cff34b135 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] 'nvme version' failed. Not Retrying. {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 09:32:02 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4955c5dc-f4b5-49c9-9b75-a71cff34b135 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] nvme not present on system {{(pid=75122) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 09:32:02 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:32:02 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:32:02 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 09:32:02 user nova-compute[75122]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 09:32:02 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[63da2402-7857-4969-ad0c-31834ddf6b93]: (4, '') {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:32:02 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.lightos [None req-4955c5dc-f4b5-49c9-9b75-a71cff34b135 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75122) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 09:32:02 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.lightos [None req-4955c5dc-f4b5-49c9-9b75-a71cff34b135 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75122) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 09:32:02 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.lightos [None req-4955c5dc-f4b5-49c9-9b75-a71cff34b135 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] LIGHTOS: no hostnqn found. {{(pid=75122) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 09:32:02 user nova-compute[75122]: DEBUG os_brick.utils [None req-4955c5dc-f4b5-49c9-9b75-a71cff34b135 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:742fb64b3587', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 09:32:02 user nova-compute[75122]: DEBUG nova.virt.block_device [None req-4955c5dc-f4b5-49c9-9b75-a71cff34b135 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] [instance: 4b582e5d-eef1-41f6-84b5-102efe3bf3f8] Updating existing volume attachment record: 57043231-7804-4138-852f-7a1a026a6d2f {{(pid=75122) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 09:32:02 user nova-compute[75122]: DEBUG nova.compute.manager [req-6654984f-b2c5-4dc6-beac-37129d03f13b req-537beb4c-473e-4ba6-88b7-afec807ee513 service nova] [instance: ee961d5a-e0d1-4931-9293-eefbe638097a] Received event network-changed-ae8a9c5e-17d1-4aa9-b3fa-b829d1dc6fd2 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:32:02 user nova-compute[75122]: DEBUG nova.compute.manager [req-6654984f-b2c5-4dc6-beac-37129d03f13b req-537beb4c-473e-4ba6-88b7-afec807ee513 service nova] [instance: ee961d5a-e0d1-4931-9293-eefbe638097a] Refreshing instance network info cache due to event network-changed-ae8a9c5e-17d1-4aa9-b3fa-b829d1dc6fd2. {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 09:32:02 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-6654984f-b2c5-4dc6-beac-37129d03f13b req-537beb4c-473e-4ba6-88b7-afec807ee513 service nova] Acquiring lock "refresh_cache-ee961d5a-e0d1-4931-9293-eefbe638097a" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 09:32:02 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-6654984f-b2c5-4dc6-beac-37129d03f13b req-537beb4c-473e-4ba6-88b7-afec807ee513 service nova] Acquired lock "refresh_cache-ee961d5a-e0d1-4931-9293-eefbe638097a" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 09:32:02 user nova-compute[75122]: DEBUG nova.network.neutron [req-6654984f-b2c5-4dc6-beac-37129d03f13b req-537beb4c-473e-4ba6-88b7-afec807ee513 service nova] [instance: ee961d5a-e0d1-4931-9293-eefbe638097a] Refreshing network info cache for port ae8a9c5e-17d1-4aa9-b3fa-b829d1dc6fd2 {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 09:32:02 user nova-compute[75122]: DEBUG nova.network.neutron [req-6654984f-b2c5-4dc6-beac-37129d03f13b req-537beb4c-473e-4ba6-88b7-afec807ee513 service nova] [instance: ee961d5a-e0d1-4931-9293-eefbe638097a] Updated VIF entry in instance network info cache for port ae8a9c5e-17d1-4aa9-b3fa-b829d1dc6fd2. {{(pid=75122) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 09:32:02 user nova-compute[75122]: DEBUG nova.network.neutron [req-6654984f-b2c5-4dc6-beac-37129d03f13b req-537beb4c-473e-4ba6-88b7-afec807ee513 service nova] [instance: ee961d5a-e0d1-4931-9293-eefbe638097a] Updating instance_info_cache with network_info: [{"id": "ae8a9c5e-17d1-4aa9-b3fa-b829d1dc6fd2", "address": "fa:16:3e:7d:98:85", "network": {"id": "44caed16-406b-4a76-966a-0dc42b26f133", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-465582303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d672b8845fa849d99e328521d3d1715b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae8a9c5e-17", "ovs_interfaceid": "ae8a9c5e-17d1-4aa9-b3fa-b829d1dc6fd2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:32:02 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-6654984f-b2c5-4dc6-beac-37129d03f13b req-537beb4c-473e-4ba6-88b7-afec807ee513 service nova] Releasing lock "refresh_cache-ee961d5a-e0d1-4931-9293-eefbe638097a" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 09:32:04 user nova-compute[75122]: DEBUG nova.compute.manager [req-9c3a1247-ee10-443f-a9f0-7edd95c6ada5 req-7a85caee-ade1-4615-b071-1e4e2078fe1a service nova] [instance: 131142fd-e8ec-42d1-a518-aa21c7bb7cb1] Received event network-changed-f8302d0d-f140-479c-96da-b21516385381 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:32:04 user nova-compute[75122]: DEBUG nova.compute.manager [req-9c3a1247-ee10-443f-a9f0-7edd95c6ada5 req-7a85caee-ade1-4615-b071-1e4e2078fe1a service nova] [instance: 131142fd-e8ec-42d1-a518-aa21c7bb7cb1] Refreshing instance network info cache due to event network-changed-f8302d0d-f140-479c-96da-b21516385381. {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 09:32:04 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-9c3a1247-ee10-443f-a9f0-7edd95c6ada5 req-7a85caee-ade1-4615-b071-1e4e2078fe1a service nova] Acquiring lock "refresh_cache-131142fd-e8ec-42d1-a518-aa21c7bb7cb1" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 09:32:04 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-9c3a1247-ee10-443f-a9f0-7edd95c6ada5 req-7a85caee-ade1-4615-b071-1e4e2078fe1a service nova] Acquired lock "refresh_cache-131142fd-e8ec-42d1-a518-aa21c7bb7cb1" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 09:32:04 user nova-compute[75122]: DEBUG nova.network.neutron [req-9c3a1247-ee10-443f-a9f0-7edd95c6ada5 req-7a85caee-ade1-4615-b071-1e4e2078fe1a service nova] [instance: 131142fd-e8ec-42d1-a518-aa21c7bb7cb1] Refreshing network info cache for port f8302d0d-f140-479c-96da-b21516385381 {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 09:32:04 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:32:04 user nova-compute[75122]: DEBUG nova.network.neutron [req-9c3a1247-ee10-443f-a9f0-7edd95c6ada5 req-7a85caee-ade1-4615-b071-1e4e2078fe1a service nova] [instance: 131142fd-e8ec-42d1-a518-aa21c7bb7cb1] Updated VIF entry in instance network info cache for port f8302d0d-f140-479c-96da-b21516385381. {{(pid=75122) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 09:32:04 user nova-compute[75122]: DEBUG nova.network.neutron [req-9c3a1247-ee10-443f-a9f0-7edd95c6ada5 req-7a85caee-ade1-4615-b071-1e4e2078fe1a service nova] [instance: 131142fd-e8ec-42d1-a518-aa21c7bb7cb1] Updating instance_info_cache with network_info: [{"id": "f8302d0d-f140-479c-96da-b21516385381", "address": "fa:16:3e:06:1e:34", "network": {"id": "6e846655-a6f8-4339-a239-65d2f94c8b74", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1923452032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b8e67f8a66a4930be3fb65c397cbeb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8302d0d-f1", "ovs_interfaceid": "f8302d0d-f140-479c-96da-b21516385381", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:32:04 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-9c3a1247-ee10-443f-a9f0-7edd95c6ada5 req-7a85caee-ade1-4615-b071-1e4e2078fe1a service nova] Releasing lock "refresh_cache-131142fd-e8ec-42d1-a518-aa21c7bb7cb1" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 09:32:06 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:32:06 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75122) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 09:32:07 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:32:07 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:32:07 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:32:07 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:32:07 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4955c5dc-f4b5-49c9-9b75-a71cff34b135 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] [instance: 4b582e5d-eef1-41f6-84b5-102efe3bf3f8] Calling os-brick to attach iSCSI Volume {{(pid=75122) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 09:32:07 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-4955c5dc-f4b5-49c9-9b75-a71cff34b135 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffa04060b80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:baba5eb3-57fa-42e8-8087-c9eec64c0de6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'akrUxyPY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 09:32:07 user nova-compute[75122]: WARNING os_brick.initiator.connectors.base [None req-4955c5dc-f4b5-49c9-9b75-a71cff34b135 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 09:32:07 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-4955c5dc-f4b5-49c9-9b75-a71cff34b135 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 09:32:07 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-4955c5dc-f4b5-49c9-9b75-a71cff34b135 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 09:32:08 user nova-compute[75122]: WARNING os_brick.initiator.connectors.base [None req-4955c5dc-f4b5-49c9-9b75-a71cff34b135 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 09:32:08 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-4955c5dc-f4b5-49c9-9b75-a71cff34b135 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:baba5eb3-57fa-42e8-8087-c9eec64c0de6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 09:32:08 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-4955c5dc-f4b5-49c9-9b75-a71cff34b135 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:baba5eb3-57fa-42e8-8087-c9eec64c0de6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 09:32:08 user nova-compute[75122]: INFO os_brick.initiator.connectors.iscsi [None req-4955c5dc-f4b5-49c9-9b75-a71cff34b135 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 09:32:08 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:baba5eb3-57fa-42e8-8087-c9eec64c0de6 -p 172.16.0.220:3260 {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:32:08 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:baba5eb3-57fa-42e8-8087-c9eec64c0de6 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:32:08 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9c47c44-9ba3-4a78-a228-e2fe1b175c86]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:32:08 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-4955c5dc-f4b5-49c9-9b75-a71cff34b135 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 09:32:08 user nova-compute[75122]:  {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:32:08 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:baba5eb3-57fa-42e8-8087-c9eec64c0de6 -p 172.16.0.220:3260 --interface default --op new {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:32:08 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:baba5eb3-57fa-42e8-8087-c9eec64c0de6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:32:08 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[27c724f3-9039-469e-827f-5bfc5d15e1ad]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:baba5eb3-57fa-42e8-8087-c9eec64c0de6] added\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:32:08 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-4955c5dc-f4b5-49c9-9b75-a71cff34b135 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:baba5eb3-57fa-42e8-8087-c9eec64c0de6] added
Nov 15 09:32:08 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:32:08 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:baba5eb3-57fa-42e8-8087-c9eec64c0de6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:32:08 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:baba5eb3-57fa-42e8-8087-c9eec64c0de6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:32:08 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c45bba0-241d-47a4-bb67-2ce81c50dc1d]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:32:08 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-4955c5dc-f4b5-49c9-9b75-a71cff34b135 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:32:08 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:baba5eb3-57fa-42e8-8087-c9eec64c0de6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:32:08 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:baba5eb3-57fa-42e8-8087-c9eec64c0de6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:32:08 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[144bd906-dee0-4fa6-ab2d-d25b77ecdce5]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:32:08 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-4955c5dc-f4b5-49c9-9b75-a71cff34b135 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:32:08 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:baba5eb3-57fa-42e8-8087-c9eec64c0de6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v akrUxyPY {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:32:08 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:baba5eb3-57fa-42e8-8087-c9eec64c0de6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v akrUxyPY" returned: 0 in 0.016s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:32:08 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6a49a71-7e14-4b6e-a2df-4a48f9c779ed]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:32:08 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-4955c5dc-f4b5-49c9-9b75-a71cff34b135 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'akrUxyPY'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:32:08 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:baba5eb3-57fa-42e8-8087-c9eec64c0de6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:32:08 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:baba5eb3-57fa-42e8-8087-c9eec64c0de6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:32:08 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b081150-ff58-4825-aeb9-7f577d427f76]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:32:08 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-4955c5dc-f4b5-49c9-9b75-a71cff34b135 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:32:08 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:32:08 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:32:08 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[347aa064-9165-43ee-bde9-a709affba5d3]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e (non-flash)\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:32:08 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-4955c5dc-f4b5-49c9-9b75-a71cff34b135 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e (non-flash)
Nov 15 09:32:08 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 09:32:08 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-4955c5dc-f4b5-49c9-9b75-a71cff34b135 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e (non-flash)
Nov 15 09:32:08 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 09:32:08 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:baba5eb3-57fa-42e8-8087-c9eec64c0de6 -p 172.16.0.220:3260 --login {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:32:08 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:32:08 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:32:08 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:32:08 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:32:08 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75122) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 09:32:08 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:baba5eb3-57fa-42e8-8087-c9eec64c0de6 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:32:08 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[d77522ec-62e9-4fda-9ffc-56506a183b88]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:baba5eb3-57fa-42e8-8087-c9eec64c0de6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:baba5eb3-57fa-42e8-8087-c9eec64c0de6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:32:08 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-4955c5dc-f4b5-49c9-9b75-a71cff34b135 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:baba5eb3-57fa-42e8-8087-c9eec64c0de6, portal: 172.16.0.220,3260]
Nov 15 09:32:08 user nova-compute[75122]: Login to [iface: default, target: iqn.2010-10.org.openstack:baba5eb3-57fa-42e8-8087-c9eec64c0de6, portal: 172.16.0.220,3260] successful.
Nov 15 09:32:08 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:32:08 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:baba5eb3-57fa-42e8-8087-c9eec64c0de6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:32:08 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:baba5eb3-57fa-42e8-8087-c9eec64c0de6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:32:08 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0506049-4218-4148-a588-01c2afb3f350]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:32:08 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-4955c5dc-f4b5-49c9-9b75-a71cff34b135 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:32:08 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:32:08 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:32:08 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[787413e5-aa5e-40af-a24f-8f0a6dab188c]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:baba5eb3-57fa-42e8-8087-c9eec64c0de6 (non-flash)\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:32:08 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-4955c5dc-f4b5-49c9-9b75-a71cff34b135 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e (non-flash)
Nov 15 09:32:08 user nova-compute[75122]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:baba5eb3-57fa-42e8-8087-c9eec64c0de6 (non-flash)
Nov 15 09:32:08 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 09:32:08 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-4955c5dc-f4b5-49c9-9b75-a71cff34b135 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e (non-flash)
Nov 15 09:32:08 user nova-compute[75122]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:baba5eb3-57fa-42e8-8087-c9eec64c0de6 (non-flash)
Nov 15 09:32:08 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 09:32:08 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-4955c5dc-f4b5-49c9-9b75-a71cff34b135 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:baba5eb3-57fa-42e8-8087-c9eec64c0de6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.300s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 09:32:08 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-4955c5dc-f4b5-49c9-9b75-a71cff34b135 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] Connected to 172.16.0.220:3260 {{(pid=75122) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 09:32:08 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-4955c5dc-f4b5-49c9-9b75-a71cff34b135 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] HCTL ('34', '-', '-', 0) found on session 6 with lun 0 {{(pid=75122) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 09:32:08 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-4955c5dc-f4b5-49c9-9b75-a71cff34b135 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75122) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 09:32:08 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:32:08 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:32:08 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b45e573-e7d3-4761-b071-2534cae421e2]: (4, ('- - 0', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:32:08 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-4955c5dc-f4b5-49c9-9b75-a71cff34b135 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] Searching for a device in session 6 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75122) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 09:32:08 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-4955c5dc-f4b5-49c9-9b75-a71cff34b135 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:baba5eb3-57fa-42e8-8087-c9eec64c0de6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'akrUxyPY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75122) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 09:32:08 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee961d5a-e0d1-4931-9293-eefbe638097a/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:32:08 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee961d5a-e0d1-4931-9293-eefbe638097a/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:32:08 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee961d5a-e0d1-4931-9293-eefbe638097a/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:32:08 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee961d5a-e0d1-4931-9293-eefbe638097a/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:32:08 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75122) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 09:32:08 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b582e5d-eef1-41f6-84b5-102efe3bf3f8/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:32:08 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b582e5d-eef1-41f6-84b5-102efe3bf3f8/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:32:08 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b582e5d-eef1-41f6-84b5-102efe3bf3f8/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:32:09 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:32:09 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b582e5d-eef1-41f6-84b5-102efe3bf3f8/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:32:09 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcb58c79-f6b3-44d9-a80f-1a4cf580379f/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:32:09 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-4955c5dc-f4b5-49c9-9b75-a71cff34b135 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.339s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 09:32:09 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-4955c5dc-f4b5-49c9-9b75-a71cff34b135 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] <== connect_volume: return (1343ms) {'type': 'block', 'scsi_wwn': '23236636638636366', 'path': '/dev/sdc'} {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 09:32:09 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4955c5dc-f4b5-49c9-9b75-a71cff34b135 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] [instance: 4b582e5d-eef1-41f6-84b5-102efe3bf3f8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23236636638636366', 'path': '/dev/sdc'} {{(pid=75122) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 09:32:09 user nova-compute[75122]: DEBUG nova.objects.instance [None req-4955c5dc-f4b5-49c9-9b75-a71cff34b135 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] Lazy-loading 'flavor' on Instance uuid 4b582e5d-eef1-41f6-84b5-102efe3bf3f8 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:32:09 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcb58c79-f6b3-44d9-a80f-1a4cf580379f/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:32:09 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcb58c79-f6b3-44d9-a80f-1a4cf580379f/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:32:09 user nova-compute[75122]: DEBUG nova.virt.libvirt.guest [None req-4955c5dc-f4b5-49c9-9b75-a71cff34b135 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 09:32:09 user nova-compute[75122]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 09:32:09 user nova-compute[75122]:   <source dev="/dev/sdc"/>
Nov 15 09:32:09 user nova-compute[75122]:   <target dev="vdb" bus="virtio"/>
Nov 15 09:32:09 user nova-compute[75122]:   <serial>baba5eb3-57fa-42e8-8087-c9eec64c0de6</serial>
Nov 15 09:32:09 user nova-compute[75122]: </disk>
Nov 15 09:32:09 user nova-compute[75122]:  {{(pid=75122) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 09:32:09 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bcb58c79-f6b3-44d9-a80f-1a4cf580379f/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:32:09 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cfb60cb-011e-4537-9f28-55ea7d6dfc13/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:32:09 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cfb60cb-011e-4537-9f28-55ea7d6dfc13/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:32:09 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cfb60cb-011e-4537-9f28-55ea7d6dfc13/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:32:09 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:32:09 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-4955c5dc-f4b5-49c9-9b75-a71cff34b135 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] No BDM found with device name vda, not building metadata. {{(pid=75122) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 09:32:09 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-4955c5dc-f4b5-49c9-9b75-a71cff34b135 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75122) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 09:32:09 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-4955c5dc-f4b5-49c9-9b75-a71cff34b135 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] No VIF found with MAC fa:16:3e:0d:bc:bc, not building metadata {{(pid=75122) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 09:32:09 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cfb60cb-011e-4537-9f28-55ea7d6dfc13/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:32:09 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa52b2a0-e5a0-4f93-a1cf-fef4a8313368/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:32:10 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-4955c5dc-f4b5-49c9-9b75-a71cff34b135 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] Lock "4b582e5d-eef1-41f6-84b5-102efe3bf3f8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.194s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:32:10 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa52b2a0-e5a0-4f93-a1cf-fef4a8313368/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:32:10 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa52b2a0-e5a0-4f93-a1cf-fef4a8313368/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:32:10 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa52b2a0-e5a0-4f93-a1cf-fef4a8313368/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:32:10 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/131142fd-e8ec-42d1-a518-aa21c7bb7cb1/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:32:10 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/131142fd-e8ec-42d1-a518-aa21c7bb7cb1/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:32:10 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/131142fd-e8ec-42d1-a518-aa21c7bb7cb1/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:32:10 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/131142fd-e8ec-42d1-a518-aa21c7bb7cb1/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:32:10 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d24a189e-2de9-404e-b281-224c150a5bbf/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:32:10 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-3d987c31-e446-429f-8a94-e828e38b6ea8 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] Acquiring lock "4b582e5d-eef1-41f6-84b5-102efe3bf3f8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:32:10 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-3d987c31-e446-429f-8a94-e828e38b6ea8 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] Lock "4b582e5d-eef1-41f6-84b5-102efe3bf3f8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:32:10 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-3d987c31-e446-429f-8a94-e828e38b6ea8 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] Acquiring lock "4b582e5d-eef1-41f6-84b5-102efe3bf3f8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:32:10 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-3d987c31-e446-429f-8a94-e828e38b6ea8 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] Lock "4b582e5d-eef1-41f6-84b5-102efe3bf3f8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:32:10 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-3d987c31-e446-429f-8a94-e828e38b6ea8 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] Lock "4b582e5d-eef1-41f6-84b5-102efe3bf3f8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:32:10 user nova-compute[75122]: INFO nova.compute.manager [None req-3d987c31-e446-429f-8a94-e828e38b6ea8 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] [instance: 4b582e5d-eef1-41f6-84b5-102efe3bf3f8] Terminating instance
Nov 15 09:32:10 user nova-compute[75122]: DEBUG nova.compute.manager [None req-3d987c31-e446-429f-8a94-e828e38b6ea8 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] [instance: 4b582e5d-eef1-41f6-84b5-102efe3bf3f8] Start destroying the instance on the hypervisor. {{(pid=75122) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 09:32:10 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:32:10 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:32:10 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d24a189e-2de9-404e-b281-224c150a5bbf/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:32:10 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d24a189e-2de9-404e-b281-224c150a5bbf/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:32:10 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:32:10 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:32:11 user nova-compute[75122]: DEBUG nova.compute.manager [req-2a2e4a85-3fce-4ffd-90d8-ff5a0937b0bd req-2a9f10e7-34e3-4f44-bca4-4f1fcae07c13 service nova] [instance: 4b582e5d-eef1-41f6-84b5-102efe3bf3f8] Received event network-vif-unplugged-43e5af96-fffc-4d74-bbed-5a78ce800158 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:32:11 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-2a2e4a85-3fce-4ffd-90d8-ff5a0937b0bd req-2a9f10e7-34e3-4f44-bca4-4f1fcae07c13 service nova] Acquiring lock "4b582e5d-eef1-41f6-84b5-102efe3bf3f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:32:11 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-2a2e4a85-3fce-4ffd-90d8-ff5a0937b0bd req-2a9f10e7-34e3-4f44-bca4-4f1fcae07c13 service nova] Lock "4b582e5d-eef1-41f6-84b5-102efe3bf3f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:32:11 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-2a2e4a85-3fce-4ffd-90d8-ff5a0937b0bd req-2a9f10e7-34e3-4f44-bca4-4f1fcae07c13 service nova] Lock "4b582e5d-eef1-41f6-84b5-102efe3bf3f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:32:11 user nova-compute[75122]: DEBUG nova.compute.manager [req-2a2e4a85-3fce-4ffd-90d8-ff5a0937b0bd req-2a9f10e7-34e3-4f44-bca4-4f1fcae07c13 service nova] [instance: 4b582e5d-eef1-41f6-84b5-102efe3bf3f8] No waiting events found dispatching network-vif-unplugged-43e5af96-fffc-4d74-bbed-5a78ce800158 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:32:11 user nova-compute[75122]: DEBUG nova.compute.manager [req-2a2e4a85-3fce-4ffd-90d8-ff5a0937b0bd req-2a9f10e7-34e3-4f44-bca4-4f1fcae07c13 service nova] [instance: 4b582e5d-eef1-41f6-84b5-102efe3bf3f8] Received event network-vif-unplugged-43e5af96-fffc-4d74-bbed-5a78ce800158 for instance with task_state deleting. {{(pid=75122) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 09:32:11 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d24a189e-2de9-404e-b281-224c150a5bbf/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:32:11 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0f32160-7130-4b9c-aa9c-84123f3a6b32/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:32:11 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0f32160-7130-4b9c-aa9c-84123f3a6b32/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:32:11 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0f32160-7130-4b9c-aa9c-84123f3a6b32/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:32:11 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0f32160-7130-4b9c-aa9c-84123f3a6b32/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:32:11 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 09:32:11 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 09:32:11 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Hypervisor/Node resource view: name=user free_ram=7303MB free_disk=25.54964828491211GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75122) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 09:32:11 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:32:11 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:32:11 user nova-compute[75122]: INFO nova.virt.libvirt.driver [-] [instance: 4b582e5d-eef1-41f6-84b5-102efe3bf3f8] Instance destroyed successfully.
Nov 15 09:32:11 user nova-compute[75122]: DEBUG nova.objects.instance [None req-3d987c31-e446-429f-8a94-e828e38b6ea8 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] Lazy-loading 'resources' on Instance uuid 4b582e5d-eef1-41f6-84b5-102efe3bf3f8 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:32:11 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-3d987c31-e446-429f-8a94-e828e38b6ea8 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T09:30:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1275384859',display_name='tempest-DeleteServersTestJSON-server-1275384859',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1275384859',id=1,image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T09:30:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='59cfb5df524a4094a303619fb04ccbd4',ramdisk_id='',reservation_id='r-fexdbayg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-1876319053',owner_user_name='tempest-DeleteServersTestJSON-1876319053-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T09:30:26Z,user_data=None,user_id='b3d18894e4e044b3ac1bca5d58231d05',uuid=4b582e5d-eef1-41f6-84b5-102efe3bf3f8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "43e5af96-fffc-4d74-bbed-5a78ce800158", "address": "fa:16:3e:0d:bc:bc", "network": {"id": "0701c672-3bc3-4a49-afd0-6b439abd2956", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1112570222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59cfb5df524a4094a303619fb04ccbd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43e5af96-ff", "ovs_interfaceid": "43e5af96-fffc-4d74-bbed-5a78ce800158", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 09:32:11 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-3d987c31-e446-429f-8a94-e828e38b6ea8 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] Converting VIF {"id": "43e5af96-fffc-4d74-bbed-5a78ce800158", "address": "fa:16:3e:0d:bc:bc", "network": {"id": "0701c672-3bc3-4a49-afd0-6b439abd2956", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1112570222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59cfb5df524a4094a303619fb04ccbd4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43e5af96-ff", "ovs_interfaceid": "43e5af96-fffc-4d74-bbed-5a78ce800158", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 09:32:11 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-3d987c31-e446-429f-8a94-e828e38b6ea8 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0d:bc:bc,bridge_name='br-int',has_traffic_filtering=True,id=43e5af96-fffc-4d74-bbed-5a78ce800158,network=Network(0701c672-3bc3-4a49-afd0-6b439abd2956),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43e5af96-ff') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 09:32:11 user nova-compute[75122]: DEBUG os_vif [None req-3d987c31-e446-429f-8a94-e828e38b6ea8 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0d:bc:bc,bridge_name='br-int',has_traffic_filtering=True,id=43e5af96-fffc-4d74-bbed-5a78ce800158,network=Network(0701c672-3bc3-4a49-afd0-6b439abd2956),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43e5af96-ff') {{(pid=75122) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 09:32:11 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:32:11 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap43e5af96-ff, bridge=br-int, if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:32:11 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:32:11 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:32:11 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:32:11 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=758c9d82-0460-43d6-8df5-1397db9f02c1) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:32:11 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:32:11 user nova-compute[75122]: INFO os_vif [None req-3d987c31-e446-429f-8a94-e828e38b6ea8 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0d:bc:bc,bridge_name='br-int',has_traffic_filtering=True,id=43e5af96-fffc-4d74-bbed-5a78ce800158,network=Network(0701c672-3bc3-4a49-afd0-6b439abd2956),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43e5af96-ff')
Nov 15 09:32:11 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3d987c31-e446-429f-8a94-e828e38b6ea8 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] [instance: 4b582e5d-eef1-41f6-84b5-102efe3bf3f8] calling os-brick to detach iSCSI Volume {{(pid=75122) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 09:32:11 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d987c31-e446-429f-8a94-e828e38b6ea8 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffa04060b80>, {'target_iqn': 'iqn.2010-10.org.openstack:baba5eb3-57fa-42e8-8087-c9eec64c0de6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'akrUxyPY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 09:32:11 user nova-compute[75122]: WARNING os_brick.initiator.connectors.base [None req-3d987c31-e446-429f-8a94-e828e38b6ea8 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 09:32:11 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-3d987c31-e446-429f-8a94-e828e38b6ea8 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 09:32:11 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-3d987c31-e446-429f-8a94-e828e38b6ea8 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 09:32:11 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:32:11 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:32:11 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3bf9d92-2a83-475e-a1ec-c43e35eb41f2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:baba5eb3-57fa-42e8-8087-c9eec64c0de6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:32:11 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d987c31-e446-429f-8a94-e828e38b6ea8 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 09:32:11 user nova-compute[75122]: No targets found.
Nov 15 09:32:11 user nova-compute[75122]: iSNS:
Nov 15 09:32:11 user nova-compute[75122]: No targets found.
Nov 15 09:32:11 user nova-compute[75122]: STATIC:
Nov 15 09:32:11 user nova-compute[75122]: Target: iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e
Nov 15 09:32:11 user nova-compute[75122]:         Portal: 172.16.0.220:3260,-1
Nov 15 09:32:11 user nova-compute[75122]:                 Iface Name: default
Nov 15 09:32:11 user nova-compute[75122]: Target: iqn.2010-10.org.openstack:baba5eb3-57fa-42e8-8087-c9eec64c0de6
Nov 15 09:32:11 user nova-compute[75122]:         Portal: 172.16.0.220:3260,-1
Nov 15 09:32:11 user nova-compute[75122]:                 Iface Name: default
Nov 15 09:32:11 user nova-compute[75122]: FIRMWARE:
Nov 15 09:32:11 user nova-compute[75122]: No targets found.
Nov 15 09:32:11 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 09:32:11 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d987c31-e446-429f-8a94-e828e38b6ea8 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 09:32:11 user nova-compute[75122]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 09:32:11 user nova-compute[75122]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75122) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 09:32:11 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d987c31-e446-429f-8a94-e828e38b6ea8 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:baba5eb3-57fa-42e8-8087-c9eec64c0de6', 0)] {{(pid=75122) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 09:32:11 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:32:12 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:32:12 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[017b78fd-7630-473f-8365-7ee863791f56]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:baba5eb3-57fa-42e8-8087-c9eec64c0de6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:32:12 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:32:12 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:32:12 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc5d273a-a1e8-4c39-9fa0-48484f4696d3]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:baba5eb3-57fa-42e8-8087-c9eec64c0de6 (non-flash)\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:32:12 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d987c31-e446-429f-8a94-e828e38b6ea8 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e (non-flash)
Nov 15 09:32:12 user nova-compute[75122]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:baba5eb3-57fa-42e8-8087-c9eec64c0de6 (non-flash)
Nov 15 09:32:12 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 09:32:12 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d987c31-e446-429f-8a94-e828e38b6ea8 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e (non-flash)
Nov 15 09:32:12 user nova-compute[75122]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:baba5eb3-57fa-42e8-8087-c9eec64c0de6 (non-flash)
Nov 15 09:32:12 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 09:32:12 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d987c31-e446-429f-8a94-e828e38b6ea8 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff9fc3d6ef0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:baba5eb3-57fa-42e8-8087-c9eec64c0de6'): ({'sdc'}, set())}) {{(pid=75122) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 09:32:12 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-3d987c31-e446-429f-8a94-e828e38b6ea8 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] Removing single pathed devices sdc {{(pid=75122) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 09:32:12 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:32:12 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance 4b582e5d-eef1-41f6-84b5-102efe3bf3f8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:32:12 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance ee961d5a-e0d1-4931-9293-eefbe638097a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:32:12 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance 131142fd-e8ec-42d1-a518-aa21c7bb7cb1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:32:12 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance bcb58c79-f6b3-44d9-a80f-1a4cf580379f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:32:12 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance e0f32160-7130-4b9c-aa9c-84123f3a6b32 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:32:12 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance d24a189e-2de9-404e-b281-224c150a5bbf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:32:12 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance fa52b2a0-e5a0-4f93-a1cf-fef4a8313368 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:32:12 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance 9cfb60cb-011e-4537-9f28-55ea7d6dfc13 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:32:12 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance f7d1a157-3228-490e-a6a0-68f6bd2b52ba actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:32:12 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75122) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 09:32:12 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75122) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 09:32:12 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:32:12 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[c58a58b2-251f-47d9-aa2f-892710b37781]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:32:12 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:32:12 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.017s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:32:12 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce891e0c-b173-475b-97cc-995650f84a49]: (4, ('ok\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:32:12 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-3d987c31-e446-429f-8a94-e828e38b6ea8 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] Flushing IO for device /dev/sdc {{(pid=75122) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 09:32:12 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:32:12 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:32:12 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[7077d769-f821-4e55-a2eb-da95bad95c31]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:32:12 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-3d987c31-e446-429f-8a94-e828e38b6ea8 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75122) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 09:32:12 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:32:12 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.051s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:32:12 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7122209-5dae-4072-abeb-7077c6bf6ae9]: (4, ('1', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:32:12 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-3d987c31-e446-429f-8a94-e828e38b6ea8 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75122) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 09:32:12 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-3d987c31-e446-429f-8a94-e828e38b6ea8 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] SCSI volumes sdc have been removed. {{(pid=75122) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 09:32:12 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d987c31-e446-429f-8a94-e828e38b6ea8 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:baba5eb3-57fa-42e8-8087-c9eec64c0de6')] {{(pid=75122) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 09:32:12 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:baba5eb3-57fa-42e8-8087-c9eec64c0de6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:32:12 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:baba5eb3-57fa-42e8-8087-c9eec64c0de6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:32:12 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bba0497-9007-4f98-aff2-9b3ca8cdb238]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:32:12 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d987c31-e446-429f-8a94-e828e38b6ea8 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:32:12 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:baba5eb3-57fa-42e8-8087-c9eec64c0de6 -p 172.16.0.220:3260 --logout {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:32:12 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:baba5eb3-57fa-42e8-8087-c9eec64c0de6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:32:12 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe594dbc-d1d9-48b7-8ad9-f22b3eae9c78]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:baba5eb3-57fa-42e8-8087-c9eec64c0de6, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:baba5eb3-57fa-42e8-8087-c9eec64c0de6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:32:12 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d987c31-e446-429f-8a94-e828e38b6ea8 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:baba5eb3-57fa-42e8-8087-c9eec64c0de6, portal: 172.16.0.220,3260]
Nov 15 09:32:12 user nova-compute[75122]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:baba5eb3-57fa-42e8-8087-c9eec64c0de6, portal: 172.16.0.220,3260] successful.
Nov 15 09:32:12 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:32:12 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:baba5eb3-57fa-42e8-8087-c9eec64c0de6 -p 172.16.0.220:3260 --op delete {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:32:12 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:baba5eb3-57fa-42e8-8087-c9eec64c0de6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:32:12 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c71bb44-e31f-41b2-9fb2-4c3dac38ee3c]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:32:12 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d987c31-e446-429f-8a94-e828e38b6ea8 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:32:12 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-3d987c31-e446-429f-8a94-e828e38b6ea8 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.290s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 09:32:12 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d987c31-e446-429f-8a94-e828e38b6ea8 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] <== disconnect_volume: return (292ms) None {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 09:32:12 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3d987c31-e446-429f-8a94-e828e38b6ea8 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] [instance: 4b582e5d-eef1-41f6-84b5-102efe3bf3f8] Disconnected iSCSI Volume {{(pid=75122) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 09:32:12 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-3d987c31-e446-429f-8a94-e828e38b6ea8 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] [instance: 4b582e5d-eef1-41f6-84b5-102efe3bf3f8] Deleting instance files /opt/stack/data/nova/instances/4b582e5d-eef1-41f6-84b5-102efe3bf3f8_del
Nov 15 09:32:12 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-3d987c31-e446-429f-8a94-e828e38b6ea8 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] [instance: 4b582e5d-eef1-41f6-84b5-102efe3bf3f8] Deletion of /opt/stack/data/nova/instances/4b582e5d-eef1-41f6-84b5-102efe3bf3f8_del complete
Nov 15 09:32:12 user nova-compute[75122]: DEBUG nova.compute.provider_tree [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Inventory has not changed in ProviderTree for provider: 69a3da65-47be-44c6-b67c-c692b58284ef {{(pid=75122) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 09:32:12 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Inventory has not changed for provider 69a3da65-47be-44c6-b67c-c692b58284ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 09:32:12 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-3d987c31-e446-429f-8a94-e828e38b6ea8 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] Checking UEFI support for host arch (x86_64) {{(pid=75122) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Nov 15 09:32:12 user nova-compute[75122]: INFO nova.virt.libvirt.host [None req-3d987c31-e446-429f-8a94-e828e38b6ea8 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] UEFI support detected
Nov 15 09:32:12 user nova-compute[75122]: INFO nova.compute.manager [None req-3d987c31-e446-429f-8a94-e828e38b6ea8 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] [instance: 4b582e5d-eef1-41f6-84b5-102efe3bf3f8] Took 1.58 seconds to destroy the instance on the hypervisor.
Nov 15 09:32:12 user nova-compute[75122]: DEBUG oslo.service.loopingcall [None req-3d987c31-e446-429f-8a94-e828e38b6ea8 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75122) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 09:32:12 user nova-compute[75122]: DEBUG nova.compute.manager [-] [instance: 4b582e5d-eef1-41f6-84b5-102efe3bf3f8] Deallocating network for instance {{(pid=75122) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 09:32:12 user nova-compute[75122]: DEBUG nova.network.neutron [-] [instance: 4b582e5d-eef1-41f6-84b5-102efe3bf3f8] deallocate_for_instance() {{(pid=75122) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 09:32:12 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Compute_service record updated for user:user {{(pid=75122) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 09:32:12 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.478s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:32:12 user nova-compute[75122]: DEBUG nova.network.neutron [-] [instance: 4b582e5d-eef1-41f6-84b5-102efe3bf3f8] Updating instance_info_cache with network_info: [] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:32:12 user nova-compute[75122]: INFO nova.compute.manager [-] [instance: 4b582e5d-eef1-41f6-84b5-102efe3bf3f8] Took 0.50 seconds to deallocate network for instance.
Nov 15 09:32:12 user nova-compute[75122]: DEBUG nova.compute.manager [req-53bc874a-508d-40a4-87e2-54712689afa9 req-ee25f517-8b53-4423-bd41-3186e726038f service nova] [instance: 4b582e5d-eef1-41f6-84b5-102efe3bf3f8] Received event network-vif-deleted-43e5af96-fffc-4d74-bbed-5a78ce800158 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:32:13 user nova-compute[75122]: DEBUG nova.compute.manager [req-283677ae-b080-4599-8338-cc115d9ddd5d req-8f3cfe0a-a85d-485d-8d8a-897224633db3 service nova] [instance: 4b582e5d-eef1-41f6-84b5-102efe3bf3f8] Received event network-vif-plugged-43e5af96-fffc-4d74-bbed-5a78ce800158 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:32:13 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-283677ae-b080-4599-8338-cc115d9ddd5d req-8f3cfe0a-a85d-485d-8d8a-897224633db3 service nova] Acquiring lock "4b582e5d-eef1-41f6-84b5-102efe3bf3f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:32:13 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-283677ae-b080-4599-8338-cc115d9ddd5d req-8f3cfe0a-a85d-485d-8d8a-897224633db3 service nova] Lock "4b582e5d-eef1-41f6-84b5-102efe3bf3f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:32:13 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-283677ae-b080-4599-8338-cc115d9ddd5d req-8f3cfe0a-a85d-485d-8d8a-897224633db3 service nova] Lock "4b582e5d-eef1-41f6-84b5-102efe3bf3f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:32:13 user nova-compute[75122]: DEBUG nova.compute.manager [req-283677ae-b080-4599-8338-cc115d9ddd5d req-8f3cfe0a-a85d-485d-8d8a-897224633db3 service nova] [instance: 4b582e5d-eef1-41f6-84b5-102efe3bf3f8] No waiting events found dispatching network-vif-plugged-43e5af96-fffc-4d74-bbed-5a78ce800158 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:32:13 user nova-compute[75122]: WARNING nova.compute.manager [req-283677ae-b080-4599-8338-cc115d9ddd5d req-8f3cfe0a-a85d-485d-8d8a-897224633db3 service nova] [instance: 4b582e5d-eef1-41f6-84b5-102efe3bf3f8] Received unexpected event network-vif-plugged-43e5af96-fffc-4d74-bbed-5a78ce800158 for instance with vm_state active and task_state deleting.
Nov 15 09:32:13 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:32:13 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:32:13 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Starting heal instance info cache {{(pid=75122) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 09:32:13 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "refresh_cache-ee961d5a-e0d1-4931-9293-eefbe638097a" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 09:32:13 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquired lock "refresh_cache-ee961d5a-e0d1-4931-9293-eefbe638097a" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 09:32:13 user nova-compute[75122]: DEBUG nova.network.neutron [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] [instance: ee961d5a-e0d1-4931-9293-eefbe638097a] Forcefully refreshing network info cache for instance {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 09:32:13 user nova-compute[75122]: INFO nova.compute.manager [None req-3d987c31-e446-429f-8a94-e828e38b6ea8 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] [instance: 4b582e5d-eef1-41f6-84b5-102efe3bf3f8] Took 0.75 seconds to detach 1 volumes for instance.
Nov 15 09:32:13 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-3d987c31-e446-429f-8a94-e828e38b6ea8 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:32:13 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-3d987c31-e446-429f-8a94-e828e38b6ea8 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:32:13 user nova-compute[75122]: DEBUG nova.network.neutron [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] [instance: ee961d5a-e0d1-4931-9293-eefbe638097a] Updating instance_info_cache with network_info: [{"id": "ae8a9c5e-17d1-4aa9-b3fa-b829d1dc6fd2", "address": "fa:16:3e:7d:98:85", "network": {"id": "44caed16-406b-4a76-966a-0dc42b26f133", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-465582303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d672b8845fa849d99e328521d3d1715b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae8a9c5e-17", "ovs_interfaceid": "ae8a9c5e-17d1-4aa9-b3fa-b829d1dc6fd2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:32:14 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Releasing lock "refresh_cache-ee961d5a-e0d1-4931-9293-eefbe638097a" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 09:32:14 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] [instance: ee961d5a-e0d1-4931-9293-eefbe638097a] Updated the network info_cache for instance {{(pid=75122) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 09:32:14 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:32:14 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:32:14 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:32:14 user nova-compute[75122]: DEBUG nova.compute.provider_tree [None req-3d987c31-e446-429f-8a94-e828e38b6ea8 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] Inventory has not changed in ProviderTree for provider: 69a3da65-47be-44c6-b67c-c692b58284ef {{(pid=75122) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 09:32:14 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-3d987c31-e446-429f-8a94-e828e38b6ea8 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] Inventory has not changed for provider 69a3da65-47be-44c6-b67c-c692b58284ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 09:32:14 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-3d987c31-e446-429f-8a94-e828e38b6ea8 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.611s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:32:14 user nova-compute[75122]: INFO nova.scheduler.client.report [None req-3d987c31-e446-429f-8a94-e828e38b6ea8 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] Deleted allocations for instance 4b582e5d-eef1-41f6-84b5-102efe3bf3f8
Nov 15 09:32:14 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-3d987c31-e446-429f-8a94-e828e38b6ea8 tempest-DeleteServersTestJSON-1876319053 tempest-DeleteServersTestJSON-1876319053-project-member] Lock "4b582e5d-eef1-41f6-84b5-102efe3bf3f8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.735s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:32:14 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:32:15 user nova-compute[75122]: DEBUG nova.compute.manager [req-f9a1b427-ccb6-4086-a67c-88465e74751d req-ab0b31ee-0eb3-4d2a-8236-b9299d60e74c service nova] [instance: bcb58c79-f6b3-44d9-a80f-1a4cf580379f] Received event network-changed-364a329a-8a90-43f6-9927-0c07dc1d6cbe {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:32:15 user nova-compute[75122]: DEBUG nova.compute.manager [req-f9a1b427-ccb6-4086-a67c-88465e74751d req-ab0b31ee-0eb3-4d2a-8236-b9299d60e74c service nova] [instance: bcb58c79-f6b3-44d9-a80f-1a4cf580379f] Refreshing instance network info cache due to event network-changed-364a329a-8a90-43f6-9927-0c07dc1d6cbe. {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 09:32:15 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-f9a1b427-ccb6-4086-a67c-88465e74751d req-ab0b31ee-0eb3-4d2a-8236-b9299d60e74c service nova] Acquiring lock "refresh_cache-bcb58c79-f6b3-44d9-a80f-1a4cf580379f" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 09:32:15 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-f9a1b427-ccb6-4086-a67c-88465e74751d req-ab0b31ee-0eb3-4d2a-8236-b9299d60e74c service nova] Acquired lock "refresh_cache-bcb58c79-f6b3-44d9-a80f-1a4cf580379f" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 09:32:15 user nova-compute[75122]: DEBUG nova.network.neutron [req-f9a1b427-ccb6-4086-a67c-88465e74751d req-ab0b31ee-0eb3-4d2a-8236-b9299d60e74c service nova] [instance: bcb58c79-f6b3-44d9-a80f-1a4cf580379f] Refreshing network info cache for port 364a329a-8a90-43f6-9927-0c07dc1d6cbe {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 09:32:15 user nova-compute[75122]: DEBUG nova.network.neutron [req-f9a1b427-ccb6-4086-a67c-88465e74751d req-ab0b31ee-0eb3-4d2a-8236-b9299d60e74c service nova] [instance: bcb58c79-f6b3-44d9-a80f-1a4cf580379f] Updated VIF entry in instance network info cache for port 364a329a-8a90-43f6-9927-0c07dc1d6cbe. {{(pid=75122) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 09:32:15 user nova-compute[75122]: DEBUG nova.network.neutron [req-f9a1b427-ccb6-4086-a67c-88465e74751d req-ab0b31ee-0eb3-4d2a-8236-b9299d60e74c service nova] [instance: bcb58c79-f6b3-44d9-a80f-1a4cf580379f] Updating instance_info_cache with network_info: [{"id": "364a329a-8a90-43f6-9927-0c07dc1d6cbe", "address": "fa:16:3e:aa:38:2f", "network": {"id": "d1bb497f-e1d4-4f70-9e5c-263b91c0b4ea", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-246917524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81b94e91587545a59312e374914b4526", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap364a329a-8a", "ovs_interfaceid": "364a329a-8a90-43f6-9927-0c07dc1d6cbe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:32:15 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-f9a1b427-ccb6-4086-a67c-88465e74751d req-ab0b31ee-0eb3-4d2a-8236-b9299d60e74c service nova] Releasing lock "refresh_cache-bcb58c79-f6b3-44d9-a80f-1a4cf580379f" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 09:32:16 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:32:17 user nova-compute[75122]: DEBUG nova.compute.manager [req-8cb31397-9b4b-40e7-bf36-1a65dcb1a0a0 req-50a2f511-dfe5-45e6-82ee-66fe135bfcaa service nova] [instance: e0f32160-7130-4b9c-aa9c-84123f3a6b32] Received event network-changed-0d48c0d7-8a0f-4bfa-b8b7-290f122c3f4a {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:32:17 user nova-compute[75122]: DEBUG nova.compute.manager [req-8cb31397-9b4b-40e7-bf36-1a65dcb1a0a0 req-50a2f511-dfe5-45e6-82ee-66fe135bfcaa service nova] [instance: e0f32160-7130-4b9c-aa9c-84123f3a6b32] Refreshing instance network info cache due to event network-changed-0d48c0d7-8a0f-4bfa-b8b7-290f122c3f4a. {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 09:32:17 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-8cb31397-9b4b-40e7-bf36-1a65dcb1a0a0 req-50a2f511-dfe5-45e6-82ee-66fe135bfcaa service nova] Acquiring lock "refresh_cache-e0f32160-7130-4b9c-aa9c-84123f3a6b32" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 09:32:17 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-8cb31397-9b4b-40e7-bf36-1a65dcb1a0a0 req-50a2f511-dfe5-45e6-82ee-66fe135bfcaa service nova] Acquired lock "refresh_cache-e0f32160-7130-4b9c-aa9c-84123f3a6b32" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 09:32:17 user nova-compute[75122]: DEBUG nova.network.neutron [req-8cb31397-9b4b-40e7-bf36-1a65dcb1a0a0 req-50a2f511-dfe5-45e6-82ee-66fe135bfcaa service nova] [instance: e0f32160-7130-4b9c-aa9c-84123f3a6b32] Refreshing network info cache for port 0d48c0d7-8a0f-4bfa-b8b7-290f122c3f4a {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 09:32:17 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-b51693ea-872e-4685-a7a2-ea0cd338912e tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] Acquiring lock "bcb58c79-f6b3-44d9-a80f-1a4cf580379f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:32:17 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-b51693ea-872e-4685-a7a2-ea0cd338912e tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] Lock "bcb58c79-f6b3-44d9-a80f-1a4cf580379f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:32:17 user nova-compute[75122]: DEBUG nova.objects.instance [None req-b51693ea-872e-4685-a7a2-ea0cd338912e tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] Lazy-loading 'flavor' on Instance uuid bcb58c79-f6b3-44d9-a80f-1a4cf580379f {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:32:17 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-b51693ea-872e-4685-a7a2-ea0cd338912e tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] Lock "bcb58c79-f6b3-44d9-a80f-1a4cf580379f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.085s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:32:17 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-b51693ea-872e-4685-a7a2-ea0cd338912e tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] Acquiring lock "bcb58c79-f6b3-44d9-a80f-1a4cf580379f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:32:17 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-b51693ea-872e-4685-a7a2-ea0cd338912e tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] Lock "bcb58c79-f6b3-44d9-a80f-1a4cf580379f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:32:17 user nova-compute[75122]: INFO nova.compute.manager [None req-b51693ea-872e-4685-a7a2-ea0cd338912e tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] [instance: bcb58c79-f6b3-44d9-a80f-1a4cf580379f] Attaching volume c99dc28e-fa63-40b8-820f-03d6c84a132f to /dev/sdc
Nov 15 09:32:17 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-6ed35de7-c150-4e42-8aeb-855adac35167 tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] Acquiring lock "interface-e0f32160-7130-4b9c-aa9c-84123f3a6b32-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:32:17 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-6ed35de7-c150-4e42-8aeb-855adac35167 tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] Lock "interface-e0f32160-7130-4b9c-aa9c-84123f3a6b32-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:32:17 user nova-compute[75122]: DEBUG nova.objects.instance [None req-6ed35de7-c150-4e42-8aeb-855adac35167 tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] Lazy-loading 'flavor' on Instance uuid e0f32160-7130-4b9c-aa9c-84123f3a6b32 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:32:17 user nova-compute[75122]: DEBUG os_brick.utils [None req-b51693ea-872e-4685-a7a2-ea0cd338912e tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 09:32:17 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:32:17 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:32:17 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[09f52046-3a4e-4721-bcee-54be6f3e7c4e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:742fb64b3587\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:32:17 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:32:17 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:32:17 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[97e146df-c60e-465d-83ba-f1818a346cd5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:32:17 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:32:17 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:32:17 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6c4c26a-5440-4183-9a90-a1eccdf693dc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:32:17 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[e52a4596-318a-41c3-8f05-ce879f5ef4b4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:32:17 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-b51693ea-872e-4685-a7a2-ea0cd338912e tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] Running cmd (subprocess): nvme version {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:32:17 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-b51693ea-872e-4685-a7a2-ea0cd338912e tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] 'nvme version' failed. Not Retrying. {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 09:32:17 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b51693ea-872e-4685-a7a2-ea0cd338912e tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] nvme not present on system {{(pid=75122) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 09:32:17 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:32:17 user nova-compute[75122]: DEBUG nova.network.neutron [req-8cb31397-9b4b-40e7-bf36-1a65dcb1a0a0 req-50a2f511-dfe5-45e6-82ee-66fe135bfcaa service nova] [instance: e0f32160-7130-4b9c-aa9c-84123f3a6b32] Updated VIF entry in instance network info cache for port 0d48c0d7-8a0f-4bfa-b8b7-290f122c3f4a. {{(pid=75122) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 09:32:17 user nova-compute[75122]: DEBUG nova.network.neutron [req-8cb31397-9b4b-40e7-bf36-1a65dcb1a0a0 req-50a2f511-dfe5-45e6-82ee-66fe135bfcaa service nova] [instance: e0f32160-7130-4b9c-aa9c-84123f3a6b32] Updating instance_info_cache with network_info: [{"id": "0d48c0d7-8a0f-4bfa-b8b7-290f122c3f4a", "address": "fa:16:3e:fd:20:4e", "network": {"id": "46853cd4-ee0a-44fe-b185-8ef14e956701", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1452664326-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6082a9c95d70462586e1f1195b43a383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d48c0d7-8a", "ovs_interfaceid": "0d48c0d7-8a0f-4bfa-b8b7-290f122c3f4a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:32:17 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 09:32:17 user nova-compute[75122]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 09:32:17 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0154dfc-cee4-4d0d-b014-ce84dbc2a333]: (4, '') {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:32:17 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.lightos [None req-b51693ea-872e-4685-a7a2-ea0cd338912e tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75122) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 09:32:17 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.lightos [None req-b51693ea-872e-4685-a7a2-ea0cd338912e tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75122) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 09:32:17 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.lightos [None req-b51693ea-872e-4685-a7a2-ea0cd338912e tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] LIGHTOS: no hostnqn found. {{(pid=75122) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 09:32:17 user nova-compute[75122]: DEBUG os_brick.utils [None req-b51693ea-872e-4685-a7a2-ea0cd338912e tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:742fb64b3587', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 09:32:17 user nova-compute[75122]: DEBUG nova.virt.block_device [None req-b51693ea-872e-4685-a7a2-ea0cd338912e tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] [instance: bcb58c79-f6b3-44d9-a80f-1a4cf580379f] Updating existing volume attachment record: 43a8fb89-dd8b-4495-a94c-0f88c34e071e {{(pid=75122) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 09:32:17 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-8cb31397-9b4b-40e7-bf36-1a65dcb1a0a0 req-50a2f511-dfe5-45e6-82ee-66fe135bfcaa service nova] Releasing lock "refresh_cache-e0f32160-7130-4b9c-aa9c-84123f3a6b32" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 09:32:17 user nova-compute[75122]: DEBUG nova.objects.instance [None req-6ed35de7-c150-4e42-8aeb-855adac35167 tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] Lazy-loading 'pci_requests' on Instance uuid e0f32160-7130-4b9c-aa9c-84123f3a6b32 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:32:17 user nova-compute[75122]: DEBUG nova.objects.base [None req-6ed35de7-c150-4e42-8aeb-855adac35167 tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] Object Instance<e0f32160-7130-4b9c-aa9c-84123f3a6b32> lazy-loaded attributes: flavor,pci_requests {{(pid=75122) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 09:32:17 user nova-compute[75122]: DEBUG nova.network.neutron [None req-6ed35de7-c150-4e42-8aeb-855adac35167 tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] [instance: e0f32160-7130-4b9c-aa9c-84123f3a6b32] allocate_for_instance() {{(pid=75122) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 09:32:18 user nova-compute[75122]: DEBUG nova.policy [None req-6ed35de7-c150-4e42-8aeb-855adac35167 tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd2529e19d29e4120b6e8ae75e16bb5b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6082a9c95d70462586e1f1195b43a383', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75122) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 09:32:18 user nova-compute[75122]: DEBUG nova.network.neutron [None req-6ed35de7-c150-4e42-8aeb-855adac35167 tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] [instance: e0f32160-7130-4b9c-aa9c-84123f3a6b32] Successfully created port: ce0d75c2-85b4-4e49-8d42-767b17493e53 {{(pid=75122) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 09:32:19 user nova-compute[75122]: DEBUG nova.network.neutron [None req-6ed35de7-c150-4e42-8aeb-855adac35167 tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] [instance: e0f32160-7130-4b9c-aa9c-84123f3a6b32] Successfully updated port: ce0d75c2-85b4-4e49-8d42-767b17493e53 {{(pid=75122) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 09:32:19 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-6ed35de7-c150-4e42-8aeb-855adac35167 tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] Acquiring lock "refresh_cache-e0f32160-7130-4b9c-aa9c-84123f3a6b32" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 09:32:19 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-6ed35de7-c150-4e42-8aeb-855adac35167 tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] Acquired lock "refresh_cache-e0f32160-7130-4b9c-aa9c-84123f3a6b32" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 09:32:19 user nova-compute[75122]: DEBUG nova.network.neutron [None req-6ed35de7-c150-4e42-8aeb-855adac35167 tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] [instance: e0f32160-7130-4b9c-aa9c-84123f3a6b32] Building network info cache for instance {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 09:32:19 user nova-compute[75122]: DEBUG nova.compute.manager [req-d00926a2-42a7-4a20-8b09-a06c8c558b7a req-5555780e-c563-40c0-a00f-9ee8b8dd75fb service nova] [instance: e0f32160-7130-4b9c-aa9c-84123f3a6b32] Received event network-changed-ce0d75c2-85b4-4e49-8d42-767b17493e53 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:32:19 user nova-compute[75122]: DEBUG nova.compute.manager [req-d00926a2-42a7-4a20-8b09-a06c8c558b7a req-5555780e-c563-40c0-a00f-9ee8b8dd75fb service nova] [instance: e0f32160-7130-4b9c-aa9c-84123f3a6b32] Refreshing instance network info cache due to event network-changed-ce0d75c2-85b4-4e49-8d42-767b17493e53. {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 09:32:19 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-d00926a2-42a7-4a20-8b09-a06c8c558b7a req-5555780e-c563-40c0-a00f-9ee8b8dd75fb service nova] Acquiring lock "refresh_cache-e0f32160-7130-4b9c-aa9c-84123f3a6b32" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 09:32:19 user nova-compute[75122]: DEBUG nova.network.neutron [None req-6ed35de7-c150-4e42-8aeb-855adac35167 tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] [instance: e0f32160-7130-4b9c-aa9c-84123f3a6b32] Updating instance_info_cache with network_info: [{"id": "0d48c0d7-8a0f-4bfa-b8b7-290f122c3f4a", "address": "fa:16:3e:fd:20:4e", "network": {"id": "46853cd4-ee0a-44fe-b185-8ef14e956701", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1452664326-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6082a9c95d70462586e1f1195b43a383", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d48c0d7-8a", "ovs_interfaceid": "0d48c0d7-8a0f-4bfa-b8b7-290f122c3f4a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ce0d75c2-85b4-4e49-8d42-767b17493e53", "address": "fa:16:3e:9e:53:27", "network": {"id": "517e7cda-b26b-4dca-9b2b-b8a52f1ef18b", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1110889298", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "6082a9c95d70462586e1f1195b43a383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce0d75c2-85", "ovs_interfaceid": "ce0d75c2-85b4-4e49-8d42-767b17493e53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:32:19 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-6ed35de7-c150-4e42-8aeb-855adac35167 tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] Releasing lock "refresh_cache-e0f32160-7130-4b9c-aa9c-84123f3a6b32" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 09:32:19 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-d00926a2-42a7-4a20-8b09-a06c8c558b7a req-5555780e-c563-40c0-a00f-9ee8b8dd75fb service nova] Acquired lock "refresh_cache-e0f32160-7130-4b9c-aa9c-84123f3a6b32" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 09:32:19 user nova-compute[75122]: DEBUG nova.network.neutron [req-d00926a2-42a7-4a20-8b09-a06c8c558b7a req-5555780e-c563-40c0-a00f-9ee8b8dd75fb service nova] [instance: e0f32160-7130-4b9c-aa9c-84123f3a6b32] Refreshing network info cache for port ce0d75c2-85b4-4e49-8d42-767b17493e53 {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 09:32:19 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-6ed35de7-c150-4e42-8aeb-855adac35167 tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T09:30:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-650907307',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-650907307',id=5,image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEs+MsbbhvkEM+SFSEAT1XChvfwYG6LS4xClecFc1s5hPTjvnawfxaNFAntQJzNhhhBe9ISEtvpo31FTBvmrG/LNlyB/uvXRpPMaH35dzVkZDJmlCiGv/MxZIKKpRxaHLw==',key_name='tempest-keypair-2107215481',keypairs=<?>,launch_index=0,launched_at=2023-11-15T09:30:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='6082a9c95d70462586e1f1195b43a383',ramdisk_id='',reservation_id='r-j04j8rw4',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-2027876138',owner_user_name='tempest-TaggedAttachmentsTest-2027876138-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T09:30:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d2529e19d29e4120b6e8ae75e16bb5b6',uuid=e0f32160-7130-4b9c-aa9c-84123f3a6b32,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ce0d75c2-85b4-4e49-8d42-767b17493e53", "address": "fa:16:3e:9e:53:27", "network": {"id": "517e7cda-b26b-4dca-9b2b-b8a52f1ef18b", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1110889298", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "6082a9c95d70462586e1f1195b43a383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce0d75c2-85", "ovs_interfaceid": "ce0d75c2-85b4-4e49-8d42-767b17493e53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 09:32:19 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-6ed35de7-c150-4e42-8aeb-855adac35167 tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] Converting VIF {"id": "ce0d75c2-85b4-4e49-8d42-767b17493e53", "address": "fa:16:3e:9e:53:27", "network": {"id": "517e7cda-b26b-4dca-9b2b-b8a52f1ef18b", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1110889298", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "6082a9c95d70462586e1f1195b43a383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce0d75c2-85", "ovs_interfaceid": "ce0d75c2-85b4-4e49-8d42-767b17493e53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 09:32:19 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-6ed35de7-c150-4e42-8aeb-855adac35167 tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:53:27,bridge_name='br-int',has_traffic_filtering=True,id=ce0d75c2-85b4-4e49-8d42-767b17493e53,network=Network(517e7cda-b26b-4dca-9b2b-b8a52f1ef18b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce0d75c2-85') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 09:32:19 user nova-compute[75122]: DEBUG os_vif [None req-6ed35de7-c150-4e42-8aeb-855adac35167 tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:53:27,bridge_name='br-int',has_traffic_filtering=True,id=ce0d75c2-85b4-4e49-8d42-767b17493e53,network=Network(517e7cda-b26b-4dca-9b2b-b8a52f1ef18b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce0d75c2-85') {{(pid=75122) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 09:32:19 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:32:19 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:32:19 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 09:32:19 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:32:19 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd5e45b45-af10-586a-ba5f-f5f17e2e809a', '_type': 'linux-noop'}}, row=False) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:32:19 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:32:19 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:32:19 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:32:19 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapce0d75c2-85, may_exist=True, interface_attrs={}) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:32:19 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapce0d75c2-85, col_values=(('qos', UUID('2126e3bb-3382-4dbf-a4ef-6a3f62fb10ac')),), if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:32:19 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapce0d75c2-85, col_values=(('external_ids', {'iface-id': 'ce0d75c2-85b4-4e49-8d42-767b17493e53', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9e:53:27', 'vm-uuid': 'e0f32160-7130-4b9c-aa9c-84123f3a6b32'}),), if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:32:19 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:32:19 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:32:19 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:32:19 user nova-compute[75122]: INFO os_vif [None req-6ed35de7-c150-4e42-8aeb-855adac35167 tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:53:27,bridge_name='br-int',has_traffic_filtering=True,id=ce0d75c2-85b4-4e49-8d42-767b17493e53,network=Network(517e7cda-b26b-4dca-9b2b-b8a52f1ef18b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce0d75c2-85')
Nov 15 09:32:19 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-6ed35de7-c150-4e42-8aeb-855adac35167 tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T09:30:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-650907307',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-650907307',id=5,image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEs+MsbbhvkEM+SFSEAT1XChvfwYG6LS4xClecFc1s5hPTjvnawfxaNFAntQJzNhhhBe9ISEtvpo31FTBvmrG/LNlyB/uvXRpPMaH35dzVkZDJmlCiGv/MxZIKKpRxaHLw==',key_name='tempest-keypair-2107215481',keypairs=<?>,launch_index=0,launched_at=2023-11-15T09:30:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='6082a9c95d70462586e1f1195b43a383',ramdisk_id='',reservation_id='r-j04j8rw4',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-2027876138',owner_user_name='tempest-TaggedAttachmentsTest-2027876138-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T09:30:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d2529e19d29e4120b6e8ae75e16bb5b6',uuid=e0f32160-7130-4b9c-aa9c-84123f3a6b32,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ce0d75c2-85b4-4e49-8d42-767b17493e53", "address": "fa:16:3e:9e:53:27", "network": {"id": "517e7cda-b26b-4dca-9b2b-b8a52f1ef18b", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1110889298", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "6082a9c95d70462586e1f1195b43a383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce0d75c2-85", "ovs_interfaceid": "ce0d75c2-85b4-4e49-8d42-767b17493e53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75122) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 09:32:19 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-6ed35de7-c150-4e42-8aeb-855adac35167 tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] Converting VIF {"id": "ce0d75c2-85b4-4e49-8d42-767b17493e53", "address": "fa:16:3e:9e:53:27", "network": {"id": "517e7cda-b26b-4dca-9b2b-b8a52f1ef18b", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1110889298", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "6082a9c95d70462586e1f1195b43a383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce0d75c2-85", "ovs_interfaceid": "ce0d75c2-85b4-4e49-8d42-767b17493e53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 09:32:19 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-6ed35de7-c150-4e42-8aeb-855adac35167 tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:53:27,bridge_name='br-int',has_traffic_filtering=True,id=ce0d75c2-85b4-4e49-8d42-767b17493e53,network=Network(517e7cda-b26b-4dca-9b2b-b8a52f1ef18b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce0d75c2-85') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 09:32:19 user nova-compute[75122]: DEBUG nova.virt.libvirt.guest [None req-6ed35de7-c150-4e42-8aeb-855adac35167 tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] attach device xml: <interface type="ethernet">
Nov 15 09:32:19 user nova-compute[75122]:   <mac address="fa:16:3e:9e:53:27"/>
Nov 15 09:32:19 user nova-compute[75122]:   <model type="virtio"/>
Nov 15 09:32:19 user nova-compute[75122]:   <mtu size="1442"/>
Nov 15 09:32:19 user nova-compute[75122]:   <target dev="tapce0d75c2-85"/>
Nov 15 09:32:19 user nova-compute[75122]: </interface>
Nov 15 09:32:19 user nova-compute[75122]:  {{(pid=75122) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 09:32:19 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:32:19 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:32:19 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:32:19 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:32:20 user nova-compute[75122]: DEBUG nova.compute.manager [req-e1b9264f-afeb-4ccb-a14e-152c00ba2a18 req-9a1ec5c2-1266-4415-a520-51b2de7ac126 service nova] [instance: e0f32160-7130-4b9c-aa9c-84123f3a6b32] Received event network-vif-plugged-ce0d75c2-85b4-4e49-8d42-767b17493e53 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:32:20 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-e1b9264f-afeb-4ccb-a14e-152c00ba2a18 req-9a1ec5c2-1266-4415-a520-51b2de7ac126 service nova] Acquiring lock "e0f32160-7130-4b9c-aa9c-84123f3a6b32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:32:20 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-e1b9264f-afeb-4ccb-a14e-152c00ba2a18 req-9a1ec5c2-1266-4415-a520-51b2de7ac126 service nova] Lock "e0f32160-7130-4b9c-aa9c-84123f3a6b32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:32:20 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-e1b9264f-afeb-4ccb-a14e-152c00ba2a18 req-9a1ec5c2-1266-4415-a520-51b2de7ac126 service nova] Lock "e0f32160-7130-4b9c-aa9c-84123f3a6b32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:32:20 user nova-compute[75122]: DEBUG nova.compute.manager [req-e1b9264f-afeb-4ccb-a14e-152c00ba2a18 req-9a1ec5c2-1266-4415-a520-51b2de7ac126 service nova] [instance: e0f32160-7130-4b9c-aa9c-84123f3a6b32] No waiting events found dispatching network-vif-plugged-ce0d75c2-85b4-4e49-8d42-767b17493e53 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:32:20 user nova-compute[75122]: WARNING nova.compute.manager [req-e1b9264f-afeb-4ccb-a14e-152c00ba2a18 req-9a1ec5c2-1266-4415-a520-51b2de7ac126 service nova] [instance: e0f32160-7130-4b9c-aa9c-84123f3a6b32] Received unexpected event network-vif-plugged-ce0d75c2-85b4-4e49-8d42-767b17493e53 for instance with vm_state active and task_state None.
Nov 15 09:32:20 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-6ed35de7-c150-4e42-8aeb-855adac35167 tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] No BDM found with device name vda, not building metadata. {{(pid=75122) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 09:32:20 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-6ed35de7-c150-4e42-8aeb-855adac35167 tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] No BDM found with device name hda, not building metadata. {{(pid=75122) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 09:32:20 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-6ed35de7-c150-4e42-8aeb-855adac35167 tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] No VIF found with MAC fa:16:3e:fd:20:4e, not building metadata {{(pid=75122) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 09:32:20 user nova-compute[75122]: DEBUG nova.network.neutron [req-d00926a2-42a7-4a20-8b09-a06c8c558b7a req-5555780e-c563-40c0-a00f-9ee8b8dd75fb service nova] [instance: e0f32160-7130-4b9c-aa9c-84123f3a6b32] Updated VIF entry in instance network info cache for port ce0d75c2-85b4-4e49-8d42-767b17493e53. {{(pid=75122) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 09:32:20 user nova-compute[75122]: DEBUG nova.network.neutron [req-d00926a2-42a7-4a20-8b09-a06c8c558b7a req-5555780e-c563-40c0-a00f-9ee8b8dd75fb service nova] [instance: e0f32160-7130-4b9c-aa9c-84123f3a6b32] Updating instance_info_cache with network_info: [{"id": "0d48c0d7-8a0f-4bfa-b8b7-290f122c3f4a", "address": "fa:16:3e:fd:20:4e", "network": {"id": "46853cd4-ee0a-44fe-b185-8ef14e956701", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1452664326-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6082a9c95d70462586e1f1195b43a383", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d48c0d7-8a", "ovs_interfaceid": "0d48c0d7-8a0f-4bfa-b8b7-290f122c3f4a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ce0d75c2-85b4-4e49-8d42-767b17493e53", "address": "fa:16:3e:9e:53:27", "network": {"id": "517e7cda-b26b-4dca-9b2b-b8a52f1ef18b", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1110889298", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "6082a9c95d70462586e1f1195b43a383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce0d75c2-85", "ovs_interfaceid": "ce0d75c2-85b4-4e49-8d42-767b17493e53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:32:20 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-d00926a2-42a7-4a20-8b09-a06c8c558b7a req-5555780e-c563-40c0-a00f-9ee8b8dd75fb service nova] Releasing lock "refresh_cache-e0f32160-7130-4b9c-aa9c-84123f3a6b32" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 09:32:20 user nova-compute[75122]: DEBUG nova.virt.libvirt.guest [None req-6ed35de7-c150-4e42-8aeb-855adac35167 tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 09:32:20 user nova-compute[75122]:   <nova:package version="0.0.0"/>
Nov 15 09:32:20 user nova-compute[75122]:   <nova:name>tempest-device-tagging-server-650907307</nova:name>
Nov 15 09:32:20 user nova-compute[75122]:   <nova:creationTime>2023-11-15 09:32:20</nova:creationTime>
Nov 15 09:32:20 user nova-compute[75122]:   <nova:flavor name="m1.tiny">
Nov 15 09:32:20 user nova-compute[75122]:     <nova:memory>512</nova:memory>
Nov 15 09:32:20 user nova-compute[75122]:     <nova:disk>1</nova:disk>
Nov 15 09:32:20 user nova-compute[75122]:     <nova:swap>0</nova:swap>
Nov 15 09:32:20 user nova-compute[75122]:     <nova:ephemeral>0</nova:ephemeral>
Nov 15 09:32:20 user nova-compute[75122]:     <nova:vcpus>1</nova:vcpus>
Nov 15 09:32:20 user nova-compute[75122]:   </nova:flavor>
Nov 15 09:32:20 user nova-compute[75122]:   <nova:owner>
Nov 15 09:32:20 user nova-compute[75122]:     <nova:user uuid="d2529e19d29e4120b6e8ae75e16bb5b6">tempest-TaggedAttachmentsTest-2027876138-project-member</nova:user>
Nov 15 09:32:20 user nova-compute[75122]:     <nova:project uuid="6082a9c95d70462586e1f1195b43a383">tempest-TaggedAttachmentsTest-2027876138</nova:project>
Nov 15 09:32:20 user nova-compute[75122]:   </nova:owner>
Nov 15 09:32:20 user nova-compute[75122]:   <nova:root type="image" uuid="5e862cfe-47b8-4725-8292-65761ee6d0f5"/>
Nov 15 09:32:20 user nova-compute[75122]:   <nova:ports>
Nov 15 09:32:20 user nova-compute[75122]:     <nova:port uuid="0d48c0d7-8a0f-4bfa-b8b7-290f122c3f4a">
Nov 15 09:32:20 user nova-compute[75122]:       <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 15 09:32:20 user nova-compute[75122]:     </nova:port>
Nov 15 09:32:20 user nova-compute[75122]:     <nova:port uuid="ce0d75c2-85b4-4e49-8d42-767b17493e53">
Nov 15 09:32:20 user nova-compute[75122]:       <nova:ip type="fixed" address="10.10.10.10" ipVersion="4"/>
Nov 15 09:32:20 user nova-compute[75122]:     </nova:port>
Nov 15 09:32:20 user nova-compute[75122]:   </nova:ports>
Nov 15 09:32:20 user nova-compute[75122]: </nova:instance>
Nov 15 09:32:20 user nova-compute[75122]:  {{(pid=75122) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 15 09:32:20 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-6ed35de7-c150-4e42-8aeb-855adac35167 tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] Lock "interface-e0f32160-7130-4b9c-aa9c-84123f3a6b32-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 2.807s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:32:20 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:32:20 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:32:20 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:32:20 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-a98c0263-b94a-4150-b9a4-56de7403586a tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] Acquiring lock "e0f32160-7130-4b9c-aa9c-84123f3a6b32" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:32:20 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-a98c0263-b94a-4150-b9a4-56de7403586a tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] Lock "e0f32160-7130-4b9c-aa9c-84123f3a6b32" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:32:20 user nova-compute[75122]: DEBUG nova.objects.instance [None req-a98c0263-b94a-4150-b9a4-56de7403586a tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] Lazy-loading 'flavor' on Instance uuid e0f32160-7130-4b9c-aa9c-84123f3a6b32 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:32:20 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-a98c0263-b94a-4150-b9a4-56de7403586a tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] Lock "e0f32160-7130-4b9c-aa9c-84123f3a6b32" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:32:20 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-a98c0263-b94a-4150-b9a4-56de7403586a tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] Acquiring lock "e0f32160-7130-4b9c-aa9c-84123f3a6b32" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:32:20 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-a98c0263-b94a-4150-b9a4-56de7403586a tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] Lock "e0f32160-7130-4b9c-aa9c-84123f3a6b32" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:32:20 user nova-compute[75122]: INFO nova.compute.manager [None req-a98c0263-b94a-4150-b9a4-56de7403586a tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] [instance: e0f32160-7130-4b9c-aa9c-84123f3a6b32] Attaching volume 6b67b7d3-ab4f-4cc4-b9b8-906eac8491e4 to /dev/vdb
Nov 15 09:32:20 user nova-compute[75122]: DEBUG os_brick.utils [None req-a98c0263-b94a-4150-b9a4-56de7403586a tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 09:32:20 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:32:20 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:32:20 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[624ffff3-8f82-4f50-9a64-b02a2817272d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:742fb64b3587\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:32:20 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:32:20 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:32:20 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[245b6ae9-6601-421a-976b-c760cebfeeea]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:32:20 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:32:20 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:32:20 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c3beffe-c580-4b13-a1e3-d8e9913c713f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:32:20 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[ece1c611-00c0-4ed9-992d-937e79411248]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:32:20 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-a98c0263-b94a-4150-b9a4-56de7403586a tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] Running cmd (subprocess): nvme version {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:32:20 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-a98c0263-b94a-4150-b9a4-56de7403586a tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] 'nvme version' failed. Not Retrying. {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 09:32:20 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a98c0263-b94a-4150-b9a4-56de7403586a tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] nvme not present on system {{(pid=75122) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 09:32:20 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:32:20 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 09:32:20 user nova-compute[75122]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 09:32:20 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[630ac3cf-eebd-42ed-8b52-9f1e78a5b94a]: (4, '') {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:32:20 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.lightos [None req-a98c0263-b94a-4150-b9a4-56de7403586a tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75122) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 09:32:20 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.lightos [None req-a98c0263-b94a-4150-b9a4-56de7403586a tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75122) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 09:32:20 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.lightos [None req-a98c0263-b94a-4150-b9a4-56de7403586a tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] LIGHTOS: no hostnqn found. {{(pid=75122) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 09:32:20 user nova-compute[75122]: DEBUG os_brick.utils [None req-a98c0263-b94a-4150-b9a4-56de7403586a tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] <== get_connector_properties: return (108ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:742fb64b3587', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 09:32:20 user nova-compute[75122]: DEBUG nova.virt.block_device [None req-a98c0263-b94a-4150-b9a4-56de7403586a tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] [instance: e0f32160-7130-4b9c-aa9c-84123f3a6b32] Updating existing volume attachment record: 56dad9a3-2b0a-4658-8066-10dca35c89e0 {{(pid=75122) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 09:32:22 user nova-compute[75122]: DEBUG nova.compute.manager [req-3e42be17-52ae-450c-a592-c8fc7487f193 req-3f90bf9a-9f67-4fc7-81ea-45b17ac69cb4 service nova] [instance: e0f32160-7130-4b9c-aa9c-84123f3a6b32] Received event network-vif-plugged-ce0d75c2-85b4-4e49-8d42-767b17493e53 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:32:22 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-3e42be17-52ae-450c-a592-c8fc7487f193 req-3f90bf9a-9f67-4fc7-81ea-45b17ac69cb4 service nova] Acquiring lock "e0f32160-7130-4b9c-aa9c-84123f3a6b32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:32:22 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-3e42be17-52ae-450c-a592-c8fc7487f193 req-3f90bf9a-9f67-4fc7-81ea-45b17ac69cb4 service nova] Lock "e0f32160-7130-4b9c-aa9c-84123f3a6b32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:32:22 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-3e42be17-52ae-450c-a592-c8fc7487f193 req-3f90bf9a-9f67-4fc7-81ea-45b17ac69cb4 service nova] Lock "e0f32160-7130-4b9c-aa9c-84123f3a6b32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:32:22 user nova-compute[75122]: DEBUG nova.compute.manager [req-3e42be17-52ae-450c-a592-c8fc7487f193 req-3f90bf9a-9f67-4fc7-81ea-45b17ac69cb4 service nova] [instance: e0f32160-7130-4b9c-aa9c-84123f3a6b32] No waiting events found dispatching network-vif-plugged-ce0d75c2-85b4-4e49-8d42-767b17493e53 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:32:22 user nova-compute[75122]: WARNING nova.compute.manager [req-3e42be17-52ae-450c-a592-c8fc7487f193 req-3f90bf9a-9f67-4fc7-81ea-45b17ac69cb4 service nova] [instance: e0f32160-7130-4b9c-aa9c-84123f3a6b32] Received unexpected event network-vif-plugged-ce0d75c2-85b4-4e49-8d42-767b17493e53 for instance with vm_state active and task_state None.
Nov 15 09:32:22 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b51693ea-872e-4685-a7a2-ea0cd338912e tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] [instance: bcb58c79-f6b3-44d9-a80f-1a4cf580379f] Calling os-brick to attach iSCSI Volume {{(pid=75122) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 09:32:22 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-b51693ea-872e-4685-a7a2-ea0cd338912e tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffa04060b80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c99dc28e-fa63-40b8-820f-03d6c84a132f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yXZzKCmD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 09:32:22 user nova-compute[75122]: WARNING os_brick.initiator.connectors.base [None req-b51693ea-872e-4685-a7a2-ea0cd338912e tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 09:32:22 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-b51693ea-872e-4685-a7a2-ea0cd338912e tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 09:32:22 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-b51693ea-872e-4685-a7a2-ea0cd338912e tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 09:32:22 user nova-compute[75122]: WARNING os_brick.initiator.connectors.base [None req-b51693ea-872e-4685-a7a2-ea0cd338912e tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 09:32:22 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-b51693ea-872e-4685-a7a2-ea0cd338912e tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c99dc28e-fa63-40b8-820f-03d6c84a132f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 09:32:22 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-b51693ea-872e-4685-a7a2-ea0cd338912e tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c99dc28e-fa63-40b8-820f-03d6c84a132f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 09:32:22 user nova-compute[75122]: INFO os_brick.initiator.connectors.iscsi [None req-b51693ea-872e-4685-a7a2-ea0cd338912e tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 09:32:22 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c99dc28e-fa63-40b8-820f-03d6c84a132f -p 172.16.0.220:3260 {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:32:22 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c99dc28e-fa63-40b8-820f-03d6c84a132f -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:32:22 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[43c157d8-fd33-4ea9-a351-9b60d2ff4c4d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:32:22 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-b51693ea-872e-4685-a7a2-ea0cd338912e tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 09:32:22 user nova-compute[75122]:  {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:32:22 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c99dc28e-fa63-40b8-820f-03d6c84a132f -p 172.16.0.220:3260 --interface default --op new {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:32:22 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c99dc28e-fa63-40b8-820f-03d6c84a132f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:32:22 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e18f005-33bf-41ea-bfeb-1ee75345a174]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c99dc28e-fa63-40b8-820f-03d6c84a132f] added\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:32:22 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-b51693ea-872e-4685-a7a2-ea0cd338912e tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c99dc28e-fa63-40b8-820f-03d6c84a132f] added
Nov 15 09:32:22 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:32:22 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c99dc28e-fa63-40b8-820f-03d6c84a132f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:32:22 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c99dc28e-fa63-40b8-820f-03d6c84a132f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:32:22 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[d33e92b2-c082-45ca-9d1c-460f9ad30de1]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:32:22 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-b51693ea-872e-4685-a7a2-ea0cd338912e tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:32:22 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c99dc28e-fa63-40b8-820f-03d6c84a132f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:32:22 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c99dc28e-fa63-40b8-820f-03d6c84a132f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:32:22 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed7dec84-a3ec-4e50-850f-ab9163c45b28]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:32:22 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-b51693ea-872e-4685-a7a2-ea0cd338912e tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:32:22 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c99dc28e-fa63-40b8-820f-03d6c84a132f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yXZzKCmD {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:32:22 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c99dc28e-fa63-40b8-820f-03d6c84a132f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yXZzKCmD" returned: 0 in 0.028s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:32:22 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddd57b81-38d4-4167-8fee-6bcc40d52fae]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:32:22 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-b51693ea-872e-4685-a7a2-ea0cd338912e tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yXZzKCmD'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:32:22 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c99dc28e-fa63-40b8-820f-03d6c84a132f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:32:22 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c99dc28e-fa63-40b8-820f-03d6c84a132f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:32:22 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c05ae8a-42d8-4729-88c9-0e3b799cf286]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:32:22 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-b51693ea-872e-4685-a7a2-ea0cd338912e tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:32:22 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:32:22 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:32:22 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[f20327b6-8a1d-4f09-8323-8f18a96fe8bc]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e (non-flash)\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:32:22 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-b51693ea-872e-4685-a7a2-ea0cd338912e tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e (non-flash)
Nov 15 09:32:22 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 09:32:22 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-b51693ea-872e-4685-a7a2-ea0cd338912e tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e (non-flash)
Nov 15 09:32:22 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 09:32:22 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c99dc28e-fa63-40b8-820f-03d6c84a132f -p 172.16.0.220:3260 --login {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:32:22 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c99dc28e-fa63-40b8-820f-03d6c84a132f -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:32:22 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bdd5392-a714-4008-bef5-d0c8a6cd83b7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c99dc28e-fa63-40b8-820f-03d6c84a132f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c99dc28e-fa63-40b8-820f-03d6c84a132f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:32:22 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-b51693ea-872e-4685-a7a2-ea0cd338912e tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c99dc28e-fa63-40b8-820f-03d6c84a132f, portal: 172.16.0.220,3260]
Nov 15 09:32:22 user nova-compute[75122]: Login to [iface: default, target: iqn.2010-10.org.openstack:c99dc28e-fa63-40b8-820f-03d6c84a132f, portal: 172.16.0.220,3260] successful.
Nov 15 09:32:22 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:32:22 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c99dc28e-fa63-40b8-820f-03d6c84a132f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:32:22 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c99dc28e-fa63-40b8-820f-03d6c84a132f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:32:22 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5329da8-c887-4dcd-b533-7f1e9c850b89]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:32:22 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-b51693ea-872e-4685-a7a2-ea0cd338912e tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:32:22 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:32:22 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:32:22 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ec56bf5-5229-4ba3-94f0-b83b257be00d]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c99dc28e-fa63-40b8-820f-03d6c84a132f (non-flash)\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:32:22 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-b51693ea-872e-4685-a7a2-ea0cd338912e tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e (non-flash)
Nov 15 09:32:22 user nova-compute[75122]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c99dc28e-fa63-40b8-820f-03d6c84a132f (non-flash)
Nov 15 09:32:22 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 09:32:22 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-b51693ea-872e-4685-a7a2-ea0cd338912e tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e (non-flash)
Nov 15 09:32:22 user nova-compute[75122]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c99dc28e-fa63-40b8-820f-03d6c84a132f (non-flash)
Nov 15 09:32:22 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 09:32:22 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-b51693ea-872e-4685-a7a2-ea0cd338912e tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c99dc28e-fa63-40b8-820f-03d6c84a132f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.250s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 09:32:22 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-b51693ea-872e-4685-a7a2-ea0cd338912e tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] Connected to 172.16.0.220:3260 {{(pid=75122) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 09:32:22 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-b51693ea-872e-4685-a7a2-ea0cd338912e tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] HCTL ('34', '-', '-', 0) found on session 7 with lun 0 {{(pid=75122) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 09:32:22 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-b51693ea-872e-4685-a7a2-ea0cd338912e tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75122) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 09:32:22 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:32:22 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:32:22 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[0df90726-cd66-4799-ba50-5165806ef767]: (4, ('- - 0', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:32:22 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-b51693ea-872e-4685-a7a2-ea0cd338912e tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] Searching for a device in session 7 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75122) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 09:32:22 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-b51693ea-872e-4685-a7a2-ea0cd338912e tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:c99dc28e-fa63-40b8-820f-03d6c84a132f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yXZzKCmD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75122) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 09:32:23 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-b51693ea-872e-4685-a7a2-ea0cd338912e tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.285s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 09:32:23 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-b51693ea-872e-4685-a7a2-ea0cd338912e tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] <== connect_volume: return (1287ms) {'type': 'block', 'scsi_wwn': '23564356336383039', 'path': '/dev/sdc'} {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 09:32:23 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b51693ea-872e-4685-a7a2-ea0cd338912e tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] [instance: bcb58c79-f6b3-44d9-a80f-1a4cf580379f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23564356336383039', 'path': '/dev/sdc'} {{(pid=75122) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 09:32:23 user nova-compute[75122]: DEBUG nova.objects.instance [None req-b51693ea-872e-4685-a7a2-ea0cd338912e tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] Lazy-loading 'flavor' on Instance uuid bcb58c79-f6b3-44d9-a80f-1a4cf580379f {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:32:23 user nova-compute[75122]: DEBUG nova.virt.libvirt.guest [None req-b51693ea-872e-4685-a7a2-ea0cd338912e tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 09:32:23 user nova-compute[75122]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 09:32:23 user nova-compute[75122]:   <source dev="/dev/sdc"/>
Nov 15 09:32:23 user nova-compute[75122]:   <target dev="sdc" bus="scsi"/>
Nov 15 09:32:23 user nova-compute[75122]:   <serial>c99dc28e-fa63-40b8-820f-03d6c84a132f</serial>
Nov 15 09:32:23 user nova-compute[75122]:   <address type="drive" controller="0" unit="2"/>
Nov 15 09:32:23 user nova-compute[75122]: </disk>
Nov 15 09:32:23 user nova-compute[75122]:  {{(pid=75122) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 09:32:23 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-b51693ea-872e-4685-a7a2-ea0cd338912e tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] No BDM found with device name sda, not building metadata. {{(pid=75122) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 09:32:23 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-b51693ea-872e-4685-a7a2-ea0cd338912e tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] No BDM found with device name sdb, not building metadata. {{(pid=75122) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 09:32:23 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-b51693ea-872e-4685-a7a2-ea0cd338912e tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] No BDM found with device name sdc, not building metadata. {{(pid=75122) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 09:32:23 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-b51693ea-872e-4685-a7a2-ea0cd338912e tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] No VIF found with MAC fa:16:3e:aa:38:2f, not building metadata {{(pid=75122) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 09:32:24 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-b51693ea-872e-4685-a7a2-ea0cd338912e tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] Lock "bcb58c79-f6b3-44d9-a80f-1a4cf580379f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.628s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:32:24 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:32:24 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:32:25 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-080ba89a-eea2-4095-8e76-fc095c1e3888 tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] Acquiring lock "bcb58c79-f6b3-44d9-a80f-1a4cf580379f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:32:25 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-080ba89a-eea2-4095-8e76-fc095c1e3888 tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] Lock "bcb58c79-f6b3-44d9-a80f-1a4cf580379f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:32:25 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a98c0263-b94a-4150-b9a4-56de7403586a tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] [instance: e0f32160-7130-4b9c-aa9c-84123f3a6b32] Calling os-brick to attach iSCSI Volume {{(pid=75122) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 09:32:25 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-a98c0263-b94a-4150-b9a4-56de7403586a tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffa04060b80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6b67b7d3-ab4f-4cc4-b9b8-906eac8491e4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SIHoOrvc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 09:32:25 user nova-compute[75122]: WARNING os_brick.initiator.connectors.base [None req-a98c0263-b94a-4150-b9a4-56de7403586a tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 09:32:25 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-a98c0263-b94a-4150-b9a4-56de7403586a tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 09:32:25 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-a98c0263-b94a-4150-b9a4-56de7403586a tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 09:32:25 user nova-compute[75122]: WARNING os_brick.initiator.connectors.base [None req-a98c0263-b94a-4150-b9a4-56de7403586a tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 09:32:25 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-a98c0263-b94a-4150-b9a4-56de7403586a tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6b67b7d3-ab4f-4cc4-b9b8-906eac8491e4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 09:32:25 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-a98c0263-b94a-4150-b9a4-56de7403586a tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6b67b7d3-ab4f-4cc4-b9b8-906eac8491e4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 09:32:25 user nova-compute[75122]: INFO os_brick.initiator.connectors.iscsi [None req-a98c0263-b94a-4150-b9a4-56de7403586a tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 09:32:25 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b67b7d3-ab4f-4cc4-b9b8-906eac8491e4 -p 172.16.0.220:3260 {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:32:25 user nova-compute[75122]: INFO nova.compute.manager [None req-080ba89a-eea2-4095-8e76-fc095c1e3888 tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] [instance: bcb58c79-f6b3-44d9-a80f-1a4cf580379f] Detaching volume c99dc28e-fa63-40b8-820f-03d6c84a132f
Nov 15 09:32:25 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b67b7d3-ab4f-4cc4-b9b8-906eac8491e4 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:32:25 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c8247f8-6e14-47af-ab8a-1ae57f581e52]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:32:25 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-a98c0263-b94a-4150-b9a4-56de7403586a tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 09:32:25 user nova-compute[75122]:  {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:32:25 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b67b7d3-ab4f-4cc4-b9b8-906eac8491e4 -p 172.16.0.220:3260 --interface default --op new {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:32:25 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b67b7d3-ab4f-4cc4-b9b8-906eac8491e4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:32:25 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[c148facf-3729-45f4-bd31-bbf12db5a8aa]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6b67b7d3-ab4f-4cc4-b9b8-906eac8491e4] added\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:32:25 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-a98c0263-b94a-4150-b9a4-56de7403586a tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6b67b7d3-ab4f-4cc4-b9b8-906eac8491e4] added
Nov 15 09:32:25 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:32:25 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b67b7d3-ab4f-4cc4-b9b8-906eac8491e4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:32:25 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b67b7d3-ab4f-4cc4-b9b8-906eac8491e4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:32:25 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1857377-105c-499b-90c6-df08dbc8d692]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:32:25 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-a98c0263-b94a-4150-b9a4-56de7403586a tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:32:25 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b67b7d3-ab4f-4cc4-b9b8-906eac8491e4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:32:25 user nova-compute[75122]: INFO nova.virt.block_device [None req-080ba89a-eea2-4095-8e76-fc095c1e3888 tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] [instance: bcb58c79-f6b3-44d9-a80f-1a4cf580379f] Attempting to driver detach volume c99dc28e-fa63-40b8-820f-03d6c84a132f from mountpoint /dev/sdc
Nov 15 09:32:25 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-080ba89a-eea2-4095-8e76-fc095c1e3888 tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] Attempting to detach device sdc from instance bcb58c79-f6b3-44d9-a80f-1a4cf580379f from the persistent domain config. {{(pid=75122) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 09:32:25 user nova-compute[75122]: DEBUG nova.virt.libvirt.guest [None req-080ba89a-eea2-4095-8e76-fc095c1e3888 tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 09:32:25 user nova-compute[75122]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 09:32:25 user nova-compute[75122]:   <source dev="/dev/sdc"/>
Nov 15 09:32:25 user nova-compute[75122]:   <target dev="sdc" bus="scsi"/>
Nov 15 09:32:25 user nova-compute[75122]:   <serial>c99dc28e-fa63-40b8-820f-03d6c84a132f</serial>
Nov 15 09:32:25 user nova-compute[75122]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 15 09:32:25 user nova-compute[75122]: </disk>
Nov 15 09:32:25 user nova-compute[75122]:  {{(pid=75122) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 09:32:25 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b67b7d3-ab4f-4cc4-b9b8-906eac8491e4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:32:25 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9e9ce7e-383b-4192-9fdd-4ea2f2640467]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:32:25 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-a98c0263-b94a-4150-b9a4-56de7403586a tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:32:25 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b67b7d3-ab4f-4cc4-b9b8-906eac8491e4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SIHoOrvc {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:32:25 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-080ba89a-eea2-4095-8e76-fc095c1e3888 tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] Successfully detached device sdc from instance bcb58c79-f6b3-44d9-a80f-1a4cf580379f from the persistent domain config.
Nov 15 09:32:25 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-080ba89a-eea2-4095-8e76-fc095c1e3888 tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance bcb58c79-f6b3-44d9-a80f-1a4cf580379f from the live domain config. {{(pid=75122) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 09:32:25 user nova-compute[75122]: DEBUG nova.virt.libvirt.guest [None req-080ba89a-eea2-4095-8e76-fc095c1e3888 tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 09:32:25 user nova-compute[75122]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 09:32:25 user nova-compute[75122]:   <source dev="/dev/sdc"/>
Nov 15 09:32:25 user nova-compute[75122]:   <target dev="sdc" bus="scsi"/>
Nov 15 09:32:25 user nova-compute[75122]:   <serial>c99dc28e-fa63-40b8-820f-03d6c84a132f</serial>
Nov 15 09:32:25 user nova-compute[75122]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 15 09:32:25 user nova-compute[75122]: </disk>
Nov 15 09:32:25 user nova-compute[75122]:  {{(pid=75122) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 09:32:25 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b67b7d3-ab4f-4cc4-b9b8-906eac8491e4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SIHoOrvc" returned: 0 in 0.016s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:32:25 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[054fcae1-641e-4705-8578-decb676353fc]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:32:25 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-a98c0263-b94a-4150-b9a4-56de7403586a tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SIHoOrvc'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:32:25 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b67b7d3-ab4f-4cc4-b9b8-906eac8491e4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:32:25 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b67b7d3-ab4f-4cc4-b9b8-906eac8491e4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:32:25 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[63addae0-d3ee-4b4b-ad23-7d310c07bd38]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:32:25 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-a98c0263-b94a-4150-b9a4-56de7403586a tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:32:25 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:32:25 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:32:25 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[69f7513a-5e3a-49f7-9349-9bcfee968da3]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c99dc28e-fa63-40b8-820f-03d6c84a132f (non-flash)\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:32:25 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-a98c0263-b94a-4150-b9a4-56de7403586a tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e (non-flash)
Nov 15 09:32:25 user nova-compute[75122]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c99dc28e-fa63-40b8-820f-03d6c84a132f (non-flash)
Nov 15 09:32:25 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 09:32:25 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-a98c0263-b94a-4150-b9a4-56de7403586a tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e (non-flash)
Nov 15 09:32:25 user nova-compute[75122]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c99dc28e-fa63-40b8-820f-03d6c84a132f (non-flash)
Nov 15 09:32:25 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 09:32:25 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b67b7d3-ab4f-4cc4-b9b8-906eac8491e4 -p 172.16.0.220:3260 --login {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:32:25 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b67b7d3-ab4f-4cc4-b9b8-906eac8491e4 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:32:25 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[8427ab2e-6d30-480a-8e64-0cd2b3da6fd1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6b67b7d3-ab4f-4cc4-b9b8-906eac8491e4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6b67b7d3-ab4f-4cc4-b9b8-906eac8491e4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:32:25 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-a98c0263-b94a-4150-b9a4-56de7403586a tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6b67b7d3-ab4f-4cc4-b9b8-906eac8491e4, portal: 172.16.0.220,3260]
Nov 15 09:32:25 user nova-compute[75122]: Login to [iface: default, target: iqn.2010-10.org.openstack:6b67b7d3-ab4f-4cc4-b9b8-906eac8491e4, portal: 172.16.0.220,3260] successful.
Nov 15 09:32:25 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:32:25 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b67b7d3-ab4f-4cc4-b9b8-906eac8491e4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:32:25 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b67b7d3-ab4f-4cc4-b9b8-906eac8491e4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.016s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:32:25 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b55e9f3-fcc4-44e6-9e03-a18599151979]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:32:25 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-a98c0263-b94a-4150-b9a4-56de7403586a tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:32:25 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:32:25 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:32:25 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[28c1ad8c-dc6d-4190-bf06-27a590cfdd90]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c99dc28e-fa63-40b8-820f-03d6c84a132f (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b67b7d3-ab4f-4cc4-b9b8-906eac8491e4 (non-flash)\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:32:25 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-a98c0263-b94a-4150-b9a4-56de7403586a tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e (non-flash)
Nov 15 09:32:25 user nova-compute[75122]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c99dc28e-fa63-40b8-820f-03d6c84a132f (non-flash)
Nov 15 09:32:25 user nova-compute[75122]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b67b7d3-ab4f-4cc4-b9b8-906eac8491e4 (non-flash)
Nov 15 09:32:25 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 09:32:25 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-a98c0263-b94a-4150-b9a4-56de7403586a tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e (non-flash)
Nov 15 09:32:25 user nova-compute[75122]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c99dc28e-fa63-40b8-820f-03d6c84a132f (non-flash)
Nov 15 09:32:25 user nova-compute[75122]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b67b7d3-ab4f-4cc4-b9b8-906eac8491e4 (non-flash)
Nov 15 09:32:25 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 09:32:25 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-a98c0263-b94a-4150-b9a4-56de7403586a tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6b67b7d3-ab4f-4cc4-b9b8-906eac8491e4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.244s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 09:32:25 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-a98c0263-b94a-4150-b9a4-56de7403586a tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] Connected to 172.16.0.220:3260 {{(pid=75122) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 09:32:25 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-a98c0263-b94a-4150-b9a4-56de7403586a tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] HCTL ('35', '-', '-', 0) found on session 8 with lun 0 {{(pid=75122) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 09:32:25 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-a98c0263-b94a-4150-b9a4-56de7403586a tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75122) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 09:32:25 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:32:25 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.013s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:32:25 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[dae854a0-d175-4696-88dd-b2dbcf42b1e8]: (4, ('- - 0', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:32:25 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-a98c0263-b94a-4150-b9a4-56de7403586a tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] Searching for a device in session 8 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75122) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 09:32:25 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-a98c0263-b94a-4150-b9a4-56de7403586a tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:6b67b7d3-ab4f-4cc4-b9b8-906eac8491e4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SIHoOrvc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75122) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 09:32:25 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-080ba89a-eea2-4095-8e76-fc095c1e3888 tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance bcb58c79-f6b3-44d9-a80f-1a4cf580379f {{(pid=75122) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 09:32:26 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-a98c0263-b94a-4150-b9a4-56de7403586a tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.277s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 09:32:26 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-a98c0263-b94a-4150-b9a4-56de7403586a tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] <== connect_volume: return (1278ms) {'type': 'block', 'scsi_wwn': '23837363132393734', 'path': '/dev/sdd'} {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 09:32:26 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a98c0263-b94a-4150-b9a4-56de7403586a tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] [instance: e0f32160-7130-4b9c-aa9c-84123f3a6b32] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23837363132393734', 'path': '/dev/sdd'} {{(pid=75122) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 09:32:26 user nova-compute[75122]: DEBUG nova.objects.instance [None req-a98c0263-b94a-4150-b9a4-56de7403586a tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] Lazy-loading 'flavor' on Instance uuid e0f32160-7130-4b9c-aa9c-84123f3a6b32 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:32:26 user nova-compute[75122]: DEBUG nova.virt.libvirt.guest [None req-a98c0263-b94a-4150-b9a4-56de7403586a tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 09:32:26 user nova-compute[75122]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 09:32:26 user nova-compute[75122]:   <source dev="/dev/sdd"/>
Nov 15 09:32:26 user nova-compute[75122]:   <target dev="vdb" bus="virtio"/>
Nov 15 09:32:26 user nova-compute[75122]:   <serial>6b67b7d3-ab4f-4cc4-b9b8-906eac8491e4</serial>
Nov 15 09:32:26 user nova-compute[75122]: </disk>
Nov 15 09:32:26 user nova-compute[75122]:  {{(pid=75122) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 09:32:27 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-a98c0263-b94a-4150-b9a4-56de7403586a tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] No BDM found with device name vda, not building metadata. {{(pid=75122) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 09:32:27 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-a98c0263-b94a-4150-b9a4-56de7403586a tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] No BDM found with device name hda, not building metadata. {{(pid=75122) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 09:32:27 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-a98c0263-b94a-4150-b9a4-56de7403586a tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] No VIF found with MAC fa:16:3e:fd:20:4e, not building metadata {{(pid=75122) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 09:32:27 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-a98c0263-b94a-4150-b9a4-56de7403586a tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] Lock "e0f32160-7130-4b9c-aa9c-84123f3a6b32" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.545s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:32:27 user nova-compute[75122]: DEBUG nova.compute.manager [req-88196f5a-b34e-4044-82a4-fa73cd7c1706 req-e0271c8f-10bd-491d-b17c-b285d87f4576 service nova] [instance: d24a189e-2de9-404e-b281-224c150a5bbf] Received event network-changed-5439a285-9a24-4c8e-a9d0-4e7c773f9e60 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:32:27 user nova-compute[75122]: DEBUG nova.compute.manager [req-88196f5a-b34e-4044-82a4-fa73cd7c1706 req-e0271c8f-10bd-491d-b17c-b285d87f4576 service nova] [instance: d24a189e-2de9-404e-b281-224c150a5bbf] Refreshing instance network info cache due to event network-changed-5439a285-9a24-4c8e-a9d0-4e7c773f9e60. {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 09:32:27 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-88196f5a-b34e-4044-82a4-fa73cd7c1706 req-e0271c8f-10bd-491d-b17c-b285d87f4576 service nova] Acquiring lock "refresh_cache-d24a189e-2de9-404e-b281-224c150a5bbf" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 09:32:27 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-88196f5a-b34e-4044-82a4-fa73cd7c1706 req-e0271c8f-10bd-491d-b17c-b285d87f4576 service nova] Acquired lock "refresh_cache-d24a189e-2de9-404e-b281-224c150a5bbf" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 09:32:27 user nova-compute[75122]: DEBUG nova.network.neutron [req-88196f5a-b34e-4044-82a4-fa73cd7c1706 req-e0271c8f-10bd-491d-b17c-b285d87f4576 service nova] [instance: d24a189e-2de9-404e-b281-224c150a5bbf] Refreshing network info cache for port 5439a285-9a24-4c8e-a9d0-4e7c773f9e60 {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 09:32:27 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-67ea604f-e584-4ed3-9a87-6573b66312b3 tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] Acquiring lock "d24a189e-2de9-404e-b281-224c150a5bbf" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:32:27 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-67ea604f-e584-4ed3-9a87-6573b66312b3 tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] Lock "d24a189e-2de9-404e-b281-224c150a5bbf" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:32:27 user nova-compute[75122]: DEBUG nova.objects.instance [None req-67ea604f-e584-4ed3-9a87-6573b66312b3 tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] Lazy-loading 'flavor' on Instance uuid d24a189e-2de9-404e-b281-224c150a5bbf {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:32:27 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-67ea604f-e584-4ed3-9a87-6573b66312b3 tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] Lock "d24a189e-2de9-404e-b281-224c150a5bbf" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:32:27 user nova-compute[75122]: DEBUG nova.network.neutron [req-88196f5a-b34e-4044-82a4-fa73cd7c1706 req-e0271c8f-10bd-491d-b17c-b285d87f4576 service nova] [instance: d24a189e-2de9-404e-b281-224c150a5bbf] Updated VIF entry in instance network info cache for port 5439a285-9a24-4c8e-a9d0-4e7c773f9e60. {{(pid=75122) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 09:32:27 user nova-compute[75122]: DEBUG nova.network.neutron [req-88196f5a-b34e-4044-82a4-fa73cd7c1706 req-e0271c8f-10bd-491d-b17c-b285d87f4576 service nova] [instance: d24a189e-2de9-404e-b281-224c150a5bbf] Updating instance_info_cache with network_info: [{"id": "5439a285-9a24-4c8e-a9d0-4e7c773f9e60", "address": "fa:16:3e:bd:9c:6c", "network": {"id": "7c08103d-8c2a-4613-8c0b-e3ed4568332a", "bridge": "br-int", "label": "tempest-TestVolumeSwap-36009092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0044b15c211422c8fe109af97ce4082", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5439a285-9a", "ovs_interfaceid": "5439a285-9a24-4c8e-a9d0-4e7c773f9e60", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:32:27 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-67ea604f-e584-4ed3-9a87-6573b66312b3 tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] Acquiring lock "d24a189e-2de9-404e-b281-224c150a5bbf" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:32:27 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-67ea604f-e584-4ed3-9a87-6573b66312b3 tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] Lock "d24a189e-2de9-404e-b281-224c150a5bbf" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:32:27 user nova-compute[75122]: INFO nova.compute.manager [None req-67ea604f-e584-4ed3-9a87-6573b66312b3 tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] [instance: d24a189e-2de9-404e-b281-224c150a5bbf] Attaching volume 0796957f-5a19-4fe2-acb8-f3568399150a to /dev/vdb
Nov 15 09:32:27 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-88196f5a-b34e-4044-82a4-fa73cd7c1706 req-e0271c8f-10bd-491d-b17c-b285d87f4576 service nova] Releasing lock "refresh_cache-d24a189e-2de9-404e-b281-224c150a5bbf" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 09:32:27 user nova-compute[75122]: DEBUG os_brick.utils [None req-67ea604f-e584-4ed3-9a87-6573b66312b3 tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 09:32:27 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:32:28 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:32:28 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[483a7d05-f933-4ed0-a260-e94ffceb4b69]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:742fb64b3587\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:32:28 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:32:28 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:32:28 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[463f3eb2-b9d6-484d-84f6-60b6c932d643]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:32:28 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:32:28 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:32:28 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5aba4c9-c4f2-4a53-ba79-0fb9295aa59e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:32:28 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[732eccdd-02c9-4cfa-9509-42d069359432]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:32:28 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-67ea604f-e584-4ed3-9a87-6573b66312b3 tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] Running cmd (subprocess): nvme version {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:32:28 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-67ea604f-e584-4ed3-9a87-6573b66312b3 tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] 'nvme version' failed. Not Retrying. {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 09:32:28 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.nvmeof [None req-67ea604f-e584-4ed3-9a87-6573b66312b3 tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] nvme not present on system {{(pid=75122) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 09:32:28 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:32:28 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 09:32:28 user nova-compute[75122]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 09:32:28 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[1854e9b0-4faa-432c-944d-eafa2fe7d05f]: (4, '') {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:32:28 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.lightos [None req-67ea604f-e584-4ed3-9a87-6573b66312b3 tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75122) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 09:32:28 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.lightos [None req-67ea604f-e584-4ed3-9a87-6573b66312b3 tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75122) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 09:32:28 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.lightos [None req-67ea604f-e584-4ed3-9a87-6573b66312b3 tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] LIGHTOS: no hostnqn found. {{(pid=75122) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 09:32:28 user nova-compute[75122]: DEBUG os_brick.utils [None req-67ea604f-e584-4ed3-9a87-6573b66312b3 tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:742fb64b3587', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 09:32:28 user nova-compute[75122]: DEBUG nova.virt.block_device [None req-67ea604f-e584-4ed3-9a87-6573b66312b3 tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] [instance: d24a189e-2de9-404e-b281-224c150a5bbf] Updating existing volume attachment record: a2f09285-f4fc-42f6-92c6-6452dffa2d8d {{(pid=75122) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 09:32:29 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-4e3a86ed-e28a-4eb6-b5cb-783706a9ed20 tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] Acquiring lock "e0f32160-7130-4b9c-aa9c-84123f3a6b32" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:32:29 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-4e3a86ed-e28a-4eb6-b5cb-783706a9ed20 tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] Lock "e0f32160-7130-4b9c-aa9c-84123f3a6b32" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:32:29 user nova-compute[75122]: INFO nova.compute.manager [None req-4e3a86ed-e28a-4eb6-b5cb-783706a9ed20 tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] [instance: e0f32160-7130-4b9c-aa9c-84123f3a6b32] Detaching volume 6b67b7d3-ab4f-4cc4-b9b8-906eac8491e4
Nov 15 09:32:29 user nova-compute[75122]: INFO nova.virt.block_device [None req-4e3a86ed-e28a-4eb6-b5cb-783706a9ed20 tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] [instance: e0f32160-7130-4b9c-aa9c-84123f3a6b32] Attempting to driver detach volume 6b67b7d3-ab4f-4cc4-b9b8-906eac8491e4 from mountpoint /dev/vdb
Nov 15 09:32:29 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-4e3a86ed-e28a-4eb6-b5cb-783706a9ed20 tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] Attempting to detach device vdb from instance e0f32160-7130-4b9c-aa9c-84123f3a6b32 from the persistent domain config. {{(pid=75122) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 09:32:29 user nova-compute[75122]: DEBUG nova.virt.libvirt.guest [None req-4e3a86ed-e28a-4eb6-b5cb-783706a9ed20 tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 09:32:29 user nova-compute[75122]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 09:32:29 user nova-compute[75122]:   <source dev="/dev/sdd"/>
Nov 15 09:32:29 user nova-compute[75122]:   <target dev="vdb" bus="virtio"/>
Nov 15 09:32:29 user nova-compute[75122]:   <serial>6b67b7d3-ab4f-4cc4-b9b8-906eac8491e4</serial>
Nov 15 09:32:29 user nova-compute[75122]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 15 09:32:29 user nova-compute[75122]: </disk>
Nov 15 09:32:29 user nova-compute[75122]:  {{(pid=75122) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 09:32:29 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-4e3a86ed-e28a-4eb6-b5cb-783706a9ed20 tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] Successfully detached device vdb from instance e0f32160-7130-4b9c-aa9c-84123f3a6b32 from the persistent domain config.
Nov 15 09:32:29 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-4e3a86ed-e28a-4eb6-b5cb-783706a9ed20 tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e0f32160-7130-4b9c-aa9c-84123f3a6b32 from the live domain config. {{(pid=75122) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 09:32:29 user nova-compute[75122]: DEBUG nova.virt.libvirt.guest [None req-4e3a86ed-e28a-4eb6-b5cb-783706a9ed20 tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 09:32:29 user nova-compute[75122]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 09:32:29 user nova-compute[75122]:   <source dev="/dev/sdd"/>
Nov 15 09:32:29 user nova-compute[75122]:   <target dev="vdb" bus="virtio"/>
Nov 15 09:32:29 user nova-compute[75122]:   <serial>6b67b7d3-ab4f-4cc4-b9b8-906eac8491e4</serial>
Nov 15 09:32:29 user nova-compute[75122]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 15 09:32:29 user nova-compute[75122]: </disk>
Nov 15 09:32:29 user nova-compute[75122]:  {{(pid=75122) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 09:32:29 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:32:29 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:32:29 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-4e3a86ed-e28a-4eb6-b5cb-783706a9ed20 tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e0f32160-7130-4b9c-aa9c-84123f3a6b32 {{(pid=75122) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 09:32:32 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-67ea604f-e584-4ed3-9a87-6573b66312b3 tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] [instance: d24a189e-2de9-404e-b281-224c150a5bbf] Calling os-brick to attach iSCSI Volume {{(pid=75122) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 09:32:32 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-67ea604f-e584-4ed3-9a87-6573b66312b3 tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffa04060b80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0796957f-5a19-4fe2-acb8-f3568399150a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KPflkmYs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 09:32:32 user nova-compute[75122]: WARNING os_brick.initiator.connectors.base [None req-67ea604f-e584-4ed3-9a87-6573b66312b3 tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 09:32:32 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-67ea604f-e584-4ed3-9a87-6573b66312b3 tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 09:32:32 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-67ea604f-e584-4ed3-9a87-6573b66312b3 tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 09:32:32 user nova-compute[75122]: WARNING os_brick.initiator.connectors.base [None req-67ea604f-e584-4ed3-9a87-6573b66312b3 tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 09:32:32 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-67ea604f-e584-4ed3-9a87-6573b66312b3 tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0796957f-5a19-4fe2-acb8-f3568399150a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 09:32:32 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-67ea604f-e584-4ed3-9a87-6573b66312b3 tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0796957f-5a19-4fe2-acb8-f3568399150a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 09:32:32 user nova-compute[75122]: INFO os_brick.initiator.connectors.iscsi [None req-67ea604f-e584-4ed3-9a87-6573b66312b3 tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 09:32:32 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0796957f-5a19-4fe2-acb8-f3568399150a -p 172.16.0.220:3260 {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:32:32 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0796957f-5a19-4fe2-acb8-f3568399150a -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:32:32 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ea85d46-e6c9-4f5a-89c9-1b9cefa0d283]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:32:32 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-67ea604f-e584-4ed3-9a87-6573b66312b3 tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 09:32:32 user nova-compute[75122]:  {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:32:32 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0796957f-5a19-4fe2-acb8-f3568399150a -p 172.16.0.220:3260 --interface default --op new {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:32:32 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0796957f-5a19-4fe2-acb8-f3568399150a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:32:32 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[b30626a8-98ca-4eb0-98bc-ca07977e916e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0796957f-5a19-4fe2-acb8-f3568399150a] added\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:32:32 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-67ea604f-e584-4ed3-9a87-6573b66312b3 tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0796957f-5a19-4fe2-acb8-f3568399150a] added
Nov 15 09:32:32 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:32:32 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0796957f-5a19-4fe2-acb8-f3568399150a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:32:32 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0796957f-5a19-4fe2-acb8-f3568399150a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:32:32 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b02b95b-286b-4260-bc09-10b4393f7eae]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:32:32 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-67ea604f-e584-4ed3-9a87-6573b66312b3 tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:32:32 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0796957f-5a19-4fe2-acb8-f3568399150a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:32:32 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0796957f-5a19-4fe2-acb8-f3568399150a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:32:32 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[388b6e9f-9f45-4a37-903d-0d28ced47b0d]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:32:32 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-67ea604f-e584-4ed3-9a87-6573b66312b3 tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:32:32 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0796957f-5a19-4fe2-acb8-f3568399150a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KPflkmYs {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:32:32 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0796957f-5a19-4fe2-acb8-f3568399150a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KPflkmYs" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:32:32 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[14f0c3a7-a800-4d1d-927d-8196c98d6efb]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:32:32 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-67ea604f-e584-4ed3-9a87-6573b66312b3 tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KPflkmYs'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:32:32 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0796957f-5a19-4fe2-acb8-f3568399150a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:32:32 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0796957f-5a19-4fe2-acb8-f3568399150a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:32:32 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d5013ed-9035-4349-bde4-b3fe5993b901]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:32:32 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-67ea604f-e584-4ed3-9a87-6573b66312b3 tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:32:32 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:32:32 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-eb272efa-923b-40da-a2ad-6dffbeed9f01 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] Acquiring lock "fa52b2a0-e5a0-4f93-a1cf-fef4a8313368" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:32:32 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-eb272efa-923b-40da-a2ad-6dffbeed9f01 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] Lock "fa52b2a0-e5a0-4f93-a1cf-fef4a8313368" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:32:32 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-eb272efa-923b-40da-a2ad-6dffbeed9f01 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] Acquiring lock "fa52b2a0-e5a0-4f93-a1cf-fef4a8313368-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:32:32 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-eb272efa-923b-40da-a2ad-6dffbeed9f01 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] Lock "fa52b2a0-e5a0-4f93-a1cf-fef4a8313368-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:32:32 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-eb272efa-923b-40da-a2ad-6dffbeed9f01 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] Lock "fa52b2a0-e5a0-4f93-a1cf-fef4a8313368-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:32:32 user nova-compute[75122]: INFO nova.compute.manager [None req-eb272efa-923b-40da-a2ad-6dffbeed9f01 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] [instance: fa52b2a0-e5a0-4f93-a1cf-fef4a8313368] Terminating instance
Nov 15 09:32:32 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:32:32 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[190fa6ac-d28f-4a5b-8be7-ef2d5af7f360]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c99dc28e-fa63-40b8-820f-03d6c84a132f (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b67b7d3-ab4f-4cc4-b9b8-906eac8491e4 (non-flash)\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:32:32 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-67ea604f-e584-4ed3-9a87-6573b66312b3 tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e (non-flash)
Nov 15 09:32:32 user nova-compute[75122]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c99dc28e-fa63-40b8-820f-03d6c84a132f (non-flash)
Nov 15 09:32:32 user nova-compute[75122]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b67b7d3-ab4f-4cc4-b9b8-906eac8491e4 (non-flash)
Nov 15 09:32:32 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 09:32:32 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-67ea604f-e584-4ed3-9a87-6573b66312b3 tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e (non-flash)
Nov 15 09:32:32 user nova-compute[75122]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c99dc28e-fa63-40b8-820f-03d6c84a132f (non-flash)
Nov 15 09:32:32 user nova-compute[75122]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b67b7d3-ab4f-4cc4-b9b8-906eac8491e4 (non-flash)
Nov 15 09:32:32 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 09:32:32 user nova-compute[75122]: DEBUG nova.compute.manager [None req-eb272efa-923b-40da-a2ad-6dffbeed9f01 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] [instance: fa52b2a0-e5a0-4f93-a1cf-fef4a8313368] Start destroying the instance on the hypervisor. {{(pid=75122) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 09:32:32 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0796957f-5a19-4fe2-acb8-f3568399150a -p 172.16.0.220:3260 --login {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:32:32 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0796957f-5a19-4fe2-acb8-f3568399150a -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:32:32 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed4fc772-2475-4df3-a0e3-e9d9538cdada]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0796957f-5a19-4fe2-acb8-f3568399150a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0796957f-5a19-4fe2-acb8-f3568399150a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:32:32 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-67ea604f-e584-4ed3-9a87-6573b66312b3 tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0796957f-5a19-4fe2-acb8-f3568399150a, portal: 172.16.0.220,3260]
Nov 15 09:32:32 user nova-compute[75122]: Login to [iface: default, target: iqn.2010-10.org.openstack:0796957f-5a19-4fe2-acb8-f3568399150a, portal: 172.16.0.220,3260] successful.
Nov 15 09:32:32 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:32:32 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0796957f-5a19-4fe2-acb8-f3568399150a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:32:32 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:32:32 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0796957f-5a19-4fe2-acb8-f3568399150a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:32:32 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf49d301-f942-4976-848e-2ab18afd7161]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:32:32 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-67ea604f-e584-4ed3-9a87-6573b66312b3 tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:32:32 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:32:32 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:32:32 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:32:32 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc227619-772d-49d0-a9d6-925b86f9a6f9]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c99dc28e-fa63-40b8-820f-03d6c84a132f (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b67b7d3-ab4f-4cc4-b9b8-906eac8491e4 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0796957f-5a19-4fe2-acb8-f3568399150a (non-flash)\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:32:32 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-67ea604f-e584-4ed3-9a87-6573b66312b3 tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e (non-flash)
Nov 15 09:32:32 user nova-compute[75122]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c99dc28e-fa63-40b8-820f-03d6c84a132f (non-flash)
Nov 15 09:32:32 user nova-compute[75122]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b67b7d3-ab4f-4cc4-b9b8-906eac8491e4 (non-flash)
Nov 15 09:32:32 user nova-compute[75122]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0796957f-5a19-4fe2-acb8-f3568399150a (non-flash)
Nov 15 09:32:32 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 09:32:32 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-67ea604f-e584-4ed3-9a87-6573b66312b3 tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e (non-flash)
Nov 15 09:32:32 user nova-compute[75122]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c99dc28e-fa63-40b8-820f-03d6c84a132f (non-flash)
Nov 15 09:32:32 user nova-compute[75122]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b67b7d3-ab4f-4cc4-b9b8-906eac8491e4 (non-flash)
Nov 15 09:32:32 user nova-compute[75122]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0796957f-5a19-4fe2-acb8-f3568399150a (non-flash)
Nov 15 09:32:32 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 09:32:32 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-67ea604f-e584-4ed3-9a87-6573b66312b3 tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0796957f-5a19-4fe2-acb8-f3568399150a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.276s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 09:32:32 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-67ea604f-e584-4ed3-9a87-6573b66312b3 tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] Connected to 172.16.0.220:3260 {{(pid=75122) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 09:32:32 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-67ea604f-e584-4ed3-9a87-6573b66312b3 tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] HCTL ('36', '-', '-', 0) found on session 9 with lun 0 {{(pid=75122) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 09:32:32 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-67ea604f-e584-4ed3-9a87-6573b66312b3 tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75122) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 09:32:32 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:32:32 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:32:33 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.025s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:32:33 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e16998d-5b3a-431e-aeaf-b03390c6a31e]: (4, ('- - 0', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:32:33 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-67ea604f-e584-4ed3-9a87-6573b66312b3 tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] Searching for a device in session 9 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75122) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 09:32:33 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-67ea604f-e584-4ed3-9a87-6573b66312b3 tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:0796957f-5a19-4fe2-acb8-f3568399150a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KPflkmYs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75122) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 09:32:33 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:32:33 user nova-compute[75122]: DEBUG nova.compute.manager [req-2e55ae03-6a35-4c95-af35-9b6bf276ae94 req-589483a1-770b-44ab-84d0-347a006ef195 service nova] [instance: fa52b2a0-e5a0-4f93-a1cf-fef4a8313368] Received event network-vif-unplugged-942f4024-43e2-4488-a7fd-c9de9bab7162 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:32:33 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-2e55ae03-6a35-4c95-af35-9b6bf276ae94 req-589483a1-770b-44ab-84d0-347a006ef195 service nova] Acquiring lock "fa52b2a0-e5a0-4f93-a1cf-fef4a8313368-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:32:33 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-2e55ae03-6a35-4c95-af35-9b6bf276ae94 req-589483a1-770b-44ab-84d0-347a006ef195 service nova] Lock "fa52b2a0-e5a0-4f93-a1cf-fef4a8313368-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:32:33 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-2e55ae03-6a35-4c95-af35-9b6bf276ae94 req-589483a1-770b-44ab-84d0-347a006ef195 service nova] Lock "fa52b2a0-e5a0-4f93-a1cf-fef4a8313368-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:32:33 user nova-compute[75122]: DEBUG nova.compute.manager [req-2e55ae03-6a35-4c95-af35-9b6bf276ae94 req-589483a1-770b-44ab-84d0-347a006ef195 service nova] [instance: fa52b2a0-e5a0-4f93-a1cf-fef4a8313368] No waiting events found dispatching network-vif-unplugged-942f4024-43e2-4488-a7fd-c9de9bab7162 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:32:33 user nova-compute[75122]: DEBUG nova.compute.manager [req-2e55ae03-6a35-4c95-af35-9b6bf276ae94 req-589483a1-770b-44ab-84d0-347a006ef195 service nova] [instance: fa52b2a0-e5a0-4f93-a1cf-fef4a8313368] Received event network-vif-unplugged-942f4024-43e2-4488-a7fd-c9de9bab7162 for instance with task_state deleting. {{(pid=75122) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 09:32:33 user nova-compute[75122]: INFO nova.virt.libvirt.driver [-] [instance: fa52b2a0-e5a0-4f93-a1cf-fef4a8313368] Instance destroyed successfully.
Nov 15 09:32:33 user nova-compute[75122]: DEBUG nova.objects.instance [None req-eb272efa-923b-40da-a2ad-6dffbeed9f01 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] Lazy-loading 'resources' on Instance uuid fa52b2a0-e5a0-4f93-a1cf-fef4a8313368 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:32:33 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-eb272efa-923b-40da-a2ad-6dffbeed9f01 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T09:30:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-577581546',display_name='tempest-VolumesActionsTest-instance-577581546',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-577581546',id=7,image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T09:30:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9af984d06e5340f8a65a54a806c7c88a',ramdisk_id='',reservation_id='r-9jf7aepj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-915673420',owner_user_name='tempest-VolumesActionsTest-915673420-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T09:30:51Z,user_data=None,user_id='a3ce318b93394200a80ba72ec74c321e',uuid=fa52b2a0-e5a0-4f93-a1cf-fef4a8313368,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "942f4024-43e2-4488-a7fd-c9de9bab7162", "address": "fa:16:3e:3a:68:1c", "network": {"id": "48c8af75-6a89-441b-8e4a-8c7186006537", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2172147-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9af984d06e5340f8a65a54a806c7c88a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap942f4024-43", "ovs_interfaceid": "942f4024-43e2-4488-a7fd-c9de9bab7162", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 09:32:33 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-eb272efa-923b-40da-a2ad-6dffbeed9f01 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] Converting VIF {"id": "942f4024-43e2-4488-a7fd-c9de9bab7162", "address": "fa:16:3e:3a:68:1c", "network": {"id": "48c8af75-6a89-441b-8e4a-8c7186006537", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2172147-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9af984d06e5340f8a65a54a806c7c88a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap942f4024-43", "ovs_interfaceid": "942f4024-43e2-4488-a7fd-c9de9bab7162", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 09:32:33 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-eb272efa-923b-40da-a2ad-6dffbeed9f01 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:68:1c,bridge_name='br-int',has_traffic_filtering=True,id=942f4024-43e2-4488-a7fd-c9de9bab7162,network=Network(48c8af75-6a89-441b-8e4a-8c7186006537),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap942f4024-43') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 09:32:33 user nova-compute[75122]: DEBUG os_vif [None req-eb272efa-923b-40da-a2ad-6dffbeed9f01 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:68:1c,bridge_name='br-int',has_traffic_filtering=True,id=942f4024-43e2-4488-a7fd-c9de9bab7162,network=Network(48c8af75-6a89-441b-8e4a-8c7186006537),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap942f4024-43') {{(pid=75122) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 09:32:33 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:32:33 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap942f4024-43, bridge=br-int, if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:32:33 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:32:33 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:32:33 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:32:33 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=02d57141-e004-43b3-8ea9-f262dd6ab19c) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:32:33 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:32:33 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:32:33 user nova-compute[75122]: INFO os_vif [None req-eb272efa-923b-40da-a2ad-6dffbeed9f01 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:68:1c,bridge_name='br-int',has_traffic_filtering=True,id=942f4024-43e2-4488-a7fd-c9de9bab7162,network=Network(48c8af75-6a89-441b-8e4a-8c7186006537),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap942f4024-43')
Nov 15 09:32:33 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-eb272efa-923b-40da-a2ad-6dffbeed9f01 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] [instance: fa52b2a0-e5a0-4f93-a1cf-fef4a8313368] Deleting instance files /opt/stack/data/nova/instances/fa52b2a0-e5a0-4f93-a1cf-fef4a8313368_del
Nov 15 09:32:33 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-eb272efa-923b-40da-a2ad-6dffbeed9f01 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] [instance: fa52b2a0-e5a0-4f93-a1cf-fef4a8313368] Deletion of /opt/stack/data/nova/instances/fa52b2a0-e5a0-4f93-a1cf-fef4a8313368_del complete
Nov 15 09:32:33 user nova-compute[75122]: INFO nova.compute.manager [None req-eb272efa-923b-40da-a2ad-6dffbeed9f01 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] [instance: fa52b2a0-e5a0-4f93-a1cf-fef4a8313368] Took 0.67 seconds to destroy the instance on the hypervisor.
Nov 15 09:32:33 user nova-compute[75122]: DEBUG oslo.service.loopingcall [None req-eb272efa-923b-40da-a2ad-6dffbeed9f01 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75122) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 09:32:33 user nova-compute[75122]: DEBUG nova.compute.manager [-] [instance: fa52b2a0-e5a0-4f93-a1cf-fef4a8313368] Deallocating network for instance {{(pid=75122) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 09:32:33 user nova-compute[75122]: DEBUG nova.network.neutron [-] [instance: fa52b2a0-e5a0-4f93-a1cf-fef4a8313368] deallocate_for_instance() {{(pid=75122) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 09:32:33 user nova-compute[75122]: DEBUG nova.network.neutron [-] [instance: fa52b2a0-e5a0-4f93-a1cf-fef4a8313368] Updating instance_info_cache with network_info: [] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:32:33 user nova-compute[75122]: INFO nova.compute.manager [-] [instance: fa52b2a0-e5a0-4f93-a1cf-fef4a8313368] Took 0.47 seconds to deallocate network for instance.
Nov 15 09:32:34 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-67ea604f-e584-4ed3-9a87-6573b66312b3 tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.321s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 09:32:34 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-67ea604f-e584-4ed3-9a87-6573b66312b3 tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] <== connect_volume: return (1322ms) {'type': 'block', 'scsi_wwn': '23938306163663631', 'path': '/dev/sde'} {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 09:32:34 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-67ea604f-e584-4ed3-9a87-6573b66312b3 tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] [instance: d24a189e-2de9-404e-b281-224c150a5bbf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23938306163663631', 'path': '/dev/sde'} {{(pid=75122) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 09:32:34 user nova-compute[75122]: DEBUG nova.objects.instance [None req-67ea604f-e584-4ed3-9a87-6573b66312b3 tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] Lazy-loading 'flavor' on Instance uuid d24a189e-2de9-404e-b281-224c150a5bbf {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:32:34 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-eb272efa-923b-40da-a2ad-6dffbeed9f01 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:32:34 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-eb272efa-923b-40da-a2ad-6dffbeed9f01 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:32:34 user nova-compute[75122]: DEBUG nova.virt.libvirt.guest [None req-67ea604f-e584-4ed3-9a87-6573b66312b3 tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 09:32:34 user nova-compute[75122]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 09:32:34 user nova-compute[75122]:   <source dev="/dev/sde"/>
Nov 15 09:32:34 user nova-compute[75122]:   <target dev="vdb" bus="virtio"/>
Nov 15 09:32:34 user nova-compute[75122]:   <serial>0796957f-5a19-4fe2-acb8-f3568399150a</serial>
Nov 15 09:32:34 user nova-compute[75122]: </disk>
Nov 15 09:32:34 user nova-compute[75122]:  {{(pid=75122) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 09:32:34 user nova-compute[75122]: DEBUG nova.compute.provider_tree [None req-eb272efa-923b-40da-a2ad-6dffbeed9f01 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] Inventory has not changed in ProviderTree for provider: 69a3da65-47be-44c6-b67c-c692b58284ef {{(pid=75122) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 09:32:34 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-eb272efa-923b-40da-a2ad-6dffbeed9f01 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] Inventory has not changed for provider 69a3da65-47be-44c6-b67c-c692b58284ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 09:32:34 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-eb272efa-923b-40da-a2ad-6dffbeed9f01 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.269s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:32:34 user nova-compute[75122]: INFO nova.scheduler.client.report [None req-eb272efa-923b-40da-a2ad-6dffbeed9f01 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] Deleted allocations for instance fa52b2a0-e5a0-4f93-a1cf-fef4a8313368
Nov 15 09:32:34 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-67ea604f-e584-4ed3-9a87-6573b66312b3 tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] No BDM found with device name vda, not building metadata. {{(pid=75122) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 09:32:34 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-67ea604f-e584-4ed3-9a87-6573b66312b3 tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75122) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 09:32:34 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-67ea604f-e584-4ed3-9a87-6573b66312b3 tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] No VIF found with MAC fa:16:3e:bd:9c:6c, not building metadata {{(pid=75122) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 09:32:34 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-eb272efa-923b-40da-a2ad-6dffbeed9f01 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] Lock "fa52b2a0-e5a0-4f93-a1cf-fef4a8313368" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.683s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:32:34 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-67ea604f-e584-4ed3-9a87-6573b66312b3 tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] Lock "d24a189e-2de9-404e-b281-224c150a5bbf" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.719s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:32:34 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:32:35 user nova-compute[75122]: DEBUG nova.compute.manager [req-2a8d90e1-0dba-42b4-bd3e-c17f5acd6da1 req-ec79f1d0-9066-46a7-a8e7-5b178c460861 service nova] [instance: fa52b2a0-e5a0-4f93-a1cf-fef4a8313368] Received event network-vif-plugged-942f4024-43e2-4488-a7fd-c9de9bab7162 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:32:35 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-2a8d90e1-0dba-42b4-bd3e-c17f5acd6da1 req-ec79f1d0-9066-46a7-a8e7-5b178c460861 service nova] Acquiring lock "fa52b2a0-e5a0-4f93-a1cf-fef4a8313368-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:32:35 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-2a8d90e1-0dba-42b4-bd3e-c17f5acd6da1 req-ec79f1d0-9066-46a7-a8e7-5b178c460861 service nova] Lock "fa52b2a0-e5a0-4f93-a1cf-fef4a8313368-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:32:35 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-2a8d90e1-0dba-42b4-bd3e-c17f5acd6da1 req-ec79f1d0-9066-46a7-a8e7-5b178c460861 service nova] Lock "fa52b2a0-e5a0-4f93-a1cf-fef4a8313368-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:32:35 user nova-compute[75122]: DEBUG nova.compute.manager [req-2a8d90e1-0dba-42b4-bd3e-c17f5acd6da1 req-ec79f1d0-9066-46a7-a8e7-5b178c460861 service nova] [instance: fa52b2a0-e5a0-4f93-a1cf-fef4a8313368] No waiting events found dispatching network-vif-plugged-942f4024-43e2-4488-a7fd-c9de9bab7162 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:32:35 user nova-compute[75122]: WARNING nova.compute.manager [req-2a8d90e1-0dba-42b4-bd3e-c17f5acd6da1 req-ec79f1d0-9066-46a7-a8e7-5b178c460861 service nova] [instance: fa52b2a0-e5a0-4f93-a1cf-fef4a8313368] Received unexpected event network-vif-plugged-942f4024-43e2-4488-a7fd-c9de9bab7162 for instance with vm_state deleted and task_state None.
Nov 15 09:32:35 user nova-compute[75122]: DEBUG nova.compute.manager [req-2a8d90e1-0dba-42b4-bd3e-c17f5acd6da1 req-ec79f1d0-9066-46a7-a8e7-5b178c460861 service nova] [instance: fa52b2a0-e5a0-4f93-a1cf-fef4a8313368] Received event network-vif-deleted-942f4024-43e2-4488-a7fd-c9de9bab7162 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:32:36 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-87b8d899-6ab9-4afd-bfa5-c093e3bcdb6d tempest-TestVolumeSwap-69301659 tempest-TestVolumeSwap-69301659-project-admin] Acquiring lock "d24a189e-2de9-404e-b281-224c150a5bbf" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:32:36 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-87b8d899-6ab9-4afd-bfa5-c093e3bcdb6d tempest-TestVolumeSwap-69301659 tempest-TestVolumeSwap-69301659-project-admin] Lock "d24a189e-2de9-404e-b281-224c150a5bbf" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:32:36 user nova-compute[75122]: DEBUG os_brick.utils [None req-87b8d899-6ab9-4afd-bfa5-c093e3bcdb6d tempest-TestVolumeSwap-69301659 tempest-TestVolumeSwap-69301659-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 09:32:36 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:32:36 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:32:36 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5c0d669-9dd5-459a-9365-791757f171ba]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:742fb64b3587\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:32:36 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:32:36 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:32:36 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c469421-f150-4885-8d79-496d12380e5e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:32:36 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:32:36 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:32:36 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eccc41d-0d33-46af-b486-ef9c904fb3b1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:32:36 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2268295-be44-4218-b8ef-3214a7440802]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:32:36 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-87b8d899-6ab9-4afd-bfa5-c093e3bcdb6d tempest-TestVolumeSwap-69301659 tempest-TestVolumeSwap-69301659-project-admin] Running cmd (subprocess): nvme version {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:32:36 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-87b8d899-6ab9-4afd-bfa5-c093e3bcdb6d tempest-TestVolumeSwap-69301659 tempest-TestVolumeSwap-69301659-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 09:32:36 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.nvmeof [None req-87b8d899-6ab9-4afd-bfa5-c093e3bcdb6d tempest-TestVolumeSwap-69301659 tempest-TestVolumeSwap-69301659-project-admin] nvme not present on system {{(pid=75122) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 09:32:36 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:32:36 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 09:32:36 user nova-compute[75122]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 09:32:36 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcfaa04d-527c-456a-920d-5a65edac5e7d]: (4, '') {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:32:36 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.lightos [None req-87b8d899-6ab9-4afd-bfa5-c093e3bcdb6d tempest-TestVolumeSwap-69301659 tempest-TestVolumeSwap-69301659-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75122) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 09:32:36 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.lightos [None req-87b8d899-6ab9-4afd-bfa5-c093e3bcdb6d tempest-TestVolumeSwap-69301659 tempest-TestVolumeSwap-69301659-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75122) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 09:32:36 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.lightos [None req-87b8d899-6ab9-4afd-bfa5-c093e3bcdb6d tempest-TestVolumeSwap-69301659 tempest-TestVolumeSwap-69301659-project-admin] LIGHTOS: no hostnqn found. {{(pid=75122) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 09:32:36 user nova-compute[75122]: DEBUG os_brick.utils [None req-87b8d899-6ab9-4afd-bfa5-c093e3bcdb6d tempest-TestVolumeSwap-69301659 tempest-TestVolumeSwap-69301659-project-admin] <== get_connector_properties: return (104ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:742fb64b3587', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 09:32:36 user nova-compute[75122]: INFO nova.compute.manager [None req-87b8d899-6ab9-4afd-bfa5-c093e3bcdb6d tempest-TestVolumeSwap-69301659 tempest-TestVolumeSwap-69301659-project-admin] [instance: d24a189e-2de9-404e-b281-224c150a5bbf] Swapping volume 0796957f-5a19-4fe2-acb8-f3568399150a for 5cb8eb00-0379-40d5-972c-9565fe412df4
Nov 15 09:32:37 user nova-compute[75122]: DEBUG nova.compute.manager [req-65e077ed-7261-4a68-8967-4e7b573c4ae2 req-f9707258-e486-4e90-97f5-048f3072780c service nova] [instance: 9cfb60cb-011e-4537-9f28-55ea7d6dfc13] Received event network-changed-f46032a9-bba1-47d0-aa79-dc66f360bc46 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:32:37 user nova-compute[75122]: DEBUG nova.compute.manager [req-65e077ed-7261-4a68-8967-4e7b573c4ae2 req-f9707258-e486-4e90-97f5-048f3072780c service nova] [instance: 9cfb60cb-011e-4537-9f28-55ea7d6dfc13] Refreshing instance network info cache due to event network-changed-f46032a9-bba1-47d0-aa79-dc66f360bc46. {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 09:32:37 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-65e077ed-7261-4a68-8967-4e7b573c4ae2 req-f9707258-e486-4e90-97f5-048f3072780c service nova] Acquiring lock "refresh_cache-9cfb60cb-011e-4537-9f28-55ea7d6dfc13" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 09:32:37 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-65e077ed-7261-4a68-8967-4e7b573c4ae2 req-f9707258-e486-4e90-97f5-048f3072780c service nova] Acquired lock "refresh_cache-9cfb60cb-011e-4537-9f28-55ea7d6dfc13" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 09:32:37 user nova-compute[75122]: DEBUG nova.network.neutron [req-65e077ed-7261-4a68-8967-4e7b573c4ae2 req-f9707258-e486-4e90-97f5-048f3072780c service nova] [instance: 9cfb60cb-011e-4537-9f28-55ea7d6dfc13] Refreshing network info cache for port f46032a9-bba1-47d0-aa79-dc66f360bc46 {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 09:32:37 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-fd429f5b-62a5-4518-a34f-c0fcf0b48004 tempest-VolumesAssistedSnapshotsTest-336030675 tempest-VolumesAssistedSnapshotsTest-336030675-project-admin] Acquiring lock "9cfb60cb-011e-4537-9f28-55ea7d6dfc13" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:32:37 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-fd429f5b-62a5-4518-a34f-c0fcf0b48004 tempest-VolumesAssistedSnapshotsTest-336030675 tempest-VolumesAssistedSnapshotsTest-336030675-project-admin] Lock "9cfb60cb-011e-4537-9f28-55ea7d6dfc13" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:32:37 user nova-compute[75122]: DEBUG nova.objects.instance [None req-fd429f5b-62a5-4518-a34f-c0fcf0b48004 tempest-VolumesAssistedSnapshotsTest-336030675 tempest-VolumesAssistedSnapshotsTest-336030675-project-admin] Lazy-loading 'flavor' on Instance uuid 9cfb60cb-011e-4537-9f28-55ea7d6dfc13 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:32:37 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-fd429f5b-62a5-4518-a34f-c0fcf0b48004 tempest-VolumesAssistedSnapshotsTest-336030675 tempest-VolumesAssistedSnapshotsTest-336030675-project-admin] Lock "9cfb60cb-011e-4537-9f28-55ea7d6dfc13" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.088s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:32:37 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-fd429f5b-62a5-4518-a34f-c0fcf0b48004 tempest-VolumesAssistedSnapshotsTest-336030675 tempest-VolumesAssistedSnapshotsTest-336030675-project-admin] Acquiring lock "9cfb60cb-011e-4537-9f28-55ea7d6dfc13" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:32:37 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-fd429f5b-62a5-4518-a34f-c0fcf0b48004 tempest-VolumesAssistedSnapshotsTest-336030675 tempest-VolumesAssistedSnapshotsTest-336030675-project-admin] Lock "9cfb60cb-011e-4537-9f28-55ea7d6dfc13" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:32:37 user nova-compute[75122]: INFO nova.compute.manager [None req-fd429f5b-62a5-4518-a34f-c0fcf0b48004 tempest-VolumesAssistedSnapshotsTest-336030675 tempest-VolumesAssistedSnapshotsTest-336030675-project-admin] [instance: 9cfb60cb-011e-4537-9f28-55ea7d6dfc13] Attaching volume 085fd119-574c-4b24-bf7c-8076479d01c3 to /dev/vdb
Nov 15 09:32:37 user nova-compute[75122]: DEBUG nova.network.neutron [req-65e077ed-7261-4a68-8967-4e7b573c4ae2 req-f9707258-e486-4e90-97f5-048f3072780c service nova] [instance: 9cfb60cb-011e-4537-9f28-55ea7d6dfc13] Updated VIF entry in instance network info cache for port f46032a9-bba1-47d0-aa79-dc66f360bc46. {{(pid=75122) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 09:32:37 user nova-compute[75122]: DEBUG nova.network.neutron [req-65e077ed-7261-4a68-8967-4e7b573c4ae2 req-f9707258-e486-4e90-97f5-048f3072780c service nova] [instance: 9cfb60cb-011e-4537-9f28-55ea7d6dfc13] Updating instance_info_cache with network_info: [{"id": "f46032a9-bba1-47d0-aa79-dc66f360bc46", "address": "fa:16:3e:95:5c:e0", "network": {"id": "360c0d80-0116-44d9-a9b0-c95257b58658", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1507264907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2823e154de6e4ffc9b965f6b5036cc17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf46032a9-bb", "ovs_interfaceid": "f46032a9-bba1-47d0-aa79-dc66f360bc46", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:32:37 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-65e077ed-7261-4a68-8967-4e7b573c4ae2 req-f9707258-e486-4e90-97f5-048f3072780c service nova] Releasing lock "refresh_cache-9cfb60cb-011e-4537-9f28-55ea7d6dfc13" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 09:32:37 user nova-compute[75122]: DEBUG os_brick.utils [None req-fd429f5b-62a5-4518-a34f-c0fcf0b48004 tempest-VolumesAssistedSnapshotsTest-336030675 tempest-VolumesAssistedSnapshotsTest-336030675-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 09:32:37 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:32:37 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:32:37 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fcd761c-e906-44d9-8e66-7a47040a529f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:742fb64b3587\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:32:37 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:32:37 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:32:37 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e5cf721-64a1-4ed6-99e2-cffa5df34fcb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:32:37 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:32:37 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.012s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:32:37 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[60cefb93-d38a-4569-9030-2ecd75b5dbbb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:32:37 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2130e48-0b47-45be-8694-131e69a5e042]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:32:37 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-fd429f5b-62a5-4518-a34f-c0fcf0b48004 tempest-VolumesAssistedSnapshotsTest-336030675 tempest-VolumesAssistedSnapshotsTest-336030675-project-admin] Running cmd (subprocess): nvme version {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:32:37 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-fd429f5b-62a5-4518-a34f-c0fcf0b48004 tempest-VolumesAssistedSnapshotsTest-336030675 tempest-VolumesAssistedSnapshotsTest-336030675-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 09:32:37 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fd429f5b-62a5-4518-a34f-c0fcf0b48004 tempest-VolumesAssistedSnapshotsTest-336030675 tempest-VolumesAssistedSnapshotsTest-336030675-project-admin] nvme not present on system {{(pid=75122) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 09:32:37 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:32:37 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 09:32:37 user nova-compute[75122]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 09:32:37 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[da592714-95cf-4ca6-acfa-04f9d2f586d3]: (4, '') {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:32:37 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.lightos [None req-fd429f5b-62a5-4518-a34f-c0fcf0b48004 tempest-VolumesAssistedSnapshotsTest-336030675 tempest-VolumesAssistedSnapshotsTest-336030675-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75122) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 09:32:37 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.lightos [None req-fd429f5b-62a5-4518-a34f-c0fcf0b48004 tempest-VolumesAssistedSnapshotsTest-336030675 tempest-VolumesAssistedSnapshotsTest-336030675-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75122) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 09:32:37 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.lightos [None req-fd429f5b-62a5-4518-a34f-c0fcf0b48004 tempest-VolumesAssistedSnapshotsTest-336030675 tempest-VolumesAssistedSnapshotsTest-336030675-project-admin] LIGHTOS: no hostnqn found. {{(pid=75122) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 09:32:37 user nova-compute[75122]: DEBUG os_brick.utils [None req-fd429f5b-62a5-4518-a34f-c0fcf0b48004 tempest-VolumesAssistedSnapshotsTest-336030675 tempest-VolumesAssistedSnapshotsTest-336030675-project-admin] <== get_connector_properties: return (102ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:742fb64b3587', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 09:32:37 user nova-compute[75122]: DEBUG nova.virt.block_device [None req-fd429f5b-62a5-4518-a34f-c0fcf0b48004 tempest-VolumesAssistedSnapshotsTest-336030675 tempest-VolumesAssistedSnapshotsTest-336030675-project-admin] [instance: 9cfb60cb-011e-4537-9f28-55ea7d6dfc13] Updating existing volume attachment record: 21548d9c-c48f-4dd2-8ba7-3ab4581b4179 {{(pid=75122) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 09:32:38 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:32:39 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:32:43 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:32:44 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:32:45 user nova-compute[75122]: DEBUG nova.compute.manager [None req-87b8d899-6ab9-4afd-bfa5-c093e3bcdb6d tempest-TestVolumeSwap-69301659 tempest-TestVolumeSwap-69301659-project-admin] [instance: d24a189e-2de9-404e-b281-224c150a5bbf] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5cb8eb00-0379-40d5-972c-9565fe412df4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eqxYPwfD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd24a189e-2de9-404e-b281-224c150a5bbf', 'attached_at': '', 'detached_at': '', 'volume_id': '5cb8eb00-0379-40d5-972c-9565fe412df4', 'serial': '5cb8eb00-0379-40d5-972c-9565fe412df4'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0796957f-5a19-4fe2-acb8-f3568399150a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KPflkmYs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': 'd24a189e-2de9-404e-b281-224c150a5bbf', 'attached_at': '', 'detached_at': '', 'volume_id': '0796957f-5a19-4fe2-acb8-f3568399150a', 'serial'} {{(pid=75122) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 15 09:32:45 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-87b8d899-6ab9-4afd-bfa5-c093e3bcdb6d tempest-TestVolumeSwap-69301659 tempest-TestVolumeSwap-69301659-project-admin] [instance: d24a189e-2de9-404e-b281-224c150a5bbf] Calling os-brick to attach iSCSI Volume {{(pid=75122) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 09:32:45 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-87b8d899-6ab9-4afd-bfa5-c093e3bcdb6d tempest-TestVolumeSwap-69301659 tempest-TestVolumeSwap-69301659-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffa04060b80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5cb8eb00-0379-40d5-972c-9565fe412df4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eqxYPwfD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 09:32:45 user nova-compute[75122]: WARNING os_brick.initiator.connectors.base [None req-87b8d899-6ab9-4afd-bfa5-c093e3bcdb6d tempest-TestVolumeSwap-69301659 tempest-TestVolumeSwap-69301659-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 09:32:45 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-87b8d899-6ab9-4afd-bfa5-c093e3bcdb6d tempest-TestVolumeSwap-69301659 tempest-TestVolumeSwap-69301659-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 09:32:45 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-87b8d899-6ab9-4afd-bfa5-c093e3bcdb6d tempest-TestVolumeSwap-69301659 tempest-TestVolumeSwap-69301659-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 09:32:45 user nova-compute[75122]: WARNING os_brick.initiator.connectors.base [None req-87b8d899-6ab9-4afd-bfa5-c093e3bcdb6d tempest-TestVolumeSwap-69301659 tempest-TestVolumeSwap-69301659-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 09:32:45 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-87b8d899-6ab9-4afd-bfa5-c093e3bcdb6d tempest-TestVolumeSwap-69301659 tempest-TestVolumeSwap-69301659-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5cb8eb00-0379-40d5-972c-9565fe412df4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 09:32:45 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-87b8d899-6ab9-4afd-bfa5-c093e3bcdb6d tempest-TestVolumeSwap-69301659 tempest-TestVolumeSwap-69301659-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5cb8eb00-0379-40d5-972c-9565fe412df4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 09:32:45 user nova-compute[75122]: INFO os_brick.initiator.connectors.iscsi [None req-87b8d899-6ab9-4afd-bfa5-c093e3bcdb6d tempest-TestVolumeSwap-69301659 tempest-TestVolumeSwap-69301659-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 09:32:45 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5cb8eb00-0379-40d5-972c-9565fe412df4 -p 172.16.0.220:3260 {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:32:45 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fd429f5b-62a5-4518-a34f-c0fcf0b48004 tempest-VolumesAssistedSnapshotsTest-336030675 tempest-VolumesAssistedSnapshotsTest-336030675-project-admin] [instance: 9cfb60cb-011e-4537-9f28-55ea7d6dfc13] Calling os-brick to attach iSCSI Volume {{(pid=75122) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 09:32:45 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd429f5b-62a5-4518-a34f-c0fcf0b48004 tempest-VolumesAssistedSnapshotsTest-336030675 tempest-VolumesAssistedSnapshotsTest-336030675-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffa04060b80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:085fd119-574c-4b24-bf7c-8076479d01c3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oSHOlNqD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 09:32:45 user nova-compute[75122]: WARNING os_brick.initiator.connectors.base [None req-fd429f5b-62a5-4518-a34f-c0fcf0b48004 tempest-VolumesAssistedSnapshotsTest-336030675 tempest-VolumesAssistedSnapshotsTest-336030675-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 09:32:45 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-fd429f5b-62a5-4518-a34f-c0fcf0b48004 tempest-VolumesAssistedSnapshotsTest-336030675 tempest-VolumesAssistedSnapshotsTest-336030675-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 09:32:45 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5cb8eb00-0379-40d5-972c-9565fe412df4 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:32:45 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[05f87267-d16d-40bc-8c06-95904198cf8d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:32:45 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-87b8d899-6ab9-4afd-bfa5-c093e3bcdb6d tempest-TestVolumeSwap-69301659 tempest-TestVolumeSwap-69301659-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 09:32:45 user nova-compute[75122]:  {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:32:45 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5cb8eb00-0379-40d5-972c-9565fe412df4 -p 172.16.0.220:3260 --interface default --op new {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:32:45 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5cb8eb00-0379-40d5-972c-9565fe412df4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:32:45 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[5032a605-6b11-4d6d-88ae-758e73943510]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5cb8eb00-0379-40d5-972c-9565fe412df4] added\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:32:45 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-87b8d899-6ab9-4afd-bfa5-c093e3bcdb6d tempest-TestVolumeSwap-69301659 tempest-TestVolumeSwap-69301659-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5cb8eb00-0379-40d5-972c-9565fe412df4] added
Nov 15 09:32:45 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:32:45 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5cb8eb00-0379-40d5-972c-9565fe412df4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:32:45 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5cb8eb00-0379-40d5-972c-9565fe412df4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:32:45 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[699bb9dc-3287-4008-a2cb-7c44aa470aa6]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:32:45 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-87b8d899-6ab9-4afd-bfa5-c093e3bcdb6d tempest-TestVolumeSwap-69301659 tempest-TestVolumeSwap-69301659-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:32:45 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5cb8eb00-0379-40d5-972c-9565fe412df4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:32:45 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5cb8eb00-0379-40d5-972c-9565fe412df4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:32:45 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[03ae7fbd-b6cd-4813-a0a3-5a63624175c0]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:32:45 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-87b8d899-6ab9-4afd-bfa5-c093e3bcdb6d tempest-TestVolumeSwap-69301659 tempest-TestVolumeSwap-69301659-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:32:45 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5cb8eb00-0379-40d5-972c-9565fe412df4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eqxYPwfD {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:32:45 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5cb8eb00-0379-40d5-972c-9565fe412df4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eqxYPwfD" returned: 0 in 0.017s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:32:45 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4a339dd-9583-4231-a7dc-b4d4cc32ca86]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:32:45 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-87b8d899-6ab9-4afd-bfa5-c093e3bcdb6d tempest-TestVolumeSwap-69301659 tempest-TestVolumeSwap-69301659-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'eqxYPwfD'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:32:45 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5cb8eb00-0379-40d5-972c-9565fe412df4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:32:45 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5cb8eb00-0379-40d5-972c-9565fe412df4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:32:45 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c93587e-ce4d-4a79-9369-e7766e375876]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:32:45 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-87b8d899-6ab9-4afd-bfa5-c093e3bcdb6d tempest-TestVolumeSwap-69301659 tempest-TestVolumeSwap-69301659-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:32:45 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:32:45 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:32:45 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e62db3b-f0f5-4dd1-843f-ffcf538961ed]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c99dc28e-fa63-40b8-820f-03d6c84a132f (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b67b7d3-ab4f-4cc4-b9b8-906eac8491e4 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0796957f-5a19-4fe2-acb8-f3568399150a (non-flash)\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:32:45 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-87b8d899-6ab9-4afd-bfa5-c093e3bcdb6d tempest-TestVolumeSwap-69301659 tempest-TestVolumeSwap-69301659-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e (non-flash)
Nov 15 09:32:45 user nova-compute[75122]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c99dc28e-fa63-40b8-820f-03d6c84a132f (non-flash)
Nov 15 09:32:45 user nova-compute[75122]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b67b7d3-ab4f-4cc4-b9b8-906eac8491e4 (non-flash)
Nov 15 09:32:45 user nova-compute[75122]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0796957f-5a19-4fe2-acb8-f3568399150a (non-flash)
Nov 15 09:32:45 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 09:32:45 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-87b8d899-6ab9-4afd-bfa5-c093e3bcdb6d tempest-TestVolumeSwap-69301659 tempest-TestVolumeSwap-69301659-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e (non-flash)
Nov 15 09:32:45 user nova-compute[75122]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c99dc28e-fa63-40b8-820f-03d6c84a132f (non-flash)
Nov 15 09:32:45 user nova-compute[75122]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b67b7d3-ab4f-4cc4-b9b8-906eac8491e4 (non-flash)
Nov 15 09:32:45 user nova-compute[75122]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0796957f-5a19-4fe2-acb8-f3568399150a (non-flash)
Nov 15 09:32:45 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 09:32:45 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5cb8eb00-0379-40d5-972c-9565fe412df4 -p 172.16.0.220:3260 --login {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:32:45 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5cb8eb00-0379-40d5-972c-9565fe412df4 -p 172.16.0.220:3260 --login" returned: 0 in 0.099s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:32:45 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f4206b1-8dc9-4917-975b-3020ba856e8e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5cb8eb00-0379-40d5-972c-9565fe412df4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5cb8eb00-0379-40d5-972c-9565fe412df4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:32:45 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-87b8d899-6ab9-4afd-bfa5-c093e3bcdb6d tempest-TestVolumeSwap-69301659 tempest-TestVolumeSwap-69301659-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5cb8eb00-0379-40d5-972c-9565fe412df4, portal: 172.16.0.220,3260]
Nov 15 09:32:45 user nova-compute[75122]: Login to [iface: default, target: iqn.2010-10.org.openstack:5cb8eb00-0379-40d5-972c-9565fe412df4, portal: 172.16.0.220,3260] successful.
Nov 15 09:32:45 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:32:45 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5cb8eb00-0379-40d5-972c-9565fe412df4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:32:45 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5cb8eb00-0379-40d5-972c-9565fe412df4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.031s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:32:45 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[82638248-887f-4994-92f0-8d10a89efa6d]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:32:45 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-87b8d899-6ab9-4afd-bfa5-c093e3bcdb6d tempest-TestVolumeSwap-69301659 tempest-TestVolumeSwap-69301659-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:32:45 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:32:45 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.154s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:32:45 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[61eeb7e8-76df-4fea-9373-5d20e85fa7af]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cb8eb00-0379-40d5-972c-9565fe412df4 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c99dc28e-fa63-40b8-820f-03d6c84a132f (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b67b7d3-ab4f-4cc4-b9b8-906eac8491e4 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0796957f-5a19-4fe2-acb8-f3568399150a (non-flash)\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:32:45 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-87b8d899-6ab9-4afd-bfa5-c093e3bcdb6d tempest-TestVolumeSwap-69301659 tempest-TestVolumeSwap-69301659-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cb8eb00-0379-40d5-972c-9565fe412df4 (non-flash)
Nov 15 09:32:45 user nova-compute[75122]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e (non-flash)
Nov 15 09:32:45 user nova-compute[75122]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c99dc28e-fa63-40b8-820f-03d6c84a132f (non-flash)
Nov 15 09:32:45 user nova-compute[75122]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b67b7d3-ab4f-4cc4-b9b8-906eac8491e4 (non-flash)
Nov 15 09:32:45 user nova-compute[75122]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0796957f-5a19-4fe2-acb8-f3568399150a (non-flash)
Nov 15 09:32:45 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 09:32:45 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-87b8d899-6ab9-4afd-bfa5-c093e3bcdb6d tempest-TestVolumeSwap-69301659 tempest-TestVolumeSwap-69301659-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cb8eb00-0379-40d5-972c-9565fe412df4 (non-flash)
Nov 15 09:32:45 user nova-compute[75122]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e (non-flash)
Nov 15 09:32:45 user nova-compute[75122]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c99dc28e-fa63-40b8-820f-03d6c84a132f (non-flash)
Nov 15 09:32:45 user nova-compute[75122]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b67b7d3-ab4f-4cc4-b9b8-906eac8491e4 (non-flash)
Nov 15 09:32:45 user nova-compute[75122]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0796957f-5a19-4fe2-acb8-f3568399150a (non-flash)
Nov 15 09:32:45 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 09:32:45 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-87b8d899-6ab9-4afd-bfa5-c093e3bcdb6d tempest-TestVolumeSwap-69301659 tempest-TestVolumeSwap-69301659-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5cb8eb00-0379-40d5-972c-9565fe412df4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.452s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 09:32:45 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-87b8d899-6ab9-4afd-bfa5-c093e3bcdb6d tempest-TestVolumeSwap-69301659 tempest-TestVolumeSwap-69301659-project-admin] Connected to 172.16.0.220:3260 {{(pid=75122) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 09:32:45 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-87b8d899-6ab9-4afd-bfa5-c093e3bcdb6d tempest-TestVolumeSwap-69301659 tempest-TestVolumeSwap-69301659-project-admin] HCTL ('37', '-', '-', 0) found on session 10 with lun 0 {{(pid=75122) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 09:32:45 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-87b8d899-6ab9-4afd-bfa5-c093e3bcdb6d tempest-TestVolumeSwap-69301659 tempest-TestVolumeSwap-69301659-project-admin] Scanning host 37 c: -, t: -, l: 0) {{(pid=75122) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 09:32:45 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-080ba89a-eea2-4095-8e76-fc095c1e3888 tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] Waiting for libvirt event about the detach of device sdc with device alias scsi0-0-0-2 from instance bcb58c79-f6b3-44d9-a80f-1a4cf580379f is timed out.
Nov 15 09:32:45 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:32:45 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-080ba89a-eea2-4095-8e76-fc095c1e3888 tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] Successfully detached device sdc from instance bcb58c79-f6b3-44d9-a80f-1a4cf580379f from the live domain config.
Nov 15 09:32:45 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-080ba89a-eea2-4095-8e76-fc095c1e3888 tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] [instance: bcb58c79-f6b3-44d9-a80f-1a4cf580379f] calling os-brick to detach iSCSI Volume {{(pid=75122) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 09:32:45 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-080ba89a-eea2-4095-8e76-fc095c1e3888 tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffa04060b80>, {'target_iqn': 'iqn.2010-10.org.openstack:c99dc28e-fa63-40b8-820f-03d6c84a132f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yXZzKCmD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 09:32:45 user nova-compute[75122]: WARNING os_brick.initiator.connectors.base [None req-080ba89a-eea2-4095-8e76-fc095c1e3888 tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 09:32:45 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-080ba89a-eea2-4095-8e76-fc095c1e3888 tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 09:32:45 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.015s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:32:45 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdc0923b-6468-4c49-84e4-520cb58f9365]: (4, ('- - 0', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:32:45 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-87b8d899-6ab9-4afd-bfa5-c093e3bcdb6d tempest-TestVolumeSwap-69301659 tempest-TestVolumeSwap-69301659-project-admin] Searching for a device in session 10 and hctl ['37', '*', '*', 0] yield: None {{(pid=75122) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 09:32:46 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-87b8d899-6ab9-4afd-bfa5-c093e3bcdb6d tempest-TestVolumeSwap-69301659 tempest-TestVolumeSwap-69301659-project-admin] Searching for a device in session 10 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75122) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 09:32:46 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-87b8d899-6ab9-4afd-bfa5-c093e3bcdb6d tempest-TestVolumeSwap-69301659 tempest-TestVolumeSwap-69301659-project-admin] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:5cb8eb00-0379-40d5-972c-9565fe412df4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eqxYPwfD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75122) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 09:32:46 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-87b8d899-6ab9-4afd-bfa5-c093e3bcdb6d tempest-TestVolumeSwap-69301659 tempest-TestVolumeSwap-69301659-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.481s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 09:32:46 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-87b8d899-6ab9-4afd-bfa5-c093e3bcdb6d tempest-TestVolumeSwap-69301659 tempest-TestVolumeSwap-69301659-project-admin] <== connect_volume: return (1483ms) {'type': 'block', 'scsi_wwn': '23565366539636132', 'path': '/dev/sdf'} {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 09:32:46 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-87b8d899-6ab9-4afd-bfa5-c093e3bcdb6d tempest-TestVolumeSwap-69301659 tempest-TestVolumeSwap-69301659-project-admin] [instance: d24a189e-2de9-404e-b281-224c150a5bbf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23565366539636132', 'path': '/dev/sdf'} {{(pid=75122) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 09:32:46 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-fd429f5b-62a5-4518-a34f-c0fcf0b48004 tempest-VolumesAssistedSnapshotsTest-336030675 tempest-VolumesAssistedSnapshotsTest-336030675-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.474s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 09:32:46 user nova-compute[75122]: WARNING os_brick.initiator.connectors.base [None req-fd429f5b-62a5-4518-a34f-c0fcf0b48004 tempest-VolumesAssistedSnapshotsTest-336030675 tempest-VolumesAssistedSnapshotsTest-336030675-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 09:32:46 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-fd429f5b-62a5-4518-a34f-c0fcf0b48004 tempest-VolumesAssistedSnapshotsTest-336030675 tempest-VolumesAssistedSnapshotsTest-336030675-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:085fd119-574c-4b24-bf7c-8076479d01c3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 09:32:46 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-fd429f5b-62a5-4518-a34f-c0fcf0b48004 tempest-VolumesAssistedSnapshotsTest-336030675 tempest-VolumesAssistedSnapshotsTest-336030675-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:085fd119-574c-4b24-bf7c-8076479d01c3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 09:32:46 user nova-compute[75122]: INFO os_brick.initiator.connectors.iscsi [None req-fd429f5b-62a5-4518-a34f-c0fcf0b48004 tempest-VolumesAssistedSnapshotsTest-336030675 tempest-VolumesAssistedSnapshotsTest-336030675-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 09:32:46 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:085fd119-574c-4b24-bf7c-8076479d01c3 -p 172.16.0.220:3260 {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:32:46 user nova-compute[75122]: DEBUG nova.objects.instance [None req-87b8d899-6ab9-4afd-bfa5-c093e3bcdb6d tempest-TestVolumeSwap-69301659 tempest-TestVolumeSwap-69301659-project-admin] Lazy-loading 'flavor' on Instance uuid d24a189e-2de9-404e-b281-224c150a5bbf {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:32:46 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:085fd119-574c-4b24-bf7c-8076479d01c3 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:32:46 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[c70385cd-f3e9-4b59-8bcf-b315f3f05f33]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:32:46 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd429f5b-62a5-4518-a34f-c0fcf0b48004 tempest-VolumesAssistedSnapshotsTest-336030675 tempest-VolumesAssistedSnapshotsTest-336030675-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 09:32:46 user nova-compute[75122]:  {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:32:46 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:085fd119-574c-4b24-bf7c-8076479d01c3 -p 172.16.0.220:3260 --interface default --op new {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:32:46 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:085fd119-574c-4b24-bf7c-8076479d01c3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:32:46 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b5c3449-c1be-4134-85b7-baaf8844f914]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:085fd119-574c-4b24-bf7c-8076479d01c3] added\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:32:46 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd429f5b-62a5-4518-a34f-c0fcf0b48004 tempest-VolumesAssistedSnapshotsTest-336030675 tempest-VolumesAssistedSnapshotsTest-336030675-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:085fd119-574c-4b24-bf7c-8076479d01c3] added
Nov 15 09:32:46 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:32:46 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:085fd119-574c-4b24-bf7c-8076479d01c3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:32:46 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:085fd119-574c-4b24-bf7c-8076479d01c3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:32:46 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f1d265c-7c6a-4d2d-874c-c55a9097bd93]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:32:46 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd429f5b-62a5-4518-a34f-c0fcf0b48004 tempest-VolumesAssistedSnapshotsTest-336030675 tempest-VolumesAssistedSnapshotsTest-336030675-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:32:46 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:085fd119-574c-4b24-bf7c-8076479d01c3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:32:46 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:085fd119-574c-4b24-bf7c-8076479d01c3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:32:46 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[e29054de-dcbb-43d9-8a26-704176ca65b5]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:32:46 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd429f5b-62a5-4518-a34f-c0fcf0b48004 tempest-VolumesAssistedSnapshotsTest-336030675 tempest-VolumesAssistedSnapshotsTest-336030675-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:32:46 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:085fd119-574c-4b24-bf7c-8076479d01c3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oSHOlNqD {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:32:46 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:085fd119-574c-4b24-bf7c-8076479d01c3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oSHOlNqD" returned: 0 in 0.023s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:32:46 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd6afc9b-33ca-41c1-846c-e6beb4c97683]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:32:46 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd429f5b-62a5-4518-a34f-c0fcf0b48004 tempest-VolumesAssistedSnapshotsTest-336030675 tempest-VolumesAssistedSnapshotsTest-336030675-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oSHOlNqD'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:32:46 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:085fd119-574c-4b24-bf7c-8076479d01c3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:32:46 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:085fd119-574c-4b24-bf7c-8076479d01c3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:32:46 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb76e40b-13ce-47de-a79f-ae3e93695a87]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:32:46 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd429f5b-62a5-4518-a34f-c0fcf0b48004 tempest-VolumesAssistedSnapshotsTest-336030675 tempest-VolumesAssistedSnapshotsTest-336030675-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:32:47 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:32:47 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:32:47 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eb37fd7-2c8a-4f12-92c3-1098fecb13dd]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cb8eb00-0379-40d5-972c-9565fe412df4 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c99dc28e-fa63-40b8-820f-03d6c84a132f (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b67b7d3-ab4f-4cc4-b9b8-906eac8491e4 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0796957f-5a19-4fe2-acb8-f3568399150a (non-flash)\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:32:47 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd429f5b-62a5-4518-a34f-c0fcf0b48004 tempest-VolumesAssistedSnapshotsTest-336030675 tempest-VolumesAssistedSnapshotsTest-336030675-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cb8eb00-0379-40d5-972c-9565fe412df4 (non-flash)
Nov 15 09:32:47 user nova-compute[75122]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e (non-flash)
Nov 15 09:32:47 user nova-compute[75122]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c99dc28e-fa63-40b8-820f-03d6c84a132f (non-flash)
Nov 15 09:32:47 user nova-compute[75122]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b67b7d3-ab4f-4cc4-b9b8-906eac8491e4 (non-flash)
Nov 15 09:32:47 user nova-compute[75122]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0796957f-5a19-4fe2-acb8-f3568399150a (non-flash)
Nov 15 09:32:47 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 09:32:47 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd429f5b-62a5-4518-a34f-c0fcf0b48004 tempest-VolumesAssistedSnapshotsTest-336030675 tempest-VolumesAssistedSnapshotsTest-336030675-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cb8eb00-0379-40d5-972c-9565fe412df4 (non-flash)
Nov 15 09:32:47 user nova-compute[75122]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e (non-flash)
Nov 15 09:32:47 user nova-compute[75122]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c99dc28e-fa63-40b8-820f-03d6c84a132f (non-flash)
Nov 15 09:32:47 user nova-compute[75122]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b67b7d3-ab4f-4cc4-b9b8-906eac8491e4 (non-flash)
Nov 15 09:32:47 user nova-compute[75122]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0796957f-5a19-4fe2-acb8-f3568399150a (non-flash)
Nov 15 09:32:47 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 09:32:47 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:085fd119-574c-4b24-bf7c-8076479d01c3 -p 172.16.0.220:3260 --login {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:32:47 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:085fd119-574c-4b24-bf7c-8076479d01c3 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:32:47 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[79d80c13-88e6-4470-aee7-8720c915ea8f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:085fd119-574c-4b24-bf7c-8076479d01c3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:085fd119-574c-4b24-bf7c-8076479d01c3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:32:47 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd429f5b-62a5-4518-a34f-c0fcf0b48004 tempest-VolumesAssistedSnapshotsTest-336030675 tempest-VolumesAssistedSnapshotsTest-336030675-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:085fd119-574c-4b24-bf7c-8076479d01c3, portal: 172.16.0.220,3260]
Nov 15 09:32:47 user nova-compute[75122]: Login to [iface: default, target: iqn.2010-10.org.openstack:085fd119-574c-4b24-bf7c-8076479d01c3, portal: 172.16.0.220,3260] successful.
Nov 15 09:32:47 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:32:47 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:085fd119-574c-4b24-bf7c-8076479d01c3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:32:47 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:085fd119-574c-4b24-bf7c-8076479d01c3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:32:47 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b874bf4-2897-46f6-b5bf-49689adaf635]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:32:47 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd429f5b-62a5-4518-a34f-c0fcf0b48004 tempest-VolumesAssistedSnapshotsTest-336030675 tempest-VolumesAssistedSnapshotsTest-336030675-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:32:47 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:32:47 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:32:47 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a0c5395-a7ef-4e5e-a5d1-fa4538aa49d6]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cb8eb00-0379-40d5-972c-9565fe412df4 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:085fd119-574c-4b24-bf7c-8076479d01c3 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c99dc28e-fa63-40b8-820f-03d6c84a132f (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b67b7d3-ab4f-4cc4-b9b8-906eac8491e4 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0796957f-5a19-4fe2-acb8-f3568399150a (non-flash)\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:32:47 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd429f5b-62a5-4518-a34f-c0fcf0b48004 tempest-VolumesAssistedSnapshotsTest-336030675 tempest-VolumesAssistedSnapshotsTest-336030675-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cb8eb00-0379-40d5-972c-9565fe412df4 (non-flash)
Nov 15 09:32:47 user nova-compute[75122]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:085fd119-574c-4b24-bf7c-8076479d01c3 (non-flash)
Nov 15 09:32:47 user nova-compute[75122]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e (non-flash)
Nov 15 09:32:47 user nova-compute[75122]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c99dc28e-fa63-40b8-820f-03d6c84a132f (non-flash)
Nov 15 09:32:47 user nova-compute[75122]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b67b7d3-ab4f-4cc4-b9b8-906eac8491e4 (non-flash)
Nov 15 09:32:47 user nova-compute[75122]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0796957f-5a19-4fe2-acb8-f3568399150a (non-flash)
Nov 15 09:32:47 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 09:32:47 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd429f5b-62a5-4518-a34f-c0fcf0b48004 tempest-VolumesAssistedSnapshotsTest-336030675 tempest-VolumesAssistedSnapshotsTest-336030675-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cb8eb00-0379-40d5-972c-9565fe412df4 (non-flash)
Nov 15 09:32:47 user nova-compute[75122]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:085fd119-574c-4b24-bf7c-8076479d01c3 (non-flash)
Nov 15 09:32:47 user nova-compute[75122]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e (non-flash)
Nov 15 09:32:47 user nova-compute[75122]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c99dc28e-fa63-40b8-820f-03d6c84a132f (non-flash)
Nov 15 09:32:47 user nova-compute[75122]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b67b7d3-ab4f-4cc4-b9b8-906eac8491e4 (non-flash)
Nov 15 09:32:47 user nova-compute[75122]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0796957f-5a19-4fe2-acb8-f3568399150a (non-flash)
Nov 15 09:32:47 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 09:32:47 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-fd429f5b-62a5-4518-a34f-c0fcf0b48004 tempest-VolumesAssistedSnapshotsTest-336030675 tempest-VolumesAssistedSnapshotsTest-336030675-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:085fd119-574c-4b24-bf7c-8076479d01c3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.275s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 09:32:47 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd429f5b-62a5-4518-a34f-c0fcf0b48004 tempest-VolumesAssistedSnapshotsTest-336030675 tempest-VolumesAssistedSnapshotsTest-336030675-project-admin] Connected to 172.16.0.220:3260 {{(pid=75122) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 09:32:47 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-fd429f5b-62a5-4518-a34f-c0fcf0b48004 tempest-VolumesAssistedSnapshotsTest-336030675 tempest-VolumesAssistedSnapshotsTest-336030675-project-admin] HCTL ('38', '-', '-', 0) found on session 11 with lun 0 {{(pid=75122) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 09:32:47 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-fd429f5b-62a5-4518-a34f-c0fcf0b48004 tempest-VolumesAssistedSnapshotsTest-336030675 tempest-VolumesAssistedSnapshotsTest-336030675-project-admin] Scanning host 38 c: -, t: -, l: 0) {{(pid=75122) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 09:32:47 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:32:47 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.014s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:32:47 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[501a6427-c0b5-4c7f-acb8-c1e90ad2921f]: (4, ('- - 0', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:32:47 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-fd429f5b-62a5-4518-a34f-c0fcf0b48004 tempest-VolumesAssistedSnapshotsTest-336030675 tempest-VolumesAssistedSnapshotsTest-336030675-project-admin] Searching for a device in session 11 and hctl ['38', '*', '*', 0] yield: None {{(pid=75122) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 09:32:47 user nova-compute[75122]: DEBUG nova.virt.libvirt.guest [None req-87b8d899-6ab9-4afd-bfa5-c093e3bcdb6d tempest-TestVolumeSwap-69301659 tempest-TestVolumeSwap-69301659-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=75122) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 09:32:47 user nova-compute[75122]: DEBUG nova.virt.libvirt.guest [None req-87b8d899-6ab9-4afd-bfa5-c093e3bcdb6d tempest-TestVolumeSwap-69301659 tempest-TestVolumeSwap-69301659-project-admin] COPY block job progress, current cursor: 155189248 final cursor: 1073741824 {{(pid=75122) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 09:32:48 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-fd429f5b-62a5-4518-a34f-c0fcf0b48004 tempest-VolumesAssistedSnapshotsTest-336030675 tempest-VolumesAssistedSnapshotsTest-336030675-project-admin] Searching for a device in session 11 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75122) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 09:32:48 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd429f5b-62a5-4518-a34f-c0fcf0b48004 tempest-VolumesAssistedSnapshotsTest-336030675 tempest-VolumesAssistedSnapshotsTest-336030675-project-admin] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:085fd119-574c-4b24-bf7c-8076479d01c3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oSHOlNqD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75122) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 09:32:48 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-fd429f5b-62a5-4518-a34f-c0fcf0b48004 tempest-VolumesAssistedSnapshotsTest-336030675 tempest-VolumesAssistedSnapshotsTest-336030675-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.303s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 09:32:48 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd429f5b-62a5-4518-a34f-c0fcf0b48004 tempest-VolumesAssistedSnapshotsTest-336030675 tempest-VolumesAssistedSnapshotsTest-336030675-project-admin] <== connect_volume: return (2778ms) {'type': 'block', 'scsi_wwn': '23166306265343465', 'path': '/dev/sdg'} {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 09:32:48 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fd429f5b-62a5-4518-a34f-c0fcf0b48004 tempest-VolumesAssistedSnapshotsTest-336030675 tempest-VolumesAssistedSnapshotsTest-336030675-project-admin] [instance: 9cfb60cb-011e-4537-9f28-55ea7d6dfc13] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23166306265343465', 'path': '/dev/sdg'} {{(pid=75122) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 09:32:48 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-080ba89a-eea2-4095-8e76-fc095c1e3888 tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 2.324s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 09:32:48 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:32:48 user nova-compute[75122]: DEBUG nova.objects.instance [None req-fd429f5b-62a5-4518-a34f-c0fcf0b48004 tempest-VolumesAssistedSnapshotsTest-336030675 tempest-VolumesAssistedSnapshotsTest-336030675-project-admin] Lazy-loading 'flavor' on Instance uuid 9cfb60cb-011e-4537-9f28-55ea7d6dfc13 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:32:48 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:32:48 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9f85020-00da-4d45-a0d0-4090aea9f5e1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c99dc28e-fa63-40b8-820f-03d6c84a132f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6b67b7d3-ab4f-4cc4-b9b8-906eac8491e4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5cb8eb00-0379-40d5-972c-9565fe412df4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0796957f-5a19-4fe2-acb8-f3568399150a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:085fd119-574c-4b24-bf7c-8076479d01c3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:32:48 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-080ba89a-eea2-4095-8e76-fc095c1e3888 tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 09:32:48 user nova-compute[75122]: No targets found.
Nov 15 09:32:48 user nova-compute[75122]: iSNS:
Nov 15 09:32:48 user nova-compute[75122]: No targets found.
Nov 15 09:32:48 user nova-compute[75122]: STATIC:
Nov 15 09:32:48 user nova-compute[75122]: Target: iqn.2010-10.org.openstack:c99dc28e-fa63-40b8-820f-03d6c84a132f
Nov 15 09:32:48 user nova-compute[75122]:         Portal: 172.16.0.220:3260,-1
Nov 15 09:32:48 user nova-compute[75122]:                 Iface Name: default
Nov 15 09:32:48 user nova-compute[75122]: Target: iqn.2010-10.org.openstack:6b67b7d3-ab4f-4cc4-b9b8-906eac8491e4
Nov 15 09:32:48 user nova-compute[75122]:         Portal: 172.16.0.220:3260,-1
Nov 15 09:32:48 user nova-compute[75122]:                 Iface Name: default
Nov 15 09:32:48 user nova-compute[75122]: Target: iqn.2010-10.org.openstack:5cb8eb00-0379-40d5-972c-9565fe412df4
Nov 15 09:32:48 user nova-compute[75122]:         Portal: 172.16.0.220:3260,-1
Nov 15 09:32:48 user nova-compute[75122]:                 Iface Name: default
Nov 15 09:32:48 user nova-compute[75122]: Target: iqn.2010-10.org.openstack:0796957f-5a19-4fe2-acb8-f3568399150a
Nov 15 09:32:48 user nova-compute[75122]:         Portal: 172.16.0.220:3260,-1
Nov 15 09:32:48 user nova-compute[75122]:                 Iface Name: default
Nov 15 09:32:48 user nova-compute[75122]: Target: iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e
Nov 15 09:32:48 user nova-compute[75122]:         Portal: 172.16.0.220:3260,-1
Nov 15 09:32:48 user nova-compute[75122]:                 Iface Name: default
Nov 15 09:32:48 user nova-compute[75122]: Target: iqn.2010-10.org.openstack:085fd119-574c-4b24-bf7c-8076479d01c3
Nov 15 09:32:48 user nova-compute[75122]:         Portal: 172.16.0.220:3260,-1
Nov 15 09:32:48 user nova-compute[75122]:                 Iface Name: default
Nov 15 09:32:48 user nova-compute[75122]: FIRMWARE:
Nov 15 09:32:48 user nova-compute[75122]: No targets found.
Nov 15 09:32:48 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 09:32:48 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-080ba89a-eea2-4095-8e76-fc095c1e3888 tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 09:32:48 user nova-compute[75122]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 09:32:48 user nova-compute[75122]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75122) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 09:32:48 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-080ba89a-eea2-4095-8e76-fc095c1e3888 tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c99dc28e-fa63-40b8-820f-03d6c84a132f', 0)] {{(pid=75122) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 09:32:48 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:32:48 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:32:48 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[f124d21c-af57-4c47-ac7e-7a092229f12e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0796957f-5a19-4fe2-acb8-f3568399150a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:085fd119-574c-4b24-bf7c-8076479d01c3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5cb8eb00-0379-40d5-972c-9565fe412df4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6b67b7d3-ab4f-4cc4-b9b8-906eac8491e4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c99dc28e-fa63-40b8-820f-03d6c84a132f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:32:48 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:32:48 user nova-compute[75122]: DEBUG nova.virt.libvirt.guest [None req-fd429f5b-62a5-4518-a34f-c0fcf0b48004 tempest-VolumesAssistedSnapshotsTest-336030675 tempest-VolumesAssistedSnapshotsTest-336030675-project-admin] attach device xml: <disk type="block" device="disk">
Nov 15 09:32:48 user nova-compute[75122]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 09:32:48 user nova-compute[75122]:   <source dev="/dev/sdg"/>
Nov 15 09:32:48 user nova-compute[75122]:   <target dev="vdb" bus="virtio"/>
Nov 15 09:32:48 user nova-compute[75122]:   <serial>085fd119-574c-4b24-bf7c-8076479d01c3</serial>
Nov 15 09:32:48 user nova-compute[75122]: </disk>
Nov 15 09:32:48 user nova-compute[75122]:  {{(pid=75122) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 09:32:48 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:32:48 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[82c324f0-93e7-4ea1-9b3d-a07204cc3852]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cb8eb00-0379-40d5-972c-9565fe412df4 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:085fd119-574c-4b24-bf7c-8076479d01c3 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c99dc28e-fa63-40b8-820f-03d6c84a132f (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b67b7d3-ab4f-4cc4-b9b8-906eac8491e4 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0796957f-5a19-4fe2-acb8-f3568399150a (non-flash)\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:32:48 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-080ba89a-eea2-4095-8e76-fc095c1e3888 tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cb8eb00-0379-40d5-972c-9565fe412df4 (non-flash)
Nov 15 09:32:48 user nova-compute[75122]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:085fd119-574c-4b24-bf7c-8076479d01c3 (non-flash)
Nov 15 09:32:48 user nova-compute[75122]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e (non-flash)
Nov 15 09:32:48 user nova-compute[75122]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c99dc28e-fa63-40b8-820f-03d6c84a132f (non-flash)
Nov 15 09:32:48 user nova-compute[75122]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b67b7d3-ab4f-4cc4-b9b8-906eac8491e4 (non-flash)
Nov 15 09:32:48 user nova-compute[75122]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0796957f-5a19-4fe2-acb8-f3568399150a (non-flash)
Nov 15 09:32:48 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 09:32:48 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-080ba89a-eea2-4095-8e76-fc095c1e3888 tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cb8eb00-0379-40d5-972c-9565fe412df4 (non-flash)
Nov 15 09:32:48 user nova-compute[75122]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:085fd119-574c-4b24-bf7c-8076479d01c3 (non-flash)
Nov 15 09:32:48 user nova-compute[75122]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e (non-flash)
Nov 15 09:32:48 user nova-compute[75122]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c99dc28e-fa63-40b8-820f-03d6c84a132f (non-flash)
Nov 15 09:32:48 user nova-compute[75122]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b67b7d3-ab4f-4cc4-b9b8-906eac8491e4 (non-flash)
Nov 15 09:32:48 user nova-compute[75122]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0796957f-5a19-4fe2-acb8-f3568399150a (non-flash)
Nov 15 09:32:48 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 09:32:48 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-080ba89a-eea2-4095-8e76-fc095c1e3888 tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff9fc3a5090>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c99dc28e-fa63-40b8-820f-03d6c84a132f'): ({'sdc'}, set())}) {{(pid=75122) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 09:32:48 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-080ba89a-eea2-4095-8e76-fc095c1e3888 tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] Removing single pathed devices sdc {{(pid=75122) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 09:32:48 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:32:48 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:32:48 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8f470a5-8982-4ae6-8251-436ecc137895]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:32:48 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:32:48 user nova-compute[75122]: DEBUG nova.virt.libvirt.guest [None req-87b8d899-6ab9-4afd-bfa5-c093e3bcdb6d tempest-TestVolumeSwap-69301659 tempest-TestVolumeSwap-69301659-project-admin] COPY block job progress, current cursor: 350224384 final cursor: 1073741824 {{(pid=75122) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 09:32:48 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:32:48 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[15e14b9c-a3cc-45e3-b0a6-5bcfa82959d7]: (4, ('ok\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:32:48 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-080ba89a-eea2-4095-8e76-fc095c1e3888 tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] Flushing IO for device /dev/sdc {{(pid=75122) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 09:32:48 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:32:48 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:32:48 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[27f8249b-fa99-4bda-be8f-c0bc9a5dacbc]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:32:48 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-080ba89a-eea2-4095-8e76-fc095c1e3888 tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75122) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 09:32:48 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:32:48 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.045s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:32:48 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6fe295d-8918-4224-abcd-e9f3bf6206d9]: (4, ('1', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:32:48 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-080ba89a-eea2-4095-8e76-fc095c1e3888 tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75122) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 09:32:48 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-080ba89a-eea2-4095-8e76-fc095c1e3888 tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] SCSI volumes sdc have been removed. {{(pid=75122) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 09:32:48 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-080ba89a-eea2-4095-8e76-fc095c1e3888 tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c99dc28e-fa63-40b8-820f-03d6c84a132f')] {{(pid=75122) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 09:32:48 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c99dc28e-fa63-40b8-820f-03d6c84a132f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:32:48 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c99dc28e-fa63-40b8-820f-03d6c84a132f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:32:48 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[54f9472d-6ea7-44fa-916a-d06af8f25423]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:32:48 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-080ba89a-eea2-4095-8e76-fc095c1e3888 tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:32:48 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c99dc28e-fa63-40b8-820f-03d6c84a132f -p 172.16.0.220:3260 --logout {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:32:48 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:32:48 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c99dc28e-fa63-40b8-820f-03d6c84a132f -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:32:48 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4c2a76c-0863-432e-9f14-d1c51fda48ec]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:c99dc28e-fa63-40b8-820f-03d6c84a132f, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:c99dc28e-fa63-40b8-820f-03d6c84a132f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:32:48 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-080ba89a-eea2-4095-8e76-fc095c1e3888 tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:c99dc28e-fa63-40b8-820f-03d6c84a132f, portal: 172.16.0.220,3260]
Nov 15 09:32:48 user nova-compute[75122]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:c99dc28e-fa63-40b8-820f-03d6c84a132f, portal: 172.16.0.220,3260] successful.
Nov 15 09:32:48 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:32:48 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c99dc28e-fa63-40b8-820f-03d6c84a132f -p 172.16.0.220:3260 --op delete {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:32:48 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c99dc28e-fa63-40b8-820f-03d6c84a132f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:32:48 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b7b0bab-8fa1-4bb3-8371-9ae91ea429aa]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:32:48 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-080ba89a-eea2-4095-8e76-fc095c1e3888 tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:32:48 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-080ba89a-eea2-4095-8e76-fc095c1e3888 tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.361s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 09:32:48 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-080ba89a-eea2-4095-8e76-fc095c1e3888 tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] <== disconnect_volume: return (2684ms) None {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 09:32:48 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-080ba89a-eea2-4095-8e76-fc095c1e3888 tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] [instance: bcb58c79-f6b3-44d9-a80f-1a4cf580379f] Disconnected iSCSI Volume {{(pid=75122) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 09:32:48 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-fd429f5b-62a5-4518-a34f-c0fcf0b48004 tempest-VolumesAssistedSnapshotsTest-336030675 tempest-VolumesAssistedSnapshotsTest-336030675-project-admin] No BDM found with device name vda, not building metadata. {{(pid=75122) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 09:32:48 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-fd429f5b-62a5-4518-a34f-c0fcf0b48004 tempest-VolumesAssistedSnapshotsTest-336030675 tempest-VolumesAssistedSnapshotsTest-336030675-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=75122) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 09:32:48 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-fd429f5b-62a5-4518-a34f-c0fcf0b48004 tempest-VolumesAssistedSnapshotsTest-336030675 tempest-VolumesAssistedSnapshotsTest-336030675-project-admin] No VIF found with MAC fa:16:3e:95:5c:e0, not building metadata {{(pid=75122) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 09:32:48 user nova-compute[75122]: DEBUG nova.virt.libvirt.guest [None req-87b8d899-6ab9-4afd-bfa5-c093e3bcdb6d tempest-TestVolumeSwap-69301659 tempest-TestVolumeSwap-69301659-project-admin] COPY block job progress, current cursor: 534773760 final cursor: 1073741824 {{(pid=75122) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 09:32:48 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-fd429f5b-62a5-4518-a34f-c0fcf0b48004 tempest-VolumesAssistedSnapshotsTest-336030675 tempest-VolumesAssistedSnapshotsTest-336030675-project-admin] Lock "9cfb60cb-011e-4537-9f28-55ea7d6dfc13" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.171s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:32:49 user nova-compute[75122]: DEBUG nova.virt.libvirt.guest [None req-87b8d899-6ab9-4afd-bfa5-c093e3bcdb6d tempest-TestVolumeSwap-69301659 tempest-TestVolumeSwap-69301659-project-admin] COPY block job progress, current cursor: 609222656 final cursor: 1073741824 {{(pid=75122) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 09:32:49 user nova-compute[75122]: DEBUG nova.objects.instance [None req-080ba89a-eea2-4095-8e76-fc095c1e3888 tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] Lazy-loading 'flavor' on Instance uuid bcb58c79-f6b3-44d9-a80f-1a4cf580379f {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:32:49 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-080ba89a-eea2-4095-8e76-fc095c1e3888 tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] Lock "bcb58c79-f6b3-44d9-a80f-1a4cf580379f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 24.249s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:32:49 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-96da443c-bba7-4693-9a9a-21086d23353f tempest-VolumesAssistedSnapshotsTest-872762512 tempest-VolumesAssistedSnapshotsTest-872762512-project] [instance: 9cfb60cb-011e-4537-9f28-55ea7d6dfc13] volume_snapshot_create: create_info: {'snapshot_id': '080b2dfd-b319-4bd5-b8c6-dfa4d2dfb9bf', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=75122) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3576}}
Nov 15 09:32:49 user nova-compute[75122]: DEBUG nova.virt.libvirt.guest [None req-87b8d899-6ab9-4afd-bfa5-c093e3bcdb6d tempest-TestVolumeSwap-69301659 tempest-TestVolumeSwap-69301659-project-admin] COPY block job progress, current cursor: 775946240 final cursor: 1073741824 {{(pid=75122) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 09:32:49 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-96da443c-bba7-4693-9a9a-21086d23353f tempest-VolumesAssistedSnapshotsTest-872762512 tempest-VolumesAssistedSnapshotsTest-872762512-project] [instance: 9cfb60cb-011e-4537-9f28-55ea7d6dfc13] snap xml: <domainsnapshot>
Nov 15 09:32:49 user nova-compute[75122]:   <disks>
Nov 15 09:32:49 user nova-compute[75122]:     <disk name="/dev/sdg" snapshot="external" type="file">
Nov 15 09:32:49 user nova-compute[75122]:       <source file="/dev/new_file"/>
Nov 15 09:32:49 user nova-compute[75122]:     </disk>
Nov 15 09:32:49 user nova-compute[75122]:     <disk name="vda" snapshot="no"/>
Nov 15 09:32:49 user nova-compute[75122]:   </disks>
Nov 15 09:32:49 user nova-compute[75122]: </domainsnapshot>
Nov 15 09:32:49 user nova-compute[75122]:  {{(pid=75122) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3517}}
Nov 15 09:32:49 user nova-compute[75122]: DEBUG nova.objects.instance [None req-96da443c-bba7-4693-9a9a-21086d23353f tempest-VolumesAssistedSnapshotsTest-872762512 tempest-VolumesAssistedSnapshotsTest-872762512-project] Lazy-loading 'system_metadata' on Instance uuid 9cfb60cb-011e-4537-9f28-55ea7d6dfc13 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:32:49 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:32:49 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-4e3a86ed-e28a-4eb6-b5cb-783706a9ed20 tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance e0f32160-7130-4b9c-aa9c-84123f3a6b32 is timed out.
Nov 15 09:32:49 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-96da443c-bba7-4693-9a9a-21086d23353f tempest-VolumesAssistedSnapshotsTest-872762512 tempest-VolumesAssistedSnapshotsTest-872762512-project] [instance: 9cfb60cb-011e-4537-9f28-55ea7d6dfc13] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 15 09:32:49 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-4e3a86ed-e28a-4eb6-b5cb-783706a9ed20 tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] Successfully detached device vdb from instance e0f32160-7130-4b9c-aa9c-84123f3a6b32 from the live domain config.
Nov 15 09:32:49 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e3a86ed-e28a-4eb6-b5cb-783706a9ed20 tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] [instance: e0f32160-7130-4b9c-aa9c-84123f3a6b32] calling os-brick to detach iSCSI Volume {{(pid=75122) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 09:32:49 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e3a86ed-e28a-4eb6-b5cb-783706a9ed20 tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffa04060b80>, {'target_iqn': 'iqn.2010-10.org.openstack:6b67b7d3-ab4f-4cc4-b9b8-906eac8491e4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SIHoOrvc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 09:32:49 user nova-compute[75122]: WARNING os_brick.initiator.connectors.base [None req-4e3a86ed-e28a-4eb6-b5cb-783706a9ed20 tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 09:32:49 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-4e3a86ed-e28a-4eb6-b5cb-783706a9ed20 tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 09:32:49 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-4e3a86ed-e28a-4eb6-b5cb-783706a9ed20 tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 09:32:50 user nova-compute[75122]: ERROR nova.virt.libvirt.driver [None req-96da443c-bba7-4693-9a9a-21086d23353f tempest-VolumesAssistedSnapshotsTest-872762512 tempest-VolumesAssistedSnapshotsTest-872762512-project] [instance: 9cfb60cb-011e-4537-9f28-55ea7d6dfc13] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 15 09:32:50 user nova-compute[75122]: ERROR nova.virt.libvirt.driver [instance: 9cfb60cb-011e-4537-9f28-55ea7d6dfc13] Traceback (most recent call last):
Nov 15 09:32:50 user nova-compute[75122]: ERROR nova.virt.libvirt.driver [instance: 9cfb60cb-011e-4537-9f28-55ea7d6dfc13]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 15 09:32:50 user nova-compute[75122]: ERROR nova.virt.libvirt.driver [instance: 9cfb60cb-011e-4537-9f28-55ea7d6dfc13]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 15 09:32:50 user nova-compute[75122]: ERROR nova.virt.libvirt.driver [instance: 9cfb60cb-011e-4537-9f28-55ea7d6dfc13]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 15 09:32:50 user nova-compute[75122]: ERROR nova.virt.libvirt.driver [instance: 9cfb60cb-011e-4537-9f28-55ea7d6dfc13]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 15 09:32:50 user nova-compute[75122]: ERROR nova.virt.libvirt.driver [instance: 9cfb60cb-011e-4537-9f28-55ea7d6dfc13]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 15 09:32:50 user nova-compute[75122]: ERROR nova.virt.libvirt.driver [instance: 9cfb60cb-011e-4537-9f28-55ea7d6dfc13]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 15 09:32:50 user nova-compute[75122]: ERROR nova.virt.libvirt.driver [instance: 9cfb60cb-011e-4537-9f28-55ea7d6dfc13]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 15 09:32:50 user nova-compute[75122]: ERROR nova.virt.libvirt.driver [instance: 9cfb60cb-011e-4537-9f28-55ea7d6dfc13]     rv = execute(f, *args, **kwargs)
Nov 15 09:32:50 user nova-compute[75122]: ERROR nova.virt.libvirt.driver [instance: 9cfb60cb-011e-4537-9f28-55ea7d6dfc13]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 15 09:32:50 user nova-compute[75122]: ERROR nova.virt.libvirt.driver [instance: 9cfb60cb-011e-4537-9f28-55ea7d6dfc13]     six.reraise(c, e, tb)
Nov 15 09:32:50 user nova-compute[75122]: ERROR nova.virt.libvirt.driver [instance: 9cfb60cb-011e-4537-9f28-55ea7d6dfc13]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 15 09:32:50 user nova-compute[75122]: ERROR nova.virt.libvirt.driver [instance: 9cfb60cb-011e-4537-9f28-55ea7d6dfc13]     raise value
Nov 15 09:32:50 user nova-compute[75122]: ERROR nova.virt.libvirt.driver [instance: 9cfb60cb-011e-4537-9f28-55ea7d6dfc13]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 15 09:32:50 user nova-compute[75122]: ERROR nova.virt.libvirt.driver [instance: 9cfb60cb-011e-4537-9f28-55ea7d6dfc13]     rv = meth(*args, **kwargs)
Nov 15 09:32:50 user nova-compute[75122]: ERROR nova.virt.libvirt.driver [instance: 9cfb60cb-011e-4537-9f28-55ea7d6dfc13]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 15 09:32:50 user nova-compute[75122]: ERROR nova.virt.libvirt.driver [instance: 9cfb60cb-011e-4537-9f28-55ea7d6dfc13]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 15 09:32:50 user nova-compute[75122]: ERROR nova.virt.libvirt.driver [instance: 9cfb60cb-011e-4537-9f28-55ea7d6dfc13] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 15 09:32:50 user nova-compute[75122]: ERROR nova.virt.libvirt.driver [instance: 9cfb60cb-011e-4537-9f28-55ea7d6dfc13] 
Nov 15 09:32:50 user nova-compute[75122]: ERROR nova.virt.libvirt.driver [None req-96da443c-bba7-4693-9a9a-21086d23353f tempest-VolumesAssistedSnapshotsTest-872762512 tempest-VolumesAssistedSnapshotsTest-872762512-project] [instance: 9cfb60cb-011e-4537-9f28-55ea7d6dfc13] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 15 09:32:50 user nova-compute[75122]: ERROR nova.virt.libvirt.driver [instance: 9cfb60cb-011e-4537-9f28-55ea7d6dfc13] Traceback (most recent call last):
Nov 15 09:32:50 user nova-compute[75122]: ERROR nova.virt.libvirt.driver [instance: 9cfb60cb-011e-4537-9f28-55ea7d6dfc13]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 15 09:32:50 user nova-compute[75122]: ERROR nova.virt.libvirt.driver [instance: 9cfb60cb-011e-4537-9f28-55ea7d6dfc13]     self._volume_snapshot_create(context, instance, guest,
Nov 15 09:32:50 user nova-compute[75122]: ERROR nova.virt.libvirt.driver [instance: 9cfb60cb-011e-4537-9f28-55ea7d6dfc13]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 15 09:32:50 user nova-compute[75122]: ERROR nova.virt.libvirt.driver [instance: 9cfb60cb-011e-4537-9f28-55ea7d6dfc13]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 15 09:32:50 user nova-compute[75122]: ERROR nova.virt.libvirt.driver [instance: 9cfb60cb-011e-4537-9f28-55ea7d6dfc13]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 15 09:32:50 user nova-compute[75122]: ERROR nova.virt.libvirt.driver [instance: 9cfb60cb-011e-4537-9f28-55ea7d6dfc13]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 15 09:32:50 user nova-compute[75122]: ERROR nova.virt.libvirt.driver [instance: 9cfb60cb-011e-4537-9f28-55ea7d6dfc13]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 15 09:32:50 user nova-compute[75122]: ERROR nova.virt.libvirt.driver [instance: 9cfb60cb-011e-4537-9f28-55ea7d6dfc13]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 15 09:32:50 user nova-compute[75122]: ERROR nova.virt.libvirt.driver [instance: 9cfb60cb-011e-4537-9f28-55ea7d6dfc13]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 15 09:32:50 user nova-compute[75122]: ERROR nova.virt.libvirt.driver [instance: 9cfb60cb-011e-4537-9f28-55ea7d6dfc13]     rv = execute(f, *args, **kwargs)
Nov 15 09:32:50 user nova-compute[75122]: ERROR nova.virt.libvirt.driver [instance: 9cfb60cb-011e-4537-9f28-55ea7d6dfc13]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 15 09:32:50 user nova-compute[75122]: ERROR nova.virt.libvirt.driver [instance: 9cfb60cb-011e-4537-9f28-55ea7d6dfc13]     six.reraise(c, e, tb)
Nov 15 09:32:50 user nova-compute[75122]: ERROR nova.virt.libvirt.driver [instance: 9cfb60cb-011e-4537-9f28-55ea7d6dfc13]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 15 09:32:50 user nova-compute[75122]: ERROR nova.virt.libvirt.driver [instance: 9cfb60cb-011e-4537-9f28-55ea7d6dfc13]     raise value
Nov 15 09:32:50 user nova-compute[75122]: ERROR nova.virt.libvirt.driver [instance: 9cfb60cb-011e-4537-9f28-55ea7d6dfc13]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 15 09:32:50 user nova-compute[75122]: ERROR nova.virt.libvirt.driver [instance: 9cfb60cb-011e-4537-9f28-55ea7d6dfc13]     rv = meth(*args, **kwargs)
Nov 15 09:32:50 user nova-compute[75122]: ERROR nova.virt.libvirt.driver [instance: 9cfb60cb-011e-4537-9f28-55ea7d6dfc13]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 15 09:32:50 user nova-compute[75122]: ERROR nova.virt.libvirt.driver [instance: 9cfb60cb-011e-4537-9f28-55ea7d6dfc13]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 15 09:32:50 user nova-compute[75122]: ERROR nova.virt.libvirt.driver [instance: 9cfb60cb-011e-4537-9f28-55ea7d6dfc13] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 15 09:32:50 user nova-compute[75122]: ERROR nova.virt.libvirt.driver [instance: 9cfb60cb-011e-4537-9f28-55ea7d6dfc13] 
Nov 15 09:32:50 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:32:50 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:32:50 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[2acc5ace-1dc8-4564-a203-24dd7f75dff7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6b67b7d3-ab4f-4cc4-b9b8-906eac8491e4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5cb8eb00-0379-40d5-972c-9565fe412df4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0796957f-5a19-4fe2-acb8-f3568399150a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:085fd119-574c-4b24-bf7c-8076479d01c3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:32:50 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e3a86ed-e28a-4eb6-b5cb-783706a9ed20 tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 09:32:50 user nova-compute[75122]: No targets found.
Nov 15 09:32:50 user nova-compute[75122]: iSNS:
Nov 15 09:32:50 user nova-compute[75122]: No targets found.
Nov 15 09:32:50 user nova-compute[75122]: STATIC:
Nov 15 09:32:50 user nova-compute[75122]: Target: iqn.2010-10.org.openstack:6b67b7d3-ab4f-4cc4-b9b8-906eac8491e4
Nov 15 09:32:50 user nova-compute[75122]:         Portal: 172.16.0.220:3260,-1
Nov 15 09:32:50 user nova-compute[75122]:                 Iface Name: default
Nov 15 09:32:50 user nova-compute[75122]: Target: iqn.2010-10.org.openstack:5cb8eb00-0379-40d5-972c-9565fe412df4
Nov 15 09:32:50 user nova-compute[75122]:         Portal: 172.16.0.220:3260,-1
Nov 15 09:32:50 user nova-compute[75122]:                 Iface Name: default
Nov 15 09:32:50 user nova-compute[75122]: Target: iqn.2010-10.org.openstack:0796957f-5a19-4fe2-acb8-f3568399150a
Nov 15 09:32:50 user nova-compute[75122]:         Portal: 172.16.0.220:3260,-1
Nov 15 09:32:50 user nova-compute[75122]:                 Iface Name: default
Nov 15 09:32:50 user nova-compute[75122]: Target: iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e
Nov 15 09:32:50 user nova-compute[75122]:         Portal: 172.16.0.220:3260,-1
Nov 15 09:32:50 user nova-compute[75122]:                 Iface Name: default
Nov 15 09:32:50 user nova-compute[75122]: Target: iqn.2010-10.org.openstack:085fd119-574c-4b24-bf7c-8076479d01c3
Nov 15 09:32:50 user nova-compute[75122]:         Portal: 172.16.0.220:3260,-1
Nov 15 09:32:50 user nova-compute[75122]:                 Iface Name: default
Nov 15 09:32:50 user nova-compute[75122]: FIRMWARE:
Nov 15 09:32:50 user nova-compute[75122]: No targets found.
Nov 15 09:32:50 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 09:32:50 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e3a86ed-e28a-4eb6-b5cb-783706a9ed20 tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 09:32:50 user nova-compute[75122]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 09:32:50 user nova-compute[75122]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75122) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 09:32:50 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e3a86ed-e28a-4eb6-b5cb-783706a9ed20 tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6b67b7d3-ab4f-4cc4-b9b8-906eac8491e4', 0)] {{(pid=75122) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 09:32:50 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-c25f57a1-c799-4d4f-be75-fe77b06c1ff2 tempest-VolumesAssistedSnapshotsTest-872762512 tempest-VolumesAssistedSnapshotsTest-872762512-project] [instance: 9cfb60cb-011e-4537-9f28-55ea7d6dfc13] volume_snapshot_delete: delete_info: {'volume_id': '085fd119-574c-4b24-bf7c-8076479d01c3'} {{(pid=75122) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3677}}
Nov 15 09:32:50 user nova-compute[75122]: ERROR nova.virt.libvirt.driver [None req-c25f57a1-c799-4d4f-be75-fe77b06c1ff2 tempest-VolumesAssistedSnapshotsTest-872762512 tempest-VolumesAssistedSnapshotsTest-872762512-project] [instance: 9cfb60cb-011e-4537-9f28-55ea7d6dfc13] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Nov 15 09:32:50 user nova-compute[75122]: ERROR nova.virt.libvirt.driver [instance: 9cfb60cb-011e-4537-9f28-55ea7d6dfc13] Traceback (most recent call last):
Nov 15 09:32:50 user nova-compute[75122]: ERROR nova.virt.libvirt.driver [instance: 9cfb60cb-011e-4537-9f28-55ea7d6dfc13]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 15 09:32:50 user nova-compute[75122]: ERROR nova.virt.libvirt.driver [instance: 9cfb60cb-011e-4537-9f28-55ea7d6dfc13]     self._volume_snapshot_delete(context, instance, volume_id,
Nov 15 09:32:50 user nova-compute[75122]: ERROR nova.virt.libvirt.driver [instance: 9cfb60cb-011e-4537-9f28-55ea7d6dfc13]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 15 09:32:50 user nova-compute[75122]: ERROR nova.virt.libvirt.driver [instance: 9cfb60cb-011e-4537-9f28-55ea7d6dfc13]     if delete_info['type'] != 'qcow2':
Nov 15 09:32:50 user nova-compute[75122]: ERROR nova.virt.libvirt.driver [instance: 9cfb60cb-011e-4537-9f28-55ea7d6dfc13] KeyError: 'type'
Nov 15 09:32:50 user nova-compute[75122]: ERROR nova.virt.libvirt.driver [instance: 9cfb60cb-011e-4537-9f28-55ea7d6dfc13] 
Nov 15 09:32:50 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:32:50 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:32:50 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[b20e33ad-63e3-4847-bf7f-b34608fb9964]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0796957f-5a19-4fe2-acb8-f3568399150a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:085fd119-574c-4b24-bf7c-8076479d01c3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5cb8eb00-0379-40d5-972c-9565fe412df4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6b67b7d3-ab4f-4cc4-b9b8-906eac8491e4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:32:50 user nova-compute[75122]: ERROR nova.virt.libvirt.driver [None req-96da443c-bba7-4693-9a9a-21086d23353f tempest-VolumesAssistedSnapshotsTest-872762512 tempest-VolumesAssistedSnapshotsTest-872762512-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot 080b2dfd-b319-4bd5-b8c6-dfa4d2dfb9bf could not be found.
Nov 15 09:32:50 user nova-compute[75122]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 15 09:32:50 user nova-compute[75122]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 15 09:32:50 user nova-compute[75122]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Nov 15 09:32:50 user nova-compute[75122]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 15 09:32:50 user nova-compute[75122]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 15 09:32:50 user nova-compute[75122]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 15 09:32:50 user nova-compute[75122]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 15 09:32:50 user nova-compute[75122]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 15 09:32:50 user nova-compute[75122]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 15 09:32:50 user nova-compute[75122]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 15 09:32:50 user nova-compute[75122]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Nov 15 09:32:50 user nova-compute[75122]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 15 09:32:50 user nova-compute[75122]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Nov 15 09:32:50 user nova-compute[75122]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 15 09:32:50 user nova-compute[75122]: ERROR nova.virt.libvirt.driver     raise value
Nov 15 09:32:50 user nova-compute[75122]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 15 09:32:50 user nova-compute[75122]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Nov 15 09:32:50 user nova-compute[75122]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 15 09:32:50 user nova-compute[75122]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 15 09:32:50 user nova-compute[75122]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 15 09:32:50 user nova-compute[75122]: ERROR nova.virt.libvirt.driver 
Nov 15 09:32:50 user nova-compute[75122]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 15 09:32:50 user nova-compute[75122]: ERROR nova.virt.libvirt.driver 
Nov 15 09:32:50 user nova-compute[75122]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 15 09:32:50 user nova-compute[75122]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 15 09:32:50 user nova-compute[75122]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 15 09:32:50 user nova-compute[75122]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 15 09:32:50 user nova-compute[75122]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 15 09:32:50 user nova-compute[75122]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 15 09:32:50 user nova-compute[75122]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 15 09:32:50 user nova-compute[75122]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 15 09:32:50 user nova-compute[75122]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 15 09:32:50 user nova-compute[75122]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 15 09:32:50 user nova-compute[75122]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 15 09:32:50 user nova-compute[75122]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 15 09:32:50 user nova-compute[75122]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 15 09:32:50 user nova-compute[75122]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 15 09:32:50 user nova-compute[75122]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 15 09:32:50 user nova-compute[75122]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot 080b2dfd-b319-4bd5-b8c6-dfa4d2dfb9bf could not be found. (HTTP 404) (Request-ID: req-9181fb94-24b7-47b1-8165-4077c4e8365c)
Nov 15 09:32:50 user nova-compute[75122]: ERROR nova.virt.libvirt.driver 
Nov 15 09:32:50 user nova-compute[75122]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 15 09:32:50 user nova-compute[75122]: ERROR nova.virt.libvirt.driver 
Nov 15 09:32:50 user nova-compute[75122]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 15 09:32:50 user nova-compute[75122]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 15 09:32:50 user nova-compute[75122]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 15 09:32:50 user nova-compute[75122]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 15 09:32:50 user nova-compute[75122]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 15 09:32:50 user nova-compute[75122]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 15 09:32:50 user nova-compute[75122]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 15 09:32:50 user nova-compute[75122]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 15 09:32:50 user nova-compute[75122]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 15 09:32:50 user nova-compute[75122]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 15 09:32:50 user nova-compute[75122]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 15 09:32:50 user nova-compute[75122]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 15 09:32:50 user nova-compute[75122]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 15 09:32:50 user nova-compute[75122]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 15 09:32:50 user nova-compute[75122]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 15 09:32:50 user nova-compute[75122]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 15 09:32:50 user nova-compute[75122]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 15 09:32:50 user nova-compute[75122]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 15 09:32:50 user nova-compute[75122]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 15 09:32:50 user nova-compute[75122]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 15 09:32:50 user nova-compute[75122]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 15 09:32:50 user nova-compute[75122]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 15 09:32:50 user nova-compute[75122]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 15 09:32:50 user nova-compute[75122]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot 080b2dfd-b319-4bd5-b8c6-dfa4d2dfb9bf could not be found.
Nov 15 09:32:50 user nova-compute[75122]: ERROR nova.virt.libvirt.driver 
Nov 15 09:32:50 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:32:50 user nova-compute[75122]: ERROR nova.virt.libvirt.driver [None req-c25f57a1-c799-4d4f-be75-fe77b06c1ff2 tempest-VolumesAssistedSnapshotsTest-872762512 tempest-VolumesAssistedSnapshotsTest-872762512-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 15 09:32:50 user nova-compute[75122]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 15 09:32:50 user nova-compute[75122]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 15 09:32:50 user nova-compute[75122]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Nov 15 09:32:50 user nova-compute[75122]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 15 09:32:50 user nova-compute[75122]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Nov 15 09:32:50 user nova-compute[75122]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Nov 15 09:32:50 user nova-compute[75122]: ERROR nova.virt.libvirt.driver 
Nov 15 09:32:50 user nova-compute[75122]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 15 09:32:50 user nova-compute[75122]: ERROR nova.virt.libvirt.driver 
Nov 15 09:32:50 user nova-compute[75122]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 15 09:32:50 user nova-compute[75122]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 15 09:32:50 user nova-compute[75122]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 15 09:32:50 user nova-compute[75122]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 15 09:32:50 user nova-compute[75122]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 15 09:32:50 user nova-compute[75122]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 15 09:32:50 user nova-compute[75122]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 15 09:32:50 user nova-compute[75122]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 15 09:32:50 user nova-compute[75122]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 15 09:32:50 user nova-compute[75122]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 15 09:32:50 user nova-compute[75122]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 15 09:32:50 user nova-compute[75122]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 15 09:32:50 user nova-compute[75122]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 15 09:32:50 user nova-compute[75122]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 15 09:32:50 user nova-compute[75122]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 15 09:32:50 user nova-compute[75122]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-1c48fc86-1e75-44cc-9d47-2a2d1567067d)
Nov 15 09:32:50 user nova-compute[75122]: ERROR nova.virt.libvirt.driver 
Nov 15 09:32:50 user nova-compute[75122]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 15 09:32:50 user nova-compute[75122]: ERROR nova.virt.libvirt.driver 
Nov 15 09:32:50 user nova-compute[75122]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 15 09:32:50 user nova-compute[75122]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 15 09:32:50 user nova-compute[75122]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 15 09:32:50 user nova-compute[75122]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 15 09:32:50 user nova-compute[75122]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 15 09:32:50 user nova-compute[75122]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 15 09:32:50 user nova-compute[75122]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 15 09:32:50 user nova-compute[75122]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 15 09:32:50 user nova-compute[75122]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 15 09:32:50 user nova-compute[75122]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 15 09:32:50 user nova-compute[75122]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 15 09:32:50 user nova-compute[75122]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 15 09:32:50 user nova-compute[75122]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 15 09:32:50 user nova-compute[75122]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 15 09:32:50 user nova-compute[75122]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 15 09:32:50 user nova-compute[75122]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 15 09:32:50 user nova-compute[75122]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 15 09:32:50 user nova-compute[75122]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 15 09:32:50 user nova-compute[75122]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 15 09:32:50 user nova-compute[75122]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 15 09:32:50 user nova-compute[75122]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 15 09:32:50 user nova-compute[75122]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 15 09:32:50 user nova-compute[75122]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 15 09:32:50 user nova-compute[75122]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 15 09:32:50 user nova-compute[75122]: ERROR nova.virt.libvirt.driver 
Nov 15 09:32:50 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:32:50 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9deb22b-f232-4ae2-bc3a-b697c470c334]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cb8eb00-0379-40d5-972c-9565fe412df4 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:085fd119-574c-4b24-bf7c-8076479d01c3 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b67b7d3-ab4f-4cc4-b9b8-906eac8491e4 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0796957f-5a19-4fe2-acb8-f3568399150a (non-flash)\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:32:50 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e3a86ed-e28a-4eb6-b5cb-783706a9ed20 tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cb8eb00-0379-40d5-972c-9565fe412df4 (non-flash)
Nov 15 09:32:50 user nova-compute[75122]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:085fd119-574c-4b24-bf7c-8076479d01c3 (non-flash)
Nov 15 09:32:50 user nova-compute[75122]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e (non-flash)
Nov 15 09:32:50 user nova-compute[75122]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b67b7d3-ab4f-4cc4-b9b8-906eac8491e4 (non-flash)
Nov 15 09:32:50 user nova-compute[75122]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0796957f-5a19-4fe2-acb8-f3568399150a (non-flash)
Nov 15 09:32:50 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 09:32:50 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e3a86ed-e28a-4eb6-b5cb-783706a9ed20 tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cb8eb00-0379-40d5-972c-9565fe412df4 (non-flash)
Nov 15 09:32:50 user nova-compute[75122]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:085fd119-574c-4b24-bf7c-8076479d01c3 (non-flash)
Nov 15 09:32:50 user nova-compute[75122]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e (non-flash)
Nov 15 09:32:50 user nova-compute[75122]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b67b7d3-ab4f-4cc4-b9b8-906eac8491e4 (non-flash)
Nov 15 09:32:50 user nova-compute[75122]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0796957f-5a19-4fe2-acb8-f3568399150a (non-flash)
Nov 15 09:32:50 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 09:32:50 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e3a86ed-e28a-4eb6-b5cb-783706a9ed20 tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ffa0403a560>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6b67b7d3-ab4f-4cc4-b9b8-906eac8491e4'): ({'sdd'}, set())}) {{(pid=75122) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 09:32:50 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-4e3a86ed-e28a-4eb6-b5cb-783706a9ed20 tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] Removing single pathed devices sdd {{(pid=75122) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 09:32:50 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:32:50 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:32:50 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aacfc92-cb0b-4e8b-9851-9494319d5820]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:32:50 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:32:50 user nova-compute[75122]: ERROR oslo_messaging.rpc.server [None req-96da443c-bba7-4693-9a9a-21086d23353f tempest-VolumesAssistedSnapshotsTest-872762512 tempest-VolumesAssistedSnapshotsTest-872762512-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 15 09:32:50 user nova-compute[75122]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 15 09:32:50 user nova-compute[75122]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 15 09:32:50 user nova-compute[75122]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 15 09:32:50 user nova-compute[75122]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 15 09:32:50 user nova-compute[75122]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 15 09:32:50 user nova-compute[75122]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 15 09:32:50 user nova-compute[75122]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 15 09:32:50 user nova-compute[75122]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 15 09:32:50 user nova-compute[75122]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 15 09:32:50 user nova-compute[75122]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 15 09:32:50 user nova-compute[75122]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 15 09:32:50 user nova-compute[75122]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 15 09:32:50 user nova-compute[75122]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 15 09:32:50 user nova-compute[75122]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 15 09:32:50 user nova-compute[75122]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 15 09:32:50 user nova-compute[75122]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 15 09:32:50 user nova-compute[75122]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 15 09:32:50 user nova-compute[75122]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4505, in volume_snapshot_create
Nov 15 09:32:50 user nova-compute[75122]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Nov 15 09:32:50 user nova-compute[75122]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3597, in volume_snapshot_create
Nov 15 09:32:50 user nova-compute[75122]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 15 09:32:50 user nova-compute[75122]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 15 09:32:50 user nova-compute[75122]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 15 09:32:50 user nova-compute[75122]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 15 09:32:50 user nova-compute[75122]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 15 09:32:50 user nova-compute[75122]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 15 09:32:50 user nova-compute[75122]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Nov 15 09:32:50 user nova-compute[75122]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 15 09:32:50 user nova-compute[75122]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 15 09:32:50 user nova-compute[75122]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 15 09:32:50 user nova-compute[75122]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 15 09:32:50 user nova-compute[75122]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 15 09:32:50 user nova-compute[75122]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 15 09:32:50 user nova-compute[75122]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 15 09:32:50 user nova-compute[75122]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Nov 15 09:32:50 user nova-compute[75122]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 15 09:32:50 user nova-compute[75122]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Nov 15 09:32:50 user nova-compute[75122]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 15 09:32:50 user nova-compute[75122]: ERROR oslo_messaging.rpc.server     raise value
Nov 15 09:32:50 user nova-compute[75122]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 15 09:32:50 user nova-compute[75122]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Nov 15 09:32:50 user nova-compute[75122]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 15 09:32:50 user nova-compute[75122]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 15 09:32:50 user nova-compute[75122]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 15 09:32:50 user nova-compute[75122]: ERROR oslo_messaging.rpc.server 
Nov 15 09:32:50 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.030s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:32:50 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[20f4c7ec-8066-4a27-937e-8f875d42c74b]: (4, ('ok\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:32:50 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-4e3a86ed-e28a-4eb6-b5cb-783706a9ed20 tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] Flushing IO for device /dev/sdd {{(pid=75122) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 09:32:50 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:32:50 user nova-compute[75122]: ERROR oslo_messaging.rpc.server [None req-c25f57a1-c799-4d4f-be75-fe77b06c1ff2 tempest-VolumesAssistedSnapshotsTest-872762512 tempest-VolumesAssistedSnapshotsTest-872762512-project] Exception during message handling: KeyError: 'type'
Nov 15 09:32:50 user nova-compute[75122]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 15 09:32:50 user nova-compute[75122]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 15 09:32:50 user nova-compute[75122]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 15 09:32:50 user nova-compute[75122]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 15 09:32:50 user nova-compute[75122]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 15 09:32:50 user nova-compute[75122]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 15 09:32:50 user nova-compute[75122]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 15 09:32:50 user nova-compute[75122]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 15 09:32:50 user nova-compute[75122]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 15 09:32:50 user nova-compute[75122]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 15 09:32:50 user nova-compute[75122]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 15 09:32:50 user nova-compute[75122]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 15 09:32:50 user nova-compute[75122]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 15 09:32:50 user nova-compute[75122]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 15 09:32:50 user nova-compute[75122]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 15 09:32:50 user nova-compute[75122]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 15 09:32:50 user nova-compute[75122]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 15 09:32:50 user nova-compute[75122]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4517, in volume_snapshot_delete
Nov 15 09:32:50 user nova-compute[75122]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Nov 15 09:32:50 user nova-compute[75122]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3853, in volume_snapshot_delete
Nov 15 09:32:50 user nova-compute[75122]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 15 09:32:50 user nova-compute[75122]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 15 09:32:50 user nova-compute[75122]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 15 09:32:50 user nova-compute[75122]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 15 09:32:50 user nova-compute[75122]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 15 09:32:50 user nova-compute[75122]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 15 09:32:50 user nova-compute[75122]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Nov 15 09:32:50 user nova-compute[75122]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 15 09:32:50 user nova-compute[75122]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Nov 15 09:32:50 user nova-compute[75122]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Nov 15 09:32:50 user nova-compute[75122]: ERROR oslo_messaging.rpc.server 
Nov 15 09:32:50 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.017s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:32:50 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aa78f39-68da-4183-9b60-bcc1d9ada27c]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:32:50 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-4e3a86ed-e28a-4eb6-b5cb-783706a9ed20 tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75122) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 09:32:50 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:32:50 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.041s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:32:50 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[641d317f-503d-4b9a-b505-ea0a558dc35f]: (4, ('1', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:32:50 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-4e3a86ed-e28a-4eb6-b5cb-783706a9ed20 tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75122) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 09:32:50 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-4e3a86ed-e28a-4eb6-b5cb-783706a9ed20 tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] SCSI volumes sdd have been removed. {{(pid=75122) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 09:32:50 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e3a86ed-e28a-4eb6-b5cb-783706a9ed20 tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6b67b7d3-ab4f-4cc4-b9b8-906eac8491e4')] {{(pid=75122) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 09:32:50 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b67b7d3-ab4f-4cc4-b9b8-906eac8491e4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:32:50 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b67b7d3-ab4f-4cc4-b9b8-906eac8491e4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:32:50 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a049fd7-45f7-4dbd-8181-990754158498]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:32:50 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e3a86ed-e28a-4eb6-b5cb-783706a9ed20 tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:32:50 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b67b7d3-ab4f-4cc4-b9b8-906eac8491e4 -p 172.16.0.220:3260 --logout {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:32:50 user nova-compute[75122]: DEBUG nova.virt.libvirt.guest [None req-87b8d899-6ab9-4afd-bfa5-c093e3bcdb6d tempest-TestVolumeSwap-69301659 tempest-TestVolumeSwap-69301659-project-admin] COPY block job progress, current cursor: 911212544 final cursor: 1073741824 {{(pid=75122) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 09:32:50 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b67b7d3-ab4f-4cc4-b9b8-906eac8491e4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:32:50 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[679aa2af-a756-4cf2-9424-5edb05c95969]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:6b67b7d3-ab4f-4cc4-b9b8-906eac8491e4, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:6b67b7d3-ab4f-4cc4-b9b8-906eac8491e4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:32:50 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e3a86ed-e28a-4eb6-b5cb-783706a9ed20 tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:6b67b7d3-ab4f-4cc4-b9b8-906eac8491e4, portal: 172.16.0.220,3260]
Nov 15 09:32:50 user nova-compute[75122]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:6b67b7d3-ab4f-4cc4-b9b8-906eac8491e4, portal: 172.16.0.220,3260] successful.
Nov 15 09:32:50 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:32:50 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b67b7d3-ab4f-4cc4-b9b8-906eac8491e4 -p 172.16.0.220:3260 --op delete {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:32:50 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b67b7d3-ab4f-4cc4-b9b8-906eac8491e4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:32:50 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9ba08c1-b9ee-40ba-8118-ab65d0675284]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:32:50 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e3a86ed-e28a-4eb6-b5cb-783706a9ed20 tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:32:50 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-4e3a86ed-e28a-4eb6-b5cb-783706a9ed20 tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.518s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 09:32:50 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e3a86ed-e28a-4eb6-b5cb-783706a9ed20 tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] <== disconnect_volume: return (520ms) None {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 09:32:50 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e3a86ed-e28a-4eb6-b5cb-783706a9ed20 tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] [instance: e0f32160-7130-4b9c-aa9c-84123f3a6b32] Disconnected iSCSI Volume {{(pid=75122) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 09:32:50 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-96e0ba80-4473-42a6-9a81-dc1917e741bc tempest-VolumesAssistedSnapshotsTest-336030675 tempest-VolumesAssistedSnapshotsTest-336030675-project-admin] Acquiring lock "9cfb60cb-011e-4537-9f28-55ea7d6dfc13" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:32:50 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-96e0ba80-4473-42a6-9a81-dc1917e741bc tempest-VolumesAssistedSnapshotsTest-336030675 tempest-VolumesAssistedSnapshotsTest-336030675-project-admin] Lock "9cfb60cb-011e-4537-9f28-55ea7d6dfc13" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:32:50 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-c5d60b30-d10a-4c86-8062-45f7ba1ef412 tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] Acquiring lock "bcb58c79-f6b3-44d9-a80f-1a4cf580379f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:32:50 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-c5d60b30-d10a-4c86-8062-45f7ba1ef412 tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] Lock "bcb58c79-f6b3-44d9-a80f-1a4cf580379f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:32:50 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-c5d60b30-d10a-4c86-8062-45f7ba1ef412 tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] Acquiring lock "bcb58c79-f6b3-44d9-a80f-1a4cf580379f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:32:50 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-c5d60b30-d10a-4c86-8062-45f7ba1ef412 tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] Lock "bcb58c79-f6b3-44d9-a80f-1a4cf580379f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:32:50 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-c5d60b30-d10a-4c86-8062-45f7ba1ef412 tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] Lock "bcb58c79-f6b3-44d9-a80f-1a4cf580379f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:32:50 user nova-compute[75122]: INFO nova.compute.manager [None req-c5d60b30-d10a-4c86-8062-45f7ba1ef412 tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] [instance: bcb58c79-f6b3-44d9-a80f-1a4cf580379f] Terminating instance
Nov 15 09:32:50 user nova-compute[75122]: DEBUG nova.compute.manager [None req-c5d60b30-d10a-4c86-8062-45f7ba1ef412 tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] [instance: bcb58c79-f6b3-44d9-a80f-1a4cf580379f] Start destroying the instance on the hypervisor. {{(pid=75122) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 09:32:50 user nova-compute[75122]: INFO nova.compute.manager [None req-96e0ba80-4473-42a6-9a81-dc1917e741bc tempest-VolumesAssistedSnapshotsTest-336030675 tempest-VolumesAssistedSnapshotsTest-336030675-project-admin] [instance: 9cfb60cb-011e-4537-9f28-55ea7d6dfc13] Detaching volume 085fd119-574c-4b24-bf7c-8076479d01c3
Nov 15 09:32:50 user nova-compute[75122]: INFO nova.virt.block_device [None req-96e0ba80-4473-42a6-9a81-dc1917e741bc tempest-VolumesAssistedSnapshotsTest-336030675 tempest-VolumesAssistedSnapshotsTest-336030675-project-admin] [instance: 9cfb60cb-011e-4537-9f28-55ea7d6dfc13] Attempting to driver detach volume 085fd119-574c-4b24-bf7c-8076479d01c3 from mountpoint /dev/vdb
Nov 15 09:32:50 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:32:50 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-96e0ba80-4473-42a6-9a81-dc1917e741bc tempest-VolumesAssistedSnapshotsTest-336030675 tempest-VolumesAssistedSnapshotsTest-336030675-project-admin] Attempting to detach device vdb from instance 9cfb60cb-011e-4537-9f28-55ea7d6dfc13 from the persistent domain config. {{(pid=75122) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 09:32:50 user nova-compute[75122]: DEBUG nova.virt.libvirt.guest [None req-96e0ba80-4473-42a6-9a81-dc1917e741bc tempest-VolumesAssistedSnapshotsTest-336030675 tempest-VolumesAssistedSnapshotsTest-336030675-project-admin] detach device xml: <disk type="block" device="disk">
Nov 15 09:32:50 user nova-compute[75122]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 09:32:50 user nova-compute[75122]:   <source dev="/dev/sdg"/>
Nov 15 09:32:50 user nova-compute[75122]:   <target dev="vdb" bus="virtio"/>
Nov 15 09:32:50 user nova-compute[75122]:   <serial>085fd119-574c-4b24-bf7c-8076479d01c3</serial>
Nov 15 09:32:50 user nova-compute[75122]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 09:32:50 user nova-compute[75122]: </disk>
Nov 15 09:32:50 user nova-compute[75122]:  {{(pid=75122) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 09:32:50 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-96e0ba80-4473-42a6-9a81-dc1917e741bc tempest-VolumesAssistedSnapshotsTest-336030675 tempest-VolumesAssistedSnapshotsTest-336030675-project-admin] Successfully detached device vdb from instance 9cfb60cb-011e-4537-9f28-55ea7d6dfc13 from the persistent domain config.
Nov 15 09:32:50 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-96e0ba80-4473-42a6-9a81-dc1917e741bc tempest-VolumesAssistedSnapshotsTest-336030675 tempest-VolumesAssistedSnapshotsTest-336030675-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9cfb60cb-011e-4537-9f28-55ea7d6dfc13 from the live domain config. {{(pid=75122) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 09:32:50 user nova-compute[75122]: DEBUG nova.virt.libvirt.guest [None req-96e0ba80-4473-42a6-9a81-dc1917e741bc tempest-VolumesAssistedSnapshotsTest-336030675 tempest-VolumesAssistedSnapshotsTest-336030675-project-admin] detach device xml: <disk type="block" device="disk">
Nov 15 09:32:50 user nova-compute[75122]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 09:32:50 user nova-compute[75122]:   <source dev="/dev/sdg"/>
Nov 15 09:32:50 user nova-compute[75122]:   <target dev="vdb" bus="virtio"/>
Nov 15 09:32:50 user nova-compute[75122]:   <serial>085fd119-574c-4b24-bf7c-8076479d01c3</serial>
Nov 15 09:32:50 user nova-compute[75122]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 09:32:50 user nova-compute[75122]: </disk>
Nov 15 09:32:50 user nova-compute[75122]:  {{(pid=75122) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 09:32:50 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:32:50 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:32:50 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:32:50 user nova-compute[75122]: DEBUG nova.virt.libvirt.guest [None req-87b8d899-6ab9-4afd-bfa5-c093e3bcdb6d tempest-TestVolumeSwap-69301659 tempest-TestVolumeSwap-69301659-project-admin] COPY block job progress, current cursor: 1058013184 final cursor: 1073741824 {{(pid=75122) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 09:32:50 user nova-compute[75122]: DEBUG nova.compute.manager [req-154425a8-67d3-4c87-9345-3d41b49b280e req-7f9605fe-e666-4692-a486-7bb2c87e4918 service nova] [instance: bcb58c79-f6b3-44d9-a80f-1a4cf580379f] Received event network-vif-unplugged-364a329a-8a90-43f6-9927-0c07dc1d6cbe {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:32:50 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-154425a8-67d3-4c87-9345-3d41b49b280e req-7f9605fe-e666-4692-a486-7bb2c87e4918 service nova] Acquiring lock "bcb58c79-f6b3-44d9-a80f-1a4cf580379f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:32:50 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-154425a8-67d3-4c87-9345-3d41b49b280e req-7f9605fe-e666-4692-a486-7bb2c87e4918 service nova] Lock "bcb58c79-f6b3-44d9-a80f-1a4cf580379f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:32:50 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-154425a8-67d3-4c87-9345-3d41b49b280e req-7f9605fe-e666-4692-a486-7bb2c87e4918 service nova] Lock "bcb58c79-f6b3-44d9-a80f-1a4cf580379f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:32:50 user nova-compute[75122]: DEBUG nova.compute.manager [req-154425a8-67d3-4c87-9345-3d41b49b280e req-7f9605fe-e666-4692-a486-7bb2c87e4918 service nova] [instance: bcb58c79-f6b3-44d9-a80f-1a4cf580379f] No waiting events found dispatching network-vif-unplugged-364a329a-8a90-43f6-9927-0c07dc1d6cbe {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:32:50 user nova-compute[75122]: DEBUG nova.compute.manager [req-154425a8-67d3-4c87-9345-3d41b49b280e req-7f9605fe-e666-4692-a486-7bb2c87e4918 service nova] [instance: bcb58c79-f6b3-44d9-a80f-1a4cf580379f] Received event network-vif-unplugged-364a329a-8a90-43f6-9927-0c07dc1d6cbe for instance with task_state deleting. {{(pid=75122) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 09:32:51 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-96e0ba80-4473-42a6-9a81-dc1917e741bc tempest-VolumesAssistedSnapshotsTest-336030675 tempest-VolumesAssistedSnapshotsTest-336030675-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9cfb60cb-011e-4537-9f28-55ea7d6dfc13 {{(pid=75122) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 09:32:51 user nova-compute[75122]: DEBUG nova.virt.libvirt.guest [None req-87b8d899-6ab9-4afd-bfa5-c093e3bcdb6d tempest-TestVolumeSwap-69301659 tempest-TestVolumeSwap-69301659-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=75122) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 09:32:51 user nova-compute[75122]: DEBUG nova.objects.instance [None req-4e3a86ed-e28a-4eb6-b5cb-783706a9ed20 tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] Lazy-loading 'flavor' on Instance uuid e0f32160-7130-4b9c-aa9c-84123f3a6b32 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:32:51 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-4e3a86ed-e28a-4eb6-b5cb-783706a9ed20 tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] Lock "e0f32160-7130-4b9c-aa9c-84123f3a6b32" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.357s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:32:51 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-87b8d899-6ab9-4afd-bfa5-c093e3bcdb6d tempest-TestVolumeSwap-69301659 tempest-TestVolumeSwap-69301659-project-admin] [instance: d24a189e-2de9-404e-b281-224c150a5bbf] calling os-brick to detach iSCSI Volume {{(pid=75122) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 09:32:51 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-87b8d899-6ab9-4afd-bfa5-c093e3bcdb6d tempest-TestVolumeSwap-69301659 tempest-TestVolumeSwap-69301659-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffa04060b80>, {'target_iqn': 'iqn.2010-10.org.openstack:0796957f-5a19-4fe2-acb8-f3568399150a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KPflkmYs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 09:32:51 user nova-compute[75122]: WARNING os_brick.initiator.connectors.base [None req-87b8d899-6ab9-4afd-bfa5-c093e3bcdb6d tempest-TestVolumeSwap-69301659 tempest-TestVolumeSwap-69301659-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 09:32:51 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-87b8d899-6ab9-4afd-bfa5-c093e3bcdb6d tempest-TestVolumeSwap-69301659 tempest-TestVolumeSwap-69301659-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 09:32:51 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-87b8d899-6ab9-4afd-bfa5-c093e3bcdb6d tempest-TestVolumeSwap-69301659 tempest-TestVolumeSwap-69301659-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 09:32:51 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:32:51 user nova-compute[75122]: INFO nova.virt.libvirt.driver [-] [instance: bcb58c79-f6b3-44d9-a80f-1a4cf580379f] Instance destroyed successfully.
Nov 15 09:32:51 user nova-compute[75122]: DEBUG nova.objects.instance [None req-c5d60b30-d10a-4c86-8062-45f7ba1ef412 tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] Lazy-loading 'resources' on Instance uuid bcb58c79-f6b3-44d9-a80f-1a4cf580379f {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:32:51 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-c5d60b30-d10a-4c86-8062-45f7ba1ef412 tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T09:30:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1969522198',display_name='tempest-AttachSCSIVolumeTestJSON-server-1969522198',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1969522198',id=4,image_ref='75853f1a-dd9a-4068-800e-7e935c28bad0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBANV6BO+yY0KWtP3r8GkA1x27UssuspIxpxVP+u7hAmnzu4GcPNf01/BZMqfxn7bzNFUkcFkO/PDv6HZ31XNDrjTRwkRbJPk54jlt1gUGyPyhkvdOaN1qrYPtb+zv7YDbA==',key_name='tempest-keypair-1727153420',keypairs=<?>,launch_index=0,launched_at=2023-11-15T09:30:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='81b94e91587545a59312e374914b4526',ramdisk_id='',reservation_id='r-m2a6ud81',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='75853f1a-dd9a-4068-800e-7e935c28bad0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-348091286',owner_user_name='tempest-AttachSCSIVolumeTestJSON-348091286-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T09:30:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='28f162a709924363b99b617bb7f3f190',uuid=bcb58c79-f6b3-44d9-a80f-1a4cf580379f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "364a329a-8a90-43f6-9927-0c07dc1d6cbe", "address": "fa:16:3e:aa:38:2f", "network": {"id": "d1bb497f-e1d4-4f70-9e5c-263b91c0b4ea", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-246917524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81b94e91587545a59312e374914b4526", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap364a329a-8a", "ovs_interfaceid": "364a329a-8a90-43f6-9927-0c07dc1d6cbe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 09:32:51 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-c5d60b30-d10a-4c86-8062-45f7ba1ef412 tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] Converting VIF {"id": "364a329a-8a90-43f6-9927-0c07dc1d6cbe", "address": "fa:16:3e:aa:38:2f", "network": {"id": "d1bb497f-e1d4-4f70-9e5c-263b91c0b4ea", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-246917524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81b94e91587545a59312e374914b4526", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap364a329a-8a", "ovs_interfaceid": "364a329a-8a90-43f6-9927-0c07dc1d6cbe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 09:32:51 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-c5d60b30-d10a-4c86-8062-45f7ba1ef412 tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:aa:38:2f,bridge_name='br-int',has_traffic_filtering=True,id=364a329a-8a90-43f6-9927-0c07dc1d6cbe,network=Network(d1bb497f-e1d4-4f70-9e5c-263b91c0b4ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap364a329a-8a') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 09:32:51 user nova-compute[75122]: DEBUG os_vif [None req-c5d60b30-d10a-4c86-8062-45f7ba1ef412 tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:aa:38:2f,bridge_name='br-int',has_traffic_filtering=True,id=364a329a-8a90-43f6-9927-0c07dc1d6cbe,network=Network(d1bb497f-e1d4-4f70-9e5c-263b91c0b4ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap364a329a-8a') {{(pid=75122) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 09:32:51 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:32:51 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[47d266bd-8285-46f9-a720-e16cc5f6862a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5cb8eb00-0379-40d5-972c-9565fe412df4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0796957f-5a19-4fe2-acb8-f3568399150a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:085fd119-574c-4b24-bf7c-8076479d01c3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:32:51 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-87b8d899-6ab9-4afd-bfa5-c093e3bcdb6d tempest-TestVolumeSwap-69301659 tempest-TestVolumeSwap-69301659-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 09:32:51 user nova-compute[75122]: No targets found.
Nov 15 09:32:51 user nova-compute[75122]: iSNS:
Nov 15 09:32:51 user nova-compute[75122]: No targets found.
Nov 15 09:32:51 user nova-compute[75122]: STATIC:
Nov 15 09:32:51 user nova-compute[75122]: Target: iqn.2010-10.org.openstack:5cb8eb00-0379-40d5-972c-9565fe412df4
Nov 15 09:32:51 user nova-compute[75122]:         Portal: 172.16.0.220:3260,-1
Nov 15 09:32:51 user nova-compute[75122]:                 Iface Name: default
Nov 15 09:32:51 user nova-compute[75122]: Target: iqn.2010-10.org.openstack:0796957f-5a19-4fe2-acb8-f3568399150a
Nov 15 09:32:51 user nova-compute[75122]:         Portal: 172.16.0.220:3260,-1
Nov 15 09:32:51 user nova-compute[75122]:                 Iface Name: default
Nov 15 09:32:51 user nova-compute[75122]: Target: iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e
Nov 15 09:32:51 user nova-compute[75122]:         Portal: 172.16.0.220:3260,-1
Nov 15 09:32:51 user nova-compute[75122]:                 Iface Name: default
Nov 15 09:32:51 user nova-compute[75122]: Target: iqn.2010-10.org.openstack:085fd119-574c-4b24-bf7c-8076479d01c3
Nov 15 09:32:51 user nova-compute[75122]:         Portal: 172.16.0.220:3260,-1
Nov 15 09:32:51 user nova-compute[75122]:                 Iface Name: default
Nov 15 09:32:51 user nova-compute[75122]: FIRMWARE:
Nov 15 09:32:51 user nova-compute[75122]: No targets found.
Nov 15 09:32:51 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 09:32:51 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-87b8d899-6ab9-4afd-bfa5-c093e3bcdb6d tempest-TestVolumeSwap-69301659 tempest-TestVolumeSwap-69301659-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 09:32:51 user nova-compute[75122]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 09:32:51 user nova-compute[75122]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75122) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 09:32:51 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-87b8d899-6ab9-4afd-bfa5-c093e3bcdb6d tempest-TestVolumeSwap-69301659 tempest-TestVolumeSwap-69301659-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0796957f-5a19-4fe2-acb8-f3568399150a', 0)] {{(pid=75122) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 09:32:51 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:32:51 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap364a329a-8a, bridge=br-int, if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:32:51 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:32:51 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:32:51 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:32:51 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:32:51 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9055668c-4041-46bb-b20b-b8b1050eea15) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:32:51 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:32:51 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:32:51 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:32:51 user nova-compute[75122]: INFO os_vif [None req-c5d60b30-d10a-4c86-8062-45f7ba1ef412 tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:aa:38:2f,bridge_name='br-int',has_traffic_filtering=True,id=364a329a-8a90-43f6-9927-0c07dc1d6cbe,network=Network(d1bb497f-e1d4-4f70-9e5c-263b91c0b4ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap364a329a-8a')
Nov 15 09:32:51 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-c5d60b30-d10a-4c86-8062-45f7ba1ef412 tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] [instance: bcb58c79-f6b3-44d9-a80f-1a4cf580379f] Deleting instance files /opt/stack/data/nova/instances/bcb58c79-f6b3-44d9-a80f-1a4cf580379f_del
Nov 15 09:32:51 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-c5d60b30-d10a-4c86-8062-45f7ba1ef412 tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] [instance: bcb58c79-f6b3-44d9-a80f-1a4cf580379f] Deletion of /opt/stack/data/nova/instances/bcb58c79-f6b3-44d9-a80f-1a4cf580379f_del complete
Nov 15 09:32:51 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ffe63b4-8b2e-42e6-83a2-c4515f700531]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0796957f-5a19-4fe2-acb8-f3568399150a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:085fd119-574c-4b24-bf7c-8076479d01c3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5cb8eb00-0379-40d5-972c-9565fe412df4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:32:51 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-de97beac-4671-46e9-856c-1c18c459c3a7 tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] Acquiring lock "interface-e0f32160-7130-4b9c-aa9c-84123f3a6b32-ce0d75c2-85b4-4e49-8d42-767b17493e53" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:32:51 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-de97beac-4671-46e9-856c-1c18c459c3a7 tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] Lock "interface-e0f32160-7130-4b9c-aa9c-84123f3a6b32-ce0d75c2-85b4-4e49-8d42-767b17493e53" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:32:51 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:32:51 user nova-compute[75122]: DEBUG nova.objects.instance [None req-de97beac-4671-46e9-856c-1c18c459c3a7 tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] Lazy-loading 'flavor' on Instance uuid e0f32160-7130-4b9c-aa9c-84123f3a6b32 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:32:51 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:32:51 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6ba4591-4214-4f4b-93bc-41114902dc18]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cb8eb00-0379-40d5-972c-9565fe412df4 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:085fd119-574c-4b24-bf7c-8076479d01c3 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0796957f-5a19-4fe2-acb8-f3568399150a (non-flash)\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:32:51 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-87b8d899-6ab9-4afd-bfa5-c093e3bcdb6d tempest-TestVolumeSwap-69301659 tempest-TestVolumeSwap-69301659-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cb8eb00-0379-40d5-972c-9565fe412df4 (non-flash)
Nov 15 09:32:51 user nova-compute[75122]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:085fd119-574c-4b24-bf7c-8076479d01c3 (non-flash)
Nov 15 09:32:51 user nova-compute[75122]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e (non-flash)
Nov 15 09:32:51 user nova-compute[75122]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0796957f-5a19-4fe2-acb8-f3568399150a (non-flash)
Nov 15 09:32:51 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 09:32:51 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-87b8d899-6ab9-4afd-bfa5-c093e3bcdb6d tempest-TestVolumeSwap-69301659 tempest-TestVolumeSwap-69301659-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cb8eb00-0379-40d5-972c-9565fe412df4 (non-flash)
Nov 15 09:32:51 user nova-compute[75122]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:085fd119-574c-4b24-bf7c-8076479d01c3 (non-flash)
Nov 15 09:32:51 user nova-compute[75122]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e (non-flash)
Nov 15 09:32:51 user nova-compute[75122]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0796957f-5a19-4fe2-acb8-f3568399150a (non-flash)
Nov 15 09:32:51 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 09:32:51 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-87b8d899-6ab9-4afd-bfa5-c093e3bcdb6d tempest-TestVolumeSwap-69301659 tempest-TestVolumeSwap-69301659-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff9e4581bd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0796957f-5a19-4fe2-acb8-f3568399150a'): ({'sde'}, set())}) {{(pid=75122) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 09:32:51 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-87b8d899-6ab9-4afd-bfa5-c093e3bcdb6d tempest-TestVolumeSwap-69301659 tempest-TestVolumeSwap-69301659-project-admin] Removing single pathed devices sde {{(pid=75122) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 09:32:51 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:32:51 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-de97beac-4671-46e9-856c-1c18c459c3a7 tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T09:30:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-650907307',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-650907307',id=5,image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEs+MsbbhvkEM+SFSEAT1XChvfwYG6LS4xClecFc1s5hPTjvnawfxaNFAntQJzNhhhBe9ISEtvpo31FTBvmrG/LNlyB/uvXRpPMaH35dzVkZDJmlCiGv/MxZIKKpRxaHLw==',key_name='tempest-keypair-2107215481',keypairs=<?>,launch_index=0,launched_at=2023-11-15T09:30:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6082a9c95d70462586e1f1195b43a383',ramdisk_id='',reservation_id='r-j04j8rw4',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-2027876138',owner_user_name='tempest-TaggedAttachmentsTest-2027876138-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T09:30:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d2529e19d29e4120b6e8ae75e16bb5b6',uuid=e0f32160-7130-4b9c-aa9c-84123f3a6b32,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ce0d75c2-85b4-4e49-8d42-767b17493e53", "address": "fa:16:3e:9e:53:27", "network": {"id": "517e7cda-b26b-4dca-9b2b-b8a52f1ef18b", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1110889298", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "6082a9c95d70462586e1f1195b43a383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce0d75c2-85", "ovs_interfaceid": "ce0d75c2-85b4-4e49-8d42-767b17493e53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75122) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 09:32:51 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-de97beac-4671-46e9-856c-1c18c459c3a7 tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] Converting VIF {"id": "ce0d75c2-85b4-4e49-8d42-767b17493e53", "address": "fa:16:3e:9e:53:27", "network": {"id": "517e7cda-b26b-4dca-9b2b-b8a52f1ef18b", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1110889298", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "6082a9c95d70462586e1f1195b43a383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce0d75c2-85", "ovs_interfaceid": "ce0d75c2-85b4-4e49-8d42-767b17493e53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 09:32:51 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-de97beac-4671-46e9-856c-1c18c459c3a7 tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:53:27,bridge_name='br-int',has_traffic_filtering=True,id=ce0d75c2-85b4-4e49-8d42-767b17493e53,network=Network(517e7cda-b26b-4dca-9b2b-b8a52f1ef18b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce0d75c2-85') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 09:32:51 user nova-compute[75122]: DEBUG nova.virt.libvirt.guest [None req-de97beac-4671-46e9-856c-1c18c459c3a7 tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:9e:53:27"/><model type="virtio"/><mtu size="1442"/><target dev="tapce0d75c2-85"/></interface> {{(pid=75122) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 15 09:32:51 user nova-compute[75122]: DEBUG nova.virt.libvirt.guest [None req-de97beac-4671-46e9-856c-1c18c459c3a7 tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:9e:53:27"/><model type="virtio"/><mtu size="1442"/><target dev="tapce0d75c2-85"/></interface> {{(pid=75122) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 15 09:32:51 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-de97beac-4671-46e9-856c-1c18c459c3a7 tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] Attempting to detach device tapce0d75c2-85 from instance e0f32160-7130-4b9c-aa9c-84123f3a6b32 from the persistent domain config. {{(pid=75122) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 09:32:51 user nova-compute[75122]: DEBUG nova.virt.libvirt.guest [None req-de97beac-4671-46e9-856c-1c18c459c3a7 tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] detach device xml: <interface type="ethernet">
Nov 15 09:32:51 user nova-compute[75122]:   <mac address="fa:16:3e:9e:53:27"/>
Nov 15 09:32:51 user nova-compute[75122]:   <model type="virtio"/>
Nov 15 09:32:51 user nova-compute[75122]:   <mtu size="1442"/>
Nov 15 09:32:51 user nova-compute[75122]:   <target dev="tapce0d75c2-85"/>
Nov 15 09:32:51 user nova-compute[75122]: </interface>
Nov 15 09:32:51 user nova-compute[75122]:  {{(pid=75122) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 09:32:51 user nova-compute[75122]: DEBUG nova.virt.libvirt.guest [None req-de97beac-4671-46e9-856c-1c18c459c3a7 tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:9e:53:27"/><model type="virtio"/><mtu size="1442"/><target dev="tapce0d75c2-85"/></interface> {{(pid=75122) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 15 09:32:51 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:32:51 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec07e09f-b8ce-498b-8758-6c751e942883]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:32:51 user nova-compute[75122]: INFO nova.compute.manager [None req-c5d60b30-d10a-4c86-8062-45f7ba1ef412 tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] [instance: bcb58c79-f6b3-44d9-a80f-1a4cf580379f] Took 1.09 seconds to destroy the instance on the hypervisor.
Nov 15 09:32:51 user nova-compute[75122]: DEBUG oslo.service.loopingcall [None req-c5d60b30-d10a-4c86-8062-45f7ba1ef412 tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75122) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 09:32:51 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:32:51 user nova-compute[75122]: DEBUG nova.compute.manager [-] [instance: bcb58c79-f6b3-44d9-a80f-1a4cf580379f] Deallocating network for instance {{(pid=75122) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 09:32:51 user nova-compute[75122]: DEBUG nova.network.neutron [-] [instance: bcb58c79-f6b3-44d9-a80f-1a4cf580379f] deallocate_for_instance() {{(pid=75122) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 09:32:51 user nova-compute[75122]: DEBUG nova.virt.libvirt.guest [None req-de97beac-4671-46e9-856c-1c18c459c3a7 tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:9e:53:27"/><model type="virtio"/><mtu size="1442"/><target dev="tapce0d75c2-85"/></interface>not found in domain: <domain type='kvm' id='5'>
Nov 15 09:32:51 user nova-compute[75122]:   <name>instance-00000005</name>
Nov 15 09:32:51 user nova-compute[75122]:   <uuid>e0f32160-7130-4b9c-aa9c-84123f3a6b32</uuid>
Nov 15 09:32:51 user nova-compute[75122]:   <metadata>
Nov 15 09:32:51 user nova-compute[75122]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 09:32:51 user nova-compute[75122]:   <nova:package version="0.0.0"/>
Nov 15 09:32:51 user nova-compute[75122]:   <nova:name>tempest-device-tagging-server-650907307</nova:name>
Nov 15 09:32:51 user nova-compute[75122]:   <nova:creationTime>2023-11-15 09:32:20</nova:creationTime>
Nov 15 09:32:51 user nova-compute[75122]:   <nova:flavor name="m1.tiny">
Nov 15 09:32:51 user nova-compute[75122]:     <nova:memory>512</nova:memory>
Nov 15 09:32:51 user nova-compute[75122]:     <nova:disk>1</nova:disk>
Nov 15 09:32:51 user nova-compute[75122]:     <nova:swap>0</nova:swap>
Nov 15 09:32:51 user nova-compute[75122]:     <nova:ephemeral>0</nova:ephemeral>
Nov 15 09:32:51 user nova-compute[75122]:     <nova:vcpus>1</nova:vcpus>
Nov 15 09:32:51 user nova-compute[75122]:   </nova:flavor>
Nov 15 09:32:51 user nova-compute[75122]:   <nova:owner>
Nov 15 09:32:51 user nova-compute[75122]:     <nova:user uuid="d2529e19d29e4120b6e8ae75e16bb5b6">tempest-TaggedAttachmentsTest-2027876138-project-member</nova:user>
Nov 15 09:32:51 user nova-compute[75122]:     <nova:project uuid="6082a9c95d70462586e1f1195b43a383">tempest-TaggedAttachmentsTest-2027876138</nova:project>
Nov 15 09:32:51 user nova-compute[75122]:   </nova:owner>
Nov 15 09:32:51 user nova-compute[75122]:   <nova:root type="image" uuid="5e862cfe-47b8-4725-8292-65761ee6d0f5"/>
Nov 15 09:32:51 user nova-compute[75122]:   <nova:ports>
Nov 15 09:32:51 user nova-compute[75122]:     <nova:port uuid="0d48c0d7-8a0f-4bfa-b8b7-290f122c3f4a">
Nov 15 09:32:51 user nova-compute[75122]:       <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 15 09:32:51 user nova-compute[75122]:     </nova:port>
Nov 15 09:32:51 user nova-compute[75122]:     <nova:port uuid="ce0d75c2-85b4-4e49-8d42-767b17493e53">
Nov 15 09:32:51 user nova-compute[75122]:       <nova:ip type="fixed" address="10.10.10.10" ipVersion="4"/>
Nov 15 09:32:51 user nova-compute[75122]:     </nova:port>
Nov 15 09:32:51 user nova-compute[75122]:   </nova:ports>
Nov 15 09:32:51 user nova-compute[75122]: </nova:instance>
Nov 15 09:32:51 user nova-compute[75122]:   </metadata>
Nov 15 09:32:51 user nova-compute[75122]:   <memory unit='KiB'>524288</memory>
Nov 15 09:32:51 user nova-compute[75122]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 15 09:32:51 user nova-compute[75122]:   <vcpu placement='static'>1</vcpu>
Nov 15 09:32:51 user nova-compute[75122]:   <resource>
Nov 15 09:32:51 user nova-compute[75122]:     <partition>/machine</partition>
Nov 15 09:32:51 user nova-compute[75122]:   </resource>
Nov 15 09:32:51 user nova-compute[75122]:   <sysinfo type='smbios'>
Nov 15 09:32:51 user nova-compute[75122]:     <system>
Nov 15 09:32:51 user nova-compute[75122]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 15 09:32:51 user nova-compute[75122]:       <entry name='product'>OpenStack Nova</entry>
Nov 15 09:32:51 user nova-compute[75122]:       <entry name='version'>0.0.0</entry>
Nov 15 09:32:51 user nova-compute[75122]:       <entry name='serial'>e0f32160-7130-4b9c-aa9c-84123f3a6b32</entry>
Nov 15 09:32:51 user nova-compute[75122]:       <entry name='uuid'>e0f32160-7130-4b9c-aa9c-84123f3a6b32</entry>
Nov 15 09:32:51 user nova-compute[75122]:       <entry name='family'>Virtual Machine</entry>
Nov 15 09:32:51 user nova-compute[75122]:     </system>
Nov 15 09:32:51 user nova-compute[75122]:   </sysinfo>
Nov 15 09:32:51 user nova-compute[75122]:   <os>
Nov 15 09:32:51 user nova-compute[75122]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 15 09:32:51 user nova-compute[75122]:     <boot dev='hd'/>
Nov 15 09:32:51 user nova-compute[75122]:     <smbios mode='sysinfo'/>
Nov 15 09:32:51 user nova-compute[75122]:   </os>
Nov 15 09:32:51 user nova-compute[75122]:   <features>
Nov 15 09:32:51 user nova-compute[75122]:     <acpi/>
Nov 15 09:32:51 user nova-compute[75122]:     <apic/>
Nov 15 09:32:51 user nova-compute[75122]:     <vmcoreinfo state='on'/>
Nov 15 09:32:51 user nova-compute[75122]:   </features>
Nov 15 09:32:51 user nova-compute[75122]:   <cpu mode='custom' match='exact' check='full'>
Nov 15 09:32:51 user nova-compute[75122]:     <model fallback='forbid'>Nehalem</model>
Nov 15 09:32:51 user nova-compute[75122]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 15 09:32:51 user nova-compute[75122]:     <feature policy='require' name='vme'/>
Nov 15 09:32:51 user nova-compute[75122]:     <feature policy='require' name='x2apic'/>
Nov 15 09:32:51 user nova-compute[75122]:     <feature policy='require' name='hypervisor'/>
Nov 15 09:32:51 user nova-compute[75122]:   </cpu>
Nov 15 09:32:51 user nova-compute[75122]:   <clock offset='utc'>
Nov 15 09:32:51 user nova-compute[75122]:     <timer name='pit' tickpolicy='delay'/>
Nov 15 09:32:51 user nova-compute[75122]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 15 09:32:51 user nova-compute[75122]:     <timer name='hpet' present='no'/>
Nov 15 09:32:51 user nova-compute[75122]:   </clock>
Nov 15 09:32:51 user nova-compute[75122]:   <on_poweroff>destroy</on_poweroff>
Nov 15 09:32:51 user nova-compute[75122]:   <on_reboot>restart</on_reboot>
Nov 15 09:32:51 user nova-compute[75122]:   <on_crash>destroy</on_crash>
Nov 15 09:32:51 user nova-compute[75122]:   <devices>
Nov 15 09:32:51 user nova-compute[75122]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 15 09:32:51 user nova-compute[75122]:     <disk type='file' device='disk'>
Nov 15 09:32:51 user nova-compute[75122]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 15 09:32:51 user nova-compute[75122]:       <source file='/opt/stack/data/nova/instances/e0f32160-7130-4b9c-aa9c-84123f3a6b32/disk' index='2'/>
Nov 15 09:32:51 user nova-compute[75122]:       <backingStore type='file' index='3'>
Nov 15 09:32:51 user nova-compute[75122]:         <format type='raw'/>
Nov 15 09:32:51 user nova-compute[75122]:         <source file='/opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665'/>
Nov 15 09:32:51 user nova-compute[75122]:         <backingStore/>
Nov 15 09:32:51 user nova-compute[75122]:       </backingStore>
Nov 15 09:32:51 user nova-compute[75122]:       <target dev='vda' bus='virtio'/>
Nov 15 09:32:51 user nova-compute[75122]:       <alias name='virtio-disk0'/>
Nov 15 09:32:51 user nova-compute[75122]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 15 09:32:51 user nova-compute[75122]:     </disk>
Nov 15 09:32:51 user nova-compute[75122]:     <disk type='file' device='cdrom'>
Nov 15 09:32:51 user nova-compute[75122]:       <driver name='qemu' type='raw' cache='none'/>
Nov 15 09:32:51 user nova-compute[75122]:       <source file='/opt/stack/data/nova/instances/e0f32160-7130-4b9c-aa9c-84123f3a6b32/disk.config' index='1'/>
Nov 15 09:32:51 user nova-compute[75122]:       <backingStore/>
Nov 15 09:32:51 user nova-compute[75122]:       <target dev='hda' bus='ide'/>
Nov 15 09:32:51 user nova-compute[75122]:       <readonly/>
Nov 15 09:32:51 user nova-compute[75122]:       <alias name='ide0-0-0'/>
Nov 15 09:32:51 user nova-compute[75122]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 15 09:32:51 user nova-compute[75122]:     </disk>
Nov 15 09:32:51 user nova-compute[75122]:     <controller type='usb' index='0' model='none'>
Nov 15 09:32:51 user nova-compute[75122]:       <alias name='usb'/>
Nov 15 09:32:51 user nova-compute[75122]:     </controller>
Nov 15 09:32:51 user nova-compute[75122]:     <controller type='pci' index='0' model='pci-root'>
Nov 15 09:32:51 user nova-compute[75122]:       <alias name='pci.0'/>
Nov 15 09:32:51 user nova-compute[75122]:     </controller>
Nov 15 09:32:51 user nova-compute[75122]:     <controller type='ide' index='0'>
Nov 15 09:32:51 user nova-compute[75122]:       <alias name='ide'/>
Nov 15 09:32:51 user nova-compute[75122]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 15 09:32:51 user nova-compute[75122]:     </controller>
Nov 15 09:32:51 user nova-compute[75122]:     <interface type='ethernet'>
Nov 15 09:32:51 user nova-compute[75122]:       <mac address='fa:16:3e:fd:20:4e'/>
Nov 15 09:32:51 user nova-compute[75122]:       <target dev='tap0d48c0d7-8a'/>
Nov 15 09:32:51 user nova-compute[75122]:       <model type='virtio'/>
Nov 15 09:32:51 user nova-compute[75122]:       <mtu size='1442'/>
Nov 15 09:32:51 user nova-compute[75122]:       <alias name='net0'/>
Nov 15 09:32:51 user nova-compute[75122]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 15 09:32:51 user nova-compute[75122]:     </interface>
Nov 15 09:32:51 user nova-compute[75122]:     <interface type='ethernet'>
Nov 15 09:32:51 user nova-compute[75122]:       <mac address='fa:16:3e:9e:53:27'/>
Nov 15 09:32:51 user nova-compute[75122]:       <target dev='tapce0d75c2-85'/>
Nov 15 09:32:51 user nova-compute[75122]:       <model type='virtio'/>
Nov 15 09:32:51 user nova-compute[75122]:       <mtu size='1442'/>
Nov 15 09:32:51 user nova-compute[75122]:       <alias name='net1'/>
Nov 15 09:32:51 user nova-compute[75122]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Nov 15 09:32:51 user nova-compute[75122]:     </interface>
Nov 15 09:32:51 user nova-compute[75122]:     <serial type='pty'>
Nov 15 09:32:51 user nova-compute[75122]:       <source path='/dev/pts/4'/>
Nov 15 09:32:51 user nova-compute[75122]:       <log file='/opt/stack/data/nova/instances/e0f32160-7130-4b9c-aa9c-84123f3a6b32/console.log' append='off'/>
Nov 15 09:32:51 user nova-compute[75122]:       <target type='isa-serial' port='0'>
Nov 15 09:32:51 user nova-compute[75122]:         <model name='isa-serial'/>
Nov 15 09:32:51 user nova-compute[75122]:       </target>
Nov 15 09:32:51 user nova-compute[75122]:       <alias name='serial0'/>
Nov 15 09:32:51 user nova-compute[75122]:     </serial>
Nov 15 09:32:51 user nova-compute[75122]:     <console type='pty' tty='/dev/pts/4'>
Nov 15 09:32:51 user nova-compute[75122]:       <source path='/dev/pts/4'/>
Nov 15 09:32:51 user nova-compute[75122]:       <log file='/opt/stack/data/nova/instances/e0f32160-7130-4b9c-aa9c-84123f3a6b32/console.log' append='off'/>
Nov 15 09:32:51 user nova-compute[75122]:       <target type='serial' port='0'/>
Nov 15 09:32:51 user nova-compute[75122]:       <alias name='serial0'/>
Nov 15 09:32:51 user nova-compute[75122]:     </console>
Nov 15 09:32:51 user nova-compute[75122]:     <input type='mouse' bus='ps2'>
Nov 15 09:32:51 user nova-compute[75122]:       <alias name='input0'/>
Nov 15 09:32:51 user nova-compute[75122]:     </input>
Nov 15 09:32:51 user nova-compute[75122]:     <input type='keyboard' bus='ps2'>
Nov 15 09:32:51 user nova-compute[75122]:       <alias name='input1'/>
Nov 15 09:32:51 user nova-compute[75122]:     </input>
Nov 15 09:32:51 user nova-compute[75122]:     <graphics type='vnc' port='5904' autoport='yes' listen='0.0.0.0'>
Nov 15 09:32:51 user nova-compute[75122]:       <listen type='address' address='0.0.0.0'/>
Nov 15 09:32:51 user nova-compute[75122]:     </graphics>
Nov 15 09:32:51 user nova-compute[75122]:     <audio id='1' type='none'/>
Nov 15 09:32:51 user nova-compute[75122]:     <video>
Nov 15 09:32:51 user nova-compute[75122]:       <model type='virtio' heads='1' primary='yes'/>
Nov 15 09:32:51 user nova-compute[75122]:       <alias name='video0'/>
Nov 15 09:32:51 user nova-compute[75122]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 15 09:32:51 user nova-compute[75122]:     </video>
Nov 15 09:32:51 user nova-compute[75122]:     <memballoon model='virtio'>
Nov 15 09:32:51 user nova-compute[75122]:       <stats period='10'/>
Nov 15 09:32:51 user nova-compute[75122]:       <alias name='balloon0'/>
Nov 15 09:32:51 user nova-compute[75122]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 15 09:32:51 user nova-compute[75122]:     </memballoon>
Nov 15 09:32:51 user nova-compute[75122]:     <rng model='virtio'>
Nov 15 09:32:51 user nova-compute[75122]:       <backend model='random'>/dev/urandom</backend>
Nov 15 09:32:51 user nova-compute[75122]:       <alias name='rng0'/>
Nov 15 09:32:51 user nova-compute[75122]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 15 09:32:51 user nova-compute[75122]:     </rng>
Nov 15 09:32:51 user nova-compute[75122]:   </devices>
Nov 15 09:32:51 user nova-compute[75122]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 15 09:32:51 user nova-compute[75122]:     <label>libvirt-e0f32160-7130-4b9c-aa9c-84123f3a6b32</label>
Nov 15 09:32:51 user nova-compute[75122]:     <imagelabel>libvirt-e0f32160-7130-4b9c-aa9c-84123f3a6b32</imagelabel>
Nov 15 09:32:51 user nova-compute[75122]:   </seclabel>
Nov 15 09:32:51 user nova-compute[75122]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 15 09:32:51 user nova-compute[75122]:     <label>+64055:+108</label>
Nov 15 09:32:51 user nova-compute[75122]:     <imagelabel>+64055:+108</imagelabel>
Nov 15 09:32:51 user nova-compute[75122]:   </seclabel>
Nov 15 09:32:51 user nova-compute[75122]: </domain>
Nov 15 09:32:51 user nova-compute[75122]:  {{(pid=75122) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 15 09:32:51 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-de97beac-4671-46e9-856c-1c18c459c3a7 tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] Successfully detached device tapce0d75c2-85 from instance e0f32160-7130-4b9c-aa9c-84123f3a6b32 from the persistent domain config.
Nov 15 09:32:51 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-de97beac-4671-46e9-856c-1c18c459c3a7 tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] (1/8): Attempting to detach device tapce0d75c2-85 with device alias net1 from instance e0f32160-7130-4b9c-aa9c-84123f3a6b32 from the live domain config. {{(pid=75122) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 09:32:51 user nova-compute[75122]: DEBUG nova.virt.libvirt.guest [None req-de97beac-4671-46e9-856c-1c18c459c3a7 tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] detach device xml: <interface type="ethernet">
Nov 15 09:32:51 user nova-compute[75122]:   <mac address="fa:16:3e:9e:53:27"/>
Nov 15 09:32:51 user nova-compute[75122]:   <model type="virtio"/>
Nov 15 09:32:51 user nova-compute[75122]:   <mtu size="1442"/>
Nov 15 09:32:51 user nova-compute[75122]:   <target dev="tapce0d75c2-85"/>
Nov 15 09:32:51 user nova-compute[75122]: </interface>
Nov 15 09:32:51 user nova-compute[75122]:  {{(pid=75122) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 09:32:51 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:32:51 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[33f81c68-bd17-4f65-9999-b7075fa93992]: (4, ('ok\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:32:51 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-87b8d899-6ab9-4afd-bfa5-c093e3bcdb6d tempest-TestVolumeSwap-69301659 tempest-TestVolumeSwap-69301659-project-admin] Flushing IO for device /dev/sde {{(pid=75122) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 09:32:51 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:32:51 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:32:51 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed12f4fc-8d6c-4794-bc98-03752731c2a4]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:32:51 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-87b8d899-6ab9-4afd-bfa5-c093e3bcdb6d tempest-TestVolumeSwap-69301659 tempest-TestVolumeSwap-69301659-project-admin] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75122) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 09:32:51 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:32:51 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.044s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:32:51 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[58b7691a-1429-4796-b9e9-d560f971f857]: (4, ('1', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:32:51 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-87b8d899-6ab9-4afd-bfa5-c093e3bcdb6d tempest-TestVolumeSwap-69301659 tempest-TestVolumeSwap-69301659-project-admin] Checking to see if SCSI volumes sde have been removed. {{(pid=75122) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 09:32:51 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-87b8d899-6ab9-4afd-bfa5-c093e3bcdb6d tempest-TestVolumeSwap-69301659 tempest-TestVolumeSwap-69301659-project-admin] SCSI volumes sde have been removed. {{(pid=75122) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 09:32:51 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-87b8d899-6ab9-4afd-bfa5-c093e3bcdb6d tempest-TestVolumeSwap-69301659 tempest-TestVolumeSwap-69301659-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0796957f-5a19-4fe2-acb8-f3568399150a')] {{(pid=75122) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 09:32:51 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0796957f-5a19-4fe2-acb8-f3568399150a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:32:51 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0796957f-5a19-4fe2-acb8-f3568399150a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:32:51 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[6057c531-9866-4c29-aaf7-6a68a7d094de]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:32:51 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-87b8d899-6ab9-4afd-bfa5-c093e3bcdb6d tempest-TestVolumeSwap-69301659 tempest-TestVolumeSwap-69301659-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:32:51 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0796957f-5a19-4fe2-acb8-f3568399150a -p 172.16.0.220:3260 --logout {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:32:51 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0796957f-5a19-4fe2-acb8-f3568399150a -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:32:51 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[2adacaf9-983a-4402-86ac-edbc5a41d680]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:0796957f-5a19-4fe2-acb8-f3568399150a, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:0796957f-5a19-4fe2-acb8-f3568399150a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:32:51 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-87b8d899-6ab9-4afd-bfa5-c093e3bcdb6d tempest-TestVolumeSwap-69301659 tempest-TestVolumeSwap-69301659-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:0796957f-5a19-4fe2-acb8-f3568399150a, portal: 172.16.0.220,3260]
Nov 15 09:32:51 user nova-compute[75122]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:0796957f-5a19-4fe2-acb8-f3568399150a, portal: 172.16.0.220,3260] successful.
Nov 15 09:32:51 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:32:51 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0796957f-5a19-4fe2-acb8-f3568399150a -p 172.16.0.220:3260 --op delete {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:32:51 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0796957f-5a19-4fe2-acb8-f3568399150a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:32:51 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[022cb949-cfa7-47b0-ba82-a40708b09ef4]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:32:51 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-87b8d899-6ab9-4afd-bfa5-c093e3bcdb6d tempest-TestVolumeSwap-69301659 tempest-TestVolumeSwap-69301659-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:32:51 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-87b8d899-6ab9-4afd-bfa5-c093e3bcdb6d tempest-TestVolumeSwap-69301659 tempest-TestVolumeSwap-69301659-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.316s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 09:32:51 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-87b8d899-6ab9-4afd-bfa5-c093e3bcdb6d tempest-TestVolumeSwap-69301659 tempest-TestVolumeSwap-69301659-project-admin] <== disconnect_volume: return (317ms) None {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 09:32:51 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-87b8d899-6ab9-4afd-bfa5-c093e3bcdb6d tempest-TestVolumeSwap-69301659 tempest-TestVolumeSwap-69301659-project-admin] [instance: d24a189e-2de9-404e-b281-224c150a5bbf] Disconnected iSCSI Volume {{(pid=75122) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 09:32:51 user nova-compute[75122]: DEBUG nova.compute.manager [None req-87b8d899-6ab9-4afd-bfa5-c093e3bcdb6d tempest-TestVolumeSwap-69301659 tempest-TestVolumeSwap-69301659-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5cb8eb00-0379-40d5-972c-9565fe412df4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eqxYPwfD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': 'd24a189e-2de9-404e-b281-224c150a5bbf', 'attached_at': '', 'detached_at': '', 'volume_id': '5cb8eb00-0379-40d5-972c-9565fe412df4', 'serial'} {{(pid=75122) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 15 09:32:51 user nova-compute[75122]: DEBUG nova.compute.manager [None req-87b8d899-6ab9-4afd-bfa5-c093e3bcdb6d tempest-TestVolumeSwap-69301659 tempest-TestVolumeSwap-69301659-project-admin] [instance: d24a189e-2de9-404e-b281-224c150a5bbf] swap_volume: removing Cinder connection for volume 0796957f-5a19-4fe2-acb8-f3568399150a {{(pid=75122) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 15 09:32:51 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:32:51 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:32:51 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-de97beac-4671-46e9-856c-1c18c459c3a7 tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] Start waiting for the detach event from libvirt for device tapce0d75c2-85 with device alias net1 for instance e0f32160-7130-4b9c-aa9c-84123f3a6b32 {{(pid=75122) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 09:32:51 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:32:52 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:32:52 user nova-compute[75122]: DEBUG nova.compute.manager [req-16764b49-7f30-43b3-be2c-1ee64cab941f req-27cbf5ed-50a4-4413-964b-c517655c7f4d service nova] [instance: e0f32160-7130-4b9c-aa9c-84123f3a6b32] Received event network-vif-unplugged-ce0d75c2-85b4-4e49-8d42-767b17493e53 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:32:52 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-16764b49-7f30-43b3-be2c-1ee64cab941f req-27cbf5ed-50a4-4413-964b-c517655c7f4d service nova] Acquiring lock "e0f32160-7130-4b9c-aa9c-84123f3a6b32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:32:52 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-16764b49-7f30-43b3-be2c-1ee64cab941f req-27cbf5ed-50a4-4413-964b-c517655c7f4d service nova] Lock "e0f32160-7130-4b9c-aa9c-84123f3a6b32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:32:52 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-16764b49-7f30-43b3-be2c-1ee64cab941f req-27cbf5ed-50a4-4413-964b-c517655c7f4d service nova] Lock "e0f32160-7130-4b9c-aa9c-84123f3a6b32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:32:52 user nova-compute[75122]: DEBUG nova.compute.manager [req-16764b49-7f30-43b3-be2c-1ee64cab941f req-27cbf5ed-50a4-4413-964b-c517655c7f4d service nova] [instance: e0f32160-7130-4b9c-aa9c-84123f3a6b32] No waiting events found dispatching network-vif-unplugged-ce0d75c2-85b4-4e49-8d42-767b17493e53 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:32:52 user nova-compute[75122]: WARNING nova.compute.manager [req-16764b49-7f30-43b3-be2c-1ee64cab941f req-27cbf5ed-50a4-4413-964b-c517655c7f4d service nova] [instance: e0f32160-7130-4b9c-aa9c-84123f3a6b32] Received unexpected event network-vif-unplugged-ce0d75c2-85b4-4e49-8d42-767b17493e53 for instance with vm_state active and task_state None.
Nov 15 09:32:52 user nova-compute[75122]: DEBUG nova.network.neutron [-] [instance: bcb58c79-f6b3-44d9-a80f-1a4cf580379f] Updating instance_info_cache with network_info: [] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:32:52 user nova-compute[75122]: INFO nova.compute.manager [-] [instance: bcb58c79-f6b3-44d9-a80f-1a4cf580379f] Took 0.89 seconds to deallocate network for instance.
Nov 15 09:32:52 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-c5d60b30-d10a-4c86-8062-45f7ba1ef412 tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:32:52 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-c5d60b30-d10a-4c86-8062-45f7ba1ef412 tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:32:52 user nova-compute[75122]: DEBUG nova.compute.manager [None req-87b8d899-6ab9-4afd-bfa5-c093e3bcdb6d tempest-TestVolumeSwap-69301659 tempest-TestVolumeSwap-69301659-project-admin] [instance: d24a189e-2de9-404e-b281-224c150a5bbf] swap_volume: Updating volume 0796957f-5a19-4fe2-acb8-f3568399150a BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:5cb8eb00-0379-40d5-972c-9565fe412df4", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "eqxYPwfD", "auth_password": "UCrSQoXbMLh6q9", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdf", "volume_id": "5cb8eb00-0379-40d5-972c-9565fe412df4"}, "status": "reserved", "instance": "d24a189e-2de9-404e-b281-224c150a5bbf", "attached_at": "", "detached_at": "", "volume_id": "5cb8eb00-0379-40d5-972c-9565fe412df4", "serial": "5cb8eb00-0379-40d5-972c-9565fe412df4"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '5cb8eb00-0379-40d5-972c-9565fe412df4', 'no_device': None, 'attachment_id': '151a9773-328f-4b12-9311-7aa273727f85'} {{(pid=75122) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 15 09:32:52 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-87b8d899-6ab9-4afd-bfa5-c093e3bcdb6d tempest-TestVolumeSwap-69301659 tempest-TestVolumeSwap-69301659-project-admin] Lock "d24a189e-2de9-404e-b281-224c150a5bbf" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 16.551s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:32:52 user nova-compute[75122]: DEBUG nova.compute.provider_tree [None req-c5d60b30-d10a-4c86-8062-45f7ba1ef412 tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] Inventory has not changed in ProviderTree for provider: 69a3da65-47be-44c6-b67c-c692b58284ef {{(pid=75122) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 09:32:52 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-c5d60b30-d10a-4c86-8062-45f7ba1ef412 tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] Inventory has not changed for provider 69a3da65-47be-44c6-b67c-c692b58284ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 09:32:52 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-c5d60b30-d10a-4c86-8062-45f7ba1ef412 tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.258s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:32:52 user nova-compute[75122]: INFO nova.scheduler.client.report [None req-c5d60b30-d10a-4c86-8062-45f7ba1ef412 tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] Deleted allocations for instance bcb58c79-f6b3-44d9-a80f-1a4cf580379f
Nov 15 09:32:52 user nova-compute[75122]: DEBUG nova.compute.manager [req-b5721cdd-a4f3-4583-8eb6-3da20c942ecf req-0172bdd1-6e57-4053-adf4-96a9065d57be service nova] [instance: bcb58c79-f6b3-44d9-a80f-1a4cf580379f] Received event network-vif-plugged-364a329a-8a90-43f6-9927-0c07dc1d6cbe {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:32:52 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-b5721cdd-a4f3-4583-8eb6-3da20c942ecf req-0172bdd1-6e57-4053-adf4-96a9065d57be service nova] Acquiring lock "bcb58c79-f6b3-44d9-a80f-1a4cf580379f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:32:52 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-b5721cdd-a4f3-4583-8eb6-3da20c942ecf req-0172bdd1-6e57-4053-adf4-96a9065d57be service nova] Lock "bcb58c79-f6b3-44d9-a80f-1a4cf580379f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:32:52 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-b5721cdd-a4f3-4583-8eb6-3da20c942ecf req-0172bdd1-6e57-4053-adf4-96a9065d57be service nova] Lock "bcb58c79-f6b3-44d9-a80f-1a4cf580379f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:32:52 user nova-compute[75122]: DEBUG nova.compute.manager [req-b5721cdd-a4f3-4583-8eb6-3da20c942ecf req-0172bdd1-6e57-4053-adf4-96a9065d57be service nova] [instance: bcb58c79-f6b3-44d9-a80f-1a4cf580379f] No waiting events found dispatching network-vif-plugged-364a329a-8a90-43f6-9927-0c07dc1d6cbe {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:32:52 user nova-compute[75122]: WARNING nova.compute.manager [req-b5721cdd-a4f3-4583-8eb6-3da20c942ecf req-0172bdd1-6e57-4053-adf4-96a9065d57be service nova] [instance: bcb58c79-f6b3-44d9-a80f-1a4cf580379f] Received unexpected event network-vif-plugged-364a329a-8a90-43f6-9927-0c07dc1d6cbe for instance with vm_state deleted and task_state None.
Nov 15 09:32:52 user nova-compute[75122]: DEBUG nova.compute.manager [req-b5721cdd-a4f3-4583-8eb6-3da20c942ecf req-0172bdd1-6e57-4053-adf4-96a9065d57be service nova] [instance: bcb58c79-f6b3-44d9-a80f-1a4cf580379f] Received event network-vif-deleted-364a329a-8a90-43f6-9927-0c07dc1d6cbe {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:32:53 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-c5d60b30-d10a-4c86-8062-45f7ba1ef412 tempest-AttachSCSIVolumeTestJSON-348091286 tempest-AttachSCSIVolumeTestJSON-348091286-project-member] Lock "bcb58c79-f6b3-44d9-a80f-1a4cf580379f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.467s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:32:53 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-ece8ad2b-5ee2-425d-85db-88632b803dda tempest-TestVolumeSwap-69301659 tempest-TestVolumeSwap-69301659-project-admin] Acquiring lock "d24a189e-2de9-404e-b281-224c150a5bbf" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:32:53 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-ece8ad2b-5ee2-425d-85db-88632b803dda tempest-TestVolumeSwap-69301659 tempest-TestVolumeSwap-69301659-project-admin] Lock "d24a189e-2de9-404e-b281-224c150a5bbf" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:32:53 user nova-compute[75122]: DEBUG os_brick.utils [None req-ece8ad2b-5ee2-425d-85db-88632b803dda tempest-TestVolumeSwap-69301659 tempest-TestVolumeSwap-69301659-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 09:32:53 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:32:53 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:32:53 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[c79f7ae8-7cbb-4b0d-b7cc-9de6749c4250]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:742fb64b3587\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:32:53 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:32:53 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:32:53 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[6de6caa6-50ef-4f9a-bee8-7049d904e5e1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:32:53 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:32:53 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:32:53 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[723076c3-d717-4305-971c-ed3000fdcb00]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:32:53 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[38d0c289-8ca4-4c08-873d-0cdc4d5b355b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:32:53 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-ece8ad2b-5ee2-425d-85db-88632b803dda tempest-TestVolumeSwap-69301659 tempest-TestVolumeSwap-69301659-project-admin] Running cmd (subprocess): nvme version {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:32:53 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-ece8ad2b-5ee2-425d-85db-88632b803dda tempest-TestVolumeSwap-69301659 tempest-TestVolumeSwap-69301659-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 09:32:53 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ece8ad2b-5ee2-425d-85db-88632b803dda tempest-TestVolumeSwap-69301659 tempest-TestVolumeSwap-69301659-project-admin] nvme not present on system {{(pid=75122) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 09:32:53 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:32:53 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 09:32:53 user nova-compute[75122]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 09:32:53 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6feb3ca-d987-44b4-9b24-ca5fd48f367e]: (4, '') {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:32:53 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.lightos [None req-ece8ad2b-5ee2-425d-85db-88632b803dda tempest-TestVolumeSwap-69301659 tempest-TestVolumeSwap-69301659-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75122) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 09:32:53 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.lightos [None req-ece8ad2b-5ee2-425d-85db-88632b803dda tempest-TestVolumeSwap-69301659 tempest-TestVolumeSwap-69301659-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75122) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 09:32:53 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.lightos [None req-ece8ad2b-5ee2-425d-85db-88632b803dda tempest-TestVolumeSwap-69301659 tempest-TestVolumeSwap-69301659-project-admin] LIGHTOS: no hostnqn found. {{(pid=75122) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 09:32:53 user nova-compute[75122]: DEBUG os_brick.utils [None req-ece8ad2b-5ee2-425d-85db-88632b803dda tempest-TestVolumeSwap-69301659 tempest-TestVolumeSwap-69301659-project-admin] <== get_connector_properties: return (106ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:742fb64b3587', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 09:32:53 user nova-compute[75122]: INFO nova.compute.manager [None req-ece8ad2b-5ee2-425d-85db-88632b803dda tempest-TestVolumeSwap-69301659 tempest-TestVolumeSwap-69301659-project-admin] [instance: d24a189e-2de9-404e-b281-224c150a5bbf] Swapping volume 5cb8eb00-0379-40d5-972c-9565fe412df4 for 0796957f-5a19-4fe2-acb8-f3568399150a
Nov 15 09:32:54 user nova-compute[75122]: DEBUG nova.compute.manager [req-9ab9f27c-6b64-467a-affc-fe028a1bf751 req-7d9236f3-68a9-4721-bf30-22cf2e6e8c00 service nova] [instance: e0f32160-7130-4b9c-aa9c-84123f3a6b32] Received event network-vif-plugged-ce0d75c2-85b4-4e49-8d42-767b17493e53 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:32:54 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-9ab9f27c-6b64-467a-affc-fe028a1bf751 req-7d9236f3-68a9-4721-bf30-22cf2e6e8c00 service nova] Acquiring lock "e0f32160-7130-4b9c-aa9c-84123f3a6b32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:32:54 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-9ab9f27c-6b64-467a-affc-fe028a1bf751 req-7d9236f3-68a9-4721-bf30-22cf2e6e8c00 service nova] Lock "e0f32160-7130-4b9c-aa9c-84123f3a6b32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:32:54 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-9ab9f27c-6b64-467a-affc-fe028a1bf751 req-7d9236f3-68a9-4721-bf30-22cf2e6e8c00 service nova] Lock "e0f32160-7130-4b9c-aa9c-84123f3a6b32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:32:54 user nova-compute[75122]: DEBUG nova.compute.manager [req-9ab9f27c-6b64-467a-affc-fe028a1bf751 req-7d9236f3-68a9-4721-bf30-22cf2e6e8c00 service nova] [instance: e0f32160-7130-4b9c-aa9c-84123f3a6b32] No waiting events found dispatching network-vif-plugged-ce0d75c2-85b4-4e49-8d42-767b17493e53 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:32:54 user nova-compute[75122]: WARNING nova.compute.manager [req-9ab9f27c-6b64-467a-affc-fe028a1bf751 req-7d9236f3-68a9-4721-bf30-22cf2e6e8c00 service nova] [instance: e0f32160-7130-4b9c-aa9c-84123f3a6b32] Received unexpected event network-vif-plugged-ce0d75c2-85b4-4e49-8d42-767b17493e53 for instance with vm_state active and task_state None.
Nov 15 09:32:54 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:32:56 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:32:58 user nova-compute[75122]: DEBUG nova.compute.manager [None req-ece8ad2b-5ee2-425d-85db-88632b803dda tempest-TestVolumeSwap-69301659 tempest-TestVolumeSwap-69301659-project-admin] [instance: d24a189e-2de9-404e-b281-224c150a5bbf] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0796957f-5a19-4fe2-acb8-f3568399150a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KPflkmYs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd24a189e-2de9-404e-b281-224c150a5bbf', 'attached_at': '', 'detached_at': '', 'volume_id': '0796957f-5a19-4fe2-acb8-f3568399150a', 'serial': '0796957f-5a19-4fe2-acb8-f3568399150a'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5cb8eb00-0379-40d5-972c-9565fe412df4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eqxYPwfD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf', 'volume_id': '5cb8eb00-0379-40d5-972c-9565fe412df4'}, 'status': 'reserved', 'instance': 'd24a189e-2de9-404e-b281-224c150a5bbf', 'attached_at': '', 'detached_at': '', 'volume_id': '5cb8eb00-0379-40d5-972c-9565fe412df4', 'serial'} {{(pid=75122) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 15 09:32:58 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ece8ad2b-5ee2-425d-85db-88632b803dda tempest-TestVolumeSwap-69301659 tempest-TestVolumeSwap-69301659-project-admin] [instance: d24a189e-2de9-404e-b281-224c150a5bbf] Calling os-brick to attach iSCSI Volume {{(pid=75122) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 09:32:58 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-ece8ad2b-5ee2-425d-85db-88632b803dda tempest-TestVolumeSwap-69301659 tempest-TestVolumeSwap-69301659-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffa04060b80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0796957f-5a19-4fe2-acb8-f3568399150a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KPflkmYs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 09:32:58 user nova-compute[75122]: WARNING os_brick.initiator.connectors.base [None req-ece8ad2b-5ee2-425d-85db-88632b803dda tempest-TestVolumeSwap-69301659 tempest-TestVolumeSwap-69301659-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 09:32:58 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-ece8ad2b-5ee2-425d-85db-88632b803dda tempest-TestVolumeSwap-69301659 tempest-TestVolumeSwap-69301659-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 09:32:58 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-ece8ad2b-5ee2-425d-85db-88632b803dda tempest-TestVolumeSwap-69301659 tempest-TestVolumeSwap-69301659-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 09:32:58 user nova-compute[75122]: WARNING os_brick.initiator.connectors.base [None req-ece8ad2b-5ee2-425d-85db-88632b803dda tempest-TestVolumeSwap-69301659 tempest-TestVolumeSwap-69301659-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 09:32:58 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-ece8ad2b-5ee2-425d-85db-88632b803dda tempest-TestVolumeSwap-69301659 tempest-TestVolumeSwap-69301659-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0796957f-5a19-4fe2-acb8-f3568399150a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 09:32:58 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-ece8ad2b-5ee2-425d-85db-88632b803dda tempest-TestVolumeSwap-69301659 tempest-TestVolumeSwap-69301659-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0796957f-5a19-4fe2-acb8-f3568399150a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 09:32:58 user nova-compute[75122]: INFO os_brick.initiator.connectors.iscsi [None req-ece8ad2b-5ee2-425d-85db-88632b803dda tempest-TestVolumeSwap-69301659 tempest-TestVolumeSwap-69301659-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 09:32:58 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0796957f-5a19-4fe2-acb8-f3568399150a -p 172.16.0.220:3260 {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:32:58 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0796957f-5a19-4fe2-acb8-f3568399150a -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:32:58 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[52c5fb73-2864-4e6d-b5f0-b69d835b0388]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:32:58 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-ece8ad2b-5ee2-425d-85db-88632b803dda tempest-TestVolumeSwap-69301659 tempest-TestVolumeSwap-69301659-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 09:32:58 user nova-compute[75122]:  {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:32:58 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0796957f-5a19-4fe2-acb8-f3568399150a -p 172.16.0.220:3260 --interface default --op new {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:32:58 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0796957f-5a19-4fe2-acb8-f3568399150a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:32:58 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[51c36fe1-700d-4dfc-83e2-af82f1fe1065]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0796957f-5a19-4fe2-acb8-f3568399150a] added\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:32:58 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-ece8ad2b-5ee2-425d-85db-88632b803dda tempest-TestVolumeSwap-69301659 tempest-TestVolumeSwap-69301659-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0796957f-5a19-4fe2-acb8-f3568399150a] added
Nov 15 09:32:58 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:32:58 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0796957f-5a19-4fe2-acb8-f3568399150a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:32:58 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0796957f-5a19-4fe2-acb8-f3568399150a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:32:58 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9351639-1717-4375-994c-4f8d2533c5dd]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:32:58 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-ece8ad2b-5ee2-425d-85db-88632b803dda tempest-TestVolumeSwap-69301659 tempest-TestVolumeSwap-69301659-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:32:58 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0796957f-5a19-4fe2-acb8-f3568399150a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:32:58 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0796957f-5a19-4fe2-acb8-f3568399150a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:32:58 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a35a8fb-197c-4289-96a8-124aa04e2722]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:32:58 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-ece8ad2b-5ee2-425d-85db-88632b803dda tempest-TestVolumeSwap-69301659 tempest-TestVolumeSwap-69301659-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:32:58 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0796957f-5a19-4fe2-acb8-f3568399150a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KPflkmYs {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:32:58 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0796957f-5a19-4fe2-acb8-f3568399150a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KPflkmYs" returned: 0 in 0.023s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:32:58 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[129af8ff-4e4b-4163-b786-f4e1482c25b8]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:32:58 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-ece8ad2b-5ee2-425d-85db-88632b803dda tempest-TestVolumeSwap-69301659 tempest-TestVolumeSwap-69301659-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KPflkmYs'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:32:58 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0796957f-5a19-4fe2-acb8-f3568399150a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:32:58 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0796957f-5a19-4fe2-acb8-f3568399150a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:32:58 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[c425187a-d784-4b3c-90cd-b0cdd9c33d9b]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:32:58 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-ece8ad2b-5ee2-425d-85db-88632b803dda tempest-TestVolumeSwap-69301659 tempest-TestVolumeSwap-69301659-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:32:58 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:32:58 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:32:58 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6ff84fa-8de5-422b-84bd-1827189ae680]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cb8eb00-0379-40d5-972c-9565fe412df4 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:085fd119-574c-4b24-bf7c-8076479d01c3 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e (non-flash)\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:32:58 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-ece8ad2b-5ee2-425d-85db-88632b803dda tempest-TestVolumeSwap-69301659 tempest-TestVolumeSwap-69301659-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cb8eb00-0379-40d5-972c-9565fe412df4 (non-flash)
Nov 15 09:32:58 user nova-compute[75122]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:085fd119-574c-4b24-bf7c-8076479d01c3 (non-flash)
Nov 15 09:32:58 user nova-compute[75122]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e (non-flash)
Nov 15 09:32:58 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 09:32:58 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-ece8ad2b-5ee2-425d-85db-88632b803dda tempest-TestVolumeSwap-69301659 tempest-TestVolumeSwap-69301659-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cb8eb00-0379-40d5-972c-9565fe412df4 (non-flash)
Nov 15 09:32:58 user nova-compute[75122]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:085fd119-574c-4b24-bf7c-8076479d01c3 (non-flash)
Nov 15 09:32:58 user nova-compute[75122]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e (non-flash)
Nov 15 09:32:58 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 09:32:58 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0796957f-5a19-4fe2-acb8-f3568399150a -p 172.16.0.220:3260 --login {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:32:58 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0796957f-5a19-4fe2-acb8-f3568399150a -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:32:58 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[96f57b5d-636a-4917-bf02-730c25dfcd07]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0796957f-5a19-4fe2-acb8-f3568399150a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0796957f-5a19-4fe2-acb8-f3568399150a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:32:58 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-ece8ad2b-5ee2-425d-85db-88632b803dda tempest-TestVolumeSwap-69301659 tempest-TestVolumeSwap-69301659-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0796957f-5a19-4fe2-acb8-f3568399150a, portal: 172.16.0.220,3260]
Nov 15 09:32:58 user nova-compute[75122]: Login to [iface: default, target: iqn.2010-10.org.openstack:0796957f-5a19-4fe2-acb8-f3568399150a, portal: 172.16.0.220,3260] successful.
Nov 15 09:32:58 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:32:58 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0796957f-5a19-4fe2-acb8-f3568399150a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:32:58 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0796957f-5a19-4fe2-acb8-f3568399150a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:32:58 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ebfe95c-a75f-4306-b9e6-a892fe58004b]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:32:58 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-ece8ad2b-5ee2-425d-85db-88632b803dda tempest-TestVolumeSwap-69301659 tempest-TestVolumeSwap-69301659-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:32:58 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:32:58 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:32:58 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa1a128d-e0d2-4c02-8b65-b4329db366f0]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cb8eb00-0379-40d5-972c-9565fe412df4 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:085fd119-574c-4b24-bf7c-8076479d01c3 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0796957f-5a19-4fe2-acb8-f3568399150a (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e (non-flash)\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:32:58 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-ece8ad2b-5ee2-425d-85db-88632b803dda tempest-TestVolumeSwap-69301659 tempest-TestVolumeSwap-69301659-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cb8eb00-0379-40d5-972c-9565fe412df4 (non-flash)
Nov 15 09:32:58 user nova-compute[75122]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:085fd119-574c-4b24-bf7c-8076479d01c3 (non-flash)
Nov 15 09:32:58 user nova-compute[75122]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0796957f-5a19-4fe2-acb8-f3568399150a (non-flash)
Nov 15 09:32:58 user nova-compute[75122]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e (non-flash)
Nov 15 09:32:58 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 09:32:58 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-ece8ad2b-5ee2-425d-85db-88632b803dda tempest-TestVolumeSwap-69301659 tempest-TestVolumeSwap-69301659-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cb8eb00-0379-40d5-972c-9565fe412df4 (non-flash)
Nov 15 09:32:58 user nova-compute[75122]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:085fd119-574c-4b24-bf7c-8076479d01c3 (non-flash)
Nov 15 09:32:58 user nova-compute[75122]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0796957f-5a19-4fe2-acb8-f3568399150a (non-flash)
Nov 15 09:32:58 user nova-compute[75122]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e (non-flash)
Nov 15 09:32:58 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 09:32:58 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-ece8ad2b-5ee2-425d-85db-88632b803dda tempest-TestVolumeSwap-69301659 tempest-TestVolumeSwap-69301659-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0796957f-5a19-4fe2-acb8-f3568399150a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.259s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 09:32:58 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-ece8ad2b-5ee2-425d-85db-88632b803dda tempest-TestVolumeSwap-69301659 tempest-TestVolumeSwap-69301659-project-admin] Connected to 172.16.0.220:3260 {{(pid=75122) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 09:32:58 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-ece8ad2b-5ee2-425d-85db-88632b803dda tempest-TestVolumeSwap-69301659 tempest-TestVolumeSwap-69301659-project-admin] HCTL ('34', '-', '-', 0) found on session 12 with lun 0 {{(pid=75122) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 09:32:58 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-ece8ad2b-5ee2-425d-85db-88632b803dda tempest-TestVolumeSwap-69301659 tempest-TestVolumeSwap-69301659-project-admin] Scanning host 34 c: -, t: -, l: 0) {{(pid=75122) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 09:32:58 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:32:58 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.014s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:32:58 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[630b07b2-ab2c-4e4e-86e3-456aed6e1a7f]: (4, ('- - 0', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:32:58 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-ece8ad2b-5ee2-425d-85db-88632b803dda tempest-TestVolumeSwap-69301659 tempest-TestVolumeSwap-69301659-project-admin] Searching for a device in session 12 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75122) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 09:32:58 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-ece8ad2b-5ee2-425d-85db-88632b803dda tempest-TestVolumeSwap-69301659 tempest-TestVolumeSwap-69301659-project-admin] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:0796957f-5a19-4fe2-acb8-f3568399150a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KPflkmYs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75122) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 09:32:59 user nova-compute[75122]: DEBUG nova.compute.manager [req-ac914843-162e-456b-b02d-c8a9b758ba60 req-7473b475-62f7-4fe6-a7ed-1e2e86b50fea service nova] [instance: f7d1a157-3228-490e-a6a0-68f6bd2b52ba] Received event network-changed-caf104ef-b652-4038-8203-76f14e4b666b {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:32:59 user nova-compute[75122]: DEBUG nova.compute.manager [req-ac914843-162e-456b-b02d-c8a9b758ba60 req-7473b475-62f7-4fe6-a7ed-1e2e86b50fea service nova] [instance: f7d1a157-3228-490e-a6a0-68f6bd2b52ba] Refreshing instance network info cache due to event network-changed-caf104ef-b652-4038-8203-76f14e4b666b. {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 09:32:59 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-ac914843-162e-456b-b02d-c8a9b758ba60 req-7473b475-62f7-4fe6-a7ed-1e2e86b50fea service nova] Acquiring lock "refresh_cache-f7d1a157-3228-490e-a6a0-68f6bd2b52ba" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 09:32:59 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-ac914843-162e-456b-b02d-c8a9b758ba60 req-7473b475-62f7-4fe6-a7ed-1e2e86b50fea service nova] Acquired lock "refresh_cache-f7d1a157-3228-490e-a6a0-68f6bd2b52ba" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 09:32:59 user nova-compute[75122]: DEBUG nova.network.neutron [req-ac914843-162e-456b-b02d-c8a9b758ba60 req-7473b475-62f7-4fe6-a7ed-1e2e86b50fea service nova] [instance: f7d1a157-3228-490e-a6a0-68f6bd2b52ba] Refreshing network info cache for port caf104ef-b652-4038-8203-76f14e4b666b {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 09:32:59 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-ece8ad2b-5ee2-425d-85db-88632b803dda tempest-TestVolumeSwap-69301659 tempest-TestVolumeSwap-69301659-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.288s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 09:32:59 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-ece8ad2b-5ee2-425d-85db-88632b803dda tempest-TestVolumeSwap-69301659 tempest-TestVolumeSwap-69301659-project-admin] <== connect_volume: return (1289ms) {'type': 'block', 'scsi_wwn': '23938306163663631', 'path': '/dev/sdc'} {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 09:32:59 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ece8ad2b-5ee2-425d-85db-88632b803dda tempest-TestVolumeSwap-69301659 tempest-TestVolumeSwap-69301659-project-admin] [instance: d24a189e-2de9-404e-b281-224c150a5bbf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23938306163663631', 'path': '/dev/sdc'} {{(pid=75122) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 09:32:59 user nova-compute[75122]: DEBUG nova.objects.instance [None req-ece8ad2b-5ee2-425d-85db-88632b803dda tempest-TestVolumeSwap-69301659 tempest-TestVolumeSwap-69301659-project-admin] Lazy-loading 'flavor' on Instance uuid d24a189e-2de9-404e-b281-224c150a5bbf {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:32:59 user nova-compute[75122]: DEBUG nova.network.neutron [req-ac914843-162e-456b-b02d-c8a9b758ba60 req-7473b475-62f7-4fe6-a7ed-1e2e86b50fea service nova] [instance: f7d1a157-3228-490e-a6a0-68f6bd2b52ba] Updated VIF entry in instance network info cache for port caf104ef-b652-4038-8203-76f14e4b666b. {{(pid=75122) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 09:32:59 user nova-compute[75122]: DEBUG nova.network.neutron [req-ac914843-162e-456b-b02d-c8a9b758ba60 req-7473b475-62f7-4fe6-a7ed-1e2e86b50fea service nova] [instance: f7d1a157-3228-490e-a6a0-68f6bd2b52ba] Updating instance_info_cache with network_info: [{"id": "caf104ef-b652-4038-8203-76f14e4b666b", "address": "fa:16:3e:6f:84:74", "network": {"id": "a2e4fc06-5a74-45cd-b530-6dd240bfd068", "bridge": "br-int", "label": "tempest-TestShelveInstance-1307896814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea59215474b04143951de2b9453a33ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcaf104ef-b6", "ovs_interfaceid": "caf104ef-b652-4038-8203-76f14e4b666b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:32:59 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-ac914843-162e-456b-b02d-c8a9b758ba60 req-7473b475-62f7-4fe6-a7ed-1e2e86b50fea service nova] Releasing lock "refresh_cache-f7d1a157-3228-490e-a6a0-68f6bd2b52ba" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 09:32:59 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:33:00 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-53332102-8575-4ce8-8c41-4bea29d1b9e2 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] Acquiring lock "f7d1a157-3228-490e-a6a0-68f6bd2b52ba" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:33:00 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-53332102-8575-4ce8-8c41-4bea29d1b9e2 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] Lock "f7d1a157-3228-490e-a6a0-68f6bd2b52ba" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:33:00 user nova-compute[75122]: INFO nova.compute.manager [None req-53332102-8575-4ce8-8c41-4bea29d1b9e2 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] [instance: f7d1a157-3228-490e-a6a0-68f6bd2b52ba] Shelve offloading
Nov 15 09:33:00 user nova-compute[75122]: DEBUG nova.virt.libvirt.guest [None req-ece8ad2b-5ee2-425d-85db-88632b803dda tempest-TestVolumeSwap-69301659 tempest-TestVolumeSwap-69301659-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=75122) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 09:33:00 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:33:00 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:33:00 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:33:00 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:33:00 user nova-compute[75122]: DEBUG nova.compute.manager [req-2ffa9003-3fa0-4d20-9cc8-e3d618a434e3 req-68d575ae-68da-42e3-b8b4-0fb5143765fc service nova] [instance: f7d1a157-3228-490e-a6a0-68f6bd2b52ba] Received event network-vif-unplugged-caf104ef-b652-4038-8203-76f14e4b666b {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:33:00 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-2ffa9003-3fa0-4d20-9cc8-e3d618a434e3 req-68d575ae-68da-42e3-b8b4-0fb5143765fc service nova] Acquiring lock "f7d1a157-3228-490e-a6a0-68f6bd2b52ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:33:00 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-2ffa9003-3fa0-4d20-9cc8-e3d618a434e3 req-68d575ae-68da-42e3-b8b4-0fb5143765fc service nova] Lock "f7d1a157-3228-490e-a6a0-68f6bd2b52ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:33:00 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-2ffa9003-3fa0-4d20-9cc8-e3d618a434e3 req-68d575ae-68da-42e3-b8b4-0fb5143765fc service nova] Lock "f7d1a157-3228-490e-a6a0-68f6bd2b52ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:33:00 user nova-compute[75122]: DEBUG nova.compute.manager [req-2ffa9003-3fa0-4d20-9cc8-e3d618a434e3 req-68d575ae-68da-42e3-b8b4-0fb5143765fc service nova] [instance: f7d1a157-3228-490e-a6a0-68f6bd2b52ba] No waiting events found dispatching network-vif-unplugged-caf104ef-b652-4038-8203-76f14e4b666b {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:33:00 user nova-compute[75122]: WARNING nova.compute.manager [req-2ffa9003-3fa0-4d20-9cc8-e3d618a434e3 req-68d575ae-68da-42e3-b8b4-0fb5143765fc service nova] [instance: f7d1a157-3228-490e-a6a0-68f6bd2b52ba] Received unexpected event network-vif-unplugged-caf104ef-b652-4038-8203-76f14e4b666b for instance with vm_state active and task_state shelving.
Nov 15 09:33:00 user nova-compute[75122]: DEBUG nova.virt.libvirt.guest [None req-ece8ad2b-5ee2-425d-85db-88632b803dda tempest-TestVolumeSwap-69301659 tempest-TestVolumeSwap-69301659-project-admin] COPY block job progress, current cursor: 149946368 final cursor: 1073741824 {{(pid=75122) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 09:33:00 user nova-compute[75122]: INFO nova.virt.libvirt.driver [-] [instance: f7d1a157-3228-490e-a6a0-68f6bd2b52ba] Instance destroyed successfully.
Nov 15 09:33:00 user nova-compute[75122]: DEBUG nova.compute.manager [None req-53332102-8575-4ce8-8c41-4bea29d1b9e2 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] [instance: f7d1a157-3228-490e-a6a0-68f6bd2b52ba] Checking state {{(pid=75122) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 09:33:00 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-53332102-8575-4ce8-8c41-4bea29d1b9e2 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] Acquiring lock "refresh_cache-f7d1a157-3228-490e-a6a0-68f6bd2b52ba" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 09:33:00 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-53332102-8575-4ce8-8c41-4bea29d1b9e2 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] Acquired lock "refresh_cache-f7d1a157-3228-490e-a6a0-68f6bd2b52ba" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 09:33:00 user nova-compute[75122]: DEBUG nova.network.neutron [None req-53332102-8575-4ce8-8c41-4bea29d1b9e2 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] [instance: f7d1a157-3228-490e-a6a0-68f6bd2b52ba] Building network info cache for instance {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 09:33:01 user nova-compute[75122]: DEBUG nova.virt.libvirt.guest [None req-ece8ad2b-5ee2-425d-85db-88632b803dda tempest-TestVolumeSwap-69301659 tempest-TestVolumeSwap-69301659-project-admin] COPY block job progress, current cursor: 276824064 final cursor: 1073741824 {{(pid=75122) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 09:33:01 user nova-compute[75122]: DEBUG nova.network.neutron [None req-53332102-8575-4ce8-8c41-4bea29d1b9e2 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] [instance: f7d1a157-3228-490e-a6a0-68f6bd2b52ba] Updating instance_info_cache with network_info: [{"id": "caf104ef-b652-4038-8203-76f14e4b666b", "address": "fa:16:3e:6f:84:74", "network": {"id": "a2e4fc06-5a74-45cd-b530-6dd240bfd068", "bridge": "br-int", "label": "tempest-TestShelveInstance-1307896814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea59215474b04143951de2b9453a33ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcaf104ef-b6", "ovs_interfaceid": "caf104ef-b652-4038-8203-76f14e4b666b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:33:01 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-53332102-8575-4ce8-8c41-4bea29d1b9e2 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] Releasing lock "refresh_cache-f7d1a157-3228-490e-a6a0-68f6bd2b52ba" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 09:33:01 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:33:01 user nova-compute[75122]: DEBUG nova.virt.libvirt.guest [None req-ece8ad2b-5ee2-425d-85db-88632b803dda tempest-TestVolumeSwap-69301659 tempest-TestVolumeSwap-69301659-project-admin] COPY block job progress, current cursor: 346030080 final cursor: 1073741824 {{(pid=75122) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 09:33:02 user nova-compute[75122]: INFO nova.virt.libvirt.driver [-] [instance: f7d1a157-3228-490e-a6a0-68f6bd2b52ba] Instance destroyed successfully.
Nov 15 09:33:02 user nova-compute[75122]: DEBUG nova.objects.instance [None req-53332102-8575-4ce8-8c41-4bea29d1b9e2 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] Lazy-loading 'resources' on Instance uuid f7d1a157-3228-490e-a6a0-68f6bd2b52ba {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:33:02 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-53332102-8575-4ce8-8c41-4bea29d1b9e2 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T09:31:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-603494418',display_name='tempest-TestShelveInstance-server-603494418',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-603494418',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM1TXRuKGvJllPKsSM4nK/OBu35HIJIsxtD/v6uaAXCLNb3zEXMlSeDAMlpm1t/haK5aaWNbGgYXswqBLiz9PJ0GAIgGVUKBoNe3Kg7RG2viWDF+pHu6wjy1e1B8GyF19A==',key_name='tempest-TestShelveInstance-571538458',keypairs=<?>,launch_index=0,launched_at=2023-11-15T09:31:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ea59215474b04143951de2b9453a33ad',ramdisk_id='',reservation_id='r-rwg3hjam',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1849491535',owner_user_name='tempest-TestShelveInstance-1849491535-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T09:31:21Z,user_data=None,user_id='f9f813d56e87487498cb9f8454ea1651',uuid=f7d1a157-3228-490e-a6a0-68f6bd2b52ba,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "caf104ef-b652-4038-8203-76f14e4b666b", "address": "fa:16:3e:6f:84:74", "network": {"id": "a2e4fc06-5a74-45cd-b530-6dd240bfd068", "bridge": "br-int", "label": "tempest-TestShelveInstance-1307896814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea59215474b04143951de2b9453a33ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcaf104ef-b6", "ovs_interfaceid": "caf104ef-b652-4038-8203-76f14e4b666b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 09:33:02 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-53332102-8575-4ce8-8c41-4bea29d1b9e2 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] Converting VIF {"id": "caf104ef-b652-4038-8203-76f14e4b666b", "address": "fa:16:3e:6f:84:74", "network": {"id": "a2e4fc06-5a74-45cd-b530-6dd240bfd068", "bridge": "br-int", "label": "tempest-TestShelveInstance-1307896814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea59215474b04143951de2b9453a33ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcaf104ef-b6", "ovs_interfaceid": "caf104ef-b652-4038-8203-76f14e4b666b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 09:33:02 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-53332102-8575-4ce8-8c41-4bea29d1b9e2 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:84:74,bridge_name='br-int',has_traffic_filtering=True,id=caf104ef-b652-4038-8203-76f14e4b666b,network=Network(a2e4fc06-5a74-45cd-b530-6dd240bfd068),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcaf104ef-b6') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 09:33:02 user nova-compute[75122]: DEBUG os_vif [None req-53332102-8575-4ce8-8c41-4bea29d1b9e2 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:84:74,bridge_name='br-int',has_traffic_filtering=True,id=caf104ef-b652-4038-8203-76f14e4b666b,network=Network(a2e4fc06-5a74-45cd-b530-6dd240bfd068),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcaf104ef-b6') {{(pid=75122) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 09:33:02 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:33:02 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcaf104ef-b6, bridge=br-int, if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:33:02 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:33:02 user nova-compute[75122]: DEBUG nova.compute.manager [req-d0ad5bbb-1803-42bc-8ea8-11a6f7a986d4 req-021b87cf-9a29-48fd-b68c-390160bcab09 service nova] [instance: f7d1a157-3228-490e-a6a0-68f6bd2b52ba] Received event network-changed-caf104ef-b652-4038-8203-76f14e4b666b {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:33:02 user nova-compute[75122]: DEBUG nova.compute.manager [req-d0ad5bbb-1803-42bc-8ea8-11a6f7a986d4 req-021b87cf-9a29-48fd-b68c-390160bcab09 service nova] [instance: f7d1a157-3228-490e-a6a0-68f6bd2b52ba] Refreshing instance network info cache due to event network-changed-caf104ef-b652-4038-8203-76f14e4b666b. {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 09:33:02 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-d0ad5bbb-1803-42bc-8ea8-11a6f7a986d4 req-021b87cf-9a29-48fd-b68c-390160bcab09 service nova] Acquiring lock "refresh_cache-f7d1a157-3228-490e-a6a0-68f6bd2b52ba" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 09:33:02 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-d0ad5bbb-1803-42bc-8ea8-11a6f7a986d4 req-021b87cf-9a29-48fd-b68c-390160bcab09 service nova] Acquired lock "refresh_cache-f7d1a157-3228-490e-a6a0-68f6bd2b52ba" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 09:33:02 user nova-compute[75122]: DEBUG nova.network.neutron [req-d0ad5bbb-1803-42bc-8ea8-11a6f7a986d4 req-021b87cf-9a29-48fd-b68c-390160bcab09 service nova] [instance: f7d1a157-3228-490e-a6a0-68f6bd2b52ba] Refreshing network info cache for port caf104ef-b652-4038-8203-76f14e4b666b {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 09:33:02 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:33:02 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:33:02 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f4400662-c0f3-429c-9648-8e4aa5a25e93) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:33:02 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:33:02 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:33:02 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:33:02 user nova-compute[75122]: INFO os_vif [None req-53332102-8575-4ce8-8c41-4bea29d1b9e2 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:84:74,bridge_name='br-int',has_traffic_filtering=True,id=caf104ef-b652-4038-8203-76f14e4b666b,network=Network(a2e4fc06-5a74-45cd-b530-6dd240bfd068),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcaf104ef-b6')
Nov 15 09:33:02 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-53332102-8575-4ce8-8c41-4bea29d1b9e2 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] [instance: f7d1a157-3228-490e-a6a0-68f6bd2b52ba] calling os-brick to detach iSCSI Volume {{(pid=75122) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 09:33:02 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-53332102-8575-4ce8-8c41-4bea29d1b9e2 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffa04060b80>, {'target_iqn': 'iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pufAUkHv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 09:33:02 user nova-compute[75122]: WARNING os_brick.initiator.connectors.base [None req-53332102-8575-4ce8-8c41-4bea29d1b9e2 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 09:33:02 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-53332102-8575-4ce8-8c41-4bea29d1b9e2 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 09:33:02 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-53332102-8575-4ce8-8c41-4bea29d1b9e2 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 09:33:02 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:33:02 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:33:02 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[89802812-f90a-4fb3-876f-849069774147]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5cb8eb00-0379-40d5-972c-9565fe412df4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0796957f-5a19-4fe2-acb8-f3568399150a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:085fd119-574c-4b24-bf7c-8076479d01c3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:33:02 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-53332102-8575-4ce8-8c41-4bea29d1b9e2 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 09:33:02 user nova-compute[75122]: No targets found.
Nov 15 09:33:02 user nova-compute[75122]: iSNS:
Nov 15 09:33:02 user nova-compute[75122]: No targets found.
Nov 15 09:33:02 user nova-compute[75122]: STATIC:
Nov 15 09:33:02 user nova-compute[75122]: Target: iqn.2010-10.org.openstack:5cb8eb00-0379-40d5-972c-9565fe412df4
Nov 15 09:33:02 user nova-compute[75122]:         Portal: 172.16.0.220:3260,-1
Nov 15 09:33:02 user nova-compute[75122]:                 Iface Name: default
Nov 15 09:33:02 user nova-compute[75122]: Target: iqn.2010-10.org.openstack:0796957f-5a19-4fe2-acb8-f3568399150a
Nov 15 09:33:02 user nova-compute[75122]:         Portal: 172.16.0.220:3260,-1
Nov 15 09:33:02 user nova-compute[75122]:                 Iface Name: default
Nov 15 09:33:02 user nova-compute[75122]: Target: iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e
Nov 15 09:33:02 user nova-compute[75122]:         Portal: 172.16.0.220:3260,-1
Nov 15 09:33:02 user nova-compute[75122]:                 Iface Name: default
Nov 15 09:33:02 user nova-compute[75122]: Target: iqn.2010-10.org.openstack:085fd119-574c-4b24-bf7c-8076479d01c3
Nov 15 09:33:02 user nova-compute[75122]:         Portal: 172.16.0.220:3260,-1
Nov 15 09:33:02 user nova-compute[75122]:                 Iface Name: default
Nov 15 09:33:02 user nova-compute[75122]: FIRMWARE:
Nov 15 09:33:02 user nova-compute[75122]: No targets found.
Nov 15 09:33:02 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 09:33:02 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-53332102-8575-4ce8-8c41-4bea29d1b9e2 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 09:33:02 user nova-compute[75122]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 09:33:02 user nova-compute[75122]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75122) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 09:33:02 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-53332102-8575-4ce8-8c41-4bea29d1b9e2 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e', 0)] {{(pid=75122) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 09:33:02 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:33:02 user nova-compute[75122]: DEBUG nova.virt.libvirt.guest [None req-ece8ad2b-5ee2-425d-85db-88632b803dda tempest-TestVolumeSwap-69301659 tempest-TestVolumeSwap-69301659-project-admin] COPY block job progress, current cursor: 509607936 final cursor: 1073741824 {{(pid=75122) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 09:33:02 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:33:02 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e3f568d-bc60-4266-9e23-f73c21e5ce05]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0796957f-5a19-4fe2-acb8-f3568399150a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:085fd119-574c-4b24-bf7c-8076479d01c3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5cb8eb00-0379-40d5-972c-9565fe412df4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:33:02 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:33:02 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:33:02 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[398b9df7-7205-4074-97b5-610792e166bf]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cb8eb00-0379-40d5-972c-9565fe412df4 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:085fd119-574c-4b24-bf7c-8076479d01c3 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0796957f-5a19-4fe2-acb8-f3568399150a (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e (non-flash)\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:33:02 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-53332102-8575-4ce8-8c41-4bea29d1b9e2 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cb8eb00-0379-40d5-972c-9565fe412df4 (non-flash)
Nov 15 09:33:02 user nova-compute[75122]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:085fd119-574c-4b24-bf7c-8076479d01c3 (non-flash)
Nov 15 09:33:02 user nova-compute[75122]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0796957f-5a19-4fe2-acb8-f3568399150a (non-flash)
Nov 15 09:33:02 user nova-compute[75122]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e (non-flash)
Nov 15 09:33:02 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 09:33:02 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-53332102-8575-4ce8-8c41-4bea29d1b9e2 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cb8eb00-0379-40d5-972c-9565fe412df4 (non-flash)
Nov 15 09:33:02 user nova-compute[75122]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:085fd119-574c-4b24-bf7c-8076479d01c3 (non-flash)
Nov 15 09:33:02 user nova-compute[75122]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0796957f-5a19-4fe2-acb8-f3568399150a (non-flash)
Nov 15 09:33:02 user nova-compute[75122]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e (non-flash)
Nov 15 09:33:02 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 09:33:02 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-53332102-8575-4ce8-8c41-4bea29d1b9e2 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff9fc25f5b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e'): ({'sdb'}, set())}) {{(pid=75122) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 09:33:02 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-53332102-8575-4ce8-8c41-4bea29d1b9e2 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] Removing single pathed devices sdb {{(pid=75122) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 09:33:02 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:33:02 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.029s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:33:02 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[57c3cbcc-4d6b-4c2f-8437-5b74af8f256e]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:33:02 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:33:02 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.026s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:33:02 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[765d1948-ec7b-4136-9435-66ac45b86def]: (4, ('ok\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:33:02 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-53332102-8575-4ce8-8c41-4bea29d1b9e2 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] Flushing IO for device /dev/sdb {{(pid=75122) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 09:33:02 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:33:02 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:33:02 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad004fcc-beb2-4238-83e1-1a3f02ed5591]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:33:02 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-53332102-8575-4ce8-8c41-4bea29d1b9e2 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75122) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 09:33:02 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:33:02 user nova-compute[75122]: DEBUG nova.compute.manager [req-ab4e96bd-e803-42c7-8e33-43d824714d9d req-ef8b3b27-ca9d-43b2-8d49-c1facb05adac service nova] [instance: f7d1a157-3228-490e-a6a0-68f6bd2b52ba] Received event network-vif-plugged-caf104ef-b652-4038-8203-76f14e4b666b {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:33:02 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-ab4e96bd-e803-42c7-8e33-43d824714d9d req-ef8b3b27-ca9d-43b2-8d49-c1facb05adac service nova] Acquiring lock "f7d1a157-3228-490e-a6a0-68f6bd2b52ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:33:02 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-ab4e96bd-e803-42c7-8e33-43d824714d9d req-ef8b3b27-ca9d-43b2-8d49-c1facb05adac service nova] Lock "f7d1a157-3228-490e-a6a0-68f6bd2b52ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:33:02 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-ab4e96bd-e803-42c7-8e33-43d824714d9d req-ef8b3b27-ca9d-43b2-8d49-c1facb05adac service nova] Lock "f7d1a157-3228-490e-a6a0-68f6bd2b52ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:33:02 user nova-compute[75122]: DEBUG nova.compute.manager [req-ab4e96bd-e803-42c7-8e33-43d824714d9d req-ef8b3b27-ca9d-43b2-8d49-c1facb05adac service nova] [instance: f7d1a157-3228-490e-a6a0-68f6bd2b52ba] No waiting events found dispatching network-vif-plugged-caf104ef-b652-4038-8203-76f14e4b666b {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:33:02 user nova-compute[75122]: WARNING nova.compute.manager [req-ab4e96bd-e803-42c7-8e33-43d824714d9d req-ef8b3b27-ca9d-43b2-8d49-c1facb05adac service nova] [instance: f7d1a157-3228-490e-a6a0-68f6bd2b52ba] Received unexpected event network-vif-plugged-caf104ef-b652-4038-8203-76f14e4b666b for instance with vm_state active and task_state shelving.
Nov 15 09:33:02 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.055s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:33:02 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[10089b2d-3c28-4f06-ae8f-c0d70ddf26c7]: (4, ('1', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:33:02 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-53332102-8575-4ce8-8c41-4bea29d1b9e2 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75122) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 09:33:02 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-53332102-8575-4ce8-8c41-4bea29d1b9e2 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] SCSI volumes sdb have been removed. {{(pid=75122) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 09:33:02 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-53332102-8575-4ce8-8c41-4bea29d1b9e2 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e')] {{(pid=75122) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 09:33:02 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:33:02 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.033s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:33:02 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[899952ac-c2bc-4478-a74f-764f780f7f2c]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:33:02 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-53332102-8575-4ce8-8c41-4bea29d1b9e2 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:33:02 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e -p 172.16.0.220:3260 --logout {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:33:02 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:33:02 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bef66be-eac6-474f-b7f8-375c6b3c3d8c]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:33:02 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-53332102-8575-4ce8-8c41-4bea29d1b9e2 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e, portal: 172.16.0.220,3260]
Nov 15 09:33:02 user nova-compute[75122]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e, portal: 172.16.0.220,3260] successful.
Nov 15 09:33:02 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:33:02 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e -p 172.16.0.220:3260 --op delete {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:33:02 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:33:02 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ee13d3e-d2e8-459b-a0a6-c1af40207867]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:33:02 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-53332102-8575-4ce8-8c41-4bea29d1b9e2 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:33:02 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-53332102-8575-4ce8-8c41-4bea29d1b9e2 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.404s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 09:33:02 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-53332102-8575-4ce8-8c41-4bea29d1b9e2 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] <== disconnect_volume: return (407ms) None {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 09:33:02 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-53332102-8575-4ce8-8c41-4bea29d1b9e2 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] [instance: f7d1a157-3228-490e-a6a0-68f6bd2b52ba] Disconnected iSCSI Volume {{(pid=75122) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 09:33:02 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-53332102-8575-4ce8-8c41-4bea29d1b9e2 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] [instance: f7d1a157-3228-490e-a6a0-68f6bd2b52ba] Deleting instance files /opt/stack/data/nova/instances/f7d1a157-3228-490e-a6a0-68f6bd2b52ba_del
Nov 15 09:33:02 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-53332102-8575-4ce8-8c41-4bea29d1b9e2 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] [instance: f7d1a157-3228-490e-a6a0-68f6bd2b52ba] Deletion of /opt/stack/data/nova/instances/f7d1a157-3228-490e-a6a0-68f6bd2b52ba_del complete
Nov 15 09:33:02 user nova-compute[75122]: DEBUG nova.network.neutron [req-d0ad5bbb-1803-42bc-8ea8-11a6f7a986d4 req-021b87cf-9a29-48fd-b68c-390160bcab09 service nova] [instance: f7d1a157-3228-490e-a6a0-68f6bd2b52ba] Updated VIF entry in instance network info cache for port caf104ef-b652-4038-8203-76f14e4b666b. {{(pid=75122) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 09:33:02 user nova-compute[75122]: DEBUG nova.network.neutron [req-d0ad5bbb-1803-42bc-8ea8-11a6f7a986d4 req-021b87cf-9a29-48fd-b68c-390160bcab09 service nova] [instance: f7d1a157-3228-490e-a6a0-68f6bd2b52ba] Updating instance_info_cache with network_info: [{"id": "caf104ef-b652-4038-8203-76f14e4b666b", "address": "fa:16:3e:6f:84:74", "network": {"id": "a2e4fc06-5a74-45cd-b530-6dd240bfd068", "bridge": null, "label": "tempest-TestShelveInstance-1307896814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea59215474b04143951de2b9453a33ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapcaf104ef-b6", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:33:02 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-d0ad5bbb-1803-42bc-8ea8-11a6f7a986d4 req-021b87cf-9a29-48fd-b68c-390160bcab09 service nova] Releasing lock "refresh_cache-f7d1a157-3228-490e-a6a0-68f6bd2b52ba" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 09:33:02 user nova-compute[75122]: DEBUG nova.virt.libvirt.guest [None req-ece8ad2b-5ee2-425d-85db-88632b803dda tempest-TestVolumeSwap-69301659 tempest-TestVolumeSwap-69301659-project-admin] COPY block job progress, current cursor: 634388480 final cursor: 1073741824 {{(pid=75122) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 09:33:03 user nova-compute[75122]: DEBUG nova.virt.libvirt.guest [None req-ece8ad2b-5ee2-425d-85db-88632b803dda tempest-TestVolumeSwap-69301659 tempest-TestVolumeSwap-69301659-project-admin] COPY block job progress, current cursor: 753926144 final cursor: 1073741824 {{(pid=75122) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 09:33:03 user nova-compute[75122]: DEBUG nova.virt.libvirt.guest [None req-ece8ad2b-5ee2-425d-85db-88632b803dda tempest-TestVolumeSwap-69301659 tempest-TestVolumeSwap-69301659-project-admin] COPY block job progress, current cursor: 824180736 final cursor: 1073741824 {{(pid=75122) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 09:33:04 user nova-compute[75122]: INFO nova.scheduler.client.report [None req-53332102-8575-4ce8-8c41-4bea29d1b9e2 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] Deleted allocations for instance f7d1a157-3228-490e-a6a0-68f6bd2b52ba
Nov 15 09:33:04 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-53332102-8575-4ce8-8c41-4bea29d1b9e2 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:33:04 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-53332102-8575-4ce8-8c41-4bea29d1b9e2 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:33:04 user nova-compute[75122]: DEBUG nova.objects.instance [None req-53332102-8575-4ce8-8c41-4bea29d1b9e2 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] Lazy-loading 'numa_topology' on Instance uuid f7d1a157-3228-490e-a6a0-68f6bd2b52ba {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:33:04 user nova-compute[75122]: DEBUG nova.objects.base [None req-53332102-8575-4ce8-8c41-4bea29d1b9e2 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] Object Instance<f7d1a157-3228-490e-a6a0-68f6bd2b52ba> lazy-loaded attributes: resources,numa_topology {{(pid=75122) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 09:33:04 user nova-compute[75122]: DEBUG nova.virt.libvirt.guest [None req-ece8ad2b-5ee2-425d-85db-88632b803dda tempest-TestVolumeSwap-69301659 tempest-TestVolumeSwap-69301659-project-admin] COPY block job progress, current cursor: 1016070144 final cursor: 1073741824 {{(pid=75122) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 09:33:04 user nova-compute[75122]: DEBUG nova.compute.provider_tree [None req-53332102-8575-4ce8-8c41-4bea29d1b9e2 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] Inventory has not changed in ProviderTree for provider: 69a3da65-47be-44c6-b67c-c692b58284ef {{(pid=75122) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 09:33:04 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-53332102-8575-4ce8-8c41-4bea29d1b9e2 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] Inventory has not changed for provider 69a3da65-47be-44c6-b67c-c692b58284ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 09:33:04 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-53332102-8575-4ce8-8c41-4bea29d1b9e2 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.327s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:33:04 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-53332102-8575-4ce8-8c41-4bea29d1b9e2 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] Lock "f7d1a157-3228-490e-a6a0-68f6bd2b52ba" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 4.441s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:33:04 user nova-compute[75122]: DEBUG nova.virt.libvirt.guest [None req-ece8ad2b-5ee2-425d-85db-88632b803dda tempest-TestVolumeSwap-69301659 tempest-TestVolumeSwap-69301659-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=75122) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 09:33:04 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:33:04 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ece8ad2b-5ee2-425d-85db-88632b803dda tempest-TestVolumeSwap-69301659 tempest-TestVolumeSwap-69301659-project-admin] [instance: d24a189e-2de9-404e-b281-224c150a5bbf] calling os-brick to detach iSCSI Volume {{(pid=75122) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 09:33:04 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-ece8ad2b-5ee2-425d-85db-88632b803dda tempest-TestVolumeSwap-69301659 tempest-TestVolumeSwap-69301659-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffa04060b80>, {'target_iqn': 'iqn.2010-10.org.openstack:5cb8eb00-0379-40d5-972c-9565fe412df4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eqxYPwfD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf', 'volume_id': '5cb8eb00-0379-40d5-972c-9565fe412df4'}, None), 'kwargs': False}}" {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 09:33:04 user nova-compute[75122]: WARNING os_brick.initiator.connectors.base [None req-ece8ad2b-5ee2-425d-85db-88632b803dda tempest-TestVolumeSwap-69301659 tempest-TestVolumeSwap-69301659-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 09:33:04 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-ece8ad2b-5ee2-425d-85db-88632b803dda tempest-TestVolumeSwap-69301659 tempest-TestVolumeSwap-69301659-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 09:33:04 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-ece8ad2b-5ee2-425d-85db-88632b803dda tempest-TestVolumeSwap-69301659 tempest-TestVolumeSwap-69301659-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 09:33:04 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:33:04 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:33:04 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[f25a89ec-dd35-4bd0-8e09-81524cbe6308]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5cb8eb00-0379-40d5-972c-9565fe412df4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0796957f-5a19-4fe2-acb8-f3568399150a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:085fd119-574c-4b24-bf7c-8076479d01c3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:33:04 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-ece8ad2b-5ee2-425d-85db-88632b803dda tempest-TestVolumeSwap-69301659 tempest-TestVolumeSwap-69301659-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 09:33:04 user nova-compute[75122]: No targets found.
Nov 15 09:33:04 user nova-compute[75122]: iSNS:
Nov 15 09:33:04 user nova-compute[75122]: No targets found.
Nov 15 09:33:04 user nova-compute[75122]: STATIC:
Nov 15 09:33:04 user nova-compute[75122]: Target: iqn.2010-10.org.openstack:5cb8eb00-0379-40d5-972c-9565fe412df4
Nov 15 09:33:04 user nova-compute[75122]:         Portal: 172.16.0.220:3260,-1
Nov 15 09:33:04 user nova-compute[75122]:                 Iface Name: default
Nov 15 09:33:04 user nova-compute[75122]: Target: iqn.2010-10.org.openstack:0796957f-5a19-4fe2-acb8-f3568399150a
Nov 15 09:33:04 user nova-compute[75122]:         Portal: 172.16.0.220:3260,-1
Nov 15 09:33:04 user nova-compute[75122]:                 Iface Name: default
Nov 15 09:33:04 user nova-compute[75122]: Target: iqn.2010-10.org.openstack:085fd119-574c-4b24-bf7c-8076479d01c3
Nov 15 09:33:04 user nova-compute[75122]:         Portal: 172.16.0.220:3260,-1
Nov 15 09:33:04 user nova-compute[75122]:                 Iface Name: default
Nov 15 09:33:04 user nova-compute[75122]: FIRMWARE:
Nov 15 09:33:04 user nova-compute[75122]: No targets found.
Nov 15 09:33:04 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 09:33:04 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-ece8ad2b-5ee2-425d-85db-88632b803dda tempest-TestVolumeSwap-69301659 tempest-TestVolumeSwap-69301659-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 09:33:04 user nova-compute[75122]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 09:33:04 user nova-compute[75122]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75122) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 09:33:04 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-ece8ad2b-5ee2-425d-85db-88632b803dda tempest-TestVolumeSwap-69301659 tempest-TestVolumeSwap-69301659-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5cb8eb00-0379-40d5-972c-9565fe412df4', 0)] {{(pid=75122) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 09:33:04 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:33:05 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:33:05 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[56ba256d-f952-4986-98b8-324344d38e7b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0796957f-5a19-4fe2-acb8-f3568399150a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:085fd119-574c-4b24-bf7c-8076479d01c3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5cb8eb00-0379-40d5-972c-9565fe412df4\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:33:05 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:33:05 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:33:05 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[79388bdd-7989-4186-8d52-666a485afc76]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cb8eb00-0379-40d5-972c-9565fe412df4 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:085fd119-574c-4b24-bf7c-8076479d01c3 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0796957f-5a19-4fe2-acb8-f3568399150a (non-flash)\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:33:05 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-ece8ad2b-5ee2-425d-85db-88632b803dda tempest-TestVolumeSwap-69301659 tempest-TestVolumeSwap-69301659-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cb8eb00-0379-40d5-972c-9565fe412df4 (non-flash)
Nov 15 09:33:05 user nova-compute[75122]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:085fd119-574c-4b24-bf7c-8076479d01c3 (non-flash)
Nov 15 09:33:05 user nova-compute[75122]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0796957f-5a19-4fe2-acb8-f3568399150a (non-flash)
Nov 15 09:33:05 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 09:33:05 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-ece8ad2b-5ee2-425d-85db-88632b803dda tempest-TestVolumeSwap-69301659 tempest-TestVolumeSwap-69301659-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5cb8eb00-0379-40d5-972c-9565fe412df4 (non-flash)
Nov 15 09:33:05 user nova-compute[75122]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:085fd119-574c-4b24-bf7c-8076479d01c3 (non-flash)
Nov 15 09:33:05 user nova-compute[75122]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0796957f-5a19-4fe2-acb8-f3568399150a (non-flash)
Nov 15 09:33:05 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 09:33:05 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-ece8ad2b-5ee2-425d-85db-88632b803dda tempest-TestVolumeSwap-69301659 tempest-TestVolumeSwap-69301659-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff9fc3d4790>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5cb8eb00-0379-40d5-972c-9565fe412df4'): ({'sdf'}, set())}) {{(pid=75122) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 09:33:05 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-ece8ad2b-5ee2-425d-85db-88632b803dda tempest-TestVolumeSwap-69301659 tempest-TestVolumeSwap-69301659-project-admin] Removing single pathed devices sdf {{(pid=75122) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 09:33:05 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:33:05 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:33:05 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[609eee7c-6763-47fd-8e0d-c03b3fddde0c]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:33:05 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:33:05 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.016s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:33:05 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[1419fe4e-542c-4026-af94-e2f527f9844f]: (4, ('ok\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:33:05 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-ece8ad2b-5ee2-425d-85db-88632b803dda tempest-TestVolumeSwap-69301659 tempest-TestVolumeSwap-69301659-project-admin] Flushing IO for device /dev/sdf {{(pid=75122) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 09:33:05 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:33:05 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.012s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:33:05 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca9dd756-b702-45cf-ace3-ac3b10461469]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:33:05 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-ece8ad2b-5ee2-425d-85db-88632b803dda tempest-TestVolumeSwap-69301659 tempest-TestVolumeSwap-69301659-project-admin] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75122) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 09:33:05 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:33:05 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.041s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:33:05 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[118d31ab-c6a6-4262-a546-31586060e4a5]: (4, ('1', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:33:05 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-ece8ad2b-5ee2-425d-85db-88632b803dda tempest-TestVolumeSwap-69301659 tempest-TestVolumeSwap-69301659-project-admin] Checking to see if SCSI volumes sdf have been removed. {{(pid=75122) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 09:33:05 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-ece8ad2b-5ee2-425d-85db-88632b803dda tempest-TestVolumeSwap-69301659 tempest-TestVolumeSwap-69301659-project-admin] SCSI volumes sdf have been removed. {{(pid=75122) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 09:33:05 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-ece8ad2b-5ee2-425d-85db-88632b803dda tempest-TestVolumeSwap-69301659 tempest-TestVolumeSwap-69301659-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5cb8eb00-0379-40d5-972c-9565fe412df4')] {{(pid=75122) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 09:33:05 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5cb8eb00-0379-40d5-972c-9565fe412df4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:33:05 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5cb8eb00-0379-40d5-972c-9565fe412df4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.016s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:33:05 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[94567562-c1e8-43de-af73-c5afd6edcb84]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:33:05 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-ece8ad2b-5ee2-425d-85db-88632b803dda tempest-TestVolumeSwap-69301659 tempest-TestVolumeSwap-69301659-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:33:05 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5cb8eb00-0379-40d5-972c-9565fe412df4 -p 172.16.0.220:3260 --logout {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:33:05 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5cb8eb00-0379-40d5-972c-9565fe412df4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:33:05 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[a53a4297-25b1-4d06-9e8f-a74238132769]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:5cb8eb00-0379-40d5-972c-9565fe412df4, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:5cb8eb00-0379-40d5-972c-9565fe412df4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:33:05 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-ece8ad2b-5ee2-425d-85db-88632b803dda tempest-TestVolumeSwap-69301659 tempest-TestVolumeSwap-69301659-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:5cb8eb00-0379-40d5-972c-9565fe412df4, portal: 172.16.0.220,3260]
Nov 15 09:33:05 user nova-compute[75122]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:5cb8eb00-0379-40d5-972c-9565fe412df4, portal: 172.16.0.220,3260] successful.
Nov 15 09:33:05 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:33:05 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5cb8eb00-0379-40d5-972c-9565fe412df4 -p 172.16.0.220:3260 --op delete {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:33:05 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5cb8eb00-0379-40d5-972c-9565fe412df4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:33:05 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[827a2138-e222-4326-96bc-21f69f8e8ee1]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:33:05 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-ece8ad2b-5ee2-425d-85db-88632b803dda tempest-TestVolumeSwap-69301659 tempest-TestVolumeSwap-69301659-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:33:05 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-ece8ad2b-5ee2-425d-85db-88632b803dda tempest-TestVolumeSwap-69301659 tempest-TestVolumeSwap-69301659-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.274s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 09:33:05 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-ece8ad2b-5ee2-425d-85db-88632b803dda tempest-TestVolumeSwap-69301659 tempest-TestVolumeSwap-69301659-project-admin] <== disconnect_volume: return (275ms) None {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 09:33:05 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ece8ad2b-5ee2-425d-85db-88632b803dda tempest-TestVolumeSwap-69301659 tempest-TestVolumeSwap-69301659-project-admin] [instance: d24a189e-2de9-404e-b281-224c150a5bbf] Disconnected iSCSI Volume {{(pid=75122) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 09:33:05 user nova-compute[75122]: DEBUG nova.compute.manager [None req-ece8ad2b-5ee2-425d-85db-88632b803dda tempest-TestVolumeSwap-69301659 tempest-TestVolumeSwap-69301659-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0796957f-5a19-4fe2-acb8-f3568399150a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KPflkmYs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': 'd24a189e-2de9-404e-b281-224c150a5bbf', 'attached_at': '', 'detached_at': '', 'volume_id': '0796957f-5a19-4fe2-acb8-f3568399150a', 'serial'} {{(pid=75122) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 15 09:33:05 user nova-compute[75122]: DEBUG nova.compute.manager [None req-ece8ad2b-5ee2-425d-85db-88632b803dda tempest-TestVolumeSwap-69301659 tempest-TestVolumeSwap-69301659-project-admin] [instance: d24a189e-2de9-404e-b281-224c150a5bbf] swap_volume: removing Cinder connection for volume 5cb8eb00-0379-40d5-972c-9565fe412df4 {{(pid=75122) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 15 09:33:06 user nova-compute[75122]: DEBUG nova.compute.manager [None req-ece8ad2b-5ee2-425d-85db-88632b803dda tempest-TestVolumeSwap-69301659 tempest-TestVolumeSwap-69301659-project-admin] [instance: d24a189e-2de9-404e-b281-224c150a5bbf] swap_volume: Updating volume 5cb8eb00-0379-40d5-972c-9565fe412df4 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:0796957f-5a19-4fe2-acb8-f3568399150a", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "KPflkmYs", "auth_password": "gQX3Yn4jfspu7y", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdc", "volume_id": "0796957f-5a19-4fe2-acb8-f3568399150a"}, "status": "reserved", "instance": "d24a189e-2de9-404e-b281-224c150a5bbf", "attached_at": "", "detached_at": "", "volume_id": "0796957f-5a19-4fe2-acb8-f3568399150a", "serial": "0796957f-5a19-4fe2-acb8-f3568399150a"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '0796957f-5a19-4fe2-acb8-f3568399150a', 'no_device': None, 'attachment_id': '1e1c6369-3c45-4260-9f7f-4d7abdf502fe'} {{(pid=75122) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 15 09:33:06 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-ece8ad2b-5ee2-425d-85db-88632b803dda tempest-TestVolumeSwap-69301659 tempest-TestVolumeSwap-69301659-project-admin] Lock "d24a189e-2de9-404e-b281-224c150a5bbf" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 12.298s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:33:06 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:33:07 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:33:07 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:33:07 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75122) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 09:33:07 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0d20b13b-59a4-4a27-93b4-94ac06d36b9c tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] Acquiring lock "d24a189e-2de9-404e-b281-224c150a5bbf" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:33:07 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0d20b13b-59a4-4a27-93b4-94ac06d36b9c tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] Lock "d24a189e-2de9-404e-b281-224c150a5bbf" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:33:07 user nova-compute[75122]: INFO nova.compute.manager [None req-0d20b13b-59a4-4a27-93b4-94ac06d36b9c tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] [instance: d24a189e-2de9-404e-b281-224c150a5bbf] Detaching volume 0796957f-5a19-4fe2-acb8-f3568399150a
Nov 15 09:33:07 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:33:07 user nova-compute[75122]: INFO nova.virt.block_device [None req-0d20b13b-59a4-4a27-93b4-94ac06d36b9c tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] [instance: d24a189e-2de9-404e-b281-224c150a5bbf] Attempting to driver detach volume 0796957f-5a19-4fe2-acb8-f3568399150a from mountpoint /dev/vdb
Nov 15 09:33:07 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-0d20b13b-59a4-4a27-93b4-94ac06d36b9c tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] Attempting to detach device vdb from instance d24a189e-2de9-404e-b281-224c150a5bbf from the persistent domain config. {{(pid=75122) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 09:33:07 user nova-compute[75122]: DEBUG nova.virt.libvirt.guest [None req-0d20b13b-59a4-4a27-93b4-94ac06d36b9c tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 09:33:07 user nova-compute[75122]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 09:33:07 user nova-compute[75122]:   <source dev="/dev/sdc"/>
Nov 15 09:33:07 user nova-compute[75122]:   <target dev="vdb" bus="virtio"/>
Nov 15 09:33:07 user nova-compute[75122]:   <serial>0796957f-5a19-4fe2-acb8-f3568399150a</serial>
Nov 15 09:33:07 user nova-compute[75122]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 09:33:07 user nova-compute[75122]: </disk>
Nov 15 09:33:07 user nova-compute[75122]:  {{(pid=75122) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 09:33:07 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-0d20b13b-59a4-4a27-93b4-94ac06d36b9c tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] Successfully detached device vdb from instance d24a189e-2de9-404e-b281-224c150a5bbf from the persistent domain config.
Nov 15 09:33:07 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-0d20b13b-59a4-4a27-93b4-94ac06d36b9c tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d24a189e-2de9-404e-b281-224c150a5bbf from the live domain config. {{(pid=75122) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 09:33:07 user nova-compute[75122]: DEBUG nova.virt.libvirt.guest [None req-0d20b13b-59a4-4a27-93b4-94ac06d36b9c tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 09:33:07 user nova-compute[75122]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 09:33:07 user nova-compute[75122]:   <source dev="/dev/sdc"/>
Nov 15 09:33:07 user nova-compute[75122]:   <target dev="vdb" bus="virtio"/>
Nov 15 09:33:07 user nova-compute[75122]:   <serial>0796957f-5a19-4fe2-acb8-f3568399150a</serial>
Nov 15 09:33:07 user nova-compute[75122]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 09:33:07 user nova-compute[75122]: </disk>
Nov 15 09:33:07 user nova-compute[75122]:  {{(pid=75122) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 09:33:07 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-0d20b13b-59a4-4a27-93b4-94ac06d36b9c tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d24a189e-2de9-404e-b281-224c150a5bbf {{(pid=75122) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 09:33:08 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:33:09 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:33:09 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:33:09 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:33:10 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:33:10 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:33:10 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:33:10 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:33:10 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:33:10 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75122) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 09:33:10 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee961d5a-e0d1-4931-9293-eefbe638097a/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:33:10 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee961d5a-e0d1-4931-9293-eefbe638097a/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:33:10 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee961d5a-e0d1-4931-9293-eefbe638097a/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:33:10 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee961d5a-e0d1-4931-9293-eefbe638097a/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:33:10 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cfb60cb-011e-4537-9f28-55ea7d6dfc13/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:33:11 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cfb60cb-011e-4537-9f28-55ea7d6dfc13/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:33:11 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cfb60cb-011e-4537-9f28-55ea7d6dfc13/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:33:11 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-96e0ba80-4473-42a6-9a81-dc1917e741bc tempest-VolumesAssistedSnapshotsTest-336030675 tempest-VolumesAssistedSnapshotsTest-336030675-project-admin] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 9cfb60cb-011e-4537-9f28-55ea7d6dfc13 is timed out.
Nov 15 09:33:11 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-96e0ba80-4473-42a6-9a81-dc1917e741bc tempest-VolumesAssistedSnapshotsTest-336030675 tempest-VolumesAssistedSnapshotsTest-336030675-project-admin] Successfully detached device vdb from instance 9cfb60cb-011e-4537-9f28-55ea7d6dfc13 from the live domain config.
Nov 15 09:33:11 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-96e0ba80-4473-42a6-9a81-dc1917e741bc tempest-VolumesAssistedSnapshotsTest-336030675 tempest-VolumesAssistedSnapshotsTest-336030675-project-admin] [instance: 9cfb60cb-011e-4537-9f28-55ea7d6dfc13] calling os-brick to detach iSCSI Volume {{(pid=75122) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 09:33:11 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-96e0ba80-4473-42a6-9a81-dc1917e741bc tempest-VolumesAssistedSnapshotsTest-336030675 tempest-VolumesAssistedSnapshotsTest-336030675-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffa04060b80>, {'target_iqn': 'iqn.2010-10.org.openstack:085fd119-574c-4b24-bf7c-8076479d01c3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oSHOlNqD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 09:33:11 user nova-compute[75122]: WARNING os_brick.initiator.connectors.base [None req-96e0ba80-4473-42a6-9a81-dc1917e741bc tempest-VolumesAssistedSnapshotsTest-336030675 tempest-VolumesAssistedSnapshotsTest-336030675-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 09:33:11 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-96e0ba80-4473-42a6-9a81-dc1917e741bc tempest-VolumesAssistedSnapshotsTest-336030675 tempest-VolumesAssistedSnapshotsTest-336030675-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 09:33:11 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-96e0ba80-4473-42a6-9a81-dc1917e741bc tempest-VolumesAssistedSnapshotsTest-336030675 tempest-VolumesAssistedSnapshotsTest-336030675-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 09:33:11 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:33:11 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:33:11 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[78e68bf0-949e-4e08-8872-af81322a801e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0796957f-5a19-4fe2-acb8-f3568399150a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:085fd119-574c-4b24-bf7c-8076479d01c3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:33:11 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-96e0ba80-4473-42a6-9a81-dc1917e741bc tempest-VolumesAssistedSnapshotsTest-336030675 tempest-VolumesAssistedSnapshotsTest-336030675-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 09:33:11 user nova-compute[75122]: No targets found.
Nov 15 09:33:11 user nova-compute[75122]: iSNS:
Nov 15 09:33:11 user nova-compute[75122]: No targets found.
Nov 15 09:33:11 user nova-compute[75122]: STATIC:
Nov 15 09:33:11 user nova-compute[75122]: Target: iqn.2010-10.org.openstack:0796957f-5a19-4fe2-acb8-f3568399150a
Nov 15 09:33:11 user nova-compute[75122]:         Portal: 172.16.0.220:3260,-1
Nov 15 09:33:11 user nova-compute[75122]:                 Iface Name: default
Nov 15 09:33:11 user nova-compute[75122]: Target: iqn.2010-10.org.openstack:085fd119-574c-4b24-bf7c-8076479d01c3
Nov 15 09:33:11 user nova-compute[75122]:         Portal: 172.16.0.220:3260,-1
Nov 15 09:33:11 user nova-compute[75122]:                 Iface Name: default
Nov 15 09:33:11 user nova-compute[75122]: FIRMWARE:
Nov 15 09:33:11 user nova-compute[75122]: No targets found.
Nov 15 09:33:11 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 09:33:11 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-96e0ba80-4473-42a6-9a81-dc1917e741bc tempest-VolumesAssistedSnapshotsTest-336030675 tempest-VolumesAssistedSnapshotsTest-336030675-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 09:33:11 user nova-compute[75122]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 09:33:11 user nova-compute[75122]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75122) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 09:33:11 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-96e0ba80-4473-42a6-9a81-dc1917e741bc tempest-VolumesAssistedSnapshotsTest-336030675 tempest-VolumesAssistedSnapshotsTest-336030675-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:085fd119-574c-4b24-bf7c-8076479d01c3', 0)] {{(pid=75122) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 09:33:11 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:33:11 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:33:11 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[81260e47-b867-4d24-8c9a-084e6b0ac061]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0796957f-5a19-4fe2-acb8-f3568399150a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:085fd119-574c-4b24-bf7c-8076479d01c3\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:33:11 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:33:11 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:33:11 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[76fcb8be-15fc-465d-9896-5ee0e31408c0]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:085fd119-574c-4b24-bf7c-8076479d01c3 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0796957f-5a19-4fe2-acb8-f3568399150a (non-flash)\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:33:11 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-96e0ba80-4473-42a6-9a81-dc1917e741bc tempest-VolumesAssistedSnapshotsTest-336030675 tempest-VolumesAssistedSnapshotsTest-336030675-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:085fd119-574c-4b24-bf7c-8076479d01c3 (non-flash)
Nov 15 09:33:11 user nova-compute[75122]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0796957f-5a19-4fe2-acb8-f3568399150a (non-flash)
Nov 15 09:33:11 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 09:33:11 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-96e0ba80-4473-42a6-9a81-dc1917e741bc tempest-VolumesAssistedSnapshotsTest-336030675 tempest-VolumesAssistedSnapshotsTest-336030675-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:085fd119-574c-4b24-bf7c-8076479d01c3 (non-flash)
Nov 15 09:33:11 user nova-compute[75122]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0796957f-5a19-4fe2-acb8-f3568399150a (non-flash)
Nov 15 09:33:11 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 09:33:11 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-96e0ba80-4473-42a6-9a81-dc1917e741bc tempest-VolumesAssistedSnapshotsTest-336030675 tempest-VolumesAssistedSnapshotsTest-336030675-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff9fc3a6c20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:085fd119-574c-4b24-bf7c-8076479d01c3'): ({'sdg'}, set())}) {{(pid=75122) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 09:33:11 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-96e0ba80-4473-42a6-9a81-dc1917e741bc tempest-VolumesAssistedSnapshotsTest-336030675 tempest-VolumesAssistedSnapshotsTest-336030675-project-admin] Removing single pathed devices sdg {{(pid=75122) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 09:33:11 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:33:11 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:33:11 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[f55e6e04-b600-4d8d-bf00-d04392b9e53e]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:33:11 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:33:11 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:33:11 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.020s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:33:11 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[df8be5e4-d9aa-4f25-b354-f0d21245b90a]: (4, ('ok\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:33:11 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-96e0ba80-4473-42a6-9a81-dc1917e741bc tempest-VolumesAssistedSnapshotsTest-336030675 tempest-VolumesAssistedSnapshotsTest-336030675-project-admin] Flushing IO for device /dev/sdg {{(pid=75122) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 09:33:11 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9cfb60cb-011e-4537-9f28-55ea7d6dfc13/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:33:11 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:33:11 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/131142fd-e8ec-42d1-a518-aa21c7bb7cb1/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:33:11 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.012s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:33:11 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[38c9bd90-cd29-462a-8d6b-56bcb24e445a]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:33:11 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-96e0ba80-4473-42a6-9a81-dc1917e741bc tempest-VolumesAssistedSnapshotsTest-336030675 tempest-VolumesAssistedSnapshotsTest-336030675-project-admin] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75122) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 09:33:11 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:33:11 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.036s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:33:11 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cd85e1c-fcca-4c44-965b-53524dc03053]: (4, ('1', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:33:11 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-96e0ba80-4473-42a6-9a81-dc1917e741bc tempest-VolumesAssistedSnapshotsTest-336030675 tempest-VolumesAssistedSnapshotsTest-336030675-project-admin] Checking to see if SCSI volumes sdg have been removed. {{(pid=75122) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 09:33:11 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-96e0ba80-4473-42a6-9a81-dc1917e741bc tempest-VolumesAssistedSnapshotsTest-336030675 tempest-VolumesAssistedSnapshotsTest-336030675-project-admin] SCSI volumes sdg have been removed. {{(pid=75122) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 09:33:11 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-96e0ba80-4473-42a6-9a81-dc1917e741bc tempest-VolumesAssistedSnapshotsTest-336030675 tempest-VolumesAssistedSnapshotsTest-336030675-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:085fd119-574c-4b24-bf7c-8076479d01c3')] {{(pid=75122) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 09:33:11 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:085fd119-574c-4b24-bf7c-8076479d01c3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:33:11 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:085fd119-574c-4b24-bf7c-8076479d01c3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.016s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:33:11 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[a375e8a8-71db-4389-8497-b369dd4ceaed]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:33:11 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-96e0ba80-4473-42a6-9a81-dc1917e741bc tempest-VolumesAssistedSnapshotsTest-336030675 tempest-VolumesAssistedSnapshotsTest-336030675-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:33:11 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:085fd119-574c-4b24-bf7c-8076479d01c3 -p 172.16.0.220:3260 --logout {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:33:11 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:085fd119-574c-4b24-bf7c-8076479d01c3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:33:11 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d6f2b26-1bfb-4c45-9145-109b43db28e1]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:085fd119-574c-4b24-bf7c-8076479d01c3, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:085fd119-574c-4b24-bf7c-8076479d01c3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:33:11 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-96e0ba80-4473-42a6-9a81-dc1917e741bc tempest-VolumesAssistedSnapshotsTest-336030675 tempest-VolumesAssistedSnapshotsTest-336030675-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:085fd119-574c-4b24-bf7c-8076479d01c3, portal: 172.16.0.220,3260]
Nov 15 09:33:11 user nova-compute[75122]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:085fd119-574c-4b24-bf7c-8076479d01c3, portal: 172.16.0.220,3260] successful.
Nov 15 09:33:11 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:33:11 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:085fd119-574c-4b24-bf7c-8076479d01c3 -p 172.16.0.220:3260 --op delete {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:33:11 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/131142fd-e8ec-42d1-a518-aa21c7bb7cb1/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:33:11 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/131142fd-e8ec-42d1-a518-aa21c7bb7cb1/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:33:11 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:085fd119-574c-4b24-bf7c-8076479d01c3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:33:11 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[b51a5430-1232-4c4b-ba8a-778b2e911cba]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:33:11 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-96e0ba80-4473-42a6-9a81-dc1917e741bc tempest-VolumesAssistedSnapshotsTest-336030675 tempest-VolumesAssistedSnapshotsTest-336030675-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:33:11 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-96e0ba80-4473-42a6-9a81-dc1917e741bc tempest-VolumesAssistedSnapshotsTest-336030675 tempest-VolumesAssistedSnapshotsTest-336030675-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.350s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 09:33:11 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-96e0ba80-4473-42a6-9a81-dc1917e741bc tempest-VolumesAssistedSnapshotsTest-336030675 tempest-VolumesAssistedSnapshotsTest-336030675-project-admin] <== disconnect_volume: return (352ms) None {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 09:33:11 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-96e0ba80-4473-42a6-9a81-dc1917e741bc tempest-VolumesAssistedSnapshotsTest-336030675 tempest-VolumesAssistedSnapshotsTest-336030675-project-admin] [instance: 9cfb60cb-011e-4537-9f28-55ea7d6dfc13] Disconnected iSCSI Volume {{(pid=75122) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 09:33:11 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/131142fd-e8ec-42d1-a518-aa21c7bb7cb1/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:33:11 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d24a189e-2de9-404e-b281-224c150a5bbf/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:33:11 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d24a189e-2de9-404e-b281-224c150a5bbf/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:33:11 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d24a189e-2de9-404e-b281-224c150a5bbf/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:33:11 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-de97beac-4671-46e9-856c-1c18c459c3a7 tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] Waiting for libvirt event about the detach of device tapce0d75c2-85 with device alias net1 from instance e0f32160-7130-4b9c-aa9c-84123f3a6b32 is timed out.
Nov 15 09:33:11 user nova-compute[75122]: DEBUG nova.virt.libvirt.guest [None req-de97beac-4671-46e9-856c-1c18c459c3a7 tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:9e:53:27"/><model type="virtio"/><mtu size="1442"/><target dev="tapce0d75c2-85"/></interface> {{(pid=75122) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 15 09:33:11 user nova-compute[75122]: DEBUG nova.virt.libvirt.guest [None req-de97beac-4671-46e9-856c-1c18c459c3a7 tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:9e:53:27"/><model type="virtio"/><mtu size="1442"/><target dev="tapce0d75c2-85"/></interface>not found in domain: <domain type='kvm' id='5'>
Nov 15 09:33:11 user nova-compute[75122]:   <name>instance-00000005</name>
Nov 15 09:33:11 user nova-compute[75122]:   <uuid>e0f32160-7130-4b9c-aa9c-84123f3a6b32</uuid>
Nov 15 09:33:11 user nova-compute[75122]:   <metadata>
Nov 15 09:33:11 user nova-compute[75122]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 09:33:11 user nova-compute[75122]:   <nova:package version="0.0.0"/>
Nov 15 09:33:11 user nova-compute[75122]:   <nova:name>tempest-device-tagging-server-650907307</nova:name>
Nov 15 09:33:11 user nova-compute[75122]:   <nova:creationTime>2023-11-15 09:32:20</nova:creationTime>
Nov 15 09:33:11 user nova-compute[75122]:   <nova:flavor name="m1.tiny">
Nov 15 09:33:11 user nova-compute[75122]:     <nova:memory>512</nova:memory>
Nov 15 09:33:11 user nova-compute[75122]:     <nova:disk>1</nova:disk>
Nov 15 09:33:11 user nova-compute[75122]:     <nova:swap>0</nova:swap>
Nov 15 09:33:11 user nova-compute[75122]:     <nova:ephemeral>0</nova:ephemeral>
Nov 15 09:33:11 user nova-compute[75122]:     <nova:vcpus>1</nova:vcpus>
Nov 15 09:33:11 user nova-compute[75122]:   </nova:flavor>
Nov 15 09:33:11 user nova-compute[75122]:   <nova:owner>
Nov 15 09:33:11 user nova-compute[75122]:     <nova:user uuid="d2529e19d29e4120b6e8ae75e16bb5b6">tempest-TaggedAttachmentsTest-2027876138-project-member</nova:user>
Nov 15 09:33:11 user nova-compute[75122]:     <nova:project uuid="6082a9c95d70462586e1f1195b43a383">tempest-TaggedAttachmentsTest-2027876138</nova:project>
Nov 15 09:33:11 user nova-compute[75122]:   </nova:owner>
Nov 15 09:33:11 user nova-compute[75122]:   <nova:root type="image" uuid="5e862cfe-47b8-4725-8292-65761ee6d0f5"/>
Nov 15 09:33:11 user nova-compute[75122]:   <nova:ports>
Nov 15 09:33:11 user nova-compute[75122]:     <nova:port uuid="0d48c0d7-8a0f-4bfa-b8b7-290f122c3f4a">
Nov 15 09:33:11 user nova-compute[75122]:       <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 15 09:33:11 user nova-compute[75122]:     </nova:port>
Nov 15 09:33:11 user nova-compute[75122]:     <nova:port uuid="ce0d75c2-85b4-4e49-8d42-767b17493e53">
Nov 15 09:33:11 user nova-compute[75122]:       <nova:ip type="fixed" address="10.10.10.10" ipVersion="4"/>
Nov 15 09:33:11 user nova-compute[75122]:     </nova:port>
Nov 15 09:33:11 user nova-compute[75122]:   </nova:ports>
Nov 15 09:33:11 user nova-compute[75122]: </nova:instance>
Nov 15 09:33:11 user nova-compute[75122]:   </metadata>
Nov 15 09:33:11 user nova-compute[75122]:   <memory unit='KiB'>524288</memory>
Nov 15 09:33:11 user nova-compute[75122]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 15 09:33:11 user nova-compute[75122]:   <vcpu placement='static'>1</vcpu>
Nov 15 09:33:11 user nova-compute[75122]:   <resource>
Nov 15 09:33:11 user nova-compute[75122]:     <partition>/machine</partition>
Nov 15 09:33:11 user nova-compute[75122]:   </resource>
Nov 15 09:33:11 user nova-compute[75122]:   <sysinfo type='smbios'>
Nov 15 09:33:11 user nova-compute[75122]:     <system>
Nov 15 09:33:11 user nova-compute[75122]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 15 09:33:11 user nova-compute[75122]:       <entry name='product'>OpenStack Nova</entry>
Nov 15 09:33:11 user nova-compute[75122]:       <entry name='version'>0.0.0</entry>
Nov 15 09:33:11 user nova-compute[75122]:       <entry name='serial'>e0f32160-7130-4b9c-aa9c-84123f3a6b32</entry>
Nov 15 09:33:11 user nova-compute[75122]:       <entry name='uuid'>e0f32160-7130-4b9c-aa9c-84123f3a6b32</entry>
Nov 15 09:33:11 user nova-compute[75122]:       <entry name='family'>Virtual Machine</entry>
Nov 15 09:33:11 user nova-compute[75122]:     </system>
Nov 15 09:33:11 user nova-compute[75122]:   </sysinfo>
Nov 15 09:33:11 user nova-compute[75122]:   <os>
Nov 15 09:33:11 user nova-compute[75122]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 15 09:33:11 user nova-compute[75122]:     <boot dev='hd'/>
Nov 15 09:33:11 user nova-compute[75122]:     <smbios mode='sysinfo'/>
Nov 15 09:33:11 user nova-compute[75122]:   </os>
Nov 15 09:33:11 user nova-compute[75122]:   <features>
Nov 15 09:33:11 user nova-compute[75122]:     <acpi/>
Nov 15 09:33:11 user nova-compute[75122]:     <apic/>
Nov 15 09:33:11 user nova-compute[75122]:     <vmcoreinfo state='on'/>
Nov 15 09:33:11 user nova-compute[75122]:   </features>
Nov 15 09:33:11 user nova-compute[75122]:   <cpu mode='custom' match='exact' check='full'>
Nov 15 09:33:11 user nova-compute[75122]:     <model fallback='forbid'>Nehalem</model>
Nov 15 09:33:11 user nova-compute[75122]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 15 09:33:11 user nova-compute[75122]:     <feature policy='require' name='vme'/>
Nov 15 09:33:11 user nova-compute[75122]:     <feature policy='require' name='x2apic'/>
Nov 15 09:33:11 user nova-compute[75122]:     <feature policy='require' name='hypervisor'/>
Nov 15 09:33:11 user nova-compute[75122]:   </cpu>
Nov 15 09:33:11 user nova-compute[75122]:   <clock offset='utc'>
Nov 15 09:33:11 user nova-compute[75122]:     <timer name='pit' tickpolicy='delay'/>
Nov 15 09:33:11 user nova-compute[75122]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 15 09:33:11 user nova-compute[75122]:     <timer name='hpet' present='no'/>
Nov 15 09:33:11 user nova-compute[75122]:   </clock>
Nov 15 09:33:11 user nova-compute[75122]:   <on_poweroff>destroy</on_poweroff>
Nov 15 09:33:11 user nova-compute[75122]:   <on_reboot>restart</on_reboot>
Nov 15 09:33:11 user nova-compute[75122]:   <on_crash>destroy</on_crash>
Nov 15 09:33:11 user nova-compute[75122]:   <devices>
Nov 15 09:33:11 user nova-compute[75122]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 15 09:33:11 user nova-compute[75122]:     <disk type='file' device='disk'>
Nov 15 09:33:11 user nova-compute[75122]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 15 09:33:11 user nova-compute[75122]:       <source file='/opt/stack/data/nova/instances/e0f32160-7130-4b9c-aa9c-84123f3a6b32/disk' index='2'/>
Nov 15 09:33:11 user nova-compute[75122]:       <backingStore type='file' index='3'>
Nov 15 09:33:11 user nova-compute[75122]:         <format type='raw'/>
Nov 15 09:33:11 user nova-compute[75122]:         <source file='/opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665'/>
Nov 15 09:33:11 user nova-compute[75122]:         <backingStore/>
Nov 15 09:33:11 user nova-compute[75122]:       </backingStore>
Nov 15 09:33:11 user nova-compute[75122]:       <target dev='vda' bus='virtio'/>
Nov 15 09:33:11 user nova-compute[75122]:       <alias name='virtio-disk0'/>
Nov 15 09:33:11 user nova-compute[75122]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 15 09:33:11 user nova-compute[75122]:     </disk>
Nov 15 09:33:11 user nova-compute[75122]:     <disk type='file' device='cdrom'>
Nov 15 09:33:11 user nova-compute[75122]:       <driver name='qemu' type='raw' cache='none'/>
Nov 15 09:33:11 user nova-compute[75122]:       <source file='/opt/stack/data/nova/instances/e0f32160-7130-4b9c-aa9c-84123f3a6b32/disk.config' index='1'/>
Nov 15 09:33:11 user nova-compute[75122]:       <backingStore/>
Nov 15 09:33:11 user nova-compute[75122]:       <target dev='hda' bus='ide'/>
Nov 15 09:33:11 user nova-compute[75122]:       <readonly/>
Nov 15 09:33:11 user nova-compute[75122]:       <alias name='ide0-0-0'/>
Nov 15 09:33:11 user nova-compute[75122]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 15 09:33:11 user nova-compute[75122]:     </disk>
Nov 15 09:33:11 user nova-compute[75122]:     <controller type='usb' index='0' model='none'>
Nov 15 09:33:11 user nova-compute[75122]:       <alias name='usb'/>
Nov 15 09:33:11 user nova-compute[75122]:     </controller>
Nov 15 09:33:11 user nova-compute[75122]:     <controller type='pci' index='0' model='pci-root'>
Nov 15 09:33:11 user nova-compute[75122]:       <alias name='pci.0'/>
Nov 15 09:33:11 user nova-compute[75122]:     </controller>
Nov 15 09:33:11 user nova-compute[75122]:     <controller type='ide' index='0'>
Nov 15 09:33:11 user nova-compute[75122]:       <alias name='ide'/>
Nov 15 09:33:11 user nova-compute[75122]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 15 09:33:11 user nova-compute[75122]:     </controller>
Nov 15 09:33:11 user nova-compute[75122]:     <interface type='ethernet'>
Nov 15 09:33:11 user nova-compute[75122]:       <mac address='fa:16:3e:fd:20:4e'/>
Nov 15 09:33:11 user nova-compute[75122]:       <target dev='tap0d48c0d7-8a'/>
Nov 15 09:33:11 user nova-compute[75122]:       <model type='virtio'/>
Nov 15 09:33:11 user nova-compute[75122]:       <mtu size='1442'/>
Nov 15 09:33:11 user nova-compute[75122]:       <alias name='net0'/>
Nov 15 09:33:11 user nova-compute[75122]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 15 09:33:11 user nova-compute[75122]:     </interface>
Nov 15 09:33:11 user nova-compute[75122]:     <serial type='pty'>
Nov 15 09:33:11 user nova-compute[75122]:       <source path='/dev/pts/4'/>
Nov 15 09:33:11 user nova-compute[75122]:       <log file='/opt/stack/data/nova/instances/e0f32160-7130-4b9c-aa9c-84123f3a6b32/console.log' append='off'/>
Nov 15 09:33:11 user nova-compute[75122]:       <target type='isa-serial' port='0'>
Nov 15 09:33:11 user nova-compute[75122]:         <model name='isa-serial'/>
Nov 15 09:33:11 user nova-compute[75122]:       </target>
Nov 15 09:33:11 user nova-compute[75122]:       <alias name='serial0'/>
Nov 15 09:33:11 user nova-compute[75122]:     </serial>
Nov 15 09:33:11 user nova-compute[75122]:     <console type='pty' tty='/dev/pts/4'>
Nov 15 09:33:11 user nova-compute[75122]:       <source path='/dev/pts/4'/>
Nov 15 09:33:11 user nova-compute[75122]:       <log file='/opt/stack/data/nova/instances/e0f32160-7130-4b9c-aa9c-84123f3a6b32/console.log' append='off'/>
Nov 15 09:33:11 user nova-compute[75122]:       <target type='serial' port='0'/>
Nov 15 09:33:11 user nova-compute[75122]:       <alias name='serial0'/>
Nov 15 09:33:11 user nova-compute[75122]:     </console>
Nov 15 09:33:11 user nova-compute[75122]:     <input type='mouse' bus='ps2'>
Nov 15 09:33:11 user nova-compute[75122]:       <alias name='input0'/>
Nov 15 09:33:11 user nova-compute[75122]:     </input>
Nov 15 09:33:11 user nova-compute[75122]:     <input type='keyboard' bus='ps2'>
Nov 15 09:33:11 user nova-compute[75122]:       <alias name='input1'/>
Nov 15 09:33:11 user nova-compute[75122]:     </input>
Nov 15 09:33:11 user nova-compute[75122]:     <graphics type='vnc' port='5904' autoport='yes' listen='0.0.0.0'>
Nov 15 09:33:11 user nova-compute[75122]:       <listen type='address' address='0.0.0.0'/>
Nov 15 09:33:11 user nova-compute[75122]:     </graphics>
Nov 15 09:33:11 user nova-compute[75122]:     <audio id='1' type='none'/>
Nov 15 09:33:11 user nova-compute[75122]:     <video>
Nov 15 09:33:11 user nova-compute[75122]:       <model type='virtio' heads='1' primary='yes'/>
Nov 15 09:33:11 user nova-compute[75122]:       <alias name='video0'/>
Nov 15 09:33:11 user nova-compute[75122]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 15 09:33:11 user nova-compute[75122]:     </video>
Nov 15 09:33:11 user nova-compute[75122]:     <memballoon model='virtio'>
Nov 15 09:33:11 user nova-compute[75122]:       <stats period='10'/>
Nov 15 09:33:11 user nova-compute[75122]:       <alias name='balloon0'/>
Nov 15 09:33:11 user nova-compute[75122]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 15 09:33:11 user nova-compute[75122]:     </memballoon>
Nov 15 09:33:11 user nova-compute[75122]:     <rng model='virtio'>
Nov 15 09:33:11 user nova-compute[75122]:       <backend model='random'>/dev/urandom</backend>
Nov 15 09:33:11 user nova-compute[75122]:       <alias name='rng0'/>
Nov 15 09:33:11 user nova-compute[75122]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 15 09:33:11 user nova-compute[75122]:     </rng>
Nov 15 09:33:11 user nova-compute[75122]:   </devices>
Nov 15 09:33:11 user nova-compute[75122]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 15 09:33:11 user nova-compute[75122]:     <label>libvirt-e0f32160-7130-4b9c-aa9c-84123f3a6b32</label>
Nov 15 09:33:11 user nova-compute[75122]:     <imagelabel>libvirt-e0f32160-7130-4b9c-aa9c-84123f3a6b32</imagelabel>
Nov 15 09:33:11 user nova-compute[75122]:   </seclabel>
Nov 15 09:33:11 user nova-compute[75122]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 15 09:33:11 user nova-compute[75122]:     <label>+64055:+108</label>
Nov 15 09:33:11 user nova-compute[75122]:     <imagelabel>+64055:+108</imagelabel>
Nov 15 09:33:11 user nova-compute[75122]:   </seclabel>
Nov 15 09:33:11 user nova-compute[75122]: </domain>
Nov 15 09:33:11 user nova-compute[75122]:  {{(pid=75122) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 15 09:33:12 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-de97beac-4671-46e9-856c-1c18c459c3a7 tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] Successfully detached device tapce0d75c2-85 from instance e0f32160-7130-4b9c-aa9c-84123f3a6b32 from the live domain config.
Nov 15 09:33:12 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-de97beac-4671-46e9-856c-1c18c459c3a7 tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T09:30:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-650907307',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-650907307',id=5,image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEs+MsbbhvkEM+SFSEAT1XChvfwYG6LS4xClecFc1s5hPTjvnawfxaNFAntQJzNhhhBe9ISEtvpo31FTBvmrG/LNlyB/uvXRpPMaH35dzVkZDJmlCiGv/MxZIKKpRxaHLw==',key_name='tempest-keypair-2107215481',keypairs=<?>,launch_index=0,launched_at=2023-11-15T09:30:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6082a9c95d70462586e1f1195b43a383',ramdisk_id='',reservation_id='r-j04j8rw4',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-2027876138',owner_user_name='tempest-TaggedAttachmentsTest-2027876138-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T09:30:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d2529e19d29e4120b6e8ae75e16bb5b6',uuid=e0f32160-7130-4b9c-aa9c-84123f3a6b32,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ce0d75c2-85b4-4e49-8d42-767b17493e53", "address": "fa:16:3e:9e:53:27", "network": {"id": "517e7cda-b26b-4dca-9b2b-b8a52f1ef18b", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1110889298", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "6082a9c95d70462586e1f1195b43a383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce0d75c2-85", "ovs_interfaceid": "ce0d75c2-85b4-4e49-8d42-767b17493e53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 09:33:12 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-de97beac-4671-46e9-856c-1c18c459c3a7 tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] Converting VIF {"id": "ce0d75c2-85b4-4e49-8d42-767b17493e53", "address": "fa:16:3e:9e:53:27", "network": {"id": "517e7cda-b26b-4dca-9b2b-b8a52f1ef18b", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1110889298", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "6082a9c95d70462586e1f1195b43a383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce0d75c2-85", "ovs_interfaceid": "ce0d75c2-85b4-4e49-8d42-767b17493e53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 09:33:12 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-de97beac-4671-46e9-856c-1c18c459c3a7 tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:53:27,bridge_name='br-int',has_traffic_filtering=True,id=ce0d75c2-85b4-4e49-8d42-767b17493e53,network=Network(517e7cda-b26b-4dca-9b2b-b8a52f1ef18b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce0d75c2-85') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 09:33:12 user nova-compute[75122]: DEBUG os_vif [None req-de97beac-4671-46e9-856c-1c18c459c3a7 tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:53:27,bridge_name='br-int',has_traffic_filtering=True,id=ce0d75c2-85b4-4e49-8d42-767b17493e53,network=Network(517e7cda-b26b-4dca-9b2b-b8a52f1ef18b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce0d75c2-85') {{(pid=75122) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 09:33:12 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:33:12 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapce0d75c2-85, bridge=br-int, if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:33:12 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:33:12 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:33:12 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2126e3bb-3382-4dbf-a4ef-6a3f62fb10ac) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:33:12 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:33:12 user nova-compute[75122]: INFO os_vif [None req-de97beac-4671-46e9-856c-1c18c459c3a7 tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:53:27,bridge_name='br-int',has_traffic_filtering=True,id=ce0d75c2-85b4-4e49-8d42-767b17493e53,network=Network(517e7cda-b26b-4dca-9b2b-b8a52f1ef18b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce0d75c2-85')
Nov 15 09:33:12 user nova-compute[75122]: DEBUG nova.virt.libvirt.guest [None req-de97beac-4671-46e9-856c-1c18c459c3a7 tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 09:33:12 user nova-compute[75122]:   <nova:package version="0.0.0"/>
Nov 15 09:33:12 user nova-compute[75122]:   <nova:name>tempest-device-tagging-server-650907307</nova:name>
Nov 15 09:33:12 user nova-compute[75122]:   <nova:creationTime>2023-11-15 09:33:12</nova:creationTime>
Nov 15 09:33:12 user nova-compute[75122]:   <nova:flavor name="m1.tiny">
Nov 15 09:33:12 user nova-compute[75122]:     <nova:memory>512</nova:memory>
Nov 15 09:33:12 user nova-compute[75122]:     <nova:disk>1</nova:disk>
Nov 15 09:33:12 user nova-compute[75122]:     <nova:swap>0</nova:swap>
Nov 15 09:33:12 user nova-compute[75122]:     <nova:ephemeral>0</nova:ephemeral>
Nov 15 09:33:12 user nova-compute[75122]:     <nova:vcpus>1</nova:vcpus>
Nov 15 09:33:12 user nova-compute[75122]:   </nova:flavor>
Nov 15 09:33:12 user nova-compute[75122]:   <nova:owner>
Nov 15 09:33:12 user nova-compute[75122]:     <nova:user uuid="d2529e19d29e4120b6e8ae75e16bb5b6">tempest-TaggedAttachmentsTest-2027876138-project-member</nova:user>
Nov 15 09:33:12 user nova-compute[75122]:     <nova:project uuid="6082a9c95d70462586e1f1195b43a383">tempest-TaggedAttachmentsTest-2027876138</nova:project>
Nov 15 09:33:12 user nova-compute[75122]:   </nova:owner>
Nov 15 09:33:12 user nova-compute[75122]:   <nova:root type="image" uuid="5e862cfe-47b8-4725-8292-65761ee6d0f5"/>
Nov 15 09:33:12 user nova-compute[75122]:   <nova:ports>
Nov 15 09:33:12 user nova-compute[75122]:     <nova:port uuid="0d48c0d7-8a0f-4bfa-b8b7-290f122c3f4a">
Nov 15 09:33:12 user nova-compute[75122]:       <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 15 09:33:12 user nova-compute[75122]:     </nova:port>
Nov 15 09:33:12 user nova-compute[75122]:   </nova:ports>
Nov 15 09:33:12 user nova-compute[75122]: </nova:instance>
Nov 15 09:33:12 user nova-compute[75122]:  {{(pid=75122) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 15 09:33:12 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d24a189e-2de9-404e-b281-224c150a5bbf/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:33:12 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0f32160-7130-4b9c-aa9c-84123f3a6b32/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:33:12 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0f32160-7130-4b9c-aa9c-84123f3a6b32/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:33:12 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0f32160-7130-4b9c-aa9c-84123f3a6b32/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:33:12 user nova-compute[75122]: DEBUG nova.objects.instance [None req-96e0ba80-4473-42a6-9a81-dc1917e741bc tempest-VolumesAssistedSnapshotsTest-336030675 tempest-VolumesAssistedSnapshotsTest-336030675-project-admin] Lazy-loading 'flavor' on Instance uuid 9cfb60cb-011e-4537-9f28-55ea7d6dfc13 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:33:12 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-96e0ba80-4473-42a6-9a81-dc1917e741bc tempest-VolumesAssistedSnapshotsTest-336030675 tempest-VolumesAssistedSnapshotsTest-336030675-project-admin] Lock "9cfb60cb-011e-4537-9f28-55ea7d6dfc13" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.880s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:33:12 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0f32160-7130-4b9c-aa9c-84123f3a6b32/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:33:12 user nova-compute[75122]: DEBUG nova.compute.manager [req-3dea74e0-0d18-4c1f-810c-181a73cf539f req-ad962786-4f47-42fb-9f64-0e8f027cbbfb service nova] [instance: e0f32160-7130-4b9c-aa9c-84123f3a6b32] Received event network-vif-deleted-ce0d75c2-85b4-4e49-8d42-767b17493e53 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:33:12 user nova-compute[75122]: INFO nova.compute.manager [req-3dea74e0-0d18-4c1f-810c-181a73cf539f req-ad962786-4f47-42fb-9f64-0e8f027cbbfb service nova] [instance: e0f32160-7130-4b9c-aa9c-84123f3a6b32] Neutron deleted interface ce0d75c2-85b4-4e49-8d42-767b17493e53; detaching it from the instance and deleting it from the info cache
Nov 15 09:33:12 user nova-compute[75122]: DEBUG nova.network.neutron [req-3dea74e0-0d18-4c1f-810c-181a73cf539f req-ad962786-4f47-42fb-9f64-0e8f027cbbfb service nova] [instance: e0f32160-7130-4b9c-aa9c-84123f3a6b32] Updating instance_info_cache with network_info: [{"id": "0d48c0d7-8a0f-4bfa-b8b7-290f122c3f4a", "address": "fa:16:3e:fd:20:4e", "network": {"id": "46853cd4-ee0a-44fe-b185-8ef14e956701", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1452664326-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6082a9c95d70462586e1f1195b43a383", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d48c0d7-8a", "ovs_interfaceid": "0d48c0d7-8a0f-4bfa-b8b7-290f122c3f4a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:33:12 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:33:12 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 09:33:12 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 09:33:12 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Hypervisor/Node resource view: name=user free_ram=8257MB free_disk=25.61273193359375GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75122) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 09:33:12 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:33:12 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:33:12 user nova-compute[75122]: DEBUG nova.objects.instance [req-3dea74e0-0d18-4c1f-810c-181a73cf539f req-ad962786-4f47-42fb-9f64-0e8f027cbbfb service nova] Lazy-loading 'system_metadata' on Instance uuid e0f32160-7130-4b9c-aa9c-84123f3a6b32 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:33:12 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-de97beac-4671-46e9-856c-1c18c459c3a7 tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] Acquiring lock "refresh_cache-e0f32160-7130-4b9c-aa9c-84123f3a6b32" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 09:33:12 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-de97beac-4671-46e9-856c-1c18c459c3a7 tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] Acquired lock "refresh_cache-e0f32160-7130-4b9c-aa9c-84123f3a6b32" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 09:33:12 user nova-compute[75122]: DEBUG nova.network.neutron [None req-de97beac-4671-46e9-856c-1c18c459c3a7 tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] [instance: e0f32160-7130-4b9c-aa9c-84123f3a6b32] Building network info cache for instance {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 09:33:12 user nova-compute[75122]: DEBUG nova.objects.instance [req-3dea74e0-0d18-4c1f-810c-181a73cf539f req-ad962786-4f47-42fb-9f64-0e8f027cbbfb service nova] Lazy-loading 'flavor' on Instance uuid e0f32160-7130-4b9c-aa9c-84123f3a6b32 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:33:13 user nova-compute[75122]: DEBUG nova.objects.base [req-3dea74e0-0d18-4c1f-810c-181a73cf539f req-ad962786-4f47-42fb-9f64-0e8f027cbbfb service nova] Object Instance<e0f32160-7130-4b9c-aa9c-84123f3a6b32> lazy-loaded attributes: system_metadata,flavor {{(pid=75122) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 09:33:13 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [req-3dea74e0-0d18-4c1f-810c-181a73cf539f req-ad962786-4f47-42fb-9f64-0e8f027cbbfb service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T09:30:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-650907307',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-650907307',id=5,image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEs+MsbbhvkEM+SFSEAT1XChvfwYG6LS4xClecFc1s5hPTjvnawfxaNFAntQJzNhhhBe9ISEtvpo31FTBvmrG/LNlyB/uvXRpPMaH35dzVkZDJmlCiGv/MxZIKKpRxaHLw==',key_name='tempest-keypair-2107215481',keypairs=<?>,launch_index=0,launched_at=2023-11-15T09:30:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6082a9c95d70462586e1f1195b43a383',ramdisk_id='',reservation_id='r-j04j8rw4',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-2027876138',owner_user_name='tempest-TaggedAttachmentsTest-2027876138-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T09:30:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d2529e19d29e4120b6e8ae75e16bb5b6',uuid=e0f32160-7130-4b9c-aa9c-84123f3a6b32,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ce0d75c2-85b4-4e49-8d42-767b17493e53", "address": "fa:16:3e:9e:53:27", "network": {"id": "517e7cda-b26b-4dca-9b2b-b8a52f1ef18b", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1110889298", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "6082a9c95d70462586e1f1195b43a383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce0d75c2-85", "ovs_interfaceid": "ce0d75c2-85b4-4e49-8d42-767b17493e53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75122) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 09:33:13 user nova-compute[75122]: DEBUG nova.network.os_vif_util [req-3dea74e0-0d18-4c1f-810c-181a73cf539f req-ad962786-4f47-42fb-9f64-0e8f027cbbfb service nova] Converting VIF {"id": "ce0d75c2-85b4-4e49-8d42-767b17493e53", "address": "fa:16:3e:9e:53:27", "network": {"id": "517e7cda-b26b-4dca-9b2b-b8a52f1ef18b", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1110889298", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "6082a9c95d70462586e1f1195b43a383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce0d75c2-85", "ovs_interfaceid": "ce0d75c2-85b4-4e49-8d42-767b17493e53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 09:33:13 user nova-compute[75122]: DEBUG nova.network.os_vif_util [req-3dea74e0-0d18-4c1f-810c-181a73cf539f req-ad962786-4f47-42fb-9f64-0e8f027cbbfb service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:53:27,bridge_name='br-int',has_traffic_filtering=True,id=ce0d75c2-85b4-4e49-8d42-767b17493e53,network=Network(517e7cda-b26b-4dca-9b2b-b8a52f1ef18b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce0d75c2-85') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 09:33:13 user nova-compute[75122]: DEBUG nova.virt.libvirt.guest [req-3dea74e0-0d18-4c1f-810c-181a73cf539f req-ad962786-4f47-42fb-9f64-0e8f027cbbfb service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:9e:53:27"/><model type="virtio"/><mtu size="1442"/><target dev="tapce0d75c2-85"/></interface> {{(pid=75122) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 15 09:33:13 user nova-compute[75122]: DEBUG nova.virt.libvirt.guest [req-3dea74e0-0d18-4c1f-810c-181a73cf539f req-ad962786-4f47-42fb-9f64-0e8f027cbbfb service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:9e:53:27"/><model type="virtio"/><mtu size="1442"/><target dev="tapce0d75c2-85"/></interface>not found in domain: <domain type='kvm' id='5'>
Nov 15 09:33:13 user nova-compute[75122]:   <name>instance-00000005</name>
Nov 15 09:33:13 user nova-compute[75122]:   <uuid>e0f32160-7130-4b9c-aa9c-84123f3a6b32</uuid>
Nov 15 09:33:13 user nova-compute[75122]:   <metadata>
Nov 15 09:33:13 user nova-compute[75122]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 09:33:13 user nova-compute[75122]:   <nova:package version="0.0.0"/>
Nov 15 09:33:13 user nova-compute[75122]:   <nova:name>tempest-device-tagging-server-650907307</nova:name>
Nov 15 09:33:13 user nova-compute[75122]:   <nova:creationTime>2023-11-15 09:33:12</nova:creationTime>
Nov 15 09:33:13 user nova-compute[75122]:   <nova:flavor name="m1.tiny">
Nov 15 09:33:13 user nova-compute[75122]:     <nova:memory>512</nova:memory>
Nov 15 09:33:13 user nova-compute[75122]:     <nova:disk>1</nova:disk>
Nov 15 09:33:13 user nova-compute[75122]:     <nova:swap>0</nova:swap>
Nov 15 09:33:13 user nova-compute[75122]:     <nova:ephemeral>0</nova:ephemeral>
Nov 15 09:33:13 user nova-compute[75122]:     <nova:vcpus>1</nova:vcpus>
Nov 15 09:33:13 user nova-compute[75122]:   </nova:flavor>
Nov 15 09:33:13 user nova-compute[75122]:   <nova:owner>
Nov 15 09:33:13 user nova-compute[75122]:     <nova:user uuid="d2529e19d29e4120b6e8ae75e16bb5b6">tempest-TaggedAttachmentsTest-2027876138-project-member</nova:user>
Nov 15 09:33:13 user nova-compute[75122]:     <nova:project uuid="6082a9c95d70462586e1f1195b43a383">tempest-TaggedAttachmentsTest-2027876138</nova:project>
Nov 15 09:33:13 user nova-compute[75122]:   </nova:owner>
Nov 15 09:33:13 user nova-compute[75122]:   <nova:root type="image" uuid="5e862cfe-47b8-4725-8292-65761ee6d0f5"/>
Nov 15 09:33:13 user nova-compute[75122]:   <nova:ports>
Nov 15 09:33:13 user nova-compute[75122]:     <nova:port uuid="0d48c0d7-8a0f-4bfa-b8b7-290f122c3f4a">
Nov 15 09:33:13 user nova-compute[75122]:       <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 15 09:33:13 user nova-compute[75122]:     </nova:port>
Nov 15 09:33:13 user nova-compute[75122]:   </nova:ports>
Nov 15 09:33:13 user nova-compute[75122]: </nova:instance>
Nov 15 09:33:13 user nova-compute[75122]:   </metadata>
Nov 15 09:33:13 user nova-compute[75122]:   <memory unit='KiB'>524288</memory>
Nov 15 09:33:13 user nova-compute[75122]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 15 09:33:13 user nova-compute[75122]:   <vcpu placement='static'>1</vcpu>
Nov 15 09:33:13 user nova-compute[75122]:   <resource>
Nov 15 09:33:13 user nova-compute[75122]:     <partition>/machine</partition>
Nov 15 09:33:13 user nova-compute[75122]:   </resource>
Nov 15 09:33:13 user nova-compute[75122]:   <sysinfo type='smbios'>
Nov 15 09:33:13 user nova-compute[75122]:     <system>
Nov 15 09:33:13 user nova-compute[75122]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 15 09:33:13 user nova-compute[75122]:       <entry name='product'>OpenStack Nova</entry>
Nov 15 09:33:13 user nova-compute[75122]:       <entry name='version'>0.0.0</entry>
Nov 15 09:33:13 user nova-compute[75122]:       <entry name='serial'>e0f32160-7130-4b9c-aa9c-84123f3a6b32</entry>
Nov 15 09:33:13 user nova-compute[75122]:       <entry name='uuid'>e0f32160-7130-4b9c-aa9c-84123f3a6b32</entry>
Nov 15 09:33:13 user nova-compute[75122]:       <entry name='family'>Virtual Machine</entry>
Nov 15 09:33:13 user nova-compute[75122]:     </system>
Nov 15 09:33:13 user nova-compute[75122]:   </sysinfo>
Nov 15 09:33:13 user nova-compute[75122]:   <os>
Nov 15 09:33:13 user nova-compute[75122]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 15 09:33:13 user nova-compute[75122]:     <boot dev='hd'/>
Nov 15 09:33:13 user nova-compute[75122]:     <smbios mode='sysinfo'/>
Nov 15 09:33:13 user nova-compute[75122]:   </os>
Nov 15 09:33:13 user nova-compute[75122]:   <features>
Nov 15 09:33:13 user nova-compute[75122]:     <acpi/>
Nov 15 09:33:13 user nova-compute[75122]:     <apic/>
Nov 15 09:33:13 user nova-compute[75122]:     <vmcoreinfo state='on'/>
Nov 15 09:33:13 user nova-compute[75122]:   </features>
Nov 15 09:33:13 user nova-compute[75122]:   <cpu mode='custom' match='exact' check='full'>
Nov 15 09:33:13 user nova-compute[75122]:     <model fallback='forbid'>Nehalem</model>
Nov 15 09:33:13 user nova-compute[75122]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 15 09:33:13 user nova-compute[75122]:     <feature policy='require' name='vme'/>
Nov 15 09:33:13 user nova-compute[75122]:     <feature policy='require' name='x2apic'/>
Nov 15 09:33:13 user nova-compute[75122]:     <feature policy='require' name='hypervisor'/>
Nov 15 09:33:13 user nova-compute[75122]:   </cpu>
Nov 15 09:33:13 user nova-compute[75122]:   <clock offset='utc'>
Nov 15 09:33:13 user nova-compute[75122]:     <timer name='pit' tickpolicy='delay'/>
Nov 15 09:33:13 user nova-compute[75122]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 15 09:33:13 user nova-compute[75122]:     <timer name='hpet' present='no'/>
Nov 15 09:33:13 user nova-compute[75122]:   </clock>
Nov 15 09:33:13 user nova-compute[75122]:   <on_poweroff>destroy</on_poweroff>
Nov 15 09:33:13 user nova-compute[75122]:   <on_reboot>restart</on_reboot>
Nov 15 09:33:13 user nova-compute[75122]:   <on_crash>destroy</on_crash>
Nov 15 09:33:13 user nova-compute[75122]:   <devices>
Nov 15 09:33:13 user nova-compute[75122]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 15 09:33:13 user nova-compute[75122]:     <disk type='file' device='disk'>
Nov 15 09:33:13 user nova-compute[75122]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 15 09:33:13 user nova-compute[75122]:       <source file='/opt/stack/data/nova/instances/e0f32160-7130-4b9c-aa9c-84123f3a6b32/disk' index='2'/>
Nov 15 09:33:13 user nova-compute[75122]:       <backingStore type='file' index='3'>
Nov 15 09:33:13 user nova-compute[75122]:         <format type='raw'/>
Nov 15 09:33:13 user nova-compute[75122]:         <source file='/opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665'/>
Nov 15 09:33:13 user nova-compute[75122]:         <backingStore/>
Nov 15 09:33:13 user nova-compute[75122]:       </backingStore>
Nov 15 09:33:13 user nova-compute[75122]:       <target dev='vda' bus='virtio'/>
Nov 15 09:33:13 user nova-compute[75122]:       <alias name='virtio-disk0'/>
Nov 15 09:33:13 user nova-compute[75122]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 15 09:33:13 user nova-compute[75122]:     </disk>
Nov 15 09:33:13 user nova-compute[75122]:     <disk type='file' device='cdrom'>
Nov 15 09:33:13 user nova-compute[75122]:       <driver name='qemu' type='raw' cache='none'/>
Nov 15 09:33:13 user nova-compute[75122]:       <source file='/opt/stack/data/nova/instances/e0f32160-7130-4b9c-aa9c-84123f3a6b32/disk.config' index='1'/>
Nov 15 09:33:13 user nova-compute[75122]:       <backingStore/>
Nov 15 09:33:13 user nova-compute[75122]:       <target dev='hda' bus='ide'/>
Nov 15 09:33:13 user nova-compute[75122]:       <readonly/>
Nov 15 09:33:13 user nova-compute[75122]:       <alias name='ide0-0-0'/>
Nov 15 09:33:13 user nova-compute[75122]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 15 09:33:13 user nova-compute[75122]:     </disk>
Nov 15 09:33:13 user nova-compute[75122]:     <controller type='usb' index='0' model='none'>
Nov 15 09:33:13 user nova-compute[75122]:       <alias name='usb'/>
Nov 15 09:33:13 user nova-compute[75122]:     </controller>
Nov 15 09:33:13 user nova-compute[75122]:     <controller type='pci' index='0' model='pci-root'>
Nov 15 09:33:13 user nova-compute[75122]:       <alias name='pci.0'/>
Nov 15 09:33:13 user nova-compute[75122]:     </controller>
Nov 15 09:33:13 user nova-compute[75122]:     <controller type='ide' index='0'>
Nov 15 09:33:13 user nova-compute[75122]:       <alias name='ide'/>
Nov 15 09:33:13 user nova-compute[75122]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 15 09:33:13 user nova-compute[75122]:     </controller>
Nov 15 09:33:13 user nova-compute[75122]:     <interface type='ethernet'>
Nov 15 09:33:13 user nova-compute[75122]:       <mac address='fa:16:3e:fd:20:4e'/>
Nov 15 09:33:13 user nova-compute[75122]:       <target dev='tap0d48c0d7-8a'/>
Nov 15 09:33:13 user nova-compute[75122]:       <model type='virtio'/>
Nov 15 09:33:13 user nova-compute[75122]:       <mtu size='1442'/>
Nov 15 09:33:13 user nova-compute[75122]:       <alias name='net0'/>
Nov 15 09:33:13 user nova-compute[75122]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 15 09:33:13 user nova-compute[75122]:     </interface>
Nov 15 09:33:13 user nova-compute[75122]:     <serial type='pty'>
Nov 15 09:33:13 user nova-compute[75122]:       <source path='/dev/pts/4'/>
Nov 15 09:33:13 user nova-compute[75122]:       <log file='/opt/stack/data/nova/instances/e0f32160-7130-4b9c-aa9c-84123f3a6b32/console.log' append='off'/>
Nov 15 09:33:13 user nova-compute[75122]:       <target type='isa-serial' port='0'>
Nov 15 09:33:13 user nova-compute[75122]:         <model name='isa-serial'/>
Nov 15 09:33:13 user nova-compute[75122]:       </target>
Nov 15 09:33:13 user nova-compute[75122]:       <alias name='serial0'/>
Nov 15 09:33:13 user nova-compute[75122]:     </serial>
Nov 15 09:33:13 user nova-compute[75122]:     <console type='pty' tty='/dev/pts/4'>
Nov 15 09:33:13 user nova-compute[75122]:       <source path='/dev/pts/4'/>
Nov 15 09:33:13 user nova-compute[75122]:       <log file='/opt/stack/data/nova/instances/e0f32160-7130-4b9c-aa9c-84123f3a6b32/console.log' append='off'/>
Nov 15 09:33:13 user nova-compute[75122]:       <target type='serial' port='0'/>
Nov 15 09:33:13 user nova-compute[75122]:       <alias name='serial0'/>
Nov 15 09:33:13 user nova-compute[75122]:     </console>
Nov 15 09:33:13 user nova-compute[75122]:     <input type='mouse' bus='ps2'>
Nov 15 09:33:13 user nova-compute[75122]:       <alias name='input0'/>
Nov 15 09:33:13 user nova-compute[75122]:     </input>
Nov 15 09:33:13 user nova-compute[75122]:     <input type='keyboard' bus='ps2'>
Nov 15 09:33:13 user nova-compute[75122]:       <alias name='input1'/>
Nov 15 09:33:13 user nova-compute[75122]:     </input>
Nov 15 09:33:13 user nova-compute[75122]:     <graphics type='vnc' port='5904' autoport='yes' listen='0.0.0.0'>
Nov 15 09:33:13 user nova-compute[75122]:       <listen type='address' address='0.0.0.0'/>
Nov 15 09:33:13 user nova-compute[75122]:     </graphics>
Nov 15 09:33:13 user nova-compute[75122]:     <audio id='1' type='none'/>
Nov 15 09:33:13 user nova-compute[75122]:     <video>
Nov 15 09:33:13 user nova-compute[75122]:       <model type='virtio' heads='1' primary='yes'/>
Nov 15 09:33:13 user nova-compute[75122]:       <alias name='video0'/>
Nov 15 09:33:13 user nova-compute[75122]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 15 09:33:13 user nova-compute[75122]:     </video>
Nov 15 09:33:13 user nova-compute[75122]:     <memballoon model='virtio'>
Nov 15 09:33:13 user nova-compute[75122]:       <stats period='10'/>
Nov 15 09:33:13 user nova-compute[75122]:       <alias name='balloon0'/>
Nov 15 09:33:13 user nova-compute[75122]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 15 09:33:13 user nova-compute[75122]:     </memballoon>
Nov 15 09:33:13 user nova-compute[75122]:     <rng model='virtio'>
Nov 15 09:33:13 user nova-compute[75122]:       <backend model='random'>/dev/urandom</backend>
Nov 15 09:33:13 user nova-compute[75122]:       <alias name='rng0'/>
Nov 15 09:33:13 user nova-compute[75122]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 15 09:33:13 user nova-compute[75122]:     </rng>
Nov 15 09:33:13 user nova-compute[75122]:   </devices>
Nov 15 09:33:13 user nova-compute[75122]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 15 09:33:13 user nova-compute[75122]:     <label>libvirt-e0f32160-7130-4b9c-aa9c-84123f3a6b32</label>
Nov 15 09:33:13 user nova-compute[75122]:     <imagelabel>libvirt-e0f32160-7130-4b9c-aa9c-84123f3a6b32</imagelabel>
Nov 15 09:33:13 user nova-compute[75122]:   </seclabel>
Nov 15 09:33:13 user nova-compute[75122]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 15 09:33:13 user nova-compute[75122]:     <label>+64055:+108</label>
Nov 15 09:33:13 user nova-compute[75122]:     <imagelabel>+64055:+108</imagelabel>
Nov 15 09:33:13 user nova-compute[75122]:   </seclabel>
Nov 15 09:33:13 user nova-compute[75122]: </domain>
Nov 15 09:33:13 user nova-compute[75122]:  {{(pid=75122) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 15 09:33:13 user nova-compute[75122]: DEBUG nova.virt.libvirt.guest [req-3dea74e0-0d18-4c1f-810c-181a73cf539f req-ad962786-4f47-42fb-9f64-0e8f027cbbfb service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:9e:53:27"/><model type="virtio"/><mtu size="1442"/><target dev="tapce0d75c2-85"/></interface> {{(pid=75122) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 15 09:33:13 user nova-compute[75122]: DEBUG nova.virt.libvirt.guest [req-3dea74e0-0d18-4c1f-810c-181a73cf539f req-ad962786-4f47-42fb-9f64-0e8f027cbbfb service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:9e:53:27"/><model type="virtio"/><mtu size="1442"/><target dev="tapce0d75c2-85"/></interface>not found in domain: <domain type='kvm' id='5'>
Nov 15 09:33:13 user nova-compute[75122]:   <name>instance-00000005</name>
Nov 15 09:33:13 user nova-compute[75122]:   <uuid>e0f32160-7130-4b9c-aa9c-84123f3a6b32</uuid>
Nov 15 09:33:13 user nova-compute[75122]:   <metadata>
Nov 15 09:33:13 user nova-compute[75122]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 09:33:13 user nova-compute[75122]:   <nova:package version="0.0.0"/>
Nov 15 09:33:13 user nova-compute[75122]:   <nova:name>tempest-device-tagging-server-650907307</nova:name>
Nov 15 09:33:13 user nova-compute[75122]:   <nova:creationTime>2023-11-15 09:33:12</nova:creationTime>
Nov 15 09:33:13 user nova-compute[75122]:   <nova:flavor name="m1.tiny">
Nov 15 09:33:13 user nova-compute[75122]:     <nova:memory>512</nova:memory>
Nov 15 09:33:13 user nova-compute[75122]:     <nova:disk>1</nova:disk>
Nov 15 09:33:13 user nova-compute[75122]:     <nova:swap>0</nova:swap>
Nov 15 09:33:13 user nova-compute[75122]:     <nova:ephemeral>0</nova:ephemeral>
Nov 15 09:33:13 user nova-compute[75122]:     <nova:vcpus>1</nova:vcpus>
Nov 15 09:33:13 user nova-compute[75122]:   </nova:flavor>
Nov 15 09:33:13 user nova-compute[75122]:   <nova:owner>
Nov 15 09:33:13 user nova-compute[75122]:     <nova:user uuid="d2529e19d29e4120b6e8ae75e16bb5b6">tempest-TaggedAttachmentsTest-2027876138-project-member</nova:user>
Nov 15 09:33:13 user nova-compute[75122]:     <nova:project uuid="6082a9c95d70462586e1f1195b43a383">tempest-TaggedAttachmentsTest-2027876138</nova:project>
Nov 15 09:33:13 user nova-compute[75122]:   </nova:owner>
Nov 15 09:33:13 user nova-compute[75122]:   <nova:root type="image" uuid="5e862cfe-47b8-4725-8292-65761ee6d0f5"/>
Nov 15 09:33:13 user nova-compute[75122]:   <nova:ports>
Nov 15 09:33:13 user nova-compute[75122]:     <nova:port uuid="0d48c0d7-8a0f-4bfa-b8b7-290f122c3f4a">
Nov 15 09:33:13 user nova-compute[75122]:       <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 15 09:33:13 user nova-compute[75122]:     </nova:port>
Nov 15 09:33:13 user nova-compute[75122]:   </nova:ports>
Nov 15 09:33:13 user nova-compute[75122]: </nova:instance>
Nov 15 09:33:13 user nova-compute[75122]:   </metadata>
Nov 15 09:33:13 user nova-compute[75122]:   <memory unit='KiB'>524288</memory>
Nov 15 09:33:13 user nova-compute[75122]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 15 09:33:13 user nova-compute[75122]:   <vcpu placement='static'>1</vcpu>
Nov 15 09:33:13 user nova-compute[75122]:   <resource>
Nov 15 09:33:13 user nova-compute[75122]:     <partition>/machine</partition>
Nov 15 09:33:13 user nova-compute[75122]:   </resource>
Nov 15 09:33:13 user nova-compute[75122]:   <sysinfo type='smbios'>
Nov 15 09:33:13 user nova-compute[75122]:     <system>
Nov 15 09:33:13 user nova-compute[75122]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 15 09:33:13 user nova-compute[75122]:       <entry name='product'>OpenStack Nova</entry>
Nov 15 09:33:13 user nova-compute[75122]:       <entry name='version'>0.0.0</entry>
Nov 15 09:33:13 user nova-compute[75122]:       <entry name='serial'>e0f32160-7130-4b9c-aa9c-84123f3a6b32</entry>
Nov 15 09:33:13 user nova-compute[75122]:       <entry name='uuid'>e0f32160-7130-4b9c-aa9c-84123f3a6b32</entry>
Nov 15 09:33:13 user nova-compute[75122]:       <entry name='family'>Virtual Machine</entry>
Nov 15 09:33:13 user nova-compute[75122]:     </system>
Nov 15 09:33:13 user nova-compute[75122]:   </sysinfo>
Nov 15 09:33:13 user nova-compute[75122]:   <os>
Nov 15 09:33:13 user nova-compute[75122]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 15 09:33:13 user nova-compute[75122]:     <boot dev='hd'/>
Nov 15 09:33:13 user nova-compute[75122]:     <smbios mode='sysinfo'/>
Nov 15 09:33:13 user nova-compute[75122]:   </os>
Nov 15 09:33:13 user nova-compute[75122]:   <features>
Nov 15 09:33:13 user nova-compute[75122]:     <acpi/>
Nov 15 09:33:13 user nova-compute[75122]:     <apic/>
Nov 15 09:33:13 user nova-compute[75122]:     <vmcoreinfo state='on'/>
Nov 15 09:33:13 user nova-compute[75122]:   </features>
Nov 15 09:33:13 user nova-compute[75122]:   <cpu mode='custom' match='exact' check='full'>
Nov 15 09:33:13 user nova-compute[75122]:     <model fallback='forbid'>Nehalem</model>
Nov 15 09:33:13 user nova-compute[75122]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 15 09:33:13 user nova-compute[75122]:     <feature policy='require' name='vme'/>
Nov 15 09:33:13 user nova-compute[75122]:     <feature policy='require' name='x2apic'/>
Nov 15 09:33:13 user nova-compute[75122]:     <feature policy='require' name='hypervisor'/>
Nov 15 09:33:13 user nova-compute[75122]:   </cpu>
Nov 15 09:33:13 user nova-compute[75122]:   <clock offset='utc'>
Nov 15 09:33:13 user nova-compute[75122]:     <timer name='pit' tickpolicy='delay'/>
Nov 15 09:33:13 user nova-compute[75122]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 15 09:33:13 user nova-compute[75122]:     <timer name='hpet' present='no'/>
Nov 15 09:33:13 user nova-compute[75122]:   </clock>
Nov 15 09:33:13 user nova-compute[75122]:   <on_poweroff>destroy</on_poweroff>
Nov 15 09:33:13 user nova-compute[75122]:   <on_reboot>restart</on_reboot>
Nov 15 09:33:13 user nova-compute[75122]:   <on_crash>destroy</on_crash>
Nov 15 09:33:13 user nova-compute[75122]:   <devices>
Nov 15 09:33:13 user nova-compute[75122]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 15 09:33:13 user nova-compute[75122]:     <disk type='file' device='disk'>
Nov 15 09:33:13 user nova-compute[75122]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 15 09:33:13 user nova-compute[75122]:       <source file='/opt/stack/data/nova/instances/e0f32160-7130-4b9c-aa9c-84123f3a6b32/disk' index='2'/>
Nov 15 09:33:13 user nova-compute[75122]:       <backingStore type='file' index='3'>
Nov 15 09:33:13 user nova-compute[75122]:         <format type='raw'/>
Nov 15 09:33:13 user nova-compute[75122]:         <source file='/opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665'/>
Nov 15 09:33:13 user nova-compute[75122]:         <backingStore/>
Nov 15 09:33:13 user nova-compute[75122]:       </backingStore>
Nov 15 09:33:13 user nova-compute[75122]:       <target dev='vda' bus='virtio'/>
Nov 15 09:33:13 user nova-compute[75122]:       <alias name='virtio-disk0'/>
Nov 15 09:33:13 user nova-compute[75122]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 15 09:33:13 user nova-compute[75122]:     </disk>
Nov 15 09:33:13 user nova-compute[75122]:     <disk type='file' device='cdrom'>
Nov 15 09:33:13 user nova-compute[75122]:       <driver name='qemu' type='raw' cache='none'/>
Nov 15 09:33:13 user nova-compute[75122]:       <source file='/opt/stack/data/nova/instances/e0f32160-7130-4b9c-aa9c-84123f3a6b32/disk.config' index='1'/>
Nov 15 09:33:13 user nova-compute[75122]:       <backingStore/>
Nov 15 09:33:13 user nova-compute[75122]:       <target dev='hda' bus='ide'/>
Nov 15 09:33:13 user nova-compute[75122]:       <readonly/>
Nov 15 09:33:13 user nova-compute[75122]:       <alias name='ide0-0-0'/>
Nov 15 09:33:13 user nova-compute[75122]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 15 09:33:13 user nova-compute[75122]:     </disk>
Nov 15 09:33:13 user nova-compute[75122]:     <controller type='usb' index='0' model='none'>
Nov 15 09:33:13 user nova-compute[75122]:       <alias name='usb'/>
Nov 15 09:33:13 user nova-compute[75122]:     </controller>
Nov 15 09:33:13 user nova-compute[75122]:     <controller type='pci' index='0' model='pci-root'>
Nov 15 09:33:13 user nova-compute[75122]:       <alias name='pci.0'/>
Nov 15 09:33:13 user nova-compute[75122]:     </controller>
Nov 15 09:33:13 user nova-compute[75122]:     <controller type='ide' index='0'>
Nov 15 09:33:13 user nova-compute[75122]:       <alias name='ide'/>
Nov 15 09:33:13 user nova-compute[75122]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 15 09:33:13 user nova-compute[75122]:     </controller>
Nov 15 09:33:13 user nova-compute[75122]:     <interface type='ethernet'>
Nov 15 09:33:13 user nova-compute[75122]:       <mac address='fa:16:3e:fd:20:4e'/>
Nov 15 09:33:13 user nova-compute[75122]:       <target dev='tap0d48c0d7-8a'/>
Nov 15 09:33:13 user nova-compute[75122]:       <model type='virtio'/>
Nov 15 09:33:13 user nova-compute[75122]:       <mtu size='1442'/>
Nov 15 09:33:13 user nova-compute[75122]:       <alias name='net0'/>
Nov 15 09:33:13 user nova-compute[75122]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 15 09:33:13 user nova-compute[75122]:     </interface>
Nov 15 09:33:13 user nova-compute[75122]:     <serial type='pty'>
Nov 15 09:33:13 user nova-compute[75122]:       <source path='/dev/pts/4'/>
Nov 15 09:33:13 user nova-compute[75122]:       <log file='/opt/stack/data/nova/instances/e0f32160-7130-4b9c-aa9c-84123f3a6b32/console.log' append='off'/>
Nov 15 09:33:13 user nova-compute[75122]:       <target type='isa-serial' port='0'>
Nov 15 09:33:13 user nova-compute[75122]:         <model name='isa-serial'/>
Nov 15 09:33:13 user nova-compute[75122]:       </target>
Nov 15 09:33:13 user nova-compute[75122]:       <alias name='serial0'/>
Nov 15 09:33:13 user nova-compute[75122]:     </serial>
Nov 15 09:33:13 user nova-compute[75122]:     <console type='pty' tty='/dev/pts/4'>
Nov 15 09:33:13 user nova-compute[75122]:       <source path='/dev/pts/4'/>
Nov 15 09:33:13 user nova-compute[75122]:       <log file='/opt/stack/data/nova/instances/e0f32160-7130-4b9c-aa9c-84123f3a6b32/console.log' append='off'/>
Nov 15 09:33:13 user nova-compute[75122]:       <target type='serial' port='0'/>
Nov 15 09:33:13 user nova-compute[75122]:       <alias name='serial0'/>
Nov 15 09:33:13 user nova-compute[75122]:     </console>
Nov 15 09:33:13 user nova-compute[75122]:     <input type='mouse' bus='ps2'>
Nov 15 09:33:13 user nova-compute[75122]:       <alias name='input0'/>
Nov 15 09:33:13 user nova-compute[75122]:     </input>
Nov 15 09:33:13 user nova-compute[75122]:     <input type='keyboard' bus='ps2'>
Nov 15 09:33:13 user nova-compute[75122]:       <alias name='input1'/>
Nov 15 09:33:13 user nova-compute[75122]:     </input>
Nov 15 09:33:13 user nova-compute[75122]:     <graphics type='vnc' port='5904' autoport='yes' listen='0.0.0.0'>
Nov 15 09:33:13 user nova-compute[75122]:       <listen type='address' address='0.0.0.0'/>
Nov 15 09:33:13 user nova-compute[75122]:     </graphics>
Nov 15 09:33:13 user nova-compute[75122]:     <audio id='1' type='none'/>
Nov 15 09:33:13 user nova-compute[75122]:     <video>
Nov 15 09:33:13 user nova-compute[75122]:       <model type='virtio' heads='1' primary='yes'/>
Nov 15 09:33:13 user nova-compute[75122]:       <alias name='video0'/>
Nov 15 09:33:13 user nova-compute[75122]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 15 09:33:13 user nova-compute[75122]:     </video>
Nov 15 09:33:13 user nova-compute[75122]:     <memballoon model='virtio'>
Nov 15 09:33:13 user nova-compute[75122]:       <stats period='10'/>
Nov 15 09:33:13 user nova-compute[75122]:       <alias name='balloon0'/>
Nov 15 09:33:13 user nova-compute[75122]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 15 09:33:13 user nova-compute[75122]:     </memballoon>
Nov 15 09:33:13 user nova-compute[75122]:     <rng model='virtio'>
Nov 15 09:33:13 user nova-compute[75122]:       <backend model='random'>/dev/urandom</backend>
Nov 15 09:33:13 user nova-compute[75122]:       <alias name='rng0'/>
Nov 15 09:33:13 user nova-compute[75122]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 15 09:33:13 user nova-compute[75122]:     </rng>
Nov 15 09:33:13 user nova-compute[75122]:   </devices>
Nov 15 09:33:13 user nova-compute[75122]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 15 09:33:13 user nova-compute[75122]:     <label>libvirt-e0f32160-7130-4b9c-aa9c-84123f3a6b32</label>
Nov 15 09:33:13 user nova-compute[75122]:     <imagelabel>libvirt-e0f32160-7130-4b9c-aa9c-84123f3a6b32</imagelabel>
Nov 15 09:33:13 user nova-compute[75122]:   </seclabel>
Nov 15 09:33:13 user nova-compute[75122]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 15 09:33:13 user nova-compute[75122]:     <label>+64055:+108</label>
Nov 15 09:33:13 user nova-compute[75122]:     <imagelabel>+64055:+108</imagelabel>
Nov 15 09:33:13 user nova-compute[75122]:   </seclabel>
Nov 15 09:33:13 user nova-compute[75122]: </domain>
Nov 15 09:33:13 user nova-compute[75122]:  {{(pid=75122) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 15 09:33:13 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [req-3dea74e0-0d18-4c1f-810c-181a73cf539f req-ad962786-4f47-42fb-9f64-0e8f027cbbfb service nova] [instance: e0f32160-7130-4b9c-aa9c-84123f3a6b32] Detaching interface fa:16:3e:9e:53:27 failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tapce0d75c2-85' not found.
Nov 15 09:33:13 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [req-3dea74e0-0d18-4c1f-810c-181a73cf539f req-ad962786-4f47-42fb-9f64-0e8f027cbbfb service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T09:30:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-650907307',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-650907307',id=5,image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEs+MsbbhvkEM+SFSEAT1XChvfwYG6LS4xClecFc1s5hPTjvnawfxaNFAntQJzNhhhBe9ISEtvpo31FTBvmrG/LNlyB/uvXRpPMaH35dzVkZDJmlCiGv/MxZIKKpRxaHLw==',key_name='tempest-keypair-2107215481',keypairs=<?>,launch_index=0,launched_at=2023-11-15T09:30:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6082a9c95d70462586e1f1195b43a383',ramdisk_id='',reservation_id='r-j04j8rw4',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-2027876138',owner_user_name='tempest-TaggedAttachmentsTest-2027876138-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T09:30:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d2529e19d29e4120b6e8ae75e16bb5b6',uuid=e0f32160-7130-4b9c-aa9c-84123f3a6b32,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ce0d75c2-85b4-4e49-8d42-767b17493e53", "address": "fa:16:3e:9e:53:27", "network": {"id": "517e7cda-b26b-4dca-9b2b-b8a52f1ef18b", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1110889298", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "6082a9c95d70462586e1f1195b43a383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce0d75c2-85", "ovs_interfaceid": "ce0d75c2-85b4-4e49-8d42-767b17493e53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 09:33:13 user nova-compute[75122]: DEBUG nova.network.os_vif_util [req-3dea74e0-0d18-4c1f-810c-181a73cf539f req-ad962786-4f47-42fb-9f64-0e8f027cbbfb service nova] Converting VIF {"id": "ce0d75c2-85b4-4e49-8d42-767b17493e53", "address": "fa:16:3e:9e:53:27", "network": {"id": "517e7cda-b26b-4dca-9b2b-b8a52f1ef18b", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1110889298", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "6082a9c95d70462586e1f1195b43a383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce0d75c2-85", "ovs_interfaceid": "ce0d75c2-85b4-4e49-8d42-767b17493e53", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 09:33:13 user nova-compute[75122]: DEBUG nova.network.os_vif_util [req-3dea74e0-0d18-4c1f-810c-181a73cf539f req-ad962786-4f47-42fb-9f64-0e8f027cbbfb service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:53:27,bridge_name='br-int',has_traffic_filtering=True,id=ce0d75c2-85b4-4e49-8d42-767b17493e53,network=Network(517e7cda-b26b-4dca-9b2b-b8a52f1ef18b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce0d75c2-85') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 09:33:13 user nova-compute[75122]: DEBUG os_vif [req-3dea74e0-0d18-4c1f-810c-181a73cf539f req-ad962786-4f47-42fb-9f64-0e8f027cbbfb service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:53:27,bridge_name='br-int',has_traffic_filtering=True,id=ce0d75c2-85b4-4e49-8d42-767b17493e53,network=Network(517e7cda-b26b-4dca-9b2b-b8a52f1ef18b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce0d75c2-85') {{(pid=75122) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 09:33:13 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:33:13 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapce0d75c2-85, bridge=br-int, if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:33:13 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 09:33:13 user nova-compute[75122]: INFO os_vif [req-3dea74e0-0d18-4c1f-810c-181a73cf539f req-ad962786-4f47-42fb-9f64-0e8f027cbbfb service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:53:27,bridge_name='br-int',has_traffic_filtering=True,id=ce0d75c2-85b4-4e49-8d42-767b17493e53,network=Network(517e7cda-b26b-4dca-9b2b-b8a52f1ef18b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce0d75c2-85')
Nov 15 09:33:13 user nova-compute[75122]: DEBUG nova.virt.libvirt.guest [req-3dea74e0-0d18-4c1f-810c-181a73cf539f req-ad962786-4f47-42fb-9f64-0e8f027cbbfb service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 09:33:13 user nova-compute[75122]:   <nova:package version="0.0.0"/>
Nov 15 09:33:13 user nova-compute[75122]:   <nova:name>tempest-device-tagging-server-650907307</nova:name>
Nov 15 09:33:13 user nova-compute[75122]:   <nova:creationTime>2023-11-15 09:33:13</nova:creationTime>
Nov 15 09:33:13 user nova-compute[75122]:   <nova:flavor name="m1.tiny">
Nov 15 09:33:13 user nova-compute[75122]:     <nova:memory>512</nova:memory>
Nov 15 09:33:13 user nova-compute[75122]:     <nova:disk>1</nova:disk>
Nov 15 09:33:13 user nova-compute[75122]:     <nova:swap>0</nova:swap>
Nov 15 09:33:13 user nova-compute[75122]:     <nova:ephemeral>0</nova:ephemeral>
Nov 15 09:33:13 user nova-compute[75122]:     <nova:vcpus>1</nova:vcpus>
Nov 15 09:33:13 user nova-compute[75122]:   </nova:flavor>
Nov 15 09:33:13 user nova-compute[75122]:   <nova:owner>
Nov 15 09:33:13 user nova-compute[75122]:     <nova:user uuid="d2529e19d29e4120b6e8ae75e16bb5b6">tempest-TaggedAttachmentsTest-2027876138-project-member</nova:user>
Nov 15 09:33:13 user nova-compute[75122]:     <nova:project uuid="6082a9c95d70462586e1f1195b43a383">tempest-TaggedAttachmentsTest-2027876138</nova:project>
Nov 15 09:33:13 user nova-compute[75122]:   </nova:owner>
Nov 15 09:33:13 user nova-compute[75122]:   <nova:root type="image" uuid="5e862cfe-47b8-4725-8292-65761ee6d0f5"/>
Nov 15 09:33:13 user nova-compute[75122]:   <nova:ports>
Nov 15 09:33:13 user nova-compute[75122]:     <nova:port uuid="0d48c0d7-8a0f-4bfa-b8b7-290f122c3f4a">
Nov 15 09:33:13 user nova-compute[75122]:       <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 15 09:33:13 user nova-compute[75122]:     </nova:port>
Nov 15 09:33:13 user nova-compute[75122]:   </nova:ports>
Nov 15 09:33:13 user nova-compute[75122]: </nova:instance>
Nov 15 09:33:13 user nova-compute[75122]:  {{(pid=75122) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 15 09:33:13 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance ee961d5a-e0d1-4931-9293-eefbe638097a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:33:13 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance 131142fd-e8ec-42d1-a518-aa21c7bb7cb1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:33:13 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance e0f32160-7130-4b9c-aa9c-84123f3a6b32 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:33:13 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance d24a189e-2de9-404e-b281-224c150a5bbf actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:33:13 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance 9cfb60cb-011e-4537-9f28-55ea7d6dfc13 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:33:13 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=75122) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 09:33:13 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=75122) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 09:33:13 user nova-compute[75122]: DEBUG nova.compute.provider_tree [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Inventory has not changed in ProviderTree for provider: 69a3da65-47be-44c6-b67c-c692b58284ef {{(pid=75122) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 09:33:13 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Inventory has not changed for provider 69a3da65-47be-44c6-b67c-c692b58284ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 09:33:13 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Compute_service record updated for user:user {{(pid=75122) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 09:33:13 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.336s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:33:13 user nova-compute[75122]: DEBUG nova.network.neutron [None req-de97beac-4671-46e9-856c-1c18c459c3a7 tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] [instance: e0f32160-7130-4b9c-aa9c-84123f3a6b32] Updating instance_info_cache with network_info: [{"id": "0d48c0d7-8a0f-4bfa-b8b7-290f122c3f4a", "address": "fa:16:3e:fd:20:4e", "network": {"id": "46853cd4-ee0a-44fe-b185-8ef14e956701", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1452664326-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6082a9c95d70462586e1f1195b43a383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d48c0d7-8a", "ovs_interfaceid": "0d48c0d7-8a0f-4bfa-b8b7-290f122c3f4a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:33:13 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-de97beac-4671-46e9-856c-1c18c459c3a7 tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] Releasing lock "refresh_cache-e0f32160-7130-4b9c-aa9c-84123f3a6b32" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 09:33:13 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-de97beac-4671-46e9-856c-1c18c459c3a7 tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] Lock "interface-e0f32160-7130-4b9c-aa9c-84123f3a6b32-ce0d75c2-85b4-4e49-8d42-767b17493e53" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 21.859s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:33:14 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:33:14 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:33:14 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Starting heal instance info cache {{(pid=75122) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 09:33:14 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "refresh_cache-131142fd-e8ec-42d1-a518-aa21c7bb7cb1" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 09:33:14 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquired lock "refresh_cache-131142fd-e8ec-42d1-a518-aa21c7bb7cb1" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 09:33:14 user nova-compute[75122]: DEBUG nova.network.neutron [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] [instance: 131142fd-e8ec-42d1-a518-aa21c7bb7cb1] Forcefully refreshing network info cache for instance {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 09:33:14 user nova-compute[75122]: DEBUG nova.network.neutron [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] [instance: 131142fd-e8ec-42d1-a518-aa21c7bb7cb1] Updating instance_info_cache with network_info: [{"id": "f8302d0d-f140-479c-96da-b21516385381", "address": "fa:16:3e:06:1e:34", "network": {"id": "6e846655-a6f8-4339-a239-65d2f94c8b74", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1923452032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b8e67f8a66a4930be3fb65c397cbeb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8302d0d-f1", "ovs_interfaceid": "f8302d0d-f140-479c-96da-b21516385381", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:33:14 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Releasing lock "refresh_cache-131142fd-e8ec-42d1-a518-aa21c7bb7cb1" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 09:33:14 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] [instance: 131142fd-e8ec-42d1-a518-aa21c7bb7cb1] Updated the network info_cache for instance {{(pid=75122) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 09:33:14 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:33:14 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:33:16 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:33:17 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:33:17 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:33:19 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:33:22 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:33:24 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-db070bfe-44b0-4635-92ee-c454ddce5449 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] Acquiring lock "3ce9b2be-aeb4-45e3-966c-e11667e6be8a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:33:24 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-db070bfe-44b0-4635-92ee-c454ddce5449 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] Lock "3ce9b2be-aeb4-45e3-966c-e11667e6be8a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:33:24 user nova-compute[75122]: DEBUG nova.compute.manager [None req-db070bfe-44b0-4635-92ee-c454ddce5449 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] [instance: 3ce9b2be-aeb4-45e3-966c-e11667e6be8a] Starting instance... {{(pid=75122) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 09:33:24 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-db070bfe-44b0-4635-92ee-c454ddce5449 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:33:24 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-db070bfe-44b0-4635-92ee-c454ddce5449 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:33:24 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-db070bfe-44b0-4635-92ee-c454ddce5449 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75122) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 09:33:24 user nova-compute[75122]: INFO nova.compute.claims [None req-db070bfe-44b0-4635-92ee-c454ddce5449 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] [instance: 3ce9b2be-aeb4-45e3-966c-e11667e6be8a] Claim successful on node user
Nov 15 09:33:24 user nova-compute[75122]: DEBUG nova.compute.provider_tree [None req-db070bfe-44b0-4635-92ee-c454ddce5449 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] Inventory has not changed in ProviderTree for provider: 69a3da65-47be-44c6-b67c-c692b58284ef {{(pid=75122) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 09:33:24 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-db070bfe-44b0-4635-92ee-c454ddce5449 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] Inventory has not changed for provider 69a3da65-47be-44c6-b67c-c692b58284ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 09:33:24 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-db070bfe-44b0-4635-92ee-c454ddce5449 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.313s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:33:24 user nova-compute[75122]: DEBUG nova.compute.manager [None req-db070bfe-44b0-4635-92ee-c454ddce5449 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] [instance: 3ce9b2be-aeb4-45e3-966c-e11667e6be8a] Start building networks asynchronously for instance. {{(pid=75122) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 09:33:24 user nova-compute[75122]: DEBUG nova.compute.manager [None req-db070bfe-44b0-4635-92ee-c454ddce5449 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] [instance: 3ce9b2be-aeb4-45e3-966c-e11667e6be8a] Allocating IP information in the background. {{(pid=75122) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 09:33:24 user nova-compute[75122]: DEBUG nova.network.neutron [None req-db070bfe-44b0-4635-92ee-c454ddce5449 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] [instance: 3ce9b2be-aeb4-45e3-966c-e11667e6be8a] allocate_for_instance() {{(pid=75122) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 09:33:24 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-db070bfe-44b0-4635-92ee-c454ddce5449 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] [instance: 3ce9b2be-aeb4-45e3-966c-e11667e6be8a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 09:33:24 user nova-compute[75122]: DEBUG nova.compute.manager [None req-db070bfe-44b0-4635-92ee-c454ddce5449 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] [instance: 3ce9b2be-aeb4-45e3-966c-e11667e6be8a] Start building block device mappings for instance. {{(pid=75122) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 09:33:24 user nova-compute[75122]: DEBUG nova.policy [None req-db070bfe-44b0-4635-92ee-c454ddce5449 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a3ce318b93394200a80ba72ec74c321e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9af984d06e5340f8a65a54a806c7c88a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75122) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 09:33:24 user nova-compute[75122]: DEBUG nova.compute.manager [None req-db070bfe-44b0-4635-92ee-c454ddce5449 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] [instance: 3ce9b2be-aeb4-45e3-966c-e11667e6be8a] Start spawning the instance on the hypervisor. {{(pid=75122) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 09:33:24 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-db070bfe-44b0-4635-92ee-c454ddce5449 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] [instance: 3ce9b2be-aeb4-45e3-966c-e11667e6be8a] Creating instance directory {{(pid=75122) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 09:33:24 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-db070bfe-44b0-4635-92ee-c454ddce5449 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] [instance: 3ce9b2be-aeb4-45e3-966c-e11667e6be8a] Creating image(s)
Nov 15 09:33:24 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-db070bfe-44b0-4635-92ee-c454ddce5449 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] Acquiring lock "/opt/stack/data/nova/instances/3ce9b2be-aeb4-45e3-966c-e11667e6be8a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:33:24 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-db070bfe-44b0-4635-92ee-c454ddce5449 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] Lock "/opt/stack/data/nova/instances/3ce9b2be-aeb4-45e3-966c-e11667e6be8a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:33:24 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-db070bfe-44b0-4635-92ee-c454ddce5449 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] Lock "/opt/stack/data/nova/instances/3ce9b2be-aeb4-45e3-966c-e11667e6be8a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.030s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:33:24 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-db070bfe-44b0-4635-92ee-c454ddce5449 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:33:24 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:33:25 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-db070bfe-44b0-4635-92ee-c454ddce5449 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json" returned: 0 in 0.198s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:33:25 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-db070bfe-44b0-4635-92ee-c454ddce5449 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] Acquiring lock "95d6e29f74d5408f818e32f3bc29bc8270a4c665" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:33:25 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-db070bfe-44b0-4635-92ee-c454ddce5449 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] Lock "95d6e29f74d5408f818e32f3bc29bc8270a4c665" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:33:25 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-db070bfe-44b0-4635-92ee-c454ddce5449 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:33:25 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-db070bfe-44b0-4635-92ee-c454ddce5449 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json" returned: 0 in 0.175s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:33:25 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-db070bfe-44b0-4635-92ee-c454ddce5449 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665,backing_fmt=raw /opt/stack/data/nova/instances/3ce9b2be-aeb4-45e3-966c-e11667e6be8a/disk 1073741824 {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:33:25 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-db070bfe-44b0-4635-92ee-c454ddce5449 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665,backing_fmt=raw /opt/stack/data/nova/instances/3ce9b2be-aeb4-45e3-966c-e11667e6be8a/disk 1073741824" returned: 0 in 0.047s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:33:25 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-db070bfe-44b0-4635-92ee-c454ddce5449 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] Lock "95d6e29f74d5408f818e32f3bc29bc8270a4c665" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.230s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:33:25 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-db070bfe-44b0-4635-92ee-c454ddce5449 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:33:25 user nova-compute[75122]: DEBUG nova.network.neutron [None req-db070bfe-44b0-4635-92ee-c454ddce5449 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] [instance: 3ce9b2be-aeb4-45e3-966c-e11667e6be8a] Successfully created port: 2eaf99e2-fc08-4374-91b6-192bde04bae6 {{(pid=75122) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 09:33:25 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-db070bfe-44b0-4635-92ee-c454ddce5449 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json" returned: 0 in 0.173s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:33:25 user nova-compute[75122]: DEBUG nova.virt.disk.api [None req-db070bfe-44b0-4635-92ee-c454ddce5449 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3ce9b2be-aeb4-45e3-966c-e11667e6be8a/disk. size=1073741824 {{(pid=75122) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 09:33:25 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-db070bfe-44b0-4635-92ee-c454ddce5449 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ce9b2be-aeb4-45e3-966c-e11667e6be8a/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:33:25 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-db070bfe-44b0-4635-92ee-c454ddce5449 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ce9b2be-aeb4-45e3-966c-e11667e6be8a/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:33:25 user nova-compute[75122]: DEBUG nova.virt.disk.api [None req-db070bfe-44b0-4635-92ee-c454ddce5449 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] Cannot resize image /opt/stack/data/nova/instances/3ce9b2be-aeb4-45e3-966c-e11667e6be8a/disk to a smaller size. {{(pid=75122) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 09:33:25 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-db070bfe-44b0-4635-92ee-c454ddce5449 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] [instance: 3ce9b2be-aeb4-45e3-966c-e11667e6be8a] Created local disks {{(pid=75122) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 09:33:25 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-db070bfe-44b0-4635-92ee-c454ddce5449 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] [instance: 3ce9b2be-aeb4-45e3-966c-e11667e6be8a] Ensure instance console log exists: /opt/stack/data/nova/instances/3ce9b2be-aeb4-45e3-966c-e11667e6be8a/console.log {{(pid=75122) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 09:33:25 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-db070bfe-44b0-4635-92ee-c454ddce5449 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:33:25 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-db070bfe-44b0-4635-92ee-c454ddce5449 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:33:25 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-db070bfe-44b0-4635-92ee-c454ddce5449 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:33:26 user nova-compute[75122]: DEBUG nova.network.neutron [None req-db070bfe-44b0-4635-92ee-c454ddce5449 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] [instance: 3ce9b2be-aeb4-45e3-966c-e11667e6be8a] Successfully updated port: 2eaf99e2-fc08-4374-91b6-192bde04bae6 {{(pid=75122) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 09:33:26 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-db070bfe-44b0-4635-92ee-c454ddce5449 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] Acquiring lock "refresh_cache-3ce9b2be-aeb4-45e3-966c-e11667e6be8a" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 09:33:26 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-db070bfe-44b0-4635-92ee-c454ddce5449 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] Acquired lock "refresh_cache-3ce9b2be-aeb4-45e3-966c-e11667e6be8a" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 09:33:26 user nova-compute[75122]: DEBUG nova.network.neutron [None req-db070bfe-44b0-4635-92ee-c454ddce5449 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] [instance: 3ce9b2be-aeb4-45e3-966c-e11667e6be8a] Building network info cache for instance {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 09:33:26 user nova-compute[75122]: DEBUG nova.compute.manager [req-4056fabd-3060-4a74-bd8a-7f89dd96ae9d req-06751386-3c94-4269-9da6-be8b8c719f64 service nova] [instance: 3ce9b2be-aeb4-45e3-966c-e11667e6be8a] Received event network-changed-2eaf99e2-fc08-4374-91b6-192bde04bae6 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:33:26 user nova-compute[75122]: DEBUG nova.compute.manager [req-4056fabd-3060-4a74-bd8a-7f89dd96ae9d req-06751386-3c94-4269-9da6-be8b8c719f64 service nova] [instance: 3ce9b2be-aeb4-45e3-966c-e11667e6be8a] Refreshing instance network info cache due to event network-changed-2eaf99e2-fc08-4374-91b6-192bde04bae6. {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 09:33:26 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-4056fabd-3060-4a74-bd8a-7f89dd96ae9d req-06751386-3c94-4269-9da6-be8b8c719f64 service nova] Acquiring lock "refresh_cache-3ce9b2be-aeb4-45e3-966c-e11667e6be8a" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 09:33:26 user nova-compute[75122]: DEBUG nova.network.neutron [None req-db070bfe-44b0-4635-92ee-c454ddce5449 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] [instance: 3ce9b2be-aeb4-45e3-966c-e11667e6be8a] Instance cache missing network info. {{(pid=75122) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 09:33:26 user nova-compute[75122]: DEBUG nova.network.neutron [None req-db070bfe-44b0-4635-92ee-c454ddce5449 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] [instance: 3ce9b2be-aeb4-45e3-966c-e11667e6be8a] Updating instance_info_cache with network_info: [{"id": "2eaf99e2-fc08-4374-91b6-192bde04bae6", "address": "fa:16:3e:6c:5e:8a", "network": {"id": "48c8af75-6a89-441b-8e4a-8c7186006537", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2172147-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9af984d06e5340f8a65a54a806c7c88a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eaf99e2-fc", "ovs_interfaceid": "2eaf99e2-fc08-4374-91b6-192bde04bae6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:33:26 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-db070bfe-44b0-4635-92ee-c454ddce5449 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] Releasing lock "refresh_cache-3ce9b2be-aeb4-45e3-966c-e11667e6be8a" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 09:33:26 user nova-compute[75122]: DEBUG nova.compute.manager [None req-db070bfe-44b0-4635-92ee-c454ddce5449 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] [instance: 3ce9b2be-aeb4-45e3-966c-e11667e6be8a] Instance network_info: |[{"id": "2eaf99e2-fc08-4374-91b6-192bde04bae6", "address": "fa:16:3e:6c:5e:8a", "network": {"id": "48c8af75-6a89-441b-8e4a-8c7186006537", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2172147-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9af984d06e5340f8a65a54a806c7c88a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eaf99e2-fc", "ovs_interfaceid": "2eaf99e2-fc08-4374-91b6-192bde04bae6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75122) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 09:33:26 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-4056fabd-3060-4a74-bd8a-7f89dd96ae9d req-06751386-3c94-4269-9da6-be8b8c719f64 service nova] Acquired lock "refresh_cache-3ce9b2be-aeb4-45e3-966c-e11667e6be8a" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 09:33:26 user nova-compute[75122]: DEBUG nova.network.neutron [req-4056fabd-3060-4a74-bd8a-7f89dd96ae9d req-06751386-3c94-4269-9da6-be8b8c719f64 service nova] [instance: 3ce9b2be-aeb4-45e3-966c-e11667e6be8a] Refreshing network info cache for port 2eaf99e2-fc08-4374-91b6-192bde04bae6 {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 09:33:26 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-db070bfe-44b0-4635-92ee-c454ddce5449 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] [instance: 3ce9b2be-aeb4-45e3-966c-e11667e6be8a] Start _get_guest_xml network_info=[{"id": "2eaf99e2-fc08-4374-91b6-192bde04bae6", "address": "fa:16:3e:6c:5e:8a", "network": {"id": "48c8af75-6a89-441b-8e4a-8c7186006537", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2172147-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9af984d06e5340f8a65a54a806c7c88a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eaf99e2-fc", "ovs_interfaceid": "2eaf99e2-fc08-4374-91b6-192bde04bae6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T09:26:31Z,direct_url=<?>,disk_format='qcow2',id=5e862cfe-47b8-4725-8292-65761ee6d0f5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9c57733cb41847c0b4ad31519c382e5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T09:26:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '5e862cfe-47b8-4725-8292-65761ee6d0f5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75122) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 09:33:26 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-db070bfe-44b0-4635-92ee-c454ddce5449 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 09:33:26 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-db070bfe-44b0-4635-92ee-c454ddce5449 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 09:33:26 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-db070bfe-44b0-4635-92ee-c454ddce5449 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75122) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 09:33:26 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-db070bfe-44b0-4635-92ee-c454ddce5449 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] CPU controller missing on host. {{(pid=75122) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 09:33:26 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-db070bfe-44b0-4635-92ee-c454ddce5449 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75122) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 09:33:26 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-db070bfe-44b0-4635-92ee-c454ddce5449 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] CPU controller found on host. {{(pid=75122) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 09:33:26 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-db070bfe-44b0-4635-92ee-c454ddce5449 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75122) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 09:33:26 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-db070bfe-44b0-4635-92ee-c454ddce5449 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T09:26:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T09:26:31Z,direct_url=<?>,disk_format='qcow2',id=5e862cfe-47b8-4725-8292-65761ee6d0f5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9c57733cb41847c0b4ad31519c382e5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T09:26:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 09:33:26 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-db070bfe-44b0-4635-92ee-c454ddce5449 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] Flavor limits 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 09:33:26 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-db070bfe-44b0-4635-92ee-c454ddce5449 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] Image limits 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 09:33:26 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-db070bfe-44b0-4635-92ee-c454ddce5449 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] Flavor pref 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 09:33:26 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-db070bfe-44b0-4635-92ee-c454ddce5449 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] Image pref 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 09:33:26 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-db070bfe-44b0-4635-92ee-c454ddce5449 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 09:33:26 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-db070bfe-44b0-4635-92ee-c454ddce5449 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 09:33:26 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-db070bfe-44b0-4635-92ee-c454ddce5449 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75122) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 09:33:26 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-db070bfe-44b0-4635-92ee-c454ddce5449 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] Got 1 possible topologies {{(pid=75122) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 09:33:26 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-db070bfe-44b0-4635-92ee-c454ddce5449 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 09:33:26 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-db070bfe-44b0-4635-92ee-c454ddce5449 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 09:33:26 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-db070bfe-44b0-4635-92ee-c454ddce5449 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T09:33:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1744416746',display_name='tempest-VolumesActionsTest-instance-1744416746',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1744416746',id=10,image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9af984d06e5340f8a65a54a806c7c88a',ramdisk_id='',reservation_id='r-a12xjog7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-915673420',owner_user_name='tempest-VolumesActionsTest-915673420-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T09:33:25Z,user_data=None,user_id='a3ce318b93394200a80ba72ec74c321e',uuid=3ce9b2be-aeb4-45e3-966c-e11667e6be8a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2eaf99e2-fc08-4374-91b6-192bde04bae6", "address": "fa:16:3e:6c:5e:8a", "network": {"id": "48c8af75-6a89-441b-8e4a-8c7186006537", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2172147-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9af984d06e5340f8a65a54a806c7c88a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eaf99e2-fc", "ovs_interfaceid": "2eaf99e2-fc08-4374-91b6-192bde04bae6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75122) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 09:33:26 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-db070bfe-44b0-4635-92ee-c454ddce5449 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] Converting VIF {"id": "2eaf99e2-fc08-4374-91b6-192bde04bae6", "address": "fa:16:3e:6c:5e:8a", "network": {"id": "48c8af75-6a89-441b-8e4a-8c7186006537", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2172147-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9af984d06e5340f8a65a54a806c7c88a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eaf99e2-fc", "ovs_interfaceid": "2eaf99e2-fc08-4374-91b6-192bde04bae6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 09:33:26 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-db070bfe-44b0-4635-92ee-c454ddce5449 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:5e:8a,bridge_name='br-int',has_traffic_filtering=True,id=2eaf99e2-fc08-4374-91b6-192bde04bae6,network=Network(48c8af75-6a89-441b-8e4a-8c7186006537),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2eaf99e2-fc') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 09:33:26 user nova-compute[75122]: DEBUG nova.objects.instance [None req-db070bfe-44b0-4635-92ee-c454ddce5449 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] Lazy-loading 'pci_devices' on Instance uuid 3ce9b2be-aeb4-45e3-966c-e11667e6be8a {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:33:26 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-db070bfe-44b0-4635-92ee-c454ddce5449 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] [instance: 3ce9b2be-aeb4-45e3-966c-e11667e6be8a] End _get_guest_xml xml=<domain type="kvm">
Nov 15 09:33:26 user nova-compute[75122]:   <uuid>3ce9b2be-aeb4-45e3-966c-e11667e6be8a</uuid>
Nov 15 09:33:26 user nova-compute[75122]:   <name>instance-0000000a</name>
Nov 15 09:33:26 user nova-compute[75122]:   <memory>524288</memory>
Nov 15 09:33:26 user nova-compute[75122]:   <vcpu>1</vcpu>
Nov 15 09:33:26 user nova-compute[75122]:   <metadata>
Nov 15 09:33:26 user nova-compute[75122]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 09:33:26 user nova-compute[75122]:       <nova:package version="0.0.0"/>
Nov 15 09:33:26 user nova-compute[75122]:       <nova:name>tempest-VolumesActionsTest-instance-1744416746</nova:name>
Nov 15 09:33:26 user nova-compute[75122]:       <nova:creationTime>2023-11-15 09:33:26</nova:creationTime>
Nov 15 09:33:26 user nova-compute[75122]:       <nova:flavor name="m1.tiny">
Nov 15 09:33:26 user nova-compute[75122]:         <nova:memory>512</nova:memory>
Nov 15 09:33:26 user nova-compute[75122]:         <nova:disk>1</nova:disk>
Nov 15 09:33:26 user nova-compute[75122]:         <nova:swap>0</nova:swap>
Nov 15 09:33:26 user nova-compute[75122]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 09:33:26 user nova-compute[75122]:         <nova:vcpus>1</nova:vcpus>
Nov 15 09:33:26 user nova-compute[75122]:       </nova:flavor>
Nov 15 09:33:26 user nova-compute[75122]:       <nova:owner>
Nov 15 09:33:26 user nova-compute[75122]:         <nova:user uuid="a3ce318b93394200a80ba72ec74c321e">tempest-VolumesActionsTest-915673420-project-member</nova:user>
Nov 15 09:33:26 user nova-compute[75122]:         <nova:project uuid="9af984d06e5340f8a65a54a806c7c88a">tempest-VolumesActionsTest-915673420</nova:project>
Nov 15 09:33:26 user nova-compute[75122]:       </nova:owner>
Nov 15 09:33:26 user nova-compute[75122]:       <nova:root type="image" uuid="5e862cfe-47b8-4725-8292-65761ee6d0f5"/>
Nov 15 09:33:26 user nova-compute[75122]:       <nova:ports>
Nov 15 09:33:26 user nova-compute[75122]:         <nova:port uuid="2eaf99e2-fc08-4374-91b6-192bde04bae6">
Nov 15 09:33:26 user nova-compute[75122]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 15 09:33:26 user nova-compute[75122]:         </nova:port>
Nov 15 09:33:26 user nova-compute[75122]:       </nova:ports>
Nov 15 09:33:26 user nova-compute[75122]:     </nova:instance>
Nov 15 09:33:26 user nova-compute[75122]:   </metadata>
Nov 15 09:33:26 user nova-compute[75122]:   <sysinfo type="smbios">
Nov 15 09:33:26 user nova-compute[75122]:     <system>
Nov 15 09:33:26 user nova-compute[75122]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 09:33:26 user nova-compute[75122]:       <entry name="product">OpenStack Nova</entry>
Nov 15 09:33:26 user nova-compute[75122]:       <entry name="version">0.0.0</entry>
Nov 15 09:33:26 user nova-compute[75122]:       <entry name="serial">3ce9b2be-aeb4-45e3-966c-e11667e6be8a</entry>
Nov 15 09:33:26 user nova-compute[75122]:       <entry name="uuid">3ce9b2be-aeb4-45e3-966c-e11667e6be8a</entry>
Nov 15 09:33:26 user nova-compute[75122]:       <entry name="family">Virtual Machine</entry>
Nov 15 09:33:26 user nova-compute[75122]:     </system>
Nov 15 09:33:26 user nova-compute[75122]:   </sysinfo>
Nov 15 09:33:26 user nova-compute[75122]:   <os>
Nov 15 09:33:26 user nova-compute[75122]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 09:33:26 user nova-compute[75122]:     <boot dev="hd"/>
Nov 15 09:33:26 user nova-compute[75122]:     <smbios mode="sysinfo"/>
Nov 15 09:33:26 user nova-compute[75122]:   </os>
Nov 15 09:33:26 user nova-compute[75122]:   <features>
Nov 15 09:33:26 user nova-compute[75122]:     <acpi/>
Nov 15 09:33:26 user nova-compute[75122]:     <apic/>
Nov 15 09:33:26 user nova-compute[75122]:     <vmcoreinfo/>
Nov 15 09:33:26 user nova-compute[75122]:   </features>
Nov 15 09:33:26 user nova-compute[75122]:   <clock offset="utc">
Nov 15 09:33:26 user nova-compute[75122]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 09:33:26 user nova-compute[75122]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 09:33:26 user nova-compute[75122]:     <timer name="hpet" present="no"/>
Nov 15 09:33:26 user nova-compute[75122]:   </clock>
Nov 15 09:33:26 user nova-compute[75122]:   <cpu mode="custom" match="exact">
Nov 15 09:33:26 user nova-compute[75122]:     <model>Nehalem</model>
Nov 15 09:33:26 user nova-compute[75122]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 09:33:26 user nova-compute[75122]:   </cpu>
Nov 15 09:33:26 user nova-compute[75122]:   <devices>
Nov 15 09:33:26 user nova-compute[75122]:     <disk type="file" device="disk">
Nov 15 09:33:26 user nova-compute[75122]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 09:33:26 user nova-compute[75122]:       <source file="/opt/stack/data/nova/instances/3ce9b2be-aeb4-45e3-966c-e11667e6be8a/disk"/>
Nov 15 09:33:26 user nova-compute[75122]:       <target dev="vda" bus="virtio"/>
Nov 15 09:33:26 user nova-compute[75122]:     </disk>
Nov 15 09:33:26 user nova-compute[75122]:     <interface type="ethernet">
Nov 15 09:33:26 user nova-compute[75122]:       <mac address="fa:16:3e:6c:5e:8a"/>
Nov 15 09:33:26 user nova-compute[75122]:       <model type="virtio"/>
Nov 15 09:33:26 user nova-compute[75122]:       <mtu size="1442"/>
Nov 15 09:33:26 user nova-compute[75122]:       <target dev="tap2eaf99e2-fc"/>
Nov 15 09:33:26 user nova-compute[75122]:     </interface>
Nov 15 09:33:26 user nova-compute[75122]:     <serial type="pty">
Nov 15 09:33:26 user nova-compute[75122]:       <log file="/opt/stack/data/nova/instances/3ce9b2be-aeb4-45e3-966c-e11667e6be8a/console.log" append="off"/>
Nov 15 09:33:26 user nova-compute[75122]:     </serial>
Nov 15 09:33:26 user nova-compute[75122]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 09:33:26 user nova-compute[75122]:     <video>
Nov 15 09:33:26 user nova-compute[75122]:       <model type="virtio"/>
Nov 15 09:33:26 user nova-compute[75122]:     </video>
Nov 15 09:33:26 user nova-compute[75122]:     <rng model="virtio">
Nov 15 09:33:26 user nova-compute[75122]:       <backend model="random">/dev/urandom</backend>
Nov 15 09:33:26 user nova-compute[75122]:     </rng>
Nov 15 09:33:26 user nova-compute[75122]:     <controller type="usb" index="0" model="none"/>
Nov 15 09:33:26 user nova-compute[75122]:     <memballoon model="virtio">
Nov 15 09:33:26 user nova-compute[75122]:       <stats period="10"/>
Nov 15 09:33:26 user nova-compute[75122]:     </memballoon>
Nov 15 09:33:26 user nova-compute[75122]:   </devices>
Nov 15 09:33:26 user nova-compute[75122]: </domain>
Nov 15 09:33:26 user nova-compute[75122]:  {{(pid=75122) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 09:33:26 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-db070bfe-44b0-4635-92ee-c454ddce5449 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T09:33:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1744416746',display_name='tempest-VolumesActionsTest-instance-1744416746',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1744416746',id=10,image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9af984d06e5340f8a65a54a806c7c88a',ramdisk_id='',reservation_id='r-a12xjog7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-915673420',owner_user_name='tempest-VolumesActionsTest-915673420-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T09:33:25Z,user_data=None,user_id='a3ce318b93394200a80ba72ec74c321e',uuid=3ce9b2be-aeb4-45e3-966c-e11667e6be8a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2eaf99e2-fc08-4374-91b6-192bde04bae6", "address": "fa:16:3e:6c:5e:8a", "network": {"id": "48c8af75-6a89-441b-8e4a-8c7186006537", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2172147-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9af984d06e5340f8a65a54a806c7c88a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eaf99e2-fc", "ovs_interfaceid": "2eaf99e2-fc08-4374-91b6-192bde04bae6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 09:33:26 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-db070bfe-44b0-4635-92ee-c454ddce5449 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] Converting VIF {"id": "2eaf99e2-fc08-4374-91b6-192bde04bae6", "address": "fa:16:3e:6c:5e:8a", "network": {"id": "48c8af75-6a89-441b-8e4a-8c7186006537", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2172147-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9af984d06e5340f8a65a54a806c7c88a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eaf99e2-fc", "ovs_interfaceid": "2eaf99e2-fc08-4374-91b6-192bde04bae6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 09:33:26 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-db070bfe-44b0-4635-92ee-c454ddce5449 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:5e:8a,bridge_name='br-int',has_traffic_filtering=True,id=2eaf99e2-fc08-4374-91b6-192bde04bae6,network=Network(48c8af75-6a89-441b-8e4a-8c7186006537),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2eaf99e2-fc') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 09:33:26 user nova-compute[75122]: DEBUG os_vif [None req-db070bfe-44b0-4635-92ee-c454ddce5449 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:5e:8a,bridge_name='br-int',has_traffic_filtering=True,id=2eaf99e2-fc08-4374-91b6-192bde04bae6,network=Network(48c8af75-6a89-441b-8e4a-8c7186006537),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2eaf99e2-fc') {{(pid=75122) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 09:33:26 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:33:26 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:33:26 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 09:33:26 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:33:26 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a5824f2a-bd0f-5760-bb5a-5d8855a36f04', '_type': 'linux-noop'}}, row=False) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:33:26 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:33:26 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:33:26 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:33:26 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2eaf99e2-fc, may_exist=True, interface_attrs={}) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:33:26 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2eaf99e2-fc, col_values=(('qos', UUID('63844025-86a2-4953-8cfc-2123fb7bb94b')),), if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:33:26 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2eaf99e2-fc, col_values=(('external_ids', {'iface-id': '2eaf99e2-fc08-4374-91b6-192bde04bae6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6c:5e:8a', 'vm-uuid': '3ce9b2be-aeb4-45e3-966c-e11667e6be8a'}),), if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:33:26 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:33:26 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:33:26 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:33:26 user nova-compute[75122]: INFO os_vif [None req-db070bfe-44b0-4635-92ee-c454ddce5449 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:5e:8a,bridge_name='br-int',has_traffic_filtering=True,id=2eaf99e2-fc08-4374-91b6-192bde04bae6,network=Network(48c8af75-6a89-441b-8e4a-8c7186006537),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2eaf99e2-fc')
Nov 15 09:33:26 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-db070bfe-44b0-4635-92ee-c454ddce5449 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] No BDM found with device name vda, not building metadata. {{(pid=75122) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 09:33:26 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-db070bfe-44b0-4635-92ee-c454ddce5449 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] No VIF found with MAC fa:16:3e:6c:5e:8a, not building metadata {{(pid=75122) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 09:33:26 user nova-compute[75122]: DEBUG nova.network.neutron [req-4056fabd-3060-4a74-bd8a-7f89dd96ae9d req-06751386-3c94-4269-9da6-be8b8c719f64 service nova] [instance: 3ce9b2be-aeb4-45e3-966c-e11667e6be8a] Updated VIF entry in instance network info cache for port 2eaf99e2-fc08-4374-91b6-192bde04bae6. {{(pid=75122) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 09:33:26 user nova-compute[75122]: DEBUG nova.network.neutron [req-4056fabd-3060-4a74-bd8a-7f89dd96ae9d req-06751386-3c94-4269-9da6-be8b8c719f64 service nova] [instance: 3ce9b2be-aeb4-45e3-966c-e11667e6be8a] Updating instance_info_cache with network_info: [{"id": "2eaf99e2-fc08-4374-91b6-192bde04bae6", "address": "fa:16:3e:6c:5e:8a", "network": {"id": "48c8af75-6a89-441b-8e4a-8c7186006537", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2172147-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9af984d06e5340f8a65a54a806c7c88a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eaf99e2-fc", "ovs_interfaceid": "2eaf99e2-fc08-4374-91b6-192bde04bae6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:33:26 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-4056fabd-3060-4a74-bd8a-7f89dd96ae9d req-06751386-3c94-4269-9da6-be8b8c719f64 service nova] Releasing lock "refresh_cache-3ce9b2be-aeb4-45e3-966c-e11667e6be8a" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 09:33:27 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-0d20b13b-59a4-4a27-93b4-94ac06d36b9c tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance d24a189e-2de9-404e-b281-224c150a5bbf is timed out.
Nov 15 09:33:27 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-0d20b13b-59a4-4a27-93b4-94ac06d36b9c tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] Successfully detached device vdb from instance d24a189e-2de9-404e-b281-224c150a5bbf from the live domain config.
Nov 15 09:33:27 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d20b13b-59a4-4a27-93b4-94ac06d36b9c tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] [instance: d24a189e-2de9-404e-b281-224c150a5bbf] calling os-brick to detach iSCSI Volume {{(pid=75122) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 09:33:27 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d20b13b-59a4-4a27-93b4-94ac06d36b9c tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffa04060b80>, {'target_iqn': 'iqn.2010-10.org.openstack:0796957f-5a19-4fe2-acb8-f3568399150a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KPflkmYs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc', 'volume_id': '0796957f-5a19-4fe2-acb8-f3568399150a'}, None), 'kwargs': False}}" {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 09:33:27 user nova-compute[75122]: WARNING os_brick.initiator.connectors.base [None req-0d20b13b-59a4-4a27-93b4-94ac06d36b9c tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 09:33:27 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-0d20b13b-59a4-4a27-93b4-94ac06d36b9c tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 09:33:27 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-0d20b13b-59a4-4a27-93b4-94ac06d36b9c tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 09:33:27 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:33:27 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:33:27 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[012421c2-6f36-4d60-93af-d0fb7f399548]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0796957f-5a19-4fe2-acb8-f3568399150a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:33:27 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d20b13b-59a4-4a27-93b4-94ac06d36b9c tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 09:33:27 user nova-compute[75122]: No targets found.
Nov 15 09:33:27 user nova-compute[75122]: iSNS:
Nov 15 09:33:27 user nova-compute[75122]: No targets found.
Nov 15 09:33:27 user nova-compute[75122]: STATIC:
Nov 15 09:33:27 user nova-compute[75122]: Target: iqn.2010-10.org.openstack:0796957f-5a19-4fe2-acb8-f3568399150a
Nov 15 09:33:27 user nova-compute[75122]:         Portal: 172.16.0.220:3260,-1
Nov 15 09:33:27 user nova-compute[75122]:                 Iface Name: default
Nov 15 09:33:27 user nova-compute[75122]: FIRMWARE:
Nov 15 09:33:27 user nova-compute[75122]: No targets found.
Nov 15 09:33:27 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 09:33:27 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d20b13b-59a4-4a27-93b4-94ac06d36b9c tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 09:33:27 user nova-compute[75122]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 09:33:27 user nova-compute[75122]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75122) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 09:33:27 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d20b13b-59a4-4a27-93b4-94ac06d36b9c tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0796957f-5a19-4fe2-acb8-f3568399150a', 0)] {{(pid=75122) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 09:33:27 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:33:27 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:33:27 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[898924c7-ec92-4b3a-a470-07a850e921f4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0796957f-5a19-4fe2-acb8-f3568399150a\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:33:27 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:33:27 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:33:27 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[aee10d1d-6c11-42bd-bad4-3fc7f5319faf]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0796957f-5a19-4fe2-acb8-f3568399150a (non-flash)\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:33:27 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d20b13b-59a4-4a27-93b4-94ac06d36b9c tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0796957f-5a19-4fe2-acb8-f3568399150a (non-flash)
Nov 15 09:33:27 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 09:33:27 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d20b13b-59a4-4a27-93b4-94ac06d36b9c tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0796957f-5a19-4fe2-acb8-f3568399150a (non-flash)
Nov 15 09:33:27 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 09:33:27 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d20b13b-59a4-4a27-93b4-94ac06d36b9c tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff9e4545510>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0796957f-5a19-4fe2-acb8-f3568399150a'): ({'sdc'}, set())}) {{(pid=75122) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 09:33:27 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-0d20b13b-59a4-4a27-93b4-94ac06d36b9c tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] Removing single pathed devices sdc {{(pid=75122) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 09:33:27 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:33:27 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:33:27 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.033s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:33:27 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[04b52103-5876-4c27-a2fd-dfe2d1497e09]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:33:27 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:33:27 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.036s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:33:27 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ff3ffdc-5621-484e-8602-ce992f598312]: (4, ('ok\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:33:27 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-0d20b13b-59a4-4a27-93b4-94ac06d36b9c tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] Flushing IO for device /dev/sdc {{(pid=75122) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 09:33:27 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:33:27 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:33:27 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:33:27 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[338440c9-732d-4339-9f91-88ff92049124]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:33:27 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-0d20b13b-59a4-4a27-93b4-94ac06d36b9c tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75122) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 09:33:27 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:33:27 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.044s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:33:27 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad6fec47-bb19-4197-8250-18e46e0abe0e]: (4, ('1', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:33:28 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-0d20b13b-59a4-4a27-93b4-94ac06d36b9c tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75122) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 09:33:28 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-0d20b13b-59a4-4a27-93b4-94ac06d36b9c tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] SCSI volumes sdc have been removed. {{(pid=75122) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 09:33:28 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d20b13b-59a4-4a27-93b4-94ac06d36b9c tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0796957f-5a19-4fe2-acb8-f3568399150a')] {{(pid=75122) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 09:33:28 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0796957f-5a19-4fe2-acb8-f3568399150a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:33:28 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0796957f-5a19-4fe2-acb8-f3568399150a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.035s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:33:28 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[f89fd8f3-93df-410d-9b68-a9bab6f9f850]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:33:28 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d20b13b-59a4-4a27-93b4-94ac06d36b9c tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:33:28 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0796957f-5a19-4fe2-acb8-f3568399150a -p 172.16.0.220:3260 --logout {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:33:28 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0796957f-5a19-4fe2-acb8-f3568399150a -p 172.16.0.220:3260 --logout" returned: 0 in 0.106s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:33:28 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[e37630a4-a8ae-46c3-964b-ab0413a8ab8e]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:0796957f-5a19-4fe2-acb8-f3568399150a, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:0796957f-5a19-4fe2-acb8-f3568399150a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:33:28 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d20b13b-59a4-4a27-93b4-94ac06d36b9c tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:0796957f-5a19-4fe2-acb8-f3568399150a, portal: 172.16.0.220,3260]
Nov 15 09:33:28 user nova-compute[75122]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:0796957f-5a19-4fe2-acb8-f3568399150a, portal: 172.16.0.220,3260] successful.
Nov 15 09:33:28 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:33:28 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0796957f-5a19-4fe2-acb8-f3568399150a -p 172.16.0.220:3260 --op delete {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:33:28 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0796957f-5a19-4fe2-acb8-f3568399150a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:33:28 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[51e1e64e-25ae-40c9-854f-9facfc9a7e04]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:33:28 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d20b13b-59a4-4a27-93b4-94ac06d36b9c tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:33:28 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-0d20b13b-59a4-4a27-93b4-94ac06d36b9c tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.449s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 09:33:28 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d20b13b-59a4-4a27-93b4-94ac06d36b9c tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] <== disconnect_volume: return (451ms) None {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 09:33:28 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d20b13b-59a4-4a27-93b4-94ac06d36b9c tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] [instance: d24a189e-2de9-404e-b281-224c150a5bbf] Disconnected iSCSI Volume {{(pid=75122) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 09:33:28 user nova-compute[75122]: DEBUG nova.compute.manager [req-1d51c6be-558b-4fa2-a983-ebba7b934cec req-d3ad1199-1c0d-48b8-8e5c-cebbb3476034 service nova] [instance: 3ce9b2be-aeb4-45e3-966c-e11667e6be8a] Received event network-vif-plugged-2eaf99e2-fc08-4374-91b6-192bde04bae6 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:33:28 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-1d51c6be-558b-4fa2-a983-ebba7b934cec req-d3ad1199-1c0d-48b8-8e5c-cebbb3476034 service nova] Acquiring lock "3ce9b2be-aeb4-45e3-966c-e11667e6be8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:33:28 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-1d51c6be-558b-4fa2-a983-ebba7b934cec req-d3ad1199-1c0d-48b8-8e5c-cebbb3476034 service nova] Lock "3ce9b2be-aeb4-45e3-966c-e11667e6be8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:33:28 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-1d51c6be-558b-4fa2-a983-ebba7b934cec req-d3ad1199-1c0d-48b8-8e5c-cebbb3476034 service nova] Lock "3ce9b2be-aeb4-45e3-966c-e11667e6be8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:33:28 user nova-compute[75122]: DEBUG nova.compute.manager [req-1d51c6be-558b-4fa2-a983-ebba7b934cec req-d3ad1199-1c0d-48b8-8e5c-cebbb3476034 service nova] [instance: 3ce9b2be-aeb4-45e3-966c-e11667e6be8a] No waiting events found dispatching network-vif-plugged-2eaf99e2-fc08-4374-91b6-192bde04bae6 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:33:28 user nova-compute[75122]: WARNING nova.compute.manager [req-1d51c6be-558b-4fa2-a983-ebba7b934cec req-d3ad1199-1c0d-48b8-8e5c-cebbb3476034 service nova] [instance: 3ce9b2be-aeb4-45e3-966c-e11667e6be8a] Received unexpected event network-vif-plugged-2eaf99e2-fc08-4374-91b6-192bde04bae6 for instance with vm_state building and task_state spawning.
Nov 15 09:33:28 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:33:28 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:33:28 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:33:29 user nova-compute[75122]: DEBUG nova.objects.instance [None req-0d20b13b-59a4-4a27-93b4-94ac06d36b9c tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] Lazy-loading 'flavor' on Instance uuid d24a189e-2de9-404e-b281-224c150a5bbf {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:33:29 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0d20b13b-59a4-4a27-93b4-94ac06d36b9c tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] Lock "d24a189e-2de9-404e-b281-224c150a5bbf" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.011s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:33:29 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:33:30 user nova-compute[75122]: DEBUG nova.compute.manager [None req-db070bfe-44b0-4635-92ee-c454ddce5449 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] [instance: 3ce9b2be-aeb4-45e3-966c-e11667e6be8a] Instance event wait completed in 0 seconds for  {{(pid=75122) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 09:33:30 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-db070bfe-44b0-4635-92ee-c454ddce5449 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] [instance: 3ce9b2be-aeb4-45e3-966c-e11667e6be8a] Guest created on hypervisor {{(pid=75122) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 09:33:30 user nova-compute[75122]: INFO nova.virt.libvirt.driver [-] [instance: 3ce9b2be-aeb4-45e3-966c-e11667e6be8a] Instance spawned successfully.
Nov 15 09:33:30 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-db070bfe-44b0-4635-92ee-c454ddce5449 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] [instance: 3ce9b2be-aeb4-45e3-966c-e11667e6be8a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 09:33:30 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-db070bfe-44b0-4635-92ee-c454ddce5449 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] [instance: 3ce9b2be-aeb4-45e3-966c-e11667e6be8a] Found default for hw_cdrom_bus of ide {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:33:30 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-db070bfe-44b0-4635-92ee-c454ddce5449 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] [instance: 3ce9b2be-aeb4-45e3-966c-e11667e6be8a] Found default for hw_disk_bus of virtio {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:33:30 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-db070bfe-44b0-4635-92ee-c454ddce5449 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] [instance: 3ce9b2be-aeb4-45e3-966c-e11667e6be8a] Found default for hw_input_bus of None {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:33:30 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-db070bfe-44b0-4635-92ee-c454ddce5449 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] [instance: 3ce9b2be-aeb4-45e3-966c-e11667e6be8a] Found default for hw_pointer_model of None {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:33:30 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-db070bfe-44b0-4635-92ee-c454ddce5449 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] [instance: 3ce9b2be-aeb4-45e3-966c-e11667e6be8a] Found default for hw_video_model of virtio {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:33:30 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-db070bfe-44b0-4635-92ee-c454ddce5449 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] [instance: 3ce9b2be-aeb4-45e3-966c-e11667e6be8a] Found default for hw_vif_model of virtio {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:33:30 user nova-compute[75122]: DEBUG nova.compute.manager [req-070f2ad0-44d2-4264-9e94-4e5e5a7e5a30 req-dbc0600b-6fc7-416b-bfd9-4f73decc7fac service nova] [instance: 3ce9b2be-aeb4-45e3-966c-e11667e6be8a] Received event network-vif-plugged-2eaf99e2-fc08-4374-91b6-192bde04bae6 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:33:30 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-070f2ad0-44d2-4264-9e94-4e5e5a7e5a30 req-dbc0600b-6fc7-416b-bfd9-4f73decc7fac service nova] Acquiring lock "3ce9b2be-aeb4-45e3-966c-e11667e6be8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:33:30 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-070f2ad0-44d2-4264-9e94-4e5e5a7e5a30 req-dbc0600b-6fc7-416b-bfd9-4f73decc7fac service nova] Lock "3ce9b2be-aeb4-45e3-966c-e11667e6be8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:33:30 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-070f2ad0-44d2-4264-9e94-4e5e5a7e5a30 req-dbc0600b-6fc7-416b-bfd9-4f73decc7fac service nova] Lock "3ce9b2be-aeb4-45e3-966c-e11667e6be8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:33:30 user nova-compute[75122]: DEBUG nova.compute.manager [req-070f2ad0-44d2-4264-9e94-4e5e5a7e5a30 req-dbc0600b-6fc7-416b-bfd9-4f73decc7fac service nova] [instance: 3ce9b2be-aeb4-45e3-966c-e11667e6be8a] No waiting events found dispatching network-vif-plugged-2eaf99e2-fc08-4374-91b6-192bde04bae6 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:33:30 user nova-compute[75122]: WARNING nova.compute.manager [req-070f2ad0-44d2-4264-9e94-4e5e5a7e5a30 req-dbc0600b-6fc7-416b-bfd9-4f73decc7fac service nova] [instance: 3ce9b2be-aeb4-45e3-966c-e11667e6be8a] Received unexpected event network-vif-plugged-2eaf99e2-fc08-4374-91b6-192bde04bae6 for instance with vm_state building and task_state spawning.
Nov 15 09:33:30 user nova-compute[75122]: INFO nova.compute.manager [None req-db070bfe-44b0-4635-92ee-c454ddce5449 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] [instance: 3ce9b2be-aeb4-45e3-966c-e11667e6be8a] Took 5.65 seconds to spawn the instance on the hypervisor.
Nov 15 09:33:30 user nova-compute[75122]: DEBUG nova.compute.manager [None req-db070bfe-44b0-4635-92ee-c454ddce5449 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] [instance: 3ce9b2be-aeb4-45e3-966c-e11667e6be8a] Checking state {{(pid=75122) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 09:33:30 user nova-compute[75122]: INFO nova.compute.manager [None req-db070bfe-44b0-4635-92ee-c454ddce5449 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] [instance: 3ce9b2be-aeb4-45e3-966c-e11667e6be8a] Took 6.28 seconds to build instance.
Nov 15 09:33:30 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-db070bfe-44b0-4635-92ee-c454ddce5449 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] Lock "3ce9b2be-aeb4-45e3-966c-e11667e6be8a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.388s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:33:31 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:33:34 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:33:35 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] Acquiring lock "742d64db-c555-4517-8ec9-cef02f09a6e0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:33:35 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] Lock "742d64db-c555-4517-8ec9-cef02f09a6e0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:33:35 user nova-compute[75122]: DEBUG nova.compute.manager [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] Starting instance... {{(pid=75122) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 09:33:35 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:33:35 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:33:35 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75122) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 09:33:35 user nova-compute[75122]: INFO nova.compute.claims [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] Claim successful on node user
Nov 15 09:33:35 user nova-compute[75122]: DEBUG nova.compute.provider_tree [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] Inventory has not changed in ProviderTree for provider: 69a3da65-47be-44c6-b67c-c692b58284ef {{(pid=75122) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 09:33:35 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] Inventory has not changed for provider 69a3da65-47be-44c6-b67c-c692b58284ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 09:33:35 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.322s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:33:35 user nova-compute[75122]: DEBUG nova.compute.manager [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] Start building networks asynchronously for instance. {{(pid=75122) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 09:33:35 user nova-compute[75122]: DEBUG nova.compute.manager [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] Allocating IP information in the background. {{(pid=75122) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 09:33:35 user nova-compute[75122]: DEBUG nova.network.neutron [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] allocate_for_instance() {{(pid=75122) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 09:33:35 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 09:33:35 user nova-compute[75122]: DEBUG nova.compute.manager [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] Start building block device mappings for instance. {{(pid=75122) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 09:33:36 user nova-compute[75122]: INFO nova.virt.block_device [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] Booting with volume 01563785-3767-460a-9815-c1bd0f7f6f9f at /dev/vda
Nov 15 09:33:36 user nova-compute[75122]: DEBUG nova.policy [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ba8869fcf4464284b52e2aaa41597bdd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '641f0acd05d8403882a4f6b1b28e9269', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75122) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 09:33:36 user nova-compute[75122]: DEBUG os_brick.utils [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 09:33:36 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:33:36 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:33:36 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[93d201f6-f412-4084-a273-6920f9e6bb00]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:742fb64b3587\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:33:36 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:33:36 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:33:36 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[16ec7515-9e14-4710-9e77-fcf488187b85]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:33:36 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:33:36 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:33:36 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[06923f2f-ecd3-47cc-947d-396e8c53dd3b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:33:36 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bcbd2eb-c6b0-4211-ab75-0e55634e702f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:33:36 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] Running cmd (subprocess): nvme version {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:33:36 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] 'nvme version' failed. Not Retrying. {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 09:33:36 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.nvmeof [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] nvme not present on system {{(pid=75122) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 09:33:36 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:33:36 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 09:33:36 user nova-compute[75122]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 09:33:36 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[9040e2c4-be2e-4107-b9a6-2f5a2b928ed4]: (4, '') {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:33:36 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.lightos [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75122) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 09:33:36 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.lightos [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75122) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 09:33:36 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.lightos [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] LIGHTOS: no hostnqn found. {{(pid=75122) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 09:33:36 user nova-compute[75122]: DEBUG os_brick.utils [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:742fb64b3587', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 09:33:36 user nova-compute[75122]: DEBUG nova.virt.block_device [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] Updating existing volume attachment record: e2bc0bbc-beed-4d97-95c9-8ecf53dcb492 {{(pid=75122) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 09:33:36 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:33:36 user nova-compute[75122]: DEBUG nova.network.neutron [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] Successfully created port: 7febe2f1-4891-4ad4-ac59-58edfd3d2f03 {{(pid=75122) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 09:33:37 user nova-compute[75122]: DEBUG nova.network.neutron [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] Successfully created port: 5ebcafd9-6939-4928-ae2f-38ec38e15876 {{(pid=75122) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 09:33:37 user nova-compute[75122]: DEBUG nova.network.neutron [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] Successfully created port: 5bf17322-fd6b-4335-9a8e-56e7cd64e180 {{(pid=75122) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 09:33:38 user nova-compute[75122]: DEBUG nova.network.neutron [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] Successfully created port: 710ae079-0b1c-4c04-bea2-e34fd0d554ae {{(pid=75122) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 09:33:38 user nova-compute[75122]: DEBUG nova.network.neutron [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] Successfully created port: d378cd7b-d582-4062-a714-d4456d71ba5f {{(pid=75122) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 09:33:39 user nova-compute[75122]: DEBUG nova.network.neutron [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] Successfully updated port: 7febe2f1-4891-4ad4-ac59-58edfd3d2f03 {{(pid=75122) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 09:33:39 user nova-compute[75122]: DEBUG nova.compute.manager [req-d91f4ae1-8b08-46eb-ae3b-4f637201480e req-80c88759-6671-432a-a604-e5ecc1f66ebb service nova] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] Received event network-changed-7febe2f1-4891-4ad4-ac59-58edfd3d2f03 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:33:39 user nova-compute[75122]: DEBUG nova.compute.manager [req-d91f4ae1-8b08-46eb-ae3b-4f637201480e req-80c88759-6671-432a-a604-e5ecc1f66ebb service nova] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] Refreshing instance network info cache due to event network-changed-7febe2f1-4891-4ad4-ac59-58edfd3d2f03. {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 09:33:39 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-d91f4ae1-8b08-46eb-ae3b-4f637201480e req-80c88759-6671-432a-a604-e5ecc1f66ebb service nova] Acquiring lock "refresh_cache-742d64db-c555-4517-8ec9-cef02f09a6e0" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 09:33:39 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-d91f4ae1-8b08-46eb-ae3b-4f637201480e req-80c88759-6671-432a-a604-e5ecc1f66ebb service nova] Acquired lock "refresh_cache-742d64db-c555-4517-8ec9-cef02f09a6e0" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 09:33:39 user nova-compute[75122]: DEBUG nova.network.neutron [req-d91f4ae1-8b08-46eb-ae3b-4f637201480e req-80c88759-6671-432a-a604-e5ecc1f66ebb service nova] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] Refreshing network info cache for port 7febe2f1-4891-4ad4-ac59-58edfd3d2f03 {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 09:33:39 user nova-compute[75122]: DEBUG nova.network.neutron [req-d91f4ae1-8b08-46eb-ae3b-4f637201480e req-80c88759-6671-432a-a604-e5ecc1f66ebb service nova] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] Instance cache missing network info. {{(pid=75122) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 09:33:39 user nova-compute[75122]: DEBUG nova.network.neutron [req-d91f4ae1-8b08-46eb-ae3b-4f637201480e req-80c88759-6671-432a-a604-e5ecc1f66ebb service nova] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] Updating instance_info_cache with network_info: [] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:33:39 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-d91f4ae1-8b08-46eb-ae3b-4f637201480e req-80c88759-6671-432a-a604-e5ecc1f66ebb service nova] Releasing lock "refresh_cache-742d64db-c555-4517-8ec9-cef02f09a6e0" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 09:33:40 user nova-compute[75122]: DEBUG nova.network.neutron [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] Successfully updated port: d8bfb09a-3733-4176-beec-aaa512b4ed8c {{(pid=75122) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 09:33:40 user nova-compute[75122]: DEBUG nova.network.neutron [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] Successfully updated port: eaecb293-c647-47d7-8103-6fb8851477f3 {{(pid=75122) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 09:33:40 user nova-compute[75122]: INFO nova.virt.block_device [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] Booting with volume bca4e77f-05f8-4ff6-8a78-6cef699f5667 at /dev/vdb
Nov 15 09:33:41 user nova-compute[75122]: DEBUG os_brick.utils [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 09:33:41 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:33:41 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:33:41 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bec7216-e8aa-4243-8c37-591aeed6fd4d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:742fb64b3587\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:33:41 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:33:41 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:33:41 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b2a35a1-6765-4951-910f-9733423cf540]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:33:41 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:33:41 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:33:41 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9a2f172-d4d9-4c46-bcda-042763623d91]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:33:41 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fbb5c33-e7e9-4c90-a4b8-3394e5284678]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:33:41 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] Running cmd (subprocess): nvme version {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:33:41 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] 'nvme version' failed. Not Retrying. {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 09:33:41 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.nvmeof [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] nvme not present on system {{(pid=75122) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 09:33:41 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:33:41 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 09:33:41 user nova-compute[75122]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 09:33:41 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[35adcaa2-e1d8-47ae-a616-3d954aa4f065]: (4, '') {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:33:41 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.lightos [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75122) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 09:33:41 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.lightos [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75122) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 09:33:41 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.lightos [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] LIGHTOS: no hostnqn found. {{(pid=75122) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 09:33:41 user nova-compute[75122]: DEBUG os_brick.utils [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:742fb64b3587', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 09:33:41 user nova-compute[75122]: DEBUG nova.virt.block_device [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] Updating existing volume attachment record: e31effb4-88ea-424b-9bde-cbeba3667a71 {{(pid=75122) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 09:33:41 user nova-compute[75122]: DEBUG nova.network.neutron [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] Successfully updated port: 5ebcafd9-6939-4928-ae2f-38ec38e15876 {{(pid=75122) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 09:33:41 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:33:41 user nova-compute[75122]: DEBUG nova.compute.manager [req-abb05d72-f297-439d-a55c-47633f21f138 req-cd8fe7d5-1cc6-4c55-b52c-1d02e04c6412 service nova] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] Received event network-changed-d8bfb09a-3733-4176-beec-aaa512b4ed8c {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:33:41 user nova-compute[75122]: DEBUG nova.compute.manager [req-abb05d72-f297-439d-a55c-47633f21f138 req-cd8fe7d5-1cc6-4c55-b52c-1d02e04c6412 service nova] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] Refreshing instance network info cache due to event network-changed-d8bfb09a-3733-4176-beec-aaa512b4ed8c. {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 09:33:41 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-abb05d72-f297-439d-a55c-47633f21f138 req-cd8fe7d5-1cc6-4c55-b52c-1d02e04c6412 service nova] Acquiring lock "refresh_cache-742d64db-c555-4517-8ec9-cef02f09a6e0" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 09:33:41 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-abb05d72-f297-439d-a55c-47633f21f138 req-cd8fe7d5-1cc6-4c55-b52c-1d02e04c6412 service nova] Acquired lock "refresh_cache-742d64db-c555-4517-8ec9-cef02f09a6e0" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 09:33:41 user nova-compute[75122]: DEBUG nova.network.neutron [req-abb05d72-f297-439d-a55c-47633f21f138 req-cd8fe7d5-1cc6-4c55-b52c-1d02e04c6412 service nova] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] Refreshing network info cache for port d8bfb09a-3733-4176-beec-aaa512b4ed8c {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 09:33:41 user nova-compute[75122]: DEBUG nova.network.neutron [req-abb05d72-f297-439d-a55c-47633f21f138 req-cd8fe7d5-1cc6-4c55-b52c-1d02e04c6412 service nova] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] Instance cache missing network info. {{(pid=75122) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 09:33:41 user nova-compute[75122]: DEBUG nova.network.neutron [req-abb05d72-f297-439d-a55c-47633f21f138 req-cd8fe7d5-1cc6-4c55-b52c-1d02e04c6412 service nova] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] Updating instance_info_cache with network_info: [] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:33:41 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-abb05d72-f297-439d-a55c-47633f21f138 req-cd8fe7d5-1cc6-4c55-b52c-1d02e04c6412 service nova] Releasing lock "refresh_cache-742d64db-c555-4517-8ec9-cef02f09a6e0" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 09:33:41 user nova-compute[75122]: DEBUG nova.compute.manager [req-abb05d72-f297-439d-a55c-47633f21f138 req-cd8fe7d5-1cc6-4c55-b52c-1d02e04c6412 service nova] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] Received event network-changed-eaecb293-c647-47d7-8103-6fb8851477f3 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:33:41 user nova-compute[75122]: DEBUG nova.compute.manager [req-abb05d72-f297-439d-a55c-47633f21f138 req-cd8fe7d5-1cc6-4c55-b52c-1d02e04c6412 service nova] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] Refreshing instance network info cache due to event network-changed-eaecb293-c647-47d7-8103-6fb8851477f3. {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 09:33:41 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-abb05d72-f297-439d-a55c-47633f21f138 req-cd8fe7d5-1cc6-4c55-b52c-1d02e04c6412 service nova] Acquiring lock "refresh_cache-742d64db-c555-4517-8ec9-cef02f09a6e0" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 09:33:41 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-abb05d72-f297-439d-a55c-47633f21f138 req-cd8fe7d5-1cc6-4c55-b52c-1d02e04c6412 service nova] Acquired lock "refresh_cache-742d64db-c555-4517-8ec9-cef02f09a6e0" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 09:33:41 user nova-compute[75122]: DEBUG nova.network.neutron [req-abb05d72-f297-439d-a55c-47633f21f138 req-cd8fe7d5-1cc6-4c55-b52c-1d02e04c6412 service nova] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] Refreshing network info cache for port eaecb293-c647-47d7-8103-6fb8851477f3 {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 09:33:42 user nova-compute[75122]: DEBUG nova.network.neutron [req-abb05d72-f297-439d-a55c-47633f21f138 req-cd8fe7d5-1cc6-4c55-b52c-1d02e04c6412 service nova] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] Instance cache missing network info. {{(pid=75122) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 09:33:42 user nova-compute[75122]: DEBUG nova.network.neutron [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] Successfully updated port: 5bf17322-fd6b-4335-9a8e-56e7cd64e180 {{(pid=75122) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 09:33:42 user nova-compute[75122]: DEBUG nova.network.neutron [req-abb05d72-f297-439d-a55c-47633f21f138 req-cd8fe7d5-1cc6-4c55-b52c-1d02e04c6412 service nova] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] Updating instance_info_cache with network_info: [] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:33:42 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-abb05d72-f297-439d-a55c-47633f21f138 req-cd8fe7d5-1cc6-4c55-b52c-1d02e04c6412 service nova] Releasing lock "refresh_cache-742d64db-c555-4517-8ec9-cef02f09a6e0" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 09:33:42 user nova-compute[75122]: DEBUG nova.compute.manager [req-abb05d72-f297-439d-a55c-47633f21f138 req-cd8fe7d5-1cc6-4c55-b52c-1d02e04c6412 service nova] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] Received event network-changed-5ebcafd9-6939-4928-ae2f-38ec38e15876 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:33:42 user nova-compute[75122]: DEBUG nova.compute.manager [req-abb05d72-f297-439d-a55c-47633f21f138 req-cd8fe7d5-1cc6-4c55-b52c-1d02e04c6412 service nova] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] Refreshing instance network info cache due to event network-changed-5ebcafd9-6939-4928-ae2f-38ec38e15876. {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 09:33:42 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-abb05d72-f297-439d-a55c-47633f21f138 req-cd8fe7d5-1cc6-4c55-b52c-1d02e04c6412 service nova] Acquiring lock "refresh_cache-742d64db-c555-4517-8ec9-cef02f09a6e0" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 09:33:42 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-abb05d72-f297-439d-a55c-47633f21f138 req-cd8fe7d5-1cc6-4c55-b52c-1d02e04c6412 service nova] Acquired lock "refresh_cache-742d64db-c555-4517-8ec9-cef02f09a6e0" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 09:33:42 user nova-compute[75122]: DEBUG nova.network.neutron [req-abb05d72-f297-439d-a55c-47633f21f138 req-cd8fe7d5-1cc6-4c55-b52c-1d02e04c6412 service nova] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] Refreshing network info cache for port 5ebcafd9-6939-4928-ae2f-38ec38e15876 {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 09:33:42 user nova-compute[75122]: DEBUG nova.network.neutron [req-abb05d72-f297-439d-a55c-47633f21f138 req-cd8fe7d5-1cc6-4c55-b52c-1d02e04c6412 service nova] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] Instance cache missing network info. {{(pid=75122) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 09:33:42 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-60c9e9b4-f205-4162-b23b-8e458bac028b tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] Acquiring lock "e0f32160-7130-4b9c-aa9c-84123f3a6b32" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:33:42 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-60c9e9b4-f205-4162-b23b-8e458bac028b tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] Lock "e0f32160-7130-4b9c-aa9c-84123f3a6b32" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:33:42 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-60c9e9b4-f205-4162-b23b-8e458bac028b tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] Acquiring lock "e0f32160-7130-4b9c-aa9c-84123f3a6b32-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:33:42 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-60c9e9b4-f205-4162-b23b-8e458bac028b tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] Lock "e0f32160-7130-4b9c-aa9c-84123f3a6b32-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:33:42 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-60c9e9b4-f205-4162-b23b-8e458bac028b tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] Lock "e0f32160-7130-4b9c-aa9c-84123f3a6b32-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:33:42 user nova-compute[75122]: INFO nova.compute.manager [None req-60c9e9b4-f205-4162-b23b-8e458bac028b tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] [instance: e0f32160-7130-4b9c-aa9c-84123f3a6b32] Terminating instance
Nov 15 09:33:42 user nova-compute[75122]: DEBUG nova.compute.manager [None req-60c9e9b4-f205-4162-b23b-8e458bac028b tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] [instance: e0f32160-7130-4b9c-aa9c-84123f3a6b32] Start destroying the instance on the hypervisor. {{(pid=75122) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 09:33:42 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:33:42 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:33:42 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:33:42 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:33:42 user nova-compute[75122]: DEBUG nova.network.neutron [req-abb05d72-f297-439d-a55c-47633f21f138 req-cd8fe7d5-1cc6-4c55-b52c-1d02e04c6412 service nova] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] Updating instance_info_cache with network_info: [] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:33:42 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-abb05d72-f297-439d-a55c-47633f21f138 req-cd8fe7d5-1cc6-4c55-b52c-1d02e04c6412 service nova] Releasing lock "refresh_cache-742d64db-c555-4517-8ec9-cef02f09a6e0" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 09:33:42 user nova-compute[75122]: DEBUG nova.compute.manager [req-29cb7a89-8204-41b8-81a5-7297734ed903 req-cae16a6d-2936-4ec6-86a6-a386b0169f9d service nova] [instance: e0f32160-7130-4b9c-aa9c-84123f3a6b32] Received event network-vif-unplugged-0d48c0d7-8a0f-4bfa-b8b7-290f122c3f4a {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:33:42 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-29cb7a89-8204-41b8-81a5-7297734ed903 req-cae16a6d-2936-4ec6-86a6-a386b0169f9d service nova] Acquiring lock "e0f32160-7130-4b9c-aa9c-84123f3a6b32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:33:42 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-29cb7a89-8204-41b8-81a5-7297734ed903 req-cae16a6d-2936-4ec6-86a6-a386b0169f9d service nova] Lock "e0f32160-7130-4b9c-aa9c-84123f3a6b32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:33:42 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-29cb7a89-8204-41b8-81a5-7297734ed903 req-cae16a6d-2936-4ec6-86a6-a386b0169f9d service nova] Lock "e0f32160-7130-4b9c-aa9c-84123f3a6b32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:33:42 user nova-compute[75122]: DEBUG nova.compute.manager [req-29cb7a89-8204-41b8-81a5-7297734ed903 req-cae16a6d-2936-4ec6-86a6-a386b0169f9d service nova] [instance: e0f32160-7130-4b9c-aa9c-84123f3a6b32] No waiting events found dispatching network-vif-unplugged-0d48c0d7-8a0f-4bfa-b8b7-290f122c3f4a {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:33:42 user nova-compute[75122]: DEBUG nova.compute.manager [req-29cb7a89-8204-41b8-81a5-7297734ed903 req-cae16a6d-2936-4ec6-86a6-a386b0169f9d service nova] [instance: e0f32160-7130-4b9c-aa9c-84123f3a6b32] Received event network-vif-unplugged-0d48c0d7-8a0f-4bfa-b8b7-290f122c3f4a for instance with task_state deleting. {{(pid=75122) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 09:33:43 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:33:43 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:33:43 user nova-compute[75122]: DEBUG nova.network.neutron [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] Successfully updated port: 710ae079-0b1c-4c04-bea2-e34fd0d554ae {{(pid=75122) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 09:33:43 user nova-compute[75122]: INFO nova.virt.libvirt.driver [-] [instance: e0f32160-7130-4b9c-aa9c-84123f3a6b32] Instance destroyed successfully.
Nov 15 09:33:43 user nova-compute[75122]: DEBUG nova.objects.instance [None req-60c9e9b4-f205-4162-b23b-8e458bac028b tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] Lazy-loading 'resources' on Instance uuid e0f32160-7130-4b9c-aa9c-84123f3a6b32 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:33:43 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-60c9e9b4-f205-4162-b23b-8e458bac028b tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T09:30:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-650907307',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-650907307',id=5,image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEs+MsbbhvkEM+SFSEAT1XChvfwYG6LS4xClecFc1s5hPTjvnawfxaNFAntQJzNhhhBe9ISEtvpo31FTBvmrG/LNlyB/uvXRpPMaH35dzVkZDJmlCiGv/MxZIKKpRxaHLw==',key_name='tempest-keypair-2107215481',keypairs=<?>,launch_index=0,launched_at=2023-11-15T09:30:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6082a9c95d70462586e1f1195b43a383',ramdisk_id='',reservation_id='r-j04j8rw4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-2027876138',owner_user_name='tempest-TaggedAttachmentsTest-2027876138-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T09:30:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d2529e19d29e4120b6e8ae75e16bb5b6',uuid=e0f32160-7130-4b9c-aa9c-84123f3a6b32,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0d48c0d7-8a0f-4bfa-b8b7-290f122c3f4a", "address": "fa:16:3e:fd:20:4e", "network": {"id": "46853cd4-ee0a-44fe-b185-8ef14e956701", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1452664326-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6082a9c95d70462586e1f1195b43a383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d48c0d7-8a", "ovs_interfaceid": "0d48c0d7-8a0f-4bfa-b8b7-290f122c3f4a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 09:33:43 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-60c9e9b4-f205-4162-b23b-8e458bac028b tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] Converting VIF {"id": "0d48c0d7-8a0f-4bfa-b8b7-290f122c3f4a", "address": "fa:16:3e:fd:20:4e", "network": {"id": "46853cd4-ee0a-44fe-b185-8ef14e956701", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1452664326-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6082a9c95d70462586e1f1195b43a383", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0d48c0d7-8a", "ovs_interfaceid": "0d48c0d7-8a0f-4bfa-b8b7-290f122c3f4a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 09:33:43 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-60c9e9b4-f205-4162-b23b-8e458bac028b tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fd:20:4e,bridge_name='br-int',has_traffic_filtering=True,id=0d48c0d7-8a0f-4bfa-b8b7-290f122c3f4a,network=Network(46853cd4-ee0a-44fe-b185-8ef14e956701),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d48c0d7-8a') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 09:33:43 user nova-compute[75122]: DEBUG os_vif [None req-60c9e9b4-f205-4162-b23b-8e458bac028b tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fd:20:4e,bridge_name='br-int',has_traffic_filtering=True,id=0d48c0d7-8a0f-4bfa-b8b7-290f122c3f4a,network=Network(46853cd4-ee0a-44fe-b185-8ef14e956701),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d48c0d7-8a') {{(pid=75122) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 09:33:43 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:33:43 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0d48c0d7-8a, bridge=br-int, if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:33:43 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-a591c7c7-11f3-4632-a857-6c0b5b9d4ccf tempest-VolumesAssistedSnapshotsTest-203861085 tempest-VolumesAssistedSnapshotsTest-203861085-project-member] Acquiring lock "9cfb60cb-011e-4537-9f28-55ea7d6dfc13" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:33:43 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-a591c7c7-11f3-4632-a857-6c0b5b9d4ccf tempest-VolumesAssistedSnapshotsTest-203861085 tempest-VolumesAssistedSnapshotsTest-203861085-project-member] Lock "9cfb60cb-011e-4537-9f28-55ea7d6dfc13" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:33:43 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-a591c7c7-11f3-4632-a857-6c0b5b9d4ccf tempest-VolumesAssistedSnapshotsTest-203861085 tempest-VolumesAssistedSnapshotsTest-203861085-project-member] Acquiring lock "9cfb60cb-011e-4537-9f28-55ea7d6dfc13-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:33:43 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-a591c7c7-11f3-4632-a857-6c0b5b9d4ccf tempest-VolumesAssistedSnapshotsTest-203861085 tempest-VolumesAssistedSnapshotsTest-203861085-project-member] Lock "9cfb60cb-011e-4537-9f28-55ea7d6dfc13-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:33:43 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-a591c7c7-11f3-4632-a857-6c0b5b9d4ccf tempest-VolumesAssistedSnapshotsTest-203861085 tempest-VolumesAssistedSnapshotsTest-203861085-project-member] Lock "9cfb60cb-011e-4537-9f28-55ea7d6dfc13-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:33:43 user nova-compute[75122]: INFO nova.compute.manager [None req-a591c7c7-11f3-4632-a857-6c0b5b9d4ccf tempest-VolumesAssistedSnapshotsTest-203861085 tempest-VolumesAssistedSnapshotsTest-203861085-project-member] [instance: 9cfb60cb-011e-4537-9f28-55ea7d6dfc13] Terminating instance
Nov 15 09:33:43 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:33:43 user nova-compute[75122]: DEBUG nova.compute.manager [None req-a591c7c7-11f3-4632-a857-6c0b5b9d4ccf tempest-VolumesAssistedSnapshotsTest-203861085 tempest-VolumesAssistedSnapshotsTest-203861085-project-member] [instance: 9cfb60cb-011e-4537-9f28-55ea7d6dfc13] Start destroying the instance on the hypervisor. {{(pid=75122) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 09:33:43 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:33:43 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:33:43 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=203c5fe0-b2cd-4b1e-906a-461c61a8eb62) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:33:43 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:33:43 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:33:43 user nova-compute[75122]: INFO os_vif [None req-60c9e9b4-f205-4162-b23b-8e458bac028b tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fd:20:4e,bridge_name='br-int',has_traffic_filtering=True,id=0d48c0d7-8a0f-4bfa-b8b7-290f122c3f4a,network=Network(46853cd4-ee0a-44fe-b185-8ef14e956701),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0d48c0d7-8a')
Nov 15 09:33:43 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-60c9e9b4-f205-4162-b23b-8e458bac028b tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] [instance: e0f32160-7130-4b9c-aa9c-84123f3a6b32] Deleting instance files /opt/stack/data/nova/instances/e0f32160-7130-4b9c-aa9c-84123f3a6b32_del
Nov 15 09:33:43 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-60c9e9b4-f205-4162-b23b-8e458bac028b tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] [instance: e0f32160-7130-4b9c-aa9c-84123f3a6b32] Deletion of /opt/stack/data/nova/instances/e0f32160-7130-4b9c-aa9c-84123f3a6b32_del complete
Nov 15 09:33:43 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:33:43 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:33:43 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:33:43 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:33:43 user nova-compute[75122]: INFO nova.compute.manager [None req-60c9e9b4-f205-4162-b23b-8e458bac028b tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] [instance: e0f32160-7130-4b9c-aa9c-84123f3a6b32] Took 1.22 seconds to destroy the instance on the hypervisor.
Nov 15 09:33:43 user nova-compute[75122]: DEBUG oslo.service.loopingcall [None req-60c9e9b4-f205-4162-b23b-8e458bac028b tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75122) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 09:33:43 user nova-compute[75122]: DEBUG nova.compute.manager [-] [instance: e0f32160-7130-4b9c-aa9c-84123f3a6b32] Deallocating network for instance {{(pid=75122) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 09:33:43 user nova-compute[75122]: DEBUG nova.network.neutron [-] [instance: e0f32160-7130-4b9c-aa9c-84123f3a6b32] deallocate_for_instance() {{(pid=75122) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 09:33:43 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:33:43 user nova-compute[75122]: DEBUG nova.compute.manager [req-ca701324-b3ed-4e9c-b891-a7e92c54b29f req-ede255eb-5012-4a0b-9c0b-a5268f589db3 service nova] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] Received event network-changed-5bf17322-fd6b-4335-9a8e-56e7cd64e180 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:33:43 user nova-compute[75122]: DEBUG nova.compute.manager [req-ca701324-b3ed-4e9c-b891-a7e92c54b29f req-ede255eb-5012-4a0b-9c0b-a5268f589db3 service nova] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] Refreshing instance network info cache due to event network-changed-5bf17322-fd6b-4335-9a8e-56e7cd64e180. {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 09:33:43 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-ca701324-b3ed-4e9c-b891-a7e92c54b29f req-ede255eb-5012-4a0b-9c0b-a5268f589db3 service nova] Acquiring lock "refresh_cache-742d64db-c555-4517-8ec9-cef02f09a6e0" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 09:33:43 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-ca701324-b3ed-4e9c-b891-a7e92c54b29f req-ede255eb-5012-4a0b-9c0b-a5268f589db3 service nova] Acquired lock "refresh_cache-742d64db-c555-4517-8ec9-cef02f09a6e0" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 09:33:43 user nova-compute[75122]: DEBUG nova.network.neutron [req-ca701324-b3ed-4e9c-b891-a7e92c54b29f req-ede255eb-5012-4a0b-9c0b-a5268f589db3 service nova] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] Refreshing network info cache for port 5bf17322-fd6b-4335-9a8e-56e7cd64e180 {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 09:33:43 user nova-compute[75122]: DEBUG nova.compute.manager [req-a016afcf-1d36-4b33-bd52-012cb94dd2a4 req-8ce6741c-d7eb-472f-b730-b9ebb6945839 service nova] [instance: 9cfb60cb-011e-4537-9f28-55ea7d6dfc13] Received event network-vif-unplugged-f46032a9-bba1-47d0-aa79-dc66f360bc46 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:33:43 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-a016afcf-1d36-4b33-bd52-012cb94dd2a4 req-8ce6741c-d7eb-472f-b730-b9ebb6945839 service nova] Acquiring lock "9cfb60cb-011e-4537-9f28-55ea7d6dfc13-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:33:43 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-a016afcf-1d36-4b33-bd52-012cb94dd2a4 req-8ce6741c-d7eb-472f-b730-b9ebb6945839 service nova] Lock "9cfb60cb-011e-4537-9f28-55ea7d6dfc13-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:33:43 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-a016afcf-1d36-4b33-bd52-012cb94dd2a4 req-8ce6741c-d7eb-472f-b730-b9ebb6945839 service nova] Lock "9cfb60cb-011e-4537-9f28-55ea7d6dfc13-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:33:43 user nova-compute[75122]: DEBUG nova.compute.manager [req-a016afcf-1d36-4b33-bd52-012cb94dd2a4 req-8ce6741c-d7eb-472f-b730-b9ebb6945839 service nova] [instance: 9cfb60cb-011e-4537-9f28-55ea7d6dfc13] No waiting events found dispatching network-vif-unplugged-f46032a9-bba1-47d0-aa79-dc66f360bc46 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:33:43 user nova-compute[75122]: DEBUG nova.compute.manager [req-a016afcf-1d36-4b33-bd52-012cb94dd2a4 req-8ce6741c-d7eb-472f-b730-b9ebb6945839 service nova] [instance: 9cfb60cb-011e-4537-9f28-55ea7d6dfc13] Received event network-vif-unplugged-f46032a9-bba1-47d0-aa79-dc66f360bc46 for instance with task_state deleting. {{(pid=75122) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 09:33:43 user nova-compute[75122]: DEBUG nova.network.neutron [req-ca701324-b3ed-4e9c-b891-a7e92c54b29f req-ede255eb-5012-4a0b-9c0b-a5268f589db3 service nova] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] Instance cache missing network info. {{(pid=75122) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 09:33:44 user nova-compute[75122]: DEBUG nova.network.neutron [req-ca701324-b3ed-4e9c-b891-a7e92c54b29f req-ede255eb-5012-4a0b-9c0b-a5268f589db3 service nova] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] Updating instance_info_cache with network_info: [] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:33:44 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-ca701324-b3ed-4e9c-b891-a7e92c54b29f req-ede255eb-5012-4a0b-9c0b-a5268f589db3 service nova] Releasing lock "refresh_cache-742d64db-c555-4517-8ec9-cef02f09a6e0" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 09:33:44 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:33:44 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:33:44 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:33:44 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:33:44 user nova-compute[75122]: INFO nova.virt.libvirt.driver [-] [instance: 9cfb60cb-011e-4537-9f28-55ea7d6dfc13] Instance destroyed successfully.
Nov 15 09:33:44 user nova-compute[75122]: DEBUG nova.objects.instance [None req-a591c7c7-11f3-4632-a857-6c0b5b9d4ccf tempest-VolumesAssistedSnapshotsTest-203861085 tempest-VolumesAssistedSnapshotsTest-203861085-project-member] Lazy-loading 'resources' on Instance uuid 9cfb60cb-011e-4537-9f28-55ea7d6dfc13 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:33:44 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-a591c7c7-11f3-4632-a857-6c0b5b9d4ccf tempest-VolumesAssistedSnapshotsTest-203861085 tempest-VolumesAssistedSnapshotsTest-203861085-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T09:30:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-610720395',display_name='tempest-VolumesAssistedSnapshotsTest-server-610720395',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-610720395',id=8,image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJhDSNEHoW2umlgLV7FRPLk273n8s/V55zW/wyu6CZh6q+6ypjDncZ4/8OV4RAxxZB9g01VzA0OBHG1H9nyjIf0SARXKgqswx9rEW8zRi9CXgxDQlbWVeIXqnKJTfc8yDQ==',key_name='tempest-keypair-1669140798',keypairs=<?>,launch_index=0,launched_at=2023-11-15T09:30:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2823e154de6e4ffc9b965f6b5036cc17',ramdisk_id='',reservation_id='r-ibnq8utf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-203861085',owner_user_name='tempest-VolumesAssistedSnapshotsTest-203861085-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T09:30:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='823d33bbfb544e18ac0a37b233563d79',uuid=9cfb60cb-011e-4537-9f28-55ea7d6dfc13,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f46032a9-bba1-47d0-aa79-dc66f360bc46", "address": "fa:16:3e:95:5c:e0", "network": {"id": "360c0d80-0116-44d9-a9b0-c95257b58658", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1507264907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2823e154de6e4ffc9b965f6b5036cc17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf46032a9-bb", "ovs_interfaceid": "f46032a9-bba1-47d0-aa79-dc66f360bc46", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 09:33:44 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-a591c7c7-11f3-4632-a857-6c0b5b9d4ccf tempest-VolumesAssistedSnapshotsTest-203861085 tempest-VolumesAssistedSnapshotsTest-203861085-project-member] Converting VIF {"id": "f46032a9-bba1-47d0-aa79-dc66f360bc46", "address": "fa:16:3e:95:5c:e0", "network": {"id": "360c0d80-0116-44d9-a9b0-c95257b58658", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1507264907-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2823e154de6e4ffc9b965f6b5036cc17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf46032a9-bb", "ovs_interfaceid": "f46032a9-bba1-47d0-aa79-dc66f360bc46", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 09:33:44 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-a591c7c7-11f3-4632-a857-6c0b5b9d4ccf tempest-VolumesAssistedSnapshotsTest-203861085 tempest-VolumesAssistedSnapshotsTest-203861085-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:95:5c:e0,bridge_name='br-int',has_traffic_filtering=True,id=f46032a9-bba1-47d0-aa79-dc66f360bc46,network=Network(360c0d80-0116-44d9-a9b0-c95257b58658),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf46032a9-bb') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 09:33:44 user nova-compute[75122]: DEBUG os_vif [None req-a591c7c7-11f3-4632-a857-6c0b5b9d4ccf tempest-VolumesAssistedSnapshotsTest-203861085 tempest-VolumesAssistedSnapshotsTest-203861085-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:95:5c:e0,bridge_name='br-int',has_traffic_filtering=True,id=f46032a9-bba1-47d0-aa79-dc66f360bc46,network=Network(360c0d80-0116-44d9-a9b0-c95257b58658),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf46032a9-bb') {{(pid=75122) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 09:33:44 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:33:44 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf46032a9-bb, bridge=br-int, if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:33:44 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:33:44 user nova-compute[75122]: DEBUG nova.network.neutron [-] [instance: e0f32160-7130-4b9c-aa9c-84123f3a6b32] Updating instance_info_cache with network_info: [] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:33:44 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:33:44 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:33:44 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d61fceec-f2d3-47c1-b571-d51e11a0e64e) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:33:44 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:33:44 user nova-compute[75122]: INFO nova.compute.manager [-] [instance: e0f32160-7130-4b9c-aa9c-84123f3a6b32] Took 0.75 seconds to deallocate network for instance.
Nov 15 09:33:44 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:33:44 user nova-compute[75122]: INFO os_vif [None req-a591c7c7-11f3-4632-a857-6c0b5b9d4ccf tempest-VolumesAssistedSnapshotsTest-203861085 tempest-VolumesAssistedSnapshotsTest-203861085-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:95:5c:e0,bridge_name='br-int',has_traffic_filtering=True,id=f46032a9-bba1-47d0-aa79-dc66f360bc46,network=Network(360c0d80-0116-44d9-a9b0-c95257b58658),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf46032a9-bb')
Nov 15 09:33:44 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-a591c7c7-11f3-4632-a857-6c0b5b9d4ccf tempest-VolumesAssistedSnapshotsTest-203861085 tempest-VolumesAssistedSnapshotsTest-203861085-project-member] [instance: 9cfb60cb-011e-4537-9f28-55ea7d6dfc13] Deleting instance files /opt/stack/data/nova/instances/9cfb60cb-011e-4537-9f28-55ea7d6dfc13_del
Nov 15 09:33:44 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-a591c7c7-11f3-4632-a857-6c0b5b9d4ccf tempest-VolumesAssistedSnapshotsTest-203861085 tempest-VolumesAssistedSnapshotsTest-203861085-project-member] [instance: 9cfb60cb-011e-4537-9f28-55ea7d6dfc13] Deletion of /opt/stack/data/nova/instances/9cfb60cb-011e-4537-9f28-55ea7d6dfc13_del complete
Nov 15 09:33:44 user nova-compute[75122]: DEBUG nova.network.neutron [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] Successfully updated port: d378cd7b-d582-4062-a714-d4456d71ba5f {{(pid=75122) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 09:33:44 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] Acquiring lock "refresh_cache-742d64db-c555-4517-8ec9-cef02f09a6e0" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 09:33:44 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] Acquired lock "refresh_cache-742d64db-c555-4517-8ec9-cef02f09a6e0" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 09:33:44 user nova-compute[75122]: DEBUG nova.network.neutron [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] Building network info cache for instance {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 09:33:44 user nova-compute[75122]: INFO nova.compute.manager [None req-a591c7c7-11f3-4632-a857-6c0b5b9d4ccf tempest-VolumesAssistedSnapshotsTest-203861085 tempest-VolumesAssistedSnapshotsTest-203861085-project-member] [instance: 9cfb60cb-011e-4537-9f28-55ea7d6dfc13] Took 1.20 seconds to destroy the instance on the hypervisor.
Nov 15 09:33:44 user nova-compute[75122]: DEBUG oslo.service.loopingcall [None req-a591c7c7-11f3-4632-a857-6c0b5b9d4ccf tempest-VolumesAssistedSnapshotsTest-203861085 tempest-VolumesAssistedSnapshotsTest-203861085-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75122) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 09:33:44 user nova-compute[75122]: DEBUG nova.compute.manager [-] [instance: 9cfb60cb-011e-4537-9f28-55ea7d6dfc13] Deallocating network for instance {{(pid=75122) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 09:33:44 user nova-compute[75122]: DEBUG nova.network.neutron [-] [instance: 9cfb60cb-011e-4537-9f28-55ea7d6dfc13] deallocate_for_instance() {{(pid=75122) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 09:33:44 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-60c9e9b4-f205-4162-b23b-8e458bac028b tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:33:44 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-60c9e9b4-f205-4162-b23b-8e458bac028b tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:33:44 user nova-compute[75122]: DEBUG nova.network.neutron [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] Instance cache missing network info. {{(pid=75122) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 09:33:44 user nova-compute[75122]: DEBUG nova.compute.provider_tree [None req-60c9e9b4-f205-4162-b23b-8e458bac028b tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] Inventory has not changed in ProviderTree for provider: 69a3da65-47be-44c6-b67c-c692b58284ef {{(pid=75122) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 09:33:44 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-60c9e9b4-f205-4162-b23b-8e458bac028b tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] Inventory has not changed for provider 69a3da65-47be-44c6-b67c-c692b58284ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 09:33:44 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-60c9e9b4-f205-4162-b23b-8e458bac028b tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.333s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:33:44 user nova-compute[75122]: INFO nova.scheduler.client.report [None req-60c9e9b4-f205-4162-b23b-8e458bac028b tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] Deleted allocations for instance e0f32160-7130-4b9c-aa9c-84123f3a6b32
Nov 15 09:33:44 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:33:44 user nova-compute[75122]: DEBUG nova.compute.manager [req-d612ae5f-9c68-4c59-bb94-3ac840c96404 req-a8fd6119-dfc3-44dc-9a7c-9239fb29b395 service nova] [instance: e0f32160-7130-4b9c-aa9c-84123f3a6b32] Received event network-vif-plugged-0d48c0d7-8a0f-4bfa-b8b7-290f122c3f4a {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:33:44 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-d612ae5f-9c68-4c59-bb94-3ac840c96404 req-a8fd6119-dfc3-44dc-9a7c-9239fb29b395 service nova] Acquiring lock "e0f32160-7130-4b9c-aa9c-84123f3a6b32-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:33:44 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-d612ae5f-9c68-4c59-bb94-3ac840c96404 req-a8fd6119-dfc3-44dc-9a7c-9239fb29b395 service nova] Lock "e0f32160-7130-4b9c-aa9c-84123f3a6b32-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:33:44 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-d612ae5f-9c68-4c59-bb94-3ac840c96404 req-a8fd6119-dfc3-44dc-9a7c-9239fb29b395 service nova] Lock "e0f32160-7130-4b9c-aa9c-84123f3a6b32-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:33:44 user nova-compute[75122]: DEBUG nova.compute.manager [req-d612ae5f-9c68-4c59-bb94-3ac840c96404 req-a8fd6119-dfc3-44dc-9a7c-9239fb29b395 service nova] [instance: e0f32160-7130-4b9c-aa9c-84123f3a6b32] No waiting events found dispatching network-vif-plugged-0d48c0d7-8a0f-4bfa-b8b7-290f122c3f4a {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:33:44 user nova-compute[75122]: WARNING nova.compute.manager [req-d612ae5f-9c68-4c59-bb94-3ac840c96404 req-a8fd6119-dfc3-44dc-9a7c-9239fb29b395 service nova] [instance: e0f32160-7130-4b9c-aa9c-84123f3a6b32] Received unexpected event network-vif-plugged-0d48c0d7-8a0f-4bfa-b8b7-290f122c3f4a for instance with vm_state deleted and task_state None.
Nov 15 09:33:44 user nova-compute[75122]: DEBUG nova.compute.manager [req-d612ae5f-9c68-4c59-bb94-3ac840c96404 req-a8fd6119-dfc3-44dc-9a7c-9239fb29b395 service nova] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] Received event network-changed-710ae079-0b1c-4c04-bea2-e34fd0d554ae {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:33:44 user nova-compute[75122]: DEBUG nova.compute.manager [req-d612ae5f-9c68-4c59-bb94-3ac840c96404 req-a8fd6119-dfc3-44dc-9a7c-9239fb29b395 service nova] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] Refreshing instance network info cache due to event network-changed-710ae079-0b1c-4c04-bea2-e34fd0d554ae. {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 09:33:45 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-d612ae5f-9c68-4c59-bb94-3ac840c96404 req-a8fd6119-dfc3-44dc-9a7c-9239fb29b395 service nova] Acquiring lock "refresh_cache-742d64db-c555-4517-8ec9-cef02f09a6e0" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 09:33:45 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:33:45 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:33:45 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-60c9e9b4-f205-4162-b23b-8e458bac028b tempest-TaggedAttachmentsTest-2027876138 tempest-TaggedAttachmentsTest-2027876138-project-member] Lock "e0f32160-7130-4b9c-aa9c-84123f3a6b32" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.597s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:33:45 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:33:45 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:33:45 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:33:45 user nova-compute[75122]: DEBUG nova.network.neutron [-] [instance: 9cfb60cb-011e-4537-9f28-55ea7d6dfc13] Updating instance_info_cache with network_info: [] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:33:45 user nova-compute[75122]: INFO nova.compute.manager [-] [instance: 9cfb60cb-011e-4537-9f28-55ea7d6dfc13] Took 1.29 seconds to deallocate network for instance.
Nov 15 09:33:45 user nova-compute[75122]: DEBUG nova.compute.manager [req-09d50030-d6ec-48f6-ac65-ec82751b3349 req-55213076-1b49-4a23-8772-05271fcf3d28 service nova] [instance: 9cfb60cb-011e-4537-9f28-55ea7d6dfc13] Received event network-vif-plugged-f46032a9-bba1-47d0-aa79-dc66f360bc46 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:33:45 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-09d50030-d6ec-48f6-ac65-ec82751b3349 req-55213076-1b49-4a23-8772-05271fcf3d28 service nova] Acquiring lock "9cfb60cb-011e-4537-9f28-55ea7d6dfc13-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:33:45 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-09d50030-d6ec-48f6-ac65-ec82751b3349 req-55213076-1b49-4a23-8772-05271fcf3d28 service nova] Lock "9cfb60cb-011e-4537-9f28-55ea7d6dfc13-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:33:45 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-09d50030-d6ec-48f6-ac65-ec82751b3349 req-55213076-1b49-4a23-8772-05271fcf3d28 service nova] Lock "9cfb60cb-011e-4537-9f28-55ea7d6dfc13-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:33:45 user nova-compute[75122]: DEBUG nova.compute.manager [req-09d50030-d6ec-48f6-ac65-ec82751b3349 req-55213076-1b49-4a23-8772-05271fcf3d28 service nova] [instance: 9cfb60cb-011e-4537-9f28-55ea7d6dfc13] No waiting events found dispatching network-vif-plugged-f46032a9-bba1-47d0-aa79-dc66f360bc46 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:33:45 user nova-compute[75122]: WARNING nova.compute.manager [req-09d50030-d6ec-48f6-ac65-ec82751b3349 req-55213076-1b49-4a23-8772-05271fcf3d28 service nova] [instance: 9cfb60cb-011e-4537-9f28-55ea7d6dfc13] Received unexpected event network-vif-plugged-f46032a9-bba1-47d0-aa79-dc66f360bc46 for instance with vm_state active and task_state deleting.
Nov 15 09:33:45 user nova-compute[75122]: DEBUG nova.compute.manager [req-09d50030-d6ec-48f6-ac65-ec82751b3349 req-55213076-1b49-4a23-8772-05271fcf3d28 service nova] [instance: 9cfb60cb-011e-4537-9f28-55ea7d6dfc13] Received event network-vif-plugged-f46032a9-bba1-47d0-aa79-dc66f360bc46 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:33:45 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-09d50030-d6ec-48f6-ac65-ec82751b3349 req-55213076-1b49-4a23-8772-05271fcf3d28 service nova] Acquiring lock "9cfb60cb-011e-4537-9f28-55ea7d6dfc13-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:33:45 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-09d50030-d6ec-48f6-ac65-ec82751b3349 req-55213076-1b49-4a23-8772-05271fcf3d28 service nova] Lock "9cfb60cb-011e-4537-9f28-55ea7d6dfc13-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:33:45 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-09d50030-d6ec-48f6-ac65-ec82751b3349 req-55213076-1b49-4a23-8772-05271fcf3d28 service nova] Lock "9cfb60cb-011e-4537-9f28-55ea7d6dfc13-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:33:45 user nova-compute[75122]: DEBUG nova.compute.manager [req-09d50030-d6ec-48f6-ac65-ec82751b3349 req-55213076-1b49-4a23-8772-05271fcf3d28 service nova] [instance: 9cfb60cb-011e-4537-9f28-55ea7d6dfc13] No waiting events found dispatching network-vif-plugged-f46032a9-bba1-47d0-aa79-dc66f360bc46 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:33:45 user nova-compute[75122]: WARNING nova.compute.manager [req-09d50030-d6ec-48f6-ac65-ec82751b3349 req-55213076-1b49-4a23-8772-05271fcf3d28 service nova] [instance: 9cfb60cb-011e-4537-9f28-55ea7d6dfc13] Received unexpected event network-vif-plugged-f46032a9-bba1-47d0-aa79-dc66f360bc46 for instance with vm_state active and task_state deleting.
Nov 15 09:33:45 user nova-compute[75122]: DEBUG nova.compute.manager [req-09d50030-d6ec-48f6-ac65-ec82751b3349 req-55213076-1b49-4a23-8772-05271fcf3d28 service nova] [instance: 9cfb60cb-011e-4537-9f28-55ea7d6dfc13] Received event network-vif-plugged-f46032a9-bba1-47d0-aa79-dc66f360bc46 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:33:45 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-09d50030-d6ec-48f6-ac65-ec82751b3349 req-55213076-1b49-4a23-8772-05271fcf3d28 service nova] Acquiring lock "9cfb60cb-011e-4537-9f28-55ea7d6dfc13-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:33:45 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-09d50030-d6ec-48f6-ac65-ec82751b3349 req-55213076-1b49-4a23-8772-05271fcf3d28 service nova] Lock "9cfb60cb-011e-4537-9f28-55ea7d6dfc13-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:33:45 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-09d50030-d6ec-48f6-ac65-ec82751b3349 req-55213076-1b49-4a23-8772-05271fcf3d28 service nova] Lock "9cfb60cb-011e-4537-9f28-55ea7d6dfc13-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:33:45 user nova-compute[75122]: DEBUG nova.compute.manager [req-09d50030-d6ec-48f6-ac65-ec82751b3349 req-55213076-1b49-4a23-8772-05271fcf3d28 service nova] [instance: 9cfb60cb-011e-4537-9f28-55ea7d6dfc13] No waiting events found dispatching network-vif-plugged-f46032a9-bba1-47d0-aa79-dc66f360bc46 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:33:45 user nova-compute[75122]: WARNING nova.compute.manager [req-09d50030-d6ec-48f6-ac65-ec82751b3349 req-55213076-1b49-4a23-8772-05271fcf3d28 service nova] [instance: 9cfb60cb-011e-4537-9f28-55ea7d6dfc13] Received unexpected event network-vif-plugged-f46032a9-bba1-47d0-aa79-dc66f360bc46 for instance with vm_state active and task_state deleting.
Nov 15 09:33:45 user nova-compute[75122]: DEBUG nova.compute.manager [req-09d50030-d6ec-48f6-ac65-ec82751b3349 req-55213076-1b49-4a23-8772-05271fcf3d28 service nova] [instance: 9cfb60cb-011e-4537-9f28-55ea7d6dfc13] Received event network-vif-unplugged-f46032a9-bba1-47d0-aa79-dc66f360bc46 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:33:45 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-09d50030-d6ec-48f6-ac65-ec82751b3349 req-55213076-1b49-4a23-8772-05271fcf3d28 service nova] Acquiring lock "9cfb60cb-011e-4537-9f28-55ea7d6dfc13-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:33:45 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-09d50030-d6ec-48f6-ac65-ec82751b3349 req-55213076-1b49-4a23-8772-05271fcf3d28 service nova] Lock "9cfb60cb-011e-4537-9f28-55ea7d6dfc13-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:33:45 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-09d50030-d6ec-48f6-ac65-ec82751b3349 req-55213076-1b49-4a23-8772-05271fcf3d28 service nova] Lock "9cfb60cb-011e-4537-9f28-55ea7d6dfc13-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:33:45 user nova-compute[75122]: DEBUG nova.compute.manager [req-09d50030-d6ec-48f6-ac65-ec82751b3349 req-55213076-1b49-4a23-8772-05271fcf3d28 service nova] [instance: 9cfb60cb-011e-4537-9f28-55ea7d6dfc13] No waiting events found dispatching network-vif-unplugged-f46032a9-bba1-47d0-aa79-dc66f360bc46 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:33:45 user nova-compute[75122]: DEBUG nova.compute.manager [req-09d50030-d6ec-48f6-ac65-ec82751b3349 req-55213076-1b49-4a23-8772-05271fcf3d28 service nova] [instance: 9cfb60cb-011e-4537-9f28-55ea7d6dfc13] Received event network-vif-unplugged-f46032a9-bba1-47d0-aa79-dc66f360bc46 for instance with task_state deleting. {{(pid=75122) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 09:33:45 user nova-compute[75122]: DEBUG nova.compute.manager [req-09d50030-d6ec-48f6-ac65-ec82751b3349 req-55213076-1b49-4a23-8772-05271fcf3d28 service nova] [instance: 9cfb60cb-011e-4537-9f28-55ea7d6dfc13] Received event network-vif-plugged-f46032a9-bba1-47d0-aa79-dc66f360bc46 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:33:45 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-09d50030-d6ec-48f6-ac65-ec82751b3349 req-55213076-1b49-4a23-8772-05271fcf3d28 service nova] Acquiring lock "9cfb60cb-011e-4537-9f28-55ea7d6dfc13-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:33:45 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-09d50030-d6ec-48f6-ac65-ec82751b3349 req-55213076-1b49-4a23-8772-05271fcf3d28 service nova] Lock "9cfb60cb-011e-4537-9f28-55ea7d6dfc13-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:33:45 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-09d50030-d6ec-48f6-ac65-ec82751b3349 req-55213076-1b49-4a23-8772-05271fcf3d28 service nova] Lock "9cfb60cb-011e-4537-9f28-55ea7d6dfc13-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:33:45 user nova-compute[75122]: DEBUG nova.compute.manager [req-09d50030-d6ec-48f6-ac65-ec82751b3349 req-55213076-1b49-4a23-8772-05271fcf3d28 service nova] [instance: 9cfb60cb-011e-4537-9f28-55ea7d6dfc13] No waiting events found dispatching network-vif-plugged-f46032a9-bba1-47d0-aa79-dc66f360bc46 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:33:45 user nova-compute[75122]: WARNING nova.compute.manager [req-09d50030-d6ec-48f6-ac65-ec82751b3349 req-55213076-1b49-4a23-8772-05271fcf3d28 service nova] [instance: 9cfb60cb-011e-4537-9f28-55ea7d6dfc13] Received unexpected event network-vif-plugged-f46032a9-bba1-47d0-aa79-dc66f360bc46 for instance with vm_state active and task_state deleting.
Nov 15 09:33:45 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-a591c7c7-11f3-4632-a857-6c0b5b9d4ccf tempest-VolumesAssistedSnapshotsTest-203861085 tempest-VolumesAssistedSnapshotsTest-203861085-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:33:45 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-a591c7c7-11f3-4632-a857-6c0b5b9d4ccf tempest-VolumesAssistedSnapshotsTest-203861085 tempest-VolumesAssistedSnapshotsTest-203861085-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:33:45 user nova-compute[75122]: DEBUG nova.compute.manager [req-89cd68b4-bd58-4ac1-9b03-ea60b7aaeca2 req-f98c42d4-0a84-48c7-a6e6-941234375d4b service nova] [instance: e0f32160-7130-4b9c-aa9c-84123f3a6b32] Received event network-vif-deleted-0d48c0d7-8a0f-4bfa-b8b7-290f122c3f4a {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:33:46 user nova-compute[75122]: DEBUG nova.compute.provider_tree [None req-a591c7c7-11f3-4632-a857-6c0b5b9d4ccf tempest-VolumesAssistedSnapshotsTest-203861085 tempest-VolumesAssistedSnapshotsTest-203861085-project-member] Inventory has not changed in ProviderTree for provider: 69a3da65-47be-44c6-b67c-c692b58284ef {{(pid=75122) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 09:33:46 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-a591c7c7-11f3-4632-a857-6c0b5b9d4ccf tempest-VolumesAssistedSnapshotsTest-203861085 tempest-VolumesAssistedSnapshotsTest-203861085-project-member] Inventory has not changed for provider 69a3da65-47be-44c6-b67c-c692b58284ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 09:33:46 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-a591c7c7-11f3-4632-a857-6c0b5b9d4ccf tempest-VolumesAssistedSnapshotsTest-203861085 tempest-VolumesAssistedSnapshotsTest-203861085-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.247s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:33:46 user nova-compute[75122]: INFO nova.scheduler.client.report [None req-a591c7c7-11f3-4632-a857-6c0b5b9d4ccf tempest-VolumesAssistedSnapshotsTest-203861085 tempest-VolumesAssistedSnapshotsTest-203861085-project-member] Deleted allocations for instance 9cfb60cb-011e-4537-9f28-55ea7d6dfc13
Nov 15 09:33:46 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-a591c7c7-11f3-4632-a857-6c0b5b9d4ccf tempest-VolumesAssistedSnapshotsTest-203861085 tempest-VolumesAssistedSnapshotsTest-203861085-project-member] Lock "9cfb60cb-011e-4537-9f28-55ea7d6dfc13" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.958s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:33:46 user nova-compute[75122]: DEBUG nova.network.neutron [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] Updating instance_info_cache with network_info: [{"id": "7febe2f1-4891-4ad4-ac59-58edfd3d2f03", "address": "fa:16:3e:ec:cb:a9", "network": {"id": "63134c25-66d5-4030-bbf0-b2a2e259df84", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2071889805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "641f0acd05d8403882a4f6b1b28e9269", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7febe2f1-48", "ovs_interfaceid": "7febe2f1-4891-4ad4-ac59-58edfd3d2f03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d8bfb09a-3733-4176-beec-aaa512b4ed8c", "address": "fa:16:3e:89:bb:49", "network": {"id": "3bb75c40-fc07-4bf2-8a8a-9f58cd457b67", "bridge": "br-int", "label": "tempest-device-tagging-net1-1158401388", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.130", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "641f0acd05d8403882a4f6b1b28e9269", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8bfb09a-37", "ovs_interfaceid": "d8bfb09a-3733-4176-beec-aaa512b4ed8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "eaecb293-c647-47d7-8103-6fb8851477f3", "address": "fa:16:3e:3c:b2:b8", "network": {"id": "3bb75c40-fc07-4bf2-8a8a-9f58cd457b67", "bridge": "br-int", "label": "tempest-device-tagging-net1-1158401388", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "641f0acd05d8403882a4f6b1b28e9269", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeaecb293-c6", "ovs_interfaceid": "eaecb293-c647-47d7-8103-6fb8851477f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5ebcafd9-6939-4928-ae2f-38ec38e15876", "address": "fa:16:3e:ec:d2:98", "network": {"id": "3bb75c40-fc07-4bf2-8a8a-9f58cd457b67", "bridge": "br-int", "label": "tempest-device-tagging-net1-1158401388", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.29", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "641f0acd05d8403882a4f6b1b28e9269", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ebcafd9-69", "ovs_interfaceid": "5ebcafd9-6939-4928-ae2f-38ec38e15876", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5bf17322-fd6b-4335-9a8e-56e7cd64e180", "address": "fa:16:3e:c9:4d:28", "network": {"id": "3bb75c40-fc07-4bf2-8a8a-9f58cd457b67", "bridge": "br-int", "label": "tempest-device-tagging-net1-1158401388", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.122", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "641f0acd05d8403882a4f6b1b28e9269", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bf17322-fd", "ovs_interfaceid": "5bf17322-fd6b-4335-9a8e-56e7cd64e180", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "710ae079-0b1c-4c04-bea2-e34fd0d554ae", "address": "fa:16:3e:0e:e7:01", "network": {"id": "b4709ef9-ae05-4eac-b530-da89c65fd367", "bridge": "br-int", "label": "tempest-device-tagging-net2-314948697", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "641f0acd05d8403882a4f6b1b28e9269", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap710ae079-0b", "ovs_interfaceid": "710ae079-0b1c-4c04-bea2-e34fd0d554ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d378cd7b-d582-4062-a714-d4456d71ba5f", "address": "fa:16:3e:e1:90:72", "network": {"id": "b4709ef9-ae05-4eac-b530-da89c65fd367", "bridge": "br-int", "label": "tempest-device-tagging-net2-314948697", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "641f0acd05d8403882a4f6b1b28e9269", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd378cd7b-d5", "ovs_interfaceid": "d378cd7b-d582-4062-a714-d4456d71ba5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:33:46 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] Releasing lock "refresh_cache-742d64db-c555-4517-8ec9-cef02f09a6e0" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 09:33:46 user nova-compute[75122]: DEBUG nova.compute.manager [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] Instance network_info: |[{"id": "7febe2f1-4891-4ad4-ac59-58edfd3d2f03", "address": "fa:16:3e:ec:cb:a9", "network": {"id": "63134c25-66d5-4030-bbf0-b2a2e259df84", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2071889805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "641f0acd05d8403882a4f6b1b28e9269", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7febe2f1-48", "ovs_interfaceid": "7febe2f1-4891-4ad4-ac59-58edfd3d2f03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d8bfb09a-3733-4176-beec-aaa512b4ed8c", "address": "fa:16:3e:89:bb:49", "network": {"id": "3bb75c40-fc07-4bf2-8a8a-9f58cd457b67", "bridge": "br-int", "label": "tempest-device-tagging-net1-1158401388", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.130", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "641f0acd05d8403882a4f6b1b28e9269", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8bfb09a-37", "ovs_interfaceid": "d8bfb09a-3733-4176-beec-aaa512b4ed8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "eaecb293-c647-47d7-8103-6fb8851477f3", "address": "fa:16:3e:3c:b2:b8", "network": {"id": "3bb75c40-fc07-4bf2-8a8a-9f58cd457b67", "bridge": "br-int", "label": "tempest-device-tagging-net1-1158401388", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "641f0acd05d8403882a4f6b1b28e9269", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeaecb293-c6", "ovs_interfaceid": "eaecb293-c647-47d7-8103-6fb8851477f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5ebcafd9-6939-4928-ae2f-38ec38e15876", "address": "fa:16:3e:ec:d2:98", "network": {"id": "3bb75c40-fc07-4bf2-8a8a-9f58cd457b67", "bridge": "br-int", "label": "tempest-device-tagging-net1-1158401388", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.29", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "641f0acd05d8403882a4f6b1b28e9269", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ebcafd9-69", "ovs_interfaceid": "5ebcafd9-6939-4928-ae2f-38ec38e15876", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5bf17322-fd6b-4335-9a8e-56e7cd64e180", "address": "fa:16:3e:c9:4d:28", "network": {"id": "3bb75c40-fc07-4bf2-8a8a-9f58cd457b67", "bridge": "br-int", "label": "tempest-device-tagging-net1-1158401388", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.122", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "641f0acd05d8403882a4f6b1b28e9269", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bf17322-fd", "ovs_interfaceid": "5bf17322-fd6b-4335-9a8e-56e7cd64e180", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "710ae079-0b1c-4c04-bea2-e34fd0d554ae", "address": "fa:16:3e:0e:e7:01", "network": {"id": "b4709ef9-ae05-4eac-b530-da89c65fd367", "bridge": "br-int", "label": "tempest-device-tagging-net2-314948697", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "641f0acd05d8403882a4f6b1b28e9269", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap710ae079-0b", "ovs_interfaceid": "710ae079-0b1c-4c04-bea2-e34fd0d554ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d378cd7b-d582-4062-a714-d4456d71ba5f", "address": "fa:16:3e:e1:90:72", "network": {"id": "b4709ef9-ae05-4eac-b530-da89c65fd367", "bridge": "br-int", "label": "tempest-device-tagging-net2-314948697", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "641f0acd05d8403882a4f6b1b28e9269", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd378cd7b-d5", "ovs_interfaceid": "d378cd7b-d582-4062-a714-d4456d71ba5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75122) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 09:33:46 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-d612ae5f-9c68-4c59-bb94-3ac840c96404 req-a8fd6119-dfc3-44dc-9a7c-9239fb29b395 service nova] Acquired lock "refresh_cache-742d64db-c555-4517-8ec9-cef02f09a6e0" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 09:33:46 user nova-compute[75122]: DEBUG nova.network.neutron [req-d612ae5f-9c68-4c59-bb94-3ac840c96404 req-a8fd6119-dfc3-44dc-9a7c-9239fb29b395 service nova] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] Refreshing network info cache for port 710ae079-0b1c-4c04-bea2-e34fd0d554ae {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 09:33:47 user nova-compute[75122]: DEBUG nova.compute.manager [req-8b86761f-4ab0-4f3b-b44e-9ab2fa15e303 req-0ddf8c79-934a-427e-a996-47aab6bea659 service nova] [instance: 9cfb60cb-011e-4537-9f28-55ea7d6dfc13] Received event network-vif-deleted-f46032a9-bba1-47d0-aa79-dc66f360bc46 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:33:47 user nova-compute[75122]: DEBUG nova.network.neutron [req-d612ae5f-9c68-4c59-bb94-3ac840c96404 req-a8fd6119-dfc3-44dc-9a7c-9239fb29b395 service nova] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] Updated VIF entry in instance network info cache for port 710ae079-0b1c-4c04-bea2-e34fd0d554ae. {{(pid=75122) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 09:33:47 user nova-compute[75122]: DEBUG nova.network.neutron [req-d612ae5f-9c68-4c59-bb94-3ac840c96404 req-a8fd6119-dfc3-44dc-9a7c-9239fb29b395 service nova] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] Updating instance_info_cache with network_info: [{"id": "7febe2f1-4891-4ad4-ac59-58edfd3d2f03", "address": "fa:16:3e:ec:cb:a9", "network": {"id": "63134c25-66d5-4030-bbf0-b2a2e259df84", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2071889805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "641f0acd05d8403882a4f6b1b28e9269", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7febe2f1-48", "ovs_interfaceid": "7febe2f1-4891-4ad4-ac59-58edfd3d2f03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d8bfb09a-3733-4176-beec-aaa512b4ed8c", "address": "fa:16:3e:89:bb:49", "network": {"id": "3bb75c40-fc07-4bf2-8a8a-9f58cd457b67", "bridge": "br-int", "label": "tempest-device-tagging-net1-1158401388", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.130", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "641f0acd05d8403882a4f6b1b28e9269", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8bfb09a-37", "ovs_interfaceid": "d8bfb09a-3733-4176-beec-aaa512b4ed8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "eaecb293-c647-47d7-8103-6fb8851477f3", "address": "fa:16:3e:3c:b2:b8", "network": {"id": "3bb75c40-fc07-4bf2-8a8a-9f58cd457b67", "bridge": "br-int", "label": "tempest-device-tagging-net1-1158401388", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "641f0acd05d8403882a4f6b1b28e9269", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeaecb293-c6", "ovs_interfaceid": "eaecb293-c647-47d7-8103-6fb8851477f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5ebcafd9-6939-4928-ae2f-38ec38e15876", "address": "fa:16:3e:ec:d2:98", "network": {"id": "3bb75c40-fc07-4bf2-8a8a-9f58cd457b67", "bridge": "br-int", "label": "tempest-device-tagging-net1-1158401388", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.29", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "641f0acd05d8403882a4f6b1b28e9269", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ebcafd9-69", "ovs_interfaceid": "5ebcafd9-6939-4928-ae2f-38ec38e15876", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5bf17322-fd6b-4335-9a8e-56e7cd64e180", "address": "fa:16:3e:c9:4d:28", "network": {"id": "3bb75c40-fc07-4bf2-8a8a-9f58cd457b67", "bridge": "br-int", "label": "tempest-device-tagging-net1-1158401388", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.122", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "641f0acd05d8403882a4f6b1b28e9269", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bf17322-fd", "ovs_interfaceid": "5bf17322-fd6b-4335-9a8e-56e7cd64e180", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "710ae079-0b1c-4c04-bea2-e34fd0d554ae", "address": "fa:16:3e:0e:e7:01", "network": {"id": "b4709ef9-ae05-4eac-b530-da89c65fd367", "bridge": "br-int", "label": "tempest-device-tagging-net2-314948697", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "641f0acd05d8403882a4f6b1b28e9269", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap710ae079-0b", "ovs_interfaceid": "710ae079-0b1c-4c04-bea2-e34fd0d554ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d378cd7b-d582-4062-a714-d4456d71ba5f", "address": "fa:16:3e:e1:90:72", "network": {"id": "b4709ef9-ae05-4eac-b530-da89c65fd367", "bridge": "br-int", "label": "tempest-device-tagging-net2-314948697", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "641f0acd05d8403882a4f6b1b28e9269", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd378cd7b-d5", "ovs_interfaceid": "d378cd7b-d582-4062-a714-d4456d71ba5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:33:47 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-d612ae5f-9c68-4c59-bb94-3ac840c96404 req-a8fd6119-dfc3-44dc-9a7c-9239fb29b395 service nova] Releasing lock "refresh_cache-742d64db-c555-4517-8ec9-cef02f09a6e0" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 09:33:47 user nova-compute[75122]: DEBUG nova.compute.manager [req-d612ae5f-9c68-4c59-bb94-3ac840c96404 req-a8fd6119-dfc3-44dc-9a7c-9239fb29b395 service nova] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] Received event network-changed-d378cd7b-d582-4062-a714-d4456d71ba5f {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:33:47 user nova-compute[75122]: DEBUG nova.compute.manager [req-d612ae5f-9c68-4c59-bb94-3ac840c96404 req-a8fd6119-dfc3-44dc-9a7c-9239fb29b395 service nova] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] Refreshing instance network info cache due to event network-changed-d378cd7b-d582-4062-a714-d4456d71ba5f. {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 09:33:47 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-d612ae5f-9c68-4c59-bb94-3ac840c96404 req-a8fd6119-dfc3-44dc-9a7c-9239fb29b395 service nova] Acquiring lock "refresh_cache-742d64db-c555-4517-8ec9-cef02f09a6e0" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 09:33:47 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-d612ae5f-9c68-4c59-bb94-3ac840c96404 req-a8fd6119-dfc3-44dc-9a7c-9239fb29b395 service nova] Acquired lock "refresh_cache-742d64db-c555-4517-8ec9-cef02f09a6e0" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 09:33:47 user nova-compute[75122]: DEBUG nova.network.neutron [req-d612ae5f-9c68-4c59-bb94-3ac840c96404 req-a8fd6119-dfc3-44dc-9a7c-9239fb29b395 service nova] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] Refreshing network info cache for port d378cd7b-d582-4062-a714-d4456d71ba5f {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 09:33:47 user nova-compute[75122]: DEBUG nova.network.neutron [req-d612ae5f-9c68-4c59-bb94-3ac840c96404 req-a8fd6119-dfc3-44dc-9a7c-9239fb29b395 service nova] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] Updated VIF entry in instance network info cache for port d378cd7b-d582-4062-a714-d4456d71ba5f. {{(pid=75122) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 09:33:47 user nova-compute[75122]: DEBUG nova.network.neutron [req-d612ae5f-9c68-4c59-bb94-3ac840c96404 req-a8fd6119-dfc3-44dc-9a7c-9239fb29b395 service nova] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] Updating instance_info_cache with network_info: [{"id": "7febe2f1-4891-4ad4-ac59-58edfd3d2f03", "address": "fa:16:3e:ec:cb:a9", "network": {"id": "63134c25-66d5-4030-bbf0-b2a2e259df84", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2071889805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "641f0acd05d8403882a4f6b1b28e9269", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7febe2f1-48", "ovs_interfaceid": "7febe2f1-4891-4ad4-ac59-58edfd3d2f03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d8bfb09a-3733-4176-beec-aaa512b4ed8c", "address": "fa:16:3e:89:bb:49", "network": {"id": "3bb75c40-fc07-4bf2-8a8a-9f58cd457b67", "bridge": "br-int", "label": "tempest-device-tagging-net1-1158401388", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.130", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "641f0acd05d8403882a4f6b1b28e9269", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8bfb09a-37", "ovs_interfaceid": "d8bfb09a-3733-4176-beec-aaa512b4ed8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "eaecb293-c647-47d7-8103-6fb8851477f3", "address": "fa:16:3e:3c:b2:b8", "network": {"id": "3bb75c40-fc07-4bf2-8a8a-9f58cd457b67", "bridge": "br-int", "label": "tempest-device-tagging-net1-1158401388", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "641f0acd05d8403882a4f6b1b28e9269", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeaecb293-c6", "ovs_interfaceid": "eaecb293-c647-47d7-8103-6fb8851477f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5ebcafd9-6939-4928-ae2f-38ec38e15876", "address": "fa:16:3e:ec:d2:98", "network": {"id": "3bb75c40-fc07-4bf2-8a8a-9f58cd457b67", "bridge": "br-int", "label": "tempest-device-tagging-net1-1158401388", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.29", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "641f0acd05d8403882a4f6b1b28e9269", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ebcafd9-69", "ovs_interfaceid": "5ebcafd9-6939-4928-ae2f-38ec38e15876", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5bf17322-fd6b-4335-9a8e-56e7cd64e180", "address": "fa:16:3e:c9:4d:28", "network": {"id": "3bb75c40-fc07-4bf2-8a8a-9f58cd457b67", "bridge": "br-int", "label": "tempest-device-tagging-net1-1158401388", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.122", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "641f0acd05d8403882a4f6b1b28e9269", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bf17322-fd", "ovs_interfaceid": "5bf17322-fd6b-4335-9a8e-56e7cd64e180", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "710ae079-0b1c-4c04-bea2-e34fd0d554ae", "address": "fa:16:3e:0e:e7:01", "network": {"id": "b4709ef9-ae05-4eac-b530-da89c65fd367", "bridge": "br-int", "label": "tempest-device-tagging-net2-314948697", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "641f0acd05d8403882a4f6b1b28e9269", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap710ae079-0b", "ovs_interfaceid": "710ae079-0b1c-4c04-bea2-e34fd0d554ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d378cd7b-d582-4062-a714-d4456d71ba5f", "address": "fa:16:3e:e1:90:72", "network": {"id": "b4709ef9-ae05-4eac-b530-da89c65fd367", "bridge": "br-int", "label": "tempest-device-tagging-net2-314948697", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "641f0acd05d8403882a4f6b1b28e9269", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd378cd7b-d5", "ovs_interfaceid": "d378cd7b-d582-4062-a714-d4456d71ba5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:33:47 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-d612ae5f-9c68-4c59-bb94-3ac840c96404 req-a8fd6119-dfc3-44dc-9a7c-9239fb29b395 service nova] Releasing lock "refresh_cache-742d64db-c555-4517-8ec9-cef02f09a6e0" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 09:33:48 user nova-compute[75122]: INFO nova.virt.block_device [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] Booting with volume 3a8a33bb-713e-4109-8306-fe91fd67904f at /dev/vdc
Nov 15 09:33:48 user nova-compute[75122]: DEBUG os_brick.utils [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 09:33:48 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:33:48 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:33:48 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[61ac51b8-1325-48e2-8df3-ecb2de5142e1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:742fb64b3587\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:33:48 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:33:48 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:33:48 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[74066271-00ce-453c-8375-091ee7945283]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:33:48 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:33:48 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:33:48 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[30f445fa-b9d1-4c5b-9894-f816c8b21016]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:33:48 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ef15e8d-7419-4627-beb9-934ea3394369]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:33:48 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] Running cmd (subprocess): nvme version {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:33:48 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] 'nvme version' failed. Not Retrying. {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 09:33:48 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.nvmeof [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] nvme not present on system {{(pid=75122) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 09:33:48 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:33:48 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 09:33:48 user nova-compute[75122]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 09:33:48 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf58df48-54cb-43f9-bbba-d6bbf4c678d6]: (4, '') {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:33:48 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.lightos [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75122) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 09:33:48 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.lightos [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75122) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 09:33:48 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.lightos [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] LIGHTOS: no hostnqn found. {{(pid=75122) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 09:33:48 user nova-compute[75122]: DEBUG os_brick.utils [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:742fb64b3587', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 09:33:48 user nova-compute[75122]: DEBUG nova.virt.block_device [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] Updating existing volume attachment record: f0682253-e5ac-4f71-852a-90df730163cd {{(pid=75122) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 09:33:49 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:33:49 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:33:50 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:33:53 user nova-compute[75122]: DEBUG nova.compute.manager [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] Start spawning the instance on the hypervisor. {{(pid=75122) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 09:33:53 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] Creating instance directory {{(pid=75122) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 09:33:53 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] Creating image(s)
Nov 15 09:33:53 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] Did not create local disks {{(pid=75122) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 09:33:53 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] Ensure instance console log exists: /opt/stack/data/nova/instances/742d64db-c555-4517-8ec9-cef02f09a6e0/console.log {{(pid=75122) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 09:33:53 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:33:53 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:33:53 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:33:53 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] Start _get_guest_xml network_info=[{"id": "7febe2f1-4891-4ad4-ac59-58edfd3d2f03", "address": "fa:16:3e:ec:cb:a9", "network": {"id": "63134c25-66d5-4030-bbf0-b2a2e259df84", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2071889805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "641f0acd05d8403882a4f6b1b28e9269", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7febe2f1-48", "ovs_interfaceid": "7febe2f1-4891-4ad4-ac59-58edfd3d2f03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d8bfb09a-3733-4176-beec-aaa512b4ed8c", "address": "fa:16:3e:89:bb:49", "network": {"id": "3bb75c40-fc07-4bf2-8a8a-9f58cd457b67", "bridge": "br-int", "label": "tempest-device-tagging-net1-1158401388", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.130", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "641f0acd05d8403882a4f6b1b28e9269", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8bfb09a-37", "ovs_interfaceid": "d8bfb09a-3733-4176-beec-aaa512b4ed8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "eaecb293-c647-47d7-8103-6fb8851477f3", "address": "fa:16:3e:3c:b2:b8", "network": {"id": "3bb75c40-fc07-4bf2-8a8a-9f58cd457b67", "bridge": "br-int", "label": "tempest-device-tagging-net1-1158401388", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "641f0acd05d8403882a4f6b1b28e9269", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeaecb293-c6", "ovs_interfaceid": "eaecb293-c647-47d7-8103-6fb8851477f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5ebcafd9-6939-4928-ae2f-38ec38e15876", "address": "fa:16:3e:ec:d2:98", "network": {"id": "3bb75c40-fc07-4bf2-8a8a-9f58cd457b67", "bridge": "br-int", "label": "tempest-device-tagging-net1-1158401388", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.29", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "641f0acd05d8403882a4f6b1b28e9269", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ebcafd9-69", "ovs_interfaceid": "5ebcafd9-6939-4928-ae2f-38ec38e15876", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5bf17322-fd6b-4335-9a8e-56e7cd64e180", "address": "fa:16:3e:c9:4d:28", "network": {"id": "3bb75c40-fc07-4bf2-8a8a-9f58cd457b67", "bridge": "br-int", "label": "tempest-device-tagging-net1-1158401388", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.122", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "641f0acd05d8403882a4f6b1b28e9269", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bf17322-fd", "ovs_interfaceid": "5bf17322-fd6b-4335-9a8e-56e7cd64e180", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "710ae079-0b1c-4c04-bea2-e34fd0d554ae", "address": "fa:16:3e:0e:e7:01", "network": {"id": "b4709ef9-ae05-4eac-b530-da89c65fd367", "bridge": "br-int", "label": "tempest-device-tagging-net2-314948697", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "641f0acd05d8403882a4f6b1b28e9269", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap710ae079-0b", "ovs_interfaceid": "710ae079-0b1c-4c04-bea2-e34fd0d554ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d378cd7b-d582-4062-a714-d4456d71ba5f", "address": "fa:16:3e:e1:90:72", "network": {"id": "b4709ef9-ae05-4eac-b530-da89c65fd367", "bridge": "br-int", "label": "tempest-device-tagging-net2-314948697", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "641f0acd05d8403882a4f6b1b28e9269", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd378cd7b-d5", "ovs_interfaceid": "d378cd7b-d582-4062-a714-d4456d71ba5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T09:26:31Z,direct_url=<?>,disk_format='qcow2',id=5e862cfe-47b8-4725-8292-65761ee6d0f5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9c57733cb41847c0b4ad31519c382e5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T09:26:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:01563785-3767-460a-9815-c1bd0f7f6f9f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WzZynFXE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '742d64db-c555-4517-8ec9-cef02f09a6e0', 'attached_at': '', 'detached_at': '', 'volume_id': '01563785-3767-460a-9815-c1bd0f7f6f9f', 'serial': '01563785-3767-460a-9815-c1bd0f7f6f9f'}, 'guest_format': None, 'delete_on_termination': False, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vda', 'attachment_id': 'e2bc0bbc-beed-4d97-95c9-8ecf53dcb492', 'volume_type': None}, {'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:bca4e77f-05f8-4ff6-8a78-6cef699f5667', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'efHIqSNO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '742d64db-c555-4517-8ec9-cef02f09a6e0', 'attached_at': '', 'detached_at': '', 'volume_id': 'bca4e77f-05f8-4ff6-8a78-6cef699f5667', 'serial': 'bca4e77f-05f8-4ff6-8a78-6cef699f5667'}, 'guest_format': None, 'delete_on_termination': False, 'boot_index': 1, 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vdb', 'attachment_id': 'e31effb4-88ea-424b-9bde-cbeba3667a71', 'volume_type': None}, {'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3a8a33bb-713e-4109-8306-fe91fd67904f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gJQwpDVz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '742d64db-c555-4517-8ec9-cef02f09a6e0', 'attached_at': '', 'detached_at': '', 'volume_id': '3a8a33bb-713e-4109-8306-fe91fd67904f', 'serial': '3a8a33bb-713e-4109-8306-fe91fd67904f'}, 'guest_format': None, 'delete_on_termination': False, 'boot_index': 2, 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vdc', 'attachment_id': 'f0682253-e5ac-4f71-852a-90df730163cd', 'volume_type': None} {{(pid=75122) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 09:33:53 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 09:33:53 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 09:33:53 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75122) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 09:33:53 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] CPU controller missing on host. {{(pid=75122) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 09:33:53 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75122) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 09:33:53 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] CPU controller found on host. {{(pid=75122) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 09:33:53 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75122) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 09:33:53 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T09:26:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T09:26:31Z,direct_url=<?>,disk_format='qcow2',id=5e862cfe-47b8-4725-8292-65761ee6d0f5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9c57733cb41847c0b4ad31519c382e5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T09:26:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 09:33:53 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] Flavor limits 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 09:33:53 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] Image limits 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 09:33:53 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] Flavor pref 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 09:33:53 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] Image pref 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 09:33:53 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 09:33:53 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 09:33:53 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75122) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 09:33:53 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] Got 1 possible topologies {{(pid=75122) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 09:33:53 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 09:33:53 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 09:33:53 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] Calling os-brick to attach iSCSI Volume {{(pid=75122) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 09:33:53 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffa04060b80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:01563785-3767-460a-9815-c1bd0f7f6f9f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WzZynFXE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 09:33:53 user nova-compute[75122]: WARNING os_brick.initiator.connectors.base [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 09:33:53 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 09:33:53 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 09:33:53 user nova-compute[75122]: WARNING os_brick.initiator.connectors.base [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 09:33:53 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:01563785-3767-460a-9815-c1bd0f7f6f9f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 09:33:53 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:01563785-3767-460a-9815-c1bd0f7f6f9f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 09:33:53 user nova-compute[75122]: INFO os_brick.initiator.connectors.iscsi [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 09:33:53 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01563785-3767-460a-9815-c1bd0f7f6f9f -p 172.16.0.220:3260 {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:33:53 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01563785-3767-460a-9815-c1bd0f7f6f9f -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:33:53 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[880868af-96cf-4afd-a746-1692d448ef03]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:33:53 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 09:33:53 user nova-compute[75122]:  {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:33:53 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01563785-3767-460a-9815-c1bd0f7f6f9f -p 172.16.0.220:3260 --interface default --op new {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:33:53 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01563785-3767-460a-9815-c1bd0f7f6f9f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:33:53 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[99f0c752-413e-4d95-a6da-1eaed2dc3158]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:01563785-3767-460a-9815-c1bd0f7f6f9f] added\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:33:53 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:01563785-3767-460a-9815-c1bd0f7f6f9f] added
Nov 15 09:33:53 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:33:53 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01563785-3767-460a-9815-c1bd0f7f6f9f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:33:53 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01563785-3767-460a-9815-c1bd0f7f6f9f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:33:53 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[b73d8f46-2dd3-4a20-834d-fb8e9aae91f8]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:33:53 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:33:53 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01563785-3767-460a-9815-c1bd0f7f6f9f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:33:53 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01563785-3767-460a-9815-c1bd0f7f6f9f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:33:53 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c556186-6999-4720-b786-c73e98d496b4]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:33:53 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:33:53 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01563785-3767-460a-9815-c1bd0f7f6f9f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WzZynFXE {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:33:53 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01563785-3767-460a-9815-c1bd0f7f6f9f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WzZynFXE" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:33:53 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e7470be-aa60-4aa8-803b-c772bc99acb7]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:33:53 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WzZynFXE'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:33:53 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01563785-3767-460a-9815-c1bd0f7f6f9f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:33:53 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01563785-3767-460a-9815-c1bd0f7f6f9f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:33:53 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ddfd47e-4fa9-419f-a19f-2c8cf048f7fd]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:33:53 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:33:53 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:33:53 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:33:53 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ce6d1bd-b34f-4f97-bf43-052ea5027f7b]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:33:53 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 15 09:33:53 user nova-compute[75122]:  {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 09:33:53 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 15 09:33:53 user nova-compute[75122]:  {{(pid=75122) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 09:33:53 user nova-compute[75122]: WARNING os_brick.initiator.connectors.iscsi [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 15 09:33:53 user nova-compute[75122]: 
Nov 15 09:33:53 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01563785-3767-460a-9815-c1bd0f7f6f9f -p 172.16.0.220:3260 --login {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:33:53 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01563785-3767-460a-9815-c1bd0f7f6f9f -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:33:53 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[826c7164-e1c4-4309-a866-4e6880885747]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:01563785-3767-460a-9815-c1bd0f7f6f9f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:01563785-3767-460a-9815-c1bd0f7f6f9f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:33:53 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:01563785-3767-460a-9815-c1bd0f7f6f9f, portal: 172.16.0.220,3260]
Nov 15 09:33:53 user nova-compute[75122]: Login to [iface: default, target: iqn.2010-10.org.openstack:01563785-3767-460a-9815-c1bd0f7f6f9f, portal: 172.16.0.220,3260] successful.
Nov 15 09:33:53 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:33:53 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01563785-3767-460a-9815-c1bd0f7f6f9f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:33:53 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01563785-3767-460a-9815-c1bd0f7f6f9f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:33:53 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[3851a296-1142-44e6-8b54-03bb6606aafe]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:33:53 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:33:53 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:33:53 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:33:53 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4b1bfae-5b99-4c0e-b604-cf443d1777fa]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01563785-3767-460a-9815-c1bd0f7f6f9f (non-flash)\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:33:53 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01563785-3767-460a-9815-c1bd0f7f6f9f (non-flash)
Nov 15 09:33:53 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 09:33:53 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01563785-3767-460a-9815-c1bd0f7f6f9f (non-flash)
Nov 15 09:33:53 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 09:33:53 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:01563785-3767-460a-9815-c1bd0f7f6f9f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.250s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 09:33:53 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] Connected to 172.16.0.220:3260 {{(pid=75122) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 09:33:53 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] HCTL ('33', '-', '-', 0) found on session 13 with lun 0 {{(pid=75122) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 09:33:53 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75122) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 09:33:53 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:33:53 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:33:53 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[4586a75e-07cb-438e-aeeb-527dd8d70b04]: (4, ('- - 0', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:33:53 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] Searching for a device in session 13 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75122) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 09:33:53 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:01563785-3767-460a-9815-c1bd0f7f6f9f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WzZynFXE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75122) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 09:33:53 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:33:54 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.286s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 09:33:54 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] <== connect_volume: return (1289ms) {'type': 'block', 'scsi_wwn': '26465333265356466', 'path': '/dev/sdb'} {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 09:33:54 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26465333265356466', 'path': '/dev/sdb'} {{(pid=75122) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 09:33:54 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] Calling os-brick to attach iSCSI Volume {{(pid=75122) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 09:33:54 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffa04060b80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bca4e77f-05f8-4ff6-8a78-6cef699f5667', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'efHIqSNO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 09:33:54 user nova-compute[75122]: WARNING os_brick.initiator.connectors.base [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 09:33:54 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 09:33:54 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 09:33:54 user nova-compute[75122]: WARNING os_brick.initiator.connectors.base [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 09:33:54 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bca4e77f-05f8-4ff6-8a78-6cef699f5667" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 09:33:54 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bca4e77f-05f8-4ff6-8a78-6cef699f5667" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 09:33:54 user nova-compute[75122]: INFO os_brick.initiator.connectors.iscsi [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 09:33:54 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bca4e77f-05f8-4ff6-8a78-6cef699f5667 -p 172.16.0.220:3260 {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:33:54 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:33:54 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bca4e77f-05f8-4ff6-8a78-6cef699f5667 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:33:54 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e355c66-f73c-4013-9c8e-d282d700c0fb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:33:54 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 09:33:54 user nova-compute[75122]:  {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:33:54 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bca4e77f-05f8-4ff6-8a78-6cef699f5667 -p 172.16.0.220:3260 --interface default --op new {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:33:54 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bca4e77f-05f8-4ff6-8a78-6cef699f5667 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:33:54 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc35138d-b3d3-46b2-a808-6d8b4f241673]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bca4e77f-05f8-4ff6-8a78-6cef699f5667] added\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:33:54 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bca4e77f-05f8-4ff6-8a78-6cef699f5667] added
Nov 15 09:33:54 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:33:54 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bca4e77f-05f8-4ff6-8a78-6cef699f5667 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:33:54 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bca4e77f-05f8-4ff6-8a78-6cef699f5667 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:33:54 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8737621-9ecb-4605-8049-7ca955bde597]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:33:54 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:33:54 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bca4e77f-05f8-4ff6-8a78-6cef699f5667 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:33:54 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bca4e77f-05f8-4ff6-8a78-6cef699f5667 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:33:54 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e141946-0b1b-469c-8ea1-40b501fc96ab]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:33:54 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:33:54 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bca4e77f-05f8-4ff6-8a78-6cef699f5667 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v efHIqSNO {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:33:54 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bca4e77f-05f8-4ff6-8a78-6cef699f5667 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v efHIqSNO" returned: 0 in 0.019s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:33:54 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb317fc4-cabb-4a3d-8323-03306ffd59be]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:33:54 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'efHIqSNO'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:33:54 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bca4e77f-05f8-4ff6-8a78-6cef699f5667 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:33:54 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bca4e77f-05f8-4ff6-8a78-6cef699f5667 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:33:54 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[e113f46c-b9b6-44f6-801d-d2efebdd66c6]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:33:54 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:33:54 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:33:54 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:33:54 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[c85a3566-cca6-41e1-8b91-f897b0f68c41]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01563785-3767-460a-9815-c1bd0f7f6f9f (non-flash)\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:33:54 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01563785-3767-460a-9815-c1bd0f7f6f9f (non-flash)
Nov 15 09:33:54 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 09:33:54 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01563785-3767-460a-9815-c1bd0f7f6f9f (non-flash)
Nov 15 09:33:54 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 09:33:54 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bca4e77f-05f8-4ff6-8a78-6cef699f5667 -p 172.16.0.220:3260 --login {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:33:54 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bca4e77f-05f8-4ff6-8a78-6cef699f5667 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:33:54 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[947f35b7-e5cd-40bb-b027-934cd53244d6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bca4e77f-05f8-4ff6-8a78-6cef699f5667, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bca4e77f-05f8-4ff6-8a78-6cef699f5667, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:33:54 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bca4e77f-05f8-4ff6-8a78-6cef699f5667, portal: 172.16.0.220,3260]
Nov 15 09:33:54 user nova-compute[75122]: Login to [iface: default, target: iqn.2010-10.org.openstack:bca4e77f-05f8-4ff6-8a78-6cef699f5667, portal: 172.16.0.220,3260] successful.
Nov 15 09:33:54 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:33:54 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bca4e77f-05f8-4ff6-8a78-6cef699f5667 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:33:54 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bca4e77f-05f8-4ff6-8a78-6cef699f5667 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:33:54 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[59ec5131-914d-4940-a888-d5c89c1ebc3c]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:33:54 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:33:54 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:33:54 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:33:54 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[c703145e-9b67-407d-8581-de07fc27571e]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01563785-3767-460a-9815-c1bd0f7f6f9f (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bca4e77f-05f8-4ff6-8a78-6cef699f5667 (non-flash)\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:33:54 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01563785-3767-460a-9815-c1bd0f7f6f9f (non-flash)
Nov 15 09:33:54 user nova-compute[75122]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bca4e77f-05f8-4ff6-8a78-6cef699f5667 (non-flash)
Nov 15 09:33:54 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 09:33:54 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01563785-3767-460a-9815-c1bd0f7f6f9f (non-flash)
Nov 15 09:33:54 user nova-compute[75122]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bca4e77f-05f8-4ff6-8a78-6cef699f5667 (non-flash)
Nov 15 09:33:54 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 09:33:54 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bca4e77f-05f8-4ff6-8a78-6cef699f5667" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.263s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 09:33:54 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] Connected to 172.16.0.220:3260 {{(pid=75122) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 09:33:54 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] HCTL ('34', '-', '-', 0) found on session 14 with lun 0 {{(pid=75122) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 09:33:54 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75122) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 09:33:54 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:33:54 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:33:54 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f2b5c94-f652-463b-9a03-f2567513f6bd]: (4, ('- - 0', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:33:54 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] Searching for a device in session 14 and hctl ['34', '*', '*', 0] yield: None {{(pid=75122) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 09:33:54 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:33:54 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-45057d87-b22d-4a18-bde4-81447e8d9c83 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Acquiring lock "ee961d5a-e0d1-4931-9293-eefbe638097a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:33:54 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-45057d87-b22d-4a18-bde4-81447e8d9c83 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Lock "ee961d5a-e0d1-4931-9293-eefbe638097a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:33:55 user nova-compute[75122]: DEBUG nova.objects.instance [None req-45057d87-b22d-4a18-bde4-81447e8d9c83 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Lazy-loading 'flavor' on Instance uuid ee961d5a-e0d1-4931-9293-eefbe638097a {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:33:55 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-45057d87-b22d-4a18-bde4-81447e8d9c83 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Lock "ee961d5a-e0d1-4931-9293-eefbe638097a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.068s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:33:55 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-45057d87-b22d-4a18-bde4-81447e8d9c83 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Acquiring lock "ee961d5a-e0d1-4931-9293-eefbe638097a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:33:55 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-45057d87-b22d-4a18-bde4-81447e8d9c83 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Lock "ee961d5a-e0d1-4931-9293-eefbe638097a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:33:55 user nova-compute[75122]: INFO nova.compute.manager [None req-45057d87-b22d-4a18-bde4-81447e8d9c83 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] [instance: ee961d5a-e0d1-4931-9293-eefbe638097a] Attaching volume 2cd51ed3-2703-4b02-aa7c-ddb113161a16 to /dev/vdb
Nov 15 09:33:55 user nova-compute[75122]: DEBUG os_brick.utils [None req-45057d87-b22d-4a18-bde4-81447e8d9c83 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 09:33:55 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:33:55 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:33:55 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cd44e53-4fc1-40ce-b5fb-f130192cdf66]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:742fb64b3587\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:33:55 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:33:55 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:33:55 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9e61d90-8495-4e3b-a9c7-09fc2070acda]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:33:55 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:33:55 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:33:55 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0e2d70d-33fe-4da4-9b77-20cf454a0b05]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:33:55 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[c224ca0e-248c-4607-a982-addaf823aa13]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:33:55 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-45057d87-b22d-4a18-bde4-81447e8d9c83 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Running cmd (subprocess): nvme version {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:33:55 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-45057d87-b22d-4a18-bde4-81447e8d9c83 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] 'nvme version' failed. Not Retrying. {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 09:33:55 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.nvmeof [None req-45057d87-b22d-4a18-bde4-81447e8d9c83 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] nvme not present on system {{(pid=75122) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 09:33:55 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:33:55 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 09:33:55 user nova-compute[75122]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 09:33:55 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[31d9f77c-69a0-404d-b393-aba84d2a429d]: (4, '') {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:33:55 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.lightos [None req-45057d87-b22d-4a18-bde4-81447e8d9c83 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75122) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 09:33:55 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.lightos [None req-45057d87-b22d-4a18-bde4-81447e8d9c83 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75122) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 09:33:55 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.lightos [None req-45057d87-b22d-4a18-bde4-81447e8d9c83 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] LIGHTOS: no hostnqn found. {{(pid=75122) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 09:33:55 user nova-compute[75122]: DEBUG os_brick.utils [None req-45057d87-b22d-4a18-bde4-81447e8d9c83 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:742fb64b3587', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 09:33:55 user nova-compute[75122]: DEBUG nova.virt.block_device [None req-45057d87-b22d-4a18-bde4-81447e8d9c83 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] [instance: ee961d5a-e0d1-4931-9293-eefbe638097a] Updating existing volume attachment record: 0f13fdcf-627c-4a82-8d0b-9495d02acdf0 {{(pid=75122) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 09:33:55 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] Searching for a device in session 14 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75122) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 09:33:55 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:bca4e77f-05f8-4ff6-8a78-6cef699f5667', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'efHIqSNO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75122) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 09:33:55 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.297s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 09:33:55 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] <== connect_volume: return (1299ms) {'type': 'block', 'scsi_wwn': '26235353633326336', 'path': '/dev/sdc'} {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 09:33:55 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26235353633326336', 'path': '/dev/sdc'} {{(pid=75122) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 09:33:55 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] Calling os-brick to attach iSCSI Volume {{(pid=75122) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 09:33:55 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffa04060b80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3a8a33bb-713e-4109-8306-fe91fd67904f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gJQwpDVz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 09:33:55 user nova-compute[75122]: WARNING os_brick.initiator.connectors.base [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 09:33:55 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 09:33:55 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 09:33:55 user nova-compute[75122]: WARNING os_brick.initiator.connectors.base [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 09:33:55 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3a8a33bb-713e-4109-8306-fe91fd67904f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 09:33:55 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3a8a33bb-713e-4109-8306-fe91fd67904f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 09:33:55 user nova-compute[75122]: INFO os_brick.initiator.connectors.iscsi [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 09:33:55 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a8a33bb-713e-4109-8306-fe91fd67904f -p 172.16.0.220:3260 {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:33:55 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a8a33bb-713e-4109-8306-fe91fd67904f -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:33:55 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc236955-b0c1-4617-bf41-2e3e503a0aa5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:33:55 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 09:33:55 user nova-compute[75122]:  {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:33:55 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a8a33bb-713e-4109-8306-fe91fd67904f -p 172.16.0.220:3260 --interface default --op new {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:33:55 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a8a33bb-713e-4109-8306-fe91fd67904f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:33:55 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[1db3fc5f-ad54-459d-898c-c37c6babf470]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3a8a33bb-713e-4109-8306-fe91fd67904f] added\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:33:55 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3a8a33bb-713e-4109-8306-fe91fd67904f] added
Nov 15 09:33:55 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:33:55 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a8a33bb-713e-4109-8306-fe91fd67904f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:33:55 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a8a33bb-713e-4109-8306-fe91fd67904f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:33:55 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[897aea24-0cb0-4fa8-9733-5e509595a29f]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:33:55 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:33:55 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a8a33bb-713e-4109-8306-fe91fd67904f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:33:55 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a8a33bb-713e-4109-8306-fe91fd67904f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:33:55 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[b949fc0e-1216-495a-98ee-a044b2250633]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:33:55 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:33:55 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a8a33bb-713e-4109-8306-fe91fd67904f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gJQwpDVz {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:33:55 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a8a33bb-713e-4109-8306-fe91fd67904f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gJQwpDVz" returned: 0 in 0.021s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:33:55 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6777686-6c48-4932-9a69-2f42ab63c429]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:33:55 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gJQwpDVz'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:33:55 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a8a33bb-713e-4109-8306-fe91fd67904f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:33:55 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a8a33bb-713e-4109-8306-fe91fd67904f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:33:55 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2e7f195-61a3-4625-9bf4-024720416816]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:33:55 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:33:55 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:33:55 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:33:55 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[87818d83-fc95-4584-8d76-8da555d90415]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01563785-3767-460a-9815-c1bd0f7f6f9f (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bca4e77f-05f8-4ff6-8a78-6cef699f5667 (non-flash)\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:33:55 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01563785-3767-460a-9815-c1bd0f7f6f9f (non-flash)
Nov 15 09:33:55 user nova-compute[75122]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bca4e77f-05f8-4ff6-8a78-6cef699f5667 (non-flash)
Nov 15 09:33:55 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 09:33:55 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01563785-3767-460a-9815-c1bd0f7f6f9f (non-flash)
Nov 15 09:33:55 user nova-compute[75122]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bca4e77f-05f8-4ff6-8a78-6cef699f5667 (non-flash)
Nov 15 09:33:55 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 09:33:55 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a8a33bb-713e-4109-8306-fe91fd67904f -p 172.16.0.220:3260 --login {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:33:56 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a8a33bb-713e-4109-8306-fe91fd67904f -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:33:56 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9b580c3-b938-4684-ae76-7696fe2dfca8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3a8a33bb-713e-4109-8306-fe91fd67904f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3a8a33bb-713e-4109-8306-fe91fd67904f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:33:56 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3a8a33bb-713e-4109-8306-fe91fd67904f, portal: 172.16.0.220,3260]
Nov 15 09:33:56 user nova-compute[75122]: Login to [iface: default, target: iqn.2010-10.org.openstack:3a8a33bb-713e-4109-8306-fe91fd67904f, portal: 172.16.0.220,3260] successful.
Nov 15 09:33:56 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:33:56 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a8a33bb-713e-4109-8306-fe91fd67904f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:33:56 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a8a33bb-713e-4109-8306-fe91fd67904f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:33:56 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a2f27a7-000f-46e2-b518-ded2ebed01ae]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:33:56 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:33:56 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:33:56 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:33:56 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3f4e501-41eb-41ac-b10a-8ff1814dde69]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01563785-3767-460a-9815-c1bd0f7f6f9f (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bca4e77f-05f8-4ff6-8a78-6cef699f5667 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a8a33bb-713e-4109-8306-fe91fd67904f (non-flash)\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:33:56 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01563785-3767-460a-9815-c1bd0f7f6f9f (non-flash)
Nov 15 09:33:56 user nova-compute[75122]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bca4e77f-05f8-4ff6-8a78-6cef699f5667 (non-flash)
Nov 15 09:33:56 user nova-compute[75122]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a8a33bb-713e-4109-8306-fe91fd67904f (non-flash)
Nov 15 09:33:56 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 09:33:56 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01563785-3767-460a-9815-c1bd0f7f6f9f (non-flash)
Nov 15 09:33:56 user nova-compute[75122]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bca4e77f-05f8-4ff6-8a78-6cef699f5667 (non-flash)
Nov 15 09:33:56 user nova-compute[75122]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a8a33bb-713e-4109-8306-fe91fd67904f (non-flash)
Nov 15 09:33:56 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 09:33:56 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3a8a33bb-713e-4109-8306-fe91fd67904f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.320s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 09:33:56 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] Connected to 172.16.0.220:3260 {{(pid=75122) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 09:33:56 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] HCTL ('35', '-', '-', 0) found on session 15 with lun 0 {{(pid=75122) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 09:33:56 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75122) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 09:33:56 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:33:56 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.021s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:33:56 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[c145a978-73bc-4d77-a1b0-a578a6014464]: (4, ('- - 0', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:33:56 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] Searching for a device in session 15 and hctl ['35', '*', '*', 0] yield: None {{(pid=75122) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 09:33:57 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] Searching for a device in session 15 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75122) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 09:33:57 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:3a8a33bb-713e-4109-8306-fe91fd67904f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gJQwpDVz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75122) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 09:33:57 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.354s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 09:33:57 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] <== connect_volume: return (1355ms) {'type': 'block', 'scsi_wwn': '26632343033386232', 'path': '/dev/sdd'} {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 09:33:57 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26632343033386232', 'path': '/dev/sdd'} {{(pid=75122) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 09:33:57 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T09:33:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1558883839',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1558883839',id=11,image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKV5WTO3RU8mImKNvyy3587R+N7JwlT6Jf2J+MJbSqo4hAZxrSxF8W72MSyi+ySsoPdgOlsbcxF8VVQqPPlJi5ujN3wRt87bd8USGqJl/UXcMrJjLkiq2AkhQDDmymDtbg==',key_name='tempest-keypair-1749304277',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='641f0acd05d8403882a4f6b1b28e9269',ramdisk_id='',reservation_id='r-qck9bfvk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-238803034',owner_user_name='tempest-TaggedBootDevicesTest-238803034-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T09:33:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ba8869fcf4464284b52e2aaa41597bdd',uuid=742d64db-c555-4517-8ec9-cef02f09a6e0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7febe2f1-4891-4ad4-ac59-58edfd3d2f03", "address": "fa:16:3e:ec:cb:a9", "network": {"id": "63134c25-66d5-4030-bbf0-b2a2e259df84", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2071889805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "641f0acd05d8403882a4f6b1b28e9269", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7febe2f1-48", "ovs_interfaceid": "7febe2f1-4891-4ad4-ac59-58edfd3d2f03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75122) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 09:33:57 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] Converting VIF {"id": "7febe2f1-4891-4ad4-ac59-58edfd3d2f03", "address": "fa:16:3e:ec:cb:a9", "network": {"id": "63134c25-66d5-4030-bbf0-b2a2e259df84", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2071889805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "641f0acd05d8403882a4f6b1b28e9269", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7febe2f1-48", "ovs_interfaceid": "7febe2f1-4891-4ad4-ac59-58edfd3d2f03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 09:33:57 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:cb:a9,bridge_name='br-int',has_traffic_filtering=True,id=7febe2f1-4891-4ad4-ac59-58edfd3d2f03,network=Network(63134c25-66d5-4030-bbf0-b2a2e259df84),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7febe2f1-48') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 09:33:57 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T09:33:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1558883839',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1558883839',id=11,image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKV5WTO3RU8mImKNvyy3587R+N7JwlT6Jf2J+MJbSqo4hAZxrSxF8W72MSyi+ySsoPdgOlsbcxF8VVQqPPlJi5ujN3wRt87bd8USGqJl/UXcMrJjLkiq2AkhQDDmymDtbg==',key_name='tempest-keypair-1749304277',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='641f0acd05d8403882a4f6b1b28e9269',ramdisk_id='',reservation_id='r-qck9bfvk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-238803034',owner_user_name='tempest-TaggedBootDevicesTest-238803034-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T09:33:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ba8869fcf4464284b52e2aaa41597bdd',uuid=742d64db-c555-4517-8ec9-cef02f09a6e0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d8bfb09a-3733-4176-beec-aaa512b4ed8c", "address": "fa:16:3e:89:bb:49", "network": {"id": "3bb75c40-fc07-4bf2-8a8a-9f58cd457b67", "bridge": "br-int", "label": "tempest-device-tagging-net1-1158401388", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.130", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "641f0acd05d8403882a4f6b1b28e9269", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8bfb09a-37", "ovs_interfaceid": "d8bfb09a-3733-4176-beec-aaa512b4ed8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75122) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 09:33:57 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] Converting VIF {"id": "d8bfb09a-3733-4176-beec-aaa512b4ed8c", "address": "fa:16:3e:89:bb:49", "network": {"id": "3bb75c40-fc07-4bf2-8a8a-9f58cd457b67", "bridge": "br-int", "label": "tempest-device-tagging-net1-1158401388", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.130", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "641f0acd05d8403882a4f6b1b28e9269", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8bfb09a-37", "ovs_interfaceid": "d8bfb09a-3733-4176-beec-aaa512b4ed8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 09:33:57 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:bb:49,bridge_name='br-int',has_traffic_filtering=True,id=d8bfb09a-3733-4176-beec-aaa512b4ed8c,network=Network(3bb75c40-fc07-4bf2-8a8a-9f58cd457b67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd8bfb09a-37') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 09:33:57 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T09:33:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1558883839',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1558883839',id=11,image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKV5WTO3RU8mImKNvyy3587R+N7JwlT6Jf2J+MJbSqo4hAZxrSxF8W72MSyi+ySsoPdgOlsbcxF8VVQqPPlJi5ujN3wRt87bd8USGqJl/UXcMrJjLkiq2AkhQDDmymDtbg==',key_name='tempest-keypair-1749304277',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='641f0acd05d8403882a4f6b1b28e9269',ramdisk_id='',reservation_id='r-qck9bfvk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-238803034',owner_user_name='tempest-TaggedBootDevicesTest-238803034-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T09:33:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ba8869fcf4464284b52e2aaa41597bdd',uuid=742d64db-c555-4517-8ec9-cef02f09a6e0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eaecb293-c647-47d7-8103-6fb8851477f3", "address": "fa:16:3e:3c:b2:b8", "network": {"id": "3bb75c40-fc07-4bf2-8a8a-9f58cd457b67", "bridge": "br-int", "label": "tempest-device-tagging-net1-1158401388", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "641f0acd05d8403882a4f6b1b28e9269", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeaecb293-c6", "ovs_interfaceid": "eaecb293-c647-47d7-8103-6fb8851477f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75122) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 09:33:57 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] Converting VIF {"id": "eaecb293-c647-47d7-8103-6fb8851477f3", "address": "fa:16:3e:3c:b2:b8", "network": {"id": "3bb75c40-fc07-4bf2-8a8a-9f58cd457b67", "bridge": "br-int", "label": "tempest-device-tagging-net1-1158401388", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "641f0acd05d8403882a4f6b1b28e9269", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeaecb293-c6", "ovs_interfaceid": "eaecb293-c647-47d7-8103-6fb8851477f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 09:33:57 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3c:b2:b8,bridge_name='br-int',has_traffic_filtering=True,id=eaecb293-c647-47d7-8103-6fb8851477f3,network=Network(3bb75c40-fc07-4bf2-8a8a-9f58cd457b67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapeaecb293-c6') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 09:33:57 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T09:33:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1558883839',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1558883839',id=11,image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKV5WTO3RU8mImKNvyy3587R+N7JwlT6Jf2J+MJbSqo4hAZxrSxF8W72MSyi+ySsoPdgOlsbcxF8VVQqPPlJi5ujN3wRt87bd8USGqJl/UXcMrJjLkiq2AkhQDDmymDtbg==',key_name='tempest-keypair-1749304277',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='641f0acd05d8403882a4f6b1b28e9269',ramdisk_id='',reservation_id='r-qck9bfvk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-238803034',owner_user_name='tempest-TaggedBootDevicesTest-238803034-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T09:33:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ba8869fcf4464284b52e2aaa41597bdd',uuid=742d64db-c555-4517-8ec9-cef02f09a6e0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5ebcafd9-6939-4928-ae2f-38ec38e15876", "address": "fa:16:3e:ec:d2:98", "network": {"id": "3bb75c40-fc07-4bf2-8a8a-9f58cd457b67", "bridge": "br-int", "label": "tempest-device-tagging-net1-1158401388", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.29", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "641f0acd05d8403882a4f6b1b28e9269", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ebcafd9-69", "ovs_interfaceid": "5ebcafd9-6939-4928-ae2f-38ec38e15876", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75122) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 09:33:57 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] Converting VIF {"id": "5ebcafd9-6939-4928-ae2f-38ec38e15876", "address": "fa:16:3e:ec:d2:98", "network": {"id": "3bb75c40-fc07-4bf2-8a8a-9f58cd457b67", "bridge": "br-int", "label": "tempest-device-tagging-net1-1158401388", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.29", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "641f0acd05d8403882a4f6b1b28e9269", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ebcafd9-69", "ovs_interfaceid": "5ebcafd9-6939-4928-ae2f-38ec38e15876", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 09:33:57 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:d2:98,bridge_name='br-int',has_traffic_filtering=True,id=5ebcafd9-6939-4928-ae2f-38ec38e15876,network=Network(3bb75c40-fc07-4bf2-8a8a-9f58cd457b67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ebcafd9-69') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 09:33:57 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T09:33:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1558883839',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1558883839',id=11,image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKV5WTO3RU8mImKNvyy3587R+N7JwlT6Jf2J+MJbSqo4hAZxrSxF8W72MSyi+ySsoPdgOlsbcxF8VVQqPPlJi5ujN3wRt87bd8USGqJl/UXcMrJjLkiq2AkhQDDmymDtbg==',key_name='tempest-keypair-1749304277',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='641f0acd05d8403882a4f6b1b28e9269',ramdisk_id='',reservation_id='r-qck9bfvk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-238803034',owner_user_name='tempest-TaggedBootDevicesTest-238803034-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T09:33:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ba8869fcf4464284b52e2aaa41597bdd',uuid=742d64db-c555-4517-8ec9-cef02f09a6e0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5bf17322-fd6b-4335-9a8e-56e7cd64e180", "address": "fa:16:3e:c9:4d:28", "network": {"id": "3bb75c40-fc07-4bf2-8a8a-9f58cd457b67", "bridge": "br-int", "label": "tempest-device-tagging-net1-1158401388", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.122", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "641f0acd05d8403882a4f6b1b28e9269", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bf17322-fd", "ovs_interfaceid": "5bf17322-fd6b-4335-9a8e-56e7cd64e180", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75122) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 09:33:57 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] Converting VIF {"id": "5bf17322-fd6b-4335-9a8e-56e7cd64e180", "address": "fa:16:3e:c9:4d:28", "network": {"id": "3bb75c40-fc07-4bf2-8a8a-9f58cd457b67", "bridge": "br-int", "label": "tempest-device-tagging-net1-1158401388", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.122", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "641f0acd05d8403882a4f6b1b28e9269", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bf17322-fd", "ovs_interfaceid": "5bf17322-fd6b-4335-9a8e-56e7cd64e180", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 09:33:57 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:4d:28,bridge_name='br-int',has_traffic_filtering=True,id=5bf17322-fd6b-4335-9a8e-56e7cd64e180,network=Network(3bb75c40-fc07-4bf2-8a8a-9f58cd457b67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5bf17322-fd') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 09:33:57 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T09:33:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1558883839',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1558883839',id=11,image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKV5WTO3RU8mImKNvyy3587R+N7JwlT6Jf2J+MJbSqo4hAZxrSxF8W72MSyi+ySsoPdgOlsbcxF8VVQqPPlJi5ujN3wRt87bd8USGqJl/UXcMrJjLkiq2AkhQDDmymDtbg==',key_name='tempest-keypair-1749304277',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='641f0acd05d8403882a4f6b1b28e9269',ramdisk_id='',reservation_id='r-qck9bfvk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-238803034',owner_user_name='tempest-TaggedBootDevicesTest-238803034-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T09:33:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ba8869fcf4464284b52e2aaa41597bdd',uuid=742d64db-c555-4517-8ec9-cef02f09a6e0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "710ae079-0b1c-4c04-bea2-e34fd0d554ae", "address": "fa:16:3e:0e:e7:01", "network": {"id": "b4709ef9-ae05-4eac-b530-da89c65fd367", "bridge": "br-int", "label": "tempest-device-tagging-net2-314948697", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "641f0acd05d8403882a4f6b1b28e9269", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap710ae079-0b", "ovs_interfaceid": "710ae079-0b1c-4c04-bea2-e34fd0d554ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75122) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 09:33:57 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] Converting VIF {"id": "710ae079-0b1c-4c04-bea2-e34fd0d554ae", "address": "fa:16:3e:0e:e7:01", "network": {"id": "b4709ef9-ae05-4eac-b530-da89c65fd367", "bridge": "br-int", "label": "tempest-device-tagging-net2-314948697", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "641f0acd05d8403882a4f6b1b28e9269", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap710ae079-0b", "ovs_interfaceid": "710ae079-0b1c-4c04-bea2-e34fd0d554ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 09:33:57 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:e7:01,bridge_name='br-int',has_traffic_filtering=True,id=710ae079-0b1c-4c04-bea2-e34fd0d554ae,network=Network(b4709ef9-ae05-4eac-b530-da89c65fd367),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap710ae079-0b') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 09:33:57 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T09:33:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1558883839',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1558883839',id=11,image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKV5WTO3RU8mImKNvyy3587R+N7JwlT6Jf2J+MJbSqo4hAZxrSxF8W72MSyi+ySsoPdgOlsbcxF8VVQqPPlJi5ujN3wRt87bd8USGqJl/UXcMrJjLkiq2AkhQDDmymDtbg==',key_name='tempest-keypair-1749304277',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='641f0acd05d8403882a4f6b1b28e9269',ramdisk_id='',reservation_id='r-qck9bfvk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-238803034',owner_user_name='tempest-TaggedBootDevicesTest-238803034-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T09:33:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ba8869fcf4464284b52e2aaa41597bdd',uuid=742d64db-c555-4517-8ec9-cef02f09a6e0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d378cd7b-d582-4062-a714-d4456d71ba5f", "address": "fa:16:3e:e1:90:72", "network": {"id": "b4709ef9-ae05-4eac-b530-da89c65fd367", "bridge": "br-int", "label": "tempest-device-tagging-net2-314948697", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "641f0acd05d8403882a4f6b1b28e9269", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd378cd7b-d5", "ovs_interfaceid": "d378cd7b-d582-4062-a714-d4456d71ba5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75122) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 09:33:57 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] Converting VIF {"id": "d378cd7b-d582-4062-a714-d4456d71ba5f", "address": "fa:16:3e:e1:90:72", "network": {"id": "b4709ef9-ae05-4eac-b530-da89c65fd367", "bridge": "br-int", "label": "tempest-device-tagging-net2-314948697", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "641f0acd05d8403882a4f6b1b28e9269", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd378cd7b-d5", "ovs_interfaceid": "d378cd7b-d582-4062-a714-d4456d71ba5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 09:33:57 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:90:72,bridge_name='br-int',has_traffic_filtering=True,id=d378cd7b-d582-4062-a714-d4456d71ba5f,network=Network(b4709ef9-ae05-4eac-b530-da89c65fd367),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd378cd7b-d5') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 09:33:57 user nova-compute[75122]: DEBUG nova.objects.instance [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] Lazy-loading 'pci_devices' on Instance uuid 742d64db-c555-4517-8ec9-cef02f09a6e0 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:33:57 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] End _get_guest_xml xml=<domain type="kvm">
Nov 15 09:33:57 user nova-compute[75122]:   <uuid>742d64db-c555-4517-8ec9-cef02f09a6e0</uuid>
Nov 15 09:33:57 user nova-compute[75122]:   <name>instance-0000000b</name>
Nov 15 09:33:57 user nova-compute[75122]:   <memory>524288</memory>
Nov 15 09:33:57 user nova-compute[75122]:   <vcpu>1</vcpu>
Nov 15 09:33:57 user nova-compute[75122]:   <metadata>
Nov 15 09:33:57 user nova-compute[75122]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 09:33:57 user nova-compute[75122]:       <nova:package version="0.0.0"/>
Nov 15 09:33:57 user nova-compute[75122]:       <nova:name>tempest-device-tagging-server-1558883839</nova:name>
Nov 15 09:33:57 user nova-compute[75122]:       <nova:creationTime>2023-11-15 09:33:53</nova:creationTime>
Nov 15 09:33:57 user nova-compute[75122]:       <nova:flavor name="m1.tiny">
Nov 15 09:33:57 user nova-compute[75122]:         <nova:memory>512</nova:memory>
Nov 15 09:33:57 user nova-compute[75122]:         <nova:disk>1</nova:disk>
Nov 15 09:33:57 user nova-compute[75122]:         <nova:swap>0</nova:swap>
Nov 15 09:33:57 user nova-compute[75122]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 09:33:57 user nova-compute[75122]:         <nova:vcpus>1</nova:vcpus>
Nov 15 09:33:57 user nova-compute[75122]:       </nova:flavor>
Nov 15 09:33:57 user nova-compute[75122]:       <nova:owner>
Nov 15 09:33:57 user nova-compute[75122]:         <nova:user uuid="ba8869fcf4464284b52e2aaa41597bdd">tempest-TaggedBootDevicesTest-238803034-project-member</nova:user>
Nov 15 09:33:57 user nova-compute[75122]:         <nova:project uuid="641f0acd05d8403882a4f6b1b28e9269">tempest-TaggedBootDevicesTest-238803034</nova:project>
Nov 15 09:33:57 user nova-compute[75122]:       </nova:owner>
Nov 15 09:33:57 user nova-compute[75122]:       <nova:root type="image" uuid="5e862cfe-47b8-4725-8292-65761ee6d0f5"/>
Nov 15 09:33:57 user nova-compute[75122]:       <nova:ports>
Nov 15 09:33:57 user nova-compute[75122]:         <nova:port uuid="7febe2f1-4891-4ad4-ac59-58edfd3d2f03">
Nov 15 09:33:57 user nova-compute[75122]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 15 09:33:57 user nova-compute[75122]:         </nova:port>
Nov 15 09:33:57 user nova-compute[75122]:         <nova:port uuid="d8bfb09a-3733-4176-beec-aaa512b4ed8c">
Nov 15 09:33:57 user nova-compute[75122]:           <nova:ip type="fixed" address="10.1.1.130" ipVersion="4"/>
Nov 15 09:33:57 user nova-compute[75122]:         </nova:port>
Nov 15 09:33:57 user nova-compute[75122]:         <nova:port uuid="eaecb293-c647-47d7-8103-6fb8851477f3">
Nov 15 09:33:57 user nova-compute[75122]:           <nova:ip type="fixed" address="10.1.1.163" ipVersion="4"/>
Nov 15 09:33:57 user nova-compute[75122]:         </nova:port>
Nov 15 09:33:57 user nova-compute[75122]:         <nova:port uuid="5ebcafd9-6939-4928-ae2f-38ec38e15876">
Nov 15 09:33:57 user nova-compute[75122]:           <nova:ip type="fixed" address="10.1.1.29" ipVersion="4"/>
Nov 15 09:33:57 user nova-compute[75122]:         </nova:port>
Nov 15 09:33:57 user nova-compute[75122]:         <nova:port uuid="5bf17322-fd6b-4335-9a8e-56e7cd64e180">
Nov 15 09:33:57 user nova-compute[75122]:           <nova:ip type="fixed" address="10.1.1.122" ipVersion="4"/>
Nov 15 09:33:57 user nova-compute[75122]:         </nova:port>
Nov 15 09:33:57 user nova-compute[75122]:         <nova:port uuid="710ae079-0b1c-4c04-bea2-e34fd0d554ae">
Nov 15 09:33:57 user nova-compute[75122]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 15 09:33:57 user nova-compute[75122]:         </nova:port>
Nov 15 09:33:57 user nova-compute[75122]:         <nova:port uuid="d378cd7b-d582-4062-a714-d4456d71ba5f">
Nov 15 09:33:57 user nova-compute[75122]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 15 09:33:57 user nova-compute[75122]:         </nova:port>
Nov 15 09:33:57 user nova-compute[75122]:       </nova:ports>
Nov 15 09:33:57 user nova-compute[75122]:     </nova:instance>
Nov 15 09:33:57 user nova-compute[75122]:   </metadata>
Nov 15 09:33:57 user nova-compute[75122]:   <sysinfo type="smbios">
Nov 15 09:33:57 user nova-compute[75122]:     <system>
Nov 15 09:33:57 user nova-compute[75122]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 09:33:57 user nova-compute[75122]:       <entry name="product">OpenStack Nova</entry>
Nov 15 09:33:57 user nova-compute[75122]:       <entry name="version">0.0.0</entry>
Nov 15 09:33:57 user nova-compute[75122]:       <entry name="serial">742d64db-c555-4517-8ec9-cef02f09a6e0</entry>
Nov 15 09:33:57 user nova-compute[75122]:       <entry name="uuid">742d64db-c555-4517-8ec9-cef02f09a6e0</entry>
Nov 15 09:33:57 user nova-compute[75122]:       <entry name="family">Virtual Machine</entry>
Nov 15 09:33:57 user nova-compute[75122]:     </system>
Nov 15 09:33:57 user nova-compute[75122]:   </sysinfo>
Nov 15 09:33:57 user nova-compute[75122]:   <os>
Nov 15 09:33:57 user nova-compute[75122]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 09:33:57 user nova-compute[75122]:     <boot dev="hd"/>
Nov 15 09:33:57 user nova-compute[75122]:     <smbios mode="sysinfo"/>
Nov 15 09:33:57 user nova-compute[75122]:   </os>
Nov 15 09:33:57 user nova-compute[75122]:   <features>
Nov 15 09:33:57 user nova-compute[75122]:     <acpi/>
Nov 15 09:33:57 user nova-compute[75122]:     <apic/>
Nov 15 09:33:57 user nova-compute[75122]:     <vmcoreinfo/>
Nov 15 09:33:57 user nova-compute[75122]:   </features>
Nov 15 09:33:57 user nova-compute[75122]:   <clock offset="utc">
Nov 15 09:33:57 user nova-compute[75122]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 09:33:57 user nova-compute[75122]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 09:33:57 user nova-compute[75122]:     <timer name="hpet" present="no"/>
Nov 15 09:33:57 user nova-compute[75122]:   </clock>
Nov 15 09:33:57 user nova-compute[75122]:   <cpu mode="custom" match="exact">
Nov 15 09:33:57 user nova-compute[75122]:     <model>Nehalem</model>
Nov 15 09:33:57 user nova-compute[75122]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 09:33:57 user nova-compute[75122]:   </cpu>
Nov 15 09:33:57 user nova-compute[75122]:   <devices>
Nov 15 09:33:57 user nova-compute[75122]:     <disk type="file" device="cdrom">
Nov 15 09:33:57 user nova-compute[75122]:       <driver name="qemu" type="raw" cache="none"/>
Nov 15 09:33:57 user nova-compute[75122]:       <source file="/opt/stack/data/nova/instances/742d64db-c555-4517-8ec9-cef02f09a6e0/disk.config"/>
Nov 15 09:33:57 user nova-compute[75122]:       <target dev="hda" bus="ide"/>
Nov 15 09:33:57 user nova-compute[75122]:     </disk>
Nov 15 09:33:57 user nova-compute[75122]:     <disk type="block" device="disk">
Nov 15 09:33:57 user nova-compute[75122]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 09:33:57 user nova-compute[75122]:       <source dev="/dev/sdb"/>
Nov 15 09:33:57 user nova-compute[75122]:       <target dev="vda" bus="virtio"/>
Nov 15 09:33:57 user nova-compute[75122]:       <serial>01563785-3767-460a-9815-c1bd0f7f6f9f</serial>
Nov 15 09:33:57 user nova-compute[75122]:     </disk>
Nov 15 09:33:57 user nova-compute[75122]:     <disk type="block" device="disk">
Nov 15 09:33:57 user nova-compute[75122]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 09:33:57 user nova-compute[75122]:       <source dev="/dev/sdc"/>
Nov 15 09:33:57 user nova-compute[75122]:       <target dev="vdb" bus="virtio"/>
Nov 15 09:33:57 user nova-compute[75122]:       <serial>bca4e77f-05f8-4ff6-8a78-6cef699f5667</serial>
Nov 15 09:33:57 user nova-compute[75122]:     </disk>
Nov 15 09:33:57 user nova-compute[75122]:     <disk type="block" device="disk">
Nov 15 09:33:57 user nova-compute[75122]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 09:33:57 user nova-compute[75122]:       <source dev="/dev/sdd"/>
Nov 15 09:33:57 user nova-compute[75122]:       <target dev="vdc" bus="virtio"/>
Nov 15 09:33:57 user nova-compute[75122]:       <serial>3a8a33bb-713e-4109-8306-fe91fd67904f</serial>
Nov 15 09:33:57 user nova-compute[75122]:     </disk>
Nov 15 09:33:57 user nova-compute[75122]:     <interface type="ethernet">
Nov 15 09:33:57 user nova-compute[75122]:       <mac address="fa:16:3e:ec:cb:a9"/>
Nov 15 09:33:57 user nova-compute[75122]:       <model type="virtio"/>
Nov 15 09:33:57 user nova-compute[75122]:       <mtu size="1442"/>
Nov 15 09:33:57 user nova-compute[75122]:       <target dev="tap7febe2f1-48"/>
Nov 15 09:33:57 user nova-compute[75122]:     </interface>
Nov 15 09:33:57 user nova-compute[75122]:     <interface type="ethernet">
Nov 15 09:33:57 user nova-compute[75122]:       <mac address="fa:16:3e:89:bb:49"/>
Nov 15 09:33:57 user nova-compute[75122]:       <model type="virtio"/>
Nov 15 09:33:57 user nova-compute[75122]:       <mtu size="1442"/>
Nov 15 09:33:57 user nova-compute[75122]:       <target dev="tapd8bfb09a-37"/>
Nov 15 09:33:57 user nova-compute[75122]:     </interface>
Nov 15 09:33:57 user nova-compute[75122]:     <interface type="ethernet">
Nov 15 09:33:57 user nova-compute[75122]:       <mac address="fa:16:3e:3c:b2:b8"/>
Nov 15 09:33:57 user nova-compute[75122]:       <model type="virtio"/>
Nov 15 09:33:57 user nova-compute[75122]:       <mtu size="1442"/>
Nov 15 09:33:57 user nova-compute[75122]:       <target dev="tapeaecb293-c6"/>
Nov 15 09:33:57 user nova-compute[75122]:     </interface>
Nov 15 09:33:57 user nova-compute[75122]:     <interface type="ethernet">
Nov 15 09:33:57 user nova-compute[75122]:       <mac address="fa:16:3e:ec:d2:98"/>
Nov 15 09:33:57 user nova-compute[75122]:       <model type="virtio"/>
Nov 15 09:33:57 user nova-compute[75122]:       <mtu size="1442"/>
Nov 15 09:33:57 user nova-compute[75122]:       <target dev="tap5ebcafd9-69"/>
Nov 15 09:33:57 user nova-compute[75122]:     </interface>
Nov 15 09:33:57 user nova-compute[75122]:     <interface type="ethernet">
Nov 15 09:33:57 user nova-compute[75122]:       <mac address="fa:16:3e:c9:4d:28"/>
Nov 15 09:33:57 user nova-compute[75122]:       <model type="virtio"/>
Nov 15 09:33:57 user nova-compute[75122]:       <mtu size="1442"/>
Nov 15 09:33:57 user nova-compute[75122]:       <target dev="tap5bf17322-fd"/>
Nov 15 09:33:57 user nova-compute[75122]:     </interface>
Nov 15 09:33:57 user nova-compute[75122]:     <interface type="ethernet">
Nov 15 09:33:57 user nova-compute[75122]:       <mac address="fa:16:3e:0e:e7:01"/>
Nov 15 09:33:57 user nova-compute[75122]:       <model type="virtio"/>
Nov 15 09:33:57 user nova-compute[75122]:       <mtu size="1442"/>
Nov 15 09:33:57 user nova-compute[75122]:       <target dev="tap710ae079-0b"/>
Nov 15 09:33:57 user nova-compute[75122]:     </interface>
Nov 15 09:33:57 user nova-compute[75122]:     <interface type="ethernet">
Nov 15 09:33:57 user nova-compute[75122]:       <mac address="fa:16:3e:e1:90:72"/>
Nov 15 09:33:57 user nova-compute[75122]:       <model type="virtio"/>
Nov 15 09:33:57 user nova-compute[75122]:       <mtu size="1442"/>
Nov 15 09:33:57 user nova-compute[75122]:       <target dev="tapd378cd7b-d5"/>
Nov 15 09:33:57 user nova-compute[75122]:     </interface>
Nov 15 09:33:57 user nova-compute[75122]:     <serial type="pty">
Nov 15 09:33:57 user nova-compute[75122]:       <log file="/opt/stack/data/nova/instances/742d64db-c555-4517-8ec9-cef02f09a6e0/console.log" append="off"/>
Nov 15 09:33:57 user nova-compute[75122]:     </serial>
Nov 15 09:33:57 user nova-compute[75122]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 09:33:57 user nova-compute[75122]:     <video>
Nov 15 09:33:57 user nova-compute[75122]:       <model type="virtio"/>
Nov 15 09:33:57 user nova-compute[75122]:     </video>
Nov 15 09:33:57 user nova-compute[75122]:     <rng model="virtio">
Nov 15 09:33:57 user nova-compute[75122]:       <backend model="random">/dev/urandom</backend>
Nov 15 09:33:57 user nova-compute[75122]:     </rng>
Nov 15 09:33:57 user nova-compute[75122]:     <controller type="usb" index="0" model="none"/>
Nov 15 09:33:57 user nova-compute[75122]:     <memballoon model="virtio">
Nov 15 09:33:57 user nova-compute[75122]:       <stats period="10"/>
Nov 15 09:33:57 user nova-compute[75122]:     </memballoon>
Nov 15 09:33:57 user nova-compute[75122]:   </devices>
Nov 15 09:33:57 user nova-compute[75122]: </domain>
Nov 15 09:33:57 user nova-compute[75122]:  {{(pid=75122) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 09:33:57 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T09:33:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1558883839',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1558883839',id=11,image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKV5WTO3RU8mImKNvyy3587R+N7JwlT6Jf2J+MJbSqo4hAZxrSxF8W72MSyi+ySsoPdgOlsbcxF8VVQqPPlJi5ujN3wRt87bd8USGqJl/UXcMrJjLkiq2AkhQDDmymDtbg==',key_name='tempest-keypair-1749304277',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='641f0acd05d8403882a4f6b1b28e9269',ramdisk_id='',reservation_id='r-qck9bfvk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-238803034',owner_user_name='tempest-TaggedBootDevicesTest-238803034-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T09:33:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ba8869fcf4464284b52e2aaa41597bdd',uuid=742d64db-c555-4517-8ec9-cef02f09a6e0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7febe2f1-4891-4ad4-ac59-58edfd3d2f03", "address": "fa:16:3e:ec:cb:a9", "network": {"id": "63134c25-66d5-4030-bbf0-b2a2e259df84", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2071889805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "641f0acd05d8403882a4f6b1b28e9269", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7febe2f1-48", "ovs_interfaceid": "7febe2f1-4891-4ad4-ac59-58edfd3d2f03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 09:33:57 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] Converting VIF {"id": "7febe2f1-4891-4ad4-ac59-58edfd3d2f03", "address": "fa:16:3e:ec:cb:a9", "network": {"id": "63134c25-66d5-4030-bbf0-b2a2e259df84", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2071889805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "641f0acd05d8403882a4f6b1b28e9269", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7febe2f1-48", "ovs_interfaceid": "7febe2f1-4891-4ad4-ac59-58edfd3d2f03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 09:33:57 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:cb:a9,bridge_name='br-int',has_traffic_filtering=True,id=7febe2f1-4891-4ad4-ac59-58edfd3d2f03,network=Network(63134c25-66d5-4030-bbf0-b2a2e259df84),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7febe2f1-48') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 09:33:57 user nova-compute[75122]: DEBUG os_vif [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:cb:a9,bridge_name='br-int',has_traffic_filtering=True,id=7febe2f1-4891-4ad4-ac59-58edfd3d2f03,network=Network(63134c25-66d5-4030-bbf0-b2a2e259df84),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7febe2f1-48') {{(pid=75122) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 09:33:57 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:33:57 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:33:57 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 09:33:57 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:33:57 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7d905552-6c3e-5b2f-b8c4-4e2ab26129ab', '_type': 'linux-noop'}}, row=False) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:33:57 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:33:57 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:33:57 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:33:57 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7febe2f1-48, may_exist=True, interface_attrs={}) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:33:57 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7febe2f1-48, col_values=(('qos', UUID('aa59d183-643f-433b-aadc-27e6a3bcf665')),), if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:33:57 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7febe2f1-48, col_values=(('external_ids', {'iface-id': '7febe2f1-4891-4ad4-ac59-58edfd3d2f03', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ec:cb:a9', 'vm-uuid': '742d64db-c555-4517-8ec9-cef02f09a6e0'}),), if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:33:57 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:33:57 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:33:57 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:33:57 user nova-compute[75122]: INFO os_vif [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:cb:a9,bridge_name='br-int',has_traffic_filtering=True,id=7febe2f1-4891-4ad4-ac59-58edfd3d2f03,network=Network(63134c25-66d5-4030-bbf0-b2a2e259df84),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7febe2f1-48')
Nov 15 09:33:57 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T09:33:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1558883839',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1558883839',id=11,image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKV5WTO3RU8mImKNvyy3587R+N7JwlT6Jf2J+MJbSqo4hAZxrSxF8W72MSyi+ySsoPdgOlsbcxF8VVQqPPlJi5ujN3wRt87bd8USGqJl/UXcMrJjLkiq2AkhQDDmymDtbg==',key_name='tempest-keypair-1749304277',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='641f0acd05d8403882a4f6b1b28e9269',ramdisk_id='',reservation_id='r-qck9bfvk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-238803034',owner_user_name='tempest-TaggedBootDevicesTest-238803034-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T09:33:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ba8869fcf4464284b52e2aaa41597bdd',uuid=742d64db-c555-4517-8ec9-cef02f09a6e0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d8bfb09a-3733-4176-beec-aaa512b4ed8c", "address": "fa:16:3e:89:bb:49", "network": {"id": "3bb75c40-fc07-4bf2-8a8a-9f58cd457b67", "bridge": "br-int", "label": "tempest-device-tagging-net1-1158401388", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.130", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "641f0acd05d8403882a4f6b1b28e9269", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8bfb09a-37", "ovs_interfaceid": "d8bfb09a-3733-4176-beec-aaa512b4ed8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75122) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 09:33:57 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] Converting VIF {"id": "d8bfb09a-3733-4176-beec-aaa512b4ed8c", "address": "fa:16:3e:89:bb:49", "network": {"id": "3bb75c40-fc07-4bf2-8a8a-9f58cd457b67", "bridge": "br-int", "label": "tempest-device-tagging-net1-1158401388", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.130", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "641f0acd05d8403882a4f6b1b28e9269", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8bfb09a-37", "ovs_interfaceid": "d8bfb09a-3733-4176-beec-aaa512b4ed8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 09:33:57 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:bb:49,bridge_name='br-int',has_traffic_filtering=True,id=d8bfb09a-3733-4176-beec-aaa512b4ed8c,network=Network(3bb75c40-fc07-4bf2-8a8a-9f58cd457b67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd8bfb09a-37') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 09:33:57 user nova-compute[75122]: DEBUG os_vif [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:bb:49,bridge_name='br-int',has_traffic_filtering=True,id=d8bfb09a-3733-4176-beec-aaa512b4ed8c,network=Network(3bb75c40-fc07-4bf2-8a8a-9f58cd457b67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd8bfb09a-37') {{(pid=75122) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 09:33:57 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:33:57 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:33:57 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 09:33:57 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:33:57 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '657fe0f0-d147-5b90-a76a-c680db6ea0de', '_type': 'linux-noop'}}, row=False) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:33:57 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:33:57 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:33:57 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:33:57 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:33:57 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd8bfb09a-37, may_exist=True, interface_attrs={}) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:33:57 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd8bfb09a-37, col_values=(('qos', UUID('b5f383c4-901e-441c-8d80-b50636185ba9')),), if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:33:57 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd8bfb09a-37, col_values=(('external_ids', {'iface-id': 'd8bfb09a-3733-4176-beec-aaa512b4ed8c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:89:bb:49', 'vm-uuid': '742d64db-c555-4517-8ec9-cef02f09a6e0'}),), if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:33:57 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:33:57 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:33:57 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:33:57 user nova-compute[75122]: INFO os_vif [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:bb:49,bridge_name='br-int',has_traffic_filtering=True,id=d8bfb09a-3733-4176-beec-aaa512b4ed8c,network=Network(3bb75c40-fc07-4bf2-8a8a-9f58cd457b67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd8bfb09a-37')
Nov 15 09:33:57 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T09:33:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1558883839',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1558883839',id=11,image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKV5WTO3RU8mImKNvyy3587R+N7JwlT6Jf2J+MJbSqo4hAZxrSxF8W72MSyi+ySsoPdgOlsbcxF8VVQqPPlJi5ujN3wRt87bd8USGqJl/UXcMrJjLkiq2AkhQDDmymDtbg==',key_name='tempest-keypair-1749304277',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='641f0acd05d8403882a4f6b1b28e9269',ramdisk_id='',reservation_id='r-qck9bfvk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-238803034',owner_user_name='tempest-TaggedBootDevicesTest-238803034-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T09:33:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ba8869fcf4464284b52e2aaa41597bdd',uuid=742d64db-c555-4517-8ec9-cef02f09a6e0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eaecb293-c647-47d7-8103-6fb8851477f3", "address": "fa:16:3e:3c:b2:b8", "network": {"id": "3bb75c40-fc07-4bf2-8a8a-9f58cd457b67", "bridge": "br-int", "label": "tempest-device-tagging-net1-1158401388", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "641f0acd05d8403882a4f6b1b28e9269", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeaecb293-c6", "ovs_interfaceid": "eaecb293-c647-47d7-8103-6fb8851477f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75122) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 09:33:57 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] Converting VIF {"id": "eaecb293-c647-47d7-8103-6fb8851477f3", "address": "fa:16:3e:3c:b2:b8", "network": {"id": "3bb75c40-fc07-4bf2-8a8a-9f58cd457b67", "bridge": "br-int", "label": "tempest-device-tagging-net1-1158401388", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "641f0acd05d8403882a4f6b1b28e9269", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeaecb293-c6", "ovs_interfaceid": "eaecb293-c647-47d7-8103-6fb8851477f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 09:33:57 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3c:b2:b8,bridge_name='br-int',has_traffic_filtering=True,id=eaecb293-c647-47d7-8103-6fb8851477f3,network=Network(3bb75c40-fc07-4bf2-8a8a-9f58cd457b67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapeaecb293-c6') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 09:33:57 user nova-compute[75122]: DEBUG os_vif [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:b2:b8,bridge_name='br-int',has_traffic_filtering=True,id=eaecb293-c647-47d7-8103-6fb8851477f3,network=Network(3bb75c40-fc07-4bf2-8a8a-9f58cd457b67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapeaecb293-c6') {{(pid=75122) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 09:33:57 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:33:57 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:33:57 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 09:33:57 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:33:57 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3d348edc-b0be-51f0-a365-d351f604fa61', '_type': 'linux-noop'}}, row=False) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:33:57 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:33:57 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:33:57 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:33:57 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:33:57 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapeaecb293-c6, may_exist=True, interface_attrs={}) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:33:57 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapeaecb293-c6, col_values=(('qos', UUID('20b4834e-faf6-4142-9a4d-0bbf19ec5f53')),), if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:33:57 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapeaecb293-c6, col_values=(('external_ids', {'iface-id': 'eaecb293-c647-47d7-8103-6fb8851477f3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3c:b2:b8', 'vm-uuid': '742d64db-c555-4517-8ec9-cef02f09a6e0'}),), if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:33:57 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:33:57 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:33:57 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:33:57 user nova-compute[75122]: INFO os_vif [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:b2:b8,bridge_name='br-int',has_traffic_filtering=True,id=eaecb293-c647-47d7-8103-6fb8851477f3,network=Network(3bb75c40-fc07-4bf2-8a8a-9f58cd457b67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapeaecb293-c6')
Nov 15 09:33:57 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T09:33:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1558883839',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1558883839',id=11,image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKV5WTO3RU8mImKNvyy3587R+N7JwlT6Jf2J+MJbSqo4hAZxrSxF8W72MSyi+ySsoPdgOlsbcxF8VVQqPPlJi5ujN3wRt87bd8USGqJl/UXcMrJjLkiq2AkhQDDmymDtbg==',key_name='tempest-keypair-1749304277',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='641f0acd05d8403882a4f6b1b28e9269',ramdisk_id='',reservation_id='r-qck9bfvk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-238803034',owner_user_name='tempest-TaggedBootDevicesTest-238803034-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T09:33:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ba8869fcf4464284b52e2aaa41597bdd',uuid=742d64db-c555-4517-8ec9-cef02f09a6e0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5ebcafd9-6939-4928-ae2f-38ec38e15876", "address": "fa:16:3e:ec:d2:98", "network": {"id": "3bb75c40-fc07-4bf2-8a8a-9f58cd457b67", "bridge": "br-int", "label": "tempest-device-tagging-net1-1158401388", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.29", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "641f0acd05d8403882a4f6b1b28e9269", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ebcafd9-69", "ovs_interfaceid": "5ebcafd9-6939-4928-ae2f-38ec38e15876", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 09:33:57 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] Converting VIF {"id": "5ebcafd9-6939-4928-ae2f-38ec38e15876", "address": "fa:16:3e:ec:d2:98", "network": {"id": "3bb75c40-fc07-4bf2-8a8a-9f58cd457b67", "bridge": "br-int", "label": "tempest-device-tagging-net1-1158401388", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.29", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "641f0acd05d8403882a4f6b1b28e9269", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ebcafd9-69", "ovs_interfaceid": "5ebcafd9-6939-4928-ae2f-38ec38e15876", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 09:33:57 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:d2:98,bridge_name='br-int',has_traffic_filtering=True,id=5ebcafd9-6939-4928-ae2f-38ec38e15876,network=Network(3bb75c40-fc07-4bf2-8a8a-9f58cd457b67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ebcafd9-69') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 09:33:57 user nova-compute[75122]: DEBUG os_vif [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:d2:98,bridge_name='br-int',has_traffic_filtering=True,id=5ebcafd9-6939-4928-ae2f-38ec38e15876,network=Network(3bb75c40-fc07-4bf2-8a8a-9f58cd457b67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ebcafd9-69') {{(pid=75122) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 09:33:57 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:33:57 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:33:57 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 09:33:57 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:33:57 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fc263905-13b6-566b-abf1-42cce1ebffb9', '_type': 'linux-noop'}}, row=False) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:33:57 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:33:57 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:33:57 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:33:57 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:33:57 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5ebcafd9-69, may_exist=True, interface_attrs={}) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:33:57 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5ebcafd9-69, col_values=(('qos', UUID('271eca80-3e4f-4654-a273-1254829b9697')),), if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:33:57 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5ebcafd9-69, col_values=(('external_ids', {'iface-id': '5ebcafd9-6939-4928-ae2f-38ec38e15876', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ec:d2:98', 'vm-uuid': '742d64db-c555-4517-8ec9-cef02f09a6e0'}),), if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:33:57 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:33:57 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:33:57 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:33:57 user nova-compute[75122]: INFO os_vif [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:d2:98,bridge_name='br-int',has_traffic_filtering=True,id=5ebcafd9-6939-4928-ae2f-38ec38e15876,network=Network(3bb75c40-fc07-4bf2-8a8a-9f58cd457b67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ebcafd9-69')
Nov 15 09:33:57 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T09:33:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1558883839',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1558883839',id=11,image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKV5WTO3RU8mImKNvyy3587R+N7JwlT6Jf2J+MJbSqo4hAZxrSxF8W72MSyi+ySsoPdgOlsbcxF8VVQqPPlJi5ujN3wRt87bd8USGqJl/UXcMrJjLkiq2AkhQDDmymDtbg==',key_name='tempest-keypair-1749304277',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='641f0acd05d8403882a4f6b1b28e9269',ramdisk_id='',reservation_id='r-qck9bfvk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-238803034',owner_user_name='tempest-TaggedBootDevicesTest-238803034-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T09:33:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ba8869fcf4464284b52e2aaa41597bdd',uuid=742d64db-c555-4517-8ec9-cef02f09a6e0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5bf17322-fd6b-4335-9a8e-56e7cd64e180", "address": "fa:16:3e:c9:4d:28", "network": {"id": "3bb75c40-fc07-4bf2-8a8a-9f58cd457b67", "bridge": "br-int", "label": "tempest-device-tagging-net1-1158401388", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.122", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "641f0acd05d8403882a4f6b1b28e9269", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bf17322-fd", "ovs_interfaceid": "5bf17322-fd6b-4335-9a8e-56e7cd64e180", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 09:33:57 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] Converting VIF {"id": "5bf17322-fd6b-4335-9a8e-56e7cd64e180", "address": "fa:16:3e:c9:4d:28", "network": {"id": "3bb75c40-fc07-4bf2-8a8a-9f58cd457b67", "bridge": "br-int", "label": "tempest-device-tagging-net1-1158401388", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.122", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "641f0acd05d8403882a4f6b1b28e9269", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bf17322-fd", "ovs_interfaceid": "5bf17322-fd6b-4335-9a8e-56e7cd64e180", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 09:33:57 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:4d:28,bridge_name='br-int',has_traffic_filtering=True,id=5bf17322-fd6b-4335-9a8e-56e7cd64e180,network=Network(3bb75c40-fc07-4bf2-8a8a-9f58cd457b67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5bf17322-fd') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 09:33:57 user nova-compute[75122]: DEBUG os_vif [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:4d:28,bridge_name='br-int',has_traffic_filtering=True,id=5bf17322-fd6b-4335-9a8e-56e7cd64e180,network=Network(3bb75c40-fc07-4bf2-8a8a-9f58cd457b67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5bf17322-fd') {{(pid=75122) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 09:33:57 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:33:57 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:33:57 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 09:33:57 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:33:57 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a14d9861-1659-59d1-a929-5bde41104a02', '_type': 'linux-noop'}}, row=False) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:33:57 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:33:57 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:33:57 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:33:57 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:33:57 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5bf17322-fd, may_exist=True, interface_attrs={}) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:33:57 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5bf17322-fd, col_values=(('qos', UUID('187f2980-2ac7-4e96-a32d-e9b8be407d8d')),), if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:33:57 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5bf17322-fd, col_values=(('external_ids', {'iface-id': '5bf17322-fd6b-4335-9a8e-56e7cd64e180', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c9:4d:28', 'vm-uuid': '742d64db-c555-4517-8ec9-cef02f09a6e0'}),), if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:33:57 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:33:57 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:33:57 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:33:57 user nova-compute[75122]: INFO os_vif [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:4d:28,bridge_name='br-int',has_traffic_filtering=True,id=5bf17322-fd6b-4335-9a8e-56e7cd64e180,network=Network(3bb75c40-fc07-4bf2-8a8a-9f58cd457b67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5bf17322-fd')
Nov 15 09:33:57 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T09:33:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1558883839',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1558883839',id=11,image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKV5WTO3RU8mImKNvyy3587R+N7JwlT6Jf2J+MJbSqo4hAZxrSxF8W72MSyi+ySsoPdgOlsbcxF8VVQqPPlJi5ujN3wRt87bd8USGqJl/UXcMrJjLkiq2AkhQDDmymDtbg==',key_name='tempest-keypair-1749304277',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='641f0acd05d8403882a4f6b1b28e9269',ramdisk_id='',reservation_id='r-qck9bfvk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-238803034',owner_user_name='tempest-TaggedBootDevicesTest-238803034-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T09:33:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ba8869fcf4464284b52e2aaa41597bdd',uuid=742d64db-c555-4517-8ec9-cef02f09a6e0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "710ae079-0b1c-4c04-bea2-e34fd0d554ae", "address": "fa:16:3e:0e:e7:01", "network": {"id": "b4709ef9-ae05-4eac-b530-da89c65fd367", "bridge": "br-int", "label": "tempest-device-tagging-net2-314948697", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "641f0acd05d8403882a4f6b1b28e9269", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap710ae079-0b", "ovs_interfaceid": "710ae079-0b1c-4c04-bea2-e34fd0d554ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 09:33:57 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] Converting VIF {"id": "710ae079-0b1c-4c04-bea2-e34fd0d554ae", "address": "fa:16:3e:0e:e7:01", "network": {"id": "b4709ef9-ae05-4eac-b530-da89c65fd367", "bridge": "br-int", "label": "tempest-device-tagging-net2-314948697", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "641f0acd05d8403882a4f6b1b28e9269", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap710ae079-0b", "ovs_interfaceid": "710ae079-0b1c-4c04-bea2-e34fd0d554ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 09:33:57 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:e7:01,bridge_name='br-int',has_traffic_filtering=True,id=710ae079-0b1c-4c04-bea2-e34fd0d554ae,network=Network(b4709ef9-ae05-4eac-b530-da89c65fd367),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap710ae079-0b') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 09:33:57 user nova-compute[75122]: DEBUG os_vif [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:e7:01,bridge_name='br-int',has_traffic_filtering=True,id=710ae079-0b1c-4c04-bea2-e34fd0d554ae,network=Network(b4709ef9-ae05-4eac-b530-da89c65fd367),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap710ae079-0b') {{(pid=75122) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 09:33:57 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:33:57 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:33:57 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 09:33:57 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:33:57 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9daeb7b8-cc6c-5ae5-a9bc-c4fd51087ffe', '_type': 'linux-noop'}}, row=False) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:33:57 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:33:57 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:33:57 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-5405ecad-f004-498f-a5df-a4c670409786 tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] Acquiring lock "d24a189e-2de9-404e-b281-224c150a5bbf" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:33:57 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-5405ecad-f004-498f-a5df-a4c670409786 tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] Lock "d24a189e-2de9-404e-b281-224c150a5bbf" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:33:57 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-5405ecad-f004-498f-a5df-a4c670409786 tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] Acquiring lock "d24a189e-2de9-404e-b281-224c150a5bbf-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:33:57 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-5405ecad-f004-498f-a5df-a4c670409786 tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] Lock "d24a189e-2de9-404e-b281-224c150a5bbf-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:33:57 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-5405ecad-f004-498f-a5df-a4c670409786 tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] Lock "d24a189e-2de9-404e-b281-224c150a5bbf-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:33:57 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:33:57 user nova-compute[75122]: INFO nova.compute.manager [None req-5405ecad-f004-498f-a5df-a4c670409786 tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] [instance: d24a189e-2de9-404e-b281-224c150a5bbf] Terminating instance
Nov 15 09:33:57 user nova-compute[75122]: DEBUG nova.compute.manager [None req-5405ecad-f004-498f-a5df-a4c670409786 tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] [instance: d24a189e-2de9-404e-b281-224c150a5bbf] Start destroying the instance on the hypervisor. {{(pid=75122) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 09:33:57 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:33:57 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap710ae079-0b, may_exist=True, interface_attrs={}) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:33:57 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap710ae079-0b, col_values=(('qos', UUID('5d434df5-38c0-4111-b83b-3013f5f89416')),), if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:33:57 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap710ae079-0b, col_values=(('external_ids', {'iface-id': '710ae079-0b1c-4c04-bea2-e34fd0d554ae', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0e:e7:01', 'vm-uuid': '742d64db-c555-4517-8ec9-cef02f09a6e0'}),), if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:33:57 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:33:57 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:33:57 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:33:57 user nova-compute[75122]: INFO os_vif [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:e7:01,bridge_name='br-int',has_traffic_filtering=True,id=710ae079-0b1c-4c04-bea2-e34fd0d554ae,network=Network(b4709ef9-ae05-4eac-b530-da89c65fd367),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap710ae079-0b')
Nov 15 09:33:57 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T09:33:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1558883839',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1558883839',id=11,image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKV5WTO3RU8mImKNvyy3587R+N7JwlT6Jf2J+MJbSqo4hAZxrSxF8W72MSyi+ySsoPdgOlsbcxF8VVQqPPlJi5ujN3wRt87bd8USGqJl/UXcMrJjLkiq2AkhQDDmymDtbg==',key_name='tempest-keypair-1749304277',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='641f0acd05d8403882a4f6b1b28e9269',ramdisk_id='',reservation_id='r-qck9bfvk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-238803034',owner_user_name='tempest-TaggedBootDevicesTest-238803034-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T09:33:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ba8869fcf4464284b52e2aaa41597bdd',uuid=742d64db-c555-4517-8ec9-cef02f09a6e0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d378cd7b-d582-4062-a714-d4456d71ba5f", "address": "fa:16:3e:e1:90:72", "network": {"id": "b4709ef9-ae05-4eac-b530-da89c65fd367", "bridge": "br-int", "label": "tempest-device-tagging-net2-314948697", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "641f0acd05d8403882a4f6b1b28e9269", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd378cd7b-d5", "ovs_interfaceid": "d378cd7b-d582-4062-a714-d4456d71ba5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 09:33:57 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] Converting VIF {"id": "d378cd7b-d582-4062-a714-d4456d71ba5f", "address": "fa:16:3e:e1:90:72", "network": {"id": "b4709ef9-ae05-4eac-b530-da89c65fd367", "bridge": "br-int", "label": "tempest-device-tagging-net2-314948697", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "641f0acd05d8403882a4f6b1b28e9269", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd378cd7b-d5", "ovs_interfaceid": "d378cd7b-d582-4062-a714-d4456d71ba5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 09:33:57 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:90:72,bridge_name='br-int',has_traffic_filtering=True,id=d378cd7b-d582-4062-a714-d4456d71ba5f,network=Network(b4709ef9-ae05-4eac-b530-da89c65fd367),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd378cd7b-d5') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 09:33:57 user nova-compute[75122]: DEBUG os_vif [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:90:72,bridge_name='br-int',has_traffic_filtering=True,id=d378cd7b-d582-4062-a714-d4456d71ba5f,network=Network(b4709ef9-ae05-4eac-b530-da89c65fd367),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd378cd7b-d5') {{(pid=75122) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 09:33:57 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:33:57 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:33:57 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 09:33:57 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:33:57 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6f62ee5c-585a-563c-b2df-4f93bedaf948', '_type': 'linux-noop'}}, row=False) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:33:57 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:33:57 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:33:57 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:33:57 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:33:57 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:33:57 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:33:57 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:33:57 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd378cd7b-d5, may_exist=True, interface_attrs={}) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:33:57 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd378cd7b-d5, col_values=(('qos', UUID('31b5e314-58fe-4dc1-8a79-f5736c985bea')),), if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:33:57 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd378cd7b-d5, col_values=(('external_ids', {'iface-id': 'd378cd7b-d582-4062-a714-d4456d71ba5f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e1:90:72', 'vm-uuid': '742d64db-c555-4517-8ec9-cef02f09a6e0'}),), if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:33:57 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:33:57 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:33:57 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:33:57 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:33:57 user nova-compute[75122]: INFO os_vif [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:90:72,bridge_name='br-int',has_traffic_filtering=True,id=d378cd7b-d582-4062-a714-d4456d71ba5f,network=Network(b4709ef9-ae05-4eac-b530-da89c65fd367),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd378cd7b-d5')
Nov 15 09:33:58 user nova-compute[75122]: DEBUG nova.compute.manager [req-ff323583-1773-43a2-a4a8-4de50faa70f0 req-b47d2fb8-bfa1-42c5-91e5-1fcfdcb90fb9 service nova] [instance: d24a189e-2de9-404e-b281-224c150a5bbf] Received event network-vif-unplugged-5439a285-9a24-4c8e-a9d0-4e7c773f9e60 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:33:58 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-ff323583-1773-43a2-a4a8-4de50faa70f0 req-b47d2fb8-bfa1-42c5-91e5-1fcfdcb90fb9 service nova] Acquiring lock "d24a189e-2de9-404e-b281-224c150a5bbf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:33:58 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-ff323583-1773-43a2-a4a8-4de50faa70f0 req-b47d2fb8-bfa1-42c5-91e5-1fcfdcb90fb9 service nova] Lock "d24a189e-2de9-404e-b281-224c150a5bbf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:33:58 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-ff323583-1773-43a2-a4a8-4de50faa70f0 req-b47d2fb8-bfa1-42c5-91e5-1fcfdcb90fb9 service nova] Lock "d24a189e-2de9-404e-b281-224c150a5bbf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:33:58 user nova-compute[75122]: DEBUG nova.compute.manager [req-ff323583-1773-43a2-a4a8-4de50faa70f0 req-b47d2fb8-bfa1-42c5-91e5-1fcfdcb90fb9 service nova] [instance: d24a189e-2de9-404e-b281-224c150a5bbf] No waiting events found dispatching network-vif-unplugged-5439a285-9a24-4c8e-a9d0-4e7c773f9e60 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:33:58 user nova-compute[75122]: DEBUG nova.compute.manager [req-ff323583-1773-43a2-a4a8-4de50faa70f0 req-b47d2fb8-bfa1-42c5-91e5-1fcfdcb90fb9 service nova] [instance: d24a189e-2de9-404e-b281-224c150a5bbf] Received event network-vif-unplugged-5439a285-9a24-4c8e-a9d0-4e7c773f9e60 for instance with task_state deleting. {{(pid=75122) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 09:33:58 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] No BDM found with device name hda, not building metadata. {{(pid=75122) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 09:33:58 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75122) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 09:33:58 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] No VIF found with MAC fa:16:3e:ec:cb:a9, not building metadata {{(pid=75122) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 09:33:58 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] No VIF found with MAC fa:16:3e:c9:4d:28, not building metadata {{(pid=75122) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 09:33:58 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] Using config drive
Nov 15 09:33:58 user nova-compute[75122]: INFO nova.virt.libvirt.driver [-] [instance: d24a189e-2de9-404e-b281-224c150a5bbf] Instance destroyed successfully.
Nov 15 09:33:58 user nova-compute[75122]: DEBUG nova.objects.instance [None req-5405ecad-f004-498f-a5df-a4c670409786 tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] Lazy-loading 'resources' on Instance uuid d24a189e-2de9-404e-b281-224c150a5bbf {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:33:58 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-5405ecad-f004-498f-a5df-a4c670409786 tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T09:30:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-109023246',display_name='tempest-TestVolumeSwap-server-109023246',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-109023246',id=6,image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPjVTLKp57X6oorWlUoavF2XMowkDqBXUpMMJ2lneVFHzF0SZygQDqW0l8RTdum5zUM8oBkAi/pdcjiyjyhsBVRhHsPo9kc6bVi2kAo27F+RdsXfEDR4KbXMJLn1mCjAMQ==',key_name='tempest-keypair-1858606583',keypairs=<?>,launch_index=0,launched_at=2023-11-15T09:30:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e0044b15c211422c8fe109af97ce4082',ramdisk_id='',reservation_id='r-gxgcihbz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-819573102',owner_user_name='tempest-TestVolumeSwap-819573102-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T09:30:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='015d0c9a02d247b9afec711822f2dc2d',uuid=d24a189e-2de9-404e-b281-224c150a5bbf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5439a285-9a24-4c8e-a9d0-4e7c773f9e60", "address": "fa:16:3e:bd:9c:6c", "network": {"id": "7c08103d-8c2a-4613-8c0b-e3ed4568332a", "bridge": "br-int", "label": "tempest-TestVolumeSwap-36009092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0044b15c211422c8fe109af97ce4082", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5439a285-9a", "ovs_interfaceid": "5439a285-9a24-4c8e-a9d0-4e7c773f9e60", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 09:33:58 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-5405ecad-f004-498f-a5df-a4c670409786 tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] Converting VIF {"id": "5439a285-9a24-4c8e-a9d0-4e7c773f9e60", "address": "fa:16:3e:bd:9c:6c", "network": {"id": "7c08103d-8c2a-4613-8c0b-e3ed4568332a", "bridge": "br-int", "label": "tempest-TestVolumeSwap-36009092-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.105", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0044b15c211422c8fe109af97ce4082", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5439a285-9a", "ovs_interfaceid": "5439a285-9a24-4c8e-a9d0-4e7c773f9e60", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 09:33:58 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-5405ecad-f004-498f-a5df-a4c670409786 tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bd:9c:6c,bridge_name='br-int',has_traffic_filtering=True,id=5439a285-9a24-4c8e-a9d0-4e7c773f9e60,network=Network(7c08103d-8c2a-4613-8c0b-e3ed4568332a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5439a285-9a') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 09:33:58 user nova-compute[75122]: DEBUG os_vif [None req-5405ecad-f004-498f-a5df-a4c670409786 tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bd:9c:6c,bridge_name='br-int',has_traffic_filtering=True,id=5439a285-9a24-4c8e-a9d0-4e7c773f9e60,network=Network(7c08103d-8c2a-4613-8c0b-e3ed4568332a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5439a285-9a') {{(pid=75122) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 09:33:58 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:33:58 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5439a285-9a, bridge=br-int, if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:33:58 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:33:58 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:33:58 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:33:58 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:33:58 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=15638ecf-f84d-45a1-9b10-837e0b83578c) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:33:58 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:33:58 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:33:58 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:33:58 user nova-compute[75122]: INFO os_vif [None req-5405ecad-f004-498f-a5df-a4c670409786 tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bd:9c:6c,bridge_name='br-int',has_traffic_filtering=True,id=5439a285-9a24-4c8e-a9d0-4e7c773f9e60,network=Network(7c08103d-8c2a-4613-8c0b-e3ed4568332a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5439a285-9a')
Nov 15 09:33:58 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-5405ecad-f004-498f-a5df-a4c670409786 tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] [instance: d24a189e-2de9-404e-b281-224c150a5bbf] Deleting instance files /opt/stack/data/nova/instances/d24a189e-2de9-404e-b281-224c150a5bbf_del
Nov 15 09:33:58 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-5405ecad-f004-498f-a5df-a4c670409786 tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] [instance: d24a189e-2de9-404e-b281-224c150a5bbf] Deletion of /opt/stack/data/nova/instances/d24a189e-2de9-404e-b281-224c150a5bbf_del complete
Nov 15 09:33:58 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] Creating config drive at /opt/stack/data/nova/instances/742d64db-c555-4517-8ec9-cef02f09a6e0/disk.config
Nov 15 09:33:58 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/742d64db-c555-4517-8ec9-cef02f09a6e0/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmparud4x1q {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:33:58 user nova-compute[75122]: INFO nova.compute.manager [None req-5405ecad-f004-498f-a5df-a4c670409786 tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] [instance: d24a189e-2de9-404e-b281-224c150a5bbf] Took 0.91 seconds to destroy the instance on the hypervisor.
Nov 15 09:33:58 user nova-compute[75122]: DEBUG oslo.service.loopingcall [None req-5405ecad-f004-498f-a5df-a4c670409786 tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75122) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 09:33:58 user nova-compute[75122]: DEBUG nova.compute.manager [-] [instance: d24a189e-2de9-404e-b281-224c150a5bbf] Deallocating network for instance {{(pid=75122) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 09:33:58 user nova-compute[75122]: DEBUG nova.network.neutron [-] [instance: d24a189e-2de9-404e-b281-224c150a5bbf] deallocate_for_instance() {{(pid=75122) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 09:33:58 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/742d64db-c555-4517-8ec9-cef02f09a6e0/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmparud4x1q" returned: 0 in 0.068s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:33:58 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-c91398e5-24c4-439b-b50e-733008fa4e25 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Acquiring lock "7cfd4155-c4b3-4cce-91e5-042cafccab8b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:33:58 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-c91398e5-24c4-439b-b50e-733008fa4e25 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Lock "7cfd4155-c4b3-4cce-91e5-042cafccab8b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:33:58 user nova-compute[75122]: DEBUG nova.compute.manager [None req-c91398e5-24c4-439b-b50e-733008fa4e25 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] [instance: 7cfd4155-c4b3-4cce-91e5-042cafccab8b] Starting instance... {{(pid=75122) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 09:33:59 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-c91398e5-24c4-439b-b50e-733008fa4e25 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:33:59 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-c91398e5-24c4-439b-b50e-733008fa4e25 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:33:59 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-c91398e5-24c4-439b-b50e-733008fa4e25 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75122) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 09:33:59 user nova-compute[75122]: INFO nova.compute.claims [None req-c91398e5-24c4-439b-b50e-733008fa4e25 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] [instance: 7cfd4155-c4b3-4cce-91e5-042cafccab8b] Claim successful on node user
Nov 15 09:33:59 user nova-compute[75122]: DEBUG nova.compute.provider_tree [None req-c91398e5-24c4-439b-b50e-733008fa4e25 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Inventory has not changed in ProviderTree for provider: 69a3da65-47be-44c6-b67c-c692b58284ef {{(pid=75122) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 09:33:59 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-c91398e5-24c4-439b-b50e-733008fa4e25 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Inventory has not changed for provider 69a3da65-47be-44c6-b67c-c692b58284ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 09:33:59 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-c91398e5-24c4-439b-b50e-733008fa4e25 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.348s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:33:59 user nova-compute[75122]: DEBUG nova.compute.manager [None req-c91398e5-24c4-439b-b50e-733008fa4e25 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] [instance: 7cfd4155-c4b3-4cce-91e5-042cafccab8b] Start building networks asynchronously for instance. {{(pid=75122) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 09:33:59 user nova-compute[75122]: DEBUG nova.compute.manager [None req-c91398e5-24c4-439b-b50e-733008fa4e25 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] [instance: 7cfd4155-c4b3-4cce-91e5-042cafccab8b] Allocating IP information in the background. {{(pid=75122) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 09:33:59 user nova-compute[75122]: DEBUG nova.network.neutron [None req-c91398e5-24c4-439b-b50e-733008fa4e25 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] [instance: 7cfd4155-c4b3-4cce-91e5-042cafccab8b] allocate_for_instance() {{(pid=75122) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 09:33:59 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-c91398e5-24c4-439b-b50e-733008fa4e25 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] [instance: 7cfd4155-c4b3-4cce-91e5-042cafccab8b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 09:33:59 user nova-compute[75122]: DEBUG nova.policy [None req-c91398e5-24c4-439b-b50e-733008fa4e25 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '91f1469b2c7c45d6ac27f2b64fd5cefe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8e67f8a66a4930be3fb65c397cbeb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75122) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 09:33:59 user nova-compute[75122]: DEBUG nova.compute.manager [None req-c91398e5-24c4-439b-b50e-733008fa4e25 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] [instance: 7cfd4155-c4b3-4cce-91e5-042cafccab8b] Start building block device mappings for instance. {{(pid=75122) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 09:33:59 user nova-compute[75122]: DEBUG nova.compute.manager [None req-c91398e5-24c4-439b-b50e-733008fa4e25 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] [instance: 7cfd4155-c4b3-4cce-91e5-042cafccab8b] Start spawning the instance on the hypervisor. {{(pid=75122) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 09:33:59 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-c91398e5-24c4-439b-b50e-733008fa4e25 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] [instance: 7cfd4155-c4b3-4cce-91e5-042cafccab8b] Creating instance directory {{(pid=75122) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 09:33:59 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-c91398e5-24c4-439b-b50e-733008fa4e25 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] [instance: 7cfd4155-c4b3-4cce-91e5-042cafccab8b] Creating image(s)
Nov 15 09:33:59 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-c91398e5-24c4-439b-b50e-733008fa4e25 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Acquiring lock "/opt/stack/data/nova/instances/7cfd4155-c4b3-4cce-91e5-042cafccab8b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:33:59 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-c91398e5-24c4-439b-b50e-733008fa4e25 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Lock "/opt/stack/data/nova/instances/7cfd4155-c4b3-4cce-91e5-042cafccab8b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:33:59 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-c91398e5-24c4-439b-b50e-733008fa4e25 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Lock "/opt/stack/data/nova/instances/7cfd4155-c4b3-4cce-91e5-042cafccab8b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:33:59 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-c91398e5-24c4-439b-b50e-733008fa4e25 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:33:59 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:34:00 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:34:00 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:34:00 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:34:00 user nova-compute[75122]: DEBUG nova.compute.manager [req-28c0196d-2a04-46ca-9fa5-c25ce6106028 req-10824d26-a4ff-40f4-abf8-dd9581b8979a service nova] [instance: d24a189e-2de9-404e-b281-224c150a5bbf] Received event network-vif-plugged-5439a285-9a24-4c8e-a9d0-4e7c773f9e60 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:34:00 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-28c0196d-2a04-46ca-9fa5-c25ce6106028 req-10824d26-a4ff-40f4-abf8-dd9581b8979a service nova] Acquiring lock "d24a189e-2de9-404e-b281-224c150a5bbf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:34:00 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-28c0196d-2a04-46ca-9fa5-c25ce6106028 req-10824d26-a4ff-40f4-abf8-dd9581b8979a service nova] Lock "d24a189e-2de9-404e-b281-224c150a5bbf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:34:00 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-28c0196d-2a04-46ca-9fa5-c25ce6106028 req-10824d26-a4ff-40f4-abf8-dd9581b8979a service nova] Lock "d24a189e-2de9-404e-b281-224c150a5bbf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:34:00 user nova-compute[75122]: DEBUG nova.compute.manager [req-28c0196d-2a04-46ca-9fa5-c25ce6106028 req-10824d26-a4ff-40f4-abf8-dd9581b8979a service nova] [instance: d24a189e-2de9-404e-b281-224c150a5bbf] No waiting events found dispatching network-vif-plugged-5439a285-9a24-4c8e-a9d0-4e7c773f9e60 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:34:00 user nova-compute[75122]: WARNING nova.compute.manager [req-28c0196d-2a04-46ca-9fa5-c25ce6106028 req-10824d26-a4ff-40f4-abf8-dd9581b8979a service nova] [instance: d24a189e-2de9-404e-b281-224c150a5bbf] Received unexpected event network-vif-plugged-5439a285-9a24-4c8e-a9d0-4e7c773f9e60 for instance with vm_state active and task_state deleting.
Nov 15 09:34:00 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-c91398e5-24c4-439b-b50e-733008fa4e25 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json" returned: 0 in 0.194s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:34:00 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-c91398e5-24c4-439b-b50e-733008fa4e25 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Acquiring lock "95d6e29f74d5408f818e32f3bc29bc8270a4c665" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:34:00 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-c91398e5-24c4-439b-b50e-733008fa4e25 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Lock "95d6e29f74d5408f818e32f3bc29bc8270a4c665" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:34:00 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-c91398e5-24c4-439b-b50e-733008fa4e25 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:34:00 user nova-compute[75122]: DEBUG nova.network.neutron [-] [instance: d24a189e-2de9-404e-b281-224c150a5bbf] Updating instance_info_cache with network_info: [] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:34:00 user nova-compute[75122]: INFO nova.compute.manager [-] [instance: d24a189e-2de9-404e-b281-224c150a5bbf] Took 1.85 seconds to deallocate network for instance.
Nov 15 09:34:00 user nova-compute[75122]: DEBUG nova.compute.manager [req-28d270ec-74da-4847-9418-56c75cabc191 req-f7d7b135-be42-4359-8dab-a2747dfd5ffd service nova] [instance: d24a189e-2de9-404e-b281-224c150a5bbf] Received event network-vif-deleted-5439a285-9a24-4c8e-a9d0-4e7c773f9e60 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:34:00 user nova-compute[75122]: INFO nova.compute.manager [req-28d270ec-74da-4847-9418-56c75cabc191 req-f7d7b135-be42-4359-8dab-a2747dfd5ffd service nova] [instance: d24a189e-2de9-404e-b281-224c150a5bbf] Neutron deleted interface 5439a285-9a24-4c8e-a9d0-4e7c773f9e60; detaching it from the instance and deleting it from the info cache
Nov 15 09:34:00 user nova-compute[75122]: DEBUG nova.network.neutron [req-28d270ec-74da-4847-9418-56c75cabc191 req-f7d7b135-be42-4359-8dab-a2747dfd5ffd service nova] [instance: d24a189e-2de9-404e-b281-224c150a5bbf] Updating instance_info_cache with network_info: [] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:34:00 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-c91398e5-24c4-439b-b50e-733008fa4e25 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json" returned: 0 in 0.224s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:34:00 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-c91398e5-24c4-439b-b50e-733008fa4e25 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665,backing_fmt=raw /opt/stack/data/nova/instances/7cfd4155-c4b3-4cce-91e5-042cafccab8b/disk 1073741824 {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:34:00 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:34:00 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-c91398e5-24c4-439b-b50e-733008fa4e25 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665,backing_fmt=raw /opt/stack/data/nova/instances/7cfd4155-c4b3-4cce-91e5-042cafccab8b/disk 1073741824" returned: 0 in 0.083s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:34:00 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-5405ecad-f004-498f-a5df-a4c670409786 tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:34:00 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-5405ecad-f004-498f-a5df-a4c670409786 tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:34:00 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-c91398e5-24c4-439b-b50e-733008fa4e25 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Lock "95d6e29f74d5408f818e32f3bc29bc8270a4c665" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.317s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:34:00 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-c91398e5-24c4-439b-b50e-733008fa4e25 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:34:00 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-45057d87-b22d-4a18-bde4-81447e8d9c83 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] [instance: ee961d5a-e0d1-4931-9293-eefbe638097a] Calling os-brick to attach iSCSI Volume {{(pid=75122) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 09:34:00 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-45057d87-b22d-4a18-bde4-81447e8d9c83 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffa04060b80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BFRblrMm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 09:34:00 user nova-compute[75122]: WARNING os_brick.initiator.connectors.base [None req-45057d87-b22d-4a18-bde4-81447e8d9c83 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 09:34:00 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-45057d87-b22d-4a18-bde4-81447e8d9c83 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 09:34:00 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-45057d87-b22d-4a18-bde4-81447e8d9c83 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 09:34:00 user nova-compute[75122]: WARNING os_brick.initiator.connectors.base [None req-45057d87-b22d-4a18-bde4-81447e8d9c83 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 09:34:00 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-45057d87-b22d-4a18-bde4-81447e8d9c83 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 09:34:00 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-45057d87-b22d-4a18-bde4-81447e8d9c83 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 09:34:00 user nova-compute[75122]: INFO os_brick.initiator.connectors.iscsi [None req-45057d87-b22d-4a18-bde4-81447e8d9c83 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 09:34:00 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16 -p 172.16.0.220:3260 {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:34:00 user nova-compute[75122]: DEBUG nova.compute.manager [req-28d270ec-74da-4847-9418-56c75cabc191 req-f7d7b135-be42-4359-8dab-a2747dfd5ffd service nova] [instance: d24a189e-2de9-404e-b281-224c150a5bbf] Detach interface failed, port_id=5439a285-9a24-4c8e-a9d0-4e7c773f9e60, reason: Instance d24a189e-2de9-404e-b281-224c150a5bbf could not be found. {{(pid=75122) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 09:34:00 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:34:00 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a46551a-f03b-4c0e-8aa3-321fcde32b1d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:34:00 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-45057d87-b22d-4a18-bde4-81447e8d9c83 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 09:34:00 user nova-compute[75122]:  {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:34:00 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16 -p 172.16.0.220:3260 --interface default --op new {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:34:00 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:34:00 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:34:00 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:34:00 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b6defff-2a51-4474-aede-3c3fa4bf1711]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16] added\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:34:00 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-45057d87-b22d-4a18-bde4-81447e8d9c83 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16] added
Nov 15 09:34:00 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:34:00 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:34:00 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:34:00 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d454830-d601-421c-9955-63df2f668056]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:34:00 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-45057d87-b22d-4a18-bde4-81447e8d9c83 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:34:00 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:34:00 user nova-compute[75122]: DEBUG nova.network.neutron [None req-c91398e5-24c4-439b-b50e-733008fa4e25 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] [instance: 7cfd4155-c4b3-4cce-91e5-042cafccab8b] Successfully created port: 3066e71b-c5d6-4e46-980c-2b0d42739f95 {{(pid=75122) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 09:34:00 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:34:00 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[e08ad8e3-a5ca-44fe-bd2d-6141f3b2333b]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:34:00 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-45057d87-b22d-4a18-bde4-81447e8d9c83 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:34:00 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BFRblrMm {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:34:00 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BFRblrMm" returned: 0 in 0.017s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:34:00 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd91076c-637f-456a-bac2-c94e0a7446a5]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:34:00 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-45057d87-b22d-4a18-bde4-81447e8d9c83 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BFRblrMm'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:34:00 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-c91398e5-24c4-439b-b50e-733008fa4e25 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json" returned: 0 in 0.206s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:34:00 user nova-compute[75122]: DEBUG nova.virt.disk.api [None req-c91398e5-24c4-439b-b50e-733008fa4e25 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7cfd4155-c4b3-4cce-91e5-042cafccab8b/disk. size=1073741824 {{(pid=75122) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 09:34:00 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-c91398e5-24c4-439b-b50e-733008fa4e25 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cfd4155-c4b3-4cce-91e5-042cafccab8b/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:34:00 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:34:00 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:34:00 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[e120d857-901d-453b-93ad-9ba8c07bc4a9]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:34:00 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-45057d87-b22d-4a18-bde4-81447e8d9c83 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:34:00 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:34:00 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:34:00 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:34:00 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:34:00 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[988f15e8-cf53-440f-89ac-fb1cb91bad27]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01563785-3767-460a-9815-c1bd0f7f6f9f (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bca4e77f-05f8-4ff6-8a78-6cef699f5667 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a8a33bb-713e-4109-8306-fe91fd67904f (non-flash)\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:34:00 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-45057d87-b22d-4a18-bde4-81447e8d9c83 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01563785-3767-460a-9815-c1bd0f7f6f9f (non-flash)
Nov 15 09:34:00 user nova-compute[75122]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bca4e77f-05f8-4ff6-8a78-6cef699f5667 (non-flash)
Nov 15 09:34:00 user nova-compute[75122]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a8a33bb-713e-4109-8306-fe91fd67904f (non-flash)
Nov 15 09:34:00 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 09:34:00 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-45057d87-b22d-4a18-bde4-81447e8d9c83 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01563785-3767-460a-9815-c1bd0f7f6f9f (non-flash)
Nov 15 09:34:00 user nova-compute[75122]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bca4e77f-05f8-4ff6-8a78-6cef699f5667 (non-flash)
Nov 15 09:34:00 user nova-compute[75122]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a8a33bb-713e-4109-8306-fe91fd67904f (non-flash)
Nov 15 09:34:00 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 09:34:00 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16 -p 172.16.0.220:3260 --login {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:34:00 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:34:00 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:34:00 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[44dfcc03-83f0-43c6-aab5-f69de7b0473c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:34:00 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-45057d87-b22d-4a18-bde4-81447e8d9c83 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16, portal: 172.16.0.220,3260]
Nov 15 09:34:00 user nova-compute[75122]: Login to [iface: default, target: iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16, portal: 172.16.0.220,3260] successful.
Nov 15 09:34:00 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:34:00 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:34:00 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:34:00 user nova-compute[75122]: DEBUG nova.compute.provider_tree [None req-5405ecad-f004-498f-a5df-a4c670409786 tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] Inventory has not changed in ProviderTree for provider: 69a3da65-47be-44c6-b67c-c692b58284ef {{(pid=75122) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 09:34:00 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:34:00 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[835027ba-7e63-459d-a7c0-921c4fda390f]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:34:00 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-45057d87-b22d-4a18-bde4-81447e8d9c83 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:34:00 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:34:00 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-5405ecad-f004-498f-a5df-a4c670409786 tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] Inventory has not changed for provider 69a3da65-47be-44c6-b67c-c692b58284ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 09:34:00 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-c91398e5-24c4-439b-b50e-733008fa4e25 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cfd4155-c4b3-4cce-91e5-042cafccab8b/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:34:00 user nova-compute[75122]: DEBUG nova.virt.disk.api [None req-c91398e5-24c4-439b-b50e-733008fa4e25 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Cannot resize image /opt/stack/data/nova/instances/7cfd4155-c4b3-4cce-91e5-042cafccab8b/disk to a smaller size. {{(pid=75122) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 09:34:00 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-c91398e5-24c4-439b-b50e-733008fa4e25 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] [instance: 7cfd4155-c4b3-4cce-91e5-042cafccab8b] Created local disks {{(pid=75122) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 09:34:00 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-c91398e5-24c4-439b-b50e-733008fa4e25 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] [instance: 7cfd4155-c4b3-4cce-91e5-042cafccab8b] Ensure instance console log exists: /opt/stack/data/nova/instances/7cfd4155-c4b3-4cce-91e5-042cafccab8b/console.log {{(pid=75122) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 09:34:00 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-c91398e5-24c4-439b-b50e-733008fa4e25 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:34:00 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-c91398e5-24c4-439b-b50e-733008fa4e25 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:34:00 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-c91398e5-24c4-439b-b50e-733008fa4e25 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:34:00 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:34:00 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3283492-92e7-43ac-a92e-70befcfc1caa]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01563785-3767-460a-9815-c1bd0f7f6f9f (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bca4e77f-05f8-4ff6-8a78-6cef699f5667 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a8a33bb-713e-4109-8306-fe91fd67904f (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16 (non-flash)\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:34:00 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-45057d87-b22d-4a18-bde4-81447e8d9c83 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01563785-3767-460a-9815-c1bd0f7f6f9f (non-flash)
Nov 15 09:34:00 user nova-compute[75122]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bca4e77f-05f8-4ff6-8a78-6cef699f5667 (non-flash)
Nov 15 09:34:00 user nova-compute[75122]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a8a33bb-713e-4109-8306-fe91fd67904f (non-flash)
Nov 15 09:34:00 user nova-compute[75122]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16 (non-flash)
Nov 15 09:34:00 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 09:34:00 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-45057d87-b22d-4a18-bde4-81447e8d9c83 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01563785-3767-460a-9815-c1bd0f7f6f9f (non-flash)
Nov 15 09:34:00 user nova-compute[75122]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bca4e77f-05f8-4ff6-8a78-6cef699f5667 (non-flash)
Nov 15 09:34:00 user nova-compute[75122]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a8a33bb-713e-4109-8306-fe91fd67904f (non-flash)
Nov 15 09:34:00 user nova-compute[75122]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16 (non-flash)
Nov 15 09:34:00 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 09:34:00 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-45057d87-b22d-4a18-bde4-81447e8d9c83 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.393s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 09:34:00 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-45057d87-b22d-4a18-bde4-81447e8d9c83 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Connected to 172.16.0.220:3260 {{(pid=75122) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 09:34:00 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-45057d87-b22d-4a18-bde4-81447e8d9c83 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] HCTL ('36', '-', '-', 0) found on session 16 with lun 0 {{(pid=75122) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 09:34:00 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-45057d87-b22d-4a18-bde4-81447e8d9c83 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75122) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 09:34:00 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:34:00 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.021s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:34:00 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[e99b56c8-cf3a-4c40-a350-aeddb8eccb7d]: (4, ('- - 0', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:34:00 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-45057d87-b22d-4a18-bde4-81447e8d9c83 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Searching for a device in session 16 and hctl ['36', '*', '*', 0] yield: None {{(pid=75122) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 09:34:00 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-5405ecad-f004-498f-a5df-a4c670409786 tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.477s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:34:00 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:34:00 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:34:00 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:34:01 user nova-compute[75122]: INFO nova.scheduler.client.report [None req-5405ecad-f004-498f-a5df-a4c670409786 tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] Deleted allocations for instance d24a189e-2de9-404e-b281-224c150a5bbf
Nov 15 09:34:01 user nova-compute[75122]: DEBUG nova.compute.manager [req-8d845507-3937-45be-a247-99b1ccdfb0f0 req-c611f5c3-31bd-44c1-82f0-04c949f76bad service nova] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] Received event network-vif-plugged-d8bfb09a-3733-4176-beec-aaa512b4ed8c {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:34:01 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-8d845507-3937-45be-a247-99b1ccdfb0f0 req-c611f5c3-31bd-44c1-82f0-04c949f76bad service nova] Acquiring lock "742d64db-c555-4517-8ec9-cef02f09a6e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:34:01 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-8d845507-3937-45be-a247-99b1ccdfb0f0 req-c611f5c3-31bd-44c1-82f0-04c949f76bad service nova] Lock "742d64db-c555-4517-8ec9-cef02f09a6e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.009s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:34:01 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-8d845507-3937-45be-a247-99b1ccdfb0f0 req-c611f5c3-31bd-44c1-82f0-04c949f76bad service nova] Lock "742d64db-c555-4517-8ec9-cef02f09a6e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:34:01 user nova-compute[75122]: DEBUG nova.compute.manager [req-8d845507-3937-45be-a247-99b1ccdfb0f0 req-c611f5c3-31bd-44c1-82f0-04c949f76bad service nova] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] No waiting events found dispatching network-vif-plugged-d8bfb09a-3733-4176-beec-aaa512b4ed8c {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:34:01 user nova-compute[75122]: WARNING nova.compute.manager [req-8d845507-3937-45be-a247-99b1ccdfb0f0 req-c611f5c3-31bd-44c1-82f0-04c949f76bad service nova] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] Received unexpected event network-vif-plugged-d8bfb09a-3733-4176-beec-aaa512b4ed8c for instance with vm_state building and task_state spawning.
Nov 15 09:34:01 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:34:01 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:34:01 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-5405ecad-f004-498f-a5df-a4c670409786 tempest-TestVolumeSwap-819573102 tempest-TestVolumeSwap-819573102-project-member] Lock "d24a189e-2de9-404e-b281-224c150a5bbf" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.608s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:34:01 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:34:01 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:34:01 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:34:01 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:34:01 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:34:01 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:34:01 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:34:01 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:34:01 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:34:01 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:34:01 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:34:01 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:34:01 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:34:01 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-45057d87-b22d-4a18-bde4-81447e8d9c83 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Searching for a device in session 16 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75122) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 09:34:01 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-45057d87-b22d-4a18-bde4-81447e8d9c83 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BFRblrMm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75122) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 09:34:01 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-45057d87-b22d-4a18-bde4-81447e8d9c83 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.429s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 09:34:01 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-45057d87-b22d-4a18-bde4-81447e8d9c83 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] <== connect_volume: return (1431ms) {'type': 'block', 'scsi_wwn': '23231356562353037', 'path': '/dev/sde'} {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 09:34:01 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-45057d87-b22d-4a18-bde4-81447e8d9c83 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] [instance: ee961d5a-e0d1-4931-9293-eefbe638097a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23231356562353037', 'path': '/dev/sde'} {{(pid=75122) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 09:34:01 user nova-compute[75122]: DEBUG nova.objects.instance [None req-45057d87-b22d-4a18-bde4-81447e8d9c83 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Lazy-loading 'flavor' on Instance uuid ee961d5a-e0d1-4931-9293-eefbe638097a {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:34:01 user nova-compute[75122]: DEBUG nova.virt.libvirt.guest [None req-45057d87-b22d-4a18-bde4-81447e8d9c83 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 09:34:01 user nova-compute[75122]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 09:34:01 user nova-compute[75122]:   <source dev="/dev/sde"/>
Nov 15 09:34:01 user nova-compute[75122]:   <target dev="vdb" bus="virtio"/>
Nov 15 09:34:01 user nova-compute[75122]:   <serial>2cd51ed3-2703-4b02-aa7c-ddb113161a16</serial>
Nov 15 09:34:01 user nova-compute[75122]: </disk>
Nov 15 09:34:01 user nova-compute[75122]:  {{(pid=75122) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 09:34:02 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:34:02 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:34:02 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:34:02 user nova-compute[75122]: DEBUG nova.compute.manager [req-cd845509-f17b-492e-93b7-dd4ab39e394f req-ffe9c9bd-9d60-4617-9b5b-47596959a672 service nova] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] Received event network-vif-plugged-5ebcafd9-6939-4928-ae2f-38ec38e15876 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:34:02 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-cd845509-f17b-492e-93b7-dd4ab39e394f req-ffe9c9bd-9d60-4617-9b5b-47596959a672 service nova] Acquiring lock "742d64db-c555-4517-8ec9-cef02f09a6e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:34:02 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-cd845509-f17b-492e-93b7-dd4ab39e394f req-ffe9c9bd-9d60-4617-9b5b-47596959a672 service nova] Lock "742d64db-c555-4517-8ec9-cef02f09a6e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:34:02 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-cd845509-f17b-492e-93b7-dd4ab39e394f req-ffe9c9bd-9d60-4617-9b5b-47596959a672 service nova] Lock "742d64db-c555-4517-8ec9-cef02f09a6e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:34:02 user nova-compute[75122]: DEBUG nova.compute.manager [req-cd845509-f17b-492e-93b7-dd4ab39e394f req-ffe9c9bd-9d60-4617-9b5b-47596959a672 service nova] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] No waiting events found dispatching network-vif-plugged-5ebcafd9-6939-4928-ae2f-38ec38e15876 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:34:02 user nova-compute[75122]: WARNING nova.compute.manager [req-cd845509-f17b-492e-93b7-dd4ab39e394f req-ffe9c9bd-9d60-4617-9b5b-47596959a672 service nova] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] Received unexpected event network-vif-plugged-5ebcafd9-6939-4928-ae2f-38ec38e15876 for instance with vm_state building and task_state spawning.
Nov 15 09:34:02 user nova-compute[75122]: DEBUG nova.compute.manager [req-cd845509-f17b-492e-93b7-dd4ab39e394f req-ffe9c9bd-9d60-4617-9b5b-47596959a672 service nova] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] Received event network-vif-plugged-5ebcafd9-6939-4928-ae2f-38ec38e15876 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:34:02 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-cd845509-f17b-492e-93b7-dd4ab39e394f req-ffe9c9bd-9d60-4617-9b5b-47596959a672 service nova] Acquiring lock "742d64db-c555-4517-8ec9-cef02f09a6e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:34:02 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-cd845509-f17b-492e-93b7-dd4ab39e394f req-ffe9c9bd-9d60-4617-9b5b-47596959a672 service nova] Lock "742d64db-c555-4517-8ec9-cef02f09a6e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:34:02 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-cd845509-f17b-492e-93b7-dd4ab39e394f req-ffe9c9bd-9d60-4617-9b5b-47596959a672 service nova] Lock "742d64db-c555-4517-8ec9-cef02f09a6e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:34:02 user nova-compute[75122]: DEBUG nova.compute.manager [req-cd845509-f17b-492e-93b7-dd4ab39e394f req-ffe9c9bd-9d60-4617-9b5b-47596959a672 service nova] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] No waiting events found dispatching network-vif-plugged-5ebcafd9-6939-4928-ae2f-38ec38e15876 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:34:02 user nova-compute[75122]: WARNING nova.compute.manager [req-cd845509-f17b-492e-93b7-dd4ab39e394f req-ffe9c9bd-9d60-4617-9b5b-47596959a672 service nova] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] Received unexpected event network-vif-plugged-5ebcafd9-6939-4928-ae2f-38ec38e15876 for instance with vm_state building and task_state spawning.
Nov 15 09:34:02 user nova-compute[75122]: DEBUG nova.compute.manager [req-cd845509-f17b-492e-93b7-dd4ab39e394f req-ffe9c9bd-9d60-4617-9b5b-47596959a672 service nova] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] Received event network-vif-plugged-5bf17322-fd6b-4335-9a8e-56e7cd64e180 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:34:02 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-cd845509-f17b-492e-93b7-dd4ab39e394f req-ffe9c9bd-9d60-4617-9b5b-47596959a672 service nova] Acquiring lock "742d64db-c555-4517-8ec9-cef02f09a6e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:34:02 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-cd845509-f17b-492e-93b7-dd4ab39e394f req-ffe9c9bd-9d60-4617-9b5b-47596959a672 service nova] Lock "742d64db-c555-4517-8ec9-cef02f09a6e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:34:02 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-cd845509-f17b-492e-93b7-dd4ab39e394f req-ffe9c9bd-9d60-4617-9b5b-47596959a672 service nova] Lock "742d64db-c555-4517-8ec9-cef02f09a6e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:34:02 user nova-compute[75122]: DEBUG nova.compute.manager [req-cd845509-f17b-492e-93b7-dd4ab39e394f req-ffe9c9bd-9d60-4617-9b5b-47596959a672 service nova] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] No waiting events found dispatching network-vif-plugged-5bf17322-fd6b-4335-9a8e-56e7cd64e180 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:34:02 user nova-compute[75122]: WARNING nova.compute.manager [req-cd845509-f17b-492e-93b7-dd4ab39e394f req-ffe9c9bd-9d60-4617-9b5b-47596959a672 service nova] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] Received unexpected event network-vif-plugged-5bf17322-fd6b-4335-9a8e-56e7cd64e180 for instance with vm_state building and task_state spawning.
Nov 15 09:34:02 user nova-compute[75122]: DEBUG nova.compute.manager [req-cd845509-f17b-492e-93b7-dd4ab39e394f req-ffe9c9bd-9d60-4617-9b5b-47596959a672 service nova] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] Received event network-vif-plugged-5bf17322-fd6b-4335-9a8e-56e7cd64e180 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:34:02 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-cd845509-f17b-492e-93b7-dd4ab39e394f req-ffe9c9bd-9d60-4617-9b5b-47596959a672 service nova] Acquiring lock "742d64db-c555-4517-8ec9-cef02f09a6e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:34:02 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-cd845509-f17b-492e-93b7-dd4ab39e394f req-ffe9c9bd-9d60-4617-9b5b-47596959a672 service nova] Lock "742d64db-c555-4517-8ec9-cef02f09a6e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:34:02 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-cd845509-f17b-492e-93b7-dd4ab39e394f req-ffe9c9bd-9d60-4617-9b5b-47596959a672 service nova] Lock "742d64db-c555-4517-8ec9-cef02f09a6e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:34:02 user nova-compute[75122]: DEBUG nova.compute.manager [req-cd845509-f17b-492e-93b7-dd4ab39e394f req-ffe9c9bd-9d60-4617-9b5b-47596959a672 service nova] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] No waiting events found dispatching network-vif-plugged-5bf17322-fd6b-4335-9a8e-56e7cd64e180 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:34:02 user nova-compute[75122]: WARNING nova.compute.manager [req-cd845509-f17b-492e-93b7-dd4ab39e394f req-ffe9c9bd-9d60-4617-9b5b-47596959a672 service nova] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] Received unexpected event network-vif-plugged-5bf17322-fd6b-4335-9a8e-56e7cd64e180 for instance with vm_state building and task_state spawning.
Nov 15 09:34:02 user nova-compute[75122]: DEBUG nova.compute.manager [req-6e3f2341-5f30-4f45-9828-9fedddbce01b req-a11b0f85-1595-4268-b45c-5ed3cdbdf127 service nova] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] Received event network-vif-plugged-7febe2f1-4891-4ad4-ac59-58edfd3d2f03 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:34:02 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-6e3f2341-5f30-4f45-9828-9fedddbce01b req-a11b0f85-1595-4268-b45c-5ed3cdbdf127 service nova] Acquiring lock "742d64db-c555-4517-8ec9-cef02f09a6e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:34:02 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-6e3f2341-5f30-4f45-9828-9fedddbce01b req-a11b0f85-1595-4268-b45c-5ed3cdbdf127 service nova] Lock "742d64db-c555-4517-8ec9-cef02f09a6e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:34:02 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-6e3f2341-5f30-4f45-9828-9fedddbce01b req-a11b0f85-1595-4268-b45c-5ed3cdbdf127 service nova] Lock "742d64db-c555-4517-8ec9-cef02f09a6e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:34:02 user nova-compute[75122]: DEBUG nova.compute.manager [req-6e3f2341-5f30-4f45-9828-9fedddbce01b req-a11b0f85-1595-4268-b45c-5ed3cdbdf127 service nova] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] No waiting events found dispatching network-vif-plugged-7febe2f1-4891-4ad4-ac59-58edfd3d2f03 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:34:02 user nova-compute[75122]: WARNING nova.compute.manager [req-6e3f2341-5f30-4f45-9828-9fedddbce01b req-a11b0f85-1595-4268-b45c-5ed3cdbdf127 service nova] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] Received unexpected event network-vif-plugged-7febe2f1-4891-4ad4-ac59-58edfd3d2f03 for instance with vm_state building and task_state spawning.
Nov 15 09:34:02 user nova-compute[75122]: DEBUG nova.compute.manager [req-6e3f2341-5f30-4f45-9828-9fedddbce01b req-a11b0f85-1595-4268-b45c-5ed3cdbdf127 service nova] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] Received event network-vif-plugged-7febe2f1-4891-4ad4-ac59-58edfd3d2f03 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:34:02 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-6e3f2341-5f30-4f45-9828-9fedddbce01b req-a11b0f85-1595-4268-b45c-5ed3cdbdf127 service nova] Acquiring lock "742d64db-c555-4517-8ec9-cef02f09a6e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:34:02 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-6e3f2341-5f30-4f45-9828-9fedddbce01b req-a11b0f85-1595-4268-b45c-5ed3cdbdf127 service nova] Lock "742d64db-c555-4517-8ec9-cef02f09a6e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:34:02 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-6e3f2341-5f30-4f45-9828-9fedddbce01b req-a11b0f85-1595-4268-b45c-5ed3cdbdf127 service nova] Lock "742d64db-c555-4517-8ec9-cef02f09a6e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:34:02 user nova-compute[75122]: DEBUG nova.compute.manager [req-6e3f2341-5f30-4f45-9828-9fedddbce01b req-a11b0f85-1595-4268-b45c-5ed3cdbdf127 service nova] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] No waiting events found dispatching network-vif-plugged-7febe2f1-4891-4ad4-ac59-58edfd3d2f03 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:34:02 user nova-compute[75122]: WARNING nova.compute.manager [req-6e3f2341-5f30-4f45-9828-9fedddbce01b req-a11b0f85-1595-4268-b45c-5ed3cdbdf127 service nova] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] Received unexpected event network-vif-plugged-7febe2f1-4891-4ad4-ac59-58edfd3d2f03 for instance with vm_state building and task_state spawning.
Nov 15 09:34:02 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:34:02 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-45057d87-b22d-4a18-bde4-81447e8d9c83 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] No BDM found with device name vda, not building metadata. {{(pid=75122) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 09:34:02 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-45057d87-b22d-4a18-bde4-81447e8d9c83 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75122) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 09:34:02 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-45057d87-b22d-4a18-bde4-81447e8d9c83 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] No VIF found with MAC fa:16:3e:7d:98:85, not building metadata {{(pid=75122) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 09:34:02 user nova-compute[75122]: DEBUG nova.network.neutron [None req-c91398e5-24c4-439b-b50e-733008fa4e25 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] [instance: 7cfd4155-c4b3-4cce-91e5-042cafccab8b] Successfully updated port: 3066e71b-c5d6-4e46-980c-2b0d42739f95 {{(pid=75122) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 09:34:02 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-c91398e5-24c4-439b-b50e-733008fa4e25 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Acquiring lock "refresh_cache-7cfd4155-c4b3-4cce-91e5-042cafccab8b" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 09:34:02 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-c91398e5-24c4-439b-b50e-733008fa4e25 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Acquired lock "refresh_cache-7cfd4155-c4b3-4cce-91e5-042cafccab8b" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 09:34:02 user nova-compute[75122]: DEBUG nova.network.neutron [None req-c91398e5-24c4-439b-b50e-733008fa4e25 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] [instance: 7cfd4155-c4b3-4cce-91e5-042cafccab8b] Building network info cache for instance {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 09:34:02 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-45057d87-b22d-4a18-bde4-81447e8d9c83 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Lock "ee961d5a-e0d1-4931-9293-eefbe638097a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.521s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:34:02 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:34:02 user nova-compute[75122]: DEBUG nova.network.neutron [None req-c91398e5-24c4-439b-b50e-733008fa4e25 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] [instance: 7cfd4155-c4b3-4cce-91e5-042cafccab8b] Instance cache missing network info. {{(pid=75122) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 09:34:02 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:34:03 user nova-compute[75122]: DEBUG nova.compute.manager [req-5324c6d5-9818-40cd-8644-441692dac26b req-4f0af53f-06e9-415a-bfbb-29a5226abeaa service nova] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] Received event network-vif-plugged-d8bfb09a-3733-4176-beec-aaa512b4ed8c {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:34:03 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-5324c6d5-9818-40cd-8644-441692dac26b req-4f0af53f-06e9-415a-bfbb-29a5226abeaa service nova] Acquiring lock "742d64db-c555-4517-8ec9-cef02f09a6e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:34:03 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-5324c6d5-9818-40cd-8644-441692dac26b req-4f0af53f-06e9-415a-bfbb-29a5226abeaa service nova] Lock "742d64db-c555-4517-8ec9-cef02f09a6e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:34:03 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-5324c6d5-9818-40cd-8644-441692dac26b req-4f0af53f-06e9-415a-bfbb-29a5226abeaa service nova] Lock "742d64db-c555-4517-8ec9-cef02f09a6e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:34:03 user nova-compute[75122]: DEBUG nova.compute.manager [req-5324c6d5-9818-40cd-8644-441692dac26b req-4f0af53f-06e9-415a-bfbb-29a5226abeaa service nova] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] No waiting events found dispatching network-vif-plugged-d8bfb09a-3733-4176-beec-aaa512b4ed8c {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:34:03 user nova-compute[75122]: WARNING nova.compute.manager [req-5324c6d5-9818-40cd-8644-441692dac26b req-4f0af53f-06e9-415a-bfbb-29a5226abeaa service nova] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] Received unexpected event network-vif-plugged-d8bfb09a-3733-4176-beec-aaa512b4ed8c for instance with vm_state building and task_state spawning.
Nov 15 09:34:03 user nova-compute[75122]: DEBUG nova.compute.manager [req-5324c6d5-9818-40cd-8644-441692dac26b req-4f0af53f-06e9-415a-bfbb-29a5226abeaa service nova] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] Received event network-vif-plugged-d378cd7b-d582-4062-a714-d4456d71ba5f {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:34:03 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-5324c6d5-9818-40cd-8644-441692dac26b req-4f0af53f-06e9-415a-bfbb-29a5226abeaa service nova] Acquiring lock "742d64db-c555-4517-8ec9-cef02f09a6e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:34:03 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-5324c6d5-9818-40cd-8644-441692dac26b req-4f0af53f-06e9-415a-bfbb-29a5226abeaa service nova] Lock "742d64db-c555-4517-8ec9-cef02f09a6e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:34:03 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-5324c6d5-9818-40cd-8644-441692dac26b req-4f0af53f-06e9-415a-bfbb-29a5226abeaa service nova] Lock "742d64db-c555-4517-8ec9-cef02f09a6e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:34:03 user nova-compute[75122]: DEBUG nova.compute.manager [req-5324c6d5-9818-40cd-8644-441692dac26b req-4f0af53f-06e9-415a-bfbb-29a5226abeaa service nova] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] No waiting events found dispatching network-vif-plugged-d378cd7b-d582-4062-a714-d4456d71ba5f {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:34:03 user nova-compute[75122]: WARNING nova.compute.manager [req-5324c6d5-9818-40cd-8644-441692dac26b req-4f0af53f-06e9-415a-bfbb-29a5226abeaa service nova] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] Received unexpected event network-vif-plugged-d378cd7b-d582-4062-a714-d4456d71ba5f for instance with vm_state building and task_state spawning.
Nov 15 09:34:03 user nova-compute[75122]: DEBUG nova.compute.manager [req-5324c6d5-9818-40cd-8644-441692dac26b req-4f0af53f-06e9-415a-bfbb-29a5226abeaa service nova] [instance: 7cfd4155-c4b3-4cce-91e5-042cafccab8b] Received event network-changed-3066e71b-c5d6-4e46-980c-2b0d42739f95 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:34:03 user nova-compute[75122]: DEBUG nova.compute.manager [req-5324c6d5-9818-40cd-8644-441692dac26b req-4f0af53f-06e9-415a-bfbb-29a5226abeaa service nova] [instance: 7cfd4155-c4b3-4cce-91e5-042cafccab8b] Refreshing instance network info cache due to event network-changed-3066e71b-c5d6-4e46-980c-2b0d42739f95. {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 09:34:03 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-5324c6d5-9818-40cd-8644-441692dac26b req-4f0af53f-06e9-415a-bfbb-29a5226abeaa service nova] Acquiring lock "refresh_cache-7cfd4155-c4b3-4cce-91e5-042cafccab8b" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 09:34:03 user nova-compute[75122]: DEBUG nova.network.neutron [None req-c91398e5-24c4-439b-b50e-733008fa4e25 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] [instance: 7cfd4155-c4b3-4cce-91e5-042cafccab8b] Updating instance_info_cache with network_info: [{"id": "3066e71b-c5d6-4e46-980c-2b0d42739f95", "address": "fa:16:3e:e1:ad:0f", "network": {"id": "6e846655-a6f8-4339-a239-65d2f94c8b74", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1923452032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b8e67f8a66a4930be3fb65c397cbeb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3066e71b-c5", "ovs_interfaceid": "3066e71b-c5d6-4e46-980c-2b0d42739f95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:34:03 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-c91398e5-24c4-439b-b50e-733008fa4e25 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Releasing lock "refresh_cache-7cfd4155-c4b3-4cce-91e5-042cafccab8b" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 09:34:03 user nova-compute[75122]: DEBUG nova.compute.manager [None req-c91398e5-24c4-439b-b50e-733008fa4e25 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] [instance: 7cfd4155-c4b3-4cce-91e5-042cafccab8b] Instance network_info: |[{"id": "3066e71b-c5d6-4e46-980c-2b0d42739f95", "address": "fa:16:3e:e1:ad:0f", "network": {"id": "6e846655-a6f8-4339-a239-65d2f94c8b74", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1923452032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b8e67f8a66a4930be3fb65c397cbeb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3066e71b-c5", "ovs_interfaceid": "3066e71b-c5d6-4e46-980c-2b0d42739f95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75122) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 09:34:03 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-5324c6d5-9818-40cd-8644-441692dac26b req-4f0af53f-06e9-415a-bfbb-29a5226abeaa service nova] Acquired lock "refresh_cache-7cfd4155-c4b3-4cce-91e5-042cafccab8b" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 09:34:03 user nova-compute[75122]: DEBUG nova.network.neutron [req-5324c6d5-9818-40cd-8644-441692dac26b req-4f0af53f-06e9-415a-bfbb-29a5226abeaa service nova] [instance: 7cfd4155-c4b3-4cce-91e5-042cafccab8b] Refreshing network info cache for port 3066e71b-c5d6-4e46-980c-2b0d42739f95 {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 09:34:03 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-c91398e5-24c4-439b-b50e-733008fa4e25 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] [instance: 7cfd4155-c4b3-4cce-91e5-042cafccab8b] Start _get_guest_xml network_info=[{"id": "3066e71b-c5d6-4e46-980c-2b0d42739f95", "address": "fa:16:3e:e1:ad:0f", "network": {"id": "6e846655-a6f8-4339-a239-65d2f94c8b74", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1923452032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b8e67f8a66a4930be3fb65c397cbeb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3066e71b-c5", "ovs_interfaceid": "3066e71b-c5d6-4e46-980c-2b0d42739f95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T09:26:31Z,direct_url=<?>,disk_format='qcow2',id=5e862cfe-47b8-4725-8292-65761ee6d0f5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9c57733cb41847c0b4ad31519c382e5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T09:26:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '5e862cfe-47b8-4725-8292-65761ee6d0f5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75122) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 09:34:03 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:34:03 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-c91398e5-24c4-439b-b50e-733008fa4e25 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 09:34:03 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-c91398e5-24c4-439b-b50e-733008fa4e25 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 09:34:03 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-c91398e5-24c4-439b-b50e-733008fa4e25 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75122) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 09:34:03 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-c91398e5-24c4-439b-b50e-733008fa4e25 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] CPU controller missing on host. {{(pid=75122) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 09:34:03 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-c91398e5-24c4-439b-b50e-733008fa4e25 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75122) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 09:34:03 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-c91398e5-24c4-439b-b50e-733008fa4e25 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] CPU controller found on host. {{(pid=75122) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 09:34:03 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-c91398e5-24c4-439b-b50e-733008fa4e25 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75122) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 09:34:03 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-c91398e5-24c4-439b-b50e-733008fa4e25 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T09:26:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T09:26:31Z,direct_url=<?>,disk_format='qcow2',id=5e862cfe-47b8-4725-8292-65761ee6d0f5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9c57733cb41847c0b4ad31519c382e5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T09:26:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 09:34:03 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-c91398e5-24c4-439b-b50e-733008fa4e25 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Flavor limits 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 09:34:03 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-c91398e5-24c4-439b-b50e-733008fa4e25 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Image limits 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 09:34:03 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-c91398e5-24c4-439b-b50e-733008fa4e25 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Flavor pref 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 09:34:03 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-c91398e5-24c4-439b-b50e-733008fa4e25 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Image pref 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 09:34:03 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-c91398e5-24c4-439b-b50e-733008fa4e25 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 09:34:03 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-c91398e5-24c4-439b-b50e-733008fa4e25 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 09:34:03 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-c91398e5-24c4-439b-b50e-733008fa4e25 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75122) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 09:34:03 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-c91398e5-24c4-439b-b50e-733008fa4e25 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Got 1 possible topologies {{(pid=75122) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 09:34:03 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-c91398e5-24c4-439b-b50e-733008fa4e25 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 09:34:03 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-c91398e5-24c4-439b-b50e-733008fa4e25 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 09:34:03 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-c91398e5-24c4-439b-b50e-733008fa4e25 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T09:33:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-2104199903',display_name='tempest-tempest.common.compute-instance-2104199903',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-2104199903',id=12,image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBOX8YtQdU9q+dZR5u6ZMUFx1hvdm2NhRUpss/Fu1DkrrAdOur+Gu9G+pa6bDZCG5H+IwYYy1a89zeBb3vsgDOIvqoXhBd6Ue9N9chSVtmlWB+JfvhMU/87GmmYpdmALKw==',key_name='tempest-keypair-2121112573',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8b8e67f8a66a4930be3fb65c397cbeb2',ramdisk_id='',reservation_id='r-93cr0hj1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1521412552',owner_user_name='tempest-ServerActionsTestOtherA-1521412552-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T09:34:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='91f1469b2c7c45d6ac27f2b64fd5cefe',uuid=7cfd4155-c4b3-4cce-91e5-042cafccab8b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3066e71b-c5d6-4e46-980c-2b0d42739f95", "address": "fa:16:3e:e1:ad:0f", "network": {"id": "6e846655-a6f8-4339-a239-65d2f94c8b74", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1923452032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b8e67f8a66a4930be3fb65c397cbeb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3066e71b-c5", "ovs_interfaceid": "3066e71b-c5d6-4e46-980c-2b0d42739f95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75122) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 09:34:03 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-c91398e5-24c4-439b-b50e-733008fa4e25 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Converting VIF {"id": "3066e71b-c5d6-4e46-980c-2b0d42739f95", "address": "fa:16:3e:e1:ad:0f", "network": {"id": "6e846655-a6f8-4339-a239-65d2f94c8b74", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1923452032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b8e67f8a66a4930be3fb65c397cbeb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3066e71b-c5", "ovs_interfaceid": "3066e71b-c5d6-4e46-980c-2b0d42739f95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 09:34:03 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-c91398e5-24c4-439b-b50e-733008fa4e25 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:ad:0f,bridge_name='br-int',has_traffic_filtering=True,id=3066e71b-c5d6-4e46-980c-2b0d42739f95,network=Network(6e846655-a6f8-4339-a239-65d2f94c8b74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3066e71b-c5') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 09:34:03 user nova-compute[75122]: DEBUG nova.objects.instance [None req-c91398e5-24c4-439b-b50e-733008fa4e25 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Lazy-loading 'pci_devices' on Instance uuid 7cfd4155-c4b3-4cce-91e5-042cafccab8b {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:34:03 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-c91398e5-24c4-439b-b50e-733008fa4e25 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] [instance: 7cfd4155-c4b3-4cce-91e5-042cafccab8b] End _get_guest_xml xml=<domain type="kvm">
Nov 15 09:34:03 user nova-compute[75122]:   <uuid>7cfd4155-c4b3-4cce-91e5-042cafccab8b</uuid>
Nov 15 09:34:03 user nova-compute[75122]:   <name>instance-0000000c</name>
Nov 15 09:34:03 user nova-compute[75122]:   <memory>524288</memory>
Nov 15 09:34:03 user nova-compute[75122]:   <vcpu>1</vcpu>
Nov 15 09:34:03 user nova-compute[75122]:   <metadata>
Nov 15 09:34:03 user nova-compute[75122]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 09:34:03 user nova-compute[75122]:       <nova:package version="0.0.0"/>
Nov 15 09:34:03 user nova-compute[75122]:       <nova:name>tempest-tempest.common.compute-instance-2104199903</nova:name>
Nov 15 09:34:03 user nova-compute[75122]:       <nova:creationTime>2023-11-15 09:34:03</nova:creationTime>
Nov 15 09:34:03 user nova-compute[75122]:       <nova:flavor name="m1.tiny">
Nov 15 09:34:03 user nova-compute[75122]:         <nova:memory>512</nova:memory>
Nov 15 09:34:03 user nova-compute[75122]:         <nova:disk>1</nova:disk>
Nov 15 09:34:03 user nova-compute[75122]:         <nova:swap>0</nova:swap>
Nov 15 09:34:03 user nova-compute[75122]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 09:34:03 user nova-compute[75122]:         <nova:vcpus>1</nova:vcpus>
Nov 15 09:34:03 user nova-compute[75122]:       </nova:flavor>
Nov 15 09:34:03 user nova-compute[75122]:       <nova:owner>
Nov 15 09:34:03 user nova-compute[75122]:         <nova:user uuid="91f1469b2c7c45d6ac27f2b64fd5cefe">tempest-ServerActionsTestOtherA-1521412552-project-member</nova:user>
Nov 15 09:34:03 user nova-compute[75122]:         <nova:project uuid="8b8e67f8a66a4930be3fb65c397cbeb2">tempest-ServerActionsTestOtherA-1521412552</nova:project>
Nov 15 09:34:03 user nova-compute[75122]:       </nova:owner>
Nov 15 09:34:03 user nova-compute[75122]:       <nova:root type="image" uuid="5e862cfe-47b8-4725-8292-65761ee6d0f5"/>
Nov 15 09:34:03 user nova-compute[75122]:       <nova:ports>
Nov 15 09:34:03 user nova-compute[75122]:         <nova:port uuid="3066e71b-c5d6-4e46-980c-2b0d42739f95">
Nov 15 09:34:03 user nova-compute[75122]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 15 09:34:03 user nova-compute[75122]:         </nova:port>
Nov 15 09:34:03 user nova-compute[75122]:       </nova:ports>
Nov 15 09:34:03 user nova-compute[75122]:     </nova:instance>
Nov 15 09:34:03 user nova-compute[75122]:   </metadata>
Nov 15 09:34:03 user nova-compute[75122]:   <sysinfo type="smbios">
Nov 15 09:34:03 user nova-compute[75122]:     <system>
Nov 15 09:34:03 user nova-compute[75122]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 09:34:03 user nova-compute[75122]:       <entry name="product">OpenStack Nova</entry>
Nov 15 09:34:03 user nova-compute[75122]:       <entry name="version">0.0.0</entry>
Nov 15 09:34:03 user nova-compute[75122]:       <entry name="serial">7cfd4155-c4b3-4cce-91e5-042cafccab8b</entry>
Nov 15 09:34:03 user nova-compute[75122]:       <entry name="uuid">7cfd4155-c4b3-4cce-91e5-042cafccab8b</entry>
Nov 15 09:34:03 user nova-compute[75122]:       <entry name="family">Virtual Machine</entry>
Nov 15 09:34:03 user nova-compute[75122]:     </system>
Nov 15 09:34:03 user nova-compute[75122]:   </sysinfo>
Nov 15 09:34:03 user nova-compute[75122]:   <os>
Nov 15 09:34:03 user nova-compute[75122]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 09:34:03 user nova-compute[75122]:     <boot dev="hd"/>
Nov 15 09:34:03 user nova-compute[75122]:     <smbios mode="sysinfo"/>
Nov 15 09:34:03 user nova-compute[75122]:   </os>
Nov 15 09:34:03 user nova-compute[75122]:   <features>
Nov 15 09:34:03 user nova-compute[75122]:     <acpi/>
Nov 15 09:34:03 user nova-compute[75122]:     <apic/>
Nov 15 09:34:03 user nova-compute[75122]:     <vmcoreinfo/>
Nov 15 09:34:03 user nova-compute[75122]:   </features>
Nov 15 09:34:03 user nova-compute[75122]:   <clock offset="utc">
Nov 15 09:34:03 user nova-compute[75122]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 09:34:03 user nova-compute[75122]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 09:34:03 user nova-compute[75122]:     <timer name="hpet" present="no"/>
Nov 15 09:34:03 user nova-compute[75122]:   </clock>
Nov 15 09:34:03 user nova-compute[75122]:   <cpu mode="custom" match="exact">
Nov 15 09:34:03 user nova-compute[75122]:     <model>Nehalem</model>
Nov 15 09:34:03 user nova-compute[75122]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 09:34:03 user nova-compute[75122]:   </cpu>
Nov 15 09:34:03 user nova-compute[75122]:   <devices>
Nov 15 09:34:03 user nova-compute[75122]:     <disk type="file" device="disk">
Nov 15 09:34:03 user nova-compute[75122]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 09:34:03 user nova-compute[75122]:       <source file="/opt/stack/data/nova/instances/7cfd4155-c4b3-4cce-91e5-042cafccab8b/disk"/>
Nov 15 09:34:03 user nova-compute[75122]:       <target dev="vda" bus="virtio"/>
Nov 15 09:34:03 user nova-compute[75122]:     </disk>
Nov 15 09:34:03 user nova-compute[75122]:     <interface type="ethernet">
Nov 15 09:34:03 user nova-compute[75122]:       <mac address="fa:16:3e:e1:ad:0f"/>
Nov 15 09:34:03 user nova-compute[75122]:       <model type="virtio"/>
Nov 15 09:34:03 user nova-compute[75122]:       <mtu size="1442"/>
Nov 15 09:34:03 user nova-compute[75122]:       <target dev="tap3066e71b-c5"/>
Nov 15 09:34:03 user nova-compute[75122]:     </interface>
Nov 15 09:34:03 user nova-compute[75122]:     <serial type="pty">
Nov 15 09:34:03 user nova-compute[75122]:       <log file="/opt/stack/data/nova/instances/7cfd4155-c4b3-4cce-91e5-042cafccab8b/console.log" append="off"/>
Nov 15 09:34:03 user nova-compute[75122]:     </serial>
Nov 15 09:34:03 user nova-compute[75122]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 09:34:03 user nova-compute[75122]:     <video>
Nov 15 09:34:03 user nova-compute[75122]:       <model type="virtio"/>
Nov 15 09:34:03 user nova-compute[75122]:     </video>
Nov 15 09:34:03 user nova-compute[75122]:     <rng model="virtio">
Nov 15 09:34:03 user nova-compute[75122]:       <backend model="random">/dev/urandom</backend>
Nov 15 09:34:03 user nova-compute[75122]:     </rng>
Nov 15 09:34:03 user nova-compute[75122]:     <controller type="usb" index="0" model="none"/>
Nov 15 09:34:03 user nova-compute[75122]:     <memballoon model="virtio">
Nov 15 09:34:03 user nova-compute[75122]:       <stats period="10"/>
Nov 15 09:34:03 user nova-compute[75122]:     </memballoon>
Nov 15 09:34:03 user nova-compute[75122]:   </devices>
Nov 15 09:34:03 user nova-compute[75122]: </domain>
Nov 15 09:34:03 user nova-compute[75122]:  {{(pid=75122) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 09:34:03 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-c91398e5-24c4-439b-b50e-733008fa4e25 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T09:33:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-2104199903',display_name='tempest-tempest.common.compute-instance-2104199903',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-2104199903',id=12,image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBOX8YtQdU9q+dZR5u6ZMUFx1hvdm2NhRUpss/Fu1DkrrAdOur+Gu9G+pa6bDZCG5H+IwYYy1a89zeBb3vsgDOIvqoXhBd6Ue9N9chSVtmlWB+JfvhMU/87GmmYpdmALKw==',key_name='tempest-keypair-2121112573',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8b8e67f8a66a4930be3fb65c397cbeb2',ramdisk_id='',reservation_id='r-93cr0hj1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1521412552',owner_user_name='tempest-ServerActionsTestOtherA-1521412552-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T09:34:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='91f1469b2c7c45d6ac27f2b64fd5cefe',uuid=7cfd4155-c4b3-4cce-91e5-042cafccab8b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3066e71b-c5d6-4e46-980c-2b0d42739f95", "address": "fa:16:3e:e1:ad:0f", "network": {"id": "6e846655-a6f8-4339-a239-65d2f94c8b74", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1923452032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b8e67f8a66a4930be3fb65c397cbeb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3066e71b-c5", "ovs_interfaceid": "3066e71b-c5d6-4e46-980c-2b0d42739f95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 09:34:03 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-c91398e5-24c4-439b-b50e-733008fa4e25 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Converting VIF {"id": "3066e71b-c5d6-4e46-980c-2b0d42739f95", "address": "fa:16:3e:e1:ad:0f", "network": {"id": "6e846655-a6f8-4339-a239-65d2f94c8b74", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1923452032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b8e67f8a66a4930be3fb65c397cbeb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3066e71b-c5", "ovs_interfaceid": "3066e71b-c5d6-4e46-980c-2b0d42739f95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 09:34:03 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-c91398e5-24c4-439b-b50e-733008fa4e25 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:ad:0f,bridge_name='br-int',has_traffic_filtering=True,id=3066e71b-c5d6-4e46-980c-2b0d42739f95,network=Network(6e846655-a6f8-4339-a239-65d2f94c8b74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3066e71b-c5') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 09:34:03 user nova-compute[75122]: DEBUG os_vif [None req-c91398e5-24c4-439b-b50e-733008fa4e25 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:ad:0f,bridge_name='br-int',has_traffic_filtering=True,id=3066e71b-c5d6-4e46-980c-2b0d42739f95,network=Network(6e846655-a6f8-4339-a239-65d2f94c8b74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3066e71b-c5') {{(pid=75122) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 09:34:03 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:34:03 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:34:03 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 09:34:03 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:34:03 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c87afcb4-a520-5882-99c8-5a84eb17da0c', '_type': 'linux-noop'}}, row=False) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:34:03 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:34:03 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:34:03 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:34:03 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3066e71b-c5, may_exist=True, interface_attrs={}) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:34:03 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3066e71b-c5, col_values=(('qos', UUID('f1e5eb3b-a8bc-4485-9300-d2ba010676fb')),), if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:34:03 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3066e71b-c5, col_values=(('external_ids', {'iface-id': '3066e71b-c5d6-4e46-980c-2b0d42739f95', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e1:ad:0f', 'vm-uuid': '7cfd4155-c4b3-4cce-91e5-042cafccab8b'}),), if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:34:03 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:34:03 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:34:03 user nova-compute[75122]: INFO os_vif [None req-c91398e5-24c4-439b-b50e-733008fa4e25 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:ad:0f,bridge_name='br-int',has_traffic_filtering=True,id=3066e71b-c5d6-4e46-980c-2b0d42739f95,network=Network(6e846655-a6f8-4339-a239-65d2f94c8b74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3066e71b-c5')
Nov 15 09:34:03 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:34:03 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:34:03 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:34:03 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-c91398e5-24c4-439b-b50e-733008fa4e25 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] No BDM found with device name vda, not building metadata. {{(pid=75122) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 09:34:03 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-c91398e5-24c4-439b-b50e-733008fa4e25 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] No VIF found with MAC fa:16:3e:e1:ad:0f, not building metadata {{(pid=75122) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 09:34:03 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:34:03 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:34:03 user nova-compute[75122]: DEBUG nova.network.neutron [req-5324c6d5-9818-40cd-8644-441692dac26b req-4f0af53f-06e9-415a-bfbb-29a5226abeaa service nova] [instance: 7cfd4155-c4b3-4cce-91e5-042cafccab8b] Updated VIF entry in instance network info cache for port 3066e71b-c5d6-4e46-980c-2b0d42739f95. {{(pid=75122) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 09:34:03 user nova-compute[75122]: DEBUG nova.network.neutron [req-5324c6d5-9818-40cd-8644-441692dac26b req-4f0af53f-06e9-415a-bfbb-29a5226abeaa service nova] [instance: 7cfd4155-c4b3-4cce-91e5-042cafccab8b] Updating instance_info_cache with network_info: [{"id": "3066e71b-c5d6-4e46-980c-2b0d42739f95", "address": "fa:16:3e:e1:ad:0f", "network": {"id": "6e846655-a6f8-4339-a239-65d2f94c8b74", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1923452032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b8e67f8a66a4930be3fb65c397cbeb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3066e71b-c5", "ovs_interfaceid": "3066e71b-c5d6-4e46-980c-2b0d42739f95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:34:03 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-5324c6d5-9818-40cd-8644-441692dac26b req-4f0af53f-06e9-415a-bfbb-29a5226abeaa service nova] Releasing lock "refresh_cache-7cfd4155-c4b3-4cce-91e5-042cafccab8b" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 09:34:03 user nova-compute[75122]: DEBUG nova.compute.manager [req-5324c6d5-9818-40cd-8644-441692dac26b req-4f0af53f-06e9-415a-bfbb-29a5226abeaa service nova] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] Received event network-vif-plugged-d378cd7b-d582-4062-a714-d4456d71ba5f {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:34:03 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-5324c6d5-9818-40cd-8644-441692dac26b req-4f0af53f-06e9-415a-bfbb-29a5226abeaa service nova] Acquiring lock "742d64db-c555-4517-8ec9-cef02f09a6e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:34:03 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-5324c6d5-9818-40cd-8644-441692dac26b req-4f0af53f-06e9-415a-bfbb-29a5226abeaa service nova] Lock "742d64db-c555-4517-8ec9-cef02f09a6e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:34:03 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-5324c6d5-9818-40cd-8644-441692dac26b req-4f0af53f-06e9-415a-bfbb-29a5226abeaa service nova] Lock "742d64db-c555-4517-8ec9-cef02f09a6e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:34:03 user nova-compute[75122]: DEBUG nova.compute.manager [req-5324c6d5-9818-40cd-8644-441692dac26b req-4f0af53f-06e9-415a-bfbb-29a5226abeaa service nova] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] No waiting events found dispatching network-vif-plugged-d378cd7b-d582-4062-a714-d4456d71ba5f {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:34:03 user nova-compute[75122]: WARNING nova.compute.manager [req-5324c6d5-9818-40cd-8644-441692dac26b req-4f0af53f-06e9-415a-bfbb-29a5226abeaa service nova] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] Received unexpected event network-vif-plugged-d378cd7b-d582-4062-a714-d4456d71ba5f for instance with vm_state building and task_state spawning.
Nov 15 09:34:04 user nova-compute[75122]: DEBUG nova.compute.manager [req-5b947711-4ee6-4823-af52-371eddbe9260 req-ee47a908-eeb6-42f7-ae15-93f7615a9140 service nova] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] Received event network-vif-plugged-710ae079-0b1c-4c04-bea2-e34fd0d554ae {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:34:04 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-5b947711-4ee6-4823-af52-371eddbe9260 req-ee47a908-eeb6-42f7-ae15-93f7615a9140 service nova] Acquiring lock "742d64db-c555-4517-8ec9-cef02f09a6e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:34:04 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-5b947711-4ee6-4823-af52-371eddbe9260 req-ee47a908-eeb6-42f7-ae15-93f7615a9140 service nova] Lock "742d64db-c555-4517-8ec9-cef02f09a6e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:34:04 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-5b947711-4ee6-4823-af52-371eddbe9260 req-ee47a908-eeb6-42f7-ae15-93f7615a9140 service nova] Lock "742d64db-c555-4517-8ec9-cef02f09a6e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:34:04 user nova-compute[75122]: DEBUG nova.compute.manager [req-5b947711-4ee6-4823-af52-371eddbe9260 req-ee47a908-eeb6-42f7-ae15-93f7615a9140 service nova] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] No waiting events found dispatching network-vif-plugged-710ae079-0b1c-4c04-bea2-e34fd0d554ae {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:34:04 user nova-compute[75122]: WARNING nova.compute.manager [req-5b947711-4ee6-4823-af52-371eddbe9260 req-ee47a908-eeb6-42f7-ae15-93f7615a9140 service nova] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] Received unexpected event network-vif-plugged-710ae079-0b1c-4c04-bea2-e34fd0d554ae for instance with vm_state building and task_state spawning.
Nov 15 09:34:04 user nova-compute[75122]: DEBUG nova.compute.manager [req-5b947711-4ee6-4823-af52-371eddbe9260 req-ee47a908-eeb6-42f7-ae15-93f7615a9140 service nova] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] Received event network-vif-plugged-710ae079-0b1c-4c04-bea2-e34fd0d554ae {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:34:04 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-5b947711-4ee6-4823-af52-371eddbe9260 req-ee47a908-eeb6-42f7-ae15-93f7615a9140 service nova] Acquiring lock "742d64db-c555-4517-8ec9-cef02f09a6e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:34:04 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-5b947711-4ee6-4823-af52-371eddbe9260 req-ee47a908-eeb6-42f7-ae15-93f7615a9140 service nova] Lock "742d64db-c555-4517-8ec9-cef02f09a6e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:34:04 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-5b947711-4ee6-4823-af52-371eddbe9260 req-ee47a908-eeb6-42f7-ae15-93f7615a9140 service nova] Lock "742d64db-c555-4517-8ec9-cef02f09a6e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:34:04 user nova-compute[75122]: DEBUG nova.compute.manager [req-5b947711-4ee6-4823-af52-371eddbe9260 req-ee47a908-eeb6-42f7-ae15-93f7615a9140 service nova] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] No waiting events found dispatching network-vif-plugged-710ae079-0b1c-4c04-bea2-e34fd0d554ae {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:34:04 user nova-compute[75122]: WARNING nova.compute.manager [req-5b947711-4ee6-4823-af52-371eddbe9260 req-ee47a908-eeb6-42f7-ae15-93f7615a9140 service nova] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] Received unexpected event network-vif-plugged-710ae079-0b1c-4c04-bea2-e34fd0d554ae for instance with vm_state building and task_state spawning.
Nov 15 09:34:04 user nova-compute[75122]: DEBUG nova.compute.manager [req-d0305623-3093-45da-8af5-f761cb1853e2 req-18d7b0e1-6550-456f-aaf8-58b59277bde2 service nova] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] Received event network-vif-plugged-eaecb293-c647-47d7-8103-6fb8851477f3 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:34:04 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-d0305623-3093-45da-8af5-f761cb1853e2 req-18d7b0e1-6550-456f-aaf8-58b59277bde2 service nova] Acquiring lock "742d64db-c555-4517-8ec9-cef02f09a6e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:34:04 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-d0305623-3093-45da-8af5-f761cb1853e2 req-18d7b0e1-6550-456f-aaf8-58b59277bde2 service nova] Lock "742d64db-c555-4517-8ec9-cef02f09a6e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:34:04 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-d0305623-3093-45da-8af5-f761cb1853e2 req-18d7b0e1-6550-456f-aaf8-58b59277bde2 service nova] Lock "742d64db-c555-4517-8ec9-cef02f09a6e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:34:04 user nova-compute[75122]: DEBUG nova.compute.manager [req-d0305623-3093-45da-8af5-f761cb1853e2 req-18d7b0e1-6550-456f-aaf8-58b59277bde2 service nova] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] No waiting events found dispatching network-vif-plugged-eaecb293-c647-47d7-8103-6fb8851477f3 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:34:04 user nova-compute[75122]: WARNING nova.compute.manager [req-d0305623-3093-45da-8af5-f761cb1853e2 req-18d7b0e1-6550-456f-aaf8-58b59277bde2 service nova] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] Received unexpected event network-vif-plugged-eaecb293-c647-47d7-8103-6fb8851477f3 for instance with vm_state building and task_state spawning.
Nov 15 09:34:04 user nova-compute[75122]: DEBUG nova.compute.manager [req-d0305623-3093-45da-8af5-f761cb1853e2 req-18d7b0e1-6550-456f-aaf8-58b59277bde2 service nova] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] Received event network-vif-plugged-eaecb293-c647-47d7-8103-6fb8851477f3 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:34:04 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-d0305623-3093-45da-8af5-f761cb1853e2 req-18d7b0e1-6550-456f-aaf8-58b59277bde2 service nova] Acquiring lock "742d64db-c555-4517-8ec9-cef02f09a6e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:34:04 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-d0305623-3093-45da-8af5-f761cb1853e2 req-18d7b0e1-6550-456f-aaf8-58b59277bde2 service nova] Lock "742d64db-c555-4517-8ec9-cef02f09a6e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:34:04 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-d0305623-3093-45da-8af5-f761cb1853e2 req-18d7b0e1-6550-456f-aaf8-58b59277bde2 service nova] Lock "742d64db-c555-4517-8ec9-cef02f09a6e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:34:04 user nova-compute[75122]: DEBUG nova.compute.manager [req-d0305623-3093-45da-8af5-f761cb1853e2 req-18d7b0e1-6550-456f-aaf8-58b59277bde2 service nova] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] No waiting events found dispatching network-vif-plugged-eaecb293-c647-47d7-8103-6fb8851477f3 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:34:04 user nova-compute[75122]: WARNING nova.compute.manager [req-d0305623-3093-45da-8af5-f761cb1853e2 req-18d7b0e1-6550-456f-aaf8-58b59277bde2 service nova] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] Received unexpected event network-vif-plugged-eaecb293-c647-47d7-8103-6fb8851477f3 for instance with vm_state building and task_state spawning.
Nov 15 09:34:04 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:34:04 user nova-compute[75122]: DEBUG nova.compute.manager [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] Instance event wait completed in 0 seconds for  {{(pid=75122) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 09:34:04 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] Guest created on hypervisor {{(pid=75122) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 09:34:04 user nova-compute[75122]: INFO nova.virt.libvirt.driver [-] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] Instance spawned successfully.
Nov 15 09:34:04 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 09:34:04 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:34:04 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:34:04 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] Found default for hw_cdrom_bus of ide {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:34:04 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] Found default for hw_disk_bus of virtio {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:34:04 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] Found default for hw_input_bus of None {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:34:04 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] Found default for hw_pointer_model of None {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:34:04 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] Found default for hw_video_model of virtio {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:34:04 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] Found default for hw_vif_model of virtio {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:34:05 user nova-compute[75122]: INFO nova.compute.manager [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] Took 12.00 seconds to spawn the instance on the hypervisor.
Nov 15 09:34:05 user nova-compute[75122]: DEBUG nova.compute.manager [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] Checking state {{(pid=75122) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 09:34:05 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:34:05 user nova-compute[75122]: INFO nova.compute.manager [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] Took 29.72 seconds to build instance.
Nov 15 09:34:05 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:34:05 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:34:05 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-14c096ea-1baf-48c5-a4c5-e8f518ae4671 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] Lock "742d64db-c555-4517-8ec9-cef02f09a6e0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 29.847s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:34:05 user nova-compute[75122]: DEBUG nova.compute.manager [req-3c79d681-dd0a-4d9b-bd4d-f9e0da2eda4d req-e3302aaf-ba9a-4b0a-b85c-471243e8af4f service nova] [instance: 7cfd4155-c4b3-4cce-91e5-042cafccab8b] Received event network-vif-plugged-3066e71b-c5d6-4e46-980c-2b0d42739f95 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:34:05 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-3c79d681-dd0a-4d9b-bd4d-f9e0da2eda4d req-e3302aaf-ba9a-4b0a-b85c-471243e8af4f service nova] Acquiring lock "7cfd4155-c4b3-4cce-91e5-042cafccab8b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:34:05 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-3c79d681-dd0a-4d9b-bd4d-f9e0da2eda4d req-e3302aaf-ba9a-4b0a-b85c-471243e8af4f service nova] Lock "7cfd4155-c4b3-4cce-91e5-042cafccab8b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:34:05 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-3c79d681-dd0a-4d9b-bd4d-f9e0da2eda4d req-e3302aaf-ba9a-4b0a-b85c-471243e8af4f service nova] Lock "7cfd4155-c4b3-4cce-91e5-042cafccab8b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:34:05 user nova-compute[75122]: DEBUG nova.compute.manager [req-3c79d681-dd0a-4d9b-bd4d-f9e0da2eda4d req-e3302aaf-ba9a-4b0a-b85c-471243e8af4f service nova] [instance: 7cfd4155-c4b3-4cce-91e5-042cafccab8b] No waiting events found dispatching network-vif-plugged-3066e71b-c5d6-4e46-980c-2b0d42739f95 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:34:05 user nova-compute[75122]: WARNING nova.compute.manager [req-3c79d681-dd0a-4d9b-bd4d-f9e0da2eda4d req-e3302aaf-ba9a-4b0a-b85c-471243e8af4f service nova] [instance: 7cfd4155-c4b3-4cce-91e5-042cafccab8b] Received unexpected event network-vif-plugged-3066e71b-c5d6-4e46-980c-2b0d42739f95 for instance with vm_state building and task_state spawning.
Nov 15 09:34:05 user nova-compute[75122]: DEBUG nova.compute.manager [None req-f6426bb2-74be-4a98-ada1-d54175831647 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] [instance: ee961d5a-e0d1-4931-9293-eefbe638097a] Stashing vm_state: active {{(pid=75122) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 15 09:34:05 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-f6426bb2-74be-4a98-ada1-d54175831647 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:34:05 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-f6426bb2-74be-4a98-ada1-d54175831647 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:34:05 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-f6426bb2-74be-4a98-ada1-d54175831647 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75122) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 09:34:05 user nova-compute[75122]: INFO nova.compute.claims [None req-f6426bb2-74be-4a98-ada1-d54175831647 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] [instance: ee961d5a-e0d1-4931-9293-eefbe638097a] Claim successful on node user
Nov 15 09:34:05 user nova-compute[75122]: INFO nova.compute.resource_tracker [None req-f6426bb2-74be-4a98-ada1-d54175831647 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] [instance: ee961d5a-e0d1-4931-9293-eefbe638097a] Updating resource usage from migration f8a46d00-fb11-44d8-a63f-1ba41a2331d7
Nov 15 09:34:05 user nova-compute[75122]: DEBUG nova.compute.provider_tree [None req-f6426bb2-74be-4a98-ada1-d54175831647 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Inventory has not changed in ProviderTree for provider: 69a3da65-47be-44c6-b67c-c692b58284ef {{(pid=75122) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 09:34:05 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-f6426bb2-74be-4a98-ada1-d54175831647 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Inventory has not changed for provider 69a3da65-47be-44c6-b67c-c692b58284ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 09:34:05 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-f6426bb2-74be-4a98-ada1-d54175831647 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.310s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:34:05 user nova-compute[75122]: INFO nova.compute.manager [None req-f6426bb2-74be-4a98-ada1-d54175831647 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] [instance: ee961d5a-e0d1-4931-9293-eefbe638097a] Migrating
Nov 15 09:34:05 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-f6426bb2-74be-4a98-ada1-d54175831647 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 09:34:05 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-f6426bb2-74be-4a98-ada1-d54175831647 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Acquired lock "compute-rpcapi-router" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 09:34:05 user nova-compute[75122]: INFO nova.compute.rpcapi [None req-f6426bb2-74be-4a98-ada1-d54175831647 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Nov 15 09:34:05 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-f6426bb2-74be-4a98-ada1-d54175831647 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Releasing lock "compute-rpcapi-router" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 09:34:05 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-f6426bb2-74be-4a98-ada1-d54175831647 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Acquiring lock "refresh_cache-ee961d5a-e0d1-4931-9293-eefbe638097a" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 09:34:05 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-f6426bb2-74be-4a98-ada1-d54175831647 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Acquired lock "refresh_cache-ee961d5a-e0d1-4931-9293-eefbe638097a" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 09:34:05 user nova-compute[75122]: DEBUG nova.network.neutron [None req-f6426bb2-74be-4a98-ada1-d54175831647 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] [instance: ee961d5a-e0d1-4931-9293-eefbe638097a] Building network info cache for instance {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 09:34:06 user nova-compute[75122]: DEBUG nova.network.neutron [None req-f6426bb2-74be-4a98-ada1-d54175831647 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] [instance: ee961d5a-e0d1-4931-9293-eefbe638097a] Updating instance_info_cache with network_info: [{"id": "ae8a9c5e-17d1-4aa9-b3fa-b829d1dc6fd2", "address": "fa:16:3e:7d:98:85", "network": {"id": "44caed16-406b-4a76-966a-0dc42b26f133", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-465582303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d672b8845fa849d99e328521d3d1715b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae8a9c5e-17", "ovs_interfaceid": "ae8a9c5e-17d1-4aa9-b3fa-b829d1dc6fd2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:34:06 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-f6426bb2-74be-4a98-ada1-d54175831647 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Releasing lock "refresh_cache-ee961d5a-e0d1-4931-9293-eefbe638097a" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 09:34:06 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-f6426bb2-74be-4a98-ada1-d54175831647 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] [instance: ee961d5a-e0d1-4931-9293-eefbe638097a] Starting migrate_disk_and_power_off {{(pid=75122) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Nov 15 09:34:06 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:34:06 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:34:06 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:34:06 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:34:06 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:34:06 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:34:07 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:34:07 user nova-compute[75122]: INFO nova.virt.libvirt.driver [-] [instance: ee961d5a-e0d1-4931-9293-eefbe638097a] Instance destroyed successfully.
Nov 15 09:34:07 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-f6426bb2-74be-4a98-ada1-d54175831647 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T09:30:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-79968674',display_name='tempest-ServerActionsTestOtherB-server-79968674',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-79968674',id=2,image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJiK6B7/Kn/Opurq4zSOmiWq8yh0HkUVgNM/DkoeYxKo1kQJMVcwOjFbHB9+CscyIIndFz0uf8CUeGmaOLp83QTM6njH0bbr1gC12yHMNGMet8mqfmXy8CIGmj4KMayIOw==',key_name='tempest-keypair-1064498524',keypairs=<?>,launch_index=0,launched_at=2023-11-15T09:30:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='d672b8845fa849d99e328521d3d1715b',ramdisk_id='',reservation_id='r-32nlhypw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-279691748',owner_user_name='tempest-ServerActionsTestOtherB-279691748-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T09:34:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c9bf6f2e607842889cd6593ba114cfc3',uuid=ee961d5a-e0d1-4931-9293-eefbe638097a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ae8a9c5e-17d1-4aa9-b3fa-b829d1dc6fd2", "address": "fa:16:3e:7d:98:85", "network": {"id": "44caed16-406b-4a76-966a-0dc42b26f133", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-465582303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-465582303-network", "vif_mac": "fa:16:3e:7d:98:85"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d672b8845fa849d99e328521d3d1715b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae8a9c5e-17", "ovs_interfaceid": "ae8a9c5e-17d1-4aa9-b3fa-b829d1dc6fd2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 09:34:07 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-f6426bb2-74be-4a98-ada1-d54175831647 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Converting VIF {"id": "ae8a9c5e-17d1-4aa9-b3fa-b829d1dc6fd2", "address": "fa:16:3e:7d:98:85", "network": {"id": "44caed16-406b-4a76-966a-0dc42b26f133", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-465582303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-465582303-network", "vif_mac": "fa:16:3e:7d:98:85"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d672b8845fa849d99e328521d3d1715b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae8a9c5e-17", "ovs_interfaceid": "ae8a9c5e-17d1-4aa9-b3fa-b829d1dc6fd2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 09:34:07 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-f6426bb2-74be-4a98-ada1-d54175831647 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7d:98:85,bridge_name='br-int',has_traffic_filtering=True,id=ae8a9c5e-17d1-4aa9-b3fa-b829d1dc6fd2,network=Network(44caed16-406b-4a76-966a-0dc42b26f133),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae8a9c5e-17') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 09:34:07 user nova-compute[75122]: DEBUG os_vif [None req-f6426bb2-74be-4a98-ada1-d54175831647 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7d:98:85,bridge_name='br-int',has_traffic_filtering=True,id=ae8a9c5e-17d1-4aa9-b3fa-b829d1dc6fd2,network=Network(44caed16-406b-4a76-966a-0dc42b26f133),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae8a9c5e-17') {{(pid=75122) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 09:34:07 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:34:07 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapae8a9c5e-17, bridge=br-int, if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:34:07 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:34:07 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:34:07 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:34:07 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=dccc8f98-98fd-4781-a0df-30515ea0b610) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:34:07 user nova-compute[75122]: DEBUG nova.compute.manager [None req-c91398e5-24c4-439b-b50e-733008fa4e25 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] [instance: 7cfd4155-c4b3-4cce-91e5-042cafccab8b] Instance event wait completed in 0 seconds for  {{(pid=75122) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 09:34:07 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-c91398e5-24c4-439b-b50e-733008fa4e25 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] [instance: 7cfd4155-c4b3-4cce-91e5-042cafccab8b] Guest created on hypervisor {{(pid=75122) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 09:34:07 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:34:07 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:34:07 user nova-compute[75122]: INFO os_vif [None req-f6426bb2-74be-4a98-ada1-d54175831647 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7d:98:85,bridge_name='br-int',has_traffic_filtering=True,id=ae8a9c5e-17d1-4aa9-b3fa-b829d1dc6fd2,network=Network(44caed16-406b-4a76-966a-0dc42b26f133),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae8a9c5e-17')
Nov 15 09:34:07 user nova-compute[75122]: INFO nova.virt.libvirt.driver [-] [instance: 7cfd4155-c4b3-4cce-91e5-042cafccab8b] Instance spawned successfully.
Nov 15 09:34:07 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-c91398e5-24c4-439b-b50e-733008fa4e25 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] [instance: 7cfd4155-c4b3-4cce-91e5-042cafccab8b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 09:34:07 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f6426bb2-74be-4a98-ada1-d54175831647 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] [instance: ee961d5a-e0d1-4931-9293-eefbe638097a] calling os-brick to detach iSCSI Volume {{(pid=75122) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 09:34:07 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6426bb2-74be-4a98-ada1-d54175831647 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffa04060b80>, {'target_iqn': 'iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BFRblrMm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 09:34:07 user nova-compute[75122]: WARNING os_brick.initiator.connectors.base [None req-f6426bb2-74be-4a98-ada1-d54175831647 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 09:34:07 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-f6426bb2-74be-4a98-ada1-d54175831647 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 09:34:07 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-f6426bb2-74be-4a98-ada1-d54175831647 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 09:34:07 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:34:07 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:34:07 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[94ba99c4-13ec-45e1-907e-f1b1269a41e4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bca4e77f-05f8-4ff6-8a78-6cef699f5667\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:01563785-3767-460a-9815-c1bd0f7f6f9f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3a8a33bb-713e-4109-8306-fe91fd67904f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:34:07 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6426bb2-74be-4a98-ada1-d54175831647 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 09:34:07 user nova-compute[75122]: No targets found.
Nov 15 09:34:07 user nova-compute[75122]: iSNS:
Nov 15 09:34:07 user nova-compute[75122]: No targets found.
Nov 15 09:34:07 user nova-compute[75122]: STATIC:
Nov 15 09:34:07 user nova-compute[75122]: Target: iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16
Nov 15 09:34:07 user nova-compute[75122]:         Portal: 172.16.0.220:3260,-1
Nov 15 09:34:07 user nova-compute[75122]:                 Iface Name: default
Nov 15 09:34:07 user nova-compute[75122]: Target: iqn.2010-10.org.openstack:bca4e77f-05f8-4ff6-8a78-6cef699f5667
Nov 15 09:34:07 user nova-compute[75122]:         Portal: 172.16.0.220:3260,-1
Nov 15 09:34:07 user nova-compute[75122]:                 Iface Name: default
Nov 15 09:34:07 user nova-compute[75122]: Target: iqn.2010-10.org.openstack:01563785-3767-460a-9815-c1bd0f7f6f9f
Nov 15 09:34:07 user nova-compute[75122]:         Portal: 172.16.0.220:3260,-1
Nov 15 09:34:07 user nova-compute[75122]:                 Iface Name: default
Nov 15 09:34:07 user nova-compute[75122]: Target: iqn.2010-10.org.openstack:3a8a33bb-713e-4109-8306-fe91fd67904f
Nov 15 09:34:07 user nova-compute[75122]:         Portal: 172.16.0.220:3260,-1
Nov 15 09:34:07 user nova-compute[75122]:                 Iface Name: default
Nov 15 09:34:07 user nova-compute[75122]: FIRMWARE:
Nov 15 09:34:07 user nova-compute[75122]: No targets found.
Nov 15 09:34:07 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 09:34:07 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6426bb2-74be-4a98-ada1-d54175831647 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 09:34:07 user nova-compute[75122]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 09:34:07 user nova-compute[75122]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75122) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 09:34:07 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6426bb2-74be-4a98-ada1-d54175831647 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16', 0)] {{(pid=75122) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 09:34:07 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:34:07 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-c91398e5-24c4-439b-b50e-733008fa4e25 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] [instance: 7cfd4155-c4b3-4cce-91e5-042cafccab8b] Found default for hw_cdrom_bus of ide {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:34:07 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-c91398e5-24c4-439b-b50e-733008fa4e25 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] [instance: 7cfd4155-c4b3-4cce-91e5-042cafccab8b] Found default for hw_disk_bus of virtio {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:34:07 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-c91398e5-24c4-439b-b50e-733008fa4e25 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] [instance: 7cfd4155-c4b3-4cce-91e5-042cafccab8b] Found default for hw_input_bus of None {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:34:07 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-c91398e5-24c4-439b-b50e-733008fa4e25 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] [instance: 7cfd4155-c4b3-4cce-91e5-042cafccab8b] Found default for hw_pointer_model of None {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:34:07 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-c91398e5-24c4-439b-b50e-733008fa4e25 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] [instance: 7cfd4155-c4b3-4cce-91e5-042cafccab8b] Found default for hw_video_model of virtio {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:34:07 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-c91398e5-24c4-439b-b50e-733008fa4e25 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] [instance: 7cfd4155-c4b3-4cce-91e5-042cafccab8b] Found default for hw_vif_model of virtio {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:34:07 user nova-compute[75122]: DEBUG nova.compute.manager [req-48a421a3-bbd9-4111-87c2-f55564ee5c6e req-2b94a103-415a-4600-a1da-56d8c6b02be8 service nova] [instance: 7cfd4155-c4b3-4cce-91e5-042cafccab8b] Received event network-vif-plugged-3066e71b-c5d6-4e46-980c-2b0d42739f95 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:34:07 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-48a421a3-bbd9-4111-87c2-f55564ee5c6e req-2b94a103-415a-4600-a1da-56d8c6b02be8 service nova] Acquiring lock "7cfd4155-c4b3-4cce-91e5-042cafccab8b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:34:07 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-48a421a3-bbd9-4111-87c2-f55564ee5c6e req-2b94a103-415a-4600-a1da-56d8c6b02be8 service nova] Lock "7cfd4155-c4b3-4cce-91e5-042cafccab8b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:34:07 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-48a421a3-bbd9-4111-87c2-f55564ee5c6e req-2b94a103-415a-4600-a1da-56d8c6b02be8 service nova] Lock "7cfd4155-c4b3-4cce-91e5-042cafccab8b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:34:07 user nova-compute[75122]: DEBUG nova.compute.manager [req-48a421a3-bbd9-4111-87c2-f55564ee5c6e req-2b94a103-415a-4600-a1da-56d8c6b02be8 service nova] [instance: 7cfd4155-c4b3-4cce-91e5-042cafccab8b] No waiting events found dispatching network-vif-plugged-3066e71b-c5d6-4e46-980c-2b0d42739f95 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:34:07 user nova-compute[75122]: WARNING nova.compute.manager [req-48a421a3-bbd9-4111-87c2-f55564ee5c6e req-2b94a103-415a-4600-a1da-56d8c6b02be8 service nova] [instance: 7cfd4155-c4b3-4cce-91e5-042cafccab8b] Received unexpected event network-vif-plugged-3066e71b-c5d6-4e46-980c-2b0d42739f95 for instance with vm_state building and task_state spawning.
Nov 15 09:34:07 user nova-compute[75122]: DEBUG nova.compute.manager [req-48a421a3-bbd9-4111-87c2-f55564ee5c6e req-2b94a103-415a-4600-a1da-56d8c6b02be8 service nova] [instance: ee961d5a-e0d1-4931-9293-eefbe638097a] Received event network-vif-unplugged-ae8a9c5e-17d1-4aa9-b3fa-b829d1dc6fd2 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:34:07 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-48a421a3-bbd9-4111-87c2-f55564ee5c6e req-2b94a103-415a-4600-a1da-56d8c6b02be8 service nova] Acquiring lock "ee961d5a-e0d1-4931-9293-eefbe638097a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:34:07 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-48a421a3-bbd9-4111-87c2-f55564ee5c6e req-2b94a103-415a-4600-a1da-56d8c6b02be8 service nova] Lock "ee961d5a-e0d1-4931-9293-eefbe638097a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:34:07 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-48a421a3-bbd9-4111-87c2-f55564ee5c6e req-2b94a103-415a-4600-a1da-56d8c6b02be8 service nova] Lock "ee961d5a-e0d1-4931-9293-eefbe638097a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:34:07 user nova-compute[75122]: DEBUG nova.compute.manager [req-48a421a3-bbd9-4111-87c2-f55564ee5c6e req-2b94a103-415a-4600-a1da-56d8c6b02be8 service nova] [instance: ee961d5a-e0d1-4931-9293-eefbe638097a] No waiting events found dispatching network-vif-unplugged-ae8a9c5e-17d1-4aa9-b3fa-b829d1dc6fd2 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:34:07 user nova-compute[75122]: WARNING nova.compute.manager [req-48a421a3-bbd9-4111-87c2-f55564ee5c6e req-2b94a103-415a-4600-a1da-56d8c6b02be8 service nova] [instance: ee961d5a-e0d1-4931-9293-eefbe638097a] Received unexpected event network-vif-unplugged-ae8a9c5e-17d1-4aa9-b3fa-b829d1dc6fd2 for instance with vm_state active and task_state resize_migrating.
Nov 15 09:34:07 user nova-compute[75122]: DEBUG nova.compute.manager [req-48a421a3-bbd9-4111-87c2-f55564ee5c6e req-2b94a103-415a-4600-a1da-56d8c6b02be8 service nova] [instance: ee961d5a-e0d1-4931-9293-eefbe638097a] Received event network-vif-plugged-ae8a9c5e-17d1-4aa9-b3fa-b829d1dc6fd2 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:34:07 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-48a421a3-bbd9-4111-87c2-f55564ee5c6e req-2b94a103-415a-4600-a1da-56d8c6b02be8 service nova] Acquiring lock "ee961d5a-e0d1-4931-9293-eefbe638097a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:34:07 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-48a421a3-bbd9-4111-87c2-f55564ee5c6e req-2b94a103-415a-4600-a1da-56d8c6b02be8 service nova] Lock "ee961d5a-e0d1-4931-9293-eefbe638097a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:34:07 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-48a421a3-bbd9-4111-87c2-f55564ee5c6e req-2b94a103-415a-4600-a1da-56d8c6b02be8 service nova] Lock "ee961d5a-e0d1-4931-9293-eefbe638097a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:34:07 user nova-compute[75122]: DEBUG nova.compute.manager [req-48a421a3-bbd9-4111-87c2-f55564ee5c6e req-2b94a103-415a-4600-a1da-56d8c6b02be8 service nova] [instance: ee961d5a-e0d1-4931-9293-eefbe638097a] No waiting events found dispatching network-vif-plugged-ae8a9c5e-17d1-4aa9-b3fa-b829d1dc6fd2 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:34:07 user nova-compute[75122]: WARNING nova.compute.manager [req-48a421a3-bbd9-4111-87c2-f55564ee5c6e req-2b94a103-415a-4600-a1da-56d8c6b02be8 service nova] [instance: ee961d5a-e0d1-4931-9293-eefbe638097a] Received unexpected event network-vif-plugged-ae8a9c5e-17d1-4aa9-b3fa-b829d1dc6fd2 for instance with vm_state active and task_state resize_migrating.
Nov 15 09:34:07 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:34:07 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[75a539e5-2983-48bf-a7ca-a732e44db09a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:01563785-3767-460a-9815-c1bd0f7f6f9f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3a8a33bb-713e-4109-8306-fe91fd67904f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bca4e77f-05f8-4ff6-8a78-6cef699f5667\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:34:07 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:34:07 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:34:07 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e10dcfe-03e2-4993-b83d-c1bc8cc7734d]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01563785-3767-460a-9815-c1bd0f7f6f9f (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bca4e77f-05f8-4ff6-8a78-6cef699f5667 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a8a33bb-713e-4109-8306-fe91fd67904f (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16 (non-flash)\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:34:07 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6426bb2-74be-4a98-ada1-d54175831647 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01563785-3767-460a-9815-c1bd0f7f6f9f (non-flash)
Nov 15 09:34:07 user nova-compute[75122]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bca4e77f-05f8-4ff6-8a78-6cef699f5667 (non-flash)
Nov 15 09:34:07 user nova-compute[75122]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a8a33bb-713e-4109-8306-fe91fd67904f (non-flash)
Nov 15 09:34:07 user nova-compute[75122]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16 (non-flash)
Nov 15 09:34:07 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 09:34:07 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6426bb2-74be-4a98-ada1-d54175831647 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01563785-3767-460a-9815-c1bd0f7f6f9f (non-flash)
Nov 15 09:34:07 user nova-compute[75122]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bca4e77f-05f8-4ff6-8a78-6cef699f5667 (non-flash)
Nov 15 09:34:07 user nova-compute[75122]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a8a33bb-713e-4109-8306-fe91fd67904f (non-flash)
Nov 15 09:34:07 user nova-compute[75122]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16 (non-flash)
Nov 15 09:34:07 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 09:34:07 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6426bb2-74be-4a98-ada1-d54175831647 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ffa044120e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16'): ({'sde'}, set())}) {{(pid=75122) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 09:34:07 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-f6426bb2-74be-4a98-ada1-d54175831647 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Removing single pathed devices sde {{(pid=75122) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 09:34:07 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:34:07 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:34:07 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[afc76a4b-3df4-407a-9fc0-d1275fd4955b]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:34:07 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:34:07 user nova-compute[75122]: INFO nova.compute.manager [None req-c91398e5-24c4-439b-b50e-733008fa4e25 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] [instance: 7cfd4155-c4b3-4cce-91e5-042cafccab8b] Took 7.48 seconds to spawn the instance on the hypervisor.
Nov 15 09:34:07 user nova-compute[75122]: DEBUG nova.compute.manager [None req-c91398e5-24c4-439b-b50e-733008fa4e25 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] [instance: 7cfd4155-c4b3-4cce-91e5-042cafccab8b] Checking state {{(pid=75122) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 09:34:07 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.028s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:34:07 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e9af54f-20d2-45ab-a382-bb04cd33dd9a]: (4, ('ok\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:34:07 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-f6426bb2-74be-4a98-ada1-d54175831647 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Flushing IO for device /dev/sde {{(pid=75122) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 09:34:07 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:34:07 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:34:07 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ec32edc-1d72-438a-972b-edcfb01cbb9b]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:34:07 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-f6426bb2-74be-4a98-ada1-d54175831647 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75122) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 09:34:07 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:34:07 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.043s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:34:07 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebd3b73a-6a0e-41df-a6b3-32e318acba17]: (4, ('1', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:34:07 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-f6426bb2-74be-4a98-ada1-d54175831647 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75122) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 09:34:07 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-f6426bb2-74be-4a98-ada1-d54175831647 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] SCSI volumes sde have been removed. {{(pid=75122) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 09:34:07 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6426bb2-74be-4a98-ada1-d54175831647 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16')] {{(pid=75122) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 09:34:07 user nova-compute[75122]: INFO nova.compute.manager [None req-c91398e5-24c4-439b-b50e-733008fa4e25 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] [instance: 7cfd4155-c4b3-4cce-91e5-042cafccab8b] Took 8.25 seconds to build instance.
Nov 15 09:34:07 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:34:07 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-c91398e5-24c4-439b-b50e-733008fa4e25 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Lock "7cfd4155-c4b3-4cce-91e5-042cafccab8b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.578s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:34:07 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:34:07 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce235571-1322-4799-aa6c-1582d96e0c50]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:34:07 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6426bb2-74be-4a98-ada1-d54175831647 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:34:07 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16 -p 172.16.0.220:3260 --logout {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:34:07 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:34:07 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[f212a26f-4b5e-414c-a088-f37e744646d1]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:34:07 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6426bb2-74be-4a98-ada1-d54175831647 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16, portal: 172.16.0.220,3260]
Nov 15 09:34:07 user nova-compute[75122]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16, portal: 172.16.0.220,3260] successful.
Nov 15 09:34:07 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:34:07 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16 -p 172.16.0.220:3260 --op delete {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:34:07 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:34:07 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8f7d40a-2619-4b6b-b6f5-238ea49e2496]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:34:07 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6426bb2-74be-4a98-ada1-d54175831647 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:34:07 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-f6426bb2-74be-4a98-ada1-d54175831647 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.368s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 09:34:07 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6426bb2-74be-4a98-ada1-d54175831647 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] <== disconnect_volume: return (370ms) None {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 09:34:07 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f6426bb2-74be-4a98-ada1-d54175831647 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] [instance: ee961d5a-e0d1-4931-9293-eefbe638097a] Disconnected iSCSI Volume {{(pid=75122) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 09:34:07 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-f6426bb2-74be-4a98-ada1-d54175831647 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee961d5a-e0d1-4931-9293-eefbe638097a/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:34:07 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-f6426bb2-74be-4a98-ada1-d54175831647 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee961d5a-e0d1-4931-9293-eefbe638097a/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:34:07 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-f6426bb2-74be-4a98-ada1-d54175831647 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee961d5a-e0d1-4931-9293-eefbe638097a/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:34:08 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-f6426bb2-74be-4a98-ada1-d54175831647 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee961d5a-e0d1-4931-9293-eefbe638097a/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:34:08 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-f6426bb2-74be-4a98-ada1-d54175831647 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75122) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 09:34:08 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-f6426bb2-74be-4a98-ada1-d54175831647 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/ee961d5a-e0d1-4931-9293-eefbe638097a_resize/disk /opt/stack/data/nova/instances/ee961d5a-e0d1-4931-9293-eefbe638097a/disk {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:34:08 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:34:08 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75122) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 09:34:08 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-f6426bb2-74be-4a98-ada1-d54175831647 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] CMD "cp -r /opt/stack/data/nova/instances/ee961d5a-e0d1-4931-9293-eefbe638097a_resize/disk /opt/stack/data/nova/instances/ee961d5a-e0d1-4931-9293-eefbe638097a/disk" returned: 0 in 0.363s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:34:08 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-f6426bb2-74be-4a98-ada1-d54175831647 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/ee961d5a-e0d1-4931-9293-eefbe638097a_resize/disk.info /opt/stack/data/nova/instances/ee961d5a-e0d1-4931-9293-eefbe638097a/disk.info {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:34:08 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-f6426bb2-74be-4a98-ada1-d54175831647 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] CMD "cp -r /opt/stack/data/nova/instances/ee961d5a-e0d1-4931-9293-eefbe638097a_resize/disk.info /opt/stack/data/nova/instances/ee961d5a-e0d1-4931-9293-eefbe638097a/disk.info" returned: 0 in 0.046s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:34:09 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:34:09 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:34:09 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:34:09 user nova-compute[75122]: DEBUG nova.network.neutron [None req-f6426bb2-74be-4a98-ada1-d54175831647 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] [instance: ee961d5a-e0d1-4931-9293-eefbe638097a] Port ae8a9c5e-17d1-4aa9-b3fa-b829d1dc6fd2 binding to destination host user is already ACTIVE {{(pid=75122) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 15 09:34:10 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-f6426bb2-74be-4a98-ada1-d54175831647 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Acquiring lock "ee961d5a-e0d1-4931-9293-eefbe638097a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:34:10 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-f6426bb2-74be-4a98-ada1-d54175831647 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Lock "ee961d5a-e0d1-4931-9293-eefbe638097a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:34:10 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-f6426bb2-74be-4a98-ada1-d54175831647 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Lock "ee961d5a-e0d1-4931-9293-eefbe638097a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:34:10 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:34:10 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:34:10 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:34:10 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-f6426bb2-74be-4a98-ada1-d54175831647 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Acquiring lock "refresh_cache-ee961d5a-e0d1-4931-9293-eefbe638097a" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 09:34:10 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-f6426bb2-74be-4a98-ada1-d54175831647 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Acquired lock "refresh_cache-ee961d5a-e0d1-4931-9293-eefbe638097a" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 09:34:10 user nova-compute[75122]: DEBUG nova.network.neutron [None req-f6426bb2-74be-4a98-ada1-d54175831647 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] [instance: ee961d5a-e0d1-4931-9293-eefbe638097a] Building network info cache for instance {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 09:34:10 user nova-compute[75122]: DEBUG nova.network.neutron [None req-f6426bb2-74be-4a98-ada1-d54175831647 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] [instance: ee961d5a-e0d1-4931-9293-eefbe638097a] Updating instance_info_cache with network_info: [{"id": "ae8a9c5e-17d1-4aa9-b3fa-b829d1dc6fd2", "address": "fa:16:3e:7d:98:85", "network": {"id": "44caed16-406b-4a76-966a-0dc42b26f133", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-465582303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d672b8845fa849d99e328521d3d1715b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae8a9c5e-17", "ovs_interfaceid": "ae8a9c5e-17d1-4aa9-b3fa-b829d1dc6fd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:34:10 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-f6426bb2-74be-4a98-ada1-d54175831647 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Releasing lock "refresh_cache-ee961d5a-e0d1-4931-9293-eefbe638097a" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 09:34:10 user nova-compute[75122]: DEBUG os_brick.utils [None req-f6426bb2-74be-4a98-ada1-d54175831647 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 09:34:10 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:34:10 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:34:10 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5d14261-952a-4bab-bc41-bad252c061a9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:742fb64b3587\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:34:10 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:34:10 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:34:10 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a7dea00-481c-49e1-ae37-b6410d916d9e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:34:10 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:34:10 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:34:10 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[5613d6a8-20e4-4a3a-a9a4-6b84bfe75424]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:34:10 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[275d4a55-1787-400f-a60c-e31c924f424a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:34:10 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-f6426bb2-74be-4a98-ada1-d54175831647 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Running cmd (subprocess): nvme version {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:34:10 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-f6426bb2-74be-4a98-ada1-d54175831647 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] 'nvme version' failed. Not Retrying. {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 09:34:10 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f6426bb2-74be-4a98-ada1-d54175831647 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] nvme not present on system {{(pid=75122) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 09:34:10 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:34:10 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 09:34:10 user nova-compute[75122]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 09:34:10 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f6610c6-4a7a-43e8-a8f8-6377b18667b8]: (4, '') {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:34:11 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.lightos [None req-f6426bb2-74be-4a98-ada1-d54175831647 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75122) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 09:34:11 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.lightos [None req-f6426bb2-74be-4a98-ada1-d54175831647 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75122) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 09:34:11 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.lightos [None req-f6426bb2-74be-4a98-ada1-d54175831647 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] LIGHTOS: no hostnqn found. {{(pid=75122) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 09:34:11 user nova-compute[75122]: DEBUG os_brick.utils [None req-f6426bb2-74be-4a98-ada1-d54175831647 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:742fb64b3587', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 09:34:11 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:34:11 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:34:11 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:34:11 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:34:11 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75122) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 09:34:11 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee961d5a-e0d1-4931-9293-eefbe638097a/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:34:11 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee961d5a-e0d1-4931-9293-eefbe638097a/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:34:11 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee961d5a-e0d1-4931-9293-eefbe638097a/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:34:11 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee961d5a-e0d1-4931-9293-eefbe638097a/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:34:11 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75122) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 09:34:11 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75122) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 09:34:11 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75122) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 09:34:11 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=75122) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 09:34:11 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ce9b2be-aeb4-45e3-966c-e11667e6be8a/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:34:12 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ce9b2be-aeb4-45e3-966c-e11667e6be8a/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:34:12 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ce9b2be-aeb4-45e3-966c-e11667e6be8a/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:34:12 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ce9b2be-aeb4-45e3-966c-e11667e6be8a/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:34:12 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/131142fd-e8ec-42d1-a518-aa21c7bb7cb1/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:34:12 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:34:12 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/131142fd-e8ec-42d1-a518-aa21c7bb7cb1/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:34:12 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/131142fd-e8ec-42d1-a518-aa21c7bb7cb1/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:34:12 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/131142fd-e8ec-42d1-a518-aa21c7bb7cb1/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:34:12 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cfd4155-c4b3-4cce-91e5-042cafccab8b/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:34:12 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cfd4155-c4b3-4cce-91e5-042cafccab8b/disk --force-share --output=json" returned: 0 in 0.324s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:34:12 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cfd4155-c4b3-4cce-91e5-042cafccab8b/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:34:13 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cfd4155-c4b3-4cce-91e5-042cafccab8b/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:34:13 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 09:34:13 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 09:34:13 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Hypervisor/Node resource view: name=user free_ram=8543MB free_disk=25.65522003173828GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75122) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 09:34:13 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:34:13 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:34:13 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Applying migration context for instance ee961d5a-e0d1-4931-9293-eefbe638097a as it has an incoming, in-progress migration f8a46d00-fb11-44d8-a63f-1ba41a2331d7. Migration status is post-migrating {{(pid=75122) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 15 09:34:13 user nova-compute[75122]: INFO nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] [instance: ee961d5a-e0d1-4931-9293-eefbe638097a] Updating resource usage from migration f8a46d00-fb11-44d8-a63f-1ba41a2331d7
Nov 15 09:34:13 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance 131142fd-e8ec-42d1-a518-aa21c7bb7cb1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:34:13 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance 3ce9b2be-aeb4-45e3-966c-e11667e6be8a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:34:13 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance 742d64db-c555-4517-8ec9-cef02f09a6e0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:34:13 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance 7cfd4155-c4b3-4cce-91e5-042cafccab8b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:34:13 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Migration f8a46d00-fb11-44d8-a63f-1ba41a2331d7 is active on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 15 09:34:13 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance ee961d5a-e0d1-4931-9293-eefbe638097a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:34:13 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=75122) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 09:34:13 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=24GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=75122) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 09:34:13 user nova-compute[75122]: DEBUG nova.compute.provider_tree [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Inventory has not changed in ProviderTree for provider: 69a3da65-47be-44c6-b67c-c692b58284ef {{(pid=75122) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 09:34:13 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Inventory has not changed for provider 69a3da65-47be-44c6-b67c-c692b58284ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 09:34:13 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Compute_service record updated for user:user {{(pid=75122) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 09:34:13 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.371s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:34:14 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:34:14 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:34:14 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Starting heal instance info cache {{(pid=75122) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 09:34:15 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:34:15 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Didn't find any instances for network info cache update. {{(pid=75122) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 15 09:34:15 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:34:17 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:34:17 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-f6426bb2-74be-4a98-ada1-d54175831647 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] [instance: ee961d5a-e0d1-4931-9293-eefbe638097a] Starting finish_migration {{(pid=75122) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Nov 15 09:34:17 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-f6426bb2-74be-4a98-ada1-d54175831647 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] [instance: ee961d5a-e0d1-4931-9293-eefbe638097a] Instance directory exists: not creating {{(pid=75122) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 15 09:34:17 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-f6426bb2-74be-4a98-ada1-d54175831647 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] [instance: ee961d5a-e0d1-4931-9293-eefbe638097a] Creating image(s)
Nov 15 09:34:17 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-f6426bb2-74be-4a98-ada1-d54175831647 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:34:18 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-f6426bb2-74be-4a98-ada1-d54175831647 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json" returned: 0 in 0.177s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:34:18 user nova-compute[75122]: DEBUG nova.virt.disk.api [None req-f6426bb2-74be-4a98-ada1-d54175831647 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ee961d5a-e0d1-4931-9293-eefbe638097a/disk. size=21474836480 {{(pid=75122) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 09:34:18 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-f6426bb2-74be-4a98-ada1-d54175831647 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee961d5a-e0d1-4931-9293-eefbe638097a/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:34:18 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-f6426bb2-74be-4a98-ada1-d54175831647 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee961d5a-e0d1-4931-9293-eefbe638097a/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:34:18 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-f6426bb2-74be-4a98-ada1-d54175831647 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/ee961d5a-e0d1-4931-9293-eefbe638097a/disk 21474836480 {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:34:18 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-f6426bb2-74be-4a98-ada1-d54175831647 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/ee961d5a-e0d1-4931-9293-eefbe638097a/disk 21474836480" returned: 0 in 0.057s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:34:18 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-f6426bb2-74be-4a98-ada1-d54175831647 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] [instance: ee961d5a-e0d1-4931-9293-eefbe638097a] Did not create local disks {{(pid=75122) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 09:34:18 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-f6426bb2-74be-4a98-ada1-d54175831647 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] [instance: ee961d5a-e0d1-4931-9293-eefbe638097a] Ensure instance console log exists: /opt/stack/data/nova/instances/ee961d5a-e0d1-4931-9293-eefbe638097a/console.log {{(pid=75122) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 09:34:18 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-f6426bb2-74be-4a98-ada1-d54175831647 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:34:18 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-f6426bb2-74be-4a98-ada1-d54175831647 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:34:18 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-f6426bb2-74be-4a98-ada1-d54175831647 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:34:18 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-f6426bb2-74be-4a98-ada1-d54175831647 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] [instance: ee961d5a-e0d1-4931-9293-eefbe638097a] Start _get_guest_xml network_info=[{"id": "ae8a9c5e-17d1-4aa9-b3fa-b829d1dc6fd2", "address": "fa:16:3e:7d:98:85", "network": {"id": "44caed16-406b-4a76-966a-0dc42b26f133", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-465582303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-465582303-network", "vif_mac": "fa:16:3e:7d:98:85"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d672b8845fa849d99e328521d3d1715b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae8a9c5e-17", "ovs_interfaceid": "ae8a9c5e-17d1-4aa9-b3fa-b829d1dc6fd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T09:26:31Z,direct_url=<?>,disk_format='qcow2',id=5e862cfe-47b8-4725-8292-65761ee6d0f5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9c57733cb41847c0b4ad31519c382e5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T09:26:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '5e862cfe-47b8-4725-8292-65761ee6d0f5'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BFRblrMm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'ee961d5a-e0d1-4931-9293-eefbe638097a', 'attached_at': '2023-11-15T09:34:18.000000', 'detached_at': '', 'volume_id': '2cd51ed3-2703-4b02-aa7c-ddb113161a16', 'serial': '2cd51ed3-2703-4b02-aa7c-ddb113161a16'}, 'guest_format': None, 'delete_on_termination': False, 'boot_index': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vdb', 'attachment_id': '9bb6f389-abe4-4b00-b97b-521070599c5c', 'volume_type': None} {{(pid=75122) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 09:34:18 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-f6426bb2-74be-4a98-ada1-d54175831647 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 09:34:18 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-f6426bb2-74be-4a98-ada1-d54175831647 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 09:34:18 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-f6426bb2-74be-4a98-ada1-d54175831647 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75122) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 09:34:18 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-f6426bb2-74be-4a98-ada1-d54175831647 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] CPU controller missing on host. {{(pid=75122) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 09:34:18 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-f6426bb2-74be-4a98-ada1-d54175831647 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75122) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 09:34:18 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-f6426bb2-74be-4a98-ada1-d54175831647 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] CPU controller found on host. {{(pid=75122) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 09:34:18 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-f6426bb2-74be-4a98-ada1-d54175831647 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75122) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 09:34:18 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-f6426bb2-74be-4a98-ada1-d54175831647 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T09:26:22Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T09:26:31Z,direct_url=<?>,disk_format='qcow2',id=5e862cfe-47b8-4725-8292-65761ee6d0f5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9c57733cb41847c0b4ad31519c382e5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T09:26:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 09:34:18 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-f6426bb2-74be-4a98-ada1-d54175831647 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Flavor limits 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 09:34:18 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-f6426bb2-74be-4a98-ada1-d54175831647 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Image limits 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 09:34:18 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-f6426bb2-74be-4a98-ada1-d54175831647 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Flavor pref 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 09:34:18 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-f6426bb2-74be-4a98-ada1-d54175831647 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Image pref 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 09:34:18 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-f6426bb2-74be-4a98-ada1-d54175831647 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 09:34:18 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-f6426bb2-74be-4a98-ada1-d54175831647 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 09:34:18 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-f6426bb2-74be-4a98-ada1-d54175831647 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75122) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 09:34:18 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-f6426bb2-74be-4a98-ada1-d54175831647 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Got 1 possible topologies {{(pid=75122) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 09:34:18 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-f6426bb2-74be-4a98-ada1-d54175831647 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 09:34:18 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-f6426bb2-74be-4a98-ada1-d54175831647 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 09:34:18 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f6426bb2-74be-4a98-ada1-d54175831647 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] [instance: ee961d5a-e0d1-4931-9293-eefbe638097a] Calling os-brick to attach iSCSI Volume {{(pid=75122) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 09:34:18 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6426bb2-74be-4a98-ada1-d54175831647 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffa04060b80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BFRblrMm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 09:34:18 user nova-compute[75122]: WARNING os_brick.initiator.connectors.base [None req-f6426bb2-74be-4a98-ada1-d54175831647 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 09:34:18 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-f6426bb2-74be-4a98-ada1-d54175831647 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 09:34:18 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-f6426bb2-74be-4a98-ada1-d54175831647 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 09:34:18 user nova-compute[75122]: WARNING os_brick.initiator.connectors.base [None req-f6426bb2-74be-4a98-ada1-d54175831647 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 09:34:18 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-f6426bb2-74be-4a98-ada1-d54175831647 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 09:34:18 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-f6426bb2-74be-4a98-ada1-d54175831647 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 09:34:18 user nova-compute[75122]: INFO os_brick.initiator.connectors.iscsi [None req-f6426bb2-74be-4a98-ada1-d54175831647 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 09:34:18 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16 -p 172.16.0.220:3260 {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:34:18 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:34:18 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6012020-c79f-470e-a00a-c65c7c514665]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:34:18 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6426bb2-74be-4a98-ada1-d54175831647 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 09:34:18 user nova-compute[75122]:  {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:34:18 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16 -p 172.16.0.220:3260 --interface default --op new {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:34:18 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:34:18 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[99e4b1da-dd6e-405c-aba2-82af3db60a23]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16] added\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:34:18 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6426bb2-74be-4a98-ada1-d54175831647 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16] added
Nov 15 09:34:18 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:34:18 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:34:18 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:34:18 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e824cc4-0414-45f7-82c6-5a0f85d9be45]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:34:18 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6426bb2-74be-4a98-ada1-d54175831647 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:34:18 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:34:18 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:34:18 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d6bba95-fb7d-4b76-949b-a7e72ba596ad]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:34:18 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6426bb2-74be-4a98-ada1-d54175831647 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:34:18 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BFRblrMm {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:34:18 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BFRblrMm" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:34:18 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[55c3d055-abae-4c6a-9e0e-2a94126880c3]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:34:18 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6426bb2-74be-4a98-ada1-d54175831647 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BFRblrMm'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:34:18 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:34:18 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:34:18 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[051a3d93-227b-4806-9625-911b32e459c8]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:34:18 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6426bb2-74be-4a98-ada1-d54175831647 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:34:18 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:34:18 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:34:18 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbad821d-266c-4fe2-a0ec-6045bdb71165]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01563785-3767-460a-9815-c1bd0f7f6f9f (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bca4e77f-05f8-4ff6-8a78-6cef699f5667 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a8a33bb-713e-4109-8306-fe91fd67904f (non-flash)\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:34:18 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6426bb2-74be-4a98-ada1-d54175831647 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01563785-3767-460a-9815-c1bd0f7f6f9f (non-flash)
Nov 15 09:34:18 user nova-compute[75122]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bca4e77f-05f8-4ff6-8a78-6cef699f5667 (non-flash)
Nov 15 09:34:18 user nova-compute[75122]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a8a33bb-713e-4109-8306-fe91fd67904f (non-flash)
Nov 15 09:34:18 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 09:34:18 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6426bb2-74be-4a98-ada1-d54175831647 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01563785-3767-460a-9815-c1bd0f7f6f9f (non-flash)
Nov 15 09:34:18 user nova-compute[75122]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bca4e77f-05f8-4ff6-8a78-6cef699f5667 (non-flash)
Nov 15 09:34:18 user nova-compute[75122]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a8a33bb-713e-4109-8306-fe91fd67904f (non-flash)
Nov 15 09:34:18 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 09:34:18 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16 -p 172.16.0.220:3260 --login {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:34:18 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16 -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:34:18 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[12100a32-3f4f-428f-81c8-c1f92029e917]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:34:18 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6426bb2-74be-4a98-ada1-d54175831647 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16, portal: 172.16.0.220,3260]
Nov 15 09:34:18 user nova-compute[75122]: Login to [iface: default, target: iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16, portal: 172.16.0.220,3260] successful.
Nov 15 09:34:18 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:34:18 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:34:18 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:34:18 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c9489e0-4fc6-4b6b-a953-003375725cea]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:34:18 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6426bb2-74be-4a98-ada1-d54175831647 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:34:18 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:34:18 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:34:18 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[17739cd7-68e7-41ef-b1dd-59c4e641c3bb]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01563785-3767-460a-9815-c1bd0f7f6f9f (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bca4e77f-05f8-4ff6-8a78-6cef699f5667 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a8a33bb-713e-4109-8306-fe91fd67904f (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16 (non-flash)\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:34:18 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6426bb2-74be-4a98-ada1-d54175831647 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01563785-3767-460a-9815-c1bd0f7f6f9f (non-flash)
Nov 15 09:34:18 user nova-compute[75122]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bca4e77f-05f8-4ff6-8a78-6cef699f5667 (non-flash)
Nov 15 09:34:18 user nova-compute[75122]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a8a33bb-713e-4109-8306-fe91fd67904f (non-flash)
Nov 15 09:34:18 user nova-compute[75122]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16 (non-flash)
Nov 15 09:34:18 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 09:34:18 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6426bb2-74be-4a98-ada1-d54175831647 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01563785-3767-460a-9815-c1bd0f7f6f9f (non-flash)
Nov 15 09:34:18 user nova-compute[75122]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bca4e77f-05f8-4ff6-8a78-6cef699f5667 (non-flash)
Nov 15 09:34:18 user nova-compute[75122]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a8a33bb-713e-4109-8306-fe91fd67904f (non-flash)
Nov 15 09:34:18 user nova-compute[75122]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16 (non-flash)
Nov 15 09:34:18 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 09:34:18 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-f6426bb2-74be-4a98-ada1-d54175831647 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.291s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 09:34:18 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6426bb2-74be-4a98-ada1-d54175831647 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Connected to 172.16.0.220:3260 {{(pid=75122) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 09:34:18 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-f6426bb2-74be-4a98-ada1-d54175831647 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] HCTL ('36', '-', '-', 0) found on session 17 with lun 0 {{(pid=75122) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 09:34:18 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-f6426bb2-74be-4a98-ada1-d54175831647 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75122) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 09:34:18 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:34:18 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.031s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:34:18 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[d51c8d1a-fdd7-46f1-a6ad-c11c53c73994]: (4, ('- - 0', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:34:18 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-f6426bb2-74be-4a98-ada1-d54175831647 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Searching for a device in session 17 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75122) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 09:34:18 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6426bb2-74be-4a98-ada1-d54175831647 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BFRblrMm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75122) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 09:34:19 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:34:19 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-f6426bb2-74be-4a98-ada1-d54175831647 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.334s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 09:34:19 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6426bb2-74be-4a98-ada1-d54175831647 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] <== connect_volume: return (1336ms) {'type': 'block', 'scsi_wwn': '23231356562353037', 'path': '/dev/sde'} {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 09:34:19 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f6426bb2-74be-4a98-ada1-d54175831647 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] [instance: ee961d5a-e0d1-4931-9293-eefbe638097a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23231356562353037', 'path': '/dev/sde'} {{(pid=75122) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 09:34:19 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-f6426bb2-74be-4a98-ada1-d54175831647 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T09:30:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-79968674',display_name='tempest-ServerActionsTestOtherB-server-79968674',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-79968674',id=2,image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJiK6B7/Kn/Opurq4zSOmiWq8yh0HkUVgNM/DkoeYxKo1kQJMVcwOjFbHB9+CscyIIndFz0uf8CUeGmaOLp83QTM6njH0bbr1gC12yHMNGMet8mqfmXy8CIGmj4KMayIOw==',key_name='tempest-keypair-1064498524',keypairs=<?>,launch_index=0,launched_at=2023-11-15T09:30:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='d672b8845fa849d99e328521d3d1715b',ramdisk_id='',reservation_id='r-32nlhypw',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-279691748',owner_user_name='tempest-ServerActionsTestOtherB-279691748-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T09:34:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c9bf6f2e607842889cd6593ba114cfc3',uuid=ee961d5a-e0d1-4931-9293-eefbe638097a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ae8a9c5e-17d1-4aa9-b3fa-b829d1dc6fd2", "address": "fa:16:3e:7d:98:85", "network": {"id": "44caed16-406b-4a76-966a-0dc42b26f133", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-465582303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-465582303-network", "vif_mac": "fa:16:3e:7d:98:85"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d672b8845fa849d99e328521d3d1715b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae8a9c5e-17", "ovs_interfaceid": "ae8a9c5e-17d1-4aa9-b3fa-b829d1dc6fd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75122) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 09:34:19 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-f6426bb2-74be-4a98-ada1-d54175831647 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Converting VIF {"id": "ae8a9c5e-17d1-4aa9-b3fa-b829d1dc6fd2", "address": "fa:16:3e:7d:98:85", "network": {"id": "44caed16-406b-4a76-966a-0dc42b26f133", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-465582303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-465582303-network", "vif_mac": "fa:16:3e:7d:98:85"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d672b8845fa849d99e328521d3d1715b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae8a9c5e-17", "ovs_interfaceid": "ae8a9c5e-17d1-4aa9-b3fa-b829d1dc6fd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 09:34:19 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-f6426bb2-74be-4a98-ada1-d54175831647 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:98:85,bridge_name='br-int',has_traffic_filtering=True,id=ae8a9c5e-17d1-4aa9-b3fa-b829d1dc6fd2,network=Network(44caed16-406b-4a76-966a-0dc42b26f133),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae8a9c5e-17') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 09:34:19 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-f6426bb2-74be-4a98-ada1-d54175831647 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] [instance: ee961d5a-e0d1-4931-9293-eefbe638097a] End _get_guest_xml xml=<domain type="kvm">
Nov 15 09:34:19 user nova-compute[75122]:   <uuid>ee961d5a-e0d1-4931-9293-eefbe638097a</uuid>
Nov 15 09:34:19 user nova-compute[75122]:   <name>instance-00000002</name>
Nov 15 09:34:19 user nova-compute[75122]:   <memory>2097152</memory>
Nov 15 09:34:19 user nova-compute[75122]:   <vcpu>1</vcpu>
Nov 15 09:34:19 user nova-compute[75122]:   <metadata>
Nov 15 09:34:19 user nova-compute[75122]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 09:34:19 user nova-compute[75122]:       <nova:package version="0.0.0"/>
Nov 15 09:34:19 user nova-compute[75122]:       <nova:name>tempest-ServerActionsTestOtherB-server-79968674</nova:name>
Nov 15 09:34:19 user nova-compute[75122]:       <nova:creationTime>2023-11-15 09:34:18</nova:creationTime>
Nov 15 09:34:19 user nova-compute[75122]:       <nova:flavor name="m1.small">
Nov 15 09:34:19 user nova-compute[75122]:         <nova:memory>2048</nova:memory>
Nov 15 09:34:19 user nova-compute[75122]:         <nova:disk>20</nova:disk>
Nov 15 09:34:19 user nova-compute[75122]:         <nova:swap>0</nova:swap>
Nov 15 09:34:19 user nova-compute[75122]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 09:34:19 user nova-compute[75122]:         <nova:vcpus>1</nova:vcpus>
Nov 15 09:34:19 user nova-compute[75122]:       </nova:flavor>
Nov 15 09:34:19 user nova-compute[75122]:       <nova:owner>
Nov 15 09:34:19 user nova-compute[75122]:         <nova:user uuid="c9bf6f2e607842889cd6593ba114cfc3">tempest-ServerActionsTestOtherB-279691748-project-member</nova:user>
Nov 15 09:34:19 user nova-compute[75122]:         <nova:project uuid="d672b8845fa849d99e328521d3d1715b">tempest-ServerActionsTestOtherB-279691748</nova:project>
Nov 15 09:34:19 user nova-compute[75122]:       </nova:owner>
Nov 15 09:34:19 user nova-compute[75122]:       <nova:root type="image" uuid="5e862cfe-47b8-4725-8292-65761ee6d0f5"/>
Nov 15 09:34:19 user nova-compute[75122]:       <nova:ports>
Nov 15 09:34:19 user nova-compute[75122]:         <nova:port uuid="ae8a9c5e-17d1-4aa9-b3fa-b829d1dc6fd2">
Nov 15 09:34:19 user nova-compute[75122]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 15 09:34:19 user nova-compute[75122]:         </nova:port>
Nov 15 09:34:19 user nova-compute[75122]:       </nova:ports>
Nov 15 09:34:19 user nova-compute[75122]:     </nova:instance>
Nov 15 09:34:19 user nova-compute[75122]:   </metadata>
Nov 15 09:34:19 user nova-compute[75122]:   <sysinfo type="smbios">
Nov 15 09:34:19 user nova-compute[75122]:     <system>
Nov 15 09:34:19 user nova-compute[75122]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 09:34:19 user nova-compute[75122]:       <entry name="product">OpenStack Nova</entry>
Nov 15 09:34:19 user nova-compute[75122]:       <entry name="version">0.0.0</entry>
Nov 15 09:34:19 user nova-compute[75122]:       <entry name="serial">ee961d5a-e0d1-4931-9293-eefbe638097a</entry>
Nov 15 09:34:19 user nova-compute[75122]:       <entry name="uuid">ee961d5a-e0d1-4931-9293-eefbe638097a</entry>
Nov 15 09:34:19 user nova-compute[75122]:       <entry name="family">Virtual Machine</entry>
Nov 15 09:34:19 user nova-compute[75122]:     </system>
Nov 15 09:34:19 user nova-compute[75122]:   </sysinfo>
Nov 15 09:34:19 user nova-compute[75122]:   <os>
Nov 15 09:34:19 user nova-compute[75122]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 09:34:19 user nova-compute[75122]:     <boot dev="hd"/>
Nov 15 09:34:19 user nova-compute[75122]:     <smbios mode="sysinfo"/>
Nov 15 09:34:19 user nova-compute[75122]:   </os>
Nov 15 09:34:19 user nova-compute[75122]:   <features>
Nov 15 09:34:19 user nova-compute[75122]:     <acpi/>
Nov 15 09:34:19 user nova-compute[75122]:     <apic/>
Nov 15 09:34:19 user nova-compute[75122]:     <vmcoreinfo/>
Nov 15 09:34:19 user nova-compute[75122]:   </features>
Nov 15 09:34:19 user nova-compute[75122]:   <clock offset="utc">
Nov 15 09:34:19 user nova-compute[75122]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 09:34:19 user nova-compute[75122]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 09:34:19 user nova-compute[75122]:     <timer name="hpet" present="no"/>
Nov 15 09:34:19 user nova-compute[75122]:   </clock>
Nov 15 09:34:19 user nova-compute[75122]:   <cpu mode="custom" match="exact">
Nov 15 09:34:19 user nova-compute[75122]:     <model>Nehalem</model>
Nov 15 09:34:19 user nova-compute[75122]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 09:34:19 user nova-compute[75122]:   </cpu>
Nov 15 09:34:19 user nova-compute[75122]:   <devices>
Nov 15 09:34:19 user nova-compute[75122]:     <disk type="file" device="disk">
Nov 15 09:34:19 user nova-compute[75122]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 09:34:19 user nova-compute[75122]:       <source file="/opt/stack/data/nova/instances/ee961d5a-e0d1-4931-9293-eefbe638097a/disk"/>
Nov 15 09:34:19 user nova-compute[75122]:       <target dev="vda" bus="virtio"/>
Nov 15 09:34:19 user nova-compute[75122]:     </disk>
Nov 15 09:34:19 user nova-compute[75122]:     <disk type="block" device="disk">
Nov 15 09:34:19 user nova-compute[75122]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 09:34:19 user nova-compute[75122]:       <source dev="/dev/sde"/>
Nov 15 09:34:19 user nova-compute[75122]:       <target dev="vdb" bus="virtio"/>
Nov 15 09:34:19 user nova-compute[75122]:       <serial>2cd51ed3-2703-4b02-aa7c-ddb113161a16</serial>
Nov 15 09:34:19 user nova-compute[75122]:     </disk>
Nov 15 09:34:19 user nova-compute[75122]:     <interface type="ethernet">
Nov 15 09:34:19 user nova-compute[75122]:       <mac address="fa:16:3e:7d:98:85"/>
Nov 15 09:34:19 user nova-compute[75122]:       <model type="virtio"/>
Nov 15 09:34:19 user nova-compute[75122]:       <mtu size="1442"/>
Nov 15 09:34:19 user nova-compute[75122]:       <target dev="tapae8a9c5e-17"/>
Nov 15 09:34:19 user nova-compute[75122]:     </interface>
Nov 15 09:34:19 user nova-compute[75122]:     <serial type="pty">
Nov 15 09:34:19 user nova-compute[75122]:       <log file="/opt/stack/data/nova/instances/ee961d5a-e0d1-4931-9293-eefbe638097a/console.log" append="off"/>
Nov 15 09:34:19 user nova-compute[75122]:     </serial>
Nov 15 09:34:19 user nova-compute[75122]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 09:34:19 user nova-compute[75122]:     <video>
Nov 15 09:34:19 user nova-compute[75122]:       <model type="virtio"/>
Nov 15 09:34:19 user nova-compute[75122]:     </video>
Nov 15 09:34:19 user nova-compute[75122]:     <rng model="virtio">
Nov 15 09:34:19 user nova-compute[75122]:       <backend model="random">/dev/urandom</backend>
Nov 15 09:34:19 user nova-compute[75122]:     </rng>
Nov 15 09:34:19 user nova-compute[75122]:     <controller type="usb" index="0" model="none"/>
Nov 15 09:34:19 user nova-compute[75122]:     <memballoon model="virtio">
Nov 15 09:34:19 user nova-compute[75122]:       <stats period="10"/>
Nov 15 09:34:19 user nova-compute[75122]:     </memballoon>
Nov 15 09:34:19 user nova-compute[75122]:   </devices>
Nov 15 09:34:19 user nova-compute[75122]: </domain>
Nov 15 09:34:19 user nova-compute[75122]:  {{(pid=75122) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 09:34:19 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-f6426bb2-74be-4a98-ada1-d54175831647 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T09:30:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-79968674',display_name='tempest-ServerActionsTestOtherB-server-79968674',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-79968674',id=2,image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJiK6B7/Kn/Opurq4zSOmiWq8yh0HkUVgNM/DkoeYxKo1kQJMVcwOjFbHB9+CscyIIndFz0uf8CUeGmaOLp83QTM6njH0bbr1gC12yHMNGMet8mqfmXy8CIGmj4KMayIOw==',key_name='tempest-keypair-1064498524',keypairs=<?>,launch_index=0,launched_at=2023-11-15T09:30:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='d672b8845fa849d99e328521d3d1715b',ramdisk_id='',reservation_id='r-32nlhypw',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-279691748',owner_user_name='tempest-ServerActionsTestOtherB-279691748-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T09:34:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c9bf6f2e607842889cd6593ba114cfc3',uuid=ee961d5a-e0d1-4931-9293-eefbe638097a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ae8a9c5e-17d1-4aa9-b3fa-b829d1dc6fd2", "address": "fa:16:3e:7d:98:85", "network": {"id": "44caed16-406b-4a76-966a-0dc42b26f133", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-465582303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-465582303-network", "vif_mac": "fa:16:3e:7d:98:85"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d672b8845fa849d99e328521d3d1715b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae8a9c5e-17", "ovs_interfaceid": "ae8a9c5e-17d1-4aa9-b3fa-b829d1dc6fd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 09:34:19 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-f6426bb2-74be-4a98-ada1-d54175831647 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Converting VIF {"id": "ae8a9c5e-17d1-4aa9-b3fa-b829d1dc6fd2", "address": "fa:16:3e:7d:98:85", "network": {"id": "44caed16-406b-4a76-966a-0dc42b26f133", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-465582303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-465582303-network", "vif_mac": "fa:16:3e:7d:98:85"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d672b8845fa849d99e328521d3d1715b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae8a9c5e-17", "ovs_interfaceid": "ae8a9c5e-17d1-4aa9-b3fa-b829d1dc6fd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 09:34:19 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-f6426bb2-74be-4a98-ada1-d54175831647 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:98:85,bridge_name='br-int',has_traffic_filtering=True,id=ae8a9c5e-17d1-4aa9-b3fa-b829d1dc6fd2,network=Network(44caed16-406b-4a76-966a-0dc42b26f133),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae8a9c5e-17') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 09:34:19 user nova-compute[75122]: DEBUG os_vif [None req-f6426bb2-74be-4a98-ada1-d54175831647 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:98:85,bridge_name='br-int',has_traffic_filtering=True,id=ae8a9c5e-17d1-4aa9-b3fa-b829d1dc6fd2,network=Network(44caed16-406b-4a76-966a-0dc42b26f133),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae8a9c5e-17') {{(pid=75122) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 09:34:19 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:34:19 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:34:19 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 09:34:19 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:34:19 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3609e1c0-55d8-546a-b83f-6084bd8a23e9', '_type': 'linux-noop'}}, row=False) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:34:19 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:34:19 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:34:19 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:34:19 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapae8a9c5e-17, may_exist=True, interface_attrs={}) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:34:19 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapae8a9c5e-17, col_values=(('qos', UUID('874e2e40-31c1-469c-a1d9-10ce1dc4fe84')),), if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:34:19 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapae8a9c5e-17, col_values=(('external_ids', {'iface-id': 'ae8a9c5e-17d1-4aa9-b3fa-b829d1dc6fd2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7d:98:85', 'vm-uuid': 'ee961d5a-e0d1-4931-9293-eefbe638097a'}),), if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:34:19 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:34:19 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:34:19 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:34:19 user nova-compute[75122]: INFO os_vif [None req-f6426bb2-74be-4a98-ada1-d54175831647 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:98:85,bridge_name='br-int',has_traffic_filtering=True,id=ae8a9c5e-17d1-4aa9-b3fa-b829d1dc6fd2,network=Network(44caed16-406b-4a76-966a-0dc42b26f133),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae8a9c5e-17')
Nov 15 09:34:19 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-f6426bb2-74be-4a98-ada1-d54175831647 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] No BDM found with device name vda, not building metadata. {{(pid=75122) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 09:34:19 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-f6426bb2-74be-4a98-ada1-d54175831647 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75122) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 09:34:19 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-f6426bb2-74be-4a98-ada1-d54175831647 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] No VIF found with MAC fa:16:3e:7d:98:85, not building metadata {{(pid=75122) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 09:34:20 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:34:21 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:34:21 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:34:21 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:34:21 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:34:21 user nova-compute[75122]: DEBUG nova.compute.manager [req-726438f8-92a6-4b83-b5a1-04ec29feda35 req-b8e0bf7a-67d4-44f4-adeb-a3c4e49b73b0 service nova] [instance: ee961d5a-e0d1-4931-9293-eefbe638097a] Received event network-vif-plugged-ae8a9c5e-17d1-4aa9-b3fa-b829d1dc6fd2 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:34:21 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-726438f8-92a6-4b83-b5a1-04ec29feda35 req-b8e0bf7a-67d4-44f4-adeb-a3c4e49b73b0 service nova] Acquiring lock "ee961d5a-e0d1-4931-9293-eefbe638097a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:34:21 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-726438f8-92a6-4b83-b5a1-04ec29feda35 req-b8e0bf7a-67d4-44f4-adeb-a3c4e49b73b0 service nova] Lock "ee961d5a-e0d1-4931-9293-eefbe638097a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:34:21 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-726438f8-92a6-4b83-b5a1-04ec29feda35 req-b8e0bf7a-67d4-44f4-adeb-a3c4e49b73b0 service nova] Lock "ee961d5a-e0d1-4931-9293-eefbe638097a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:34:21 user nova-compute[75122]: DEBUG nova.compute.manager [req-726438f8-92a6-4b83-b5a1-04ec29feda35 req-b8e0bf7a-67d4-44f4-adeb-a3c4e49b73b0 service nova] [instance: ee961d5a-e0d1-4931-9293-eefbe638097a] No waiting events found dispatching network-vif-plugged-ae8a9c5e-17d1-4aa9-b3fa-b829d1dc6fd2 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:34:21 user nova-compute[75122]: WARNING nova.compute.manager [req-726438f8-92a6-4b83-b5a1-04ec29feda35 req-b8e0bf7a-67d4-44f4-adeb-a3c4e49b73b0 service nova] [instance: ee961d5a-e0d1-4931-9293-eefbe638097a] Received unexpected event network-vif-plugged-ae8a9c5e-17d1-4aa9-b3fa-b829d1dc6fd2 for instance with vm_state active and task_state resize_finish.
Nov 15 09:34:21 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:34:21 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:34:21 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:34:21 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:34:23 user nova-compute[75122]: DEBUG nova.compute.manager [req-2c3632bf-6412-4dc8-9f79-187b2dbbf735 req-8d9905d1-e720-45c0-ab76-f537263cda9c service nova] [instance: ee961d5a-e0d1-4931-9293-eefbe638097a] Received event network-vif-plugged-ae8a9c5e-17d1-4aa9-b3fa-b829d1dc6fd2 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:34:23 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-2c3632bf-6412-4dc8-9f79-187b2dbbf735 req-8d9905d1-e720-45c0-ab76-f537263cda9c service nova] Acquiring lock "ee961d5a-e0d1-4931-9293-eefbe638097a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:34:23 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-2c3632bf-6412-4dc8-9f79-187b2dbbf735 req-8d9905d1-e720-45c0-ab76-f537263cda9c service nova] Lock "ee961d5a-e0d1-4931-9293-eefbe638097a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:34:23 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-2c3632bf-6412-4dc8-9f79-187b2dbbf735 req-8d9905d1-e720-45c0-ab76-f537263cda9c service nova] Lock "ee961d5a-e0d1-4931-9293-eefbe638097a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:34:23 user nova-compute[75122]: DEBUG nova.compute.manager [req-2c3632bf-6412-4dc8-9f79-187b2dbbf735 req-8d9905d1-e720-45c0-ab76-f537263cda9c service nova] [instance: ee961d5a-e0d1-4931-9293-eefbe638097a] No waiting events found dispatching network-vif-plugged-ae8a9c5e-17d1-4aa9-b3fa-b829d1dc6fd2 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:34:23 user nova-compute[75122]: WARNING nova.compute.manager [req-2c3632bf-6412-4dc8-9f79-187b2dbbf735 req-8d9905d1-e720-45c0-ab76-f537263cda9c service nova] [instance: ee961d5a-e0d1-4931-9293-eefbe638097a] Received unexpected event network-vif-plugged-ae8a9c5e-17d1-4aa9-b3fa-b829d1dc6fd2 for instance with vm_state active and task_state resize_finish.
Nov 15 09:34:23 user nova-compute[75122]: DEBUG nova.compute.manager [None req-f6426bb2-74be-4a98-ada1-d54175831647 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] [instance: ee961d5a-e0d1-4931-9293-eefbe638097a] Instance event wait completed in 0 seconds for  {{(pid=75122) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 09:34:23 user nova-compute[75122]: INFO nova.virt.libvirt.driver [-] [instance: ee961d5a-e0d1-4931-9293-eefbe638097a] Instance running successfully.
Nov 15 09:34:23 user nova-compute[75122]: DEBUG nova.virt.libvirt.guest [None req-f6426bb2-74be-4a98-ada1-d54175831647 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] [instance: ee961d5a-e0d1-4931-9293-eefbe638097a] Failed to set time: agent not configured {{(pid=75122) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 15 09:34:23 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-f6426bb2-74be-4a98-ada1-d54175831647 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] [instance: ee961d5a-e0d1-4931-9293-eefbe638097a] finish_migration finished successfully. {{(pid=75122) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Nov 15 09:34:24 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:34:25 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:34:28 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] Acquiring lock "6a2fb361-de47-41c4-afa2-46f7107af1f4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:34:28 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] Lock "6a2fb361-de47-41c4-afa2-46f7107af1f4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:34:29 user nova-compute[75122]: DEBUG nova.compute.manager [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] Starting instance... {{(pid=75122) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 09:34:29 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:34:29 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:34:29 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75122) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 09:34:29 user nova-compute[75122]: INFO nova.compute.claims [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] Claim successful on node user
Nov 15 09:34:29 user nova-compute[75122]: DEBUG nova.compute.provider_tree [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] Inventory has not changed in ProviderTree for provider: 69a3da65-47be-44c6-b67c-c692b58284ef {{(pid=75122) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 09:34:29 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] Inventory has not changed for provider 69a3da65-47be-44c6-b67c-c692b58284ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 09:34:29 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.324s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:34:29 user nova-compute[75122]: DEBUG nova.compute.manager [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] Start building networks asynchronously for instance. {{(pid=75122) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 09:34:29 user nova-compute[75122]: DEBUG nova.compute.manager [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] Allocating IP information in the background. {{(pid=75122) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 09:34:29 user nova-compute[75122]: DEBUG nova.network.neutron [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] allocate_for_instance() {{(pid=75122) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 09:34:29 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 09:34:29 user nova-compute[75122]: DEBUG nova.compute.manager [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] Start building block device mappings for instance. {{(pid=75122) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 09:34:29 user nova-compute[75122]: INFO nova.virt.block_device [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] Booting with volume 697acd7d-564d-4149-9ecf-7c7d89f10013 at /dev/vda
Nov 15 09:34:29 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:34:29 user nova-compute[75122]: DEBUG os_brick.utils [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 09:34:29 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:34:29 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:34:29 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ca6d80f-b2ea-41bc-9deb-09c8352e8888]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:742fb64b3587\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:34:29 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:34:29 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:34:29 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[98f3f00e-807b-48ef-a308-4992cb22a887]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:34:29 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:34:29 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:34:29 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5ef21d8-62d1-4312-b1fc-7d28b7d649bc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:34:29 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed6349cc-6320-4019-b810-3ef7f0ade04e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:34:29 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] Running cmd (subprocess): nvme version {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:34:29 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] 'nvme version' failed. Not Retrying. {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 09:34:29 user nova-compute[75122]: DEBUG nova.policy [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '47d4e4c120fc40a994518ce384652a9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71b1beadf771447694e937ffa1453d56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75122) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 09:34:29 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.nvmeof [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] nvme not present on system {{(pid=75122) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 09:34:29 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:34:29 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 09:34:29 user nova-compute[75122]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 09:34:29 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d5e4112-2d90-4913-92e5-51121eb44529]: (4, '') {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:34:29 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.lightos [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75122) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 09:34:29 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.lightos [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75122) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 09:34:29 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.lightos [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] LIGHTOS: no hostnqn found. {{(pid=75122) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 09:34:29 user nova-compute[75122]: DEBUG os_brick.utils [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:742fb64b3587', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 09:34:29 user nova-compute[75122]: DEBUG nova.virt.block_device [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] Updating existing volume attachment record: 811c4d3b-6694-4aa2-b320-d8e7c77d627a {{(pid=75122) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 09:34:30 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:34:30 user nova-compute[75122]: DEBUG nova.network.neutron [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] Successfully created port: 3f2e7e15-d1e1-42b1-8cda-c0ec4cadff4a {{(pid=75122) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 09:34:31 user nova-compute[75122]: DEBUG nova.network.neutron [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] Successfully created port: 1cb107c5-bd60-4ce6-8da3-b6b15bd16ef1 {{(pid=75122) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 09:34:31 user nova-compute[75122]: DEBUG nova.network.neutron [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] Successfully created port: 2f92aaa6-98e2-4d75-8b96-92c08d77c635 {{(pid=75122) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 09:34:32 user nova-compute[75122]: DEBUG nova.network.neutron [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] Successfully created port: 598c4b32-243b-461b-b9a4-3a2ba2b7537b {{(pid=75122) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 09:34:32 user nova-compute[75122]: DEBUG nova.network.neutron [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] Successfully created port: 917da5e4-bdd2-40d9-9e03-b6f96858805b {{(pid=75122) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 09:34:33 user nova-compute[75122]: DEBUG nova.network.neutron [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] Successfully updated port: 3f2e7e15-d1e1-42b1-8cda-c0ec4cadff4a {{(pid=75122) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 09:34:33 user nova-compute[75122]: DEBUG nova.compute.manager [req-e56144c9-b951-46e1-9e6a-9ccbb0465c49 req-d7e8ccc0-6d5c-4584-a949-e66b9169f7c5 service nova] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] Received event network-changed-3f2e7e15-d1e1-42b1-8cda-c0ec4cadff4a {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:34:33 user nova-compute[75122]: DEBUG nova.compute.manager [req-e56144c9-b951-46e1-9e6a-9ccbb0465c49 req-d7e8ccc0-6d5c-4584-a949-e66b9169f7c5 service nova] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] Refreshing instance network info cache due to event network-changed-3f2e7e15-d1e1-42b1-8cda-c0ec4cadff4a. {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 09:34:33 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-e56144c9-b951-46e1-9e6a-9ccbb0465c49 req-d7e8ccc0-6d5c-4584-a949-e66b9169f7c5 service nova] Acquiring lock "refresh_cache-6a2fb361-de47-41c4-afa2-46f7107af1f4" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 09:34:33 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-e56144c9-b951-46e1-9e6a-9ccbb0465c49 req-d7e8ccc0-6d5c-4584-a949-e66b9169f7c5 service nova] Acquired lock "refresh_cache-6a2fb361-de47-41c4-afa2-46f7107af1f4" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 09:34:33 user nova-compute[75122]: DEBUG nova.network.neutron [req-e56144c9-b951-46e1-9e6a-9ccbb0465c49 req-d7e8ccc0-6d5c-4584-a949-e66b9169f7c5 service nova] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] Refreshing network info cache for port 3f2e7e15-d1e1-42b1-8cda-c0ec4cadff4a {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 09:34:33 user nova-compute[75122]: DEBUG nova.network.neutron [req-e56144c9-b951-46e1-9e6a-9ccbb0465c49 req-d7e8ccc0-6d5c-4584-a949-e66b9169f7c5 service nova] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] Instance cache missing network info. {{(pid=75122) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 09:34:33 user nova-compute[75122]: DEBUG nova.network.neutron [req-e56144c9-b951-46e1-9e6a-9ccbb0465c49 req-d7e8ccc0-6d5c-4584-a949-e66b9169f7c5 service nova] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] Updating instance_info_cache with network_info: [] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:34:33 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-e56144c9-b951-46e1-9e6a-9ccbb0465c49 req-d7e8ccc0-6d5c-4584-a949-e66b9169f7c5 service nova] Releasing lock "refresh_cache-6a2fb361-de47-41c4-afa2-46f7107af1f4" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 09:34:34 user nova-compute[75122]: DEBUG nova.network.neutron [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] Successfully updated port: ed761290-10dd-41fa-a1c6-479747e0b83d {{(pid=75122) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 09:34:34 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:34:34 user nova-compute[75122]: DEBUG nova.network.neutron [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] Successfully updated port: c357e948-986d-4592-a7c5-389bd6202867 {{(pid=75122) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 09:34:35 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:34:35 user nova-compute[75122]: INFO nova.virt.block_device [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] Booting with volume df76fc47-1a36-4bd6-97e6-bff6a6ead337 at /dev/vdb
Nov 15 09:34:35 user nova-compute[75122]: DEBUG os_brick.utils [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 09:34:35 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:34:35 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:34:35 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb38322d-f330-4ed3-b198-6b99d1df65dd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:742fb64b3587\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:34:35 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:34:35 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:34:35 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[56f724ae-3636-420f-b282-bfb690456b64]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:34:35 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:34:35 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:34:35 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[50e06e97-761e-43ed-bfd4-c544e46969cf]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:34:35 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[226f704d-4abd-47ad-8926-2f7b9468cbd4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:34:35 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] Running cmd (subprocess): nvme version {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:34:35 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] 'nvme version' failed. Not Retrying. {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 09:34:35 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.nvmeof [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] nvme not present on system {{(pid=75122) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 09:34:35 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:34:35 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 09:34:35 user nova-compute[75122]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 09:34:35 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f88d8f3-ff9c-4fd3-a24e-f502f9ce6a60]: (4, '') {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:34:35 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.lightos [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75122) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 09:34:35 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.lightos [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75122) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 09:34:35 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.lightos [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] LIGHTOS: no hostnqn found. {{(pid=75122) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 09:34:35 user nova-compute[75122]: DEBUG os_brick.utils [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] <== get_connector_properties: return (153ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:742fb64b3587', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 09:34:35 user nova-compute[75122]: DEBUG nova.virt.block_device [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] Updating existing volume attachment record: 86413609-944e-4f5e-8cff-fe9c91b04db3 {{(pid=75122) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 09:34:35 user nova-compute[75122]: DEBUG nova.compute.manager [req-9d7e983f-aee1-4302-be2b-95168ece92c9 req-4f55cf9e-7646-437f-ba97-d288fddfae80 service nova] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] Received event network-changed-ed761290-10dd-41fa-a1c6-479747e0b83d {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:34:35 user nova-compute[75122]: DEBUG nova.compute.manager [req-9d7e983f-aee1-4302-be2b-95168ece92c9 req-4f55cf9e-7646-437f-ba97-d288fddfae80 service nova] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] Refreshing instance network info cache due to event network-changed-ed761290-10dd-41fa-a1c6-479747e0b83d. {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 09:34:35 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-9d7e983f-aee1-4302-be2b-95168ece92c9 req-4f55cf9e-7646-437f-ba97-d288fddfae80 service nova] Acquiring lock "refresh_cache-6a2fb361-de47-41c4-afa2-46f7107af1f4" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 09:34:35 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-9d7e983f-aee1-4302-be2b-95168ece92c9 req-4f55cf9e-7646-437f-ba97-d288fddfae80 service nova] Acquired lock "refresh_cache-6a2fb361-de47-41c4-afa2-46f7107af1f4" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 09:34:35 user nova-compute[75122]: DEBUG nova.network.neutron [req-9d7e983f-aee1-4302-be2b-95168ece92c9 req-4f55cf9e-7646-437f-ba97-d288fddfae80 service nova] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] Refreshing network info cache for port ed761290-10dd-41fa-a1c6-479747e0b83d {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 09:34:35 user nova-compute[75122]: DEBUG nova.network.neutron [req-9d7e983f-aee1-4302-be2b-95168ece92c9 req-4f55cf9e-7646-437f-ba97-d288fddfae80 service nova] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] Instance cache missing network info. {{(pid=75122) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 09:34:35 user nova-compute[75122]: DEBUG nova.network.neutron [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] Successfully updated port: 1cb107c5-bd60-4ce6-8da3-b6b15bd16ef1 {{(pid=75122) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 09:34:35 user nova-compute[75122]: DEBUG nova.network.neutron [req-9d7e983f-aee1-4302-be2b-95168ece92c9 req-4f55cf9e-7646-437f-ba97-d288fddfae80 service nova] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] Updating instance_info_cache with network_info: [] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:34:35 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-9d7e983f-aee1-4302-be2b-95168ece92c9 req-4f55cf9e-7646-437f-ba97-d288fddfae80 service nova] Releasing lock "refresh_cache-6a2fb361-de47-41c4-afa2-46f7107af1f4" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 09:34:35 user nova-compute[75122]: DEBUG nova.compute.manager [req-9d7e983f-aee1-4302-be2b-95168ece92c9 req-4f55cf9e-7646-437f-ba97-d288fddfae80 service nova] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] Received event network-changed-c357e948-986d-4592-a7c5-389bd6202867 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:34:35 user nova-compute[75122]: DEBUG nova.compute.manager [req-9d7e983f-aee1-4302-be2b-95168ece92c9 req-4f55cf9e-7646-437f-ba97-d288fddfae80 service nova] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] Refreshing instance network info cache due to event network-changed-c357e948-986d-4592-a7c5-389bd6202867. {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 09:34:35 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-9d7e983f-aee1-4302-be2b-95168ece92c9 req-4f55cf9e-7646-437f-ba97-d288fddfae80 service nova] Acquiring lock "refresh_cache-6a2fb361-de47-41c4-afa2-46f7107af1f4" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 09:34:35 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-9d7e983f-aee1-4302-be2b-95168ece92c9 req-4f55cf9e-7646-437f-ba97-d288fddfae80 service nova] Acquired lock "refresh_cache-6a2fb361-de47-41c4-afa2-46f7107af1f4" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 09:34:35 user nova-compute[75122]: DEBUG nova.network.neutron [req-9d7e983f-aee1-4302-be2b-95168ece92c9 req-4f55cf9e-7646-437f-ba97-d288fddfae80 service nova] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] Refreshing network info cache for port c357e948-986d-4592-a7c5-389bd6202867 {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 09:34:35 user nova-compute[75122]: DEBUG nova.network.neutron [req-9d7e983f-aee1-4302-be2b-95168ece92c9 req-4f55cf9e-7646-437f-ba97-d288fddfae80 service nova] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] Instance cache missing network info. {{(pid=75122) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 09:34:36 user nova-compute[75122]: DEBUG nova.network.neutron [req-9d7e983f-aee1-4302-be2b-95168ece92c9 req-4f55cf9e-7646-437f-ba97-d288fddfae80 service nova] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] Updating instance_info_cache with network_info: [] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:34:36 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-9d7e983f-aee1-4302-be2b-95168ece92c9 req-4f55cf9e-7646-437f-ba97-d288fddfae80 service nova] Releasing lock "refresh_cache-6a2fb361-de47-41c4-afa2-46f7107af1f4" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 09:34:36 user nova-compute[75122]: DEBUG nova.network.neutron [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] Successfully updated port: 2f92aaa6-98e2-4d75-8b96-92c08d77c635 {{(pid=75122) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 09:34:37 user nova-compute[75122]: DEBUG nova.compute.manager [req-a82329b9-258c-4665-a0d4-168139d80405 req-41eeb56a-1736-44d6-8b5a-90c735ba7d2c service nova] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] Received event network-changed-1cb107c5-bd60-4ce6-8da3-b6b15bd16ef1 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:34:37 user nova-compute[75122]: DEBUG nova.compute.manager [req-a82329b9-258c-4665-a0d4-168139d80405 req-41eeb56a-1736-44d6-8b5a-90c735ba7d2c service nova] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] Refreshing instance network info cache due to event network-changed-1cb107c5-bd60-4ce6-8da3-b6b15bd16ef1. {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 09:34:37 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-a82329b9-258c-4665-a0d4-168139d80405 req-41eeb56a-1736-44d6-8b5a-90c735ba7d2c service nova] Acquiring lock "refresh_cache-6a2fb361-de47-41c4-afa2-46f7107af1f4" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 09:34:37 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-a82329b9-258c-4665-a0d4-168139d80405 req-41eeb56a-1736-44d6-8b5a-90c735ba7d2c service nova] Acquired lock "refresh_cache-6a2fb361-de47-41c4-afa2-46f7107af1f4" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 09:34:37 user nova-compute[75122]: DEBUG nova.network.neutron [req-a82329b9-258c-4665-a0d4-168139d80405 req-41eeb56a-1736-44d6-8b5a-90c735ba7d2c service nova] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] Refreshing network info cache for port 1cb107c5-bd60-4ce6-8da3-b6b15bd16ef1 {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 09:34:37 user nova-compute[75122]: DEBUG nova.network.neutron [req-a82329b9-258c-4665-a0d4-168139d80405 req-41eeb56a-1736-44d6-8b5a-90c735ba7d2c service nova] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] Instance cache missing network info. {{(pid=75122) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 09:34:37 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:34:37 user nova-compute[75122]: DEBUG nova.network.neutron [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] Successfully updated port: 598c4b32-243b-461b-b9a4-3a2ba2b7537b {{(pid=75122) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 09:34:38 user nova-compute[75122]: DEBUG nova.network.neutron [req-a82329b9-258c-4665-a0d4-168139d80405 req-41eeb56a-1736-44d6-8b5a-90c735ba7d2c service nova] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] Updating instance_info_cache with network_info: [] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:34:38 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-a82329b9-258c-4665-a0d4-168139d80405 req-41eeb56a-1736-44d6-8b5a-90c735ba7d2c service nova] Releasing lock "refresh_cache-6a2fb361-de47-41c4-afa2-46f7107af1f4" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 09:34:38 user nova-compute[75122]: DEBUG nova.compute.manager [req-a82329b9-258c-4665-a0d4-168139d80405 req-41eeb56a-1736-44d6-8b5a-90c735ba7d2c service nova] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] Received event network-changed-2f92aaa6-98e2-4d75-8b96-92c08d77c635 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:34:38 user nova-compute[75122]: DEBUG nova.compute.manager [req-a82329b9-258c-4665-a0d4-168139d80405 req-41eeb56a-1736-44d6-8b5a-90c735ba7d2c service nova] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] Refreshing instance network info cache due to event network-changed-2f92aaa6-98e2-4d75-8b96-92c08d77c635. {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 09:34:38 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-a82329b9-258c-4665-a0d4-168139d80405 req-41eeb56a-1736-44d6-8b5a-90c735ba7d2c service nova] Acquiring lock "refresh_cache-6a2fb361-de47-41c4-afa2-46f7107af1f4" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 09:34:38 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-a82329b9-258c-4665-a0d4-168139d80405 req-41eeb56a-1736-44d6-8b5a-90c735ba7d2c service nova] Acquired lock "refresh_cache-6a2fb361-de47-41c4-afa2-46f7107af1f4" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 09:34:38 user nova-compute[75122]: DEBUG nova.network.neutron [req-a82329b9-258c-4665-a0d4-168139d80405 req-41eeb56a-1736-44d6-8b5a-90c735ba7d2c service nova] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] Refreshing network info cache for port 2f92aaa6-98e2-4d75-8b96-92c08d77c635 {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 09:34:38 user nova-compute[75122]: DEBUG nova.network.neutron [req-a82329b9-258c-4665-a0d4-168139d80405 req-41eeb56a-1736-44d6-8b5a-90c735ba7d2c service nova] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] Instance cache missing network info. {{(pid=75122) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 09:34:38 user nova-compute[75122]: DEBUG nova.network.neutron [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] Successfully updated port: 917da5e4-bdd2-40d9-9e03-b6f96858805b {{(pid=75122) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 09:34:38 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] Acquiring lock "refresh_cache-6a2fb361-de47-41c4-afa2-46f7107af1f4" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 09:34:38 user nova-compute[75122]: DEBUG nova.network.neutron [req-a82329b9-258c-4665-a0d4-168139d80405 req-41eeb56a-1736-44d6-8b5a-90c735ba7d2c service nova] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] Updating instance_info_cache with network_info: [] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:34:38 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-a82329b9-258c-4665-a0d4-168139d80405 req-41eeb56a-1736-44d6-8b5a-90c735ba7d2c service nova] Releasing lock "refresh_cache-6a2fb361-de47-41c4-afa2-46f7107af1f4" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 09:34:38 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] Acquired lock "refresh_cache-6a2fb361-de47-41c4-afa2-46f7107af1f4" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 09:34:38 user nova-compute[75122]: DEBUG nova.network.neutron [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] Building network info cache for instance {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 09:34:38 user nova-compute[75122]: DEBUG nova.network.neutron [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] Instance cache missing network info. {{(pid=75122) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 09:34:39 user nova-compute[75122]: DEBUG nova.compute.manager [req-608c5ed6-3970-49d5-8db0-52c3c1a2930b req-cf54f84b-b056-4fa2-bfa3-cd79fbcee309 service nova] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] Received event network-changed-598c4b32-243b-461b-b9a4-3a2ba2b7537b {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:34:39 user nova-compute[75122]: DEBUG nova.compute.manager [req-608c5ed6-3970-49d5-8db0-52c3c1a2930b req-cf54f84b-b056-4fa2-bfa3-cd79fbcee309 service nova] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] Refreshing instance network info cache due to event network-changed-598c4b32-243b-461b-b9a4-3a2ba2b7537b. {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 09:34:39 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-608c5ed6-3970-49d5-8db0-52c3c1a2930b req-cf54f84b-b056-4fa2-bfa3-cd79fbcee309 service nova] Acquiring lock "refresh_cache-6a2fb361-de47-41c4-afa2-46f7107af1f4" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 09:34:39 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:34:40 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:34:40 user nova-compute[75122]: INFO nova.virt.block_device [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] Booting with volume b9022bc1-82d9-4e14-9d0e-85a8b645e512 at /dev/vdc
Nov 15 09:34:40 user nova-compute[75122]: DEBUG os_brick.utils [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 09:34:40 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:34:40 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:34:40 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffb8d27a-58c7-46e1-886e-12ff5f00e18a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:742fb64b3587\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:34:40 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:34:40 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:34:40 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba7a26d4-d5c9-401a-8dcd-c36933e49458]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:34:40 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:34:40 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:34:40 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d5ac521-3d1c-4e90-bcaa-0aced52e493e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:34:40 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[42c9b82e-feb3-47a8-9f11-3374298f9a00]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:34:40 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] Running cmd (subprocess): nvme version {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:34:40 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] 'nvme version' failed. Not Retrying. {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 09:34:40 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:34:40 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.nvmeof [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] nvme not present on system {{(pid=75122) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 09:34:40 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:34:40 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 09:34:40 user nova-compute[75122]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 09:34:40 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[5490df59-221c-44d3-b73a-3ca314a67bdd]: (4, '') {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:34:40 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.lightos [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75122) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 09:34:40 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.lightos [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75122) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 09:34:40 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.lightos [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] LIGHTOS: no hostnqn found. {{(pid=75122) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 09:34:40 user nova-compute[75122]: DEBUG os_brick.utils [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:742fb64b3587', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 09:34:40 user nova-compute[75122]: DEBUG nova.virt.block_device [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] Updating existing volume attachment record: 3f112066-f38e-498a-83da-cb106fb7a1a1 {{(pid=75122) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 09:34:41 user nova-compute[75122]: DEBUG nova.network.neutron [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] Updating instance_info_cache with network_info: [{"id": "3f2e7e15-d1e1-42b1-8cda-c0ec4cadff4a", "address": "fa:16:3e:dd:2a:39", "network": {"id": "2d3f0ed7-fd1f-4b58-9e19-c498613e096b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-737425118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71b1beadf771447694e937ffa1453d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f2e7e15-d1", "ovs_interfaceid": "3f2e7e15-d1e1-42b1-8cda-c0ec4cadff4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ed761290-10dd-41fa-a1c6-479747e0b83d", "address": "fa:16:3e:3b:ea:63", "network": {"id": "10809c12-a24e-41c8-ad4b-4ecab7ab24dd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1109444380", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.229", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "71b1beadf771447694e937ffa1453d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped761290-10", "ovs_interfaceid": "ed761290-10dd-41fa-a1c6-479747e0b83d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c357e948-986d-4592-a7c5-389bd6202867", "address": "fa:16:3e:0a:a9:a9", "network": {"id": "10809c12-a24e-41c8-ad4b-4ecab7ab24dd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1109444380", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.35", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "71b1beadf771447694e937ffa1453d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc357e948-98", "ovs_interfaceid": "c357e948-986d-4592-a7c5-389bd6202867", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1cb107c5-bd60-4ce6-8da3-b6b15bd16ef1", "address": "fa:16:3e:17:4f:64", "network": {"id": "10809c12-a24e-41c8-ad4b-4ecab7ab24dd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1109444380", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.24", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "71b1beadf771447694e937ffa1453d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cb107c5-bd", "ovs_interfaceid": "1cb107c5-bd60-4ce6-8da3-b6b15bd16ef1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2f92aaa6-98e2-4d75-8b96-92c08d77c635", "address": "fa:16:3e:b6:db:04", "network": {"id": "10809c12-a24e-41c8-ad4b-4ecab7ab24dd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1109444380", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.202", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "71b1beadf771447694e937ffa1453d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f92aaa6-98", "ovs_interfaceid": "2f92aaa6-98e2-4d75-8b96-92c08d77c635", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "598c4b32-243b-461b-b9a4-3a2ba2b7537b", "address": "fa:16:3e:3f:ce:07", "network": {"id": "217bd6f7-91ff-488f-855e-32d3a5268c46", "bridge": "br-int", "label": "tempest-device-tagging-net2-1686179832", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "71b1beadf771447694e937ffa1453d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap598c4b32-24", "ovs_interfaceid": "598c4b32-243b-461b-b9a4-3a2ba2b7537b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "917da5e4-bdd2-40d9-9e03-b6f96858805b", "address": "fa:16:3e:ce:f2:9a", "network": {"id": "217bd6f7-91ff-488f-855e-32d3a5268c46", "bridge": "br-int", "label": "tempest-device-tagging-net2-1686179832", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "71b1beadf771447694e937ffa1453d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap917da5e4-bd", "ovs_interfaceid": "917da5e4-bdd2-40d9-9e03-b6f96858805b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:34:41 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] Releasing lock "refresh_cache-6a2fb361-de47-41c4-afa2-46f7107af1f4" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 09:34:41 user nova-compute[75122]: DEBUG nova.compute.manager [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] Instance network_info: |[{"id": "3f2e7e15-d1e1-42b1-8cda-c0ec4cadff4a", "address": "fa:16:3e:dd:2a:39", "network": {"id": "2d3f0ed7-fd1f-4b58-9e19-c498613e096b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-737425118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71b1beadf771447694e937ffa1453d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f2e7e15-d1", "ovs_interfaceid": "3f2e7e15-d1e1-42b1-8cda-c0ec4cadff4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ed761290-10dd-41fa-a1c6-479747e0b83d", "address": "fa:16:3e:3b:ea:63", "network": {"id": "10809c12-a24e-41c8-ad4b-4ecab7ab24dd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1109444380", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.229", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "71b1beadf771447694e937ffa1453d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped761290-10", "ovs_interfaceid": "ed761290-10dd-41fa-a1c6-479747e0b83d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c357e948-986d-4592-a7c5-389bd6202867", "address": "fa:16:3e:0a:a9:a9", "network": {"id": "10809c12-a24e-41c8-ad4b-4ecab7ab24dd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1109444380", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.35", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "71b1beadf771447694e937ffa1453d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc357e948-98", "ovs_interfaceid": "c357e948-986d-4592-a7c5-389bd6202867", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1cb107c5-bd60-4ce6-8da3-b6b15bd16ef1", "address": "fa:16:3e:17:4f:64", "network": {"id": "10809c12-a24e-41c8-ad4b-4ecab7ab24dd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1109444380", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.24", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "71b1beadf771447694e937ffa1453d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cb107c5-bd", "ovs_interfaceid": "1cb107c5-bd60-4ce6-8da3-b6b15bd16ef1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2f92aaa6-98e2-4d75-8b96-92c08d77c635", "address": "fa:16:3e:b6:db:04", "network": {"id": "10809c12-a24e-41c8-ad4b-4ecab7ab24dd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1109444380", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.202", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "71b1beadf771447694e937ffa1453d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f92aaa6-98", "ovs_interfaceid": "2f92aaa6-98e2-4d75-8b96-92c08d77c635", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "598c4b32-243b-461b-b9a4-3a2ba2b7537b", "address": "fa:16:3e:3f:ce:07", "network": {"id": "217bd6f7-91ff-488f-855e-32d3a5268c46", "bridge": "br-int", "label": "tempest-device-tagging-net2-1686179832", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "71b1beadf771447694e937ffa1453d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap598c4b32-24", "ovs_interfaceid": "598c4b32-243b-461b-b9a4-3a2ba2b7537b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "917da5e4-bdd2-40d9-9e03-b6f96858805b", "address": "fa:16:3e:ce:f2:9a", "network": {"id": "217bd6f7-91ff-488f-855e-32d3a5268c46", "bridge": "br-int", "label": "tempest-device-tagging-net2-1686179832", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "71b1beadf771447694e937ffa1453d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap917da5e4-bd", "ovs_interfaceid": "917da5e4-bdd2-40d9-9e03-b6f96858805b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75122) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 09:34:41 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-608c5ed6-3970-49d5-8db0-52c3c1a2930b req-cf54f84b-b056-4fa2-bfa3-cd79fbcee309 service nova] Acquired lock "refresh_cache-6a2fb361-de47-41c4-afa2-46f7107af1f4" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 09:34:41 user nova-compute[75122]: DEBUG nova.network.neutron [req-608c5ed6-3970-49d5-8db0-52c3c1a2930b req-cf54f84b-b056-4fa2-bfa3-cd79fbcee309 service nova] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] Refreshing network info cache for port 598c4b32-243b-461b-b9a4-3a2ba2b7537b {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 09:34:41 user nova-compute[75122]: DEBUG nova.network.neutron [req-608c5ed6-3970-49d5-8db0-52c3c1a2930b req-cf54f84b-b056-4fa2-bfa3-cd79fbcee309 service nova] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] Updated VIF entry in instance network info cache for port 598c4b32-243b-461b-b9a4-3a2ba2b7537b. {{(pid=75122) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 09:34:41 user nova-compute[75122]: DEBUG nova.network.neutron [req-608c5ed6-3970-49d5-8db0-52c3c1a2930b req-cf54f84b-b056-4fa2-bfa3-cd79fbcee309 service nova] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] Updating instance_info_cache with network_info: [{"id": "3f2e7e15-d1e1-42b1-8cda-c0ec4cadff4a", "address": "fa:16:3e:dd:2a:39", "network": {"id": "2d3f0ed7-fd1f-4b58-9e19-c498613e096b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-737425118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71b1beadf771447694e937ffa1453d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f2e7e15-d1", "ovs_interfaceid": "3f2e7e15-d1e1-42b1-8cda-c0ec4cadff4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ed761290-10dd-41fa-a1c6-479747e0b83d", "address": "fa:16:3e:3b:ea:63", "network": {"id": "10809c12-a24e-41c8-ad4b-4ecab7ab24dd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1109444380", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.229", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "71b1beadf771447694e937ffa1453d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped761290-10", "ovs_interfaceid": "ed761290-10dd-41fa-a1c6-479747e0b83d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c357e948-986d-4592-a7c5-389bd6202867", "address": "fa:16:3e:0a:a9:a9", "network": {"id": "10809c12-a24e-41c8-ad4b-4ecab7ab24dd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1109444380", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.35", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "71b1beadf771447694e937ffa1453d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc357e948-98", "ovs_interfaceid": "c357e948-986d-4592-a7c5-389bd6202867", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1cb107c5-bd60-4ce6-8da3-b6b15bd16ef1", "address": "fa:16:3e:17:4f:64", "network": {"id": "10809c12-a24e-41c8-ad4b-4ecab7ab24dd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1109444380", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.24", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "71b1beadf771447694e937ffa1453d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cb107c5-bd", "ovs_interfaceid": "1cb107c5-bd60-4ce6-8da3-b6b15bd16ef1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2f92aaa6-98e2-4d75-8b96-92c08d77c635", "address": "fa:16:3e:b6:db:04", "network": {"id": "10809c12-a24e-41c8-ad4b-4ecab7ab24dd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1109444380", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.202", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "71b1beadf771447694e937ffa1453d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f92aaa6-98", "ovs_interfaceid": "2f92aaa6-98e2-4d75-8b96-92c08d77c635", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "598c4b32-243b-461b-b9a4-3a2ba2b7537b", "address": "fa:16:3e:3f:ce:07", "network": {"id": "217bd6f7-91ff-488f-855e-32d3a5268c46", "bridge": "br-int", "label": "tempest-device-tagging-net2-1686179832", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "71b1beadf771447694e937ffa1453d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap598c4b32-24", "ovs_interfaceid": "598c4b32-243b-461b-b9a4-3a2ba2b7537b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "917da5e4-bdd2-40d9-9e03-b6f96858805b", "address": "fa:16:3e:ce:f2:9a", "network": {"id": "217bd6f7-91ff-488f-855e-32d3a5268c46", "bridge": "br-int", "label": "tempest-device-tagging-net2-1686179832", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "71b1beadf771447694e937ffa1453d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap917da5e4-bd", "ovs_interfaceid": "917da5e4-bdd2-40d9-9e03-b6f96858805b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:34:41 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-608c5ed6-3970-49d5-8db0-52c3c1a2930b req-cf54f84b-b056-4fa2-bfa3-cd79fbcee309 service nova] Releasing lock "refresh_cache-6a2fb361-de47-41c4-afa2-46f7107af1f4" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 09:34:41 user nova-compute[75122]: DEBUG nova.compute.manager [req-608c5ed6-3970-49d5-8db0-52c3c1a2930b req-cf54f84b-b056-4fa2-bfa3-cd79fbcee309 service nova] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] Received event network-changed-917da5e4-bdd2-40d9-9e03-b6f96858805b {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:34:41 user nova-compute[75122]: DEBUG nova.compute.manager [req-608c5ed6-3970-49d5-8db0-52c3c1a2930b req-cf54f84b-b056-4fa2-bfa3-cd79fbcee309 service nova] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] Refreshing instance network info cache due to event network-changed-917da5e4-bdd2-40d9-9e03-b6f96858805b. {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 09:34:41 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-608c5ed6-3970-49d5-8db0-52c3c1a2930b req-cf54f84b-b056-4fa2-bfa3-cd79fbcee309 service nova] Acquiring lock "refresh_cache-6a2fb361-de47-41c4-afa2-46f7107af1f4" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 09:34:41 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-608c5ed6-3970-49d5-8db0-52c3c1a2930b req-cf54f84b-b056-4fa2-bfa3-cd79fbcee309 service nova] Acquired lock "refresh_cache-6a2fb361-de47-41c4-afa2-46f7107af1f4" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 09:34:41 user nova-compute[75122]: DEBUG nova.network.neutron [req-608c5ed6-3970-49d5-8db0-52c3c1a2930b req-cf54f84b-b056-4fa2-bfa3-cd79fbcee309 service nova] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] Refreshing network info cache for port 917da5e4-bdd2-40d9-9e03-b6f96858805b {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 09:34:42 user nova-compute[75122]: DEBUG nova.network.neutron [req-608c5ed6-3970-49d5-8db0-52c3c1a2930b req-cf54f84b-b056-4fa2-bfa3-cd79fbcee309 service nova] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] Updated VIF entry in instance network info cache for port 917da5e4-bdd2-40d9-9e03-b6f96858805b. {{(pid=75122) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 09:34:42 user nova-compute[75122]: DEBUG nova.network.neutron [req-608c5ed6-3970-49d5-8db0-52c3c1a2930b req-cf54f84b-b056-4fa2-bfa3-cd79fbcee309 service nova] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] Updating instance_info_cache with network_info: [{"id": "3f2e7e15-d1e1-42b1-8cda-c0ec4cadff4a", "address": "fa:16:3e:dd:2a:39", "network": {"id": "2d3f0ed7-fd1f-4b58-9e19-c498613e096b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-737425118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71b1beadf771447694e937ffa1453d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f2e7e15-d1", "ovs_interfaceid": "3f2e7e15-d1e1-42b1-8cda-c0ec4cadff4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ed761290-10dd-41fa-a1c6-479747e0b83d", "address": "fa:16:3e:3b:ea:63", "network": {"id": "10809c12-a24e-41c8-ad4b-4ecab7ab24dd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1109444380", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.229", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "71b1beadf771447694e937ffa1453d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped761290-10", "ovs_interfaceid": "ed761290-10dd-41fa-a1c6-479747e0b83d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c357e948-986d-4592-a7c5-389bd6202867", "address": "fa:16:3e:0a:a9:a9", "network": {"id": "10809c12-a24e-41c8-ad4b-4ecab7ab24dd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1109444380", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.35", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "71b1beadf771447694e937ffa1453d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc357e948-98", "ovs_interfaceid": "c357e948-986d-4592-a7c5-389bd6202867", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1cb107c5-bd60-4ce6-8da3-b6b15bd16ef1", "address": "fa:16:3e:17:4f:64", "network": {"id": "10809c12-a24e-41c8-ad4b-4ecab7ab24dd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1109444380", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.24", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "71b1beadf771447694e937ffa1453d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cb107c5-bd", "ovs_interfaceid": "1cb107c5-bd60-4ce6-8da3-b6b15bd16ef1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2f92aaa6-98e2-4d75-8b96-92c08d77c635", "address": "fa:16:3e:b6:db:04", "network": {"id": "10809c12-a24e-41c8-ad4b-4ecab7ab24dd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1109444380", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.202", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "71b1beadf771447694e937ffa1453d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f92aaa6-98", "ovs_interfaceid": "2f92aaa6-98e2-4d75-8b96-92c08d77c635", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "598c4b32-243b-461b-b9a4-3a2ba2b7537b", "address": "fa:16:3e:3f:ce:07", "network": {"id": "217bd6f7-91ff-488f-855e-32d3a5268c46", "bridge": "br-int", "label": "tempest-device-tagging-net2-1686179832", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "71b1beadf771447694e937ffa1453d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap598c4b32-24", "ovs_interfaceid": "598c4b32-243b-461b-b9a4-3a2ba2b7537b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "917da5e4-bdd2-40d9-9e03-b6f96858805b", "address": "fa:16:3e:ce:f2:9a", "network": {"id": "217bd6f7-91ff-488f-855e-32d3a5268c46", "bridge": "br-int", "label": "tempest-device-tagging-net2-1686179832", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "71b1beadf771447694e937ffa1453d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap917da5e4-bd", "ovs_interfaceid": "917da5e4-bdd2-40d9-9e03-b6f96858805b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:34:42 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-608c5ed6-3970-49d5-8db0-52c3c1a2930b req-cf54f84b-b056-4fa2-bfa3-cd79fbcee309 service nova] Releasing lock "refresh_cache-6a2fb361-de47-41c4-afa2-46f7107af1f4" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 09:34:43 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:34:43 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:34:44 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:34:45 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:34:46 user nova-compute[75122]: DEBUG nova.compute.manager [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] Start spawning the instance on the hypervisor. {{(pid=75122) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 09:34:46 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] Creating instance directory {{(pid=75122) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 09:34:46 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] Creating image(s)
Nov 15 09:34:46 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] Did not create local disks {{(pid=75122) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 09:34:46 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] Ensure instance console log exists: /opt/stack/data/nova/instances/6a2fb361-de47-41c4-afa2-46f7107af1f4/console.log {{(pid=75122) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 09:34:46 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:34:46 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:34:46 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:34:46 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] Start _get_guest_xml network_info=[{"id": "3f2e7e15-d1e1-42b1-8cda-c0ec4cadff4a", "address": "fa:16:3e:dd:2a:39", "network": {"id": "2d3f0ed7-fd1f-4b58-9e19-c498613e096b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-737425118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71b1beadf771447694e937ffa1453d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f2e7e15-d1", "ovs_interfaceid": "3f2e7e15-d1e1-42b1-8cda-c0ec4cadff4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ed761290-10dd-41fa-a1c6-479747e0b83d", "address": "fa:16:3e:3b:ea:63", "network": {"id": "10809c12-a24e-41c8-ad4b-4ecab7ab24dd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1109444380", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.229", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "71b1beadf771447694e937ffa1453d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped761290-10", "ovs_interfaceid": "ed761290-10dd-41fa-a1c6-479747e0b83d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c357e948-986d-4592-a7c5-389bd6202867", "address": "fa:16:3e:0a:a9:a9", "network": {"id": "10809c12-a24e-41c8-ad4b-4ecab7ab24dd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1109444380", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.35", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "71b1beadf771447694e937ffa1453d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc357e948-98", "ovs_interfaceid": "c357e948-986d-4592-a7c5-389bd6202867", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1cb107c5-bd60-4ce6-8da3-b6b15bd16ef1", "address": "fa:16:3e:17:4f:64", "network": {"id": "10809c12-a24e-41c8-ad4b-4ecab7ab24dd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1109444380", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.24", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "71b1beadf771447694e937ffa1453d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cb107c5-bd", "ovs_interfaceid": "1cb107c5-bd60-4ce6-8da3-b6b15bd16ef1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2f92aaa6-98e2-4d75-8b96-92c08d77c635", "address": "fa:16:3e:b6:db:04", "network": {"id": "10809c12-a24e-41c8-ad4b-4ecab7ab24dd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1109444380", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.202", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "71b1beadf771447694e937ffa1453d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f92aaa6-98", "ovs_interfaceid": "2f92aaa6-98e2-4d75-8b96-92c08d77c635", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "598c4b32-243b-461b-b9a4-3a2ba2b7537b", "address": "fa:16:3e:3f:ce:07", "network": {"id": "217bd6f7-91ff-488f-855e-32d3a5268c46", "bridge": "br-int", "label": "tempest-device-tagging-net2-1686179832", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "71b1beadf771447694e937ffa1453d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap598c4b32-24", "ovs_interfaceid": "598c4b32-243b-461b-b9a4-3a2ba2b7537b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "917da5e4-bdd2-40d9-9e03-b6f96858805b", "address": "fa:16:3e:ce:f2:9a", "network": {"id": "217bd6f7-91ff-488f-855e-32d3a5268c46", "bridge": "br-int", "label": "tempest-device-tagging-net2-1686179832", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "71b1beadf771447694e937ffa1453d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap917da5e4-bd", "ovs_interfaceid": "917da5e4-bdd2-40d9-9e03-b6f96858805b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T09:26:31Z,direct_url=<?>,disk_format='qcow2',id=5e862cfe-47b8-4725-8292-65761ee6d0f5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9c57733cb41847c0b4ad31519c382e5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T09:26:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:697acd7d-564d-4149-9ecf-7c7d89f10013', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vAcWakYy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '6a2fb361-de47-41c4-afa2-46f7107af1f4', 'attached_at': '', 'detached_at': '', 'volume_id': '697acd7d-564d-4149-9ecf-7c7d89f10013', 'serial': '697acd7d-564d-4149-9ecf-7c7d89f10013'}, 'guest_format': None, 'delete_on_termination': False, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vda', 'attachment_id': '811c4d3b-6694-4aa2-b320-d8e7c77d627a', 'volume_type': None}, {'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:df76fc47-1a36-4bd6-97e6-bff6a6ead337', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aVqcQmhZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '6a2fb361-de47-41c4-afa2-46f7107af1f4', 'attached_at': '', 'detached_at': '', 'volume_id': 'df76fc47-1a36-4bd6-97e6-bff6a6ead337', 'serial': 'df76fc47-1a36-4bd6-97e6-bff6a6ead337'}, 'guest_format': None, 'delete_on_termination': False, 'boot_index': 1, 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vdb', 'attachment_id': '86413609-944e-4f5e-8cff-fe9c91b04db3', 'volume_type': None}, {'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b9022bc1-82d9-4e14-9d0e-85a8b645e512', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'scRJzhVO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '6a2fb361-de47-41c4-afa2-46f7107af1f4', 'attached_at': '', 'detached_at': '', 'volume_id': 'b9022bc1-82d9-4e14-9d0e-85a8b645e512', 'serial': 'b9022bc1-82d9-4e14-9d0e-85a8b645e512'}, 'guest_format': None, 'delete_on_termination': False, 'boot_index': 2, 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vdc', 'attachment_id': '3f112066-f38e-498a-83da-cb106fb7a1a1', 'volume_type': None} {{(pid=75122) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 09:34:46 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 09:34:46 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 09:34:46 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75122) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 09:34:46 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] CPU controller missing on host. {{(pid=75122) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 09:34:46 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75122) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 09:34:46 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] CPU controller found on host. {{(pid=75122) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 09:34:46 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75122) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 09:34:46 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T09:26:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T09:26:31Z,direct_url=<?>,disk_format='qcow2',id=5e862cfe-47b8-4725-8292-65761ee6d0f5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9c57733cb41847c0b4ad31519c382e5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T09:26:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 09:34:46 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] Flavor limits 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 09:34:46 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] Image limits 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 09:34:46 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] Flavor pref 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 09:34:46 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] Image pref 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 09:34:46 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 09:34:46 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 09:34:46 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75122) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 09:34:46 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] Got 1 possible topologies {{(pid=75122) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 09:34:46 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 09:34:46 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 09:34:46 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] Calling os-brick to attach iSCSI Volume {{(pid=75122) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 09:34:46 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffa04060b80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:697acd7d-564d-4149-9ecf-7c7d89f10013', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vAcWakYy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 09:34:46 user nova-compute[75122]: WARNING os_brick.initiator.connectors.base [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 09:34:46 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 09:34:46 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 09:34:46 user nova-compute[75122]: WARNING os_brick.initiator.connectors.base [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 09:34:46 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:697acd7d-564d-4149-9ecf-7c7d89f10013" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 09:34:46 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:697acd7d-564d-4149-9ecf-7c7d89f10013" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 09:34:46 user nova-compute[75122]: INFO os_brick.initiator.connectors.iscsi [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 09:34:46 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:697acd7d-564d-4149-9ecf-7c7d89f10013 -p 172.16.0.220:3260 {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:34:46 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:697acd7d-564d-4149-9ecf-7c7d89f10013 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:34:46 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[f32cad32-c661-434e-90dc-0ec1e0f19728]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:34:46 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 09:34:46 user nova-compute[75122]:  {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:34:46 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:697acd7d-564d-4149-9ecf-7c7d89f10013 -p 172.16.0.220:3260 --interface default --op new {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:34:46 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:697acd7d-564d-4149-9ecf-7c7d89f10013 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:34:46 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea1da3ce-09f1-435e-970e-e9223a9d638e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:697acd7d-564d-4149-9ecf-7c7d89f10013] added\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:34:46 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:697acd7d-564d-4149-9ecf-7c7d89f10013] added
Nov 15 09:34:46 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:34:46 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:697acd7d-564d-4149-9ecf-7c7d89f10013 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:34:46 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:697acd7d-564d-4149-9ecf-7c7d89f10013 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:34:46 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[90b0d860-0e1c-4115-b4c7-c402ea268c49]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:34:46 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:34:46 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:697acd7d-564d-4149-9ecf-7c7d89f10013 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:34:46 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:697acd7d-564d-4149-9ecf-7c7d89f10013 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:34:46 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[f34f2960-36cc-4a30-b56d-c62a7156869b]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:34:46 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:34:46 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:697acd7d-564d-4149-9ecf-7c7d89f10013 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vAcWakYy {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:34:46 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:697acd7d-564d-4149-9ecf-7c7d89f10013 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vAcWakYy" returned: 0 in 0.024s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:34:46 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa4b27d7-bc17-423d-aabc-ff83ba33865d]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:34:46 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vAcWakYy'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:34:46 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:697acd7d-564d-4149-9ecf-7c7d89f10013 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:34:46 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:697acd7d-564d-4149-9ecf-7c7d89f10013 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:34:46 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[76ca4258-f120-4ed5-b3b5-8f29956c2afa]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:34:46 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:34:46 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:34:46 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:34:46 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6e74568-4f3e-4920-915d-658702eca8fe]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01563785-3767-460a-9815-c1bd0f7f6f9f (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bca4e77f-05f8-4ff6-8a78-6cef699f5667 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a8a33bb-713e-4109-8306-fe91fd67904f (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16 (non-flash)\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:34:46 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01563785-3767-460a-9815-c1bd0f7f6f9f (non-flash)
Nov 15 09:34:46 user nova-compute[75122]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bca4e77f-05f8-4ff6-8a78-6cef699f5667 (non-flash)
Nov 15 09:34:46 user nova-compute[75122]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a8a33bb-713e-4109-8306-fe91fd67904f (non-flash)
Nov 15 09:34:46 user nova-compute[75122]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16 (non-flash)
Nov 15 09:34:46 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 09:34:46 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01563785-3767-460a-9815-c1bd0f7f6f9f (non-flash)
Nov 15 09:34:46 user nova-compute[75122]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bca4e77f-05f8-4ff6-8a78-6cef699f5667 (non-flash)
Nov 15 09:34:46 user nova-compute[75122]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a8a33bb-713e-4109-8306-fe91fd67904f (non-flash)
Nov 15 09:34:46 user nova-compute[75122]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16 (non-flash)
Nov 15 09:34:46 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 09:34:46 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:697acd7d-564d-4149-9ecf-7c7d89f10013 -p 172.16.0.220:3260 --login {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:34:46 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:697acd7d-564d-4149-9ecf-7c7d89f10013 -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:34:46 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[68f39672-9140-4a72-a662-d5eedbb7004d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:697acd7d-564d-4149-9ecf-7c7d89f10013, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:697acd7d-564d-4149-9ecf-7c7d89f10013, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:34:46 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:697acd7d-564d-4149-9ecf-7c7d89f10013, portal: 172.16.0.220,3260]
Nov 15 09:34:46 user nova-compute[75122]: Login to [iface: default, target: iqn.2010-10.org.openstack:697acd7d-564d-4149-9ecf-7c7d89f10013, portal: 172.16.0.220,3260] successful.
Nov 15 09:34:46 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:34:46 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:697acd7d-564d-4149-9ecf-7c7d89f10013 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:34:46 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:697acd7d-564d-4149-9ecf-7c7d89f10013 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:34:46 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[30da891e-3d9b-47cb-b0e2-e1b8fd112d9f]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:34:46 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:34:46 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:34:46 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:34:46 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b0937ff-c684-4c35-b3fa-26098b7e4949]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01563785-3767-460a-9815-c1bd0f7f6f9f (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bca4e77f-05f8-4ff6-8a78-6cef699f5667 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a8a33bb-713e-4109-8306-fe91fd67904f (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:697acd7d-564d-4149-9ecf-7c7d89f10013 (non-flash)\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:34:46 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01563785-3767-460a-9815-c1bd0f7f6f9f (non-flash)
Nov 15 09:34:46 user nova-compute[75122]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bca4e77f-05f8-4ff6-8a78-6cef699f5667 (non-flash)
Nov 15 09:34:46 user nova-compute[75122]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a8a33bb-713e-4109-8306-fe91fd67904f (non-flash)
Nov 15 09:34:46 user nova-compute[75122]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16 (non-flash)
Nov 15 09:34:46 user nova-compute[75122]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:697acd7d-564d-4149-9ecf-7c7d89f10013 (non-flash)
Nov 15 09:34:46 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 09:34:46 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01563785-3767-460a-9815-c1bd0f7f6f9f (non-flash)
Nov 15 09:34:46 user nova-compute[75122]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bca4e77f-05f8-4ff6-8a78-6cef699f5667 (non-flash)
Nov 15 09:34:46 user nova-compute[75122]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a8a33bb-713e-4109-8306-fe91fd67904f (non-flash)
Nov 15 09:34:46 user nova-compute[75122]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16 (non-flash)
Nov 15 09:34:46 user nova-compute[75122]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:697acd7d-564d-4149-9ecf-7c7d89f10013 (non-flash)
Nov 15 09:34:46 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 09:34:46 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:697acd7d-564d-4149-9ecf-7c7d89f10013" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.316s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 09:34:46 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] Connected to 172.16.0.220:3260 {{(pid=75122) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 09:34:46 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] HCTL ('37', '-', '-', 0) found on session 18 with lun 0 {{(pid=75122) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 09:34:46 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75122) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 09:34:46 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:34:46 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.016s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:34:46 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a7d680f-26ab-410f-9dd0-b0b15008a760]: (4, ('- - 0', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:34:46 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] Searching for a device in session 18 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75122) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 09:34:46 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:697acd7d-564d-4149-9ecf-7c7d89f10013', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vAcWakYy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75122) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 09:34:47 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.354s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 09:34:47 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] <== connect_volume: return (1356ms) {'type': 'block', 'scsi_wwn': '23936633538393238', 'path': '/dev/sdf'} {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 09:34:47 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23936633538393238', 'path': '/dev/sdf'} {{(pid=75122) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 09:34:47 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] Calling os-brick to attach iSCSI Volume {{(pid=75122) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 09:34:47 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffa04060b80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:df76fc47-1a36-4bd6-97e6-bff6a6ead337', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aVqcQmhZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 09:34:47 user nova-compute[75122]: WARNING os_brick.initiator.connectors.base [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 09:34:47 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 09:34:47 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 09:34:47 user nova-compute[75122]: WARNING os_brick.initiator.connectors.base [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 09:34:47 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:df76fc47-1a36-4bd6-97e6-bff6a6ead337" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 09:34:47 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:df76fc47-1a36-4bd6-97e6-bff6a6ead337" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 09:34:47 user nova-compute[75122]: INFO os_brick.initiator.connectors.iscsi [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 09:34:47 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df76fc47-1a36-4bd6-97e6-bff6a6ead337 -p 172.16.0.220:3260 {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:34:47 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df76fc47-1a36-4bd6-97e6-bff6a6ead337 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:34:47 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea02a855-120b-461d-b13b-bf2a7f7e39ef]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:34:47 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 09:34:47 user nova-compute[75122]:  {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:34:47 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df76fc47-1a36-4bd6-97e6-bff6a6ead337 -p 172.16.0.220:3260 --interface default --op new {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:34:47 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df76fc47-1a36-4bd6-97e6-bff6a6ead337 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:34:47 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ccc5e1b-0883-4257-a0af-64b4da171f0d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:df76fc47-1a36-4bd6-97e6-bff6a6ead337] added\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:34:47 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:df76fc47-1a36-4bd6-97e6-bff6a6ead337] added
Nov 15 09:34:47 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:34:47 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df76fc47-1a36-4bd6-97e6-bff6a6ead337 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:34:47 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df76fc47-1a36-4bd6-97e6-bff6a6ead337 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:34:47 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[49124418-9def-4386-a931-175fc57064f5]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:34:47 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:34:47 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df76fc47-1a36-4bd6-97e6-bff6a6ead337 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:34:47 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df76fc47-1a36-4bd6-97e6-bff6a6ead337 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:34:47 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6a7a2e8-343d-4a6d-9d06-f3b3759c6f25]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:34:47 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:34:47 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df76fc47-1a36-4bd6-97e6-bff6a6ead337 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aVqcQmhZ {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:34:47 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df76fc47-1a36-4bd6-97e6-bff6a6ead337 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aVqcQmhZ" returned: 0 in 0.028s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:34:47 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[42959cf5-bc21-4377-9ca1-29a8801b0611]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:34:47 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'aVqcQmhZ'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:34:47 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df76fc47-1a36-4bd6-97e6-bff6a6ead337 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:34:47 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df76fc47-1a36-4bd6-97e6-bff6a6ead337 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:34:47 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b009cd2-9fc2-46a0-bae9-609ea7eda368]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:34:47 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:34:47 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:34:47 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:34:47 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c1f25d6-e405-473e-b538-b60397580386]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01563785-3767-460a-9815-c1bd0f7f6f9f (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bca4e77f-05f8-4ff6-8a78-6cef699f5667 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a8a33bb-713e-4109-8306-fe91fd67904f (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:697acd7d-564d-4149-9ecf-7c7d89f10013 (non-flash)\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:34:47 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01563785-3767-460a-9815-c1bd0f7f6f9f (non-flash)
Nov 15 09:34:47 user nova-compute[75122]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bca4e77f-05f8-4ff6-8a78-6cef699f5667 (non-flash)
Nov 15 09:34:47 user nova-compute[75122]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a8a33bb-713e-4109-8306-fe91fd67904f (non-flash)
Nov 15 09:34:47 user nova-compute[75122]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16 (non-flash)
Nov 15 09:34:47 user nova-compute[75122]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:697acd7d-564d-4149-9ecf-7c7d89f10013 (non-flash)
Nov 15 09:34:47 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 09:34:47 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01563785-3767-460a-9815-c1bd0f7f6f9f (non-flash)
Nov 15 09:34:47 user nova-compute[75122]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bca4e77f-05f8-4ff6-8a78-6cef699f5667 (non-flash)
Nov 15 09:34:47 user nova-compute[75122]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a8a33bb-713e-4109-8306-fe91fd67904f (non-flash)
Nov 15 09:34:47 user nova-compute[75122]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16 (non-flash)
Nov 15 09:34:47 user nova-compute[75122]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:697acd7d-564d-4149-9ecf-7c7d89f10013 (non-flash)
Nov 15 09:34:47 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 09:34:47 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df76fc47-1a36-4bd6-97e6-bff6a6ead337 -p 172.16.0.220:3260 --login {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:34:47 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df76fc47-1a36-4bd6-97e6-bff6a6ead337 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:34:47 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca99f213-bfa6-4c69-82f4-55c2afbadb46]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:df76fc47-1a36-4bd6-97e6-bff6a6ead337, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:df76fc47-1a36-4bd6-97e6-bff6a6ead337, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:34:47 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:df76fc47-1a36-4bd6-97e6-bff6a6ead337, portal: 172.16.0.220,3260]
Nov 15 09:34:47 user nova-compute[75122]: Login to [iface: default, target: iqn.2010-10.org.openstack:df76fc47-1a36-4bd6-97e6-bff6a6ead337, portal: 172.16.0.220,3260] successful.
Nov 15 09:34:47 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:34:47 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df76fc47-1a36-4bd6-97e6-bff6a6ead337 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:34:47 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df76fc47-1a36-4bd6-97e6-bff6a6ead337 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.031s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:34:47 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[9738dc25-ddd1-4cb6-94e3-91d854d9494d]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:34:47 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:34:47 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:34:47 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:34:47 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c93bfff-b41d-4854-971f-7a5a88b10c80]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01563785-3767-460a-9815-c1bd0f7f6f9f (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bca4e77f-05f8-4ff6-8a78-6cef699f5667 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a8a33bb-713e-4109-8306-fe91fd67904f (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:697acd7d-564d-4149-9ecf-7c7d89f10013 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df76fc47-1a36-4bd6-97e6-bff6a6ead337 (non-flash)\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:34:47 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01563785-3767-460a-9815-c1bd0f7f6f9f (non-flash)
Nov 15 09:34:47 user nova-compute[75122]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bca4e77f-05f8-4ff6-8a78-6cef699f5667 (non-flash)
Nov 15 09:34:47 user nova-compute[75122]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a8a33bb-713e-4109-8306-fe91fd67904f (non-flash)
Nov 15 09:34:47 user nova-compute[75122]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16 (non-flash)
Nov 15 09:34:47 user nova-compute[75122]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:697acd7d-564d-4149-9ecf-7c7d89f10013 (non-flash)
Nov 15 09:34:47 user nova-compute[75122]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df76fc47-1a36-4bd6-97e6-bff6a6ead337 (non-flash)
Nov 15 09:34:47 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 09:34:47 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01563785-3767-460a-9815-c1bd0f7f6f9f (non-flash)
Nov 15 09:34:47 user nova-compute[75122]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bca4e77f-05f8-4ff6-8a78-6cef699f5667 (non-flash)
Nov 15 09:34:47 user nova-compute[75122]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a8a33bb-713e-4109-8306-fe91fd67904f (non-flash)
Nov 15 09:34:47 user nova-compute[75122]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16 (non-flash)
Nov 15 09:34:47 user nova-compute[75122]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:697acd7d-564d-4149-9ecf-7c7d89f10013 (non-flash)
Nov 15 09:34:47 user nova-compute[75122]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df76fc47-1a36-4bd6-97e6-bff6a6ead337 (non-flash)
Nov 15 09:34:47 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 09:34:47 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:df76fc47-1a36-4bd6-97e6-bff6a6ead337" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.318s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 09:34:47 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] Connected to 172.16.0.220:3260 {{(pid=75122) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 09:34:47 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] HCTL ('38', '-', '-', 0) found on session 19 with lun 0 {{(pid=75122) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 09:34:47 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75122) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 09:34:47 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:34:47 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.024s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:34:47 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d74382b-1034-411e-aa35-04f01f878ba4]: (4, ('- - 0', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:34:47 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] Searching for a device in session 19 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75122) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 09:34:47 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:df76fc47-1a36-4bd6-97e6-bff6a6ead337', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aVqcQmhZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75122) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 09:34:48 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.365s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 09:34:48 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] <== connect_volume: return (1367ms) {'type': 'block', 'scsi_wwn': '26437613834366132', 'path': '/dev/sdg'} {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 09:34:48 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26437613834366132', 'path': '/dev/sdg'} {{(pid=75122) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 09:34:49 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] Calling os-brick to attach iSCSI Volume {{(pid=75122) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 09:34:49 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffa04060b80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b9022bc1-82d9-4e14-9d0e-85a8b645e512', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'scRJzhVO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 09:34:49 user nova-compute[75122]: WARNING os_brick.initiator.connectors.base [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 09:34:49 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 09:34:49 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 09:34:49 user nova-compute[75122]: WARNING os_brick.initiator.connectors.base [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 09:34:49 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b9022bc1-82d9-4e14-9d0e-85a8b645e512" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 09:34:49 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b9022bc1-82d9-4e14-9d0e-85a8b645e512" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 09:34:49 user nova-compute[75122]: INFO os_brick.initiator.connectors.iscsi [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 09:34:49 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9022bc1-82d9-4e14-9d0e-85a8b645e512 -p 172.16.0.220:3260 {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:34:49 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9022bc1-82d9-4e14-9d0e-85a8b645e512 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:34:49 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[316ec54c-63ce-4115-8c74-13dc236f0ea8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:34:49 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 09:34:49 user nova-compute[75122]:  {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:34:49 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9022bc1-82d9-4e14-9d0e-85a8b645e512 -p 172.16.0.220:3260 --interface default --op new {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:34:49 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9022bc1-82d9-4e14-9d0e-85a8b645e512 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:34:49 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[359b23e2-e78d-4726-aaf5-31b0e1c7da11]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b9022bc1-82d9-4e14-9d0e-85a8b645e512] added\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:34:49 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b9022bc1-82d9-4e14-9d0e-85a8b645e512] added
Nov 15 09:34:49 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:34:49 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9022bc1-82d9-4e14-9d0e-85a8b645e512 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:34:49 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9022bc1-82d9-4e14-9d0e-85a8b645e512 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:34:49 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[64341369-e263-4cf6-8339-dd8a9da8fb56]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:34:49 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:34:49 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9022bc1-82d9-4e14-9d0e-85a8b645e512 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:34:49 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9022bc1-82d9-4e14-9d0e-85a8b645e512 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:34:49 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8d8c621-1ab7-438c-95d7-c4803c777db9]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:34:49 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:34:49 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9022bc1-82d9-4e14-9d0e-85a8b645e512 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v scRJzhVO {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:34:49 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9022bc1-82d9-4e14-9d0e-85a8b645e512 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v scRJzhVO" returned: 0 in 0.020s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:34:49 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[d835566a-ae1b-4a28-946a-18e4634d21de]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:34:49 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'scRJzhVO'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:34:49 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9022bc1-82d9-4e14-9d0e-85a8b645e512 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:34:49 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9022bc1-82d9-4e14-9d0e-85a8b645e512 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:34:49 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[49a089f3-b6ac-406d-bdc0-696140870ff1]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:34:49 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:34:49 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:34:49 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:34:49 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[69f367c6-2c38-407f-bccf-99b9fdb42078]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01563785-3767-460a-9815-c1bd0f7f6f9f (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bca4e77f-05f8-4ff6-8a78-6cef699f5667 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a8a33bb-713e-4109-8306-fe91fd67904f (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:697acd7d-564d-4149-9ecf-7c7d89f10013 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df76fc47-1a36-4bd6-97e6-bff6a6ead337 (non-flash)\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:34:49 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01563785-3767-460a-9815-c1bd0f7f6f9f (non-flash)
Nov 15 09:34:49 user nova-compute[75122]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bca4e77f-05f8-4ff6-8a78-6cef699f5667 (non-flash)
Nov 15 09:34:49 user nova-compute[75122]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a8a33bb-713e-4109-8306-fe91fd67904f (non-flash)
Nov 15 09:34:49 user nova-compute[75122]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16 (non-flash)
Nov 15 09:34:49 user nova-compute[75122]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:697acd7d-564d-4149-9ecf-7c7d89f10013 (non-flash)
Nov 15 09:34:49 user nova-compute[75122]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df76fc47-1a36-4bd6-97e6-bff6a6ead337 (non-flash)
Nov 15 09:34:49 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 09:34:49 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01563785-3767-460a-9815-c1bd0f7f6f9f (non-flash)
Nov 15 09:34:49 user nova-compute[75122]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bca4e77f-05f8-4ff6-8a78-6cef699f5667 (non-flash)
Nov 15 09:34:49 user nova-compute[75122]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a8a33bb-713e-4109-8306-fe91fd67904f (non-flash)
Nov 15 09:34:49 user nova-compute[75122]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16 (non-flash)
Nov 15 09:34:49 user nova-compute[75122]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:697acd7d-564d-4149-9ecf-7c7d89f10013 (non-flash)
Nov 15 09:34:49 user nova-compute[75122]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df76fc47-1a36-4bd6-97e6-bff6a6ead337 (non-flash)
Nov 15 09:34:49 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 09:34:49 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9022bc1-82d9-4e14-9d0e-85a8b645e512 -p 172.16.0.220:3260 --login {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:34:49 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9022bc1-82d9-4e14-9d0e-85a8b645e512 -p 172.16.0.220:3260 --login" returned: 0 in 0.095s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:34:49 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ae0eb3c-72d7-4506-95c1-ebf875b7a172]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b9022bc1-82d9-4e14-9d0e-85a8b645e512, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b9022bc1-82d9-4e14-9d0e-85a8b645e512, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:34:49 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b9022bc1-82d9-4e14-9d0e-85a8b645e512, portal: 172.16.0.220,3260]
Nov 15 09:34:49 user nova-compute[75122]: Login to [iface: default, target: iqn.2010-10.org.openstack:b9022bc1-82d9-4e14-9d0e-85a8b645e512, portal: 172.16.0.220,3260] successful.
Nov 15 09:34:49 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:34:49 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9022bc1-82d9-4e14-9d0e-85a8b645e512 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:34:49 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9022bc1-82d9-4e14-9d0e-85a8b645e512 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:34:49 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[a54f6970-9cec-4d5d-bd42-2f023ccfd821]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:34:49 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:34:49 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:34:49 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:34:49 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[206d54f7-3b79-4693-83b0-dba55a57d4bf]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01563785-3767-460a-9815-c1bd0f7f6f9f (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bca4e77f-05f8-4ff6-8a78-6cef699f5667 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a8a33bb-713e-4109-8306-fe91fd67904f (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:697acd7d-564d-4149-9ecf-7c7d89f10013 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df76fc47-1a36-4bd6-97e6-bff6a6ead337 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9022bc1-82d9-4e14-9d0e-85a8b645e512 (non-flash)\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:34:49 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01563785-3767-460a-9815-c1bd0f7f6f9f (non-flash)
Nov 15 09:34:49 user nova-compute[75122]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bca4e77f-05f8-4ff6-8a78-6cef699f5667 (non-flash)
Nov 15 09:34:49 user nova-compute[75122]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a8a33bb-713e-4109-8306-fe91fd67904f (non-flash)
Nov 15 09:34:49 user nova-compute[75122]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16 (non-flash)
Nov 15 09:34:49 user nova-compute[75122]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:697acd7d-564d-4149-9ecf-7c7d89f10013 (non-flash)
Nov 15 09:34:49 user nova-compute[75122]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df76fc47-1a36-4bd6-97e6-bff6a6ead337 (non-flash)
Nov 15 09:34:49 user nova-compute[75122]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9022bc1-82d9-4e14-9d0e-85a8b645e512 (non-flash)
Nov 15 09:34:49 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 09:34:49 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01563785-3767-460a-9815-c1bd0f7f6f9f (non-flash)
Nov 15 09:34:49 user nova-compute[75122]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bca4e77f-05f8-4ff6-8a78-6cef699f5667 (non-flash)
Nov 15 09:34:49 user nova-compute[75122]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a8a33bb-713e-4109-8306-fe91fd67904f (non-flash)
Nov 15 09:34:49 user nova-compute[75122]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16 (non-flash)
Nov 15 09:34:49 user nova-compute[75122]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:697acd7d-564d-4149-9ecf-7c7d89f10013 (non-flash)
Nov 15 09:34:49 user nova-compute[75122]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df76fc47-1a36-4bd6-97e6-bff6a6ead337 (non-flash)
Nov 15 09:34:49 user nova-compute[75122]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9022bc1-82d9-4e14-9d0e-85a8b645e512 (non-flash)
Nov 15 09:34:49 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 09:34:49 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b9022bc1-82d9-4e14-9d0e-85a8b645e512" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.360s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 09:34:49 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] Connected to 172.16.0.220:3260 {{(pid=75122) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 09:34:49 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] HCTL ('39', '-', '-', 0) found on session 20 with lun 0 {{(pid=75122) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 09:34:49 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=75122) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 09:34:49 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:34:49 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.022s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:34:49 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c3bd5b1-94f3-44e4-af00-0473b0180a20]: (4, ('- - 0', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:34:49 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] Searching for a device in session 20 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=75122) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 09:34:49 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:b9022bc1-82d9-4e14-9d0e-85a8b645e512', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'scRJzhVO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75122) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 09:34:49 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:34:50 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:34:50 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:34:50 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.419s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 09:34:50 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] <== connect_volume: return (1421ms) {'type': 'block', 'scsi_wwn': '23163313461616662', 'path': '/dev/sdh'} {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 09:34:50 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23163313461616662', 'path': '/dev/sdh'} {{(pid=75122) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 09:34:50 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T09:34:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-779991034',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-779991034',id=13,image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNtzm4oVqy6sf0O7KeIxwJ4JdwiWvUadSQZ0XPCSfdRAZRCJOKze9wXnBI4mMiHsO2k8q5mphaM2/2fNINKbO0ntvDQnZmJp/47MBtzunoCAm54iLS2xZb0FtbX4Gq2CEQ==',key_name='tempest-keypair-985108224',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='71b1beadf771447694e937ffa1453d56',ramdisk_id='',reservation_id='r-cviciewg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1167502079',owner_user_name='tempest-TaggedBootDevicesTest_v242-1167502079-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T09:34:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='47d4e4c120fc40a994518ce384652a9b',uuid=6a2fb361-de47-41c4-afa2-46f7107af1f4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3f2e7e15-d1e1-42b1-8cda-c0ec4cadff4a", "address": "fa:16:3e:dd:2a:39", "network": {"id": "2d3f0ed7-fd1f-4b58-9e19-c498613e096b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-737425118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71b1beadf771447694e937ffa1453d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f2e7e15-d1", "ovs_interfaceid": "3f2e7e15-d1e1-42b1-8cda-c0ec4cadff4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75122) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 09:34:50 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] Converting VIF {"id": "3f2e7e15-d1e1-42b1-8cda-c0ec4cadff4a", "address": "fa:16:3e:dd:2a:39", "network": {"id": "2d3f0ed7-fd1f-4b58-9e19-c498613e096b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-737425118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71b1beadf771447694e937ffa1453d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f2e7e15-d1", "ovs_interfaceid": "3f2e7e15-d1e1-42b1-8cda-c0ec4cadff4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 09:34:50 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:2a:39,bridge_name='br-int',has_traffic_filtering=True,id=3f2e7e15-d1e1-42b1-8cda-c0ec4cadff4a,network=Network(2d3f0ed7-fd1f-4b58-9e19-c498613e096b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f2e7e15-d1') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 09:34:50 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T09:34:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-779991034',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-779991034',id=13,image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNtzm4oVqy6sf0O7KeIxwJ4JdwiWvUadSQZ0XPCSfdRAZRCJOKze9wXnBI4mMiHsO2k8q5mphaM2/2fNINKbO0ntvDQnZmJp/47MBtzunoCAm54iLS2xZb0FtbX4Gq2CEQ==',key_name='tempest-keypair-985108224',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='71b1beadf771447694e937ffa1453d56',ramdisk_id='',reservation_id='r-cviciewg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1167502079',owner_user_name='tempest-TaggedBootDevicesTest_v242-1167502079-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T09:34:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='47d4e4c120fc40a994518ce384652a9b',uuid=6a2fb361-de47-41c4-afa2-46f7107af1f4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ed761290-10dd-41fa-a1c6-479747e0b83d", "address": "fa:16:3e:3b:ea:63", "network": {"id": "10809c12-a24e-41c8-ad4b-4ecab7ab24dd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1109444380", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.229", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "71b1beadf771447694e937ffa1453d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped761290-10", "ovs_interfaceid": "ed761290-10dd-41fa-a1c6-479747e0b83d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75122) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 09:34:50 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] Converting VIF {"id": "ed761290-10dd-41fa-a1c6-479747e0b83d", "address": "fa:16:3e:3b:ea:63", "network": {"id": "10809c12-a24e-41c8-ad4b-4ecab7ab24dd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1109444380", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.229", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "71b1beadf771447694e937ffa1453d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped761290-10", "ovs_interfaceid": "ed761290-10dd-41fa-a1c6-479747e0b83d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 09:34:50 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:ea:63,bridge_name='br-int',has_traffic_filtering=True,id=ed761290-10dd-41fa-a1c6-479747e0b83d,network=Network(10809c12-a24e-41c8-ad4b-4ecab7ab24dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='taped761290-10') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 09:34:50 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T09:34:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-779991034',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-779991034',id=13,image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNtzm4oVqy6sf0O7KeIxwJ4JdwiWvUadSQZ0XPCSfdRAZRCJOKze9wXnBI4mMiHsO2k8q5mphaM2/2fNINKbO0ntvDQnZmJp/47MBtzunoCAm54iLS2xZb0FtbX4Gq2CEQ==',key_name='tempest-keypair-985108224',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='71b1beadf771447694e937ffa1453d56',ramdisk_id='',reservation_id='r-cviciewg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1167502079',owner_user_name='tempest-TaggedBootDevicesTest_v242-1167502079-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T09:34:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='47d4e4c120fc40a994518ce384652a9b',uuid=6a2fb361-de47-41c4-afa2-46f7107af1f4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c357e948-986d-4592-a7c5-389bd6202867", "address": "fa:16:3e:0a:a9:a9", "network": {"id": "10809c12-a24e-41c8-ad4b-4ecab7ab24dd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1109444380", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.35", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "71b1beadf771447694e937ffa1453d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc357e948-98", "ovs_interfaceid": "c357e948-986d-4592-a7c5-389bd6202867", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75122) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 09:34:50 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] Converting VIF {"id": "c357e948-986d-4592-a7c5-389bd6202867", "address": "fa:16:3e:0a:a9:a9", "network": {"id": "10809c12-a24e-41c8-ad4b-4ecab7ab24dd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1109444380", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.35", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "71b1beadf771447694e937ffa1453d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc357e948-98", "ovs_interfaceid": "c357e948-986d-4592-a7c5-389bd6202867", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 09:34:50 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0a:a9:a9,bridge_name='br-int',has_traffic_filtering=True,id=c357e948-986d-4592-a7c5-389bd6202867,network=Network(10809c12-a24e-41c8-ad4b-4ecab7ab24dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc357e948-98') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 09:34:50 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T09:34:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-779991034',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-779991034',id=13,image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNtzm4oVqy6sf0O7KeIxwJ4JdwiWvUadSQZ0XPCSfdRAZRCJOKze9wXnBI4mMiHsO2k8q5mphaM2/2fNINKbO0ntvDQnZmJp/47MBtzunoCAm54iLS2xZb0FtbX4Gq2CEQ==',key_name='tempest-keypair-985108224',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='71b1beadf771447694e937ffa1453d56',ramdisk_id='',reservation_id='r-cviciewg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1167502079',owner_user_name='tempest-TaggedBootDevicesTest_v242-1167502079-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T09:34:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='47d4e4c120fc40a994518ce384652a9b',uuid=6a2fb361-de47-41c4-afa2-46f7107af1f4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1cb107c5-bd60-4ce6-8da3-b6b15bd16ef1", "address": "fa:16:3e:17:4f:64", "network": {"id": "10809c12-a24e-41c8-ad4b-4ecab7ab24dd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1109444380", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.24", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "71b1beadf771447694e937ffa1453d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cb107c5-bd", "ovs_interfaceid": "1cb107c5-bd60-4ce6-8da3-b6b15bd16ef1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75122) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 09:34:50 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] Converting VIF {"id": "1cb107c5-bd60-4ce6-8da3-b6b15bd16ef1", "address": "fa:16:3e:17:4f:64", "network": {"id": "10809c12-a24e-41c8-ad4b-4ecab7ab24dd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1109444380", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.24", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "71b1beadf771447694e937ffa1453d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cb107c5-bd", "ovs_interfaceid": "1cb107c5-bd60-4ce6-8da3-b6b15bd16ef1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 09:34:50 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:4f:64,bridge_name='br-int',has_traffic_filtering=True,id=1cb107c5-bd60-4ce6-8da3-b6b15bd16ef1,network=Network(10809c12-a24e-41c8-ad4b-4ecab7ab24dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1cb107c5-bd') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 09:34:50 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T09:34:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-779991034',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-779991034',id=13,image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNtzm4oVqy6sf0O7KeIxwJ4JdwiWvUadSQZ0XPCSfdRAZRCJOKze9wXnBI4mMiHsO2k8q5mphaM2/2fNINKbO0ntvDQnZmJp/47MBtzunoCAm54iLS2xZb0FtbX4Gq2CEQ==',key_name='tempest-keypair-985108224',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='71b1beadf771447694e937ffa1453d56',ramdisk_id='',reservation_id='r-cviciewg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1167502079',owner_user_name='tempest-TaggedBootDevicesTest_v242-1167502079-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T09:34:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='47d4e4c120fc40a994518ce384652a9b',uuid=6a2fb361-de47-41c4-afa2-46f7107af1f4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2f92aaa6-98e2-4d75-8b96-92c08d77c635", "address": "fa:16:3e:b6:db:04", "network": {"id": "10809c12-a24e-41c8-ad4b-4ecab7ab24dd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1109444380", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.202", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "71b1beadf771447694e937ffa1453d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f92aaa6-98", "ovs_interfaceid": "2f92aaa6-98e2-4d75-8b96-92c08d77c635", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75122) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 09:34:50 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] Converting VIF {"id": "2f92aaa6-98e2-4d75-8b96-92c08d77c635", "address": "fa:16:3e:b6:db:04", "network": {"id": "10809c12-a24e-41c8-ad4b-4ecab7ab24dd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1109444380", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.202", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "71b1beadf771447694e937ffa1453d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f92aaa6-98", "ovs_interfaceid": "2f92aaa6-98e2-4d75-8b96-92c08d77c635", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 09:34:50 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:db:04,bridge_name='br-int',has_traffic_filtering=True,id=2f92aaa6-98e2-4d75-8b96-92c08d77c635,network=Network(10809c12-a24e-41c8-ad4b-4ecab7ab24dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f92aaa6-98') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 09:34:50 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T09:34:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-779991034',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-779991034',id=13,image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNtzm4oVqy6sf0O7KeIxwJ4JdwiWvUadSQZ0XPCSfdRAZRCJOKze9wXnBI4mMiHsO2k8q5mphaM2/2fNINKbO0ntvDQnZmJp/47MBtzunoCAm54iLS2xZb0FtbX4Gq2CEQ==',key_name='tempest-keypair-985108224',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='71b1beadf771447694e937ffa1453d56',ramdisk_id='',reservation_id='r-cviciewg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1167502079',owner_user_name='tempest-TaggedBootDevicesTest_v242-1167502079-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T09:34:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='47d4e4c120fc40a994518ce384652a9b',uuid=6a2fb361-de47-41c4-afa2-46f7107af1f4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "598c4b32-243b-461b-b9a4-3a2ba2b7537b", "address": "fa:16:3e:3f:ce:07", "network": {"id": "217bd6f7-91ff-488f-855e-32d3a5268c46", "bridge": "br-int", "label": "tempest-device-tagging-net2-1686179832", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "71b1beadf771447694e937ffa1453d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap598c4b32-24", "ovs_interfaceid": "598c4b32-243b-461b-b9a4-3a2ba2b7537b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75122) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 09:34:50 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] Converting VIF {"id": "598c4b32-243b-461b-b9a4-3a2ba2b7537b", "address": "fa:16:3e:3f:ce:07", "network": {"id": "217bd6f7-91ff-488f-855e-32d3a5268c46", "bridge": "br-int", "label": "tempest-device-tagging-net2-1686179832", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "71b1beadf771447694e937ffa1453d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap598c4b32-24", "ovs_interfaceid": "598c4b32-243b-461b-b9a4-3a2ba2b7537b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 09:34:50 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:ce:07,bridge_name='br-int',has_traffic_filtering=True,id=598c4b32-243b-461b-b9a4-3a2ba2b7537b,network=Network(217bd6f7-91ff-488f-855e-32d3a5268c46),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap598c4b32-24') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 09:34:50 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T09:34:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-779991034',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-779991034',id=13,image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNtzm4oVqy6sf0O7KeIxwJ4JdwiWvUadSQZ0XPCSfdRAZRCJOKze9wXnBI4mMiHsO2k8q5mphaM2/2fNINKbO0ntvDQnZmJp/47MBtzunoCAm54iLS2xZb0FtbX4Gq2CEQ==',key_name='tempest-keypair-985108224',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='71b1beadf771447694e937ffa1453d56',ramdisk_id='',reservation_id='r-cviciewg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1167502079',owner_user_name='tempest-TaggedBootDevicesTest_v242-1167502079-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T09:34:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='47d4e4c120fc40a994518ce384652a9b',uuid=6a2fb361-de47-41c4-afa2-46f7107af1f4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "917da5e4-bdd2-40d9-9e03-b6f96858805b", "address": "fa:16:3e:ce:f2:9a", "network": {"id": "217bd6f7-91ff-488f-855e-32d3a5268c46", "bridge": "br-int", "label": "tempest-device-tagging-net2-1686179832", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "71b1beadf771447694e937ffa1453d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap917da5e4-bd", "ovs_interfaceid": "917da5e4-bdd2-40d9-9e03-b6f96858805b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75122) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 09:34:50 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] Converting VIF {"id": "917da5e4-bdd2-40d9-9e03-b6f96858805b", "address": "fa:16:3e:ce:f2:9a", "network": {"id": "217bd6f7-91ff-488f-855e-32d3a5268c46", "bridge": "br-int", "label": "tempest-device-tagging-net2-1686179832", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "71b1beadf771447694e937ffa1453d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap917da5e4-bd", "ovs_interfaceid": "917da5e4-bdd2-40d9-9e03-b6f96858805b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 09:34:50 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:f2:9a,bridge_name='br-int',has_traffic_filtering=True,id=917da5e4-bdd2-40d9-9e03-b6f96858805b,network=Network(217bd6f7-91ff-488f-855e-32d3a5268c46),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap917da5e4-bd') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 09:34:50 user nova-compute[75122]: DEBUG nova.objects.instance [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] Lazy-loading 'pci_devices' on Instance uuid 6a2fb361-de47-41c4-afa2-46f7107af1f4 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:34:50 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] End _get_guest_xml xml=<domain type="kvm">
Nov 15 09:34:50 user nova-compute[75122]:   <uuid>6a2fb361-de47-41c4-afa2-46f7107af1f4</uuid>
Nov 15 09:34:50 user nova-compute[75122]:   <name>instance-0000000d</name>
Nov 15 09:34:50 user nova-compute[75122]:   <memory>524288</memory>
Nov 15 09:34:50 user nova-compute[75122]:   <vcpu>1</vcpu>
Nov 15 09:34:50 user nova-compute[75122]:   <metadata>
Nov 15 09:34:50 user nova-compute[75122]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 09:34:50 user nova-compute[75122]:       <nova:package version="0.0.0"/>
Nov 15 09:34:50 user nova-compute[75122]:       <nova:name>tempest-device-tagging-server-779991034</nova:name>
Nov 15 09:34:50 user nova-compute[75122]:       <nova:creationTime>2023-11-15 09:34:46</nova:creationTime>
Nov 15 09:34:50 user nova-compute[75122]:       <nova:flavor name="m1.tiny">
Nov 15 09:34:50 user nova-compute[75122]:         <nova:memory>512</nova:memory>
Nov 15 09:34:50 user nova-compute[75122]:         <nova:disk>1</nova:disk>
Nov 15 09:34:50 user nova-compute[75122]:         <nova:swap>0</nova:swap>
Nov 15 09:34:50 user nova-compute[75122]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 09:34:50 user nova-compute[75122]:         <nova:vcpus>1</nova:vcpus>
Nov 15 09:34:50 user nova-compute[75122]:       </nova:flavor>
Nov 15 09:34:50 user nova-compute[75122]:       <nova:owner>
Nov 15 09:34:50 user nova-compute[75122]:         <nova:user uuid="47d4e4c120fc40a994518ce384652a9b">tempest-TaggedBootDevicesTest_v242-1167502079-project-member</nova:user>
Nov 15 09:34:50 user nova-compute[75122]:         <nova:project uuid="71b1beadf771447694e937ffa1453d56">tempest-TaggedBootDevicesTest_v242-1167502079</nova:project>
Nov 15 09:34:50 user nova-compute[75122]:       </nova:owner>
Nov 15 09:34:50 user nova-compute[75122]:       <nova:root type="image" uuid="5e862cfe-47b8-4725-8292-65761ee6d0f5"/>
Nov 15 09:34:50 user nova-compute[75122]:       <nova:ports>
Nov 15 09:34:50 user nova-compute[75122]:         <nova:port uuid="3f2e7e15-d1e1-42b1-8cda-c0ec4cadff4a">
Nov 15 09:34:50 user nova-compute[75122]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 15 09:34:50 user nova-compute[75122]:         </nova:port>
Nov 15 09:34:50 user nova-compute[75122]:         <nova:port uuid="ed761290-10dd-41fa-a1c6-479747e0b83d">
Nov 15 09:34:50 user nova-compute[75122]:           <nova:ip type="fixed" address="10.1.1.229" ipVersion="4"/>
Nov 15 09:34:50 user nova-compute[75122]:         </nova:port>
Nov 15 09:34:50 user nova-compute[75122]:         <nova:port uuid="c357e948-986d-4592-a7c5-389bd6202867">
Nov 15 09:34:50 user nova-compute[75122]:           <nova:ip type="fixed" address="10.1.1.35" ipVersion="4"/>
Nov 15 09:34:50 user nova-compute[75122]:         </nova:port>
Nov 15 09:34:50 user nova-compute[75122]:         <nova:port uuid="1cb107c5-bd60-4ce6-8da3-b6b15bd16ef1">
Nov 15 09:34:50 user nova-compute[75122]:           <nova:ip type="fixed" address="10.1.1.24" ipVersion="4"/>
Nov 15 09:34:50 user nova-compute[75122]:         </nova:port>
Nov 15 09:34:50 user nova-compute[75122]:         <nova:port uuid="2f92aaa6-98e2-4d75-8b96-92c08d77c635">
Nov 15 09:34:50 user nova-compute[75122]:           <nova:ip type="fixed" address="10.1.1.202" ipVersion="4"/>
Nov 15 09:34:50 user nova-compute[75122]:         </nova:port>
Nov 15 09:34:50 user nova-compute[75122]:         <nova:port uuid="598c4b32-243b-461b-b9a4-3a2ba2b7537b">
Nov 15 09:34:50 user nova-compute[75122]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 15 09:34:50 user nova-compute[75122]:         </nova:port>
Nov 15 09:34:50 user nova-compute[75122]:         <nova:port uuid="917da5e4-bdd2-40d9-9e03-b6f96858805b">
Nov 15 09:34:50 user nova-compute[75122]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 15 09:34:50 user nova-compute[75122]:         </nova:port>
Nov 15 09:34:50 user nova-compute[75122]:       </nova:ports>
Nov 15 09:34:50 user nova-compute[75122]:     </nova:instance>
Nov 15 09:34:50 user nova-compute[75122]:   </metadata>
Nov 15 09:34:50 user nova-compute[75122]:   <sysinfo type="smbios">
Nov 15 09:34:50 user nova-compute[75122]:     <system>
Nov 15 09:34:50 user nova-compute[75122]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 09:34:50 user nova-compute[75122]:       <entry name="product">OpenStack Nova</entry>
Nov 15 09:34:50 user nova-compute[75122]:       <entry name="version">0.0.0</entry>
Nov 15 09:34:50 user nova-compute[75122]:       <entry name="serial">6a2fb361-de47-41c4-afa2-46f7107af1f4</entry>
Nov 15 09:34:50 user nova-compute[75122]:       <entry name="uuid">6a2fb361-de47-41c4-afa2-46f7107af1f4</entry>
Nov 15 09:34:50 user nova-compute[75122]:       <entry name="family">Virtual Machine</entry>
Nov 15 09:34:50 user nova-compute[75122]:     </system>
Nov 15 09:34:50 user nova-compute[75122]:   </sysinfo>
Nov 15 09:34:50 user nova-compute[75122]:   <os>
Nov 15 09:34:50 user nova-compute[75122]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 09:34:50 user nova-compute[75122]:     <boot dev="hd"/>
Nov 15 09:34:50 user nova-compute[75122]:     <smbios mode="sysinfo"/>
Nov 15 09:34:50 user nova-compute[75122]:   </os>
Nov 15 09:34:50 user nova-compute[75122]:   <features>
Nov 15 09:34:50 user nova-compute[75122]:     <acpi/>
Nov 15 09:34:50 user nova-compute[75122]:     <apic/>
Nov 15 09:34:50 user nova-compute[75122]:     <vmcoreinfo/>
Nov 15 09:34:50 user nova-compute[75122]:   </features>
Nov 15 09:34:50 user nova-compute[75122]:   <clock offset="utc">
Nov 15 09:34:50 user nova-compute[75122]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 09:34:50 user nova-compute[75122]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 09:34:50 user nova-compute[75122]:     <timer name="hpet" present="no"/>
Nov 15 09:34:50 user nova-compute[75122]:   </clock>
Nov 15 09:34:50 user nova-compute[75122]:   <cpu mode="custom" match="exact">
Nov 15 09:34:50 user nova-compute[75122]:     <model>Nehalem</model>
Nov 15 09:34:50 user nova-compute[75122]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 09:34:50 user nova-compute[75122]:   </cpu>
Nov 15 09:34:50 user nova-compute[75122]:   <devices>
Nov 15 09:34:50 user nova-compute[75122]:     <disk type="file" device="cdrom">
Nov 15 09:34:50 user nova-compute[75122]:       <driver name="qemu" type="raw" cache="none"/>
Nov 15 09:34:50 user nova-compute[75122]:       <source file="/opt/stack/data/nova/instances/6a2fb361-de47-41c4-afa2-46f7107af1f4/disk.config"/>
Nov 15 09:34:50 user nova-compute[75122]:       <target dev="hda" bus="ide"/>
Nov 15 09:34:50 user nova-compute[75122]:     </disk>
Nov 15 09:34:50 user nova-compute[75122]:     <disk type="block" device="disk">
Nov 15 09:34:50 user nova-compute[75122]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 09:34:50 user nova-compute[75122]:       <source dev="/dev/sdf"/>
Nov 15 09:34:50 user nova-compute[75122]:       <target dev="vda" bus="virtio"/>
Nov 15 09:34:50 user nova-compute[75122]:       <serial>697acd7d-564d-4149-9ecf-7c7d89f10013</serial>
Nov 15 09:34:50 user nova-compute[75122]:     </disk>
Nov 15 09:34:50 user nova-compute[75122]:     <disk type="block" device="disk">
Nov 15 09:34:50 user nova-compute[75122]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 09:34:50 user nova-compute[75122]:       <source dev="/dev/sdg"/>
Nov 15 09:34:50 user nova-compute[75122]:       <target dev="vdb" bus="virtio"/>
Nov 15 09:34:50 user nova-compute[75122]:       <serial>df76fc47-1a36-4bd6-97e6-bff6a6ead337</serial>
Nov 15 09:34:50 user nova-compute[75122]:     </disk>
Nov 15 09:34:50 user nova-compute[75122]:     <disk type="block" device="disk">
Nov 15 09:34:50 user nova-compute[75122]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 09:34:50 user nova-compute[75122]:       <source dev="/dev/sdh"/>
Nov 15 09:34:50 user nova-compute[75122]:       <target dev="vdc" bus="virtio"/>
Nov 15 09:34:50 user nova-compute[75122]:       <serial>b9022bc1-82d9-4e14-9d0e-85a8b645e512</serial>
Nov 15 09:34:50 user nova-compute[75122]:     </disk>
Nov 15 09:34:50 user nova-compute[75122]:     <interface type="ethernet">
Nov 15 09:34:50 user nova-compute[75122]:       <mac address="fa:16:3e:dd:2a:39"/>
Nov 15 09:34:50 user nova-compute[75122]:       <model type="virtio"/>
Nov 15 09:34:50 user nova-compute[75122]:       <mtu size="1442"/>
Nov 15 09:34:50 user nova-compute[75122]:       <target dev="tap3f2e7e15-d1"/>
Nov 15 09:34:50 user nova-compute[75122]:     </interface>
Nov 15 09:34:50 user nova-compute[75122]:     <interface type="ethernet">
Nov 15 09:34:50 user nova-compute[75122]:       <mac address="fa:16:3e:3b:ea:63"/>
Nov 15 09:34:50 user nova-compute[75122]:       <model type="virtio"/>
Nov 15 09:34:50 user nova-compute[75122]:       <mtu size="1442"/>
Nov 15 09:34:50 user nova-compute[75122]:       <target dev="taped761290-10"/>
Nov 15 09:34:50 user nova-compute[75122]:     </interface>
Nov 15 09:34:50 user nova-compute[75122]:     <interface type="ethernet">
Nov 15 09:34:50 user nova-compute[75122]:       <mac address="fa:16:3e:0a:a9:a9"/>
Nov 15 09:34:50 user nova-compute[75122]:       <model type="virtio"/>
Nov 15 09:34:50 user nova-compute[75122]:       <mtu size="1442"/>
Nov 15 09:34:50 user nova-compute[75122]:       <target dev="tapc357e948-98"/>
Nov 15 09:34:50 user nova-compute[75122]:     </interface>
Nov 15 09:34:50 user nova-compute[75122]:     <interface type="ethernet">
Nov 15 09:34:50 user nova-compute[75122]:       <mac address="fa:16:3e:17:4f:64"/>
Nov 15 09:34:50 user nova-compute[75122]:       <model type="virtio"/>
Nov 15 09:34:50 user nova-compute[75122]:       <mtu size="1442"/>
Nov 15 09:34:50 user nova-compute[75122]:       <target dev="tap1cb107c5-bd"/>
Nov 15 09:34:50 user nova-compute[75122]:     </interface>
Nov 15 09:34:50 user nova-compute[75122]:     <interface type="ethernet">
Nov 15 09:34:50 user nova-compute[75122]:       <mac address="fa:16:3e:b6:db:04"/>
Nov 15 09:34:50 user nova-compute[75122]:       <model type="virtio"/>
Nov 15 09:34:50 user nova-compute[75122]:       <mtu size="1442"/>
Nov 15 09:34:50 user nova-compute[75122]:       <target dev="tap2f92aaa6-98"/>
Nov 15 09:34:50 user nova-compute[75122]:     </interface>
Nov 15 09:34:50 user nova-compute[75122]:     <interface type="ethernet">
Nov 15 09:34:50 user nova-compute[75122]:       <mac address="fa:16:3e:3f:ce:07"/>
Nov 15 09:34:50 user nova-compute[75122]:       <model type="virtio"/>
Nov 15 09:34:50 user nova-compute[75122]:       <mtu size="1442"/>
Nov 15 09:34:50 user nova-compute[75122]:       <target dev="tap598c4b32-24"/>
Nov 15 09:34:50 user nova-compute[75122]:     </interface>
Nov 15 09:34:50 user nova-compute[75122]:     <interface type="ethernet">
Nov 15 09:34:50 user nova-compute[75122]:       <mac address="fa:16:3e:ce:f2:9a"/>
Nov 15 09:34:50 user nova-compute[75122]:       <model type="virtio"/>
Nov 15 09:34:50 user nova-compute[75122]:       <mtu size="1442"/>
Nov 15 09:34:50 user nova-compute[75122]:       <target dev="tap917da5e4-bd"/>
Nov 15 09:34:50 user nova-compute[75122]:     </interface>
Nov 15 09:34:50 user nova-compute[75122]:     <serial type="pty">
Nov 15 09:34:50 user nova-compute[75122]:       <log file="/opt/stack/data/nova/instances/6a2fb361-de47-41c4-afa2-46f7107af1f4/console.log" append="off"/>
Nov 15 09:34:50 user nova-compute[75122]:     </serial>
Nov 15 09:34:50 user nova-compute[75122]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 09:34:50 user nova-compute[75122]:     <video>
Nov 15 09:34:50 user nova-compute[75122]:       <model type="virtio"/>
Nov 15 09:34:50 user nova-compute[75122]:     </video>
Nov 15 09:34:50 user nova-compute[75122]:     <rng model="virtio">
Nov 15 09:34:50 user nova-compute[75122]:       <backend model="random">/dev/urandom</backend>
Nov 15 09:34:50 user nova-compute[75122]:     </rng>
Nov 15 09:34:50 user nova-compute[75122]:     <controller type="usb" index="0" model="none"/>
Nov 15 09:34:50 user nova-compute[75122]:     <memballoon model="virtio">
Nov 15 09:34:50 user nova-compute[75122]:       <stats period="10"/>
Nov 15 09:34:50 user nova-compute[75122]:     </memballoon>
Nov 15 09:34:50 user nova-compute[75122]:   </devices>
Nov 15 09:34:50 user nova-compute[75122]: </domain>
Nov 15 09:34:50 user nova-compute[75122]:  {{(pid=75122) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 09:34:50 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T09:34:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-779991034',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-779991034',id=13,image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNtzm4oVqy6sf0O7KeIxwJ4JdwiWvUadSQZ0XPCSfdRAZRCJOKze9wXnBI4mMiHsO2k8q5mphaM2/2fNINKbO0ntvDQnZmJp/47MBtzunoCAm54iLS2xZb0FtbX4Gq2CEQ==',key_name='tempest-keypair-985108224',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='71b1beadf771447694e937ffa1453d56',ramdisk_id='',reservation_id='r-cviciewg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1167502079',owner_user_name='tempest-TaggedBootDevicesTest_v242-1167502079-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T09:34:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='47d4e4c120fc40a994518ce384652a9b',uuid=6a2fb361-de47-41c4-afa2-46f7107af1f4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3f2e7e15-d1e1-42b1-8cda-c0ec4cadff4a", "address": "fa:16:3e:dd:2a:39", "network": {"id": "2d3f0ed7-fd1f-4b58-9e19-c498613e096b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-737425118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71b1beadf771447694e937ffa1453d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f2e7e15-d1", "ovs_interfaceid": "3f2e7e15-d1e1-42b1-8cda-c0ec4cadff4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 09:34:50 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] Converting VIF {"id": "3f2e7e15-d1e1-42b1-8cda-c0ec4cadff4a", "address": "fa:16:3e:dd:2a:39", "network": {"id": "2d3f0ed7-fd1f-4b58-9e19-c498613e096b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-737425118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71b1beadf771447694e937ffa1453d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f2e7e15-d1", "ovs_interfaceid": "3f2e7e15-d1e1-42b1-8cda-c0ec4cadff4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 09:34:50 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:2a:39,bridge_name='br-int',has_traffic_filtering=True,id=3f2e7e15-d1e1-42b1-8cda-c0ec4cadff4a,network=Network(2d3f0ed7-fd1f-4b58-9e19-c498613e096b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f2e7e15-d1') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 09:34:50 user nova-compute[75122]: DEBUG os_vif [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:2a:39,bridge_name='br-int',has_traffic_filtering=True,id=3f2e7e15-d1e1-42b1-8cda-c0ec4cadff4a,network=Network(2d3f0ed7-fd1f-4b58-9e19-c498613e096b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f2e7e15-d1') {{(pid=75122) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 09:34:50 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:34:50 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:34:50 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 09:34:50 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:34:50 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '83c71b17-d60f-5b59-896b-9dbaecb987cf', '_type': 'linux-noop'}}, row=False) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:34:50 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:34:50 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:34:50 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:34:50 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3f2e7e15-d1, may_exist=True, interface_attrs={}) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:34:50 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3f2e7e15-d1, col_values=(('qos', UUID('04ed0040-2f1e-47a2-9f73-27640af06230')),), if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:34:50 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3f2e7e15-d1, col_values=(('external_ids', {'iface-id': '3f2e7e15-d1e1-42b1-8cda-c0ec4cadff4a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:dd:2a:39', 'vm-uuid': '6a2fb361-de47-41c4-afa2-46f7107af1f4'}),), if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:34:50 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:34:50 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:34:50 user nova-compute[75122]: INFO os_vif [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:2a:39,bridge_name='br-int',has_traffic_filtering=True,id=3f2e7e15-d1e1-42b1-8cda-c0ec4cadff4a,network=Network(2d3f0ed7-fd1f-4b58-9e19-c498613e096b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f2e7e15-d1')
Nov 15 09:34:50 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T09:34:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-779991034',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-779991034',id=13,image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNtzm4oVqy6sf0O7KeIxwJ4JdwiWvUadSQZ0XPCSfdRAZRCJOKze9wXnBI4mMiHsO2k8q5mphaM2/2fNINKbO0ntvDQnZmJp/47MBtzunoCAm54iLS2xZb0FtbX4Gq2CEQ==',key_name='tempest-keypair-985108224',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='71b1beadf771447694e937ffa1453d56',ramdisk_id='',reservation_id='r-cviciewg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1167502079',owner_user_name='tempest-TaggedBootDevicesTest_v242-1167502079-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T09:34:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='47d4e4c120fc40a994518ce384652a9b',uuid=6a2fb361-de47-41c4-afa2-46f7107af1f4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ed761290-10dd-41fa-a1c6-479747e0b83d", "address": "fa:16:3e:3b:ea:63", "network": {"id": "10809c12-a24e-41c8-ad4b-4ecab7ab24dd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1109444380", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.229", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "71b1beadf771447694e937ffa1453d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped761290-10", "ovs_interfaceid": "ed761290-10dd-41fa-a1c6-479747e0b83d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75122) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 09:34:50 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] Converting VIF {"id": "ed761290-10dd-41fa-a1c6-479747e0b83d", "address": "fa:16:3e:3b:ea:63", "network": {"id": "10809c12-a24e-41c8-ad4b-4ecab7ab24dd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1109444380", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.229", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "71b1beadf771447694e937ffa1453d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped761290-10", "ovs_interfaceid": "ed761290-10dd-41fa-a1c6-479747e0b83d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 09:34:50 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:ea:63,bridge_name='br-int',has_traffic_filtering=True,id=ed761290-10dd-41fa-a1c6-479747e0b83d,network=Network(10809c12-a24e-41c8-ad4b-4ecab7ab24dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='taped761290-10') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 09:34:50 user nova-compute[75122]: DEBUG os_vif [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:ea:63,bridge_name='br-int',has_traffic_filtering=True,id=ed761290-10dd-41fa-a1c6-479747e0b83d,network=Network(10809c12-a24e-41c8-ad4b-4ecab7ab24dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='taped761290-10') {{(pid=75122) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 09:34:50 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:34:50 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:34:50 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 09:34:50 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:34:50 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9bfd25d7-ac78-5d80-844b-3d7f25ed54de', '_type': 'linux-noop'}}, row=False) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:34:50 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:34:50 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:34:50 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:34:50 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=taped761290-10, may_exist=True, interface_attrs={}) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:34:50 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=taped761290-10, col_values=(('qos', UUID('415283cd-7856-4530-84ed-294d06f2b6e9')),), if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:34:50 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=taped761290-10, col_values=(('external_ids', {'iface-id': 'ed761290-10dd-41fa-a1c6-479747e0b83d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3b:ea:63', 'vm-uuid': '6a2fb361-de47-41c4-afa2-46f7107af1f4'}),), if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:34:50 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:34:50 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:34:50 user nova-compute[75122]: INFO os_vif [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:ea:63,bridge_name='br-int',has_traffic_filtering=True,id=ed761290-10dd-41fa-a1c6-479747e0b83d,network=Network(10809c12-a24e-41c8-ad4b-4ecab7ab24dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='taped761290-10')
Nov 15 09:34:50 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T09:34:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-779991034',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-779991034',id=13,image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNtzm4oVqy6sf0O7KeIxwJ4JdwiWvUadSQZ0XPCSfdRAZRCJOKze9wXnBI4mMiHsO2k8q5mphaM2/2fNINKbO0ntvDQnZmJp/47MBtzunoCAm54iLS2xZb0FtbX4Gq2CEQ==',key_name='tempest-keypair-985108224',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='71b1beadf771447694e937ffa1453d56',ramdisk_id='',reservation_id='r-cviciewg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1167502079',owner_user_name='tempest-TaggedBootDevicesTest_v242-1167502079-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T09:34:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='47d4e4c120fc40a994518ce384652a9b',uuid=6a2fb361-de47-41c4-afa2-46f7107af1f4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c357e948-986d-4592-a7c5-389bd6202867", "address": "fa:16:3e:0a:a9:a9", "network": {"id": "10809c12-a24e-41c8-ad4b-4ecab7ab24dd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1109444380", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.35", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "71b1beadf771447694e937ffa1453d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc357e948-98", "ovs_interfaceid": "c357e948-986d-4592-a7c5-389bd6202867", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75122) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 09:34:50 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] Converting VIF {"id": "c357e948-986d-4592-a7c5-389bd6202867", "address": "fa:16:3e:0a:a9:a9", "network": {"id": "10809c12-a24e-41c8-ad4b-4ecab7ab24dd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1109444380", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.35", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "71b1beadf771447694e937ffa1453d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc357e948-98", "ovs_interfaceid": "c357e948-986d-4592-a7c5-389bd6202867", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 09:34:50 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0a:a9:a9,bridge_name='br-int',has_traffic_filtering=True,id=c357e948-986d-4592-a7c5-389bd6202867,network=Network(10809c12-a24e-41c8-ad4b-4ecab7ab24dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc357e948-98') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 09:34:50 user nova-compute[75122]: DEBUG os_vif [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:a9:a9,bridge_name='br-int',has_traffic_filtering=True,id=c357e948-986d-4592-a7c5-389bd6202867,network=Network(10809c12-a24e-41c8-ad4b-4ecab7ab24dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc357e948-98') {{(pid=75122) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 09:34:50 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:34:50 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:34:50 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 09:34:50 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:34:50 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2ae55098-8ae5-5778-8a50-ecfe8cd02674', '_type': 'linux-noop'}}, row=False) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:34:50 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:34:50 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:34:50 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:34:50 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc357e948-98, may_exist=True, interface_attrs={}) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:34:50 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc357e948-98, col_values=(('qos', UUID('fadb0e26-9d87-4632-8278-aa7fa10d64ef')),), if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:34:50 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc357e948-98, col_values=(('external_ids', {'iface-id': 'c357e948-986d-4592-a7c5-389bd6202867', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0a:a9:a9', 'vm-uuid': '6a2fb361-de47-41c4-afa2-46f7107af1f4'}),), if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:34:50 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:34:50 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:34:50 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:34:50 user nova-compute[75122]: INFO os_vif [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:a9:a9,bridge_name='br-int',has_traffic_filtering=True,id=c357e948-986d-4592-a7c5-389bd6202867,network=Network(10809c12-a24e-41c8-ad4b-4ecab7ab24dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc357e948-98')
Nov 15 09:34:50 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T09:34:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-779991034',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-779991034',id=13,image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNtzm4oVqy6sf0O7KeIxwJ4JdwiWvUadSQZ0XPCSfdRAZRCJOKze9wXnBI4mMiHsO2k8q5mphaM2/2fNINKbO0ntvDQnZmJp/47MBtzunoCAm54iLS2xZb0FtbX4Gq2CEQ==',key_name='tempest-keypair-985108224',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='71b1beadf771447694e937ffa1453d56',ramdisk_id='',reservation_id='r-cviciewg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1167502079',owner_user_name='tempest-TaggedBootDevicesTest_v242-1167502079-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T09:34:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='47d4e4c120fc40a994518ce384652a9b',uuid=6a2fb361-de47-41c4-afa2-46f7107af1f4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1cb107c5-bd60-4ce6-8da3-b6b15bd16ef1", "address": "fa:16:3e:17:4f:64", "network": {"id": "10809c12-a24e-41c8-ad4b-4ecab7ab24dd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1109444380", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.24", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "71b1beadf771447694e937ffa1453d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cb107c5-bd", "ovs_interfaceid": "1cb107c5-bd60-4ce6-8da3-b6b15bd16ef1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 09:34:50 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] Converting VIF {"id": "1cb107c5-bd60-4ce6-8da3-b6b15bd16ef1", "address": "fa:16:3e:17:4f:64", "network": {"id": "10809c12-a24e-41c8-ad4b-4ecab7ab24dd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1109444380", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.24", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "71b1beadf771447694e937ffa1453d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cb107c5-bd", "ovs_interfaceid": "1cb107c5-bd60-4ce6-8da3-b6b15bd16ef1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 09:34:50 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:4f:64,bridge_name='br-int',has_traffic_filtering=True,id=1cb107c5-bd60-4ce6-8da3-b6b15bd16ef1,network=Network(10809c12-a24e-41c8-ad4b-4ecab7ab24dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1cb107c5-bd') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 09:34:50 user nova-compute[75122]: DEBUG os_vif [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:4f:64,bridge_name='br-int',has_traffic_filtering=True,id=1cb107c5-bd60-4ce6-8da3-b6b15bd16ef1,network=Network(10809c12-a24e-41c8-ad4b-4ecab7ab24dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1cb107c5-bd') {{(pid=75122) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 09:34:50 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:34:50 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:34:50 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 09:34:50 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:34:50 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7ab34577-a5fb-5c7b-8ecb-4837676822ab', '_type': 'linux-noop'}}, row=False) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:34:50 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:34:50 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:34:50 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:34:50 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:34:50 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1cb107c5-bd, may_exist=True, interface_attrs={}) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:34:50 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1cb107c5-bd, col_values=(('qos', UUID('79b62e41-57de-473f-8716-e996e41186d7')),), if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:34:50 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1cb107c5-bd, col_values=(('external_ids', {'iface-id': '1cb107c5-bd60-4ce6-8da3-b6b15bd16ef1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:17:4f:64', 'vm-uuid': '6a2fb361-de47-41c4-afa2-46f7107af1f4'}),), if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:34:50 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:34:50 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:34:50 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:34:50 user nova-compute[75122]: INFO os_vif [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:4f:64,bridge_name='br-int',has_traffic_filtering=True,id=1cb107c5-bd60-4ce6-8da3-b6b15bd16ef1,network=Network(10809c12-a24e-41c8-ad4b-4ecab7ab24dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1cb107c5-bd')
Nov 15 09:34:50 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T09:34:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-779991034',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-779991034',id=13,image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNtzm4oVqy6sf0O7KeIxwJ4JdwiWvUadSQZ0XPCSfdRAZRCJOKze9wXnBI4mMiHsO2k8q5mphaM2/2fNINKbO0ntvDQnZmJp/47MBtzunoCAm54iLS2xZb0FtbX4Gq2CEQ==',key_name='tempest-keypair-985108224',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='71b1beadf771447694e937ffa1453d56',ramdisk_id='',reservation_id='r-cviciewg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1167502079',owner_user_name='tempest-TaggedBootDevicesTest_v242-1167502079-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T09:34:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='47d4e4c120fc40a994518ce384652a9b',uuid=6a2fb361-de47-41c4-afa2-46f7107af1f4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2f92aaa6-98e2-4d75-8b96-92c08d77c635", "address": "fa:16:3e:b6:db:04", "network": {"id": "10809c12-a24e-41c8-ad4b-4ecab7ab24dd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1109444380", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.202", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "71b1beadf771447694e937ffa1453d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f92aaa6-98", "ovs_interfaceid": "2f92aaa6-98e2-4d75-8b96-92c08d77c635", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 09:34:50 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] Converting VIF {"id": "2f92aaa6-98e2-4d75-8b96-92c08d77c635", "address": "fa:16:3e:b6:db:04", "network": {"id": "10809c12-a24e-41c8-ad4b-4ecab7ab24dd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1109444380", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.202", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "71b1beadf771447694e937ffa1453d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f92aaa6-98", "ovs_interfaceid": "2f92aaa6-98e2-4d75-8b96-92c08d77c635", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 09:34:50 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:db:04,bridge_name='br-int',has_traffic_filtering=True,id=2f92aaa6-98e2-4d75-8b96-92c08d77c635,network=Network(10809c12-a24e-41c8-ad4b-4ecab7ab24dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f92aaa6-98') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 09:34:50 user nova-compute[75122]: DEBUG os_vif [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:db:04,bridge_name='br-int',has_traffic_filtering=True,id=2f92aaa6-98e2-4d75-8b96-92c08d77c635,network=Network(10809c12-a24e-41c8-ad4b-4ecab7ab24dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f92aaa6-98') {{(pid=75122) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 09:34:50 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:34:50 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:34:50 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 09:34:50 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:34:50 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a4e47e9f-2911-5539-8855-73c0e914e9c0', '_type': 'linux-noop'}}, row=False) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:34:50 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:34:50 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:34:50 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:34:50 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:34:50 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2f92aaa6-98, may_exist=True, interface_attrs={}) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:34:50 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2f92aaa6-98, col_values=(('qos', UUID('1db03a35-3afb-4d56-ab11-064825cedd10')),), if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:34:50 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2f92aaa6-98, col_values=(('external_ids', {'iface-id': '2f92aaa6-98e2-4d75-8b96-92c08d77c635', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b6:db:04', 'vm-uuid': '6a2fb361-de47-41c4-afa2-46f7107af1f4'}),), if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:34:50 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:34:50 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:34:50 user nova-compute[75122]: INFO os_vif [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:db:04,bridge_name='br-int',has_traffic_filtering=True,id=2f92aaa6-98e2-4d75-8b96-92c08d77c635,network=Network(10809c12-a24e-41c8-ad4b-4ecab7ab24dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f92aaa6-98')
Nov 15 09:34:50 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T09:34:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-779991034',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-779991034',id=13,image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNtzm4oVqy6sf0O7KeIxwJ4JdwiWvUadSQZ0XPCSfdRAZRCJOKze9wXnBI4mMiHsO2k8q5mphaM2/2fNINKbO0ntvDQnZmJp/47MBtzunoCAm54iLS2xZb0FtbX4Gq2CEQ==',key_name='tempest-keypair-985108224',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='71b1beadf771447694e937ffa1453d56',ramdisk_id='',reservation_id='r-cviciewg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1167502079',owner_user_name='tempest-TaggedBootDevicesTest_v242-1167502079-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T09:34:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='47d4e4c120fc40a994518ce384652a9b',uuid=6a2fb361-de47-41c4-afa2-46f7107af1f4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "598c4b32-243b-461b-b9a4-3a2ba2b7537b", "address": "fa:16:3e:3f:ce:07", "network": {"id": "217bd6f7-91ff-488f-855e-32d3a5268c46", "bridge": "br-int", "label": "tempest-device-tagging-net2-1686179832", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "71b1beadf771447694e937ffa1453d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap598c4b32-24", "ovs_interfaceid": "598c4b32-243b-461b-b9a4-3a2ba2b7537b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 09:34:50 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] Converting VIF {"id": "598c4b32-243b-461b-b9a4-3a2ba2b7537b", "address": "fa:16:3e:3f:ce:07", "network": {"id": "217bd6f7-91ff-488f-855e-32d3a5268c46", "bridge": "br-int", "label": "tempest-device-tagging-net2-1686179832", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "71b1beadf771447694e937ffa1453d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap598c4b32-24", "ovs_interfaceid": "598c4b32-243b-461b-b9a4-3a2ba2b7537b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 09:34:50 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:ce:07,bridge_name='br-int',has_traffic_filtering=True,id=598c4b32-243b-461b-b9a4-3a2ba2b7537b,network=Network(217bd6f7-91ff-488f-855e-32d3a5268c46),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap598c4b32-24') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 09:34:50 user nova-compute[75122]: DEBUG os_vif [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:ce:07,bridge_name='br-int',has_traffic_filtering=True,id=598c4b32-243b-461b-b9a4-3a2ba2b7537b,network=Network(217bd6f7-91ff-488f-855e-32d3a5268c46),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap598c4b32-24') {{(pid=75122) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 09:34:50 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:34:50 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:34:50 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 09:34:50 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:34:50 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b70f8682-1d04-542d-839d-27ea24ae8a60', '_type': 'linux-noop'}}, row=False) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:34:50 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:34:51 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:34:51 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:34:51 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap598c4b32-24, may_exist=True, interface_attrs={}) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:34:51 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap598c4b32-24, col_values=(('qos', UUID('2fec64b1-a4e9-423c-878b-c6b6675a642d')),), if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:34:51 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap598c4b32-24, col_values=(('external_ids', {'iface-id': '598c4b32-243b-461b-b9a4-3a2ba2b7537b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3f:ce:07', 'vm-uuid': '6a2fb361-de47-41c4-afa2-46f7107af1f4'}),), if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:34:51 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:34:51 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:34:51 user nova-compute[75122]: INFO os_vif [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:ce:07,bridge_name='br-int',has_traffic_filtering=True,id=598c4b32-243b-461b-b9a4-3a2ba2b7537b,network=Network(217bd6f7-91ff-488f-855e-32d3a5268c46),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap598c4b32-24')
Nov 15 09:34:51 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T09:34:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-779991034',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-779991034',id=13,image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNtzm4oVqy6sf0O7KeIxwJ4JdwiWvUadSQZ0XPCSfdRAZRCJOKze9wXnBI4mMiHsO2k8q5mphaM2/2fNINKbO0ntvDQnZmJp/47MBtzunoCAm54iLS2xZb0FtbX4Gq2CEQ==',key_name='tempest-keypair-985108224',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='71b1beadf771447694e937ffa1453d56',ramdisk_id='',reservation_id='r-cviciewg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1167502079',owner_user_name='tempest-TaggedBootDevicesTest_v242-1167502079-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T09:34:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='47d4e4c120fc40a994518ce384652a9b',uuid=6a2fb361-de47-41c4-afa2-46f7107af1f4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "917da5e4-bdd2-40d9-9e03-b6f96858805b", "address": "fa:16:3e:ce:f2:9a", "network": {"id": "217bd6f7-91ff-488f-855e-32d3a5268c46", "bridge": "br-int", "label": "tempest-device-tagging-net2-1686179832", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "71b1beadf771447694e937ffa1453d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap917da5e4-bd", "ovs_interfaceid": "917da5e4-bdd2-40d9-9e03-b6f96858805b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 09:34:51 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] Converting VIF {"id": "917da5e4-bdd2-40d9-9e03-b6f96858805b", "address": "fa:16:3e:ce:f2:9a", "network": {"id": "217bd6f7-91ff-488f-855e-32d3a5268c46", "bridge": "br-int", "label": "tempest-device-tagging-net2-1686179832", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "71b1beadf771447694e937ffa1453d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap917da5e4-bd", "ovs_interfaceid": "917da5e4-bdd2-40d9-9e03-b6f96858805b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 09:34:51 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:f2:9a,bridge_name='br-int',has_traffic_filtering=True,id=917da5e4-bdd2-40d9-9e03-b6f96858805b,network=Network(217bd6f7-91ff-488f-855e-32d3a5268c46),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap917da5e4-bd') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 09:34:51 user nova-compute[75122]: DEBUG os_vif [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:f2:9a,bridge_name='br-int',has_traffic_filtering=True,id=917da5e4-bdd2-40d9-9e03-b6f96858805b,network=Network(217bd6f7-91ff-488f-855e-32d3a5268c46),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap917da5e4-bd') {{(pid=75122) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 09:34:51 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:34:51 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:34:51 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 09:34:51 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:34:51 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7ba96f23-cf62-5a7a-8f40-26ef72a9041a', '_type': 'linux-noop'}}, row=False) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:34:51 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:34:51 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:34:51 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:34:51 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap917da5e4-bd, may_exist=True, interface_attrs={}) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:34:51 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap917da5e4-bd, col_values=(('qos', UUID('427eb655-9f6e-4f98-b7a1-74b3d63e4e3e')),), if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:34:51 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap917da5e4-bd, col_values=(('external_ids', {'iface-id': '917da5e4-bdd2-40d9-9e03-b6f96858805b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ce:f2:9a', 'vm-uuid': '6a2fb361-de47-41c4-afa2-46f7107af1f4'}),), if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:34:51 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:34:51 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:34:51 user nova-compute[75122]: INFO os_vif [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:f2:9a,bridge_name='br-int',has_traffic_filtering=True,id=917da5e4-bdd2-40d9-9e03-b6f96858805b,network=Network(217bd6f7-91ff-488f-855e-32d3a5268c46),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap917da5e4-bd')
Nov 15 09:34:51 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] No BDM found with device name hda, not building metadata. {{(pid=75122) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 09:34:51 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75122) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 09:34:51 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] No VIF found with MAC fa:16:3e:dd:2a:39, not building metadata {{(pid=75122) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 09:34:51 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] No VIF found with MAC fa:16:3e:b6:db:04, not building metadata {{(pid=75122) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 09:34:51 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] Using config drive
Nov 15 09:34:51 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] Creating config drive at /opt/stack/data/nova/instances/6a2fb361-de47-41c4-afa2-46f7107af1f4/disk.config
Nov 15 09:34:51 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/6a2fb361-de47-41c4-afa2-46f7107af1f4/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpu_l45t5r {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:34:51 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/6a2fb361-de47-41c4-afa2-46f7107af1f4/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpu_l45t5r" returned: 0 in 0.057s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:34:51 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:34:52 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-de2520fb-4d8d-4fbc-8dc6-6b4215a67c12 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] Acquiring lock "f7d1a157-3228-490e-a6a0-68f6bd2b52ba" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:34:52 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-de2520fb-4d8d-4fbc-8dc6-6b4215a67c12 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] Lock "f7d1a157-3228-490e-a6a0-68f6bd2b52ba" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:34:52 user nova-compute[75122]: INFO nova.compute.manager [None req-de2520fb-4d8d-4fbc-8dc6-6b4215a67c12 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] [instance: f7d1a157-3228-490e-a6a0-68f6bd2b52ba] Unshelving
Nov 15 09:34:52 user nova-compute[75122]: INFO nova.virt.block_device [None req-de2520fb-4d8d-4fbc-8dc6-6b4215a67c12 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] [instance: f7d1a157-3228-490e-a6a0-68f6bd2b52ba] Booting with volume d1b088a7-71ac-43f7-8ee4-c9a32a33681e at /dev/vda
Nov 15 09:34:52 user nova-compute[75122]: DEBUG os_brick.utils [None req-de2520fb-4d8d-4fbc-8dc6-6b4215a67c12 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 09:34:52 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:34:52 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:34:52 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7e0dbcd-3ecb-42ef-83c9-cfba4267cd3c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:742fb64b3587\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:34:52 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:34:52 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:34:52 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[83dce767-4762-47b0-9ccb-2f39e42a200c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:34:52 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:34:52 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:34:52 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[e383d9f6-03c9-45cd-b212-db64eb1f94a7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:34:52 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddc98028-3c0d-4e27-9580-a6f0b7fa9528]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:34:52 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-de2520fb-4d8d-4fbc-8dc6-6b4215a67c12 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] Running cmd (subprocess): nvme version {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:34:52 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-de2520fb-4d8d-4fbc-8dc6-6b4215a67c12 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] 'nvme version' failed. Not Retrying. {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 09:34:52 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.nvmeof [None req-de2520fb-4d8d-4fbc-8dc6-6b4215a67c12 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] nvme not present on system {{(pid=75122) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 09:34:52 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:34:52 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 09:34:52 user nova-compute[75122]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 09:34:52 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bb6b902-7be4-4968-b116-38e805087167]: (4, '') {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:34:52 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.lightos [None req-de2520fb-4d8d-4fbc-8dc6-6b4215a67c12 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75122) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 09:34:52 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.lightos [None req-de2520fb-4d8d-4fbc-8dc6-6b4215a67c12 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75122) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 09:34:52 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.lightos [None req-de2520fb-4d8d-4fbc-8dc6-6b4215a67c12 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] LIGHTOS: no hostnqn found. {{(pid=75122) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 09:34:52 user nova-compute[75122]: DEBUG os_brick.utils [None req-de2520fb-4d8d-4fbc-8dc6-6b4215a67c12 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] <== get_connector_properties: return (148ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:742fb64b3587', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 09:34:52 user nova-compute[75122]: DEBUG nova.virt.block_device [None req-de2520fb-4d8d-4fbc-8dc6-6b4215a67c12 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] [instance: f7d1a157-3228-490e-a6a0-68f6bd2b52ba] Updating existing volume attachment record: 4c5980ea-4bae-4965-8797-67579e31d27e {{(pid=75122) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 09:34:52 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:34:53 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:34:53 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:34:53 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:34:53 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:34:53 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:34:53 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:34:53 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:34:53 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:34:53 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:34:53 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:34:54 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:34:54 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:34:54 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:34:54 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:34:54 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:34:54 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:34:54 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:34:54 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:34:54 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:34:54 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:34:54 user nova-compute[75122]: DEBUG nova.compute.manager [req-9618f66c-648c-4e61-a860-745202dfe154 req-0a808032-0eed-4351-a084-76fb459a0121 service nova] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] Received event network-vif-plugged-3f2e7e15-d1e1-42b1-8cda-c0ec4cadff4a {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:34:54 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-9618f66c-648c-4e61-a860-745202dfe154 req-0a808032-0eed-4351-a084-76fb459a0121 service nova] Acquiring lock "6a2fb361-de47-41c4-afa2-46f7107af1f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:34:54 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-9618f66c-648c-4e61-a860-745202dfe154 req-0a808032-0eed-4351-a084-76fb459a0121 service nova] Lock "6a2fb361-de47-41c4-afa2-46f7107af1f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:34:54 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-9618f66c-648c-4e61-a860-745202dfe154 req-0a808032-0eed-4351-a084-76fb459a0121 service nova] Lock "6a2fb361-de47-41c4-afa2-46f7107af1f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:34:54 user nova-compute[75122]: DEBUG nova.compute.manager [req-9618f66c-648c-4e61-a860-745202dfe154 req-0a808032-0eed-4351-a084-76fb459a0121 service nova] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] No waiting events found dispatching network-vif-plugged-3f2e7e15-d1e1-42b1-8cda-c0ec4cadff4a {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:34:54 user nova-compute[75122]: WARNING nova.compute.manager [req-9618f66c-648c-4e61-a860-745202dfe154 req-0a808032-0eed-4351-a084-76fb459a0121 service nova] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] Received unexpected event network-vif-plugged-3f2e7e15-d1e1-42b1-8cda-c0ec4cadff4a for instance with vm_state building and task_state spawning.
Nov 15 09:34:54 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:34:54 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:34:55 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:34:55 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:34:55 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:34:55 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:34:55 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:34:55 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:34:55 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:34:55 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:34:55 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:34:55 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:34:55 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:34:55 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:34:56 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:34:56 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:34:56 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:34:56 user nova-compute[75122]: DEBUG nova.compute.manager [req-9e9383f2-5c75-4291-9b3b-18b66222cc61 req-282f02fc-333d-4045-b512-59b083abfaed service nova] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] Received event network-vif-plugged-3f2e7e15-d1e1-42b1-8cda-c0ec4cadff4a {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:34:56 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-9e9383f2-5c75-4291-9b3b-18b66222cc61 req-282f02fc-333d-4045-b512-59b083abfaed service nova] Acquiring lock "6a2fb361-de47-41c4-afa2-46f7107af1f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:34:56 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-9e9383f2-5c75-4291-9b3b-18b66222cc61 req-282f02fc-333d-4045-b512-59b083abfaed service nova] Lock "6a2fb361-de47-41c4-afa2-46f7107af1f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:34:56 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-9e9383f2-5c75-4291-9b3b-18b66222cc61 req-282f02fc-333d-4045-b512-59b083abfaed service nova] Lock "6a2fb361-de47-41c4-afa2-46f7107af1f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:34:56 user nova-compute[75122]: DEBUG nova.compute.manager [req-9e9383f2-5c75-4291-9b3b-18b66222cc61 req-282f02fc-333d-4045-b512-59b083abfaed service nova] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] No waiting events found dispatching network-vif-plugged-3f2e7e15-d1e1-42b1-8cda-c0ec4cadff4a {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:34:56 user nova-compute[75122]: WARNING nova.compute.manager [req-9e9383f2-5c75-4291-9b3b-18b66222cc61 req-282f02fc-333d-4045-b512-59b083abfaed service nova] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] Received unexpected event network-vif-plugged-3f2e7e15-d1e1-42b1-8cda-c0ec4cadff4a for instance with vm_state building and task_state spawning.
Nov 15 09:34:56 user nova-compute[75122]: DEBUG nova.compute.manager [req-9e9383f2-5c75-4291-9b3b-18b66222cc61 req-282f02fc-333d-4045-b512-59b083abfaed service nova] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] Received event network-vif-plugged-c357e948-986d-4592-a7c5-389bd6202867 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:34:56 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-9e9383f2-5c75-4291-9b3b-18b66222cc61 req-282f02fc-333d-4045-b512-59b083abfaed service nova] Acquiring lock "6a2fb361-de47-41c4-afa2-46f7107af1f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:34:56 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-9e9383f2-5c75-4291-9b3b-18b66222cc61 req-282f02fc-333d-4045-b512-59b083abfaed service nova] Lock "6a2fb361-de47-41c4-afa2-46f7107af1f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:34:56 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-9e9383f2-5c75-4291-9b3b-18b66222cc61 req-282f02fc-333d-4045-b512-59b083abfaed service nova] Lock "6a2fb361-de47-41c4-afa2-46f7107af1f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:34:56 user nova-compute[75122]: DEBUG nova.compute.manager [req-9e9383f2-5c75-4291-9b3b-18b66222cc61 req-282f02fc-333d-4045-b512-59b083abfaed service nova] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] No waiting events found dispatching network-vif-plugged-c357e948-986d-4592-a7c5-389bd6202867 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:34:56 user nova-compute[75122]: WARNING nova.compute.manager [req-9e9383f2-5c75-4291-9b3b-18b66222cc61 req-282f02fc-333d-4045-b512-59b083abfaed service nova] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] Received unexpected event network-vif-plugged-c357e948-986d-4592-a7c5-389bd6202867 for instance with vm_state building and task_state spawning.
Nov 15 09:34:56 user nova-compute[75122]: DEBUG nova.compute.manager [req-9e9383f2-5c75-4291-9b3b-18b66222cc61 req-282f02fc-333d-4045-b512-59b083abfaed service nova] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] Received event network-vif-plugged-c357e948-986d-4592-a7c5-389bd6202867 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:34:56 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-9e9383f2-5c75-4291-9b3b-18b66222cc61 req-282f02fc-333d-4045-b512-59b083abfaed service nova] Acquiring lock "6a2fb361-de47-41c4-afa2-46f7107af1f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:34:56 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-9e9383f2-5c75-4291-9b3b-18b66222cc61 req-282f02fc-333d-4045-b512-59b083abfaed service nova] Lock "6a2fb361-de47-41c4-afa2-46f7107af1f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:34:56 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-9e9383f2-5c75-4291-9b3b-18b66222cc61 req-282f02fc-333d-4045-b512-59b083abfaed service nova] Lock "6a2fb361-de47-41c4-afa2-46f7107af1f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:34:56 user nova-compute[75122]: DEBUG nova.compute.manager [req-9e9383f2-5c75-4291-9b3b-18b66222cc61 req-282f02fc-333d-4045-b512-59b083abfaed service nova] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] No waiting events found dispatching network-vif-plugged-c357e948-986d-4592-a7c5-389bd6202867 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:34:56 user nova-compute[75122]: WARNING nova.compute.manager [req-9e9383f2-5c75-4291-9b3b-18b66222cc61 req-282f02fc-333d-4045-b512-59b083abfaed service nova] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] Received unexpected event network-vif-plugged-c357e948-986d-4592-a7c5-389bd6202867 for instance with vm_state building and task_state spawning.
Nov 15 09:34:56 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:34:56 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:34:56 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:34:56 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:34:56 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:34:57 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:34:57 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:34:57 user nova-compute[75122]: DEBUG nova.compute.manager [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] Instance event wait completed in 0 seconds for  {{(pid=75122) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 09:34:57 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] Guest created on hypervisor {{(pid=75122) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 09:34:57 user nova-compute[75122]: INFO nova.virt.libvirt.driver [-] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] Instance spawned successfully.
Nov 15 09:34:57 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 09:34:58 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] Found default for hw_cdrom_bus of ide {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:34:58 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] Found default for hw_disk_bus of virtio {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:34:58 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] Found default for hw_input_bus of None {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:34:58 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] Found default for hw_pointer_model of None {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:34:58 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] Found default for hw_video_model of virtio {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:34:58 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] Found default for hw_vif_model of virtio {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:34:58 user nova-compute[75122]: INFO nova.compute.manager [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] Took 11.97 seconds to spawn the instance on the hypervisor.
Nov 15 09:34:58 user nova-compute[75122]: DEBUG nova.compute.manager [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] Checking state {{(pid=75122) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 09:34:58 user nova-compute[75122]: INFO nova.compute.manager [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] Took 29.13 seconds to build instance.
Nov 15 09:34:58 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-94a54ebb-29d7-46ec-a23d-f91e27ca4185 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] Lock "6a2fb361-de47-41c4-afa2-46f7107af1f4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 29.265s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:34:58 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-32d804b1-3196-4915-b336-6e8ff3a983fa tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] Acquiring lock "5b5a4d58-ba1e-473d-a32a-06fae1c84efc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:34:58 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-32d804b1-3196-4915-b336-6e8ff3a983fa tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] Lock "5b5a4d58-ba1e-473d-a32a-06fae1c84efc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:34:58 user nova-compute[75122]: DEBUG nova.compute.manager [None req-32d804b1-3196-4915-b336-6e8ff3a983fa tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] [instance: 5b5a4d58-ba1e-473d-a32a-06fae1c84efc] Starting instance... {{(pid=75122) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 09:34:58 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-32d804b1-3196-4915-b336-6e8ff3a983fa tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:34:58 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-32d804b1-3196-4915-b336-6e8ff3a983fa tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:34:58 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-32d804b1-3196-4915-b336-6e8ff3a983fa tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75122) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 09:34:58 user nova-compute[75122]: INFO nova.compute.claims [None req-32d804b1-3196-4915-b336-6e8ff3a983fa tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] [instance: 5b5a4d58-ba1e-473d-a32a-06fae1c84efc] Claim successful on node user
Nov 15 09:34:58 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-de2520fb-4d8d-4fbc-8dc6-6b4215a67c12 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:34:59 user nova-compute[75122]: DEBUG nova.compute.provider_tree [None req-32d804b1-3196-4915-b336-6e8ff3a983fa tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] Inventory has not changed in ProviderTree for provider: 69a3da65-47be-44c6-b67c-c692b58284ef {{(pid=75122) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 09:34:59 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-32d804b1-3196-4915-b336-6e8ff3a983fa tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] Inventory has not changed for provider 69a3da65-47be-44c6-b67c-c692b58284ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 09:34:59 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-32d804b1-3196-4915-b336-6e8ff3a983fa tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.442s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:34:59 user nova-compute[75122]: DEBUG nova.compute.manager [None req-32d804b1-3196-4915-b336-6e8ff3a983fa tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] [instance: 5b5a4d58-ba1e-473d-a32a-06fae1c84efc] Start building networks asynchronously for instance. {{(pid=75122) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 09:34:59 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-de2520fb-4d8d-4fbc-8dc6-6b4215a67c12 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.399s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:34:59 user nova-compute[75122]: DEBUG nova.objects.instance [None req-de2520fb-4d8d-4fbc-8dc6-6b4215a67c12 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] Lazy-loading 'pci_requests' on Instance uuid f7d1a157-3228-490e-a6a0-68f6bd2b52ba {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:34:59 user nova-compute[75122]: DEBUG nova.objects.instance [None req-de2520fb-4d8d-4fbc-8dc6-6b4215a67c12 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] Lazy-loading 'numa_topology' on Instance uuid f7d1a157-3228-490e-a6a0-68f6bd2b52ba {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:34:59 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-de2520fb-4d8d-4fbc-8dc6-6b4215a67c12 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75122) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 09:34:59 user nova-compute[75122]: INFO nova.compute.claims [None req-de2520fb-4d8d-4fbc-8dc6-6b4215a67c12 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] [instance: f7d1a157-3228-490e-a6a0-68f6bd2b52ba] Claim successful on node user
Nov 15 09:34:59 user nova-compute[75122]: DEBUG nova.compute.manager [None req-32d804b1-3196-4915-b336-6e8ff3a983fa tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] [instance: 5b5a4d58-ba1e-473d-a32a-06fae1c84efc] Allocating IP information in the background. {{(pid=75122) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 09:34:59 user nova-compute[75122]: DEBUG nova.network.neutron [None req-32d804b1-3196-4915-b336-6e8ff3a983fa tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] [instance: 5b5a4d58-ba1e-473d-a32a-06fae1c84efc] allocate_for_instance() {{(pid=75122) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 09:34:59 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-32d804b1-3196-4915-b336-6e8ff3a983fa tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] [instance: 5b5a4d58-ba1e-473d-a32a-06fae1c84efc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 09:34:59 user nova-compute[75122]: DEBUG nova.compute.manager [None req-32d804b1-3196-4915-b336-6e8ff3a983fa tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] [instance: 5b5a4d58-ba1e-473d-a32a-06fae1c84efc] Start building block device mappings for instance. {{(pid=75122) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 09:34:59 user nova-compute[75122]: DEBUG nova.policy [None req-32d804b1-3196-4915-b336-6e8ff3a983fa tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2940f4a7d03a4c9b97a832c436ae4b76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aed61f0071f44ac901b94cd9a4a909d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75122) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 09:34:59 user nova-compute[75122]: DEBUG nova.compute.manager [None req-32d804b1-3196-4915-b336-6e8ff3a983fa tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] [instance: 5b5a4d58-ba1e-473d-a32a-06fae1c84efc] Start spawning the instance on the hypervisor. {{(pid=75122) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 09:34:59 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-32d804b1-3196-4915-b336-6e8ff3a983fa tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] [instance: 5b5a4d58-ba1e-473d-a32a-06fae1c84efc] Creating instance directory {{(pid=75122) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 09:34:59 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-32d804b1-3196-4915-b336-6e8ff3a983fa tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] [instance: 5b5a4d58-ba1e-473d-a32a-06fae1c84efc] Creating image(s)
Nov 15 09:34:59 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-32d804b1-3196-4915-b336-6e8ff3a983fa tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] Acquiring lock "/opt/stack/data/nova/instances/5b5a4d58-ba1e-473d-a32a-06fae1c84efc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:34:59 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-32d804b1-3196-4915-b336-6e8ff3a983fa tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] Lock "/opt/stack/data/nova/instances/5b5a4d58-ba1e-473d-a32a-06fae1c84efc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:34:59 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-32d804b1-3196-4915-b336-6e8ff3a983fa tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] Lock "/opt/stack/data/nova/instances/5b5a4d58-ba1e-473d-a32a-06fae1c84efc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:34:59 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-32d804b1-3196-4915-b336-6e8ff3a983fa tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:34:59 user nova-compute[75122]: DEBUG nova.compute.provider_tree [None req-de2520fb-4d8d-4fbc-8dc6-6b4215a67c12 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] Inventory has not changed in ProviderTree for provider: 69a3da65-47be-44c6-b67c-c692b58284ef {{(pid=75122) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 09:34:59 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-de2520fb-4d8d-4fbc-8dc6-6b4215a67c12 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] Inventory has not changed for provider 69a3da65-47be-44c6-b67c-c692b58284ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 09:34:59 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-32d804b1-3196-4915-b336-6e8ff3a983fa tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json" returned: 0 in 0.211s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:34:59 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-32d804b1-3196-4915-b336-6e8ff3a983fa tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] Acquiring lock "95d6e29f74d5408f818e32f3bc29bc8270a4c665" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:34:59 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-32d804b1-3196-4915-b336-6e8ff3a983fa tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] Lock "95d6e29f74d5408f818e32f3bc29bc8270a4c665" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:34:59 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-32d804b1-3196-4915-b336-6e8ff3a983fa tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:34:59 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-de2520fb-4d8d-4fbc-8dc6-6b4215a67c12 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.538s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:34:59 user nova-compute[75122]: INFO nova.network.neutron [None req-de2520fb-4d8d-4fbc-8dc6-6b4215a67c12 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] [instance: f7d1a157-3228-490e-a6a0-68f6bd2b52ba] Updating port caf104ef-b652-4038-8203-76f14e4b666b with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 15 09:34:59 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-32d804b1-3196-4915-b336-6e8ff3a983fa tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json" returned: 0 in 0.197s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:34:59 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-32d804b1-3196-4915-b336-6e8ff3a983fa tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665,backing_fmt=raw /opt/stack/data/nova/instances/5b5a4d58-ba1e-473d-a32a-06fae1c84efc/disk 1073741824 {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:34:59 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-32d804b1-3196-4915-b336-6e8ff3a983fa tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665,backing_fmt=raw /opt/stack/data/nova/instances/5b5a4d58-ba1e-473d-a32a-06fae1c84efc/disk 1073741824" returned: 0 in 0.057s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:34:59 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-32d804b1-3196-4915-b336-6e8ff3a983fa tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] Lock "95d6e29f74d5408f818e32f3bc29bc8270a4c665" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.264s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:34:59 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-32d804b1-3196-4915-b336-6e8ff3a983fa tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:35:00 user nova-compute[75122]: DEBUG nova.compute.manager [req-da269216-4cb2-469b-a1b1-3bda4e3e7f4c req-6d94458f-fc95-4522-bf8b-eb8af951a10f service nova] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] Received event network-vif-plugged-ed761290-10dd-41fa-a1c6-479747e0b83d {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:35:00 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-da269216-4cb2-469b-a1b1-3bda4e3e7f4c req-6d94458f-fc95-4522-bf8b-eb8af951a10f service nova] Acquiring lock "6a2fb361-de47-41c4-afa2-46f7107af1f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:35:00 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-da269216-4cb2-469b-a1b1-3bda4e3e7f4c req-6d94458f-fc95-4522-bf8b-eb8af951a10f service nova] Lock "6a2fb361-de47-41c4-afa2-46f7107af1f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:35:00 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-da269216-4cb2-469b-a1b1-3bda4e3e7f4c req-6d94458f-fc95-4522-bf8b-eb8af951a10f service nova] Lock "6a2fb361-de47-41c4-afa2-46f7107af1f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:35:00 user nova-compute[75122]: DEBUG nova.compute.manager [req-da269216-4cb2-469b-a1b1-3bda4e3e7f4c req-6d94458f-fc95-4522-bf8b-eb8af951a10f service nova] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] No waiting events found dispatching network-vif-plugged-ed761290-10dd-41fa-a1c6-479747e0b83d {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:35:00 user nova-compute[75122]: WARNING nova.compute.manager [req-da269216-4cb2-469b-a1b1-3bda4e3e7f4c req-6d94458f-fc95-4522-bf8b-eb8af951a10f service nova] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] Received unexpected event network-vif-plugged-ed761290-10dd-41fa-a1c6-479747e0b83d for instance with vm_state active and task_state None.
Nov 15 09:35:00 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:35:00 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-32d804b1-3196-4915-b336-6e8ff3a983fa tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json" returned: 0 in 0.301s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:35:00 user nova-compute[75122]: DEBUG nova.virt.disk.api [None req-32d804b1-3196-4915-b336-6e8ff3a983fa tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5b5a4d58-ba1e-473d-a32a-06fae1c84efc/disk. size=1073741824 {{(pid=75122) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 09:35:00 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-32d804b1-3196-4915-b336-6e8ff3a983fa tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5a4d58-ba1e-473d-a32a-06fae1c84efc/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:35:00 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-32d804b1-3196-4915-b336-6e8ff3a983fa tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5a4d58-ba1e-473d-a32a-06fae1c84efc/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:35:00 user nova-compute[75122]: DEBUG nova.virt.disk.api [None req-32d804b1-3196-4915-b336-6e8ff3a983fa tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] Cannot resize image /opt/stack/data/nova/instances/5b5a4d58-ba1e-473d-a32a-06fae1c84efc/disk to a smaller size. {{(pid=75122) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 09:35:00 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-32d804b1-3196-4915-b336-6e8ff3a983fa tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] [instance: 5b5a4d58-ba1e-473d-a32a-06fae1c84efc] Created local disks {{(pid=75122) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 09:35:00 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-32d804b1-3196-4915-b336-6e8ff3a983fa tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] [instance: 5b5a4d58-ba1e-473d-a32a-06fae1c84efc] Ensure instance console log exists: /opt/stack/data/nova/instances/5b5a4d58-ba1e-473d-a32a-06fae1c84efc/console.log {{(pid=75122) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 09:35:00 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-32d804b1-3196-4915-b336-6e8ff3a983fa tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:35:00 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-32d804b1-3196-4915-b336-6e8ff3a983fa tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:35:00 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-32d804b1-3196-4915-b336-6e8ff3a983fa tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:35:00 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:35:00 user nova-compute[75122]: DEBUG nova.network.neutron [None req-32d804b1-3196-4915-b336-6e8ff3a983fa tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] [instance: 5b5a4d58-ba1e-473d-a32a-06fae1c84efc] Successfully created port: b245a5c2-e523-4d4e-a343-f5b2352337ab {{(pid=75122) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 09:35:01 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:35:01 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:35:01 user nova-compute[75122]: DEBUG nova.network.neutron [None req-32d804b1-3196-4915-b336-6e8ff3a983fa tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] [instance: 5b5a4d58-ba1e-473d-a32a-06fae1c84efc] Successfully updated port: b245a5c2-e523-4d4e-a343-f5b2352337ab {{(pid=75122) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 09:35:01 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-32d804b1-3196-4915-b336-6e8ff3a983fa tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] Acquiring lock "refresh_cache-5b5a4d58-ba1e-473d-a32a-06fae1c84efc" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 09:35:01 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-32d804b1-3196-4915-b336-6e8ff3a983fa tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] Acquired lock "refresh_cache-5b5a4d58-ba1e-473d-a32a-06fae1c84efc" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 09:35:01 user nova-compute[75122]: DEBUG nova.network.neutron [None req-32d804b1-3196-4915-b336-6e8ff3a983fa tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] [instance: 5b5a4d58-ba1e-473d-a32a-06fae1c84efc] Building network info cache for instance {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 09:35:01 user nova-compute[75122]: DEBUG nova.compute.manager [req-dd322975-a9cd-4a3c-b92e-5670dfb3a84b req-cf7133b9-2445-4684-91b9-6cf1984d84d1 service nova] [instance: 5b5a4d58-ba1e-473d-a32a-06fae1c84efc] Received event network-changed-b245a5c2-e523-4d4e-a343-f5b2352337ab {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:35:01 user nova-compute[75122]: DEBUG nova.compute.manager [req-dd322975-a9cd-4a3c-b92e-5670dfb3a84b req-cf7133b9-2445-4684-91b9-6cf1984d84d1 service nova] [instance: 5b5a4d58-ba1e-473d-a32a-06fae1c84efc] Refreshing instance network info cache due to event network-changed-b245a5c2-e523-4d4e-a343-f5b2352337ab. {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 09:35:01 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-dd322975-a9cd-4a3c-b92e-5670dfb3a84b req-cf7133b9-2445-4684-91b9-6cf1984d84d1 service nova] Acquiring lock "refresh_cache-5b5a4d58-ba1e-473d-a32a-06fae1c84efc" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 09:35:01 user nova-compute[75122]: DEBUG nova.compute.manager [req-aefaae9b-0795-4218-abff-6872c3c9d11c req-04c7b0f5-ce9a-4954-abdb-9cfc0d14e527 service nova] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] Received event network-vif-plugged-598c4b32-243b-461b-b9a4-3a2ba2b7537b {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:35:01 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-aefaae9b-0795-4218-abff-6872c3c9d11c req-04c7b0f5-ce9a-4954-abdb-9cfc0d14e527 service nova] Acquiring lock "6a2fb361-de47-41c4-afa2-46f7107af1f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:35:01 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-aefaae9b-0795-4218-abff-6872c3c9d11c req-04c7b0f5-ce9a-4954-abdb-9cfc0d14e527 service nova] Lock "6a2fb361-de47-41c4-afa2-46f7107af1f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:35:01 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-aefaae9b-0795-4218-abff-6872c3c9d11c req-04c7b0f5-ce9a-4954-abdb-9cfc0d14e527 service nova] Lock "6a2fb361-de47-41c4-afa2-46f7107af1f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:35:01 user nova-compute[75122]: DEBUG nova.compute.manager [req-aefaae9b-0795-4218-abff-6872c3c9d11c req-04c7b0f5-ce9a-4954-abdb-9cfc0d14e527 service nova] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] No waiting events found dispatching network-vif-plugged-598c4b32-243b-461b-b9a4-3a2ba2b7537b {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:35:01 user nova-compute[75122]: WARNING nova.compute.manager [req-aefaae9b-0795-4218-abff-6872c3c9d11c req-04c7b0f5-ce9a-4954-abdb-9cfc0d14e527 service nova] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] Received unexpected event network-vif-plugged-598c4b32-243b-461b-b9a4-3a2ba2b7537b for instance with vm_state active and task_state None.
Nov 15 09:35:01 user nova-compute[75122]: DEBUG nova.network.neutron [None req-32d804b1-3196-4915-b336-6e8ff3a983fa tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] [instance: 5b5a4d58-ba1e-473d-a32a-06fae1c84efc] Instance cache missing network info. {{(pid=75122) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 09:35:01 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-de2520fb-4d8d-4fbc-8dc6-6b4215a67c12 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] Acquiring lock "refresh_cache-f7d1a157-3228-490e-a6a0-68f6bd2b52ba" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 09:35:01 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-de2520fb-4d8d-4fbc-8dc6-6b4215a67c12 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] Acquired lock "refresh_cache-f7d1a157-3228-490e-a6a0-68f6bd2b52ba" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 09:35:01 user nova-compute[75122]: DEBUG nova.network.neutron [None req-de2520fb-4d8d-4fbc-8dc6-6b4215a67c12 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] [instance: f7d1a157-3228-490e-a6a0-68f6bd2b52ba] Building network info cache for instance {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 09:35:02 user nova-compute[75122]: DEBUG nova.compute.manager [req-473b88a4-70bc-41dc-97b6-64f1fb28dc63 req-1bbf84d4-6fa1-4cce-b86d-0aaad29d858e service nova] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] Received event network-vif-plugged-ed761290-10dd-41fa-a1c6-479747e0b83d {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:35:02 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-473b88a4-70bc-41dc-97b6-64f1fb28dc63 req-1bbf84d4-6fa1-4cce-b86d-0aaad29d858e service nova] Acquiring lock "6a2fb361-de47-41c4-afa2-46f7107af1f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:35:02 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-473b88a4-70bc-41dc-97b6-64f1fb28dc63 req-1bbf84d4-6fa1-4cce-b86d-0aaad29d858e service nova] Lock "6a2fb361-de47-41c4-afa2-46f7107af1f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:35:02 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-473b88a4-70bc-41dc-97b6-64f1fb28dc63 req-1bbf84d4-6fa1-4cce-b86d-0aaad29d858e service nova] Lock "6a2fb361-de47-41c4-afa2-46f7107af1f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:35:02 user nova-compute[75122]: DEBUG nova.compute.manager [req-473b88a4-70bc-41dc-97b6-64f1fb28dc63 req-1bbf84d4-6fa1-4cce-b86d-0aaad29d858e service nova] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] No waiting events found dispatching network-vif-plugged-ed761290-10dd-41fa-a1c6-479747e0b83d {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:35:02 user nova-compute[75122]: WARNING nova.compute.manager [req-473b88a4-70bc-41dc-97b6-64f1fb28dc63 req-1bbf84d4-6fa1-4cce-b86d-0aaad29d858e service nova] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] Received unexpected event network-vif-plugged-ed761290-10dd-41fa-a1c6-479747e0b83d for instance with vm_state active and task_state None.
Nov 15 09:35:02 user nova-compute[75122]: DEBUG nova.compute.manager [req-473b88a4-70bc-41dc-97b6-64f1fb28dc63 req-1bbf84d4-6fa1-4cce-b86d-0aaad29d858e service nova] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] Received event network-vif-plugged-1cb107c5-bd60-4ce6-8da3-b6b15bd16ef1 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:35:02 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-473b88a4-70bc-41dc-97b6-64f1fb28dc63 req-1bbf84d4-6fa1-4cce-b86d-0aaad29d858e service nova] Acquiring lock "6a2fb361-de47-41c4-afa2-46f7107af1f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:35:02 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-473b88a4-70bc-41dc-97b6-64f1fb28dc63 req-1bbf84d4-6fa1-4cce-b86d-0aaad29d858e service nova] Lock "6a2fb361-de47-41c4-afa2-46f7107af1f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:35:02 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-473b88a4-70bc-41dc-97b6-64f1fb28dc63 req-1bbf84d4-6fa1-4cce-b86d-0aaad29d858e service nova] Lock "6a2fb361-de47-41c4-afa2-46f7107af1f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:35:02 user nova-compute[75122]: DEBUG nova.compute.manager [req-473b88a4-70bc-41dc-97b6-64f1fb28dc63 req-1bbf84d4-6fa1-4cce-b86d-0aaad29d858e service nova] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] No waiting events found dispatching network-vif-plugged-1cb107c5-bd60-4ce6-8da3-b6b15bd16ef1 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:35:02 user nova-compute[75122]: WARNING nova.compute.manager [req-473b88a4-70bc-41dc-97b6-64f1fb28dc63 req-1bbf84d4-6fa1-4cce-b86d-0aaad29d858e service nova] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] Received unexpected event network-vif-plugged-1cb107c5-bd60-4ce6-8da3-b6b15bd16ef1 for instance with vm_state active and task_state None.
Nov 15 09:35:02 user nova-compute[75122]: DEBUG nova.compute.manager [req-473b88a4-70bc-41dc-97b6-64f1fb28dc63 req-1bbf84d4-6fa1-4cce-b86d-0aaad29d858e service nova] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] Received event network-vif-plugged-1cb107c5-bd60-4ce6-8da3-b6b15bd16ef1 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:35:02 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-473b88a4-70bc-41dc-97b6-64f1fb28dc63 req-1bbf84d4-6fa1-4cce-b86d-0aaad29d858e service nova] Acquiring lock "6a2fb361-de47-41c4-afa2-46f7107af1f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:35:02 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-473b88a4-70bc-41dc-97b6-64f1fb28dc63 req-1bbf84d4-6fa1-4cce-b86d-0aaad29d858e service nova] Lock "6a2fb361-de47-41c4-afa2-46f7107af1f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:35:02 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-473b88a4-70bc-41dc-97b6-64f1fb28dc63 req-1bbf84d4-6fa1-4cce-b86d-0aaad29d858e service nova] Lock "6a2fb361-de47-41c4-afa2-46f7107af1f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:35:02 user nova-compute[75122]: DEBUG nova.compute.manager [req-473b88a4-70bc-41dc-97b6-64f1fb28dc63 req-1bbf84d4-6fa1-4cce-b86d-0aaad29d858e service nova] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] No waiting events found dispatching network-vif-plugged-1cb107c5-bd60-4ce6-8da3-b6b15bd16ef1 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:35:02 user nova-compute[75122]: WARNING nova.compute.manager [req-473b88a4-70bc-41dc-97b6-64f1fb28dc63 req-1bbf84d4-6fa1-4cce-b86d-0aaad29d858e service nova] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] Received unexpected event network-vif-plugged-1cb107c5-bd60-4ce6-8da3-b6b15bd16ef1 for instance with vm_state active and task_state None.
Nov 15 09:35:02 user nova-compute[75122]: DEBUG nova.compute.manager [req-473b88a4-70bc-41dc-97b6-64f1fb28dc63 req-1bbf84d4-6fa1-4cce-b86d-0aaad29d858e service nova] [instance: f7d1a157-3228-490e-a6a0-68f6bd2b52ba] Received event network-changed-caf104ef-b652-4038-8203-76f14e4b666b {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:35:02 user nova-compute[75122]: DEBUG nova.compute.manager [req-473b88a4-70bc-41dc-97b6-64f1fb28dc63 req-1bbf84d4-6fa1-4cce-b86d-0aaad29d858e service nova] [instance: f7d1a157-3228-490e-a6a0-68f6bd2b52ba] Refreshing instance network info cache due to event network-changed-caf104ef-b652-4038-8203-76f14e4b666b. {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 09:35:02 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-473b88a4-70bc-41dc-97b6-64f1fb28dc63 req-1bbf84d4-6fa1-4cce-b86d-0aaad29d858e service nova] Acquiring lock "refresh_cache-f7d1a157-3228-490e-a6a0-68f6bd2b52ba" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 09:35:02 user nova-compute[75122]: DEBUG nova.network.neutron [None req-32d804b1-3196-4915-b336-6e8ff3a983fa tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] [instance: 5b5a4d58-ba1e-473d-a32a-06fae1c84efc] Updating instance_info_cache with network_info: [{"id": "b245a5c2-e523-4d4e-a343-f5b2352337ab", "address": "fa:16:3e:cd:ac:71", "network": {"id": "53e8c131-26be-4b3f-beca-dd48fe06ffbe", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-888345656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6aed61f0071f44ac901b94cd9a4a909d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb245a5c2-e5", "ovs_interfaceid": "b245a5c2-e523-4d4e-a343-f5b2352337ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:35:02 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-32d804b1-3196-4915-b336-6e8ff3a983fa tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] Releasing lock "refresh_cache-5b5a4d58-ba1e-473d-a32a-06fae1c84efc" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 09:35:02 user nova-compute[75122]: DEBUG nova.compute.manager [None req-32d804b1-3196-4915-b336-6e8ff3a983fa tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] [instance: 5b5a4d58-ba1e-473d-a32a-06fae1c84efc] Instance network_info: |[{"id": "b245a5c2-e523-4d4e-a343-f5b2352337ab", "address": "fa:16:3e:cd:ac:71", "network": {"id": "53e8c131-26be-4b3f-beca-dd48fe06ffbe", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-888345656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6aed61f0071f44ac901b94cd9a4a909d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb245a5c2-e5", "ovs_interfaceid": "b245a5c2-e523-4d4e-a343-f5b2352337ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75122) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 09:35:02 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-dd322975-a9cd-4a3c-b92e-5670dfb3a84b req-cf7133b9-2445-4684-91b9-6cf1984d84d1 service nova] Acquired lock "refresh_cache-5b5a4d58-ba1e-473d-a32a-06fae1c84efc" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 09:35:02 user nova-compute[75122]: DEBUG nova.network.neutron [req-dd322975-a9cd-4a3c-b92e-5670dfb3a84b req-cf7133b9-2445-4684-91b9-6cf1984d84d1 service nova] [instance: 5b5a4d58-ba1e-473d-a32a-06fae1c84efc] Refreshing network info cache for port b245a5c2-e523-4d4e-a343-f5b2352337ab {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 09:35:02 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-32d804b1-3196-4915-b336-6e8ff3a983fa tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] [instance: 5b5a4d58-ba1e-473d-a32a-06fae1c84efc] Start _get_guest_xml network_info=[{"id": "b245a5c2-e523-4d4e-a343-f5b2352337ab", "address": "fa:16:3e:cd:ac:71", "network": {"id": "53e8c131-26be-4b3f-beca-dd48fe06ffbe", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-888345656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6aed61f0071f44ac901b94cd9a4a909d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb245a5c2-e5", "ovs_interfaceid": "b245a5c2-e523-4d4e-a343-f5b2352337ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T09:26:31Z,direct_url=<?>,disk_format='qcow2',id=5e862cfe-47b8-4725-8292-65761ee6d0f5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9c57733cb41847c0b4ad31519c382e5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T09:26:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '5e862cfe-47b8-4725-8292-65761ee6d0f5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75122) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 09:35:02 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-32d804b1-3196-4915-b336-6e8ff3a983fa tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 09:35:02 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-32d804b1-3196-4915-b336-6e8ff3a983fa tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 09:35:02 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-32d804b1-3196-4915-b336-6e8ff3a983fa tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75122) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 09:35:02 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-32d804b1-3196-4915-b336-6e8ff3a983fa tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] CPU controller missing on host. {{(pid=75122) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 09:35:02 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-32d804b1-3196-4915-b336-6e8ff3a983fa tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75122) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 09:35:02 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-32d804b1-3196-4915-b336-6e8ff3a983fa tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] CPU controller found on host. {{(pid=75122) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 09:35:02 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-32d804b1-3196-4915-b336-6e8ff3a983fa tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75122) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 09:35:02 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-32d804b1-3196-4915-b336-6e8ff3a983fa tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T09:26:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T09:26:31Z,direct_url=<?>,disk_format='qcow2',id=5e862cfe-47b8-4725-8292-65761ee6d0f5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9c57733cb41847c0b4ad31519c382e5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T09:26:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 09:35:02 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-32d804b1-3196-4915-b336-6e8ff3a983fa tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] Flavor limits 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 09:35:02 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-32d804b1-3196-4915-b336-6e8ff3a983fa tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] Image limits 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 09:35:02 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-32d804b1-3196-4915-b336-6e8ff3a983fa tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] Flavor pref 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 09:35:02 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-32d804b1-3196-4915-b336-6e8ff3a983fa tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] Image pref 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 09:35:02 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-32d804b1-3196-4915-b336-6e8ff3a983fa tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 09:35:02 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-32d804b1-3196-4915-b336-6e8ff3a983fa tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 09:35:02 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-32d804b1-3196-4915-b336-6e8ff3a983fa tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75122) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 09:35:02 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-32d804b1-3196-4915-b336-6e8ff3a983fa tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] Got 1 possible topologies {{(pid=75122) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 09:35:02 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-32d804b1-3196-4915-b336-6e8ff3a983fa tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 09:35:02 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-32d804b1-3196-4915-b336-6e8ff3a983fa tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 09:35:02 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-32d804b1-3196-4915-b336-6e8ff3a983fa tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T09:34:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-180143653',display_name='tempest-ServerStableDeviceRescueTest-server-180143653',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-180143653',id=14,image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKac38UUwHVGlBpF/6pXojX0cRWwmcLLAWsTVnSZWVmiaULTNSXXsfMP/wFHtldyqrM46US3c5PHqGscE2t9cqcjfXRdmnAO58flpaqENX0njs5rEgrRIIKZ8U9R5OYa5Q==',key_name='tempest-keypair-537753446',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6aed61f0071f44ac901b94cd9a4a909d',ramdisk_id='',reservation_id='r-v0tsii3q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-813673110',owner_user_name='tempest-ServerStableDeviceRescueTest-813673110-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T09:34:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2940f4a7d03a4c9b97a832c436ae4b76',uuid=5b5a4d58-ba1e-473d-a32a-06fae1c84efc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b245a5c2-e523-4d4e-a343-f5b2352337ab", "address": "fa:16:3e:cd:ac:71", "network": {"id": "53e8c131-26be-4b3f-beca-dd48fe06ffbe", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-888345656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6aed61f0071f44ac901b94cd9a4a909d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb245a5c2-e5", "ovs_interfaceid": "b245a5c2-e523-4d4e-a343-f5b2352337ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75122) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 09:35:02 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-32d804b1-3196-4915-b336-6e8ff3a983fa tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] Converting VIF {"id": "b245a5c2-e523-4d4e-a343-f5b2352337ab", "address": "fa:16:3e:cd:ac:71", "network": {"id": "53e8c131-26be-4b3f-beca-dd48fe06ffbe", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-888345656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6aed61f0071f44ac901b94cd9a4a909d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb245a5c2-e5", "ovs_interfaceid": "b245a5c2-e523-4d4e-a343-f5b2352337ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 09:35:02 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-32d804b1-3196-4915-b336-6e8ff3a983fa tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:ac:71,bridge_name='br-int',has_traffic_filtering=True,id=b245a5c2-e523-4d4e-a343-f5b2352337ab,network=Network(53e8c131-26be-4b3f-beca-dd48fe06ffbe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb245a5c2-e5') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 09:35:02 user nova-compute[75122]: DEBUG nova.objects.instance [None req-32d804b1-3196-4915-b336-6e8ff3a983fa tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] Lazy-loading 'pci_devices' on Instance uuid 5b5a4d58-ba1e-473d-a32a-06fae1c84efc {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:35:02 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-32d804b1-3196-4915-b336-6e8ff3a983fa tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] [instance: 5b5a4d58-ba1e-473d-a32a-06fae1c84efc] End _get_guest_xml xml=<domain type="kvm">
Nov 15 09:35:02 user nova-compute[75122]:   <uuid>5b5a4d58-ba1e-473d-a32a-06fae1c84efc</uuid>
Nov 15 09:35:02 user nova-compute[75122]:   <name>instance-0000000e</name>
Nov 15 09:35:02 user nova-compute[75122]:   <memory>524288</memory>
Nov 15 09:35:02 user nova-compute[75122]:   <vcpu>1</vcpu>
Nov 15 09:35:02 user nova-compute[75122]:   <metadata>
Nov 15 09:35:02 user nova-compute[75122]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 09:35:02 user nova-compute[75122]:       <nova:package version="0.0.0"/>
Nov 15 09:35:02 user nova-compute[75122]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-180143653</nova:name>
Nov 15 09:35:02 user nova-compute[75122]:       <nova:creationTime>2023-11-15 09:35:02</nova:creationTime>
Nov 15 09:35:02 user nova-compute[75122]:       <nova:flavor name="m1.tiny">
Nov 15 09:35:02 user nova-compute[75122]:         <nova:memory>512</nova:memory>
Nov 15 09:35:02 user nova-compute[75122]:         <nova:disk>1</nova:disk>
Nov 15 09:35:02 user nova-compute[75122]:         <nova:swap>0</nova:swap>
Nov 15 09:35:02 user nova-compute[75122]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 09:35:02 user nova-compute[75122]:         <nova:vcpus>1</nova:vcpus>
Nov 15 09:35:02 user nova-compute[75122]:       </nova:flavor>
Nov 15 09:35:02 user nova-compute[75122]:       <nova:owner>
Nov 15 09:35:02 user nova-compute[75122]:         <nova:user uuid="2940f4a7d03a4c9b97a832c436ae4b76">tempest-ServerStableDeviceRescueTest-813673110-project-member</nova:user>
Nov 15 09:35:02 user nova-compute[75122]:         <nova:project uuid="6aed61f0071f44ac901b94cd9a4a909d">tempest-ServerStableDeviceRescueTest-813673110</nova:project>
Nov 15 09:35:02 user nova-compute[75122]:       </nova:owner>
Nov 15 09:35:02 user nova-compute[75122]:       <nova:root type="image" uuid="5e862cfe-47b8-4725-8292-65761ee6d0f5"/>
Nov 15 09:35:02 user nova-compute[75122]:       <nova:ports>
Nov 15 09:35:02 user nova-compute[75122]:         <nova:port uuid="b245a5c2-e523-4d4e-a343-f5b2352337ab">
Nov 15 09:35:02 user nova-compute[75122]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 15 09:35:02 user nova-compute[75122]:         </nova:port>
Nov 15 09:35:02 user nova-compute[75122]:       </nova:ports>
Nov 15 09:35:02 user nova-compute[75122]:     </nova:instance>
Nov 15 09:35:02 user nova-compute[75122]:   </metadata>
Nov 15 09:35:02 user nova-compute[75122]:   <sysinfo type="smbios">
Nov 15 09:35:02 user nova-compute[75122]:     <system>
Nov 15 09:35:02 user nova-compute[75122]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 09:35:02 user nova-compute[75122]:       <entry name="product">OpenStack Nova</entry>
Nov 15 09:35:02 user nova-compute[75122]:       <entry name="version">0.0.0</entry>
Nov 15 09:35:02 user nova-compute[75122]:       <entry name="serial">5b5a4d58-ba1e-473d-a32a-06fae1c84efc</entry>
Nov 15 09:35:02 user nova-compute[75122]:       <entry name="uuid">5b5a4d58-ba1e-473d-a32a-06fae1c84efc</entry>
Nov 15 09:35:02 user nova-compute[75122]:       <entry name="family">Virtual Machine</entry>
Nov 15 09:35:02 user nova-compute[75122]:     </system>
Nov 15 09:35:02 user nova-compute[75122]:   </sysinfo>
Nov 15 09:35:02 user nova-compute[75122]:   <os>
Nov 15 09:35:02 user nova-compute[75122]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 09:35:02 user nova-compute[75122]:     <boot dev="hd"/>
Nov 15 09:35:02 user nova-compute[75122]:     <smbios mode="sysinfo"/>
Nov 15 09:35:02 user nova-compute[75122]:   </os>
Nov 15 09:35:02 user nova-compute[75122]:   <features>
Nov 15 09:35:02 user nova-compute[75122]:     <acpi/>
Nov 15 09:35:02 user nova-compute[75122]:     <apic/>
Nov 15 09:35:02 user nova-compute[75122]:     <vmcoreinfo/>
Nov 15 09:35:02 user nova-compute[75122]:   </features>
Nov 15 09:35:02 user nova-compute[75122]:   <clock offset="utc">
Nov 15 09:35:02 user nova-compute[75122]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 09:35:02 user nova-compute[75122]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 09:35:02 user nova-compute[75122]:     <timer name="hpet" present="no"/>
Nov 15 09:35:02 user nova-compute[75122]:   </clock>
Nov 15 09:35:02 user nova-compute[75122]:   <cpu mode="custom" match="exact">
Nov 15 09:35:02 user nova-compute[75122]:     <model>Nehalem</model>
Nov 15 09:35:02 user nova-compute[75122]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 09:35:02 user nova-compute[75122]:   </cpu>
Nov 15 09:35:02 user nova-compute[75122]:   <devices>
Nov 15 09:35:02 user nova-compute[75122]:     <disk type="file" device="disk">
Nov 15 09:35:02 user nova-compute[75122]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 09:35:02 user nova-compute[75122]:       <source file="/opt/stack/data/nova/instances/5b5a4d58-ba1e-473d-a32a-06fae1c84efc/disk"/>
Nov 15 09:35:02 user nova-compute[75122]:       <target dev="vda" bus="virtio"/>
Nov 15 09:35:02 user nova-compute[75122]:     </disk>
Nov 15 09:35:02 user nova-compute[75122]:     <interface type="ethernet">
Nov 15 09:35:02 user nova-compute[75122]:       <mac address="fa:16:3e:cd:ac:71"/>
Nov 15 09:35:02 user nova-compute[75122]:       <model type="virtio"/>
Nov 15 09:35:02 user nova-compute[75122]:       <mtu size="1442"/>
Nov 15 09:35:02 user nova-compute[75122]:       <target dev="tapb245a5c2-e5"/>
Nov 15 09:35:02 user nova-compute[75122]:     </interface>
Nov 15 09:35:02 user nova-compute[75122]:     <serial type="pty">
Nov 15 09:35:02 user nova-compute[75122]:       <log file="/opt/stack/data/nova/instances/5b5a4d58-ba1e-473d-a32a-06fae1c84efc/console.log" append="off"/>
Nov 15 09:35:02 user nova-compute[75122]:     </serial>
Nov 15 09:35:02 user nova-compute[75122]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 09:35:02 user nova-compute[75122]:     <video>
Nov 15 09:35:02 user nova-compute[75122]:       <model type="virtio"/>
Nov 15 09:35:02 user nova-compute[75122]:     </video>
Nov 15 09:35:02 user nova-compute[75122]:     <rng model="virtio">
Nov 15 09:35:02 user nova-compute[75122]:       <backend model="random">/dev/urandom</backend>
Nov 15 09:35:02 user nova-compute[75122]:     </rng>
Nov 15 09:35:02 user nova-compute[75122]:     <controller type="usb" index="0" model="none"/>
Nov 15 09:35:02 user nova-compute[75122]:     <memballoon model="virtio">
Nov 15 09:35:02 user nova-compute[75122]:       <stats period="10"/>
Nov 15 09:35:02 user nova-compute[75122]:     </memballoon>
Nov 15 09:35:02 user nova-compute[75122]:   </devices>
Nov 15 09:35:02 user nova-compute[75122]: </domain>
Nov 15 09:35:02 user nova-compute[75122]:  {{(pid=75122) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 09:35:02 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-32d804b1-3196-4915-b336-6e8ff3a983fa tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T09:34:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-180143653',display_name='tempest-ServerStableDeviceRescueTest-server-180143653',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-180143653',id=14,image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKac38UUwHVGlBpF/6pXojX0cRWwmcLLAWsTVnSZWVmiaULTNSXXsfMP/wFHtldyqrM46US3c5PHqGscE2t9cqcjfXRdmnAO58flpaqENX0njs5rEgrRIIKZ8U9R5OYa5Q==',key_name='tempest-keypair-537753446',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6aed61f0071f44ac901b94cd9a4a909d',ramdisk_id='',reservation_id='r-v0tsii3q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-813673110',owner_user_name='tempest-ServerStableDeviceRescueTest-813673110-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T09:34:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2940f4a7d03a4c9b97a832c436ae4b76',uuid=5b5a4d58-ba1e-473d-a32a-06fae1c84efc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b245a5c2-e523-4d4e-a343-f5b2352337ab", "address": "fa:16:3e:cd:ac:71", "network": {"id": "53e8c131-26be-4b3f-beca-dd48fe06ffbe", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-888345656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6aed61f0071f44ac901b94cd9a4a909d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb245a5c2-e5", "ovs_interfaceid": "b245a5c2-e523-4d4e-a343-f5b2352337ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 09:35:02 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-32d804b1-3196-4915-b336-6e8ff3a983fa tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] Converting VIF {"id": "b245a5c2-e523-4d4e-a343-f5b2352337ab", "address": "fa:16:3e:cd:ac:71", "network": {"id": "53e8c131-26be-4b3f-beca-dd48fe06ffbe", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-888345656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6aed61f0071f44ac901b94cd9a4a909d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb245a5c2-e5", "ovs_interfaceid": "b245a5c2-e523-4d4e-a343-f5b2352337ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 09:35:02 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-32d804b1-3196-4915-b336-6e8ff3a983fa tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:ac:71,bridge_name='br-int',has_traffic_filtering=True,id=b245a5c2-e523-4d4e-a343-f5b2352337ab,network=Network(53e8c131-26be-4b3f-beca-dd48fe06ffbe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb245a5c2-e5') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 09:35:02 user nova-compute[75122]: DEBUG os_vif [None req-32d804b1-3196-4915-b336-6e8ff3a983fa tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:ac:71,bridge_name='br-int',has_traffic_filtering=True,id=b245a5c2-e523-4d4e-a343-f5b2352337ab,network=Network(53e8c131-26be-4b3f-beca-dd48fe06ffbe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb245a5c2-e5') {{(pid=75122) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 09:35:02 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:35:02 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:35:02 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 09:35:02 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:35:02 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b5158c62-7124-5d89-a906-9ce7290b5360', '_type': 'linux-noop'}}, row=False) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:35:02 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:35:02 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:35:02 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:35:02 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb245a5c2-e5, may_exist=True, interface_attrs={}) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:35:02 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb245a5c2-e5, col_values=(('qos', UUID('c9443ec0-0c08-4aeb-ab78-d99fd14ab163')),), if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:35:02 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb245a5c2-e5, col_values=(('external_ids', {'iface-id': 'b245a5c2-e523-4d4e-a343-f5b2352337ab', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cd:ac:71', 'vm-uuid': '5b5a4d58-ba1e-473d-a32a-06fae1c84efc'}),), if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:35:02 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:35:02 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:35:02 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:35:02 user nova-compute[75122]: INFO os_vif [None req-32d804b1-3196-4915-b336-6e8ff3a983fa tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:ac:71,bridge_name='br-int',has_traffic_filtering=True,id=b245a5c2-e523-4d4e-a343-f5b2352337ab,network=Network(53e8c131-26be-4b3f-beca-dd48fe06ffbe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb245a5c2-e5')
Nov 15 09:35:02 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-32d804b1-3196-4915-b336-6e8ff3a983fa tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] No BDM found with device name vda, not building metadata. {{(pid=75122) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 09:35:02 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-32d804b1-3196-4915-b336-6e8ff3a983fa tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] No VIF found with MAC fa:16:3e:cd:ac:71, not building metadata {{(pid=75122) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 09:35:02 user nova-compute[75122]: DEBUG nova.network.neutron [None req-de2520fb-4d8d-4fbc-8dc6-6b4215a67c12 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] [instance: f7d1a157-3228-490e-a6a0-68f6bd2b52ba] Updating instance_info_cache with network_info: [{"id": "caf104ef-b652-4038-8203-76f14e4b666b", "address": "fa:16:3e:6f:84:74", "network": {"id": "a2e4fc06-5a74-45cd-b530-6dd240bfd068", "bridge": "br-int", "label": "tempest-TestShelveInstance-1307896814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea59215474b04143951de2b9453a33ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcaf104ef-b6", "ovs_interfaceid": "caf104ef-b652-4038-8203-76f14e4b666b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:35:02 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-de2520fb-4d8d-4fbc-8dc6-6b4215a67c12 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] Releasing lock "refresh_cache-f7d1a157-3228-490e-a6a0-68f6bd2b52ba" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 09:35:02 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-de2520fb-4d8d-4fbc-8dc6-6b4215a67c12 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] [instance: f7d1a157-3228-490e-a6a0-68f6bd2b52ba] Creating instance directory {{(pid=75122) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 09:35:02 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-de2520fb-4d8d-4fbc-8dc6-6b4215a67c12 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] [instance: f7d1a157-3228-490e-a6a0-68f6bd2b52ba] Creating image(s)
Nov 15 09:35:02 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-de2520fb-4d8d-4fbc-8dc6-6b4215a67c12 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] [instance: f7d1a157-3228-490e-a6a0-68f6bd2b52ba] Did not create local disks {{(pid=75122) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 09:35:02 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-de2520fb-4d8d-4fbc-8dc6-6b4215a67c12 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] [instance: f7d1a157-3228-490e-a6a0-68f6bd2b52ba] Ensure instance console log exists: /opt/stack/data/nova/instances/f7d1a157-3228-490e-a6a0-68f6bd2b52ba/console.log {{(pid=75122) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 09:35:02 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-de2520fb-4d8d-4fbc-8dc6-6b4215a67c12 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:35:02 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-de2520fb-4d8d-4fbc-8dc6-6b4215a67c12 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:35:02 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-de2520fb-4d8d-4fbc-8dc6-6b4215a67c12 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:35:02 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-de2520fb-4d8d-4fbc-8dc6-6b4215a67c12 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] [instance: f7d1a157-3228-490e-a6a0-68f6bd2b52ba] Start _get_guest_xml network_info=[{"id": "caf104ef-b652-4038-8203-76f14e4b666b", "address": "fa:16:3e:6f:84:74", "network": {"id": "a2e4fc06-5a74-45cd-b530-6dd240bfd068", "bridge": "br-int", "label": "tempest-TestShelveInstance-1307896814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea59215474b04143951de2b9453a33ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcaf104ef-b6", "ovs_interfaceid": "caf104ef-b652-4038-8203-76f14e4b666b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pufAUkHv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f7d1a157-3228-490e-a6a0-68f6bd2b52ba', 'attached_at': '', 'detached_at': '', 'volume_id': 'd1b088a7-71ac-43f7-8ee4-c9a32a33681e', 'serial': 'd1b088a7-71ac-43f7-8ee4-c9a32a33681e'}, 'guest_format': None, 'delete_on_termination': True, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vda', 'attachment_id': '4c5980ea-4bae-4965-8797-67579e31d27e', 'volume_type': None} {{(pid=75122) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 09:35:02 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-473b88a4-70bc-41dc-97b6-64f1fb28dc63 req-1bbf84d4-6fa1-4cce-b86d-0aaad29d858e service nova] Acquired lock "refresh_cache-f7d1a157-3228-490e-a6a0-68f6bd2b52ba" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 09:35:02 user nova-compute[75122]: DEBUG nova.network.neutron [req-473b88a4-70bc-41dc-97b6-64f1fb28dc63 req-1bbf84d4-6fa1-4cce-b86d-0aaad29d858e service nova] [instance: f7d1a157-3228-490e-a6a0-68f6bd2b52ba] Refreshing network info cache for port caf104ef-b652-4038-8203-76f14e4b666b {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 09:35:02 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-de2520fb-4d8d-4fbc-8dc6-6b4215a67c12 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 09:35:02 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-de2520fb-4d8d-4fbc-8dc6-6b4215a67c12 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 09:35:02 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-de2520fb-4d8d-4fbc-8dc6-6b4215a67c12 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75122) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 09:35:02 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-de2520fb-4d8d-4fbc-8dc6-6b4215a67c12 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] CPU controller missing on host. {{(pid=75122) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 09:35:02 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-de2520fb-4d8d-4fbc-8dc6-6b4215a67c12 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75122) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 09:35:02 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-de2520fb-4d8d-4fbc-8dc6-6b4215a67c12 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] CPU controller found on host. {{(pid=75122) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 09:35:02 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-de2520fb-4d8d-4fbc-8dc6-6b4215a67c12 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75122) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 09:35:02 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-de2520fb-4d8d-4fbc-8dc6-6b4215a67c12 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T09:26:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 09:35:02 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-de2520fb-4d8d-4fbc-8dc6-6b4215a67c12 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] Flavor limits 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 09:35:02 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-de2520fb-4d8d-4fbc-8dc6-6b4215a67c12 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] Image limits 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 09:35:02 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-de2520fb-4d8d-4fbc-8dc6-6b4215a67c12 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] Flavor pref 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 09:35:02 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-de2520fb-4d8d-4fbc-8dc6-6b4215a67c12 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] Image pref 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 09:35:02 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-de2520fb-4d8d-4fbc-8dc6-6b4215a67c12 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 09:35:02 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-de2520fb-4d8d-4fbc-8dc6-6b4215a67c12 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 09:35:02 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-de2520fb-4d8d-4fbc-8dc6-6b4215a67c12 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75122) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 09:35:02 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-de2520fb-4d8d-4fbc-8dc6-6b4215a67c12 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] Got 1 possible topologies {{(pid=75122) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 09:35:02 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-de2520fb-4d8d-4fbc-8dc6-6b4215a67c12 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 09:35:02 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-de2520fb-4d8d-4fbc-8dc6-6b4215a67c12 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 09:35:02 user nova-compute[75122]: DEBUG nova.objects.instance [None req-de2520fb-4d8d-4fbc-8dc6-6b4215a67c12 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] Lazy-loading 'vcpu_model' on Instance uuid f7d1a157-3228-490e-a6a0-68f6bd2b52ba {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:35:02 user nova-compute[75122]: DEBUG nova.objects.base [None req-de2520fb-4d8d-4fbc-8dc6-6b4215a67c12 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] Object Instance<f7d1a157-3228-490e-a6a0-68f6bd2b52ba> lazy-loaded attributes: pci_requests,vcpu_model {{(pid=75122) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 09:35:02 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de2520fb-4d8d-4fbc-8dc6-6b4215a67c12 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] [instance: f7d1a157-3228-490e-a6a0-68f6bd2b52ba] Calling os-brick to attach iSCSI Volume {{(pid=75122) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 09:35:02 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-de2520fb-4d8d-4fbc-8dc6-6b4215a67c12 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffa04060b80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pufAUkHv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 09:35:02 user nova-compute[75122]: WARNING os_brick.initiator.connectors.base [None req-de2520fb-4d8d-4fbc-8dc6-6b4215a67c12 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 09:35:02 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-de2520fb-4d8d-4fbc-8dc6-6b4215a67c12 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 09:35:02 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-de2520fb-4d8d-4fbc-8dc6-6b4215a67c12 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 09:35:02 user nova-compute[75122]: WARNING os_brick.initiator.connectors.base [None req-de2520fb-4d8d-4fbc-8dc6-6b4215a67c12 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 09:35:02 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-de2520fb-4d8d-4fbc-8dc6-6b4215a67c12 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 09:35:02 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-de2520fb-4d8d-4fbc-8dc6-6b4215a67c12 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 09:35:02 user nova-compute[75122]: INFO os_brick.initiator.connectors.iscsi [None req-de2520fb-4d8d-4fbc-8dc6-6b4215a67c12 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 09:35:02 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e -p 172.16.0.220:3260 {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:35:02 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:35:02 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[880e09d3-0872-47ea-9df9-e4ad01135192]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:35:02 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-de2520fb-4d8d-4fbc-8dc6-6b4215a67c12 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 09:35:02 user nova-compute[75122]:  {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:35:02 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e -p 172.16.0.220:3260 --interface default --op new {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:35:03 user nova-compute[75122]: DEBUG nova.network.neutron [req-dd322975-a9cd-4a3c-b92e-5670dfb3a84b req-cf7133b9-2445-4684-91b9-6cf1984d84d1 service nova] [instance: 5b5a4d58-ba1e-473d-a32a-06fae1c84efc] Updated VIF entry in instance network info cache for port b245a5c2-e523-4d4e-a343-f5b2352337ab. {{(pid=75122) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 09:35:03 user nova-compute[75122]: DEBUG nova.network.neutron [req-dd322975-a9cd-4a3c-b92e-5670dfb3a84b req-cf7133b9-2445-4684-91b9-6cf1984d84d1 service nova] [instance: 5b5a4d58-ba1e-473d-a32a-06fae1c84efc] Updating instance_info_cache with network_info: [{"id": "b245a5c2-e523-4d4e-a343-f5b2352337ab", "address": "fa:16:3e:cd:ac:71", "network": {"id": "53e8c131-26be-4b3f-beca-dd48fe06ffbe", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-888345656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6aed61f0071f44ac901b94cd9a4a909d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb245a5c2-e5", "ovs_interfaceid": "b245a5c2-e523-4d4e-a343-f5b2352337ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:35:03 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:35:03 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1d169a1-58b4-41ad-8bfc-91e158e1edf0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e] added\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:35:03 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-de2520fb-4d8d-4fbc-8dc6-6b4215a67c12 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e] added
Nov 15 09:35:03 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:35:03 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:35:03 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-dd322975-a9cd-4a3c-b92e-5670dfb3a84b req-cf7133b9-2445-4684-91b9-6cf1984d84d1 service nova] Releasing lock "refresh_cache-5b5a4d58-ba1e-473d-a32a-06fae1c84efc" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 09:35:03 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.173s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:35:03 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[222aeff1-a403-42ef-9219-eb17f3b68066]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:35:03 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-de2520fb-4d8d-4fbc-8dc6-6b4215a67c12 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:35:03 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:35:03 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.056s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:35:03 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3547e2d-b434-4fa1-b471-054da25e1614]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:35:03 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-de2520fb-4d8d-4fbc-8dc6-6b4215a67c12 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:35:03 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pufAUkHv {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:35:03 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pufAUkHv" returned: 0 in 0.024s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:35:03 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ceed432-ecce-46f1-95c6-34b461668234]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:35:03 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-de2520fb-4d8d-4fbc-8dc6-6b4215a67c12 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pufAUkHv'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:35:03 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:35:03 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:35:03 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd009598-234a-484a-9cf3-a9c561d6f454]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:35:03 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-de2520fb-4d8d-4fbc-8dc6-6b4215a67c12 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:35:03 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:35:03 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.049s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:35:03 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[23f03218-85ed-4c23-adba-60ce64cafce3]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01563785-3767-460a-9815-c1bd0f7f6f9f (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bca4e77f-05f8-4ff6-8a78-6cef699f5667 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a8a33bb-713e-4109-8306-fe91fd67904f (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:697acd7d-564d-4149-9ecf-7c7d89f10013 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df76fc47-1a36-4bd6-97e6-bff6a6ead337 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9022bc1-82d9-4e14-9d0e-85a8b645e512 (non-flash)\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:35:03 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-de2520fb-4d8d-4fbc-8dc6-6b4215a67c12 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01563785-3767-460a-9815-c1bd0f7f6f9f (non-flash)
Nov 15 09:35:03 user nova-compute[75122]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bca4e77f-05f8-4ff6-8a78-6cef699f5667 (non-flash)
Nov 15 09:35:03 user nova-compute[75122]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a8a33bb-713e-4109-8306-fe91fd67904f (non-flash)
Nov 15 09:35:03 user nova-compute[75122]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16 (non-flash)
Nov 15 09:35:03 user nova-compute[75122]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:697acd7d-564d-4149-9ecf-7c7d89f10013 (non-flash)
Nov 15 09:35:03 user nova-compute[75122]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df76fc47-1a36-4bd6-97e6-bff6a6ead337 (non-flash)
Nov 15 09:35:03 user nova-compute[75122]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9022bc1-82d9-4e14-9d0e-85a8b645e512 (non-flash)
Nov 15 09:35:03 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 09:35:03 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-de2520fb-4d8d-4fbc-8dc6-6b4215a67c12 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01563785-3767-460a-9815-c1bd0f7f6f9f (non-flash)
Nov 15 09:35:03 user nova-compute[75122]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bca4e77f-05f8-4ff6-8a78-6cef699f5667 (non-flash)
Nov 15 09:35:03 user nova-compute[75122]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a8a33bb-713e-4109-8306-fe91fd67904f (non-flash)
Nov 15 09:35:03 user nova-compute[75122]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16 (non-flash)
Nov 15 09:35:03 user nova-compute[75122]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:697acd7d-564d-4149-9ecf-7c7d89f10013 (non-flash)
Nov 15 09:35:03 user nova-compute[75122]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df76fc47-1a36-4bd6-97e6-bff6a6ead337 (non-flash)
Nov 15 09:35:03 user nova-compute[75122]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9022bc1-82d9-4e14-9d0e-85a8b645e512 (non-flash)
Nov 15 09:35:03 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 09:35:03 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e -p 172.16.0.220:3260 --login {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:35:03 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e -p 172.16.0.220:3260 --login" returned: 0 in 0.085s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:35:03 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[aefb8fdf-ab71-4446-8edf-3048c712d906]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:35:03 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-de2520fb-4d8d-4fbc-8dc6-6b4215a67c12 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e, portal: 172.16.0.220,3260]
Nov 15 09:35:03 user nova-compute[75122]: Login to [iface: default, target: iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e, portal: 172.16.0.220,3260] successful.
Nov 15 09:35:03 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:35:03 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:35:03 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:35:03 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f7b684a-fcb3-4c76-99c5-9b99e278a590]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:35:03 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-de2520fb-4d8d-4fbc-8dc6-6b4215a67c12 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:35:03 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:35:03 user nova-compute[75122]: DEBUG nova.network.neutron [req-473b88a4-70bc-41dc-97b6-64f1fb28dc63 req-1bbf84d4-6fa1-4cce-b86d-0aaad29d858e service nova] [instance: f7d1a157-3228-490e-a6a0-68f6bd2b52ba] Updated VIF entry in instance network info cache for port caf104ef-b652-4038-8203-76f14e4b666b. {{(pid=75122) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 09:35:03 user nova-compute[75122]: DEBUG nova.network.neutron [req-473b88a4-70bc-41dc-97b6-64f1fb28dc63 req-1bbf84d4-6fa1-4cce-b86d-0aaad29d858e service nova] [instance: f7d1a157-3228-490e-a6a0-68f6bd2b52ba] Updating instance_info_cache with network_info: [{"id": "caf104ef-b652-4038-8203-76f14e4b666b", "address": "fa:16:3e:6f:84:74", "network": {"id": "a2e4fc06-5a74-45cd-b530-6dd240bfd068", "bridge": "br-int", "label": "tempest-TestShelveInstance-1307896814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea59215474b04143951de2b9453a33ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcaf104ef-b6", "ovs_interfaceid": "caf104ef-b652-4038-8203-76f14e4b666b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:35:03 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:35:03 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb7b1fa4-7c98-4adc-8995-d307c057021c]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01563785-3767-460a-9815-c1bd0f7f6f9f (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bca4e77f-05f8-4ff6-8a78-6cef699f5667 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a8a33bb-713e-4109-8306-fe91fd67904f (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:697acd7d-564d-4149-9ecf-7c7d89f10013 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df76fc47-1a36-4bd6-97e6-bff6a6ead337 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9022bc1-82d9-4e14-9d0e-85a8b645e512 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e (non-flash)\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:35:03 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-de2520fb-4d8d-4fbc-8dc6-6b4215a67c12 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01563785-3767-460a-9815-c1bd0f7f6f9f (non-flash)
Nov 15 09:35:03 user nova-compute[75122]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bca4e77f-05f8-4ff6-8a78-6cef699f5667 (non-flash)
Nov 15 09:35:03 user nova-compute[75122]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a8a33bb-713e-4109-8306-fe91fd67904f (non-flash)
Nov 15 09:35:03 user nova-compute[75122]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16 (non-flash)
Nov 15 09:35:03 user nova-compute[75122]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:697acd7d-564d-4149-9ecf-7c7d89f10013 (non-flash)
Nov 15 09:35:03 user nova-compute[75122]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df76fc47-1a36-4bd6-97e6-bff6a6ead337 (non-flash)
Nov 15 09:35:03 user nova-compute[75122]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9022bc1-82d9-4e14-9d0e-85a8b645e512 (non-flash)
Nov 15 09:35:03 user nova-compute[75122]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e (non-flash)
Nov 15 09:35:03 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 09:35:03 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-de2520fb-4d8d-4fbc-8dc6-6b4215a67c12 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01563785-3767-460a-9815-c1bd0f7f6f9f (non-flash)
Nov 15 09:35:03 user nova-compute[75122]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bca4e77f-05f8-4ff6-8a78-6cef699f5667 (non-flash)
Nov 15 09:35:03 user nova-compute[75122]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a8a33bb-713e-4109-8306-fe91fd67904f (non-flash)
Nov 15 09:35:03 user nova-compute[75122]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16 (non-flash)
Nov 15 09:35:03 user nova-compute[75122]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:697acd7d-564d-4149-9ecf-7c7d89f10013 (non-flash)
Nov 15 09:35:03 user nova-compute[75122]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df76fc47-1a36-4bd6-97e6-bff6a6ead337 (non-flash)
Nov 15 09:35:03 user nova-compute[75122]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9022bc1-82d9-4e14-9d0e-85a8b645e512 (non-flash)
Nov 15 09:35:03 user nova-compute[75122]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e (non-flash)
Nov 15 09:35:03 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 09:35:03 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-de2520fb-4d8d-4fbc-8dc6-6b4215a67c12 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.583s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 09:35:03 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-de2520fb-4d8d-4fbc-8dc6-6b4215a67c12 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] Connected to 172.16.0.220:3260 {{(pid=75122) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 09:35:03 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-de2520fb-4d8d-4fbc-8dc6-6b4215a67c12 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] HCTL ('40', '-', '-', 0) found on session 21 with lun 0 {{(pid=75122) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 09:35:03 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-de2520fb-4d8d-4fbc-8dc6-6b4215a67c12 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=75122) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 09:35:03 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:35:03 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-473b88a4-70bc-41dc-97b6-64f1fb28dc63 req-1bbf84d4-6fa1-4cce-b86d-0aaad29d858e service nova] Releasing lock "refresh_cache-f7d1a157-3228-490e-a6a0-68f6bd2b52ba" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 09:35:03 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.019s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:35:03 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[070a1348-864a-42de-8841-99d95fb3eaf3]: (4, ('- - 0', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:35:03 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-de2520fb-4d8d-4fbc-8dc6-6b4215a67c12 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] Searching for a device in session 21 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=75122) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 09:35:03 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-de2520fb-4d8d-4fbc-8dc6-6b4215a67c12 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pufAUkHv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75122) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 09:35:03 user nova-compute[75122]: DEBUG nova.compute.manager [req-9bef3f62-e88f-409c-9a4d-138245e0f598 req-3a511c4d-df23-466b-b800-578f3b31691e service nova] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] Received event network-vif-plugged-598c4b32-243b-461b-b9a4-3a2ba2b7537b {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:35:03 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-9bef3f62-e88f-409c-9a4d-138245e0f598 req-3a511c4d-df23-466b-b800-578f3b31691e service nova] Acquiring lock "6a2fb361-de47-41c4-afa2-46f7107af1f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:35:03 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-9bef3f62-e88f-409c-9a4d-138245e0f598 req-3a511c4d-df23-466b-b800-578f3b31691e service nova] Lock "6a2fb361-de47-41c4-afa2-46f7107af1f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:35:03 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-9bef3f62-e88f-409c-9a4d-138245e0f598 req-3a511c4d-df23-466b-b800-578f3b31691e service nova] Lock "6a2fb361-de47-41c4-afa2-46f7107af1f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:35:03 user nova-compute[75122]: DEBUG nova.compute.manager [req-9bef3f62-e88f-409c-9a4d-138245e0f598 req-3a511c4d-df23-466b-b800-578f3b31691e service nova] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] No waiting events found dispatching network-vif-plugged-598c4b32-243b-461b-b9a4-3a2ba2b7537b {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:35:03 user nova-compute[75122]: WARNING nova.compute.manager [req-9bef3f62-e88f-409c-9a4d-138245e0f598 req-3a511c4d-df23-466b-b800-578f3b31691e service nova] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] Received unexpected event network-vif-plugged-598c4b32-243b-461b-b9a4-3a2ba2b7537b for instance with vm_state active and task_state None.
Nov 15 09:35:03 user nova-compute[75122]: DEBUG nova.compute.manager [req-9bef3f62-e88f-409c-9a4d-138245e0f598 req-3a511c4d-df23-466b-b800-578f3b31691e service nova] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] Received event network-vif-plugged-917da5e4-bdd2-40d9-9e03-b6f96858805b {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:35:03 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-9bef3f62-e88f-409c-9a4d-138245e0f598 req-3a511c4d-df23-466b-b800-578f3b31691e service nova] Acquiring lock "6a2fb361-de47-41c4-afa2-46f7107af1f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:35:03 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-9bef3f62-e88f-409c-9a4d-138245e0f598 req-3a511c4d-df23-466b-b800-578f3b31691e service nova] Lock "6a2fb361-de47-41c4-afa2-46f7107af1f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:35:03 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-9bef3f62-e88f-409c-9a4d-138245e0f598 req-3a511c4d-df23-466b-b800-578f3b31691e service nova] Lock "6a2fb361-de47-41c4-afa2-46f7107af1f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:35:03 user nova-compute[75122]: DEBUG nova.compute.manager [req-9bef3f62-e88f-409c-9a4d-138245e0f598 req-3a511c4d-df23-466b-b800-578f3b31691e service nova] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] No waiting events found dispatching network-vif-plugged-917da5e4-bdd2-40d9-9e03-b6f96858805b {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:35:03 user nova-compute[75122]: WARNING nova.compute.manager [req-9bef3f62-e88f-409c-9a4d-138245e0f598 req-3a511c4d-df23-466b-b800-578f3b31691e service nova] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] Received unexpected event network-vif-plugged-917da5e4-bdd2-40d9-9e03-b6f96858805b for instance with vm_state active and task_state None.
Nov 15 09:35:03 user nova-compute[75122]: DEBUG nova.compute.manager [req-9bef3f62-e88f-409c-9a4d-138245e0f598 req-3a511c4d-df23-466b-b800-578f3b31691e service nova] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] Received event network-vif-plugged-917da5e4-bdd2-40d9-9e03-b6f96858805b {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:35:03 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-9bef3f62-e88f-409c-9a4d-138245e0f598 req-3a511c4d-df23-466b-b800-578f3b31691e service nova] Acquiring lock "6a2fb361-de47-41c4-afa2-46f7107af1f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:35:03 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-9bef3f62-e88f-409c-9a4d-138245e0f598 req-3a511c4d-df23-466b-b800-578f3b31691e service nova] Lock "6a2fb361-de47-41c4-afa2-46f7107af1f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:35:03 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-9bef3f62-e88f-409c-9a4d-138245e0f598 req-3a511c4d-df23-466b-b800-578f3b31691e service nova] Lock "6a2fb361-de47-41c4-afa2-46f7107af1f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:35:03 user nova-compute[75122]: DEBUG nova.compute.manager [req-9bef3f62-e88f-409c-9a4d-138245e0f598 req-3a511c4d-df23-466b-b800-578f3b31691e service nova] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] No waiting events found dispatching network-vif-plugged-917da5e4-bdd2-40d9-9e03-b6f96858805b {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:35:03 user nova-compute[75122]: WARNING nova.compute.manager [req-9bef3f62-e88f-409c-9a4d-138245e0f598 req-3a511c4d-df23-466b-b800-578f3b31691e service nova] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] Received unexpected event network-vif-plugged-917da5e4-bdd2-40d9-9e03-b6f96858805b for instance with vm_state active and task_state None.
Nov 15 09:35:04 user nova-compute[75122]: DEBUG nova.compute.manager [req-87f373c9-fd76-47d3-a5f5-8638b96544b3 req-88bfb417-d151-4f7c-b907-926b09cb6211 service nova] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] Received event network-vif-plugged-2f92aaa6-98e2-4d75-8b96-92c08d77c635 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:35:04 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-87f373c9-fd76-47d3-a5f5-8638b96544b3 req-88bfb417-d151-4f7c-b907-926b09cb6211 service nova] Acquiring lock "6a2fb361-de47-41c4-afa2-46f7107af1f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:35:04 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-87f373c9-fd76-47d3-a5f5-8638b96544b3 req-88bfb417-d151-4f7c-b907-926b09cb6211 service nova] Lock "6a2fb361-de47-41c4-afa2-46f7107af1f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:35:04 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-87f373c9-fd76-47d3-a5f5-8638b96544b3 req-88bfb417-d151-4f7c-b907-926b09cb6211 service nova] Lock "6a2fb361-de47-41c4-afa2-46f7107af1f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:35:04 user nova-compute[75122]: DEBUG nova.compute.manager [req-87f373c9-fd76-47d3-a5f5-8638b96544b3 req-88bfb417-d151-4f7c-b907-926b09cb6211 service nova] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] No waiting events found dispatching network-vif-plugged-2f92aaa6-98e2-4d75-8b96-92c08d77c635 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:35:04 user nova-compute[75122]: WARNING nova.compute.manager [req-87f373c9-fd76-47d3-a5f5-8638b96544b3 req-88bfb417-d151-4f7c-b907-926b09cb6211 service nova] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] Received unexpected event network-vif-plugged-2f92aaa6-98e2-4d75-8b96-92c08d77c635 for instance with vm_state active and task_state None.
Nov 15 09:35:04 user nova-compute[75122]: DEBUG nova.compute.manager [req-87f373c9-fd76-47d3-a5f5-8638b96544b3 req-88bfb417-d151-4f7c-b907-926b09cb6211 service nova] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] Received event network-vif-plugged-2f92aaa6-98e2-4d75-8b96-92c08d77c635 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:35:04 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-87f373c9-fd76-47d3-a5f5-8638b96544b3 req-88bfb417-d151-4f7c-b907-926b09cb6211 service nova] Acquiring lock "6a2fb361-de47-41c4-afa2-46f7107af1f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:35:04 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-87f373c9-fd76-47d3-a5f5-8638b96544b3 req-88bfb417-d151-4f7c-b907-926b09cb6211 service nova] Lock "6a2fb361-de47-41c4-afa2-46f7107af1f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:35:04 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-87f373c9-fd76-47d3-a5f5-8638b96544b3 req-88bfb417-d151-4f7c-b907-926b09cb6211 service nova] Lock "6a2fb361-de47-41c4-afa2-46f7107af1f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:35:04 user nova-compute[75122]: DEBUG nova.compute.manager [req-87f373c9-fd76-47d3-a5f5-8638b96544b3 req-88bfb417-d151-4f7c-b907-926b09cb6211 service nova] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] No waiting events found dispatching network-vif-plugged-2f92aaa6-98e2-4d75-8b96-92c08d77c635 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:35:04 user nova-compute[75122]: WARNING nova.compute.manager [req-87f373c9-fd76-47d3-a5f5-8638b96544b3 req-88bfb417-d151-4f7c-b907-926b09cb6211 service nova] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] Received unexpected event network-vif-plugged-2f92aaa6-98e2-4d75-8b96-92c08d77c635 for instance with vm_state active and task_state None.
Nov 15 09:35:04 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:35:04 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:35:04 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:35:04 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:35:04 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-de2520fb-4d8d-4fbc-8dc6-6b4215a67c12 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.626s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 09:35:04 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-de2520fb-4d8d-4fbc-8dc6-6b4215a67c12 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] <== connect_volume: return (1629ms) {'type': 'block', 'scsi_wwn': '23239313437666239', 'path': '/dev/sdi'} {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 09:35:04 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de2520fb-4d8d-4fbc-8dc6-6b4215a67c12 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] [instance: f7d1a157-3228-490e-a6a0-68f6bd2b52ba] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23239313437666239', 'path': '/dev/sdi'} {{(pid=75122) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 09:35:04 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-de2520fb-4d8d-4fbc-8dc6-6b4215a67c12 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-15T09:31:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-603494418',display_name='tempest-TestShelveInstance-server-603494418',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-603494418',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-571538458',keypairs=<?>,launch_index=0,launched_at=2023-11-15T09:31:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='ea59215474b04143951de2b9453a33ad',ramdisk_id='',reservation_id='r-rwg3hjam',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1849491535',owner_user_name='tempest-TestShelveInstance-1849491535-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T09:34:53Z,user_data=None,user_id='f9f813d56e87487498cb9f8454ea1651',uuid=f7d1a157-3228-490e-a6a0-68f6bd2b52ba,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "caf104ef-b652-4038-8203-76f14e4b666b", "address": "fa:16:3e:6f:84:74", "network": {"id": "a2e4fc06-5a74-45cd-b530-6dd240bfd068", "bridge": "br-int", "label": "tempest-TestShelveInstance-1307896814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea59215474b04143951de2b9453a33ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcaf104ef-b6", "ovs_interfaceid": "caf104ef-b652-4038-8203-76f14e4b666b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75122) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 09:35:04 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-de2520fb-4d8d-4fbc-8dc6-6b4215a67c12 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] Converting VIF {"id": "caf104ef-b652-4038-8203-76f14e4b666b", "address": "fa:16:3e:6f:84:74", "network": {"id": "a2e4fc06-5a74-45cd-b530-6dd240bfd068", "bridge": "br-int", "label": "tempest-TestShelveInstance-1307896814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea59215474b04143951de2b9453a33ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcaf104ef-b6", "ovs_interfaceid": "caf104ef-b652-4038-8203-76f14e4b666b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 09:35:04 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-de2520fb-4d8d-4fbc-8dc6-6b4215a67c12 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:84:74,bridge_name='br-int',has_traffic_filtering=True,id=caf104ef-b652-4038-8203-76f14e4b666b,network=Network(a2e4fc06-5a74-45cd-b530-6dd240bfd068),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcaf104ef-b6') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 09:35:04 user nova-compute[75122]: DEBUG nova.objects.instance [None req-de2520fb-4d8d-4fbc-8dc6-6b4215a67c12 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] Lazy-loading 'pci_devices' on Instance uuid f7d1a157-3228-490e-a6a0-68f6bd2b52ba {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:35:04 user nova-compute[75122]: DEBUG nova.objects.base [None req-de2520fb-4d8d-4fbc-8dc6-6b4215a67c12 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] Object Instance<f7d1a157-3228-490e-a6a0-68f6bd2b52ba> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices {{(pid=75122) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 09:35:04 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-de2520fb-4d8d-4fbc-8dc6-6b4215a67c12 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] [instance: f7d1a157-3228-490e-a6a0-68f6bd2b52ba] End _get_guest_xml xml=<domain type="kvm">
Nov 15 09:35:04 user nova-compute[75122]:   <uuid>f7d1a157-3228-490e-a6a0-68f6bd2b52ba</uuid>
Nov 15 09:35:04 user nova-compute[75122]:   <name>instance-00000009</name>
Nov 15 09:35:04 user nova-compute[75122]:   <memory>524288</memory>
Nov 15 09:35:04 user nova-compute[75122]:   <vcpu>1</vcpu>
Nov 15 09:35:04 user nova-compute[75122]:   <metadata>
Nov 15 09:35:04 user nova-compute[75122]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 09:35:04 user nova-compute[75122]:       <nova:package version="0.0.0"/>
Nov 15 09:35:04 user nova-compute[75122]:       <nova:name>tempest-TestShelveInstance-server-603494418</nova:name>
Nov 15 09:35:04 user nova-compute[75122]:       <nova:creationTime>2023-11-15 09:35:02</nova:creationTime>
Nov 15 09:35:04 user nova-compute[75122]:       <nova:flavor name="m1.tiny">
Nov 15 09:35:04 user nova-compute[75122]:         <nova:memory>512</nova:memory>
Nov 15 09:35:04 user nova-compute[75122]:         <nova:disk>1</nova:disk>
Nov 15 09:35:04 user nova-compute[75122]:         <nova:swap>0</nova:swap>
Nov 15 09:35:04 user nova-compute[75122]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 09:35:04 user nova-compute[75122]:         <nova:vcpus>1</nova:vcpus>
Nov 15 09:35:04 user nova-compute[75122]:       </nova:flavor>
Nov 15 09:35:04 user nova-compute[75122]:       <nova:owner>
Nov 15 09:35:04 user nova-compute[75122]:         <nova:user uuid="f9f813d56e87487498cb9f8454ea1651">tempest-TestShelveInstance-1849491535-project-member</nova:user>
Nov 15 09:35:04 user nova-compute[75122]:         <nova:project uuid="ea59215474b04143951de2b9453a33ad">tempest-TestShelveInstance-1849491535</nova:project>
Nov 15 09:35:04 user nova-compute[75122]:       </nova:owner>
Nov 15 09:35:04 user nova-compute[75122]:       <nova:ports>
Nov 15 09:35:04 user nova-compute[75122]:         <nova:port uuid="caf104ef-b652-4038-8203-76f14e4b666b">
Nov 15 09:35:04 user nova-compute[75122]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 15 09:35:04 user nova-compute[75122]:         </nova:port>
Nov 15 09:35:04 user nova-compute[75122]:       </nova:ports>
Nov 15 09:35:04 user nova-compute[75122]:     </nova:instance>
Nov 15 09:35:04 user nova-compute[75122]:   </metadata>
Nov 15 09:35:04 user nova-compute[75122]:   <sysinfo type="smbios">
Nov 15 09:35:04 user nova-compute[75122]:     <system>
Nov 15 09:35:04 user nova-compute[75122]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 09:35:04 user nova-compute[75122]:       <entry name="product">OpenStack Nova</entry>
Nov 15 09:35:04 user nova-compute[75122]:       <entry name="version">0.0.0</entry>
Nov 15 09:35:04 user nova-compute[75122]:       <entry name="serial">f7d1a157-3228-490e-a6a0-68f6bd2b52ba</entry>
Nov 15 09:35:04 user nova-compute[75122]:       <entry name="uuid">f7d1a157-3228-490e-a6a0-68f6bd2b52ba</entry>
Nov 15 09:35:04 user nova-compute[75122]:       <entry name="family">Virtual Machine</entry>
Nov 15 09:35:04 user nova-compute[75122]:     </system>
Nov 15 09:35:04 user nova-compute[75122]:   </sysinfo>
Nov 15 09:35:04 user nova-compute[75122]:   <os>
Nov 15 09:35:04 user nova-compute[75122]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 09:35:04 user nova-compute[75122]:     <boot dev="hd"/>
Nov 15 09:35:04 user nova-compute[75122]:     <smbios mode="sysinfo"/>
Nov 15 09:35:04 user nova-compute[75122]:   </os>
Nov 15 09:35:04 user nova-compute[75122]:   <features>
Nov 15 09:35:04 user nova-compute[75122]:     <acpi/>
Nov 15 09:35:04 user nova-compute[75122]:     <apic/>
Nov 15 09:35:04 user nova-compute[75122]:     <vmcoreinfo/>
Nov 15 09:35:04 user nova-compute[75122]:   </features>
Nov 15 09:35:04 user nova-compute[75122]:   <clock offset="utc">
Nov 15 09:35:04 user nova-compute[75122]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 09:35:04 user nova-compute[75122]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 09:35:04 user nova-compute[75122]:     <timer name="hpet" present="no"/>
Nov 15 09:35:04 user nova-compute[75122]:   </clock>
Nov 15 09:35:04 user nova-compute[75122]:   <cpu mode="custom" match="exact">
Nov 15 09:35:04 user nova-compute[75122]:     <model>Nehalem</model>
Nov 15 09:35:04 user nova-compute[75122]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 09:35:04 user nova-compute[75122]:   </cpu>
Nov 15 09:35:04 user nova-compute[75122]:   <devices>
Nov 15 09:35:04 user nova-compute[75122]:     <disk type="block" device="disk">
Nov 15 09:35:04 user nova-compute[75122]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 09:35:04 user nova-compute[75122]:       <source dev="/dev/sdi"/>
Nov 15 09:35:04 user nova-compute[75122]:       <target dev="vda" bus="virtio"/>
Nov 15 09:35:04 user nova-compute[75122]:       <serial>d1b088a7-71ac-43f7-8ee4-c9a32a33681e</serial>
Nov 15 09:35:04 user nova-compute[75122]:     </disk>
Nov 15 09:35:04 user nova-compute[75122]:     <interface type="ethernet">
Nov 15 09:35:04 user nova-compute[75122]:       <mac address="fa:16:3e:6f:84:74"/>
Nov 15 09:35:04 user nova-compute[75122]:       <model type="virtio"/>
Nov 15 09:35:04 user nova-compute[75122]:       <mtu size="1442"/>
Nov 15 09:35:04 user nova-compute[75122]:       <target dev="tapcaf104ef-b6"/>
Nov 15 09:35:04 user nova-compute[75122]:     </interface>
Nov 15 09:35:04 user nova-compute[75122]:     <serial type="pty">
Nov 15 09:35:04 user nova-compute[75122]:       <log file="/opt/stack/data/nova/instances/f7d1a157-3228-490e-a6a0-68f6bd2b52ba/console.log" append="off"/>
Nov 15 09:35:04 user nova-compute[75122]:     </serial>
Nov 15 09:35:04 user nova-compute[75122]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 09:35:04 user nova-compute[75122]:     <video>
Nov 15 09:35:04 user nova-compute[75122]:       <model type="virtio"/>
Nov 15 09:35:04 user nova-compute[75122]:     </video>
Nov 15 09:35:04 user nova-compute[75122]:     <rng model="virtio">
Nov 15 09:35:04 user nova-compute[75122]:       <backend model="random">/dev/urandom</backend>
Nov 15 09:35:04 user nova-compute[75122]:     </rng>
Nov 15 09:35:04 user nova-compute[75122]:     <controller type="usb" index="0" model="none"/>
Nov 15 09:35:04 user nova-compute[75122]:     <memballoon model="virtio">
Nov 15 09:35:04 user nova-compute[75122]:       <stats period="10"/>
Nov 15 09:35:04 user nova-compute[75122]:     </memballoon>
Nov 15 09:35:04 user nova-compute[75122]:   </devices>
Nov 15 09:35:04 user nova-compute[75122]: </domain>
Nov 15 09:35:04 user nova-compute[75122]:  {{(pid=75122) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 09:35:04 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-de2520fb-4d8d-4fbc-8dc6-6b4215a67c12 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-15T09:31:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-603494418',display_name='tempest-TestShelveInstance-server-603494418',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-603494418',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-571538458',keypairs=<?>,launch_index=0,launched_at=2023-11-15T09:31:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='ea59215474b04143951de2b9453a33ad',ramdisk_id='',reservation_id='r-rwg3hjam',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1849491535',owner_user_name='tempest-TestShelveInstance-1849491535-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T09:34:53Z,user_data=None,user_id='f9f813d56e87487498cb9f8454ea1651',uuid=f7d1a157-3228-490e-a6a0-68f6bd2b52ba,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "caf104ef-b652-4038-8203-76f14e4b666b", "address": "fa:16:3e:6f:84:74", "network": {"id": "a2e4fc06-5a74-45cd-b530-6dd240bfd068", "bridge": "br-int", "label": "tempest-TestShelveInstance-1307896814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea59215474b04143951de2b9453a33ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcaf104ef-b6", "ovs_interfaceid": "caf104ef-b652-4038-8203-76f14e4b666b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 09:35:04 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-de2520fb-4d8d-4fbc-8dc6-6b4215a67c12 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] Converting VIF {"id": "caf104ef-b652-4038-8203-76f14e4b666b", "address": "fa:16:3e:6f:84:74", "network": {"id": "a2e4fc06-5a74-45cd-b530-6dd240bfd068", "bridge": "br-int", "label": "tempest-TestShelveInstance-1307896814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea59215474b04143951de2b9453a33ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcaf104ef-b6", "ovs_interfaceid": "caf104ef-b652-4038-8203-76f14e4b666b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 09:35:04 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-de2520fb-4d8d-4fbc-8dc6-6b4215a67c12 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:84:74,bridge_name='br-int',has_traffic_filtering=True,id=caf104ef-b652-4038-8203-76f14e4b666b,network=Network(a2e4fc06-5a74-45cd-b530-6dd240bfd068),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcaf104ef-b6') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 09:35:04 user nova-compute[75122]: DEBUG os_vif [None req-de2520fb-4d8d-4fbc-8dc6-6b4215a67c12 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:84:74,bridge_name='br-int',has_traffic_filtering=True,id=caf104ef-b652-4038-8203-76f14e4b666b,network=Network(a2e4fc06-5a74-45cd-b530-6dd240bfd068),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcaf104ef-b6') {{(pid=75122) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 09:35:04 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:35:04 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:35:04 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 09:35:04 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:35:04 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'affc42db-29a4-5ea3-b0fe-a3a73781f070', '_type': 'linux-noop'}}, row=False) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:35:04 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:35:04 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:35:04 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:35:04 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcaf104ef-b6, may_exist=True, interface_attrs={}) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:35:04 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcaf104ef-b6, col_values=(('qos', UUID('a5b4784c-80bb-4b35-afee-c804d04c63d5')),), if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:35:04 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcaf104ef-b6, col_values=(('external_ids', {'iface-id': 'caf104ef-b652-4038-8203-76f14e4b666b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6f:84:74', 'vm-uuid': 'f7d1a157-3228-490e-a6a0-68f6bd2b52ba'}),), if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:35:04 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:35:04 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:35:04 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:35:04 user nova-compute[75122]: INFO os_vif [None req-de2520fb-4d8d-4fbc-8dc6-6b4215a67c12 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:84:74,bridge_name='br-int',has_traffic_filtering=True,id=caf104ef-b652-4038-8203-76f14e4b666b,network=Network(a2e4fc06-5a74-45cd-b530-6dd240bfd068),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcaf104ef-b6')
Nov 15 09:35:04 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-de2520fb-4d8d-4fbc-8dc6-6b4215a67c12 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] No BDM found with device name vda, not building metadata. {{(pid=75122) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 09:35:04 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-de2520fb-4d8d-4fbc-8dc6-6b4215a67c12 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] No VIF found with MAC fa:16:3e:6f:84:74, not building metadata {{(pid=75122) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 09:35:05 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:35:05 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:35:05 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:35:05 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:35:05 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:35:05 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:35:05 user nova-compute[75122]: DEBUG nova.compute.manager [req-71c46037-5e3a-4d69-8b17-9d02a594dcf9 req-661a44ab-d00d-4474-befe-8af93877023c service nova] [instance: 5b5a4d58-ba1e-473d-a32a-06fae1c84efc] Received event network-vif-plugged-b245a5c2-e523-4d4e-a343-f5b2352337ab {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:35:05 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-71c46037-5e3a-4d69-8b17-9d02a594dcf9 req-661a44ab-d00d-4474-befe-8af93877023c service nova] Acquiring lock "5b5a4d58-ba1e-473d-a32a-06fae1c84efc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:35:05 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-71c46037-5e3a-4d69-8b17-9d02a594dcf9 req-661a44ab-d00d-4474-befe-8af93877023c service nova] Lock "5b5a4d58-ba1e-473d-a32a-06fae1c84efc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:35:05 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-71c46037-5e3a-4d69-8b17-9d02a594dcf9 req-661a44ab-d00d-4474-befe-8af93877023c service nova] Lock "5b5a4d58-ba1e-473d-a32a-06fae1c84efc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:35:05 user nova-compute[75122]: DEBUG nova.compute.manager [req-71c46037-5e3a-4d69-8b17-9d02a594dcf9 req-661a44ab-d00d-4474-befe-8af93877023c service nova] [instance: 5b5a4d58-ba1e-473d-a32a-06fae1c84efc] No waiting events found dispatching network-vif-plugged-b245a5c2-e523-4d4e-a343-f5b2352337ab {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:35:05 user nova-compute[75122]: WARNING nova.compute.manager [req-71c46037-5e3a-4d69-8b17-9d02a594dcf9 req-661a44ab-d00d-4474-befe-8af93877023c service nova] [instance: 5b5a4d58-ba1e-473d-a32a-06fae1c84efc] Received unexpected event network-vif-plugged-b245a5c2-e523-4d4e-a343-f5b2352337ab for instance with vm_state building and task_state spawning.
Nov 15 09:35:05 user nova-compute[75122]: DEBUG nova.compute.manager [req-71c46037-5e3a-4d69-8b17-9d02a594dcf9 req-661a44ab-d00d-4474-befe-8af93877023c service nova] [instance: 5b5a4d58-ba1e-473d-a32a-06fae1c84efc] Received event network-vif-plugged-b245a5c2-e523-4d4e-a343-f5b2352337ab {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:35:05 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-71c46037-5e3a-4d69-8b17-9d02a594dcf9 req-661a44ab-d00d-4474-befe-8af93877023c service nova] Acquiring lock "5b5a4d58-ba1e-473d-a32a-06fae1c84efc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:35:05 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-71c46037-5e3a-4d69-8b17-9d02a594dcf9 req-661a44ab-d00d-4474-befe-8af93877023c service nova] Lock "5b5a4d58-ba1e-473d-a32a-06fae1c84efc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:35:05 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-71c46037-5e3a-4d69-8b17-9d02a594dcf9 req-661a44ab-d00d-4474-befe-8af93877023c service nova] Lock "5b5a4d58-ba1e-473d-a32a-06fae1c84efc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.010s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:35:05 user nova-compute[75122]: DEBUG nova.compute.manager [req-71c46037-5e3a-4d69-8b17-9d02a594dcf9 req-661a44ab-d00d-4474-befe-8af93877023c service nova] [instance: 5b5a4d58-ba1e-473d-a32a-06fae1c84efc] No waiting events found dispatching network-vif-plugged-b245a5c2-e523-4d4e-a343-f5b2352337ab {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:35:05 user nova-compute[75122]: WARNING nova.compute.manager [req-71c46037-5e3a-4d69-8b17-9d02a594dcf9 req-661a44ab-d00d-4474-befe-8af93877023c service nova] [instance: 5b5a4d58-ba1e-473d-a32a-06fae1c84efc] Received unexpected event network-vif-plugged-b245a5c2-e523-4d4e-a343-f5b2352337ab for instance with vm_state building and task_state spawning.
Nov 15 09:35:06 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:35:06 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:35:06 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:35:06 user nova-compute[75122]: DEBUG nova.compute.manager [None req-32d804b1-3196-4915-b336-6e8ff3a983fa tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] [instance: 5b5a4d58-ba1e-473d-a32a-06fae1c84efc] Instance event wait completed in 0 seconds for  {{(pid=75122) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 09:35:06 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-32d804b1-3196-4915-b336-6e8ff3a983fa tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] [instance: 5b5a4d58-ba1e-473d-a32a-06fae1c84efc] Guest created on hypervisor {{(pid=75122) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 09:35:06 user nova-compute[75122]: INFO nova.virt.libvirt.driver [-] [instance: 5b5a4d58-ba1e-473d-a32a-06fae1c84efc] Instance spawned successfully.
Nov 15 09:35:06 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-32d804b1-3196-4915-b336-6e8ff3a983fa tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] [instance: 5b5a4d58-ba1e-473d-a32a-06fae1c84efc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 09:35:06 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-32d804b1-3196-4915-b336-6e8ff3a983fa tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] [instance: 5b5a4d58-ba1e-473d-a32a-06fae1c84efc] Found default for hw_cdrom_bus of ide {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:35:06 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-32d804b1-3196-4915-b336-6e8ff3a983fa tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] [instance: 5b5a4d58-ba1e-473d-a32a-06fae1c84efc] Found default for hw_disk_bus of virtio {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:35:06 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-32d804b1-3196-4915-b336-6e8ff3a983fa tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] [instance: 5b5a4d58-ba1e-473d-a32a-06fae1c84efc] Found default for hw_input_bus of None {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:35:06 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-32d804b1-3196-4915-b336-6e8ff3a983fa tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] [instance: 5b5a4d58-ba1e-473d-a32a-06fae1c84efc] Found default for hw_pointer_model of None {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:35:06 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-32d804b1-3196-4915-b336-6e8ff3a983fa tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] [instance: 5b5a4d58-ba1e-473d-a32a-06fae1c84efc] Found default for hw_video_model of virtio {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:35:06 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-32d804b1-3196-4915-b336-6e8ff3a983fa tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] [instance: 5b5a4d58-ba1e-473d-a32a-06fae1c84efc] Found default for hw_vif_model of virtio {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:35:06 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:35:06 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:35:06 user nova-compute[75122]: INFO nova.compute.manager [None req-32d804b1-3196-4915-b336-6e8ff3a983fa tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] [instance: 5b5a4d58-ba1e-473d-a32a-06fae1c84efc] Took 7.48 seconds to spawn the instance on the hypervisor.
Nov 15 09:35:06 user nova-compute[75122]: DEBUG nova.compute.manager [None req-32d804b1-3196-4915-b336-6e8ff3a983fa tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] [instance: 5b5a4d58-ba1e-473d-a32a-06fae1c84efc] Checking state {{(pid=75122) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 09:35:07 user nova-compute[75122]: INFO nova.compute.manager [None req-32d804b1-3196-4915-b336-6e8ff3a983fa tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] [instance: 5b5a4d58-ba1e-473d-a32a-06fae1c84efc] Took 8.34 seconds to build instance.
Nov 15 09:35:07 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-32d804b1-3196-4915-b336-6e8ff3a983fa tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] Lock "5b5a4d58-ba1e-473d-a32a-06fae1c84efc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.492s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:35:07 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0eda62c4-6dce-4dff-8a45-c04392d7a2b2 tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] Acquiring lock "1e19f9e1-69c6-4590-85d2-e90cbdbb3d80" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:35:07 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0eda62c4-6dce-4dff-8a45-c04392d7a2b2 tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] Lock "1e19f9e1-69c6-4590-85d2-e90cbdbb3d80" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:35:07 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0eda62c4-6dce-4dff-8a45-c04392d7a2b2 tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] [instance: 1e19f9e1-69c6-4590-85d2-e90cbdbb3d80] Starting instance... {{(pid=75122) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 09:35:07 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0eda62c4-6dce-4dff-8a45-c04392d7a2b2 tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:35:07 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0eda62c4-6dce-4dff-8a45-c04392d7a2b2 tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:35:07 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-0eda62c4-6dce-4dff-8a45-c04392d7a2b2 tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75122) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 09:35:07 user nova-compute[75122]: INFO nova.compute.claims [None req-0eda62c4-6dce-4dff-8a45-c04392d7a2b2 tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] [instance: 1e19f9e1-69c6-4590-85d2-e90cbdbb3d80] Claim successful on node user
Nov 15 09:35:07 user nova-compute[75122]: DEBUG nova.compute.manager [req-089e383c-1fb8-4d65-83c9-fa9953dcf1f2 req-5b94241b-3610-41c2-9df8-98935009a619 service nova] [instance: f7d1a157-3228-490e-a6a0-68f6bd2b52ba] Received event network-vif-plugged-caf104ef-b652-4038-8203-76f14e4b666b {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:35:07 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-089e383c-1fb8-4d65-83c9-fa9953dcf1f2 req-5b94241b-3610-41c2-9df8-98935009a619 service nova] Acquiring lock "f7d1a157-3228-490e-a6a0-68f6bd2b52ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:35:07 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-089e383c-1fb8-4d65-83c9-fa9953dcf1f2 req-5b94241b-3610-41c2-9df8-98935009a619 service nova] Lock "f7d1a157-3228-490e-a6a0-68f6bd2b52ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:35:07 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-089e383c-1fb8-4d65-83c9-fa9953dcf1f2 req-5b94241b-3610-41c2-9df8-98935009a619 service nova] Lock "f7d1a157-3228-490e-a6a0-68f6bd2b52ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:35:07 user nova-compute[75122]: DEBUG nova.compute.manager [req-089e383c-1fb8-4d65-83c9-fa9953dcf1f2 req-5b94241b-3610-41c2-9df8-98935009a619 service nova] [instance: f7d1a157-3228-490e-a6a0-68f6bd2b52ba] No waiting events found dispatching network-vif-plugged-caf104ef-b652-4038-8203-76f14e4b666b {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:35:07 user nova-compute[75122]: WARNING nova.compute.manager [req-089e383c-1fb8-4d65-83c9-fa9953dcf1f2 req-5b94241b-3610-41c2-9df8-98935009a619 service nova] [instance: f7d1a157-3228-490e-a6a0-68f6bd2b52ba] Received unexpected event network-vif-plugged-caf104ef-b652-4038-8203-76f14e4b666b for instance with vm_state shelved_offloaded and task_state spawning.
Nov 15 09:35:07 user nova-compute[75122]: DEBUG nova.compute.manager [req-089e383c-1fb8-4d65-83c9-fa9953dcf1f2 req-5b94241b-3610-41c2-9df8-98935009a619 service nova] [instance: f7d1a157-3228-490e-a6a0-68f6bd2b52ba] Received event network-vif-plugged-caf104ef-b652-4038-8203-76f14e4b666b {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:35:07 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-089e383c-1fb8-4d65-83c9-fa9953dcf1f2 req-5b94241b-3610-41c2-9df8-98935009a619 service nova] Acquiring lock "f7d1a157-3228-490e-a6a0-68f6bd2b52ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:35:07 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-089e383c-1fb8-4d65-83c9-fa9953dcf1f2 req-5b94241b-3610-41c2-9df8-98935009a619 service nova] Lock "f7d1a157-3228-490e-a6a0-68f6bd2b52ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:35:07 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-089e383c-1fb8-4d65-83c9-fa9953dcf1f2 req-5b94241b-3610-41c2-9df8-98935009a619 service nova] Lock "f7d1a157-3228-490e-a6a0-68f6bd2b52ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:35:07 user nova-compute[75122]: DEBUG nova.compute.manager [req-089e383c-1fb8-4d65-83c9-fa9953dcf1f2 req-5b94241b-3610-41c2-9df8-98935009a619 service nova] [instance: f7d1a157-3228-490e-a6a0-68f6bd2b52ba] No waiting events found dispatching network-vif-plugged-caf104ef-b652-4038-8203-76f14e4b666b {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:35:07 user nova-compute[75122]: WARNING nova.compute.manager [req-089e383c-1fb8-4d65-83c9-fa9953dcf1f2 req-5b94241b-3610-41c2-9df8-98935009a619 service nova] [instance: f7d1a157-3228-490e-a6a0-68f6bd2b52ba] Received unexpected event network-vif-plugged-caf104ef-b652-4038-8203-76f14e4b666b for instance with vm_state shelved_offloaded and task_state spawning.
Nov 15 09:35:08 user nova-compute[75122]: DEBUG nova.compute.provider_tree [None req-0eda62c4-6dce-4dff-8a45-c04392d7a2b2 tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] Inventory has not changed in ProviderTree for provider: 69a3da65-47be-44c6-b67c-c692b58284ef {{(pid=75122) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 09:35:08 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-0eda62c4-6dce-4dff-8a45-c04392d7a2b2 tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] Inventory has not changed for provider 69a3da65-47be-44c6-b67c-c692b58284ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 09:35:08 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0eda62c4-6dce-4dff-8a45-c04392d7a2b2 tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.492s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:35:08 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0eda62c4-6dce-4dff-8a45-c04392d7a2b2 tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] [instance: 1e19f9e1-69c6-4590-85d2-e90cbdbb3d80] Start building networks asynchronously for instance. {{(pid=75122) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 09:35:08 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0eda62c4-6dce-4dff-8a45-c04392d7a2b2 tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] [instance: 1e19f9e1-69c6-4590-85d2-e90cbdbb3d80] Allocating IP information in the background. {{(pid=75122) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 09:35:08 user nova-compute[75122]: DEBUG nova.network.neutron [None req-0eda62c4-6dce-4dff-8a45-c04392d7a2b2 tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] [instance: 1e19f9e1-69c6-4590-85d2-e90cbdbb3d80] allocate_for_instance() {{(pid=75122) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 09:35:08 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-0eda62c4-6dce-4dff-8a45-c04392d7a2b2 tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] [instance: 1e19f9e1-69c6-4590-85d2-e90cbdbb3d80] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 09:35:08 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0eda62c4-6dce-4dff-8a45-c04392d7a2b2 tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] [instance: 1e19f9e1-69c6-4590-85d2-e90cbdbb3d80] Start building block device mappings for instance. {{(pid=75122) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 09:35:08 user nova-compute[75122]: DEBUG nova.policy [None req-0eda62c4-6dce-4dff-8a45-c04392d7a2b2 tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bf43ec7daef3486cbcd5e5d2831e4615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f97007ed06a04d7ebbc6cd3543a23d96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75122) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 09:35:08 user nova-compute[75122]: DEBUG nova.compute.manager [None req-de2520fb-4d8d-4fbc-8dc6-6b4215a67c12 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] [instance: f7d1a157-3228-490e-a6a0-68f6bd2b52ba] Instance event wait completed in 0 seconds for  {{(pid=75122) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 09:35:08 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-de2520fb-4d8d-4fbc-8dc6-6b4215a67c12 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] [instance: f7d1a157-3228-490e-a6a0-68f6bd2b52ba] Guest created on hypervisor {{(pid=75122) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 09:35:08 user nova-compute[75122]: INFO nova.virt.libvirt.driver [-] [instance: f7d1a157-3228-490e-a6a0-68f6bd2b52ba] Instance spawned successfully.
Nov 15 09:35:08 user nova-compute[75122]: DEBUG nova.compute.manager [None req-de2520fb-4d8d-4fbc-8dc6-6b4215a67c12 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] [instance: f7d1a157-3228-490e-a6a0-68f6bd2b52ba] Checking state {{(pid=75122) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 09:35:08 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0eda62c4-6dce-4dff-8a45-c04392d7a2b2 tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] [instance: 1e19f9e1-69c6-4590-85d2-e90cbdbb3d80] Start spawning the instance on the hypervisor. {{(pid=75122) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 09:35:08 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-0eda62c4-6dce-4dff-8a45-c04392d7a2b2 tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] [instance: 1e19f9e1-69c6-4590-85d2-e90cbdbb3d80] Creating instance directory {{(pid=75122) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 09:35:08 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-0eda62c4-6dce-4dff-8a45-c04392d7a2b2 tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] [instance: 1e19f9e1-69c6-4590-85d2-e90cbdbb3d80] Creating image(s)
Nov 15 09:35:08 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0eda62c4-6dce-4dff-8a45-c04392d7a2b2 tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] Acquiring lock "/opt/stack/data/nova/instances/1e19f9e1-69c6-4590-85d2-e90cbdbb3d80/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:35:08 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0eda62c4-6dce-4dff-8a45-c04392d7a2b2 tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] Lock "/opt/stack/data/nova/instances/1e19f9e1-69c6-4590-85d2-e90cbdbb3d80/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:35:08 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0eda62c4-6dce-4dff-8a45-c04392d7a2b2 tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] Lock "/opt/stack/data/nova/instances/1e19f9e1-69c6-4590-85d2-e90cbdbb3d80/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:35:08 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0eda62c4-6dce-4dff-8a45-c04392d7a2b2 tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:35:08 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-de2520fb-4d8d-4fbc-8dc6-6b4215a67c12 tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] Lock "f7d1a157-3228-490e-a6a0-68f6bd2b52ba" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 16.075s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:35:08 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0eda62c4-6dce-4dff-8a45-c04392d7a2b2 tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json" returned: 0 in 0.205s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:35:08 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0eda62c4-6dce-4dff-8a45-c04392d7a2b2 tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] Acquiring lock "95d6e29f74d5408f818e32f3bc29bc8270a4c665" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:35:08 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0eda62c4-6dce-4dff-8a45-c04392d7a2b2 tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] Lock "95d6e29f74d5408f818e32f3bc29bc8270a4c665" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:35:08 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0eda62c4-6dce-4dff-8a45-c04392d7a2b2 tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:35:08 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0eda62c4-6dce-4dff-8a45-c04392d7a2b2 tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json" returned: 0 in 0.184s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:35:08 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0eda62c4-6dce-4dff-8a45-c04392d7a2b2 tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665,backing_fmt=raw /opt/stack/data/nova/instances/1e19f9e1-69c6-4590-85d2-e90cbdbb3d80/disk 1073741824 {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:35:08 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0eda62c4-6dce-4dff-8a45-c04392d7a2b2 tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665,backing_fmt=raw /opt/stack/data/nova/instances/1e19f9e1-69c6-4590-85d2-e90cbdbb3d80/disk 1073741824" returned: 0 in 0.050s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:35:08 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0eda62c4-6dce-4dff-8a45-c04392d7a2b2 tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] Lock "95d6e29f74d5408f818e32f3bc29bc8270a4c665" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.243s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:35:08 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0eda62c4-6dce-4dff-8a45-c04392d7a2b2 tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:35:09 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0eda62c4-6dce-4dff-8a45-c04392d7a2b2 tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json" returned: 0 in 0.197s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:35:09 user nova-compute[75122]: DEBUG nova.virt.disk.api [None req-0eda62c4-6dce-4dff-8a45-c04392d7a2b2 tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1e19f9e1-69c6-4590-85d2-e90cbdbb3d80/disk. size=1073741824 {{(pid=75122) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 09:35:09 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0eda62c4-6dce-4dff-8a45-c04392d7a2b2 tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e19f9e1-69c6-4590-85d2-e90cbdbb3d80/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:35:09 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:35:09 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0eda62c4-6dce-4dff-8a45-c04392d7a2b2 tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e19f9e1-69c6-4590-85d2-e90cbdbb3d80/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:35:09 user nova-compute[75122]: DEBUG nova.virt.disk.api [None req-0eda62c4-6dce-4dff-8a45-c04392d7a2b2 tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] Cannot resize image /opt/stack/data/nova/instances/1e19f9e1-69c6-4590-85d2-e90cbdbb3d80/disk to a smaller size. {{(pid=75122) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 09:35:09 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-0eda62c4-6dce-4dff-8a45-c04392d7a2b2 tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] [instance: 1e19f9e1-69c6-4590-85d2-e90cbdbb3d80] Created local disks {{(pid=75122) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 09:35:09 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-0eda62c4-6dce-4dff-8a45-c04392d7a2b2 tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] [instance: 1e19f9e1-69c6-4590-85d2-e90cbdbb3d80] Ensure instance console log exists: /opt/stack/data/nova/instances/1e19f9e1-69c6-4590-85d2-e90cbdbb3d80/console.log {{(pid=75122) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 09:35:09 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0eda62c4-6dce-4dff-8a45-c04392d7a2b2 tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:35:09 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0eda62c4-6dce-4dff-8a45-c04392d7a2b2 tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:35:09 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0eda62c4-6dce-4dff-8a45-c04392d7a2b2 tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:35:09 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:35:09 user nova-compute[75122]: DEBUG nova.network.neutron [None req-0eda62c4-6dce-4dff-8a45-c04392d7a2b2 tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] [instance: 1e19f9e1-69c6-4590-85d2-e90cbdbb3d80] Successfully created port: a9170e2e-32f0-422c-becf-e1b2792b9b75 {{(pid=75122) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 09:35:10 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:35:10 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:35:10 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:35:10 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75122) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 09:35:10 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:35:10 user nova-compute[75122]: DEBUG nova.network.neutron [None req-0eda62c4-6dce-4dff-8a45-c04392d7a2b2 tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] [instance: 1e19f9e1-69c6-4590-85d2-e90cbdbb3d80] Successfully updated port: a9170e2e-32f0-422c-becf-e1b2792b9b75 {{(pid=75122) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 09:35:10 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0eda62c4-6dce-4dff-8a45-c04392d7a2b2 tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] Acquiring lock "refresh_cache-1e19f9e1-69c6-4590-85d2-e90cbdbb3d80" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 09:35:10 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0eda62c4-6dce-4dff-8a45-c04392d7a2b2 tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] Acquired lock "refresh_cache-1e19f9e1-69c6-4590-85d2-e90cbdbb3d80" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 09:35:10 user nova-compute[75122]: DEBUG nova.network.neutron [None req-0eda62c4-6dce-4dff-8a45-c04392d7a2b2 tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] [instance: 1e19f9e1-69c6-4590-85d2-e90cbdbb3d80] Building network info cache for instance {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 09:35:10 user nova-compute[75122]: DEBUG nova.compute.manager [req-65454576-c3bc-4cac-9992-15260acf0564 req-dcd69727-9632-44fb-9611-ee918f35ea34 service nova] [instance: 1e19f9e1-69c6-4590-85d2-e90cbdbb3d80] Received event network-changed-a9170e2e-32f0-422c-becf-e1b2792b9b75 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:35:10 user nova-compute[75122]: DEBUG nova.compute.manager [req-65454576-c3bc-4cac-9992-15260acf0564 req-dcd69727-9632-44fb-9611-ee918f35ea34 service nova] [instance: 1e19f9e1-69c6-4590-85d2-e90cbdbb3d80] Refreshing instance network info cache due to event network-changed-a9170e2e-32f0-422c-becf-e1b2792b9b75. {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 09:35:10 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-65454576-c3bc-4cac-9992-15260acf0564 req-dcd69727-9632-44fb-9611-ee918f35ea34 service nova] Acquiring lock "refresh_cache-1e19f9e1-69c6-4590-85d2-e90cbdbb3d80" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 09:35:10 user nova-compute[75122]: DEBUG nova.network.neutron [None req-0eda62c4-6dce-4dff-8a45-c04392d7a2b2 tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] [instance: 1e19f9e1-69c6-4590-85d2-e90cbdbb3d80] Instance cache missing network info. {{(pid=75122) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 09:35:11 user nova-compute[75122]: DEBUG nova.network.neutron [None req-0eda62c4-6dce-4dff-8a45-c04392d7a2b2 tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] [instance: 1e19f9e1-69c6-4590-85d2-e90cbdbb3d80] Updating instance_info_cache with network_info: [{"id": "a9170e2e-32f0-422c-becf-e1b2792b9b75", "address": "fa:16:3e:4c:61:a8", "network": {"id": "cd65f44e-6f5f-40c7-87f0-de082fb2bda9", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-635927865-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f97007ed06a04d7ebbc6cd3543a23d96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9170e2e-32", "ovs_interfaceid": "a9170e2e-32f0-422c-becf-e1b2792b9b75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:35:11 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0eda62c4-6dce-4dff-8a45-c04392d7a2b2 tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] Releasing lock "refresh_cache-1e19f9e1-69c6-4590-85d2-e90cbdbb3d80" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 09:35:11 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0eda62c4-6dce-4dff-8a45-c04392d7a2b2 tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] [instance: 1e19f9e1-69c6-4590-85d2-e90cbdbb3d80] Instance network_info: |[{"id": "a9170e2e-32f0-422c-becf-e1b2792b9b75", "address": "fa:16:3e:4c:61:a8", "network": {"id": "cd65f44e-6f5f-40c7-87f0-de082fb2bda9", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-635927865-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f97007ed06a04d7ebbc6cd3543a23d96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9170e2e-32", "ovs_interfaceid": "a9170e2e-32f0-422c-becf-e1b2792b9b75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75122) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 09:35:11 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-65454576-c3bc-4cac-9992-15260acf0564 req-dcd69727-9632-44fb-9611-ee918f35ea34 service nova] Acquired lock "refresh_cache-1e19f9e1-69c6-4590-85d2-e90cbdbb3d80" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 09:35:11 user nova-compute[75122]: DEBUG nova.network.neutron [req-65454576-c3bc-4cac-9992-15260acf0564 req-dcd69727-9632-44fb-9611-ee918f35ea34 service nova] [instance: 1e19f9e1-69c6-4590-85d2-e90cbdbb3d80] Refreshing network info cache for port a9170e2e-32f0-422c-becf-e1b2792b9b75 {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 09:35:11 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-0eda62c4-6dce-4dff-8a45-c04392d7a2b2 tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] [instance: 1e19f9e1-69c6-4590-85d2-e90cbdbb3d80] Start _get_guest_xml network_info=[{"id": "a9170e2e-32f0-422c-becf-e1b2792b9b75", "address": "fa:16:3e:4c:61:a8", "network": {"id": "cd65f44e-6f5f-40c7-87f0-de082fb2bda9", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-635927865-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f97007ed06a04d7ebbc6cd3543a23d96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9170e2e-32", "ovs_interfaceid": "a9170e2e-32f0-422c-becf-e1b2792b9b75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T09:26:31Z,direct_url=<?>,disk_format='qcow2',id=5e862cfe-47b8-4725-8292-65761ee6d0f5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9c57733cb41847c0b4ad31519c382e5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T09:26:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '5e862cfe-47b8-4725-8292-65761ee6d0f5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75122) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 09:35:11 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-0eda62c4-6dce-4dff-8a45-c04392d7a2b2 tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 09:35:11 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-0eda62c4-6dce-4dff-8a45-c04392d7a2b2 tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 09:35:11 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-0eda62c4-6dce-4dff-8a45-c04392d7a2b2 tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75122) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 09:35:11 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-0eda62c4-6dce-4dff-8a45-c04392d7a2b2 tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] CPU controller missing on host. {{(pid=75122) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 09:35:11 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-0eda62c4-6dce-4dff-8a45-c04392d7a2b2 tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75122) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 09:35:11 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-0eda62c4-6dce-4dff-8a45-c04392d7a2b2 tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] CPU controller found on host. {{(pid=75122) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 09:35:11 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-0eda62c4-6dce-4dff-8a45-c04392d7a2b2 tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75122) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 09:35:11 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-0eda62c4-6dce-4dff-8a45-c04392d7a2b2 tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T09:26:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T09:26:31Z,direct_url=<?>,disk_format='qcow2',id=5e862cfe-47b8-4725-8292-65761ee6d0f5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9c57733cb41847c0b4ad31519c382e5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T09:26:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 09:35:11 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-0eda62c4-6dce-4dff-8a45-c04392d7a2b2 tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] Flavor limits 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 09:35:11 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-0eda62c4-6dce-4dff-8a45-c04392d7a2b2 tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] Image limits 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 09:35:11 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-0eda62c4-6dce-4dff-8a45-c04392d7a2b2 tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] Flavor pref 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 09:35:11 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-0eda62c4-6dce-4dff-8a45-c04392d7a2b2 tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] Image pref 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 09:35:11 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-0eda62c4-6dce-4dff-8a45-c04392d7a2b2 tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 09:35:11 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-0eda62c4-6dce-4dff-8a45-c04392d7a2b2 tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 09:35:11 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-0eda62c4-6dce-4dff-8a45-c04392d7a2b2 tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75122) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 09:35:11 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-0eda62c4-6dce-4dff-8a45-c04392d7a2b2 tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] Got 1 possible topologies {{(pid=75122) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 09:35:11 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-0eda62c4-6dce-4dff-8a45-c04392d7a2b2 tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 09:35:11 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-0eda62c4-6dce-4dff-8a45-c04392d7a2b2 tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 09:35:11 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-0eda62c4-6dce-4dff-8a45-c04392d7a2b2 tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T09:35:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-412056593',display_name='tempest-VolumesAdminNegativeTest-server-412056593',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-412056593',id=15,image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKXjs5SOTPmIKBg6xFMXSmve6Sj7bQfvi4DYYYoZDNJ3nDlAQAAbzlKIYDRthtIg9zVZfMzY3rnkwZSA5aSTQbGZOfl4WkEYweWbf7Lrl7GcUYmAJWbXBhi7A/WSBCcerg==',key_name='tempest-keypair-1745833748',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f97007ed06a04d7ebbc6cd3543a23d96',ramdisk_id='',reservation_id='r-t050bzxw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1303240267',owner_user_name='tempest-VolumesAdminNegativeTest-1303240267-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T09:35:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bf43ec7daef3486cbcd5e5d2831e4615',uuid=1e19f9e1-69c6-4590-85d2-e90cbdbb3d80,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a9170e2e-32f0-422c-becf-e1b2792b9b75", "address": "fa:16:3e:4c:61:a8", "network": {"id": "cd65f44e-6f5f-40c7-87f0-de082fb2bda9", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-635927865-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f97007ed06a04d7ebbc6cd3543a23d96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9170e2e-32", "ovs_interfaceid": "a9170e2e-32f0-422c-becf-e1b2792b9b75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75122) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 09:35:11 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-0eda62c4-6dce-4dff-8a45-c04392d7a2b2 tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] Converting VIF {"id": "a9170e2e-32f0-422c-becf-e1b2792b9b75", "address": "fa:16:3e:4c:61:a8", "network": {"id": "cd65f44e-6f5f-40c7-87f0-de082fb2bda9", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-635927865-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f97007ed06a04d7ebbc6cd3543a23d96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9170e2e-32", "ovs_interfaceid": "a9170e2e-32f0-422c-becf-e1b2792b9b75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 09:35:11 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-0eda62c4-6dce-4dff-8a45-c04392d7a2b2 tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:61:a8,bridge_name='br-int',has_traffic_filtering=True,id=a9170e2e-32f0-422c-becf-e1b2792b9b75,network=Network(cd65f44e-6f5f-40c7-87f0-de082fb2bda9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9170e2e-32') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 09:35:11 user nova-compute[75122]: DEBUG nova.objects.instance [None req-0eda62c4-6dce-4dff-8a45-c04392d7a2b2 tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] Lazy-loading 'pci_devices' on Instance uuid 1e19f9e1-69c6-4590-85d2-e90cbdbb3d80 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:35:11 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-0eda62c4-6dce-4dff-8a45-c04392d7a2b2 tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] [instance: 1e19f9e1-69c6-4590-85d2-e90cbdbb3d80] End _get_guest_xml xml=<domain type="kvm">
Nov 15 09:35:11 user nova-compute[75122]:   <uuid>1e19f9e1-69c6-4590-85d2-e90cbdbb3d80</uuid>
Nov 15 09:35:11 user nova-compute[75122]:   <name>instance-0000000f</name>
Nov 15 09:35:11 user nova-compute[75122]:   <memory>524288</memory>
Nov 15 09:35:11 user nova-compute[75122]:   <vcpu>1</vcpu>
Nov 15 09:35:11 user nova-compute[75122]:   <metadata>
Nov 15 09:35:11 user nova-compute[75122]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 09:35:11 user nova-compute[75122]:       <nova:package version="0.0.0"/>
Nov 15 09:35:11 user nova-compute[75122]:       <nova:name>tempest-VolumesAdminNegativeTest-server-412056593</nova:name>
Nov 15 09:35:11 user nova-compute[75122]:       <nova:creationTime>2023-11-15 09:35:11</nova:creationTime>
Nov 15 09:35:11 user nova-compute[75122]:       <nova:flavor name="m1.tiny">
Nov 15 09:35:11 user nova-compute[75122]:         <nova:memory>512</nova:memory>
Nov 15 09:35:11 user nova-compute[75122]:         <nova:disk>1</nova:disk>
Nov 15 09:35:11 user nova-compute[75122]:         <nova:swap>0</nova:swap>
Nov 15 09:35:11 user nova-compute[75122]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 09:35:11 user nova-compute[75122]:         <nova:vcpus>1</nova:vcpus>
Nov 15 09:35:11 user nova-compute[75122]:       </nova:flavor>
Nov 15 09:35:11 user nova-compute[75122]:       <nova:owner>
Nov 15 09:35:11 user nova-compute[75122]:         <nova:user uuid="bf43ec7daef3486cbcd5e5d2831e4615">tempest-VolumesAdminNegativeTest-1303240267-project-member</nova:user>
Nov 15 09:35:11 user nova-compute[75122]:         <nova:project uuid="f97007ed06a04d7ebbc6cd3543a23d96">tempest-VolumesAdminNegativeTest-1303240267</nova:project>
Nov 15 09:35:11 user nova-compute[75122]:       </nova:owner>
Nov 15 09:35:11 user nova-compute[75122]:       <nova:root type="image" uuid="5e862cfe-47b8-4725-8292-65761ee6d0f5"/>
Nov 15 09:35:11 user nova-compute[75122]:       <nova:ports>
Nov 15 09:35:11 user nova-compute[75122]:         <nova:port uuid="a9170e2e-32f0-422c-becf-e1b2792b9b75">
Nov 15 09:35:11 user nova-compute[75122]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 15 09:35:11 user nova-compute[75122]:         </nova:port>
Nov 15 09:35:11 user nova-compute[75122]:       </nova:ports>
Nov 15 09:35:11 user nova-compute[75122]:     </nova:instance>
Nov 15 09:35:11 user nova-compute[75122]:   </metadata>
Nov 15 09:35:11 user nova-compute[75122]:   <sysinfo type="smbios">
Nov 15 09:35:11 user nova-compute[75122]:     <system>
Nov 15 09:35:11 user nova-compute[75122]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 09:35:11 user nova-compute[75122]:       <entry name="product">OpenStack Nova</entry>
Nov 15 09:35:11 user nova-compute[75122]:       <entry name="version">0.0.0</entry>
Nov 15 09:35:11 user nova-compute[75122]:       <entry name="serial">1e19f9e1-69c6-4590-85d2-e90cbdbb3d80</entry>
Nov 15 09:35:11 user nova-compute[75122]:       <entry name="uuid">1e19f9e1-69c6-4590-85d2-e90cbdbb3d80</entry>
Nov 15 09:35:11 user nova-compute[75122]:       <entry name="family">Virtual Machine</entry>
Nov 15 09:35:11 user nova-compute[75122]:     </system>
Nov 15 09:35:11 user nova-compute[75122]:   </sysinfo>
Nov 15 09:35:11 user nova-compute[75122]:   <os>
Nov 15 09:35:11 user nova-compute[75122]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 09:35:11 user nova-compute[75122]:     <boot dev="hd"/>
Nov 15 09:35:11 user nova-compute[75122]:     <smbios mode="sysinfo"/>
Nov 15 09:35:11 user nova-compute[75122]:   </os>
Nov 15 09:35:11 user nova-compute[75122]:   <features>
Nov 15 09:35:11 user nova-compute[75122]:     <acpi/>
Nov 15 09:35:11 user nova-compute[75122]:     <apic/>
Nov 15 09:35:11 user nova-compute[75122]:     <vmcoreinfo/>
Nov 15 09:35:11 user nova-compute[75122]:   </features>
Nov 15 09:35:11 user nova-compute[75122]:   <clock offset="utc">
Nov 15 09:35:11 user nova-compute[75122]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 09:35:11 user nova-compute[75122]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 09:35:11 user nova-compute[75122]:     <timer name="hpet" present="no"/>
Nov 15 09:35:11 user nova-compute[75122]:   </clock>
Nov 15 09:35:11 user nova-compute[75122]:   <cpu mode="custom" match="exact">
Nov 15 09:35:11 user nova-compute[75122]:     <model>Nehalem</model>
Nov 15 09:35:11 user nova-compute[75122]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 09:35:11 user nova-compute[75122]:   </cpu>
Nov 15 09:35:11 user nova-compute[75122]:   <devices>
Nov 15 09:35:11 user nova-compute[75122]:     <disk type="file" device="disk">
Nov 15 09:35:11 user nova-compute[75122]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 09:35:11 user nova-compute[75122]:       <source file="/opt/stack/data/nova/instances/1e19f9e1-69c6-4590-85d2-e90cbdbb3d80/disk"/>
Nov 15 09:35:11 user nova-compute[75122]:       <target dev="vda" bus="virtio"/>
Nov 15 09:35:11 user nova-compute[75122]:     </disk>
Nov 15 09:35:11 user nova-compute[75122]:     <interface type="ethernet">
Nov 15 09:35:11 user nova-compute[75122]:       <mac address="fa:16:3e:4c:61:a8"/>
Nov 15 09:35:11 user nova-compute[75122]:       <model type="virtio"/>
Nov 15 09:35:11 user nova-compute[75122]:       <mtu size="1442"/>
Nov 15 09:35:11 user nova-compute[75122]:       <target dev="tapa9170e2e-32"/>
Nov 15 09:35:11 user nova-compute[75122]:     </interface>
Nov 15 09:35:11 user nova-compute[75122]:     <serial type="pty">
Nov 15 09:35:11 user nova-compute[75122]:       <log file="/opt/stack/data/nova/instances/1e19f9e1-69c6-4590-85d2-e90cbdbb3d80/console.log" append="off"/>
Nov 15 09:35:11 user nova-compute[75122]:     </serial>
Nov 15 09:35:11 user nova-compute[75122]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 09:35:11 user nova-compute[75122]:     <video>
Nov 15 09:35:11 user nova-compute[75122]:       <model type="virtio"/>
Nov 15 09:35:11 user nova-compute[75122]:     </video>
Nov 15 09:35:11 user nova-compute[75122]:     <rng model="virtio">
Nov 15 09:35:11 user nova-compute[75122]:       <backend model="random">/dev/urandom</backend>
Nov 15 09:35:11 user nova-compute[75122]:     </rng>
Nov 15 09:35:11 user nova-compute[75122]:     <controller type="usb" index="0" model="none"/>
Nov 15 09:35:11 user nova-compute[75122]:     <memballoon model="virtio">
Nov 15 09:35:11 user nova-compute[75122]:       <stats period="10"/>
Nov 15 09:35:11 user nova-compute[75122]:     </memballoon>
Nov 15 09:35:11 user nova-compute[75122]:   </devices>
Nov 15 09:35:11 user nova-compute[75122]: </domain>
Nov 15 09:35:11 user nova-compute[75122]:  {{(pid=75122) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 09:35:11 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-0eda62c4-6dce-4dff-8a45-c04392d7a2b2 tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T09:35:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-412056593',display_name='tempest-VolumesAdminNegativeTest-server-412056593',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-412056593',id=15,image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKXjs5SOTPmIKBg6xFMXSmve6Sj7bQfvi4DYYYoZDNJ3nDlAQAAbzlKIYDRthtIg9zVZfMzY3rnkwZSA5aSTQbGZOfl4WkEYweWbf7Lrl7GcUYmAJWbXBhi7A/WSBCcerg==',key_name='tempest-keypair-1745833748',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f97007ed06a04d7ebbc6cd3543a23d96',ramdisk_id='',reservation_id='r-t050bzxw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1303240267',owner_user_name='tempest-VolumesAdminNegativeTest-1303240267-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T09:35:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bf43ec7daef3486cbcd5e5d2831e4615',uuid=1e19f9e1-69c6-4590-85d2-e90cbdbb3d80,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a9170e2e-32f0-422c-becf-e1b2792b9b75", "address": "fa:16:3e:4c:61:a8", "network": {"id": "cd65f44e-6f5f-40c7-87f0-de082fb2bda9", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-635927865-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f97007ed06a04d7ebbc6cd3543a23d96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9170e2e-32", "ovs_interfaceid": "a9170e2e-32f0-422c-becf-e1b2792b9b75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 09:35:11 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-0eda62c4-6dce-4dff-8a45-c04392d7a2b2 tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] Converting VIF {"id": "a9170e2e-32f0-422c-becf-e1b2792b9b75", "address": "fa:16:3e:4c:61:a8", "network": {"id": "cd65f44e-6f5f-40c7-87f0-de082fb2bda9", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-635927865-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f97007ed06a04d7ebbc6cd3543a23d96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9170e2e-32", "ovs_interfaceid": "a9170e2e-32f0-422c-becf-e1b2792b9b75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 09:35:11 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-0eda62c4-6dce-4dff-8a45-c04392d7a2b2 tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:61:a8,bridge_name='br-int',has_traffic_filtering=True,id=a9170e2e-32f0-422c-becf-e1b2792b9b75,network=Network(cd65f44e-6f5f-40c7-87f0-de082fb2bda9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9170e2e-32') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 09:35:11 user nova-compute[75122]: DEBUG os_vif [None req-0eda62c4-6dce-4dff-8a45-c04392d7a2b2 tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:61:a8,bridge_name='br-int',has_traffic_filtering=True,id=a9170e2e-32f0-422c-becf-e1b2792b9b75,network=Network(cd65f44e-6f5f-40c7-87f0-de082fb2bda9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9170e2e-32') {{(pid=75122) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 09:35:11 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:35:11 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:35:11 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 09:35:11 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:35:11 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ab11a61a-0f0d-5204-8935-8a3966cca7e7', '_type': 'linux-noop'}}, row=False) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:35:11 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:35:11 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:35:11 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:35:11 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa9170e2e-32, may_exist=True, interface_attrs={}) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:35:11 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa9170e2e-32, col_values=(('qos', UUID('4c6ca4c5-4adf-43ca-8f04-b733b26eddf7')),), if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:35:11 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa9170e2e-32, col_values=(('external_ids', {'iface-id': 'a9170e2e-32f0-422c-becf-e1b2792b9b75', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4c:61:a8', 'vm-uuid': '1e19f9e1-69c6-4590-85d2-e90cbdbb3d80'}),), if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:35:11 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:35:11 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:35:11 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:35:11 user nova-compute[75122]: INFO os_vif [None req-0eda62c4-6dce-4dff-8a45-c04392d7a2b2 tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:61:a8,bridge_name='br-int',has_traffic_filtering=True,id=a9170e2e-32f0-422c-becf-e1b2792b9b75,network=Network(cd65f44e-6f5f-40c7-87f0-de082fb2bda9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9170e2e-32')
Nov 15 09:35:11 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-0eda62c4-6dce-4dff-8a45-c04392d7a2b2 tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] No BDM found with device name vda, not building metadata. {{(pid=75122) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 09:35:11 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-0eda62c4-6dce-4dff-8a45-c04392d7a2b2 tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] No VIF found with MAC fa:16:3e:4c:61:a8, not building metadata {{(pid=75122) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 09:35:11 user nova-compute[75122]: DEBUG nova.network.neutron [req-65454576-c3bc-4cac-9992-15260acf0564 req-dcd69727-9632-44fb-9611-ee918f35ea34 service nova] [instance: 1e19f9e1-69c6-4590-85d2-e90cbdbb3d80] Updated VIF entry in instance network info cache for port a9170e2e-32f0-422c-becf-e1b2792b9b75. {{(pid=75122) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 09:35:11 user nova-compute[75122]: DEBUG nova.network.neutron [req-65454576-c3bc-4cac-9992-15260acf0564 req-dcd69727-9632-44fb-9611-ee918f35ea34 service nova] [instance: 1e19f9e1-69c6-4590-85d2-e90cbdbb3d80] Updating instance_info_cache with network_info: [{"id": "a9170e2e-32f0-422c-becf-e1b2792b9b75", "address": "fa:16:3e:4c:61:a8", "network": {"id": "cd65f44e-6f5f-40c7-87f0-de082fb2bda9", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-635927865-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f97007ed06a04d7ebbc6cd3543a23d96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9170e2e-32", "ovs_interfaceid": "a9170e2e-32f0-422c-becf-e1b2792b9b75", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:35:11 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-65454576-c3bc-4cac-9992-15260acf0564 req-dcd69727-9632-44fb-9611-ee918f35ea34 service nova] Releasing lock "refresh_cache-1e19f9e1-69c6-4590-85d2-e90cbdbb3d80" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 09:35:12 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:35:12 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:35:12 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:35:12 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:35:13 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:35:13 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:35:13 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:35:13 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:35:13 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:35:13 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:35:13 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75122) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 09:35:13 user nova-compute[75122]: DEBUG nova.compute.manager [req-f8acec47-7143-47eb-8b5c-aa0791f2257f req-b73b889d-62ff-4ce5-a15d-1e63eb2a4e99 service nova] [instance: 1e19f9e1-69c6-4590-85d2-e90cbdbb3d80] Received event network-vif-plugged-a9170e2e-32f0-422c-becf-e1b2792b9b75 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:35:13 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-f8acec47-7143-47eb-8b5c-aa0791f2257f req-b73b889d-62ff-4ce5-a15d-1e63eb2a4e99 service nova] Acquiring lock "1e19f9e1-69c6-4590-85d2-e90cbdbb3d80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:35:13 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-f8acec47-7143-47eb-8b5c-aa0791f2257f req-b73b889d-62ff-4ce5-a15d-1e63eb2a4e99 service nova] Lock "1e19f9e1-69c6-4590-85d2-e90cbdbb3d80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:35:13 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-f8acec47-7143-47eb-8b5c-aa0791f2257f req-b73b889d-62ff-4ce5-a15d-1e63eb2a4e99 service nova] Lock "1e19f9e1-69c6-4590-85d2-e90cbdbb3d80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:35:13 user nova-compute[75122]: DEBUG nova.compute.manager [req-f8acec47-7143-47eb-8b5c-aa0791f2257f req-b73b889d-62ff-4ce5-a15d-1e63eb2a4e99 service nova] [instance: 1e19f9e1-69c6-4590-85d2-e90cbdbb3d80] No waiting events found dispatching network-vif-plugged-a9170e2e-32f0-422c-becf-e1b2792b9b75 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:35:13 user nova-compute[75122]: WARNING nova.compute.manager [req-f8acec47-7143-47eb-8b5c-aa0791f2257f req-b73b889d-62ff-4ce5-a15d-1e63eb2a4e99 service nova] [instance: 1e19f9e1-69c6-4590-85d2-e90cbdbb3d80] Received unexpected event network-vif-plugged-a9170e2e-32f0-422c-becf-e1b2792b9b75 for instance with vm_state building and task_state spawning.
Nov 15 09:35:13 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee961d5a-e0d1-4931-9293-eefbe638097a/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:35:13 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:35:13 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:35:13 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:35:13 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee961d5a-e0d1-4931-9293-eefbe638097a/disk --force-share --output=json" returned: 0 in 0.302s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:35:13 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee961d5a-e0d1-4931-9293-eefbe638097a/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:35:14 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee961d5a-e0d1-4931-9293-eefbe638097a/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:35:14 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75122) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 09:35:14 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75122) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 09:35:14 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75122) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 09:35:14 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=75122) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 09:35:14 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] skipping disk /dev/sdi (vda) as it is a volume {{(pid=75122) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 09:35:14 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ce9b2be-aeb4-45e3-966c-e11667e6be8a/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:35:14 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-9d4e7731-cbaa-4623-8177-57f4294bfc8f tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Acquiring lock "fd9d52bb-6248-48e6-a798-6dbdaaa68cbc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:35:14 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-9d4e7731-cbaa-4623-8177-57f4294bfc8f tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Lock "fd9d52bb-6248-48e6-a798-6dbdaaa68cbc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:35:14 user nova-compute[75122]: DEBUG nova.compute.manager [None req-9d4e7731-cbaa-4623-8177-57f4294bfc8f tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] [instance: fd9d52bb-6248-48e6-a798-6dbdaaa68cbc] Starting instance... {{(pid=75122) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 09:35:14 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ce9b2be-aeb4-45e3-966c-e11667e6be8a/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:35:14 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ce9b2be-aeb4-45e3-966c-e11667e6be8a/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:35:14 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-9d4e7731-cbaa-4623-8177-57f4294bfc8f tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:35:14 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-9d4e7731-cbaa-4623-8177-57f4294bfc8f tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:35:14 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-9d4e7731-cbaa-4623-8177-57f4294bfc8f tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75122) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 09:35:14 user nova-compute[75122]: INFO nova.compute.claims [None req-9d4e7731-cbaa-4623-8177-57f4294bfc8f tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] [instance: fd9d52bb-6248-48e6-a798-6dbdaaa68cbc] Claim successful on node user
Nov 15 09:35:14 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ce9b2be-aeb4-45e3-966c-e11667e6be8a/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:35:14 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5a4d58-ba1e-473d-a32a-06fae1c84efc/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:35:14 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5a4d58-ba1e-473d-a32a-06fae1c84efc/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:35:14 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5a4d58-ba1e-473d-a32a-06fae1c84efc/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:35:15 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5a4d58-ba1e-473d-a32a-06fae1c84efc/disk --force-share --output=json" returned: 0 in 0.259s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:35:15 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e19f9e1-69c6-4590-85d2-e90cbdbb3d80/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:35:15 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:35:15 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-bd389e29-63f5-4101-8d91-086e3ad24cf6 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] Acquiring lock "3ce9b2be-aeb4-45e3-966c-e11667e6be8a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:35:15 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-bd389e29-63f5-4101-8d91-086e3ad24cf6 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] Lock "3ce9b2be-aeb4-45e3-966c-e11667e6be8a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:35:15 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-bd389e29-63f5-4101-8d91-086e3ad24cf6 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] Acquiring lock "3ce9b2be-aeb4-45e3-966c-e11667e6be8a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:35:15 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-bd389e29-63f5-4101-8d91-086e3ad24cf6 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] Lock "3ce9b2be-aeb4-45e3-966c-e11667e6be8a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:35:15 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-bd389e29-63f5-4101-8d91-086e3ad24cf6 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] Lock "3ce9b2be-aeb4-45e3-966c-e11667e6be8a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:35:15 user nova-compute[75122]: INFO nova.compute.manager [None req-bd389e29-63f5-4101-8d91-086e3ad24cf6 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] [instance: 3ce9b2be-aeb4-45e3-966c-e11667e6be8a] Terminating instance
Nov 15 09:35:15 user nova-compute[75122]: DEBUG nova.compute.manager [None req-bd389e29-63f5-4101-8d91-086e3ad24cf6 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] [instance: 3ce9b2be-aeb4-45e3-966c-e11667e6be8a] Start destroying the instance on the hypervisor. {{(pid=75122) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 09:35:15 user nova-compute[75122]: DEBUG nova.compute.manager [req-13b3c132-c83d-478c-862c-9c35f0127502 req-5a354c69-eb01-47e9-8a89-b0c961b32e0c service nova] [instance: 1e19f9e1-69c6-4590-85d2-e90cbdbb3d80] Received event network-vif-plugged-a9170e2e-32f0-422c-becf-e1b2792b9b75 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:35:15 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-13b3c132-c83d-478c-862c-9c35f0127502 req-5a354c69-eb01-47e9-8a89-b0c961b32e0c service nova] Acquiring lock "1e19f9e1-69c6-4590-85d2-e90cbdbb3d80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:35:15 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-13b3c132-c83d-478c-862c-9c35f0127502 req-5a354c69-eb01-47e9-8a89-b0c961b32e0c service nova] Lock "1e19f9e1-69c6-4590-85d2-e90cbdbb3d80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:35:15 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-13b3c132-c83d-478c-862c-9c35f0127502 req-5a354c69-eb01-47e9-8a89-b0c961b32e0c service nova] Lock "1e19f9e1-69c6-4590-85d2-e90cbdbb3d80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:35:15 user nova-compute[75122]: DEBUG nova.compute.manager [req-13b3c132-c83d-478c-862c-9c35f0127502 req-5a354c69-eb01-47e9-8a89-b0c961b32e0c service nova] [instance: 1e19f9e1-69c6-4590-85d2-e90cbdbb3d80] No waiting events found dispatching network-vif-plugged-a9170e2e-32f0-422c-becf-e1b2792b9b75 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:35:15 user nova-compute[75122]: WARNING nova.compute.manager [req-13b3c132-c83d-478c-862c-9c35f0127502 req-5a354c69-eb01-47e9-8a89-b0c961b32e0c service nova] [instance: 1e19f9e1-69c6-4590-85d2-e90cbdbb3d80] Received unexpected event network-vif-plugged-a9170e2e-32f0-422c-becf-e1b2792b9b75 for instance with vm_state building and task_state spawning.
Nov 15 09:35:15 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:35:15 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-dcebddcd-993d-47ac-8506-44af7c18a2ea tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Acquiring lock "00270cc2-4f5b-4f64-8f88-31f21e3b3950" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:35:15 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-dcebddcd-993d-47ac-8506-44af7c18a2ea tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Lock "00270cc2-4f5b-4f64-8f88-31f21e3b3950" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:35:15 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:35:15 user nova-compute[75122]: DEBUG nova.compute.provider_tree [None req-9d4e7731-cbaa-4623-8177-57f4294bfc8f tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Inventory has not changed in ProviderTree for provider: 69a3da65-47be-44c6-b67c-c692b58284ef {{(pid=75122) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 09:35:15 user nova-compute[75122]: DEBUG nova.compute.manager [None req-dcebddcd-993d-47ac-8506-44af7c18a2ea tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] [instance: 00270cc2-4f5b-4f64-8f88-31f21e3b3950] Starting instance... {{(pid=75122) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 09:35:15 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:35:15 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e19f9e1-69c6-4590-85d2-e90cbdbb3d80/disk --force-share --output=json" returned: 0 in 0.269s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:35:15 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e19f9e1-69c6-4590-85d2-e90cbdbb3d80/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:35:15 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:35:15 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-9d4e7731-cbaa-4623-8177-57f4294bfc8f tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Inventory has not changed for provider 69a3da65-47be-44c6-b67c-c692b58284ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 09:35:15 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-dcebddcd-993d-47ac-8506-44af7c18a2ea tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:35:15 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-9d4e7731-cbaa-4623-8177-57f4294bfc8f tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.157s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:35:15 user nova-compute[75122]: DEBUG nova.compute.manager [None req-9d4e7731-cbaa-4623-8177-57f4294bfc8f tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] [instance: fd9d52bb-6248-48e6-a798-6dbdaaa68cbc] Start building networks asynchronously for instance. {{(pid=75122) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 09:35:15 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-dcebddcd-993d-47ac-8506-44af7c18a2ea tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.012s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:35:15 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-dcebddcd-993d-47ac-8506-44af7c18a2ea tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75122) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 09:35:15 user nova-compute[75122]: INFO nova.compute.claims [None req-dcebddcd-993d-47ac-8506-44af7c18a2ea tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] [instance: 00270cc2-4f5b-4f64-8f88-31f21e3b3950] Claim successful on node user
Nov 15 09:35:15 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0eda62c4-6dce-4dff-8a45-c04392d7a2b2 tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] [instance: 1e19f9e1-69c6-4590-85d2-e90cbdbb3d80] Instance event wait completed in 0 seconds for  {{(pid=75122) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 09:35:15 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-0eda62c4-6dce-4dff-8a45-c04392d7a2b2 tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] [instance: 1e19f9e1-69c6-4590-85d2-e90cbdbb3d80] Guest created on hypervisor {{(pid=75122) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 09:35:15 user nova-compute[75122]: INFO nova.virt.libvirt.driver [-] [instance: 1e19f9e1-69c6-4590-85d2-e90cbdbb3d80] Instance spawned successfully.
Nov 15 09:35:15 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-0eda62c4-6dce-4dff-8a45-c04392d7a2b2 tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] [instance: 1e19f9e1-69c6-4590-85d2-e90cbdbb3d80] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 09:35:15 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-0eda62c4-6dce-4dff-8a45-c04392d7a2b2 tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] [instance: 1e19f9e1-69c6-4590-85d2-e90cbdbb3d80] Found default for hw_cdrom_bus of ide {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:35:15 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-0eda62c4-6dce-4dff-8a45-c04392d7a2b2 tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] [instance: 1e19f9e1-69c6-4590-85d2-e90cbdbb3d80] Found default for hw_disk_bus of virtio {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:35:15 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-0eda62c4-6dce-4dff-8a45-c04392d7a2b2 tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] [instance: 1e19f9e1-69c6-4590-85d2-e90cbdbb3d80] Found default for hw_input_bus of None {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:35:15 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-0eda62c4-6dce-4dff-8a45-c04392d7a2b2 tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] [instance: 1e19f9e1-69c6-4590-85d2-e90cbdbb3d80] Found default for hw_pointer_model of None {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:35:15 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-0eda62c4-6dce-4dff-8a45-c04392d7a2b2 tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] [instance: 1e19f9e1-69c6-4590-85d2-e90cbdbb3d80] Found default for hw_video_model of virtio {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:35:15 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-0eda62c4-6dce-4dff-8a45-c04392d7a2b2 tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] [instance: 1e19f9e1-69c6-4590-85d2-e90cbdbb3d80] Found default for hw_vif_model of virtio {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:35:15 user nova-compute[75122]: DEBUG nova.compute.manager [None req-9d4e7731-cbaa-4623-8177-57f4294bfc8f tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] [instance: fd9d52bb-6248-48e6-a798-6dbdaaa68cbc] Allocating IP information in the background. {{(pid=75122) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 09:35:15 user nova-compute[75122]: DEBUG nova.network.neutron [None req-9d4e7731-cbaa-4623-8177-57f4294bfc8f tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] [instance: fd9d52bb-6248-48e6-a798-6dbdaaa68cbc] allocate_for_instance() {{(pid=75122) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 09:35:15 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-9d4e7731-cbaa-4623-8177-57f4294bfc8f tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] [instance: fd9d52bb-6248-48e6-a798-6dbdaaa68cbc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 09:35:15 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e19f9e1-69c6-4590-85d2-e90cbdbb3d80/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:35:15 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/131142fd-e8ec-42d1-a518-aa21c7bb7cb1/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:35:15 user nova-compute[75122]: DEBUG nova.compute.manager [None req-9d4e7731-cbaa-4623-8177-57f4294bfc8f tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] [instance: fd9d52bb-6248-48e6-a798-6dbdaaa68cbc] Start building block device mappings for instance. {{(pid=75122) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 09:35:15 user nova-compute[75122]: INFO nova.compute.manager [None req-0eda62c4-6dce-4dff-8a45-c04392d7a2b2 tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] [instance: 1e19f9e1-69c6-4590-85d2-e90cbdbb3d80] Took 7.39 seconds to spawn the instance on the hypervisor.
Nov 15 09:35:15 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0eda62c4-6dce-4dff-8a45-c04392d7a2b2 tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] [instance: 1e19f9e1-69c6-4590-85d2-e90cbdbb3d80] Checking state {{(pid=75122) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 09:35:15 user nova-compute[75122]: DEBUG nova.policy [None req-9d4e7731-cbaa-4623-8177-57f4294bfc8f tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd05ef35b07ba45afb142f406d418d8d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeff24cb28f5481fa3941ba399ce82ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75122) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 09:35:16 user nova-compute[75122]: INFO nova.compute.manager [None req-0eda62c4-6dce-4dff-8a45-c04392d7a2b2 tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] [instance: 1e19f9e1-69c6-4590-85d2-e90cbdbb3d80] Took 8.31 seconds to build instance.
Nov 15 09:35:16 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/131142fd-e8ec-42d1-a518-aa21c7bb7cb1/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:35:16 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/131142fd-e8ec-42d1-a518-aa21c7bb7cb1/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:35:16 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0eda62c4-6dce-4dff-8a45-c04392d7a2b2 tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] Lock "1e19f9e1-69c6-4590-85d2-e90cbdbb3d80" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.459s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:35:16 user nova-compute[75122]: DEBUG nova.compute.manager [None req-9d4e7731-cbaa-4623-8177-57f4294bfc8f tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] [instance: fd9d52bb-6248-48e6-a798-6dbdaaa68cbc] Start spawning the instance on the hypervisor. {{(pid=75122) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 09:35:16 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-9d4e7731-cbaa-4623-8177-57f4294bfc8f tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] [instance: fd9d52bb-6248-48e6-a798-6dbdaaa68cbc] Creating instance directory {{(pid=75122) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 09:35:16 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-9d4e7731-cbaa-4623-8177-57f4294bfc8f tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] [instance: fd9d52bb-6248-48e6-a798-6dbdaaa68cbc] Creating image(s)
Nov 15 09:35:16 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-9d4e7731-cbaa-4623-8177-57f4294bfc8f tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Acquiring lock "/opt/stack/data/nova/instances/fd9d52bb-6248-48e6-a798-6dbdaaa68cbc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:35:16 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-9d4e7731-cbaa-4623-8177-57f4294bfc8f tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Lock "/opt/stack/data/nova/instances/fd9d52bb-6248-48e6-a798-6dbdaaa68cbc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:35:16 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-9d4e7731-cbaa-4623-8177-57f4294bfc8f tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Lock "/opt/stack/data/nova/instances/fd9d52bb-6248-48e6-a798-6dbdaaa68cbc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.067s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:35:16 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-9d4e7731-cbaa-4623-8177-57f4294bfc8f tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:35:16 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/131142fd-e8ec-42d1-a518-aa21c7bb7cb1/disk --force-share --output=json" returned: 0 in 0.280s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:35:16 user nova-compute[75122]: INFO nova.virt.libvirt.driver [-] [instance: 3ce9b2be-aeb4-45e3-966c-e11667e6be8a] Instance destroyed successfully.
Nov 15 09:35:16 user nova-compute[75122]: DEBUG nova.objects.instance [None req-bd389e29-63f5-4101-8d91-086e3ad24cf6 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] Lazy-loading 'resources' on Instance uuid 3ce9b2be-aeb4-45e3-966c-e11667e6be8a {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:35:16 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cfd4155-c4b3-4cce-91e5-042cafccab8b/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:35:16 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-bd389e29-63f5-4101-8d91-086e3ad24cf6 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T09:33:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1744416746',display_name='tempest-VolumesActionsTest-instance-1744416746',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1744416746',id=10,image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T09:33:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9af984d06e5340f8a65a54a806c7c88a',ramdisk_id='',reservation_id='r-a12xjog7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-915673420',owner_user_name='tempest-VolumesActionsTest-915673420-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T09:33:31Z,user_data=None,user_id='a3ce318b93394200a80ba72ec74c321e',uuid=3ce9b2be-aeb4-45e3-966c-e11667e6be8a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2eaf99e2-fc08-4374-91b6-192bde04bae6", "address": "fa:16:3e:6c:5e:8a", "network": {"id": "48c8af75-6a89-441b-8e4a-8c7186006537", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2172147-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9af984d06e5340f8a65a54a806c7c88a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eaf99e2-fc", "ovs_interfaceid": "2eaf99e2-fc08-4374-91b6-192bde04bae6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 09:35:16 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-bd389e29-63f5-4101-8d91-086e3ad24cf6 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] Converting VIF {"id": "2eaf99e2-fc08-4374-91b6-192bde04bae6", "address": "fa:16:3e:6c:5e:8a", "network": {"id": "48c8af75-6a89-441b-8e4a-8c7186006537", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2172147-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9af984d06e5340f8a65a54a806c7c88a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eaf99e2-fc", "ovs_interfaceid": "2eaf99e2-fc08-4374-91b6-192bde04bae6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 09:35:16 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-bd389e29-63f5-4101-8d91-086e3ad24cf6 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:5e:8a,bridge_name='br-int',has_traffic_filtering=True,id=2eaf99e2-fc08-4374-91b6-192bde04bae6,network=Network(48c8af75-6a89-441b-8e4a-8c7186006537),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2eaf99e2-fc') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 09:35:16 user nova-compute[75122]: DEBUG os_vif [None req-bd389e29-63f5-4101-8d91-086e3ad24cf6 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:5e:8a,bridge_name='br-int',has_traffic_filtering=True,id=2eaf99e2-fc08-4374-91b6-192bde04bae6,network=Network(48c8af75-6a89-441b-8e4a-8c7186006537),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2eaf99e2-fc') {{(pid=75122) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 09:35:16 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-9d4e7731-cbaa-4623-8177-57f4294bfc8f tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json" returned: 0 in 0.247s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:35:16 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-9d4e7731-cbaa-4623-8177-57f4294bfc8f tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Acquiring lock "95d6e29f74d5408f818e32f3bc29bc8270a4c665" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:35:16 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-9d4e7731-cbaa-4623-8177-57f4294bfc8f tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Lock "95d6e29f74d5408f818e32f3bc29bc8270a4c665" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:35:16 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-9d4e7731-cbaa-4623-8177-57f4294bfc8f tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:35:16 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:35:16 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2eaf99e2-fc, bridge=br-int, if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:35:16 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:35:16 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:35:16 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:35:16 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=63844025-86a2-4953-8cfc-2123fb7bb94b) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:35:16 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:35:16 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:35:16 user nova-compute[75122]: INFO os_vif [None req-bd389e29-63f5-4101-8d91-086e3ad24cf6 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:5e:8a,bridge_name='br-int',has_traffic_filtering=True,id=2eaf99e2-fc08-4374-91b6-192bde04bae6,network=Network(48c8af75-6a89-441b-8e4a-8c7186006537),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2eaf99e2-fc')
Nov 15 09:35:16 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-bd389e29-63f5-4101-8d91-086e3ad24cf6 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] [instance: 3ce9b2be-aeb4-45e3-966c-e11667e6be8a] Deleting instance files /opt/stack/data/nova/instances/3ce9b2be-aeb4-45e3-966c-e11667e6be8a_del
Nov 15 09:35:16 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-bd389e29-63f5-4101-8d91-086e3ad24cf6 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] [instance: 3ce9b2be-aeb4-45e3-966c-e11667e6be8a] Deletion of /opt/stack/data/nova/instances/3ce9b2be-aeb4-45e3-966c-e11667e6be8a_del complete
Nov 15 09:35:16 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cfd4155-c4b3-4cce-91e5-042cafccab8b/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:35:16 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cfd4155-c4b3-4cce-91e5-042cafccab8b/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:35:16 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-9d4e7731-cbaa-4623-8177-57f4294bfc8f tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json" returned: 0 in 0.210s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:35:16 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-9d4e7731-cbaa-4623-8177-57f4294bfc8f tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665,backing_fmt=raw /opt/stack/data/nova/instances/fd9d52bb-6248-48e6-a798-6dbdaaa68cbc/disk 1073741824 {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:35:16 user nova-compute[75122]: INFO nova.compute.manager [None req-bd389e29-63f5-4101-8d91-086e3ad24cf6 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] [instance: 3ce9b2be-aeb4-45e3-966c-e11667e6be8a] Took 1.38 seconds to destroy the instance on the hypervisor.
Nov 15 09:35:16 user nova-compute[75122]: DEBUG oslo.service.loopingcall [None req-bd389e29-63f5-4101-8d91-086e3ad24cf6 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75122) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 09:35:16 user nova-compute[75122]: DEBUG nova.compute.manager [-] [instance: 3ce9b2be-aeb4-45e3-966c-e11667e6be8a] Deallocating network for instance {{(pid=75122) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 09:35:16 user nova-compute[75122]: DEBUG nova.network.neutron [-] [instance: 3ce9b2be-aeb4-45e3-966c-e11667e6be8a] deallocate_for_instance() {{(pid=75122) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 09:35:16 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-9d4e7731-cbaa-4623-8177-57f4294bfc8f tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665,backing_fmt=raw /opt/stack/data/nova/instances/fd9d52bb-6248-48e6-a798-6dbdaaa68cbc/disk 1073741824" returned: 0 in 0.117s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:35:16 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-9d4e7731-cbaa-4623-8177-57f4294bfc8f tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Lock "95d6e29f74d5408f818e32f3bc29bc8270a4c665" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.333s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:35:16 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-9d4e7731-cbaa-4623-8177-57f4294bfc8f tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:35:16 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cfd4155-c4b3-4cce-91e5-042cafccab8b/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:35:16 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75122) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 09:35:16 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=75122) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 09:35:16 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] skipping disk /dev/sdh (vdc) as it is a volume {{(pid=75122) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 09:35:16 user nova-compute[75122]: DEBUG nova.compute.provider_tree [None req-dcebddcd-993d-47ac-8506-44af7c18a2ea tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Inventory has not changed in ProviderTree for provider: 69a3da65-47be-44c6-b67c-c692b58284ef {{(pid=75122) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 09:35:16 user nova-compute[75122]: DEBUG nova.network.neutron [None req-9d4e7731-cbaa-4623-8177-57f4294bfc8f tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] [instance: fd9d52bb-6248-48e6-a798-6dbdaaa68cbc] Successfully created port: f6892701-aba2-4c9a-88bd-996d00963301 {{(pid=75122) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 09:35:16 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-dcebddcd-993d-47ac-8506-44af7c18a2ea tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Inventory has not changed for provider 69a3da65-47be-44c6-b67c-c692b58284ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 09:35:17 user nova-compute[75122]: DEBUG nova.compute.manager [req-c1eb28bd-1118-40b3-bd0e-97bedcb5dbfe req-ba65d1fd-1304-4ff0-80a7-257c6a9e7656 service nova] [instance: 3ce9b2be-aeb4-45e3-966c-e11667e6be8a] Received event network-vif-unplugged-2eaf99e2-fc08-4374-91b6-192bde04bae6 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:35:17 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-c1eb28bd-1118-40b3-bd0e-97bedcb5dbfe req-ba65d1fd-1304-4ff0-80a7-257c6a9e7656 service nova] Acquiring lock "3ce9b2be-aeb4-45e3-966c-e11667e6be8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:35:17 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-c1eb28bd-1118-40b3-bd0e-97bedcb5dbfe req-ba65d1fd-1304-4ff0-80a7-257c6a9e7656 service nova] Lock "3ce9b2be-aeb4-45e3-966c-e11667e6be8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:35:17 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-c1eb28bd-1118-40b3-bd0e-97bedcb5dbfe req-ba65d1fd-1304-4ff0-80a7-257c6a9e7656 service nova] Lock "3ce9b2be-aeb4-45e3-966c-e11667e6be8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:35:17 user nova-compute[75122]: DEBUG nova.compute.manager [req-c1eb28bd-1118-40b3-bd0e-97bedcb5dbfe req-ba65d1fd-1304-4ff0-80a7-257c6a9e7656 service nova] [instance: 3ce9b2be-aeb4-45e3-966c-e11667e6be8a] No waiting events found dispatching network-vif-unplugged-2eaf99e2-fc08-4374-91b6-192bde04bae6 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:35:17 user nova-compute[75122]: DEBUG nova.compute.manager [req-c1eb28bd-1118-40b3-bd0e-97bedcb5dbfe req-ba65d1fd-1304-4ff0-80a7-257c6a9e7656 service nova] [instance: 3ce9b2be-aeb4-45e3-966c-e11667e6be8a] Received event network-vif-unplugged-2eaf99e2-fc08-4374-91b6-192bde04bae6 for instance with task_state deleting. {{(pid=75122) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 09:35:17 user nova-compute[75122]: DEBUG nova.compute.manager [req-4c65c8dc-f6b5-4800-a441-550e16cbfa47 req-1b733151-5c56-47c4-8ea7-118d490dc378 service nova] [instance: 3ce9b2be-aeb4-45e3-966c-e11667e6be8a] Received event network-vif-deleted-2eaf99e2-fc08-4374-91b6-192bde04bae6 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:35:17 user nova-compute[75122]: INFO nova.compute.manager [req-4c65c8dc-f6b5-4800-a441-550e16cbfa47 req-1b733151-5c56-47c4-8ea7-118d490dc378 service nova] [instance: 3ce9b2be-aeb4-45e3-966c-e11667e6be8a] Neutron deleted interface 2eaf99e2-fc08-4374-91b6-192bde04bae6; detaching it from the instance and deleting it from the info cache
Nov 15 09:35:17 user nova-compute[75122]: DEBUG nova.network.neutron [req-4c65c8dc-f6b5-4800-a441-550e16cbfa47 req-1b733151-5c56-47c4-8ea7-118d490dc378 service nova] [instance: 3ce9b2be-aeb4-45e3-966c-e11667e6be8a] Updating instance_info_cache with network_info: [] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:35:17 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-dcebddcd-993d-47ac-8506-44af7c18a2ea tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.124s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:35:17 user nova-compute[75122]: DEBUG nova.compute.manager [None req-dcebddcd-993d-47ac-8506-44af7c18a2ea tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] [instance: 00270cc2-4f5b-4f64-8f88-31f21e3b3950] Start building networks asynchronously for instance. {{(pid=75122) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 09:35:17 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-9d4e7731-cbaa-4623-8177-57f4294bfc8f tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json" returned: 0 in 1.057s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:35:17 user nova-compute[75122]: DEBUG nova.virt.disk.api [None req-9d4e7731-cbaa-4623-8177-57f4294bfc8f tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fd9d52bb-6248-48e6-a798-6dbdaaa68cbc/disk. size=1073741824 {{(pid=75122) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 09:35:17 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-9d4e7731-cbaa-4623-8177-57f4294bfc8f tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd9d52bb-6248-48e6-a798-6dbdaaa68cbc/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:35:17 user nova-compute[75122]: DEBUG nova.network.neutron [-] [instance: 3ce9b2be-aeb4-45e3-966c-e11667e6be8a] Updating instance_info_cache with network_info: [] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:35:17 user nova-compute[75122]: DEBUG nova.network.neutron [None req-9d4e7731-cbaa-4623-8177-57f4294bfc8f tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] [instance: fd9d52bb-6248-48e6-a798-6dbdaaa68cbc] Successfully updated port: f6892701-aba2-4c9a-88bd-996d00963301 {{(pid=75122) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 09:35:17 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-9d4e7731-cbaa-4623-8177-57f4294bfc8f tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Acquiring lock "refresh_cache-fd9d52bb-6248-48e6-a798-6dbdaaa68cbc" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 09:35:17 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-9d4e7731-cbaa-4623-8177-57f4294bfc8f tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Acquired lock "refresh_cache-fd9d52bb-6248-48e6-a798-6dbdaaa68cbc" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 09:35:17 user nova-compute[75122]: DEBUG nova.network.neutron [None req-9d4e7731-cbaa-4623-8177-57f4294bfc8f tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] [instance: fd9d52bb-6248-48e6-a798-6dbdaaa68cbc] Building network info cache for instance {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 09:35:17 user nova-compute[75122]: INFO nova.compute.manager [-] [instance: 3ce9b2be-aeb4-45e3-966c-e11667e6be8a] Took 1.15 seconds to deallocate network for instance.
Nov 15 09:35:17 user nova-compute[75122]: DEBUG nova.compute.manager [req-4c65c8dc-f6b5-4800-a441-550e16cbfa47 req-1b733151-5c56-47c4-8ea7-118d490dc378 service nova] [instance: 3ce9b2be-aeb4-45e3-966c-e11667e6be8a] Detach interface failed, port_id=2eaf99e2-fc08-4374-91b6-192bde04bae6, reason: Instance 3ce9b2be-aeb4-45e3-966c-e11667e6be8a could not be found. {{(pid=75122) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 09:35:17 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 09:35:17 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 09:35:17 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Hypervisor/Node resource view: name=user free_ram=7835MB free_disk=25.607711791992188GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75122) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 09:35:17 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:35:17 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:35:17 user nova-compute[75122]: DEBUG nova.network.neutron [None req-9d4e7731-cbaa-4623-8177-57f4294bfc8f tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] [instance: fd9d52bb-6248-48e6-a798-6dbdaaa68cbc] Instance cache missing network info. {{(pid=75122) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 09:35:17 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-bd389e29-63f5-4101-8d91-086e3ad24cf6 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:35:18 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-9d4e7731-cbaa-4623-8177-57f4294bfc8f tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd9d52bb-6248-48e6-a798-6dbdaaa68cbc/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:35:18 user nova-compute[75122]: DEBUG nova.virt.disk.api [None req-9d4e7731-cbaa-4623-8177-57f4294bfc8f tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Cannot resize image /opt/stack/data/nova/instances/fd9d52bb-6248-48e6-a798-6dbdaaa68cbc/disk to a smaller size. {{(pid=75122) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 09:35:18 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-9d4e7731-cbaa-4623-8177-57f4294bfc8f tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] [instance: fd9d52bb-6248-48e6-a798-6dbdaaa68cbc] Created local disks {{(pid=75122) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 09:35:18 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-9d4e7731-cbaa-4623-8177-57f4294bfc8f tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] [instance: fd9d52bb-6248-48e6-a798-6dbdaaa68cbc] Ensure instance console log exists: /opt/stack/data/nova/instances/fd9d52bb-6248-48e6-a798-6dbdaaa68cbc/console.log {{(pid=75122) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 09:35:18 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-9d4e7731-cbaa-4623-8177-57f4294bfc8f tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:35:18 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-9d4e7731-cbaa-4623-8177-57f4294bfc8f tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:35:18 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-9d4e7731-cbaa-4623-8177-57f4294bfc8f tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:35:18 user nova-compute[75122]: DEBUG nova.compute.manager [None req-dcebddcd-993d-47ac-8506-44af7c18a2ea tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] [instance: 00270cc2-4f5b-4f64-8f88-31f21e3b3950] Allocating IP information in the background. {{(pid=75122) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 09:35:18 user nova-compute[75122]: DEBUG nova.network.neutron [None req-dcebddcd-993d-47ac-8506-44af7c18a2ea tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] [instance: 00270cc2-4f5b-4f64-8f88-31f21e3b3950] allocate_for_instance() {{(pid=75122) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 09:35:18 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-dcebddcd-993d-47ac-8506-44af7c18a2ea tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] [instance: 00270cc2-4f5b-4f64-8f88-31f21e3b3950] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 09:35:18 user nova-compute[75122]: DEBUG nova.compute.manager [None req-dcebddcd-993d-47ac-8506-44af7c18a2ea tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] [instance: 00270cc2-4f5b-4f64-8f88-31f21e3b3950] Start building block device mappings for instance. {{(pid=75122) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 09:35:18 user nova-compute[75122]: DEBUG nova.policy [None req-dcebddcd-993d-47ac-8506-44af7c18a2ea tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd05ef35b07ba45afb142f406d418d8d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeff24cb28f5481fa3941ba399ce82ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75122) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 09:35:18 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Applying migration context for instance ee961d5a-e0d1-4931-9293-eefbe638097a as it has an incoming, in-progress migration f8a46d00-fb11-44d8-a63f-1ba41a2331d7. Migration status is finished {{(pid=75122) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 15 09:35:18 user nova-compute[75122]: INFO nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] [instance: ee961d5a-e0d1-4931-9293-eefbe638097a] Updating resource usage from migration f8a46d00-fb11-44d8-a63f-1ba41a2331d7
Nov 15 09:35:18 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance 131142fd-e8ec-42d1-a518-aa21c7bb7cb1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:35:18 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance 3ce9b2be-aeb4-45e3-966c-e11667e6be8a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:35:18 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance 742d64db-c555-4517-8ec9-cef02f09a6e0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:35:18 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance 7cfd4155-c4b3-4cce-91e5-042cafccab8b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:35:18 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Migration f8a46d00-fb11-44d8-a63f-1ba41a2331d7 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 15 09:35:18 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance ee961d5a-e0d1-4931-9293-eefbe638097a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:35:18 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance 6a2fb361-de47-41c4-afa2-46f7107af1f4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:35:18 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance f7d1a157-3228-490e-a6a0-68f6bd2b52ba actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:35:18 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance 5b5a4d58-ba1e-473d-a32a-06fae1c84efc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:35:18 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance 1e19f9e1-69c6-4590-85d2-e90cbdbb3d80 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:35:18 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance fd9d52bb-6248-48e6-a798-6dbdaaa68cbc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:35:18 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance 00270cc2-4f5b-4f64-8f88-31f21e3b3950 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:35:18 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75122) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 09:35:18 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=28GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75122) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 09:35:18 user nova-compute[75122]: DEBUG nova.network.neutron [None req-9d4e7731-cbaa-4623-8177-57f4294bfc8f tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] [instance: fd9d52bb-6248-48e6-a798-6dbdaaa68cbc] Updating instance_info_cache with network_info: [{"id": "f6892701-aba2-4c9a-88bd-996d00963301", "address": "fa:16:3e:a5:6f:a0", "network": {"id": "c2062f64-d925-42d2-9687-5d2511ef6697", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1134087048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eeff24cb28f5481fa3941ba399ce82ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6892701-ab", "ovs_interfaceid": "f6892701-aba2-4c9a-88bd-996d00963301", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:35:18 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-9d4e7731-cbaa-4623-8177-57f4294bfc8f tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Releasing lock "refresh_cache-fd9d52bb-6248-48e6-a798-6dbdaaa68cbc" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 09:35:18 user nova-compute[75122]: DEBUG nova.compute.manager [None req-9d4e7731-cbaa-4623-8177-57f4294bfc8f tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] [instance: fd9d52bb-6248-48e6-a798-6dbdaaa68cbc] Instance network_info: |[{"id": "f6892701-aba2-4c9a-88bd-996d00963301", "address": "fa:16:3e:a5:6f:a0", "network": {"id": "c2062f64-d925-42d2-9687-5d2511ef6697", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1134087048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eeff24cb28f5481fa3941ba399ce82ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6892701-ab", "ovs_interfaceid": "f6892701-aba2-4c9a-88bd-996d00963301", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75122) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 09:35:18 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-9d4e7731-cbaa-4623-8177-57f4294bfc8f tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] [instance: fd9d52bb-6248-48e6-a798-6dbdaaa68cbc] Start _get_guest_xml network_info=[{"id": "f6892701-aba2-4c9a-88bd-996d00963301", "address": "fa:16:3e:a5:6f:a0", "network": {"id": "c2062f64-d925-42d2-9687-5d2511ef6697", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1134087048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eeff24cb28f5481fa3941ba399ce82ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6892701-ab", "ovs_interfaceid": "f6892701-aba2-4c9a-88bd-996d00963301", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T09:26:31Z,direct_url=<?>,disk_format='qcow2',id=5e862cfe-47b8-4725-8292-65761ee6d0f5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9c57733cb41847c0b4ad31519c382e5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T09:26:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '5e862cfe-47b8-4725-8292-65761ee6d0f5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75122) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 09:35:18 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-9d4e7731-cbaa-4623-8177-57f4294bfc8f tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 09:35:18 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-9d4e7731-cbaa-4623-8177-57f4294bfc8f tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 09:35:18 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-9d4e7731-cbaa-4623-8177-57f4294bfc8f tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75122) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 09:35:18 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-9d4e7731-cbaa-4623-8177-57f4294bfc8f tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] CPU controller missing on host. {{(pid=75122) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 09:35:18 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-9d4e7731-cbaa-4623-8177-57f4294bfc8f tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75122) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 09:35:18 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-9d4e7731-cbaa-4623-8177-57f4294bfc8f tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] CPU controller found on host. {{(pid=75122) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 09:35:18 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-9d4e7731-cbaa-4623-8177-57f4294bfc8f tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75122) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 09:35:18 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-9d4e7731-cbaa-4623-8177-57f4294bfc8f tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T09:26:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T09:26:31Z,direct_url=<?>,disk_format='qcow2',id=5e862cfe-47b8-4725-8292-65761ee6d0f5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9c57733cb41847c0b4ad31519c382e5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T09:26:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 09:35:18 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-9d4e7731-cbaa-4623-8177-57f4294bfc8f tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Flavor limits 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 09:35:18 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-9d4e7731-cbaa-4623-8177-57f4294bfc8f tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Image limits 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 09:35:18 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-9d4e7731-cbaa-4623-8177-57f4294bfc8f tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Flavor pref 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 09:35:18 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-9d4e7731-cbaa-4623-8177-57f4294bfc8f tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Image pref 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 09:35:18 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-9d4e7731-cbaa-4623-8177-57f4294bfc8f tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 09:35:18 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-9d4e7731-cbaa-4623-8177-57f4294bfc8f tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 09:35:18 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-9d4e7731-cbaa-4623-8177-57f4294bfc8f tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75122) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 09:35:18 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-9d4e7731-cbaa-4623-8177-57f4294bfc8f tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Got 1 possible topologies {{(pid=75122) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 09:35:18 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-9d4e7731-cbaa-4623-8177-57f4294bfc8f tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 09:35:18 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-9d4e7731-cbaa-4623-8177-57f4294bfc8f tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 09:35:18 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-9d4e7731-cbaa-4623-8177-57f4294bfc8f tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T09:35:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1046243250',display_name='tempest-ServerRescueNegativeTestJSON-server-1046243250',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1046243250',id=16,image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eeff24cb28f5481fa3941ba399ce82ff',ramdisk_id='',reservation_id='r-wmbthb7r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-59965354',owner_user_name='tempest-ServerRescueNegativeTestJSON-59965354-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T09:35:16Z,user_data=None,user_id='d05ef35b07ba45afb142f406d418d8d4',uuid=fd9d52bb-6248-48e6-a798-6dbdaaa68cbc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f6892701-aba2-4c9a-88bd-996d00963301", "address": "fa:16:3e:a5:6f:a0", "network": {"id": "c2062f64-d925-42d2-9687-5d2511ef6697", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1134087048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eeff24cb28f5481fa3941ba399ce82ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6892701-ab", "ovs_interfaceid": "f6892701-aba2-4c9a-88bd-996d00963301", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75122) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 09:35:18 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-9d4e7731-cbaa-4623-8177-57f4294bfc8f tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Converting VIF {"id": "f6892701-aba2-4c9a-88bd-996d00963301", "address": "fa:16:3e:a5:6f:a0", "network": {"id": "c2062f64-d925-42d2-9687-5d2511ef6697", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1134087048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eeff24cb28f5481fa3941ba399ce82ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6892701-ab", "ovs_interfaceid": "f6892701-aba2-4c9a-88bd-996d00963301", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 09:35:18 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-9d4e7731-cbaa-4623-8177-57f4294bfc8f tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a5:6f:a0,bridge_name='br-int',has_traffic_filtering=True,id=f6892701-aba2-4c9a-88bd-996d00963301,network=Network(c2062f64-d925-42d2-9687-5d2511ef6697),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6892701-ab') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 09:35:18 user nova-compute[75122]: DEBUG nova.objects.instance [None req-9d4e7731-cbaa-4623-8177-57f4294bfc8f tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Lazy-loading 'pci_devices' on Instance uuid fd9d52bb-6248-48e6-a798-6dbdaaa68cbc {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:35:18 user nova-compute[75122]: DEBUG nova.compute.manager [None req-dcebddcd-993d-47ac-8506-44af7c18a2ea tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] [instance: 00270cc2-4f5b-4f64-8f88-31f21e3b3950] Start spawning the instance on the hypervisor. {{(pid=75122) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 09:35:18 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-dcebddcd-993d-47ac-8506-44af7c18a2ea tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] [instance: 00270cc2-4f5b-4f64-8f88-31f21e3b3950] Creating instance directory {{(pid=75122) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 09:35:18 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-dcebddcd-993d-47ac-8506-44af7c18a2ea tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] [instance: 00270cc2-4f5b-4f64-8f88-31f21e3b3950] Creating image(s)
Nov 15 09:35:18 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-dcebddcd-993d-47ac-8506-44af7c18a2ea tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Acquiring lock "/opt/stack/data/nova/instances/00270cc2-4f5b-4f64-8f88-31f21e3b3950/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:35:18 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-dcebddcd-993d-47ac-8506-44af7c18a2ea tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Lock "/opt/stack/data/nova/instances/00270cc2-4f5b-4f64-8f88-31f21e3b3950/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:35:18 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-dcebddcd-993d-47ac-8506-44af7c18a2ea tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Lock "/opt/stack/data/nova/instances/00270cc2-4f5b-4f64-8f88-31f21e3b3950/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:35:18 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-9d4e7731-cbaa-4623-8177-57f4294bfc8f tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] [instance: fd9d52bb-6248-48e6-a798-6dbdaaa68cbc] End _get_guest_xml xml=<domain type="kvm">
Nov 15 09:35:18 user nova-compute[75122]:   <uuid>fd9d52bb-6248-48e6-a798-6dbdaaa68cbc</uuid>
Nov 15 09:35:18 user nova-compute[75122]:   <name>instance-00000010</name>
Nov 15 09:35:18 user nova-compute[75122]:   <memory>524288</memory>
Nov 15 09:35:18 user nova-compute[75122]:   <vcpu>1</vcpu>
Nov 15 09:35:18 user nova-compute[75122]:   <metadata>
Nov 15 09:35:18 user nova-compute[75122]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 09:35:18 user nova-compute[75122]:       <nova:package version="0.0.0"/>
Nov 15 09:35:18 user nova-compute[75122]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1046243250</nova:name>
Nov 15 09:35:18 user nova-compute[75122]:       <nova:creationTime>2023-11-15 09:35:18</nova:creationTime>
Nov 15 09:35:18 user nova-compute[75122]:       <nova:flavor name="m1.tiny">
Nov 15 09:35:18 user nova-compute[75122]:         <nova:memory>512</nova:memory>
Nov 15 09:35:18 user nova-compute[75122]:         <nova:disk>1</nova:disk>
Nov 15 09:35:18 user nova-compute[75122]:         <nova:swap>0</nova:swap>
Nov 15 09:35:18 user nova-compute[75122]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 09:35:18 user nova-compute[75122]:         <nova:vcpus>1</nova:vcpus>
Nov 15 09:35:18 user nova-compute[75122]:       </nova:flavor>
Nov 15 09:35:18 user nova-compute[75122]:       <nova:owner>
Nov 15 09:35:18 user nova-compute[75122]:         <nova:user uuid="d05ef35b07ba45afb142f406d418d8d4">tempest-ServerRescueNegativeTestJSON-59965354-project-member</nova:user>
Nov 15 09:35:18 user nova-compute[75122]:         <nova:project uuid="eeff24cb28f5481fa3941ba399ce82ff">tempest-ServerRescueNegativeTestJSON-59965354</nova:project>
Nov 15 09:35:18 user nova-compute[75122]:       </nova:owner>
Nov 15 09:35:18 user nova-compute[75122]:       <nova:root type="image" uuid="5e862cfe-47b8-4725-8292-65761ee6d0f5"/>
Nov 15 09:35:18 user nova-compute[75122]:       <nova:ports>
Nov 15 09:35:18 user nova-compute[75122]:         <nova:port uuid="f6892701-aba2-4c9a-88bd-996d00963301">
Nov 15 09:35:18 user nova-compute[75122]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 15 09:35:18 user nova-compute[75122]:         </nova:port>
Nov 15 09:35:18 user nova-compute[75122]:       </nova:ports>
Nov 15 09:35:18 user nova-compute[75122]:     </nova:instance>
Nov 15 09:35:18 user nova-compute[75122]:   </metadata>
Nov 15 09:35:18 user nova-compute[75122]:   <sysinfo type="smbios">
Nov 15 09:35:18 user nova-compute[75122]:     <system>
Nov 15 09:35:18 user nova-compute[75122]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 09:35:18 user nova-compute[75122]:       <entry name="product">OpenStack Nova</entry>
Nov 15 09:35:18 user nova-compute[75122]:       <entry name="version">0.0.0</entry>
Nov 15 09:35:18 user nova-compute[75122]:       <entry name="serial">fd9d52bb-6248-48e6-a798-6dbdaaa68cbc</entry>
Nov 15 09:35:18 user nova-compute[75122]:       <entry name="uuid">fd9d52bb-6248-48e6-a798-6dbdaaa68cbc</entry>
Nov 15 09:35:18 user nova-compute[75122]:       <entry name="family">Virtual Machine</entry>
Nov 15 09:35:18 user nova-compute[75122]:     </system>
Nov 15 09:35:18 user nova-compute[75122]:   </sysinfo>
Nov 15 09:35:18 user nova-compute[75122]:   <os>
Nov 15 09:35:18 user nova-compute[75122]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 09:35:18 user nova-compute[75122]:     <boot dev="hd"/>
Nov 15 09:35:18 user nova-compute[75122]:     <smbios mode="sysinfo"/>
Nov 15 09:35:18 user nova-compute[75122]:   </os>
Nov 15 09:35:18 user nova-compute[75122]:   <features>
Nov 15 09:35:18 user nova-compute[75122]:     <acpi/>
Nov 15 09:35:18 user nova-compute[75122]:     <apic/>
Nov 15 09:35:18 user nova-compute[75122]:     <vmcoreinfo/>
Nov 15 09:35:18 user nova-compute[75122]:   </features>
Nov 15 09:35:18 user nova-compute[75122]:   <clock offset="utc">
Nov 15 09:35:18 user nova-compute[75122]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 09:35:18 user nova-compute[75122]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 09:35:18 user nova-compute[75122]:     <timer name="hpet" present="no"/>
Nov 15 09:35:18 user nova-compute[75122]:   </clock>
Nov 15 09:35:18 user nova-compute[75122]:   <cpu mode="custom" match="exact">
Nov 15 09:35:18 user nova-compute[75122]:     <model>Nehalem</model>
Nov 15 09:35:18 user nova-compute[75122]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 09:35:18 user nova-compute[75122]:   </cpu>
Nov 15 09:35:18 user nova-compute[75122]:   <devices>
Nov 15 09:35:18 user nova-compute[75122]:     <disk type="file" device="disk">
Nov 15 09:35:18 user nova-compute[75122]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 09:35:18 user nova-compute[75122]:       <source file="/opt/stack/data/nova/instances/fd9d52bb-6248-48e6-a798-6dbdaaa68cbc/disk"/>
Nov 15 09:35:18 user nova-compute[75122]:       <target dev="vda" bus="virtio"/>
Nov 15 09:35:18 user nova-compute[75122]:     </disk>
Nov 15 09:35:18 user nova-compute[75122]:     <interface type="ethernet">
Nov 15 09:35:18 user nova-compute[75122]:       <mac address="fa:16:3e:a5:6f:a0"/>
Nov 15 09:35:18 user nova-compute[75122]:       <model type="virtio"/>
Nov 15 09:35:18 user nova-compute[75122]:       <mtu size="1442"/>
Nov 15 09:35:18 user nova-compute[75122]:       <target dev="tapf6892701-ab"/>
Nov 15 09:35:18 user nova-compute[75122]:     </interface>
Nov 15 09:35:18 user nova-compute[75122]:     <serial type="pty">
Nov 15 09:35:18 user nova-compute[75122]:       <log file="/opt/stack/data/nova/instances/fd9d52bb-6248-48e6-a798-6dbdaaa68cbc/console.log" append="off"/>
Nov 15 09:35:18 user nova-compute[75122]:     </serial>
Nov 15 09:35:18 user nova-compute[75122]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 09:35:18 user nova-compute[75122]:     <video>
Nov 15 09:35:18 user nova-compute[75122]:       <model type="virtio"/>
Nov 15 09:35:18 user nova-compute[75122]:     </video>
Nov 15 09:35:18 user nova-compute[75122]:     <rng model="virtio">
Nov 15 09:35:18 user nova-compute[75122]:       <backend model="random">/dev/urandom</backend>
Nov 15 09:35:18 user nova-compute[75122]:     </rng>
Nov 15 09:35:18 user nova-compute[75122]:     <controller type="usb" index="0" model="none"/>
Nov 15 09:35:18 user nova-compute[75122]:     <memballoon model="virtio">
Nov 15 09:35:18 user nova-compute[75122]:       <stats period="10"/>
Nov 15 09:35:18 user nova-compute[75122]:     </memballoon>
Nov 15 09:35:18 user nova-compute[75122]:   </devices>
Nov 15 09:35:18 user nova-compute[75122]: </domain>
Nov 15 09:35:18 user nova-compute[75122]:  {{(pid=75122) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 09:35:18 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-9d4e7731-cbaa-4623-8177-57f4294bfc8f tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T09:35:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1046243250',display_name='tempest-ServerRescueNegativeTestJSON-server-1046243250',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1046243250',id=16,image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eeff24cb28f5481fa3941ba399ce82ff',ramdisk_id='',reservation_id='r-wmbthb7r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-59965354',owner_user_name='tempest-ServerRescueNegativeTestJSON-59965354-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T09:35:16Z,user_data=None,user_id='d05ef35b07ba45afb142f406d418d8d4',uuid=fd9d52bb-6248-48e6-a798-6dbdaaa68cbc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f6892701-aba2-4c9a-88bd-996d00963301", "address": "fa:16:3e:a5:6f:a0", "network": {"id": "c2062f64-d925-42d2-9687-5d2511ef6697", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1134087048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eeff24cb28f5481fa3941ba399ce82ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6892701-ab", "ovs_interfaceid": "f6892701-aba2-4c9a-88bd-996d00963301", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 09:35:18 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-9d4e7731-cbaa-4623-8177-57f4294bfc8f tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Converting VIF {"id": "f6892701-aba2-4c9a-88bd-996d00963301", "address": "fa:16:3e:a5:6f:a0", "network": {"id": "c2062f64-d925-42d2-9687-5d2511ef6697", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1134087048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eeff24cb28f5481fa3941ba399ce82ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6892701-ab", "ovs_interfaceid": "f6892701-aba2-4c9a-88bd-996d00963301", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 09:35:18 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-9d4e7731-cbaa-4623-8177-57f4294bfc8f tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a5:6f:a0,bridge_name='br-int',has_traffic_filtering=True,id=f6892701-aba2-4c9a-88bd-996d00963301,network=Network(c2062f64-d925-42d2-9687-5d2511ef6697),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6892701-ab') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 09:35:18 user nova-compute[75122]: DEBUG os_vif [None req-9d4e7731-cbaa-4623-8177-57f4294bfc8f tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:6f:a0,bridge_name='br-int',has_traffic_filtering=True,id=f6892701-aba2-4c9a-88bd-996d00963301,network=Network(c2062f64-d925-42d2-9687-5d2511ef6697),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6892701-ab') {{(pid=75122) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 09:35:18 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-dcebddcd-993d-47ac-8506-44af7c18a2ea tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:35:18 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:35:18 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:35:18 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 09:35:18 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:35:18 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e6878b43-adc9-5034-b600-9663275aca7d', '_type': 'linux-noop'}}, row=False) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:35:18 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:35:18 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:35:18 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:35:18 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf6892701-ab, may_exist=True, interface_attrs={}) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:35:18 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf6892701-ab, col_values=(('qos', UUID('249e9776-4657-40a2-aa3c-7ccbf5ef2566')),), if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:35:18 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf6892701-ab, col_values=(('external_ids', {'iface-id': 'f6892701-aba2-4c9a-88bd-996d00963301', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a5:6f:a0', 'vm-uuid': 'fd9d52bb-6248-48e6-a798-6dbdaaa68cbc'}),), if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:35:18 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:35:18 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:35:18 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:35:18 user nova-compute[75122]: INFO os_vif [None req-9d4e7731-cbaa-4623-8177-57f4294bfc8f tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:6f:a0,bridge_name='br-int',has_traffic_filtering=True,id=f6892701-aba2-4c9a-88bd-996d00963301,network=Network(c2062f64-d925-42d2-9687-5d2511ef6697),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6892701-ab')
Nov 15 09:35:18 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-9d4e7731-cbaa-4623-8177-57f4294bfc8f tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] No BDM found with device name vda, not building metadata. {{(pid=75122) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 09:35:18 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-9d4e7731-cbaa-4623-8177-57f4294bfc8f tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] No VIF found with MAC fa:16:3e:a5:6f:a0, not building metadata {{(pid=75122) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 09:35:18 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-dcebddcd-993d-47ac-8506-44af7c18a2ea tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json" returned: 0 in 0.250s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:35:18 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-dcebddcd-993d-47ac-8506-44af7c18a2ea tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Acquiring lock "95d6e29f74d5408f818e32f3bc29bc8270a4c665" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:35:18 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-dcebddcd-993d-47ac-8506-44af7c18a2ea tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Lock "95d6e29f74d5408f818e32f3bc29bc8270a4c665" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:35:18 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-dcebddcd-993d-47ac-8506-44af7c18a2ea tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:35:18 user nova-compute[75122]: DEBUG nova.network.neutron [None req-dcebddcd-993d-47ac-8506-44af7c18a2ea tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] [instance: 00270cc2-4f5b-4f64-8f88-31f21e3b3950] Successfully created port: bb6552dc-ebef-427a-beea-b41083f05e70 {{(pid=75122) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 09:35:18 user nova-compute[75122]: DEBUG nova.compute.provider_tree [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Inventory has not changed in ProviderTree for provider: 69a3da65-47be-44c6-b67c-c692b58284ef {{(pid=75122) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 09:35:18 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Inventory has not changed for provider 69a3da65-47be-44c6-b67c-c692b58284ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 09:35:18 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Compute_service record updated for user:user {{(pid=75122) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 09:35:18 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.912s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:35:18 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-bd389e29-63f5-4101-8d91-086e3ad24cf6 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.824s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:35:18 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-dcebddcd-993d-47ac-8506-44af7c18a2ea tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json" returned: 0 in 0.251s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:35:18 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-dcebddcd-993d-47ac-8506-44af7c18a2ea tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665,backing_fmt=raw /opt/stack/data/nova/instances/00270cc2-4f5b-4f64-8f88-31f21e3b3950/disk 1073741824 {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:35:18 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-dcebddcd-993d-47ac-8506-44af7c18a2ea tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665,backing_fmt=raw /opt/stack/data/nova/instances/00270cc2-4f5b-4f64-8f88-31f21e3b3950/disk 1073741824" returned: 0 in 0.071s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:35:18 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-dcebddcd-993d-47ac-8506-44af7c18a2ea tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Lock "95d6e29f74d5408f818e32f3bc29bc8270a4c665" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.327s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:35:18 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-dcebddcd-993d-47ac-8506-44af7c18a2ea tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:35:19 user nova-compute[75122]: DEBUG nova.compute.manager [req-8efd5d41-50d4-4045-9983-38fbb978b23a req-cc7d1a4d-0e1e-4746-874f-5a8f56dbc9dc service nova] [instance: fd9d52bb-6248-48e6-a798-6dbdaaa68cbc] Received event network-changed-f6892701-aba2-4c9a-88bd-996d00963301 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:35:19 user nova-compute[75122]: DEBUG nova.compute.manager [req-8efd5d41-50d4-4045-9983-38fbb978b23a req-cc7d1a4d-0e1e-4746-874f-5a8f56dbc9dc service nova] [instance: fd9d52bb-6248-48e6-a798-6dbdaaa68cbc] Refreshing instance network info cache due to event network-changed-f6892701-aba2-4c9a-88bd-996d00963301. {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 09:35:19 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-8efd5d41-50d4-4045-9983-38fbb978b23a req-cc7d1a4d-0e1e-4746-874f-5a8f56dbc9dc service nova] Acquiring lock "refresh_cache-fd9d52bb-6248-48e6-a798-6dbdaaa68cbc" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 09:35:19 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-8efd5d41-50d4-4045-9983-38fbb978b23a req-cc7d1a4d-0e1e-4746-874f-5a8f56dbc9dc service nova] Acquired lock "refresh_cache-fd9d52bb-6248-48e6-a798-6dbdaaa68cbc" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 09:35:19 user nova-compute[75122]: DEBUG nova.network.neutron [req-8efd5d41-50d4-4045-9983-38fbb978b23a req-cc7d1a4d-0e1e-4746-874f-5a8f56dbc9dc service nova] [instance: fd9d52bb-6248-48e6-a798-6dbdaaa68cbc] Refreshing network info cache for port f6892701-aba2-4c9a-88bd-996d00963301 {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 09:35:19 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-dcebddcd-993d-47ac-8506-44af7c18a2ea tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json" returned: 0 in 0.255s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:35:19 user nova-compute[75122]: DEBUG nova.virt.disk.api [None req-dcebddcd-993d-47ac-8506-44af7c18a2ea tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Checking if we can resize image /opt/stack/data/nova/instances/00270cc2-4f5b-4f64-8f88-31f21e3b3950/disk. size=1073741824 {{(pid=75122) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 09:35:19 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-dcebddcd-993d-47ac-8506-44af7c18a2ea tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00270cc2-4f5b-4f64-8f88-31f21e3b3950/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:35:19 user nova-compute[75122]: DEBUG nova.network.neutron [None req-dcebddcd-993d-47ac-8506-44af7c18a2ea tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] [instance: 00270cc2-4f5b-4f64-8f88-31f21e3b3950] Successfully updated port: bb6552dc-ebef-427a-beea-b41083f05e70 {{(pid=75122) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 09:35:19 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-dcebddcd-993d-47ac-8506-44af7c18a2ea tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Acquiring lock "refresh_cache-00270cc2-4f5b-4f64-8f88-31f21e3b3950" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 09:35:19 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-dcebddcd-993d-47ac-8506-44af7c18a2ea tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Acquired lock "refresh_cache-00270cc2-4f5b-4f64-8f88-31f21e3b3950" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 09:35:19 user nova-compute[75122]: DEBUG nova.network.neutron [None req-dcebddcd-993d-47ac-8506-44af7c18a2ea tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] [instance: 00270cc2-4f5b-4f64-8f88-31f21e3b3950] Building network info cache for instance {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 09:35:19 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-dcebddcd-993d-47ac-8506-44af7c18a2ea tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00270cc2-4f5b-4f64-8f88-31f21e3b3950/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:35:19 user nova-compute[75122]: DEBUG nova.virt.disk.api [None req-dcebddcd-993d-47ac-8506-44af7c18a2ea tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Cannot resize image /opt/stack/data/nova/instances/00270cc2-4f5b-4f64-8f88-31f21e3b3950/disk to a smaller size. {{(pid=75122) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 09:35:19 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-dcebddcd-993d-47ac-8506-44af7c18a2ea tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] [instance: 00270cc2-4f5b-4f64-8f88-31f21e3b3950] Created local disks {{(pid=75122) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 09:35:19 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-dcebddcd-993d-47ac-8506-44af7c18a2ea tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] [instance: 00270cc2-4f5b-4f64-8f88-31f21e3b3950] Ensure instance console log exists: /opt/stack/data/nova/instances/00270cc2-4f5b-4f64-8f88-31f21e3b3950/console.log {{(pid=75122) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 09:35:19 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-dcebddcd-993d-47ac-8506-44af7c18a2ea tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:35:19 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-dcebddcd-993d-47ac-8506-44af7c18a2ea tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:35:19 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-dcebddcd-993d-47ac-8506-44af7c18a2ea tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:35:19 user nova-compute[75122]: DEBUG nova.network.neutron [None req-dcebddcd-993d-47ac-8506-44af7c18a2ea tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] [instance: 00270cc2-4f5b-4f64-8f88-31f21e3b3950] Instance cache missing network info. {{(pid=75122) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 09:35:19 user nova-compute[75122]: DEBUG nova.compute.provider_tree [None req-bd389e29-63f5-4101-8d91-086e3ad24cf6 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] Inventory has not changed in ProviderTree for provider: 69a3da65-47be-44c6-b67c-c692b58284ef {{(pid=75122) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 09:35:19 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-bd389e29-63f5-4101-8d91-086e3ad24cf6 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] Inventory has not changed for provider 69a3da65-47be-44c6-b67c-c692b58284ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 09:35:19 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-bd389e29-63f5-4101-8d91-086e3ad24cf6 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.703s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:35:19 user nova-compute[75122]: INFO nova.scheduler.client.report [None req-bd389e29-63f5-4101-8d91-086e3ad24cf6 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] Deleted allocations for instance 3ce9b2be-aeb4-45e3-966c-e11667e6be8a
Nov 15 09:35:19 user nova-compute[75122]: DEBUG nova.compute.manager [req-9d1bcb16-c90f-4f1c-a698-3190a62307aa req-22be02e4-b8ed-44a7-86d5-4a0dd2661758 service nova] [instance: 00270cc2-4f5b-4f64-8f88-31f21e3b3950] Received event network-changed-bb6552dc-ebef-427a-beea-b41083f05e70 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:35:19 user nova-compute[75122]: DEBUG nova.compute.manager [req-9d1bcb16-c90f-4f1c-a698-3190a62307aa req-22be02e4-b8ed-44a7-86d5-4a0dd2661758 service nova] [instance: 00270cc2-4f5b-4f64-8f88-31f21e3b3950] Refreshing instance network info cache due to event network-changed-bb6552dc-ebef-427a-beea-b41083f05e70. {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 09:35:19 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-9d1bcb16-c90f-4f1c-a698-3190a62307aa req-22be02e4-b8ed-44a7-86d5-4a0dd2661758 service nova] Acquiring lock "refresh_cache-00270cc2-4f5b-4f64-8f88-31f21e3b3950" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 09:35:19 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-bd389e29-63f5-4101-8d91-086e3ad24cf6 tempest-VolumesActionsTest-915673420 tempest-VolumesActionsTest-915673420-project-member] Lock "3ce9b2be-aeb4-45e3-966c-e11667e6be8a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.388s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:35:19 user nova-compute[75122]: DEBUG nova.network.neutron [req-8efd5d41-50d4-4045-9983-38fbb978b23a req-cc7d1a4d-0e1e-4746-874f-5a8f56dbc9dc service nova] [instance: fd9d52bb-6248-48e6-a798-6dbdaaa68cbc] Updated VIF entry in instance network info cache for port f6892701-aba2-4c9a-88bd-996d00963301. {{(pid=75122) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 09:35:19 user nova-compute[75122]: DEBUG nova.network.neutron [req-8efd5d41-50d4-4045-9983-38fbb978b23a req-cc7d1a4d-0e1e-4746-874f-5a8f56dbc9dc service nova] [instance: fd9d52bb-6248-48e6-a798-6dbdaaa68cbc] Updating instance_info_cache with network_info: [{"id": "f6892701-aba2-4c9a-88bd-996d00963301", "address": "fa:16:3e:a5:6f:a0", "network": {"id": "c2062f64-d925-42d2-9687-5d2511ef6697", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1134087048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eeff24cb28f5481fa3941ba399ce82ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6892701-ab", "ovs_interfaceid": "f6892701-aba2-4c9a-88bd-996d00963301", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:35:19 user nova-compute[75122]: DEBUG nova.network.neutron [None req-dcebddcd-993d-47ac-8506-44af7c18a2ea tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] [instance: 00270cc2-4f5b-4f64-8f88-31f21e3b3950] Updating instance_info_cache with network_info: [{"id": "bb6552dc-ebef-427a-beea-b41083f05e70", "address": "fa:16:3e:44:9c:f9", "network": {"id": "c2062f64-d925-42d2-9687-5d2511ef6697", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1134087048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eeff24cb28f5481fa3941ba399ce82ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb6552dc-eb", "ovs_interfaceid": "bb6552dc-ebef-427a-beea-b41083f05e70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:35:19 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-8efd5d41-50d4-4045-9983-38fbb978b23a req-cc7d1a4d-0e1e-4746-874f-5a8f56dbc9dc service nova] Releasing lock "refresh_cache-fd9d52bb-6248-48e6-a798-6dbdaaa68cbc" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 09:35:19 user nova-compute[75122]: DEBUG nova.compute.manager [req-8efd5d41-50d4-4045-9983-38fbb978b23a req-cc7d1a4d-0e1e-4746-874f-5a8f56dbc9dc service nova] [instance: 3ce9b2be-aeb4-45e3-966c-e11667e6be8a] Received event network-vif-plugged-2eaf99e2-fc08-4374-91b6-192bde04bae6 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:35:19 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-8efd5d41-50d4-4045-9983-38fbb978b23a req-cc7d1a4d-0e1e-4746-874f-5a8f56dbc9dc service nova] Acquiring lock "3ce9b2be-aeb4-45e3-966c-e11667e6be8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:35:19 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-8efd5d41-50d4-4045-9983-38fbb978b23a req-cc7d1a4d-0e1e-4746-874f-5a8f56dbc9dc service nova] Lock "3ce9b2be-aeb4-45e3-966c-e11667e6be8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:35:19 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-8efd5d41-50d4-4045-9983-38fbb978b23a req-cc7d1a4d-0e1e-4746-874f-5a8f56dbc9dc service nova] Lock "3ce9b2be-aeb4-45e3-966c-e11667e6be8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:35:19 user nova-compute[75122]: DEBUG nova.compute.manager [req-8efd5d41-50d4-4045-9983-38fbb978b23a req-cc7d1a4d-0e1e-4746-874f-5a8f56dbc9dc service nova] [instance: 3ce9b2be-aeb4-45e3-966c-e11667e6be8a] No waiting events found dispatching network-vif-plugged-2eaf99e2-fc08-4374-91b6-192bde04bae6 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:35:19 user nova-compute[75122]: WARNING nova.compute.manager [req-8efd5d41-50d4-4045-9983-38fbb978b23a req-cc7d1a4d-0e1e-4746-874f-5a8f56dbc9dc service nova] [instance: 3ce9b2be-aeb4-45e3-966c-e11667e6be8a] Received unexpected event network-vif-plugged-2eaf99e2-fc08-4374-91b6-192bde04bae6 for instance with vm_state deleted and task_state None.
Nov 15 09:35:19 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-dcebddcd-993d-47ac-8506-44af7c18a2ea tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Releasing lock "refresh_cache-00270cc2-4f5b-4f64-8f88-31f21e3b3950" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 09:35:19 user nova-compute[75122]: DEBUG nova.compute.manager [None req-dcebddcd-993d-47ac-8506-44af7c18a2ea tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] [instance: 00270cc2-4f5b-4f64-8f88-31f21e3b3950] Instance network_info: |[{"id": "bb6552dc-ebef-427a-beea-b41083f05e70", "address": "fa:16:3e:44:9c:f9", "network": {"id": "c2062f64-d925-42d2-9687-5d2511ef6697", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1134087048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eeff24cb28f5481fa3941ba399ce82ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb6552dc-eb", "ovs_interfaceid": "bb6552dc-ebef-427a-beea-b41083f05e70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75122) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 09:35:19 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-9d1bcb16-c90f-4f1c-a698-3190a62307aa req-22be02e4-b8ed-44a7-86d5-4a0dd2661758 service nova] Acquired lock "refresh_cache-00270cc2-4f5b-4f64-8f88-31f21e3b3950" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 09:35:19 user nova-compute[75122]: DEBUG nova.network.neutron [req-9d1bcb16-c90f-4f1c-a698-3190a62307aa req-22be02e4-b8ed-44a7-86d5-4a0dd2661758 service nova] [instance: 00270cc2-4f5b-4f64-8f88-31f21e3b3950] Refreshing network info cache for port bb6552dc-ebef-427a-beea-b41083f05e70 {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 09:35:19 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-dcebddcd-993d-47ac-8506-44af7c18a2ea tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] [instance: 00270cc2-4f5b-4f64-8f88-31f21e3b3950] Start _get_guest_xml network_info=[{"id": "bb6552dc-ebef-427a-beea-b41083f05e70", "address": "fa:16:3e:44:9c:f9", "network": {"id": "c2062f64-d925-42d2-9687-5d2511ef6697", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1134087048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eeff24cb28f5481fa3941ba399ce82ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb6552dc-eb", "ovs_interfaceid": "bb6552dc-ebef-427a-beea-b41083f05e70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T09:26:31Z,direct_url=<?>,disk_format='qcow2',id=5e862cfe-47b8-4725-8292-65761ee6d0f5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9c57733cb41847c0b4ad31519c382e5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T09:26:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '5e862cfe-47b8-4725-8292-65761ee6d0f5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75122) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 09:35:19 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-dcebddcd-993d-47ac-8506-44af7c18a2ea tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 09:35:19 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-dcebddcd-993d-47ac-8506-44af7c18a2ea tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 09:35:19 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-dcebddcd-993d-47ac-8506-44af7c18a2ea tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75122) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 09:35:19 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-dcebddcd-993d-47ac-8506-44af7c18a2ea tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] CPU controller missing on host. {{(pid=75122) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 09:35:19 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-dcebddcd-993d-47ac-8506-44af7c18a2ea tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75122) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 09:35:19 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-dcebddcd-993d-47ac-8506-44af7c18a2ea tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] CPU controller found on host. {{(pid=75122) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 09:35:19 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-dcebddcd-993d-47ac-8506-44af7c18a2ea tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75122) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 09:35:19 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-dcebddcd-993d-47ac-8506-44af7c18a2ea tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T09:26:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T09:26:31Z,direct_url=<?>,disk_format='qcow2',id=5e862cfe-47b8-4725-8292-65761ee6d0f5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9c57733cb41847c0b4ad31519c382e5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T09:26:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 09:35:19 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-dcebddcd-993d-47ac-8506-44af7c18a2ea tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Flavor limits 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 09:35:19 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-dcebddcd-993d-47ac-8506-44af7c18a2ea tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Image limits 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 09:35:19 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-dcebddcd-993d-47ac-8506-44af7c18a2ea tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Flavor pref 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 09:35:19 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-dcebddcd-993d-47ac-8506-44af7c18a2ea tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Image pref 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 09:35:19 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-dcebddcd-993d-47ac-8506-44af7c18a2ea tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 09:35:19 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-dcebddcd-993d-47ac-8506-44af7c18a2ea tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 09:35:19 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-dcebddcd-993d-47ac-8506-44af7c18a2ea tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75122) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 09:35:19 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-dcebddcd-993d-47ac-8506-44af7c18a2ea tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Got 1 possible topologies {{(pid=75122) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 09:35:19 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-dcebddcd-993d-47ac-8506-44af7c18a2ea tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 09:35:19 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-dcebddcd-993d-47ac-8506-44af7c18a2ea tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 09:35:19 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-dcebddcd-993d-47ac-8506-44af7c18a2ea tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T09:35:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1776429290',display_name='tempest-ServerRescueNegativeTestJSON-server-1776429290',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1776429290',id=17,image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eeff24cb28f5481fa3941ba399ce82ff',ramdisk_id='',reservation_id='r-rom8e8vs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-59965354',owner_user_name='tempest-ServerRescueNegativeTestJSON-59965354-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T09:35:18Z,user_data=None,user_id='d05ef35b07ba45afb142f406d418d8d4',uuid=00270cc2-4f5b-4f64-8f88-31f21e3b3950,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bb6552dc-ebef-427a-beea-b41083f05e70", "address": "fa:16:3e:44:9c:f9", "network": {"id": "c2062f64-d925-42d2-9687-5d2511ef6697", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1134087048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eeff24cb28f5481fa3941ba399ce82ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb6552dc-eb", "ovs_interfaceid": "bb6552dc-ebef-427a-beea-b41083f05e70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75122) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 09:35:19 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-dcebddcd-993d-47ac-8506-44af7c18a2ea tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Converting VIF {"id": "bb6552dc-ebef-427a-beea-b41083f05e70", "address": "fa:16:3e:44:9c:f9", "network": {"id": "c2062f64-d925-42d2-9687-5d2511ef6697", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1134087048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eeff24cb28f5481fa3941ba399ce82ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb6552dc-eb", "ovs_interfaceid": "bb6552dc-ebef-427a-beea-b41083f05e70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 09:35:19 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-dcebddcd-993d-47ac-8506-44af7c18a2ea tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:9c:f9,bridge_name='br-int',has_traffic_filtering=True,id=bb6552dc-ebef-427a-beea-b41083f05e70,network=Network(c2062f64-d925-42d2-9687-5d2511ef6697),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb6552dc-eb') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 09:35:19 user nova-compute[75122]: DEBUG nova.objects.instance [None req-dcebddcd-993d-47ac-8506-44af7c18a2ea tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Lazy-loading 'pci_devices' on Instance uuid 00270cc2-4f5b-4f64-8f88-31f21e3b3950 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:35:19 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:35:19 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:35:19 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Starting heal instance info cache {{(pid=75122) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 09:35:19 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Rebuilding the list of instances to heal {{(pid=75122) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 09:35:19 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-dcebddcd-993d-47ac-8506-44af7c18a2ea tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] [instance: 00270cc2-4f5b-4f64-8f88-31f21e3b3950] End _get_guest_xml xml=<domain type="kvm">
Nov 15 09:35:19 user nova-compute[75122]:   <uuid>00270cc2-4f5b-4f64-8f88-31f21e3b3950</uuid>
Nov 15 09:35:19 user nova-compute[75122]:   <name>instance-00000011</name>
Nov 15 09:35:19 user nova-compute[75122]:   <memory>524288</memory>
Nov 15 09:35:19 user nova-compute[75122]:   <vcpu>1</vcpu>
Nov 15 09:35:19 user nova-compute[75122]:   <metadata>
Nov 15 09:35:19 user nova-compute[75122]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 09:35:19 user nova-compute[75122]:       <nova:package version="0.0.0"/>
Nov 15 09:35:19 user nova-compute[75122]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1776429290</nova:name>
Nov 15 09:35:19 user nova-compute[75122]:       <nova:creationTime>2023-11-15 09:35:19</nova:creationTime>
Nov 15 09:35:19 user nova-compute[75122]:       <nova:flavor name="m1.tiny">
Nov 15 09:35:19 user nova-compute[75122]:         <nova:memory>512</nova:memory>
Nov 15 09:35:19 user nova-compute[75122]:         <nova:disk>1</nova:disk>
Nov 15 09:35:19 user nova-compute[75122]:         <nova:swap>0</nova:swap>
Nov 15 09:35:19 user nova-compute[75122]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 09:35:19 user nova-compute[75122]:         <nova:vcpus>1</nova:vcpus>
Nov 15 09:35:19 user nova-compute[75122]:       </nova:flavor>
Nov 15 09:35:19 user nova-compute[75122]:       <nova:owner>
Nov 15 09:35:19 user nova-compute[75122]:         <nova:user uuid="d05ef35b07ba45afb142f406d418d8d4">tempest-ServerRescueNegativeTestJSON-59965354-project-member</nova:user>
Nov 15 09:35:19 user nova-compute[75122]:         <nova:project uuid="eeff24cb28f5481fa3941ba399ce82ff">tempest-ServerRescueNegativeTestJSON-59965354</nova:project>
Nov 15 09:35:19 user nova-compute[75122]:       </nova:owner>
Nov 15 09:35:19 user nova-compute[75122]:       <nova:root type="image" uuid="5e862cfe-47b8-4725-8292-65761ee6d0f5"/>
Nov 15 09:35:19 user nova-compute[75122]:       <nova:ports>
Nov 15 09:35:19 user nova-compute[75122]:         <nova:port uuid="bb6552dc-ebef-427a-beea-b41083f05e70">
Nov 15 09:35:19 user nova-compute[75122]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 15 09:35:19 user nova-compute[75122]:         </nova:port>
Nov 15 09:35:19 user nova-compute[75122]:       </nova:ports>
Nov 15 09:35:19 user nova-compute[75122]:     </nova:instance>
Nov 15 09:35:19 user nova-compute[75122]:   </metadata>
Nov 15 09:35:19 user nova-compute[75122]:   <sysinfo type="smbios">
Nov 15 09:35:19 user nova-compute[75122]:     <system>
Nov 15 09:35:19 user nova-compute[75122]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 09:35:19 user nova-compute[75122]:       <entry name="product">OpenStack Nova</entry>
Nov 15 09:35:19 user nova-compute[75122]:       <entry name="version">0.0.0</entry>
Nov 15 09:35:19 user nova-compute[75122]:       <entry name="serial">00270cc2-4f5b-4f64-8f88-31f21e3b3950</entry>
Nov 15 09:35:19 user nova-compute[75122]:       <entry name="uuid">00270cc2-4f5b-4f64-8f88-31f21e3b3950</entry>
Nov 15 09:35:19 user nova-compute[75122]:       <entry name="family">Virtual Machine</entry>
Nov 15 09:35:19 user nova-compute[75122]:     </system>
Nov 15 09:35:19 user nova-compute[75122]:   </sysinfo>
Nov 15 09:35:19 user nova-compute[75122]:   <os>
Nov 15 09:35:19 user nova-compute[75122]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 09:35:19 user nova-compute[75122]:     <boot dev="hd"/>
Nov 15 09:35:19 user nova-compute[75122]:     <smbios mode="sysinfo"/>
Nov 15 09:35:19 user nova-compute[75122]:   </os>
Nov 15 09:35:19 user nova-compute[75122]:   <features>
Nov 15 09:35:19 user nova-compute[75122]:     <acpi/>
Nov 15 09:35:19 user nova-compute[75122]:     <apic/>
Nov 15 09:35:19 user nova-compute[75122]:     <vmcoreinfo/>
Nov 15 09:35:19 user nova-compute[75122]:   </features>
Nov 15 09:35:19 user nova-compute[75122]:   <clock offset="utc">
Nov 15 09:35:19 user nova-compute[75122]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 09:35:19 user nova-compute[75122]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 09:35:19 user nova-compute[75122]:     <timer name="hpet" present="no"/>
Nov 15 09:35:19 user nova-compute[75122]:   </clock>
Nov 15 09:35:19 user nova-compute[75122]:   <cpu mode="custom" match="exact">
Nov 15 09:35:19 user nova-compute[75122]:     <model>Nehalem</model>
Nov 15 09:35:19 user nova-compute[75122]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 09:35:19 user nova-compute[75122]:   </cpu>
Nov 15 09:35:19 user nova-compute[75122]:   <devices>
Nov 15 09:35:19 user nova-compute[75122]:     <disk type="file" device="disk">
Nov 15 09:35:19 user nova-compute[75122]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 09:35:19 user nova-compute[75122]:       <source file="/opt/stack/data/nova/instances/00270cc2-4f5b-4f64-8f88-31f21e3b3950/disk"/>
Nov 15 09:35:19 user nova-compute[75122]:       <target dev="vda" bus="virtio"/>
Nov 15 09:35:19 user nova-compute[75122]:     </disk>
Nov 15 09:35:19 user nova-compute[75122]:     <interface type="ethernet">
Nov 15 09:35:19 user nova-compute[75122]:       <mac address="fa:16:3e:44:9c:f9"/>
Nov 15 09:35:19 user nova-compute[75122]:       <model type="virtio"/>
Nov 15 09:35:19 user nova-compute[75122]:       <mtu size="1442"/>
Nov 15 09:35:19 user nova-compute[75122]:       <target dev="tapbb6552dc-eb"/>
Nov 15 09:35:19 user nova-compute[75122]:     </interface>
Nov 15 09:35:19 user nova-compute[75122]:     <serial type="pty">
Nov 15 09:35:19 user nova-compute[75122]:       <log file="/opt/stack/data/nova/instances/00270cc2-4f5b-4f64-8f88-31f21e3b3950/console.log" append="off"/>
Nov 15 09:35:19 user nova-compute[75122]:     </serial>
Nov 15 09:35:19 user nova-compute[75122]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 09:35:19 user nova-compute[75122]:     <video>
Nov 15 09:35:19 user nova-compute[75122]:       <model type="virtio"/>
Nov 15 09:35:19 user nova-compute[75122]:     </video>
Nov 15 09:35:19 user nova-compute[75122]:     <rng model="virtio">
Nov 15 09:35:19 user nova-compute[75122]:       <backend model="random">/dev/urandom</backend>
Nov 15 09:35:19 user nova-compute[75122]:     </rng>
Nov 15 09:35:19 user nova-compute[75122]:     <controller type="usb" index="0" model="none"/>
Nov 15 09:35:19 user nova-compute[75122]:     <memballoon model="virtio">
Nov 15 09:35:19 user nova-compute[75122]:       <stats period="10"/>
Nov 15 09:35:19 user nova-compute[75122]:     </memballoon>
Nov 15 09:35:19 user nova-compute[75122]:   </devices>
Nov 15 09:35:19 user nova-compute[75122]: </domain>
Nov 15 09:35:19 user nova-compute[75122]:  {{(pid=75122) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 09:35:19 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-dcebddcd-993d-47ac-8506-44af7c18a2ea tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T09:35:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1776429290',display_name='tempest-ServerRescueNegativeTestJSON-server-1776429290',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1776429290',id=17,image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eeff24cb28f5481fa3941ba399ce82ff',ramdisk_id='',reservation_id='r-rom8e8vs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-59965354',owner_user_name='tempest-ServerRescueNegativeTestJSON-59965354-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T09:35:18Z,user_data=None,user_id='d05ef35b07ba45afb142f406d418d8d4',uuid=00270cc2-4f5b-4f64-8f88-31f21e3b3950,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bb6552dc-ebef-427a-beea-b41083f05e70", "address": "fa:16:3e:44:9c:f9", "network": {"id": "c2062f64-d925-42d2-9687-5d2511ef6697", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1134087048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eeff24cb28f5481fa3941ba399ce82ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb6552dc-eb", "ovs_interfaceid": "bb6552dc-ebef-427a-beea-b41083f05e70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 09:35:19 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-dcebddcd-993d-47ac-8506-44af7c18a2ea tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Converting VIF {"id": "bb6552dc-ebef-427a-beea-b41083f05e70", "address": "fa:16:3e:44:9c:f9", "network": {"id": "c2062f64-d925-42d2-9687-5d2511ef6697", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1134087048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eeff24cb28f5481fa3941ba399ce82ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb6552dc-eb", "ovs_interfaceid": "bb6552dc-ebef-427a-beea-b41083f05e70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 09:35:19 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-dcebddcd-993d-47ac-8506-44af7c18a2ea tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:9c:f9,bridge_name='br-int',has_traffic_filtering=True,id=bb6552dc-ebef-427a-beea-b41083f05e70,network=Network(c2062f64-d925-42d2-9687-5d2511ef6697),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb6552dc-eb') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 09:35:19 user nova-compute[75122]: DEBUG os_vif [None req-dcebddcd-993d-47ac-8506-44af7c18a2ea tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:9c:f9,bridge_name='br-int',has_traffic_filtering=True,id=bb6552dc-ebef-427a-beea-b41083f05e70,network=Network(c2062f64-d925-42d2-9687-5d2511ef6697),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb6552dc-eb') {{(pid=75122) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 09:35:19 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:35:19 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:35:19 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 09:35:19 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:35:19 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a40e6944-0369-5f8d-95bd-4ac66f301429', '_type': 'linux-noop'}}, row=False) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:35:19 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:35:19 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:35:19 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:35:19 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] [instance: fd9d52bb-6248-48e6-a798-6dbdaaa68cbc] Skipping network cache update for instance because it is Building. {{(pid=75122) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 15 09:35:19 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] [instance: 00270cc2-4f5b-4f64-8f88-31f21e3b3950] Skipping network cache update for instance because it is Building. {{(pid=75122) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 15 09:35:19 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:35:19 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbb6552dc-eb, may_exist=True, interface_attrs={}) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:35:19 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbb6552dc-eb, col_values=(('qos', UUID('2540f2fe-70ec-4268-bd64-addcfa5b8f83')),), if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:35:19 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbb6552dc-eb, col_values=(('external_ids', {'iface-id': 'bb6552dc-ebef-427a-beea-b41083f05e70', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:44:9c:f9', 'vm-uuid': '00270cc2-4f5b-4f64-8f88-31f21e3b3950'}),), if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:35:19 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:35:19 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:35:19 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:35:19 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:35:19 user nova-compute[75122]: INFO os_vif [None req-dcebddcd-993d-47ac-8506-44af7c18a2ea tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:9c:f9,bridge_name='br-int',has_traffic_filtering=True,id=bb6552dc-ebef-427a-beea-b41083f05e70,network=Network(c2062f64-d925-42d2-9687-5d2511ef6697),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb6552dc-eb')
Nov 15 09:35:20 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "refresh_cache-ee961d5a-e0d1-4931-9293-eefbe638097a" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 09:35:20 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquired lock "refresh_cache-ee961d5a-e0d1-4931-9293-eefbe638097a" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 09:35:20 user nova-compute[75122]: DEBUG nova.network.neutron [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] [instance: ee961d5a-e0d1-4931-9293-eefbe638097a] Forcefully refreshing network info cache for instance {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 09:35:20 user nova-compute[75122]: DEBUG nova.objects.instance [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lazy-loading 'info_cache' on Instance uuid ee961d5a-e0d1-4931-9293-eefbe638097a {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:35:20 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-dcebddcd-993d-47ac-8506-44af7c18a2ea tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] No BDM found with device name vda, not building metadata. {{(pid=75122) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 09:35:20 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-dcebddcd-993d-47ac-8506-44af7c18a2ea tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] No VIF found with MAC fa:16:3e:44:9c:f9, not building metadata {{(pid=75122) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 09:35:20 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:35:20 user nova-compute[75122]: DEBUG nova.network.neutron [req-9d1bcb16-c90f-4f1c-a698-3190a62307aa req-22be02e4-b8ed-44a7-86d5-4a0dd2661758 service nova] [instance: 00270cc2-4f5b-4f64-8f88-31f21e3b3950] Updated VIF entry in instance network info cache for port bb6552dc-ebef-427a-beea-b41083f05e70. {{(pid=75122) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 09:35:20 user nova-compute[75122]: DEBUG nova.network.neutron [req-9d1bcb16-c90f-4f1c-a698-3190a62307aa req-22be02e4-b8ed-44a7-86d5-4a0dd2661758 service nova] [instance: 00270cc2-4f5b-4f64-8f88-31f21e3b3950] Updating instance_info_cache with network_info: [{"id": "bb6552dc-ebef-427a-beea-b41083f05e70", "address": "fa:16:3e:44:9c:f9", "network": {"id": "c2062f64-d925-42d2-9687-5d2511ef6697", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1134087048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eeff24cb28f5481fa3941ba399ce82ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb6552dc-eb", "ovs_interfaceid": "bb6552dc-ebef-427a-beea-b41083f05e70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:35:20 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-9d1bcb16-c90f-4f1c-a698-3190a62307aa req-22be02e4-b8ed-44a7-86d5-4a0dd2661758 service nova] Releasing lock "refresh_cache-00270cc2-4f5b-4f64-8f88-31f21e3b3950" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 09:35:20 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:35:20 user nova-compute[75122]: DEBUG nova.network.neutron [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] [instance: ee961d5a-e0d1-4931-9293-eefbe638097a] Updating instance_info_cache with network_info: [{"id": "ae8a9c5e-17d1-4aa9-b3fa-b829d1dc6fd2", "address": "fa:16:3e:7d:98:85", "network": {"id": "44caed16-406b-4a76-966a-0dc42b26f133", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-465582303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d672b8845fa849d99e328521d3d1715b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae8a9c5e-17", "ovs_interfaceid": "ae8a9c5e-17d1-4aa9-b3fa-b829d1dc6fd2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:35:20 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:35:20 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:35:20 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:35:20 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Releasing lock "refresh_cache-ee961d5a-e0d1-4931-9293-eefbe638097a" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 09:35:20 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] [instance: ee961d5a-e0d1-4931-9293-eefbe638097a] Updated the network info_cache for instance {{(pid=75122) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 09:35:20 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:35:21 user nova-compute[75122]: DEBUG nova.compute.manager [req-f3d594ee-4efa-40cb-bfab-f03f9c59b43e req-fd5a4e14-4c78-471e-917b-47b69e9c5f71 service nova] [instance: fd9d52bb-6248-48e6-a798-6dbdaaa68cbc] Received event network-vif-plugged-f6892701-aba2-4c9a-88bd-996d00963301 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:35:21 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-f3d594ee-4efa-40cb-bfab-f03f9c59b43e req-fd5a4e14-4c78-471e-917b-47b69e9c5f71 service nova] Acquiring lock "fd9d52bb-6248-48e6-a798-6dbdaaa68cbc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:35:21 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-f3d594ee-4efa-40cb-bfab-f03f9c59b43e req-fd5a4e14-4c78-471e-917b-47b69e9c5f71 service nova] Lock "fd9d52bb-6248-48e6-a798-6dbdaaa68cbc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:35:21 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-f3d594ee-4efa-40cb-bfab-f03f9c59b43e req-fd5a4e14-4c78-471e-917b-47b69e9c5f71 service nova] Lock "fd9d52bb-6248-48e6-a798-6dbdaaa68cbc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:35:21 user nova-compute[75122]: DEBUG nova.compute.manager [req-f3d594ee-4efa-40cb-bfab-f03f9c59b43e req-fd5a4e14-4c78-471e-917b-47b69e9c5f71 service nova] [instance: fd9d52bb-6248-48e6-a798-6dbdaaa68cbc] No waiting events found dispatching network-vif-plugged-f6892701-aba2-4c9a-88bd-996d00963301 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:35:21 user nova-compute[75122]: WARNING nova.compute.manager [req-f3d594ee-4efa-40cb-bfab-f03f9c59b43e req-fd5a4e14-4c78-471e-917b-47b69e9c5f71 service nova] [instance: fd9d52bb-6248-48e6-a798-6dbdaaa68cbc] Received unexpected event network-vif-plugged-f6892701-aba2-4c9a-88bd-996d00963301 for instance with vm_state building and task_state spawning.
Nov 15 09:35:21 user nova-compute[75122]: DEBUG nova.compute.manager [req-f3d594ee-4efa-40cb-bfab-f03f9c59b43e req-fd5a4e14-4c78-471e-917b-47b69e9c5f71 service nova] [instance: fd9d52bb-6248-48e6-a798-6dbdaaa68cbc] Received event network-vif-plugged-f6892701-aba2-4c9a-88bd-996d00963301 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:35:21 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-f3d594ee-4efa-40cb-bfab-f03f9c59b43e req-fd5a4e14-4c78-471e-917b-47b69e9c5f71 service nova] Acquiring lock "fd9d52bb-6248-48e6-a798-6dbdaaa68cbc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:35:21 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-f3d594ee-4efa-40cb-bfab-f03f9c59b43e req-fd5a4e14-4c78-471e-917b-47b69e9c5f71 service nova] Lock "fd9d52bb-6248-48e6-a798-6dbdaaa68cbc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:35:21 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-f3d594ee-4efa-40cb-bfab-f03f9c59b43e req-fd5a4e14-4c78-471e-917b-47b69e9c5f71 service nova] Lock "fd9d52bb-6248-48e6-a798-6dbdaaa68cbc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:35:21 user nova-compute[75122]: DEBUG nova.compute.manager [req-f3d594ee-4efa-40cb-bfab-f03f9c59b43e req-fd5a4e14-4c78-471e-917b-47b69e9c5f71 service nova] [instance: fd9d52bb-6248-48e6-a798-6dbdaaa68cbc] No waiting events found dispatching network-vif-plugged-f6892701-aba2-4c9a-88bd-996d00963301 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:35:21 user nova-compute[75122]: WARNING nova.compute.manager [req-f3d594ee-4efa-40cb-bfab-f03f9c59b43e req-fd5a4e14-4c78-471e-917b-47b69e9c5f71 service nova] [instance: fd9d52bb-6248-48e6-a798-6dbdaaa68cbc] Received unexpected event network-vif-plugged-f6892701-aba2-4c9a-88bd-996d00963301 for instance with vm_state building and task_state spawning.
Nov 15 09:35:21 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:35:21 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:35:21 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:35:22 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:35:22 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:35:23 user nova-compute[75122]: DEBUG nova.compute.manager [req-a925e89f-1e35-4ff8-9893-11e28520fdf6 req-16b8f7e6-2654-47e3-99d1-bbb2d71abab0 service nova] [instance: 00270cc2-4f5b-4f64-8f88-31f21e3b3950] Received event network-vif-plugged-bb6552dc-ebef-427a-beea-b41083f05e70 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:35:23 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-a925e89f-1e35-4ff8-9893-11e28520fdf6 req-16b8f7e6-2654-47e3-99d1-bbb2d71abab0 service nova] Acquiring lock "00270cc2-4f5b-4f64-8f88-31f21e3b3950-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:35:23 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-a925e89f-1e35-4ff8-9893-11e28520fdf6 req-16b8f7e6-2654-47e3-99d1-bbb2d71abab0 service nova] Lock "00270cc2-4f5b-4f64-8f88-31f21e3b3950-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:35:23 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-a925e89f-1e35-4ff8-9893-11e28520fdf6 req-16b8f7e6-2654-47e3-99d1-bbb2d71abab0 service nova] Lock "00270cc2-4f5b-4f64-8f88-31f21e3b3950-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:35:23 user nova-compute[75122]: DEBUG nova.compute.manager [req-a925e89f-1e35-4ff8-9893-11e28520fdf6 req-16b8f7e6-2654-47e3-99d1-bbb2d71abab0 service nova] [instance: 00270cc2-4f5b-4f64-8f88-31f21e3b3950] No waiting events found dispatching network-vif-plugged-bb6552dc-ebef-427a-beea-b41083f05e70 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:35:23 user nova-compute[75122]: WARNING nova.compute.manager [req-a925e89f-1e35-4ff8-9893-11e28520fdf6 req-16b8f7e6-2654-47e3-99d1-bbb2d71abab0 service nova] [instance: 00270cc2-4f5b-4f64-8f88-31f21e3b3950] Received unexpected event network-vif-plugged-bb6552dc-ebef-427a-beea-b41083f05e70 for instance with vm_state building and task_state spawning.
Nov 15 09:35:23 user nova-compute[75122]: DEBUG nova.compute.manager [req-a925e89f-1e35-4ff8-9893-11e28520fdf6 req-16b8f7e6-2654-47e3-99d1-bbb2d71abab0 service nova] [instance: 00270cc2-4f5b-4f64-8f88-31f21e3b3950] Received event network-vif-plugged-bb6552dc-ebef-427a-beea-b41083f05e70 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:35:23 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-a925e89f-1e35-4ff8-9893-11e28520fdf6 req-16b8f7e6-2654-47e3-99d1-bbb2d71abab0 service nova] Acquiring lock "00270cc2-4f5b-4f64-8f88-31f21e3b3950-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:35:23 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-a925e89f-1e35-4ff8-9893-11e28520fdf6 req-16b8f7e6-2654-47e3-99d1-bbb2d71abab0 service nova] Lock "00270cc2-4f5b-4f64-8f88-31f21e3b3950-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:35:23 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-a925e89f-1e35-4ff8-9893-11e28520fdf6 req-16b8f7e6-2654-47e3-99d1-bbb2d71abab0 service nova] Lock "00270cc2-4f5b-4f64-8f88-31f21e3b3950-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:35:23 user nova-compute[75122]: DEBUG nova.compute.manager [req-a925e89f-1e35-4ff8-9893-11e28520fdf6 req-16b8f7e6-2654-47e3-99d1-bbb2d71abab0 service nova] [instance: 00270cc2-4f5b-4f64-8f88-31f21e3b3950] No waiting events found dispatching network-vif-plugged-bb6552dc-ebef-427a-beea-b41083f05e70 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:35:23 user nova-compute[75122]: WARNING nova.compute.manager [req-a925e89f-1e35-4ff8-9893-11e28520fdf6 req-16b8f7e6-2654-47e3-99d1-bbb2d71abab0 service nova] [instance: 00270cc2-4f5b-4f64-8f88-31f21e3b3950] Received unexpected event network-vif-plugged-bb6552dc-ebef-427a-beea-b41083f05e70 for instance with vm_state building and task_state spawning.
Nov 15 09:35:24 user nova-compute[75122]: DEBUG nova.compute.manager [None req-9d4e7731-cbaa-4623-8177-57f4294bfc8f tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] [instance: fd9d52bb-6248-48e6-a798-6dbdaaa68cbc] Instance event wait completed in 0 seconds for  {{(pid=75122) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 09:35:24 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-9d4e7731-cbaa-4623-8177-57f4294bfc8f tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] [instance: fd9d52bb-6248-48e6-a798-6dbdaaa68cbc] Guest created on hypervisor {{(pid=75122) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 09:35:24 user nova-compute[75122]: INFO nova.virt.libvirt.driver [-] [instance: fd9d52bb-6248-48e6-a798-6dbdaaa68cbc] Instance spawned successfully.
Nov 15 09:35:24 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-9d4e7731-cbaa-4623-8177-57f4294bfc8f tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] [instance: fd9d52bb-6248-48e6-a798-6dbdaaa68cbc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 09:35:24 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-9d4e7731-cbaa-4623-8177-57f4294bfc8f tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] [instance: fd9d52bb-6248-48e6-a798-6dbdaaa68cbc] Found default for hw_cdrom_bus of ide {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:35:24 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-9d4e7731-cbaa-4623-8177-57f4294bfc8f tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] [instance: fd9d52bb-6248-48e6-a798-6dbdaaa68cbc] Found default for hw_disk_bus of virtio {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:35:24 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-9d4e7731-cbaa-4623-8177-57f4294bfc8f tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] [instance: fd9d52bb-6248-48e6-a798-6dbdaaa68cbc] Found default for hw_input_bus of None {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:35:24 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-9d4e7731-cbaa-4623-8177-57f4294bfc8f tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] [instance: fd9d52bb-6248-48e6-a798-6dbdaaa68cbc] Found default for hw_pointer_model of None {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:35:24 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-9d4e7731-cbaa-4623-8177-57f4294bfc8f tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] [instance: fd9d52bb-6248-48e6-a798-6dbdaaa68cbc] Found default for hw_video_model of virtio {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:35:24 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-9d4e7731-cbaa-4623-8177-57f4294bfc8f tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] [instance: fd9d52bb-6248-48e6-a798-6dbdaaa68cbc] Found default for hw_vif_model of virtio {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:35:24 user nova-compute[75122]: INFO nova.compute.manager [None req-9d4e7731-cbaa-4623-8177-57f4294bfc8f tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] [instance: fd9d52bb-6248-48e6-a798-6dbdaaa68cbc] Took 8.13 seconds to spawn the instance on the hypervisor.
Nov 15 09:35:24 user nova-compute[75122]: DEBUG nova.compute.manager [None req-9d4e7731-cbaa-4623-8177-57f4294bfc8f tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] [instance: fd9d52bb-6248-48e6-a798-6dbdaaa68cbc] Checking state {{(pid=75122) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 09:35:24 user nova-compute[75122]: INFO nova.compute.manager [None req-9d4e7731-cbaa-4623-8177-57f4294bfc8f tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] [instance: fd9d52bb-6248-48e6-a798-6dbdaaa68cbc] Took 9.87 seconds to build instance.
Nov 15 09:35:24 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-9d4e7731-cbaa-4623-8177-57f4294bfc8f tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Lock "fd9d52bb-6248-48e6-a798-6dbdaaa68cbc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.999s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:35:24 user nova-compute[75122]: DEBUG nova.compute.manager [None req-dcebddcd-993d-47ac-8506-44af7c18a2ea tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] [instance: 00270cc2-4f5b-4f64-8f88-31f21e3b3950] Instance event wait completed in 0 seconds for  {{(pid=75122) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 09:35:24 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-dcebddcd-993d-47ac-8506-44af7c18a2ea tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] [instance: 00270cc2-4f5b-4f64-8f88-31f21e3b3950] Guest created on hypervisor {{(pid=75122) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 09:35:24 user nova-compute[75122]: INFO nova.virt.libvirt.driver [-] [instance: 00270cc2-4f5b-4f64-8f88-31f21e3b3950] Instance spawned successfully.
Nov 15 09:35:24 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-dcebddcd-993d-47ac-8506-44af7c18a2ea tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] [instance: 00270cc2-4f5b-4f64-8f88-31f21e3b3950] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 09:35:24 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-dcebddcd-993d-47ac-8506-44af7c18a2ea tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] [instance: 00270cc2-4f5b-4f64-8f88-31f21e3b3950] Found default for hw_cdrom_bus of ide {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:35:24 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-dcebddcd-993d-47ac-8506-44af7c18a2ea tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] [instance: 00270cc2-4f5b-4f64-8f88-31f21e3b3950] Found default for hw_disk_bus of virtio {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:35:24 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-dcebddcd-993d-47ac-8506-44af7c18a2ea tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] [instance: 00270cc2-4f5b-4f64-8f88-31f21e3b3950] Found default for hw_input_bus of None {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:35:24 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-dcebddcd-993d-47ac-8506-44af7c18a2ea tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] [instance: 00270cc2-4f5b-4f64-8f88-31f21e3b3950] Found default for hw_pointer_model of None {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:35:24 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-dcebddcd-993d-47ac-8506-44af7c18a2ea tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] [instance: 00270cc2-4f5b-4f64-8f88-31f21e3b3950] Found default for hw_video_model of virtio {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:35:24 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-dcebddcd-993d-47ac-8506-44af7c18a2ea tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] [instance: 00270cc2-4f5b-4f64-8f88-31f21e3b3950] Found default for hw_vif_model of virtio {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:35:24 user nova-compute[75122]: INFO nova.compute.manager [None req-dcebddcd-993d-47ac-8506-44af7c18a2ea tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] [instance: 00270cc2-4f5b-4f64-8f88-31f21e3b3950] Took 6.19 seconds to spawn the instance on the hypervisor.
Nov 15 09:35:24 user nova-compute[75122]: DEBUG nova.compute.manager [None req-dcebddcd-993d-47ac-8506-44af7c18a2ea tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] [instance: 00270cc2-4f5b-4f64-8f88-31f21e3b3950] Checking state {{(pid=75122) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 09:35:24 user nova-compute[75122]: INFO nova.compute.manager [None req-dcebddcd-993d-47ac-8506-44af7c18a2ea tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] [instance: 00270cc2-4f5b-4f64-8f88-31f21e3b3950] Took 9.01 seconds to build instance.
Nov 15 09:35:24 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-dcebddcd-993d-47ac-8506-44af7c18a2ea tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Lock "00270cc2-4f5b-4f64-8f88-31f21e3b3950" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.175s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:35:24 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:35:25 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:35:26 user nova-compute[75122]: DEBUG nova.compute.manager [req-e576ad67-7595-45e1-97f3-234add20b434 req-97674566-e5ce-443c-a602-95b3e006ed28 service nova] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] Received event network-changed-7febe2f1-4891-4ad4-ac59-58edfd3d2f03 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:35:26 user nova-compute[75122]: DEBUG nova.compute.manager [req-e576ad67-7595-45e1-97f3-234add20b434 req-97674566-e5ce-443c-a602-95b3e006ed28 service nova] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] Refreshing instance network info cache due to event network-changed-7febe2f1-4891-4ad4-ac59-58edfd3d2f03. {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 09:35:26 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-e576ad67-7595-45e1-97f3-234add20b434 req-97674566-e5ce-443c-a602-95b3e006ed28 service nova] Acquiring lock "refresh_cache-742d64db-c555-4517-8ec9-cef02f09a6e0" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 09:35:26 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-e576ad67-7595-45e1-97f3-234add20b434 req-97674566-e5ce-443c-a602-95b3e006ed28 service nova] Acquired lock "refresh_cache-742d64db-c555-4517-8ec9-cef02f09a6e0" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 09:35:26 user nova-compute[75122]: DEBUG nova.network.neutron [req-e576ad67-7595-45e1-97f3-234add20b434 req-97674566-e5ce-443c-a602-95b3e006ed28 service nova] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] Refreshing network info cache for port 7febe2f1-4891-4ad4-ac59-58edfd3d2f03 {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 09:35:27 user nova-compute[75122]: DEBUG nova.network.neutron [req-e576ad67-7595-45e1-97f3-234add20b434 req-97674566-e5ce-443c-a602-95b3e006ed28 service nova] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] Updated VIF entry in instance network info cache for port 7febe2f1-4891-4ad4-ac59-58edfd3d2f03. {{(pid=75122) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 09:35:27 user nova-compute[75122]: DEBUG nova.network.neutron [req-e576ad67-7595-45e1-97f3-234add20b434 req-97674566-e5ce-443c-a602-95b3e006ed28 service nova] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] Updating instance_info_cache with network_info: [{"id": "7febe2f1-4891-4ad4-ac59-58edfd3d2f03", "address": "fa:16:3e:ec:cb:a9", "network": {"id": "63134c25-66d5-4030-bbf0-b2a2e259df84", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2071889805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "641f0acd05d8403882a4f6b1b28e9269", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7febe2f1-48", "ovs_interfaceid": "7febe2f1-4891-4ad4-ac59-58edfd3d2f03", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d8bfb09a-3733-4176-beec-aaa512b4ed8c", "address": "fa:16:3e:89:bb:49", "network": {"id": "3bb75c40-fc07-4bf2-8a8a-9f58cd457b67", "bridge": "br-int", "label": "tempest-device-tagging-net1-1158401388", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.130", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "641f0acd05d8403882a4f6b1b28e9269", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8bfb09a-37", "ovs_interfaceid": "d8bfb09a-3733-4176-beec-aaa512b4ed8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "eaecb293-c647-47d7-8103-6fb8851477f3", "address": "fa:16:3e:3c:b2:b8", "network": {"id": "3bb75c40-fc07-4bf2-8a8a-9f58cd457b67", "bridge": "br-int", "label": "tempest-device-tagging-net1-1158401388", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "641f0acd05d8403882a4f6b1b28e9269", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeaecb293-c6", "ovs_interfaceid": "eaecb293-c647-47d7-8103-6fb8851477f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5ebcafd9-6939-4928-ae2f-38ec38e15876", "address": "fa:16:3e:ec:d2:98", "network": {"id": "3bb75c40-fc07-4bf2-8a8a-9f58cd457b67", "bridge": "br-int", "label": "tempest-device-tagging-net1-1158401388", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.29", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "641f0acd05d8403882a4f6b1b28e9269", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ebcafd9-69", "ovs_interfaceid": "5ebcafd9-6939-4928-ae2f-38ec38e15876", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5bf17322-fd6b-4335-9a8e-56e7cd64e180", "address": "fa:16:3e:c9:4d:28", "network": {"id": "3bb75c40-fc07-4bf2-8a8a-9f58cd457b67", "bridge": "br-int", "label": "tempest-device-tagging-net1-1158401388", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.122", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "641f0acd05d8403882a4f6b1b28e9269", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bf17322-fd", "ovs_interfaceid": "5bf17322-fd6b-4335-9a8e-56e7cd64e180", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "710ae079-0b1c-4c04-bea2-e34fd0d554ae", "address": "fa:16:3e:0e:e7:01", "network": {"id": "b4709ef9-ae05-4eac-b530-da89c65fd367", "bridge": "br-int", "label": "tempest-device-tagging-net2-314948697", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "641f0acd05d8403882a4f6b1b28e9269", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap710ae079-0b", "ovs_interfaceid": "710ae079-0b1c-4c04-bea2-e34fd0d554ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d378cd7b-d582-4062-a714-d4456d71ba5f", "address": "fa:16:3e:e1:90:72", "network": {"id": "b4709ef9-ae05-4eac-b530-da89c65fd367", "bridge": "br-int", "label": "tempest-device-tagging-net2-314948697", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "641f0acd05d8403882a4f6b1b28e9269", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd378cd7b-d5", "ovs_interfaceid": "d378cd7b-d582-4062-a714-d4456d71ba5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:35:27 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-e576ad67-7595-45e1-97f3-234add20b434 req-97674566-e5ce-443c-a602-95b3e006ed28 service nova] Releasing lock "refresh_cache-742d64db-c555-4517-8ec9-cef02f09a6e0" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 09:35:29 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-adc52e27-bb5e-477e-95cd-ba2a925ebaf8 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] Acquiring lock "742d64db-c555-4517-8ec9-cef02f09a6e0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:35:29 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-adc52e27-bb5e-477e-95cd-ba2a925ebaf8 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] Lock "742d64db-c555-4517-8ec9-cef02f09a6e0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:35:29 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-adc52e27-bb5e-477e-95cd-ba2a925ebaf8 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] Acquiring lock "742d64db-c555-4517-8ec9-cef02f09a6e0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:35:29 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-adc52e27-bb5e-477e-95cd-ba2a925ebaf8 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] Lock "742d64db-c555-4517-8ec9-cef02f09a6e0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:35:29 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-adc52e27-bb5e-477e-95cd-ba2a925ebaf8 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] Lock "742d64db-c555-4517-8ec9-cef02f09a6e0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:35:29 user nova-compute[75122]: INFO nova.compute.manager [None req-adc52e27-bb5e-477e-95cd-ba2a925ebaf8 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] Terminating instance
Nov 15 09:35:29 user nova-compute[75122]: DEBUG nova.compute.manager [None req-adc52e27-bb5e-477e-95cd-ba2a925ebaf8 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] Start destroying the instance on the hypervisor. {{(pid=75122) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 09:35:29 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:35:29 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:35:29 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:35:29 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:35:29 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:35:29 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:35:29 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:35:29 user nova-compute[75122]: DEBUG nova.compute.manager [req-e0368888-36ae-4cb6-8afb-cc8496a36c4f req-0713b6cf-69b2-42ea-9c88-796f47d01c4c service nova] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] Received event network-vif-unplugged-7febe2f1-4891-4ad4-ac59-58edfd3d2f03 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:35:29 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-e0368888-36ae-4cb6-8afb-cc8496a36c4f req-0713b6cf-69b2-42ea-9c88-796f47d01c4c service nova] Acquiring lock "742d64db-c555-4517-8ec9-cef02f09a6e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:35:29 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-e0368888-36ae-4cb6-8afb-cc8496a36c4f req-0713b6cf-69b2-42ea-9c88-796f47d01c4c service nova] Lock "742d64db-c555-4517-8ec9-cef02f09a6e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:35:29 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-e0368888-36ae-4cb6-8afb-cc8496a36c4f req-0713b6cf-69b2-42ea-9c88-796f47d01c4c service nova] Lock "742d64db-c555-4517-8ec9-cef02f09a6e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:35:29 user nova-compute[75122]: DEBUG nova.compute.manager [req-e0368888-36ae-4cb6-8afb-cc8496a36c4f req-0713b6cf-69b2-42ea-9c88-796f47d01c4c service nova] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] No waiting events found dispatching network-vif-unplugged-7febe2f1-4891-4ad4-ac59-58edfd3d2f03 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:35:29 user nova-compute[75122]: DEBUG nova.compute.manager [req-e0368888-36ae-4cb6-8afb-cc8496a36c4f req-0713b6cf-69b2-42ea-9c88-796f47d01c4c service nova] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] Received event network-vif-unplugged-7febe2f1-4891-4ad4-ac59-58edfd3d2f03 for instance with task_state deleting. {{(pid=75122) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 09:35:29 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:35:30 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:35:30 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:35:30 user nova-compute[75122]: DEBUG nova.compute.manager [req-0567de3c-4cbf-4ec4-bdb0-41eabcb6dd80 req-194e89d2-0d72-4716-b33f-da488d6dfbb4 service nova] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] Received event network-vif-unplugged-d8bfb09a-3733-4176-beec-aaa512b4ed8c {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:35:30 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-0567de3c-4cbf-4ec4-bdb0-41eabcb6dd80 req-194e89d2-0d72-4716-b33f-da488d6dfbb4 service nova] Acquiring lock "742d64db-c555-4517-8ec9-cef02f09a6e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:35:30 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-0567de3c-4cbf-4ec4-bdb0-41eabcb6dd80 req-194e89d2-0d72-4716-b33f-da488d6dfbb4 service nova] Lock "742d64db-c555-4517-8ec9-cef02f09a6e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:35:30 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-0567de3c-4cbf-4ec4-bdb0-41eabcb6dd80 req-194e89d2-0d72-4716-b33f-da488d6dfbb4 service nova] Lock "742d64db-c555-4517-8ec9-cef02f09a6e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:35:30 user nova-compute[75122]: DEBUG nova.compute.manager [req-0567de3c-4cbf-4ec4-bdb0-41eabcb6dd80 req-194e89d2-0d72-4716-b33f-da488d6dfbb4 service nova] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] No waiting events found dispatching network-vif-unplugged-d8bfb09a-3733-4176-beec-aaa512b4ed8c {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:35:30 user nova-compute[75122]: DEBUG nova.compute.manager [req-0567de3c-4cbf-4ec4-bdb0-41eabcb6dd80 req-194e89d2-0d72-4716-b33f-da488d6dfbb4 service nova] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] Received event network-vif-unplugged-d8bfb09a-3733-4176-beec-aaa512b4ed8c for instance with task_state deleting. {{(pid=75122) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 09:35:30 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:35:30 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:35:30 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:35:30 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:35:30 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:35:30 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:35:30 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:35:30 user nova-compute[75122]: DEBUG nova.compute.manager [req-ca910b4e-3e40-46c1-8fd3-15e745e78d79 req-6c5785fe-245f-439d-8b87-c151642cc09f service nova] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] Received event network-vif-unplugged-5ebcafd9-6939-4928-ae2f-38ec38e15876 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:35:30 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-ca910b4e-3e40-46c1-8fd3-15e745e78d79 req-6c5785fe-245f-439d-8b87-c151642cc09f service nova] Acquiring lock "742d64db-c555-4517-8ec9-cef02f09a6e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:35:30 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-ca910b4e-3e40-46c1-8fd3-15e745e78d79 req-6c5785fe-245f-439d-8b87-c151642cc09f service nova] Lock "742d64db-c555-4517-8ec9-cef02f09a6e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:35:30 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-ca910b4e-3e40-46c1-8fd3-15e745e78d79 req-6c5785fe-245f-439d-8b87-c151642cc09f service nova] Lock "742d64db-c555-4517-8ec9-cef02f09a6e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:35:30 user nova-compute[75122]: DEBUG nova.compute.manager [req-ca910b4e-3e40-46c1-8fd3-15e745e78d79 req-6c5785fe-245f-439d-8b87-c151642cc09f service nova] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] No waiting events found dispatching network-vif-unplugged-5ebcafd9-6939-4928-ae2f-38ec38e15876 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:35:30 user nova-compute[75122]: DEBUG nova.compute.manager [req-ca910b4e-3e40-46c1-8fd3-15e745e78d79 req-6c5785fe-245f-439d-8b87-c151642cc09f service nova] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] Received event network-vif-unplugged-5ebcafd9-6939-4928-ae2f-38ec38e15876 for instance with task_state deleting. {{(pid=75122) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 09:35:30 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:35:30 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:35:30 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:35:30 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:35:31 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:35:31 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:35:31 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:35:31 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:35:31 user nova-compute[75122]: INFO nova.virt.libvirt.driver [-] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] Instance destroyed successfully.
Nov 15 09:35:31 user nova-compute[75122]: DEBUG nova.objects.instance [None req-adc52e27-bb5e-477e-95cd-ba2a925ebaf8 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] Lazy-loading 'resources' on Instance uuid 742d64db-c555-4517-8ec9-cef02f09a6e0 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:35:31 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-adc52e27-bb5e-477e-95cd-ba2a925ebaf8 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T09:33:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1558883839',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1558883839',id=11,image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKV5WTO3RU8mImKNvyy3587R+N7JwlT6Jf2J+MJbSqo4hAZxrSxF8W72MSyi+ySsoPdgOlsbcxF8VVQqPPlJi5ujN3wRt87bd8USGqJl/UXcMrJjLkiq2AkhQDDmymDtbg==',key_name='tempest-keypair-1749304277',keypairs=<?>,launch_index=0,launched_at=2023-11-15T09:34:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='641f0acd05d8403882a4f6b1b28e9269',ramdisk_id='',reservation_id='r-qck9bfvk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-238803034',owner_user_name='tempest-TaggedBootDevicesTest-238803034-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T09:34:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ba8869fcf4464284b52e2aaa41597bdd',uuid=742d64db-c555-4517-8ec9-cef02f09a6e0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7febe2f1-4891-4ad4-ac59-58edfd3d2f03", "address": "fa:16:3e:ec:cb:a9", "network": {"id": "63134c25-66d5-4030-bbf0-b2a2e259df84", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2071889805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "641f0acd05d8403882a4f6b1b28e9269", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7febe2f1-48", "ovs_interfaceid": "7febe2f1-4891-4ad4-ac59-58edfd3d2f03", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 09:35:31 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-adc52e27-bb5e-477e-95cd-ba2a925ebaf8 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] Converting VIF {"id": "7febe2f1-4891-4ad4-ac59-58edfd3d2f03", "address": "fa:16:3e:ec:cb:a9", "network": {"id": "63134c25-66d5-4030-bbf0-b2a2e259df84", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2071889805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "641f0acd05d8403882a4f6b1b28e9269", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7febe2f1-48", "ovs_interfaceid": "7febe2f1-4891-4ad4-ac59-58edfd3d2f03", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 09:35:31 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-adc52e27-bb5e-477e-95cd-ba2a925ebaf8 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ec:cb:a9,bridge_name='br-int',has_traffic_filtering=True,id=7febe2f1-4891-4ad4-ac59-58edfd3d2f03,network=Network(63134c25-66d5-4030-bbf0-b2a2e259df84),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7febe2f1-48') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 09:35:31 user nova-compute[75122]: DEBUG os_vif [None req-adc52e27-bb5e-477e-95cd-ba2a925ebaf8 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ec:cb:a9,bridge_name='br-int',has_traffic_filtering=True,id=7febe2f1-4891-4ad4-ac59-58edfd3d2f03,network=Network(63134c25-66d5-4030-bbf0-b2a2e259df84),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7febe2f1-48') {{(pid=75122) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 09:35:31 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:35:31 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7febe2f1-48, bridge=br-int, if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:35:31 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:35:31 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:35:31 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:35:31 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=aa59d183-643f-433b-aadc-27e6a3bcf665) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:35:31 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:35:31 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:35:31 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:35:31 user nova-compute[75122]: INFO os_vif [None req-adc52e27-bb5e-477e-95cd-ba2a925ebaf8 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ec:cb:a9,bridge_name='br-int',has_traffic_filtering=True,id=7febe2f1-4891-4ad4-ac59-58edfd3d2f03,network=Network(63134c25-66d5-4030-bbf0-b2a2e259df84),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7febe2f1-48')
Nov 15 09:35:31 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-adc52e27-bb5e-477e-95cd-ba2a925ebaf8 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T09:33:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1558883839',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1558883839',id=11,image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKV5WTO3RU8mImKNvyy3587R+N7JwlT6Jf2J+MJbSqo4hAZxrSxF8W72MSyi+ySsoPdgOlsbcxF8VVQqPPlJi5ujN3wRt87bd8USGqJl/UXcMrJjLkiq2AkhQDDmymDtbg==',key_name='tempest-keypair-1749304277',keypairs=<?>,launch_index=0,launched_at=2023-11-15T09:34:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='641f0acd05d8403882a4f6b1b28e9269',ramdisk_id='',reservation_id='r-qck9bfvk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-238803034',owner_user_name='tempest-TaggedBootDevicesTest-238803034-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T09:34:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ba8869fcf4464284b52e2aaa41597bdd',uuid=742d64db-c555-4517-8ec9-cef02f09a6e0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d8bfb09a-3733-4176-beec-aaa512b4ed8c", "address": "fa:16:3e:89:bb:49", "network": {"id": "3bb75c40-fc07-4bf2-8a8a-9f58cd457b67", "bridge": "br-int", "label": "tempest-device-tagging-net1-1158401388", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.130", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "641f0acd05d8403882a4f6b1b28e9269", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8bfb09a-37", "ovs_interfaceid": "d8bfb09a-3733-4176-beec-aaa512b4ed8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75122) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 09:35:31 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-adc52e27-bb5e-477e-95cd-ba2a925ebaf8 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] Converting VIF {"id": "d8bfb09a-3733-4176-beec-aaa512b4ed8c", "address": "fa:16:3e:89:bb:49", "network": {"id": "3bb75c40-fc07-4bf2-8a8a-9f58cd457b67", "bridge": "br-int", "label": "tempest-device-tagging-net1-1158401388", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.130", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "641f0acd05d8403882a4f6b1b28e9269", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8bfb09a-37", "ovs_interfaceid": "d8bfb09a-3733-4176-beec-aaa512b4ed8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 09:35:31 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-adc52e27-bb5e-477e-95cd-ba2a925ebaf8 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:bb:49,bridge_name='br-int',has_traffic_filtering=True,id=d8bfb09a-3733-4176-beec-aaa512b4ed8c,network=Network(3bb75c40-fc07-4bf2-8a8a-9f58cd457b67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd8bfb09a-37') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 09:35:31 user nova-compute[75122]: DEBUG os_vif [None req-adc52e27-bb5e-477e-95cd-ba2a925ebaf8 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:bb:49,bridge_name='br-int',has_traffic_filtering=True,id=d8bfb09a-3733-4176-beec-aaa512b4ed8c,network=Network(3bb75c40-fc07-4bf2-8a8a-9f58cd457b67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd8bfb09a-37') {{(pid=75122) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 09:35:31 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:35:31 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd8bfb09a-37, bridge=br-int, if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:35:31 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:35:31 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:35:31 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:35:31 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:35:31 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b5f383c4-901e-441c-8d80-b50636185ba9) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:35:31 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:35:31 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:35:32 user nova-compute[75122]: INFO os_vif [None req-adc52e27-bb5e-477e-95cd-ba2a925ebaf8 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:bb:49,bridge_name='br-int',has_traffic_filtering=True,id=d8bfb09a-3733-4176-beec-aaa512b4ed8c,network=Network(3bb75c40-fc07-4bf2-8a8a-9f58cd457b67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapd8bfb09a-37')
Nov 15 09:35:32 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-adc52e27-bb5e-477e-95cd-ba2a925ebaf8 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T09:33:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1558883839',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1558883839',id=11,image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKV5WTO3RU8mImKNvyy3587R+N7JwlT6Jf2J+MJbSqo4hAZxrSxF8W72MSyi+ySsoPdgOlsbcxF8VVQqPPlJi5ujN3wRt87bd8USGqJl/UXcMrJjLkiq2AkhQDDmymDtbg==',key_name='tempest-keypair-1749304277',keypairs=<?>,launch_index=0,launched_at=2023-11-15T09:34:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='641f0acd05d8403882a4f6b1b28e9269',ramdisk_id='',reservation_id='r-qck9bfvk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-238803034',owner_user_name='tempest-TaggedBootDevicesTest-238803034-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T09:34:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ba8869fcf4464284b52e2aaa41597bdd',uuid=742d64db-c555-4517-8ec9-cef02f09a6e0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "eaecb293-c647-47d7-8103-6fb8851477f3", "address": "fa:16:3e:3c:b2:b8", "network": {"id": "3bb75c40-fc07-4bf2-8a8a-9f58cd457b67", "bridge": "br-int", "label": "tempest-device-tagging-net1-1158401388", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "641f0acd05d8403882a4f6b1b28e9269", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeaecb293-c6", "ovs_interfaceid": "eaecb293-c647-47d7-8103-6fb8851477f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75122) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-adc52e27-bb5e-477e-95cd-ba2a925ebaf8 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] Converting VIF {"id": "eaecb293-c647-47d7-8103-6fb8851477f3", "address": "fa:16:3e:3c:b2:b8", "network": {"id": "3bb75c40-fc07-4bf2-8a8a-9f58cd457b67", "bridge": "br-int", "label": "tempest-device-tagging-net1-1158401388", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "641f0acd05d8403882a4f6b1b28e9269", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeaecb293-c6", "ovs_interfaceid": "eaecb293-c647-47d7-8103-6fb8851477f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-adc52e27-bb5e-477e-95cd-ba2a925ebaf8 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3c:b2:b8,bridge_name='br-int',has_traffic_filtering=True,id=eaecb293-c647-47d7-8103-6fb8851477f3,network=Network(3bb75c40-fc07-4bf2-8a8a-9f58cd457b67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapeaecb293-c6') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG os_vif [None req-adc52e27-bb5e-477e-95cd-ba2a925ebaf8 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:b2:b8,bridge_name='br-int',has_traffic_filtering=True,id=eaecb293-c647-47d7-8103-6fb8851477f3,network=Network(3bb75c40-fc07-4bf2-8a8a-9f58cd457b67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapeaecb293-c6') {{(pid=75122) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapeaecb293-c6, bridge=br-int, if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=20b4834e-faf6-4142-9a4d-0bbf19ec5f53) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG nova.compute.manager [req-5cbd8f61-a057-4e8c-b12b-4da9f0219947 req-94389ea6-4f18-47b2-854f-8b2909206b03 service nova] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] Received event network-vif-plugged-7febe2f1-4891-4ad4-ac59-58edfd3d2f03 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-5cbd8f61-a057-4e8c-b12b-4da9f0219947 req-94389ea6-4f18-47b2-854f-8b2909206b03 service nova] Acquiring lock "742d64db-c555-4517-8ec9-cef02f09a6e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-5cbd8f61-a057-4e8c-b12b-4da9f0219947 req-94389ea6-4f18-47b2-854f-8b2909206b03 service nova] Lock "742d64db-c555-4517-8ec9-cef02f09a6e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-5cbd8f61-a057-4e8c-b12b-4da9f0219947 req-94389ea6-4f18-47b2-854f-8b2909206b03 service nova] Lock "742d64db-c555-4517-8ec9-cef02f09a6e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG nova.compute.manager [req-5cbd8f61-a057-4e8c-b12b-4da9f0219947 req-94389ea6-4f18-47b2-854f-8b2909206b03 service nova] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] No waiting events found dispatching network-vif-plugged-7febe2f1-4891-4ad4-ac59-58edfd3d2f03 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:35:32 user nova-compute[75122]: WARNING nova.compute.manager [req-5cbd8f61-a057-4e8c-b12b-4da9f0219947 req-94389ea6-4f18-47b2-854f-8b2909206b03 service nova] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] Received unexpected event network-vif-plugged-7febe2f1-4891-4ad4-ac59-58edfd3d2f03 for instance with vm_state active and task_state deleting.
Nov 15 09:35:32 user nova-compute[75122]: DEBUG nova.compute.manager [req-5cbd8f61-a057-4e8c-b12b-4da9f0219947 req-94389ea6-4f18-47b2-854f-8b2909206b03 service nova] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] Received event network-vif-unplugged-eaecb293-c647-47d7-8103-6fb8851477f3 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-5cbd8f61-a057-4e8c-b12b-4da9f0219947 req-94389ea6-4f18-47b2-854f-8b2909206b03 service nova] Acquiring lock "742d64db-c555-4517-8ec9-cef02f09a6e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-5cbd8f61-a057-4e8c-b12b-4da9f0219947 req-94389ea6-4f18-47b2-854f-8b2909206b03 service nova] Lock "742d64db-c555-4517-8ec9-cef02f09a6e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-5cbd8f61-a057-4e8c-b12b-4da9f0219947 req-94389ea6-4f18-47b2-854f-8b2909206b03 service nova] Lock "742d64db-c555-4517-8ec9-cef02f09a6e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG nova.compute.manager [req-5cbd8f61-a057-4e8c-b12b-4da9f0219947 req-94389ea6-4f18-47b2-854f-8b2909206b03 service nova] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] No waiting events found dispatching network-vif-unplugged-eaecb293-c647-47d7-8103-6fb8851477f3 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG nova.compute.manager [req-5cbd8f61-a057-4e8c-b12b-4da9f0219947 req-94389ea6-4f18-47b2-854f-8b2909206b03 service nova] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] Received event network-vif-unplugged-eaecb293-c647-47d7-8103-6fb8851477f3 for instance with task_state deleting. {{(pid=75122) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG nova.compute.manager [req-5cbd8f61-a057-4e8c-b12b-4da9f0219947 req-94389ea6-4f18-47b2-854f-8b2909206b03 service nova] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] Received event network-vif-plugged-eaecb293-c647-47d7-8103-6fb8851477f3 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-5cbd8f61-a057-4e8c-b12b-4da9f0219947 req-94389ea6-4f18-47b2-854f-8b2909206b03 service nova] Acquiring lock "742d64db-c555-4517-8ec9-cef02f09a6e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-5cbd8f61-a057-4e8c-b12b-4da9f0219947 req-94389ea6-4f18-47b2-854f-8b2909206b03 service nova] Lock "742d64db-c555-4517-8ec9-cef02f09a6e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-5cbd8f61-a057-4e8c-b12b-4da9f0219947 req-94389ea6-4f18-47b2-854f-8b2909206b03 service nova] Lock "742d64db-c555-4517-8ec9-cef02f09a6e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG nova.compute.manager [req-5cbd8f61-a057-4e8c-b12b-4da9f0219947 req-94389ea6-4f18-47b2-854f-8b2909206b03 service nova] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] No waiting events found dispatching network-vif-plugged-eaecb293-c647-47d7-8103-6fb8851477f3 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:35:32 user nova-compute[75122]: WARNING nova.compute.manager [req-5cbd8f61-a057-4e8c-b12b-4da9f0219947 req-94389ea6-4f18-47b2-854f-8b2909206b03 service nova] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] Received unexpected event network-vif-plugged-eaecb293-c647-47d7-8103-6fb8851477f3 for instance with vm_state active and task_state deleting.
Nov 15 09:35:32 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:35:32 user nova-compute[75122]: INFO os_vif [None req-adc52e27-bb5e-477e-95cd-ba2a925ebaf8 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:b2:b8,bridge_name='br-int',has_traffic_filtering=True,id=eaecb293-c647-47d7-8103-6fb8851477f3,network=Network(3bb75c40-fc07-4bf2-8a8a-9f58cd457b67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapeaecb293-c6')
Nov 15 09:35:32 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-adc52e27-bb5e-477e-95cd-ba2a925ebaf8 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T09:33:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1558883839',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1558883839',id=11,image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKV5WTO3RU8mImKNvyy3587R+N7JwlT6Jf2J+MJbSqo4hAZxrSxF8W72MSyi+ySsoPdgOlsbcxF8VVQqPPlJi5ujN3wRt87bd8USGqJl/UXcMrJjLkiq2AkhQDDmymDtbg==',key_name='tempest-keypair-1749304277',keypairs=<?>,launch_index=0,launched_at=2023-11-15T09:34:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='641f0acd05d8403882a4f6b1b28e9269',ramdisk_id='',reservation_id='r-qck9bfvk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-238803034',owner_user_name='tempest-TaggedBootDevicesTest-238803034-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T09:34:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ba8869fcf4464284b52e2aaa41597bdd',uuid=742d64db-c555-4517-8ec9-cef02f09a6e0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5ebcafd9-6939-4928-ae2f-38ec38e15876", "address": "fa:16:3e:ec:d2:98", "network": {"id": "3bb75c40-fc07-4bf2-8a8a-9f58cd457b67", "bridge": "br-int", "label": "tempest-device-tagging-net1-1158401388", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.29", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "641f0acd05d8403882a4f6b1b28e9269", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ebcafd9-69", "ovs_interfaceid": "5ebcafd9-6939-4928-ae2f-38ec38e15876", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-adc52e27-bb5e-477e-95cd-ba2a925ebaf8 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] Converting VIF {"id": "5ebcafd9-6939-4928-ae2f-38ec38e15876", "address": "fa:16:3e:ec:d2:98", "network": {"id": "3bb75c40-fc07-4bf2-8a8a-9f58cd457b67", "bridge": "br-int", "label": "tempest-device-tagging-net1-1158401388", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.29", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "641f0acd05d8403882a4f6b1b28e9269", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ebcafd9-69", "ovs_interfaceid": "5ebcafd9-6939-4928-ae2f-38ec38e15876", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-adc52e27-bb5e-477e-95cd-ba2a925ebaf8 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:d2:98,bridge_name='br-int',has_traffic_filtering=True,id=5ebcafd9-6939-4928-ae2f-38ec38e15876,network=Network(3bb75c40-fc07-4bf2-8a8a-9f58cd457b67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ebcafd9-69') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG os_vif [None req-adc52e27-bb5e-477e-95cd-ba2a925ebaf8 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:d2:98,bridge_name='br-int',has_traffic_filtering=True,id=5ebcafd9-6939-4928-ae2f-38ec38e15876,network=Network(3bb75c40-fc07-4bf2-8a8a-9f58cd457b67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ebcafd9-69') {{(pid=75122) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG nova.compute.manager [req-334e0a9e-0706-48bf-abd8-92137f4ce925 req-f40e1c03-d126-4049-b244-23f0822366ed service nova] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] Received event network-vif-plugged-d8bfb09a-3733-4176-beec-aaa512b4ed8c {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-334e0a9e-0706-48bf-abd8-92137f4ce925 req-f40e1c03-d126-4049-b244-23f0822366ed service nova] Acquiring lock "742d64db-c555-4517-8ec9-cef02f09a6e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-334e0a9e-0706-48bf-abd8-92137f4ce925 req-f40e1c03-d126-4049-b244-23f0822366ed service nova] Lock "742d64db-c555-4517-8ec9-cef02f09a6e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-334e0a9e-0706-48bf-abd8-92137f4ce925 req-f40e1c03-d126-4049-b244-23f0822366ed service nova] Lock "742d64db-c555-4517-8ec9-cef02f09a6e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG nova.compute.manager [req-334e0a9e-0706-48bf-abd8-92137f4ce925 req-f40e1c03-d126-4049-b244-23f0822366ed service nova] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] No waiting events found dispatching network-vif-plugged-d8bfb09a-3733-4176-beec-aaa512b4ed8c {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:35:32 user nova-compute[75122]: WARNING nova.compute.manager [req-334e0a9e-0706-48bf-abd8-92137f4ce925 req-f40e1c03-d126-4049-b244-23f0822366ed service nova] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] Received unexpected event network-vif-plugged-d8bfb09a-3733-4176-beec-aaa512b4ed8c for instance with vm_state active and task_state deleting.
Nov 15 09:35:32 user nova-compute[75122]: DEBUG nova.compute.manager [req-334e0a9e-0706-48bf-abd8-92137f4ce925 req-f40e1c03-d126-4049-b244-23f0822366ed service nova] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] Received event network-vif-unplugged-d378cd7b-d582-4062-a714-d4456d71ba5f {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-334e0a9e-0706-48bf-abd8-92137f4ce925 req-f40e1c03-d126-4049-b244-23f0822366ed service nova] Acquiring lock "742d64db-c555-4517-8ec9-cef02f09a6e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-334e0a9e-0706-48bf-abd8-92137f4ce925 req-f40e1c03-d126-4049-b244-23f0822366ed service nova] Lock "742d64db-c555-4517-8ec9-cef02f09a6e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-334e0a9e-0706-48bf-abd8-92137f4ce925 req-f40e1c03-d126-4049-b244-23f0822366ed service nova] Lock "742d64db-c555-4517-8ec9-cef02f09a6e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG nova.compute.manager [req-334e0a9e-0706-48bf-abd8-92137f4ce925 req-f40e1c03-d126-4049-b244-23f0822366ed service nova] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] No waiting events found dispatching network-vif-unplugged-d378cd7b-d582-4062-a714-d4456d71ba5f {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG nova.compute.manager [req-334e0a9e-0706-48bf-abd8-92137f4ce925 req-f40e1c03-d126-4049-b244-23f0822366ed service nova] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] Received event network-vif-unplugged-d378cd7b-d582-4062-a714-d4456d71ba5f for instance with task_state deleting. {{(pid=75122) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG nova.compute.manager [req-334e0a9e-0706-48bf-abd8-92137f4ce925 req-f40e1c03-d126-4049-b244-23f0822366ed service nova] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] Received event network-vif-plugged-d378cd7b-d582-4062-a714-d4456d71ba5f {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-334e0a9e-0706-48bf-abd8-92137f4ce925 req-f40e1c03-d126-4049-b244-23f0822366ed service nova] Acquiring lock "742d64db-c555-4517-8ec9-cef02f09a6e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-334e0a9e-0706-48bf-abd8-92137f4ce925 req-f40e1c03-d126-4049-b244-23f0822366ed service nova] Lock "742d64db-c555-4517-8ec9-cef02f09a6e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-334e0a9e-0706-48bf-abd8-92137f4ce925 req-f40e1c03-d126-4049-b244-23f0822366ed service nova] Lock "742d64db-c555-4517-8ec9-cef02f09a6e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG nova.compute.manager [req-334e0a9e-0706-48bf-abd8-92137f4ce925 req-f40e1c03-d126-4049-b244-23f0822366ed service nova] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] No waiting events found dispatching network-vif-plugged-d378cd7b-d582-4062-a714-d4456d71ba5f {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:35:32 user nova-compute[75122]: WARNING nova.compute.manager [req-334e0a9e-0706-48bf-abd8-92137f4ce925 req-f40e1c03-d126-4049-b244-23f0822366ed service nova] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] Received unexpected event network-vif-plugged-d378cd7b-d582-4062-a714-d4456d71ba5f for instance with vm_state active and task_state deleting.
Nov 15 09:35:32 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5ebcafd9-69, bridge=br-int, if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=271eca80-3e4f-4654-a273-1254829b9697) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:35:32 user nova-compute[75122]: INFO os_vif [None req-adc52e27-bb5e-477e-95cd-ba2a925ebaf8 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:d2:98,bridge_name='br-int',has_traffic_filtering=True,id=5ebcafd9-6939-4928-ae2f-38ec38e15876,network=Network(3bb75c40-fc07-4bf2-8a8a-9f58cd457b67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ebcafd9-69')
Nov 15 09:35:32 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-adc52e27-bb5e-477e-95cd-ba2a925ebaf8 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T09:33:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1558883839',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1558883839',id=11,image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKV5WTO3RU8mImKNvyy3587R+N7JwlT6Jf2J+MJbSqo4hAZxrSxF8W72MSyi+ySsoPdgOlsbcxF8VVQqPPlJi5ujN3wRt87bd8USGqJl/UXcMrJjLkiq2AkhQDDmymDtbg==',key_name='tempest-keypair-1749304277',keypairs=<?>,launch_index=0,launched_at=2023-11-15T09:34:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='641f0acd05d8403882a4f6b1b28e9269',ramdisk_id='',reservation_id='r-qck9bfvk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-238803034',owner_user_name='tempest-TaggedBootDevicesTest-238803034-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T09:34:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ba8869fcf4464284b52e2aaa41597bdd',uuid=742d64db-c555-4517-8ec9-cef02f09a6e0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5bf17322-fd6b-4335-9a8e-56e7cd64e180", "address": "fa:16:3e:c9:4d:28", "network": {"id": "3bb75c40-fc07-4bf2-8a8a-9f58cd457b67", "bridge": "br-int", "label": "tempest-device-tagging-net1-1158401388", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.122", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "641f0acd05d8403882a4f6b1b28e9269", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bf17322-fd", "ovs_interfaceid": "5bf17322-fd6b-4335-9a8e-56e7cd64e180", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-adc52e27-bb5e-477e-95cd-ba2a925ebaf8 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] Converting VIF {"id": "5bf17322-fd6b-4335-9a8e-56e7cd64e180", "address": "fa:16:3e:c9:4d:28", "network": {"id": "3bb75c40-fc07-4bf2-8a8a-9f58cd457b67", "bridge": "br-int", "label": "tempest-device-tagging-net1-1158401388", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.122", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "641f0acd05d8403882a4f6b1b28e9269", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5bf17322-fd", "ovs_interfaceid": "5bf17322-fd6b-4335-9a8e-56e7cd64e180", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-adc52e27-bb5e-477e-95cd-ba2a925ebaf8 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c9:4d:28,bridge_name='br-int',has_traffic_filtering=True,id=5bf17322-fd6b-4335-9a8e-56e7cd64e180,network=Network(3bb75c40-fc07-4bf2-8a8a-9f58cd457b67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5bf17322-fd') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG os_vif [None req-adc52e27-bb5e-477e-95cd-ba2a925ebaf8 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:4d:28,bridge_name='br-int',has_traffic_filtering=True,id=5bf17322-fd6b-4335-9a8e-56e7cd64e180,network=Network(3bb75c40-fc07-4bf2-8a8a-9f58cd457b67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5bf17322-fd') {{(pid=75122) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5bf17322-fd, bridge=br-int, if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=187f2980-2ac7-4e96-a32d-e9b8be407d8d) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:35:32 user nova-compute[75122]: INFO os_vif [None req-adc52e27-bb5e-477e-95cd-ba2a925ebaf8 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c9:4d:28,bridge_name='br-int',has_traffic_filtering=True,id=5bf17322-fd6b-4335-9a8e-56e7cd64e180,network=Network(3bb75c40-fc07-4bf2-8a8a-9f58cd457b67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5bf17322-fd')
Nov 15 09:35:32 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-adc52e27-bb5e-477e-95cd-ba2a925ebaf8 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T09:33:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1558883839',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1558883839',id=11,image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKV5WTO3RU8mImKNvyy3587R+N7JwlT6Jf2J+MJbSqo4hAZxrSxF8W72MSyi+ySsoPdgOlsbcxF8VVQqPPlJi5ujN3wRt87bd8USGqJl/UXcMrJjLkiq2AkhQDDmymDtbg==',key_name='tempest-keypair-1749304277',keypairs=<?>,launch_index=0,launched_at=2023-11-15T09:34:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='641f0acd05d8403882a4f6b1b28e9269',ramdisk_id='',reservation_id='r-qck9bfvk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-238803034',owner_user_name='tempest-TaggedBootDevicesTest-238803034-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T09:34:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ba8869fcf4464284b52e2aaa41597bdd',uuid=742d64db-c555-4517-8ec9-cef02f09a6e0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "710ae079-0b1c-4c04-bea2-e34fd0d554ae", "address": "fa:16:3e:0e:e7:01", "network": {"id": "b4709ef9-ae05-4eac-b530-da89c65fd367", "bridge": "br-int", "label": "tempest-device-tagging-net2-314948697", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "641f0acd05d8403882a4f6b1b28e9269", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap710ae079-0b", "ovs_interfaceid": "710ae079-0b1c-4c04-bea2-e34fd0d554ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-adc52e27-bb5e-477e-95cd-ba2a925ebaf8 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] Converting VIF {"id": "710ae079-0b1c-4c04-bea2-e34fd0d554ae", "address": "fa:16:3e:0e:e7:01", "network": {"id": "b4709ef9-ae05-4eac-b530-da89c65fd367", "bridge": "br-int", "label": "tempest-device-tagging-net2-314948697", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "641f0acd05d8403882a4f6b1b28e9269", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap710ae079-0b", "ovs_interfaceid": "710ae079-0b1c-4c04-bea2-e34fd0d554ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-adc52e27-bb5e-477e-95cd-ba2a925ebaf8 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:e7:01,bridge_name='br-int',has_traffic_filtering=True,id=710ae079-0b1c-4c04-bea2-e34fd0d554ae,network=Network(b4709ef9-ae05-4eac-b530-da89c65fd367),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap710ae079-0b') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG os_vif [None req-adc52e27-bb5e-477e-95cd-ba2a925ebaf8 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:e7:01,bridge_name='br-int',has_traffic_filtering=True,id=710ae079-0b1c-4c04-bea2-e34fd0d554ae,network=Network(b4709ef9-ae05-4eac-b530-da89c65fd367),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap710ae079-0b') {{(pid=75122) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap710ae079-0b, bridge=br-int, if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5d434df5-38c0-4111-b83b-3013f5f89416) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:35:32 user nova-compute[75122]: INFO os_vif [None req-adc52e27-bb5e-477e-95cd-ba2a925ebaf8 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:e7:01,bridge_name='br-int',has_traffic_filtering=True,id=710ae079-0b1c-4c04-bea2-e34fd0d554ae,network=Network(b4709ef9-ae05-4eac-b530-da89c65fd367),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap710ae079-0b')
Nov 15 09:35:32 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-adc52e27-bb5e-477e-95cd-ba2a925ebaf8 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T09:33:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1558883839',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1558883839',id=11,image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKV5WTO3RU8mImKNvyy3587R+N7JwlT6Jf2J+MJbSqo4hAZxrSxF8W72MSyi+ySsoPdgOlsbcxF8VVQqPPlJi5ujN3wRt87bd8USGqJl/UXcMrJjLkiq2AkhQDDmymDtbg==',key_name='tempest-keypair-1749304277',keypairs=<?>,launch_index=0,launched_at=2023-11-15T09:34:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='641f0acd05d8403882a4f6b1b28e9269',ramdisk_id='',reservation_id='r-qck9bfvk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-238803034',owner_user_name='tempest-TaggedBootDevicesTest-238803034-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T09:34:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ba8869fcf4464284b52e2aaa41597bdd',uuid=742d64db-c555-4517-8ec9-cef02f09a6e0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d378cd7b-d582-4062-a714-d4456d71ba5f", "address": "fa:16:3e:e1:90:72", "network": {"id": "b4709ef9-ae05-4eac-b530-da89c65fd367", "bridge": "br-int", "label": "tempest-device-tagging-net2-314948697", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "641f0acd05d8403882a4f6b1b28e9269", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd378cd7b-d5", "ovs_interfaceid": "d378cd7b-d582-4062-a714-d4456d71ba5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-adc52e27-bb5e-477e-95cd-ba2a925ebaf8 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] Converting VIF {"id": "d378cd7b-d582-4062-a714-d4456d71ba5f", "address": "fa:16:3e:e1:90:72", "network": {"id": "b4709ef9-ae05-4eac-b530-da89c65fd367", "bridge": "br-int", "label": "tempest-device-tagging-net2-314948697", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "641f0acd05d8403882a4f6b1b28e9269", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd378cd7b-d5", "ovs_interfaceid": "d378cd7b-d582-4062-a714-d4456d71ba5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-adc52e27-bb5e-477e-95cd-ba2a925ebaf8 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:90:72,bridge_name='br-int',has_traffic_filtering=True,id=d378cd7b-d582-4062-a714-d4456d71ba5f,network=Network(b4709ef9-ae05-4eac-b530-da89c65fd367),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd378cd7b-d5') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG os_vif [None req-adc52e27-bb5e-477e-95cd-ba2a925ebaf8 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:90:72,bridge_name='br-int',has_traffic_filtering=True,id=d378cd7b-d582-4062-a714-d4456d71ba5f,network=Network(b4709ef9-ae05-4eac-b530-da89c65fd367),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd378cd7b-d5') {{(pid=75122) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd378cd7b-d5, bridge=br-int, if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=31b5e314-58fe-4dc1-8a79-f5736c985bea) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:35:32 user nova-compute[75122]: INFO os_vif [None req-adc52e27-bb5e-477e-95cd-ba2a925ebaf8 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:90:72,bridge_name='br-int',has_traffic_filtering=True,id=d378cd7b-d582-4062-a714-d4456d71ba5f,network=Network(b4709ef9-ae05-4eac-b530-da89c65fd367),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd378cd7b-d5')
Nov 15 09:35:32 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-adc52e27-bb5e-477e-95cd-ba2a925ebaf8 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] calling os-brick to detach iSCSI Volume {{(pid=75122) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-adc52e27-bb5e-477e-95cd-ba2a925ebaf8 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffa04060b80>, {'target_iqn': 'iqn.2010-10.org.openstack:01563785-3767-460a-9815-c1bd0f7f6f9f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WzZynFXE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 09:35:32 user nova-compute[75122]: WARNING os_brick.initiator.connectors.base [None req-adc52e27-bb5e-477e-95cd-ba2a925ebaf8 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 09:35:32 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-adc52e27-bb5e-477e-95cd-ba2a925ebaf8 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-adc52e27-bb5e-477e-95cd-ba2a925ebaf8 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf1d6c53-e9ef-4111-9867-deb5e126a45f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bca4e77f-05f8-4ff6-8a78-6cef699f5667\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b9022bc1-82d9-4e14-9d0e-85a8b645e512\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:01563785-3767-460a-9815-c1bd0f7f6f9f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3a8a33bb-713e-4109-8306-fe91fd67904f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:697acd7d-564d-4149-9ecf-7c7d89f10013\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:df76fc47-1a36-4bd6-97e6-bff6a6ead337\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-adc52e27-bb5e-477e-95cd-ba2a925ebaf8 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 09:35:32 user nova-compute[75122]: No targets found.
Nov 15 09:35:32 user nova-compute[75122]: iSNS:
Nov 15 09:35:32 user nova-compute[75122]: No targets found.
Nov 15 09:35:32 user nova-compute[75122]: STATIC:
Nov 15 09:35:32 user nova-compute[75122]: Target: iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16
Nov 15 09:35:32 user nova-compute[75122]:         Portal: 172.16.0.220:3260,-1
Nov 15 09:35:32 user nova-compute[75122]:                 Iface Name: default
Nov 15 09:35:32 user nova-compute[75122]: Target: iqn.2010-10.org.openstack:bca4e77f-05f8-4ff6-8a78-6cef699f5667
Nov 15 09:35:32 user nova-compute[75122]:         Portal: 172.16.0.220:3260,-1
Nov 15 09:35:32 user nova-compute[75122]:                 Iface Name: default
Nov 15 09:35:32 user nova-compute[75122]: Target: iqn.2010-10.org.openstack:b9022bc1-82d9-4e14-9d0e-85a8b645e512
Nov 15 09:35:32 user nova-compute[75122]:         Portal: 172.16.0.220:3260,-1
Nov 15 09:35:32 user nova-compute[75122]:                 Iface Name: default
Nov 15 09:35:32 user nova-compute[75122]: Target: iqn.2010-10.org.openstack:01563785-3767-460a-9815-c1bd0f7f6f9f
Nov 15 09:35:32 user nova-compute[75122]:         Portal: 172.16.0.220:3260,-1
Nov 15 09:35:32 user nova-compute[75122]:                 Iface Name: default
Nov 15 09:35:32 user nova-compute[75122]: Target: iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e
Nov 15 09:35:32 user nova-compute[75122]:         Portal: 172.16.0.220:3260,-1
Nov 15 09:35:32 user nova-compute[75122]:                 Iface Name: default
Nov 15 09:35:32 user nova-compute[75122]: Target: iqn.2010-10.org.openstack:3a8a33bb-713e-4109-8306-fe91fd67904f
Nov 15 09:35:32 user nova-compute[75122]:         Portal: 172.16.0.220:3260,-1
Nov 15 09:35:32 user nova-compute[75122]:                 Iface Name: default
Nov 15 09:35:32 user nova-compute[75122]: Target: iqn.2010-10.org.openstack:697acd7d-564d-4149-9ecf-7c7d89f10013
Nov 15 09:35:32 user nova-compute[75122]:         Portal: 172.16.0.220:3260,-1
Nov 15 09:35:32 user nova-compute[75122]:                 Iface Name: default
Nov 15 09:35:32 user nova-compute[75122]: Target: iqn.2010-10.org.openstack:df76fc47-1a36-4bd6-97e6-bff6a6ead337
Nov 15 09:35:32 user nova-compute[75122]:         Portal: 172.16.0.220:3260,-1
Nov 15 09:35:32 user nova-compute[75122]:                 Iface Name: default
Nov 15 09:35:32 user nova-compute[75122]: FIRMWARE:
Nov 15 09:35:32 user nova-compute[75122]: No targets found.
Nov 15 09:35:32 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-adc52e27-bb5e-477e-95cd-ba2a925ebaf8 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 09:35:32 user nova-compute[75122]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 09:35:32 user nova-compute[75122]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75122) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-adc52e27-bb5e-477e-95cd-ba2a925ebaf8 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:01563785-3767-460a-9815-c1bd0f7f6f9f', 0)] {{(pid=75122) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ae7dd13-1eed-41ad-8da3-f94a39eb448c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:01563785-3767-460a-9815-c1bd0f7f6f9f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3a8a33bb-713e-4109-8306-fe91fd67904f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:697acd7d-564d-4149-9ecf-7c7d89f10013\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b9022bc1-82d9-4e14-9d0e-85a8b645e512\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bca4e77f-05f8-4ff6-8a78-6cef699f5667\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:df76fc47-1a36-4bd6-97e6-bff6a6ead337\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[cea0d24e-9190-4171-8888-0627807a3045]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01563785-3767-460a-9815-c1bd0f7f6f9f (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bca4e77f-05f8-4ff6-8a78-6cef699f5667 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a8a33bb-713e-4109-8306-fe91fd67904f (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:697acd7d-564d-4149-9ecf-7c7d89f10013 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df76fc47-1a36-4bd6-97e6-bff6a6ead337 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9022bc1-82d9-4e14-9d0e-85a8b645e512 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e (non-flash)\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-adc52e27-bb5e-477e-95cd-ba2a925ebaf8 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01563785-3767-460a-9815-c1bd0f7f6f9f (non-flash)
Nov 15 09:35:32 user nova-compute[75122]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bca4e77f-05f8-4ff6-8a78-6cef699f5667 (non-flash)
Nov 15 09:35:32 user nova-compute[75122]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a8a33bb-713e-4109-8306-fe91fd67904f (non-flash)
Nov 15 09:35:32 user nova-compute[75122]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16 (non-flash)
Nov 15 09:35:32 user nova-compute[75122]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:697acd7d-564d-4149-9ecf-7c7d89f10013 (non-flash)
Nov 15 09:35:32 user nova-compute[75122]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df76fc47-1a36-4bd6-97e6-bff6a6ead337 (non-flash)
Nov 15 09:35:32 user nova-compute[75122]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9022bc1-82d9-4e14-9d0e-85a8b645e512 (non-flash)
Nov 15 09:35:32 user nova-compute[75122]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e (non-flash)
Nov 15 09:35:32 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-adc52e27-bb5e-477e-95cd-ba2a925ebaf8 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01563785-3767-460a-9815-c1bd0f7f6f9f (non-flash)
Nov 15 09:35:32 user nova-compute[75122]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bca4e77f-05f8-4ff6-8a78-6cef699f5667 (non-flash)
Nov 15 09:35:32 user nova-compute[75122]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a8a33bb-713e-4109-8306-fe91fd67904f (non-flash)
Nov 15 09:35:32 user nova-compute[75122]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16 (non-flash)
Nov 15 09:35:32 user nova-compute[75122]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:697acd7d-564d-4149-9ecf-7c7d89f10013 (non-flash)
Nov 15 09:35:32 user nova-compute[75122]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df76fc47-1a36-4bd6-97e6-bff6a6ead337 (non-flash)
Nov 15 09:35:32 user nova-compute[75122]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9022bc1-82d9-4e14-9d0e-85a8b645e512 (non-flash)
Nov 15 09:35:32 user nova-compute[75122]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e (non-flash)
Nov 15 09:35:32 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-adc52e27-bb5e-477e-95cd-ba2a925ebaf8 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff9fc384280>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:01563785-3767-460a-9815-c1bd0f7f6f9f'): ({'sdb'}, set())}) {{(pid=75122) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-adc52e27-bb5e-477e-95cd-ba2a925ebaf8 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] Removing single pathed devices sdb {{(pid=75122) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f59c079-a3d3-4d87-957b-02f60282e9d7]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebf20a19-cf20-46a6-a1dc-8cace5dcff3c]: (4, ('ok\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-adc52e27-bb5e-477e-95cd-ba2a925ebaf8 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] Flushing IO for device /dev/sdb {{(pid=75122) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce4e7da4-f7a6-41cf-93d7-13937f9ad593]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-adc52e27-bb5e-477e-95cd-ba2a925ebaf8 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75122) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.052s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a52c2c6-6bee-46fa-8990-fe7686a324fc]: (4, ('1', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-adc52e27-bb5e-477e-95cd-ba2a925ebaf8 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75122) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-adc52e27-bb5e-477e-95cd-ba2a925ebaf8 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] SCSI volumes sdb have been removed. {{(pid=75122) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-adc52e27-bb5e-477e-95cd-ba2a925ebaf8 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:01563785-3767-460a-9815-c1bd0f7f6f9f')] {{(pid=75122) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01563785-3767-460a-9815-c1bd0f7f6f9f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01563785-3767-460a-9815-c1bd0f7f6f9f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[c20c39cd-e822-4c3a-bdf4-6ae07fe66394]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-adc52e27-bb5e-477e-95cd-ba2a925ebaf8 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01563785-3767-460a-9815-c1bd0f7f6f9f -p 172.16.0.220:3260 --logout {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01563785-3767-460a-9815-c1bd0f7f6f9f -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[8291d38f-b61c-4bf3-994d-a8a08d8302c4]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:01563785-3767-460a-9815-c1bd0f7f6f9f, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:01563785-3767-460a-9815-c1bd0f7f6f9f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-adc52e27-bb5e-477e-95cd-ba2a925ebaf8 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:01563785-3767-460a-9815-c1bd0f7f6f9f, portal: 172.16.0.220,3260]
Nov 15 09:35:32 user nova-compute[75122]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:01563785-3767-460a-9815-c1bd0f7f6f9f, portal: 172.16.0.220,3260] successful.
Nov 15 09:35:32 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01563785-3767-460a-9815-c1bd0f7f6f9f -p 172.16.0.220:3260 --op delete {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01563785-3767-460a-9815-c1bd0f7f6f9f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[214de770-04d9-4ba1-b498-85f6b5617955]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG nova.compute.manager [req-68809b80-afb3-46b1-be6e-4dab4aa1d591 req-ac1c8743-601f-45be-948c-deb9b00deb67 service nova] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] Received event network-vif-plugged-5ebcafd9-6939-4928-ae2f-38ec38e15876 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-68809b80-afb3-46b1-be6e-4dab4aa1d591 req-ac1c8743-601f-45be-948c-deb9b00deb67 service nova] Acquiring lock "742d64db-c555-4517-8ec9-cef02f09a6e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-68809b80-afb3-46b1-be6e-4dab4aa1d591 req-ac1c8743-601f-45be-948c-deb9b00deb67 service nova] Lock "742d64db-c555-4517-8ec9-cef02f09a6e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-68809b80-afb3-46b1-be6e-4dab4aa1d591 req-ac1c8743-601f-45be-948c-deb9b00deb67 service nova] Lock "742d64db-c555-4517-8ec9-cef02f09a6e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG nova.compute.manager [req-68809b80-afb3-46b1-be6e-4dab4aa1d591 req-ac1c8743-601f-45be-948c-deb9b00deb67 service nova] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] No waiting events found dispatching network-vif-plugged-5ebcafd9-6939-4928-ae2f-38ec38e15876 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:35:32 user nova-compute[75122]: WARNING nova.compute.manager [req-68809b80-afb3-46b1-be6e-4dab4aa1d591 req-ac1c8743-601f-45be-948c-deb9b00deb67 service nova] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] Received unexpected event network-vif-plugged-5ebcafd9-6939-4928-ae2f-38ec38e15876 for instance with vm_state active and task_state deleting.
Nov 15 09:35:32 user nova-compute[75122]: DEBUG nova.compute.manager [req-68809b80-afb3-46b1-be6e-4dab4aa1d591 req-ac1c8743-601f-45be-948c-deb9b00deb67 service nova] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] Received event network-vif-unplugged-5bf17322-fd6b-4335-9a8e-56e7cd64e180 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-68809b80-afb3-46b1-be6e-4dab4aa1d591 req-ac1c8743-601f-45be-948c-deb9b00deb67 service nova] Acquiring lock "742d64db-c555-4517-8ec9-cef02f09a6e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-68809b80-afb3-46b1-be6e-4dab4aa1d591 req-ac1c8743-601f-45be-948c-deb9b00deb67 service nova] Lock "742d64db-c555-4517-8ec9-cef02f09a6e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-68809b80-afb3-46b1-be6e-4dab4aa1d591 req-ac1c8743-601f-45be-948c-deb9b00deb67 service nova] Lock "742d64db-c555-4517-8ec9-cef02f09a6e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG nova.compute.manager [req-68809b80-afb3-46b1-be6e-4dab4aa1d591 req-ac1c8743-601f-45be-948c-deb9b00deb67 service nova] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] No waiting events found dispatching network-vif-unplugged-5bf17322-fd6b-4335-9a8e-56e7cd64e180 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG nova.compute.manager [req-68809b80-afb3-46b1-be6e-4dab4aa1d591 req-ac1c8743-601f-45be-948c-deb9b00deb67 service nova] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] Received event network-vif-unplugged-5bf17322-fd6b-4335-9a8e-56e7cd64e180 for instance with task_state deleting. {{(pid=75122) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG nova.compute.manager [req-68809b80-afb3-46b1-be6e-4dab4aa1d591 req-ac1c8743-601f-45be-948c-deb9b00deb67 service nova] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] Received event network-vif-plugged-5bf17322-fd6b-4335-9a8e-56e7cd64e180 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-68809b80-afb3-46b1-be6e-4dab4aa1d591 req-ac1c8743-601f-45be-948c-deb9b00deb67 service nova] Acquiring lock "742d64db-c555-4517-8ec9-cef02f09a6e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-68809b80-afb3-46b1-be6e-4dab4aa1d591 req-ac1c8743-601f-45be-948c-deb9b00deb67 service nova] Lock "742d64db-c555-4517-8ec9-cef02f09a6e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-68809b80-afb3-46b1-be6e-4dab4aa1d591 req-ac1c8743-601f-45be-948c-deb9b00deb67 service nova] Lock "742d64db-c555-4517-8ec9-cef02f09a6e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG nova.compute.manager [req-68809b80-afb3-46b1-be6e-4dab4aa1d591 req-ac1c8743-601f-45be-948c-deb9b00deb67 service nova] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] No waiting events found dispatching network-vif-plugged-5bf17322-fd6b-4335-9a8e-56e7cd64e180 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:35:32 user nova-compute[75122]: WARNING nova.compute.manager [req-68809b80-afb3-46b1-be6e-4dab4aa1d591 req-ac1c8743-601f-45be-948c-deb9b00deb67 service nova] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] Received unexpected event network-vif-plugged-5bf17322-fd6b-4335-9a8e-56e7cd64e180 for instance with vm_state active and task_state deleting.
Nov 15 09:35:32 user nova-compute[75122]: DEBUG nova.compute.manager [req-68809b80-afb3-46b1-be6e-4dab4aa1d591 req-ac1c8743-601f-45be-948c-deb9b00deb67 service nova] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] Received event network-vif-unplugged-710ae079-0b1c-4c04-bea2-e34fd0d554ae {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-68809b80-afb3-46b1-be6e-4dab4aa1d591 req-ac1c8743-601f-45be-948c-deb9b00deb67 service nova] Acquiring lock "742d64db-c555-4517-8ec9-cef02f09a6e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-68809b80-afb3-46b1-be6e-4dab4aa1d591 req-ac1c8743-601f-45be-948c-deb9b00deb67 service nova] Lock "742d64db-c555-4517-8ec9-cef02f09a6e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-68809b80-afb3-46b1-be6e-4dab4aa1d591 req-ac1c8743-601f-45be-948c-deb9b00deb67 service nova] Lock "742d64db-c555-4517-8ec9-cef02f09a6e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG nova.compute.manager [req-68809b80-afb3-46b1-be6e-4dab4aa1d591 req-ac1c8743-601f-45be-948c-deb9b00deb67 service nova] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] No waiting events found dispatching network-vif-unplugged-710ae079-0b1c-4c04-bea2-e34fd0d554ae {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG nova.compute.manager [req-68809b80-afb3-46b1-be6e-4dab4aa1d591 req-ac1c8743-601f-45be-948c-deb9b00deb67 service nova] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] Received event network-vif-unplugged-710ae079-0b1c-4c04-bea2-e34fd0d554ae for instance with task_state deleting. {{(pid=75122) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG nova.compute.manager [req-68809b80-afb3-46b1-be6e-4dab4aa1d591 req-ac1c8743-601f-45be-948c-deb9b00deb67 service nova] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] Received event network-vif-plugged-710ae079-0b1c-4c04-bea2-e34fd0d554ae {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-68809b80-afb3-46b1-be6e-4dab4aa1d591 req-ac1c8743-601f-45be-948c-deb9b00deb67 service nova] Acquiring lock "742d64db-c555-4517-8ec9-cef02f09a6e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-68809b80-afb3-46b1-be6e-4dab4aa1d591 req-ac1c8743-601f-45be-948c-deb9b00deb67 service nova] Lock "742d64db-c555-4517-8ec9-cef02f09a6e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-68809b80-afb3-46b1-be6e-4dab4aa1d591 req-ac1c8743-601f-45be-948c-deb9b00deb67 service nova] Lock "742d64db-c555-4517-8ec9-cef02f09a6e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG nova.compute.manager [req-68809b80-afb3-46b1-be6e-4dab4aa1d591 req-ac1c8743-601f-45be-948c-deb9b00deb67 service nova] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] No waiting events found dispatching network-vif-plugged-710ae079-0b1c-4c04-bea2-e34fd0d554ae {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:35:32 user nova-compute[75122]: WARNING nova.compute.manager [req-68809b80-afb3-46b1-be6e-4dab4aa1d591 req-ac1c8743-601f-45be-948c-deb9b00deb67 service nova] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] Received unexpected event network-vif-plugged-710ae079-0b1c-4c04-bea2-e34fd0d554ae for instance with vm_state active and task_state deleting.
Nov 15 09:35:32 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-adc52e27-bb5e-477e-95cd-ba2a925ebaf8 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-adc52e27-bb5e-477e-95cd-ba2a925ebaf8 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.363s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-adc52e27-bb5e-477e-95cd-ba2a925ebaf8 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] <== disconnect_volume: return (364ms) None {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-adc52e27-bb5e-477e-95cd-ba2a925ebaf8 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] Disconnected iSCSI Volume {{(pid=75122) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-adc52e27-bb5e-477e-95cd-ba2a925ebaf8 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] calling os-brick to detach iSCSI Volume {{(pid=75122) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-adc52e27-bb5e-477e-95cd-ba2a925ebaf8 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffa04060b80>, {'target_iqn': 'iqn.2010-10.org.openstack:3a8a33bb-713e-4109-8306-fe91fd67904f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gJQwpDVz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 09:35:32 user nova-compute[75122]: WARNING os_brick.initiator.connectors.base [None req-adc52e27-bb5e-477e-95cd-ba2a925ebaf8 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 09:35:32 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-adc52e27-bb5e-477e-95cd-ba2a925ebaf8 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-adc52e27-bb5e-477e-95cd-ba2a925ebaf8 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cc961d6-39d3-4ca8-96bd-cb7e664e6047]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bca4e77f-05f8-4ff6-8a78-6cef699f5667\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b9022bc1-82d9-4e14-9d0e-85a8b645e512\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3a8a33bb-713e-4109-8306-fe91fd67904f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:697acd7d-564d-4149-9ecf-7c7d89f10013\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:df76fc47-1a36-4bd6-97e6-bff6a6ead337\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-adc52e27-bb5e-477e-95cd-ba2a925ebaf8 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 09:35:32 user nova-compute[75122]: No targets found.
Nov 15 09:35:32 user nova-compute[75122]: iSNS:
Nov 15 09:35:32 user nova-compute[75122]: No targets found.
Nov 15 09:35:32 user nova-compute[75122]: STATIC:
Nov 15 09:35:32 user nova-compute[75122]: Target: iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16
Nov 15 09:35:32 user nova-compute[75122]:         Portal: 172.16.0.220:3260,-1
Nov 15 09:35:32 user nova-compute[75122]:                 Iface Name: default
Nov 15 09:35:32 user nova-compute[75122]: Target: iqn.2010-10.org.openstack:bca4e77f-05f8-4ff6-8a78-6cef699f5667
Nov 15 09:35:32 user nova-compute[75122]:         Portal: 172.16.0.220:3260,-1
Nov 15 09:35:32 user nova-compute[75122]:                 Iface Name: default
Nov 15 09:35:32 user nova-compute[75122]: Target: iqn.2010-10.org.openstack:b9022bc1-82d9-4e14-9d0e-85a8b645e512
Nov 15 09:35:32 user nova-compute[75122]:         Portal: 172.16.0.220:3260,-1
Nov 15 09:35:32 user nova-compute[75122]:                 Iface Name: default
Nov 15 09:35:32 user nova-compute[75122]: Target: iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e
Nov 15 09:35:32 user nova-compute[75122]:         Portal: 172.16.0.220:3260,-1
Nov 15 09:35:32 user nova-compute[75122]:                 Iface Name: default
Nov 15 09:35:32 user nova-compute[75122]: Target: iqn.2010-10.org.openstack:3a8a33bb-713e-4109-8306-fe91fd67904f
Nov 15 09:35:32 user nova-compute[75122]:         Portal: 172.16.0.220:3260,-1
Nov 15 09:35:32 user nova-compute[75122]:                 Iface Name: default
Nov 15 09:35:32 user nova-compute[75122]: Target: iqn.2010-10.org.openstack:697acd7d-564d-4149-9ecf-7c7d89f10013
Nov 15 09:35:32 user nova-compute[75122]:         Portal: 172.16.0.220:3260,-1
Nov 15 09:35:32 user nova-compute[75122]:                 Iface Name: default
Nov 15 09:35:32 user nova-compute[75122]: Target: iqn.2010-10.org.openstack:df76fc47-1a36-4bd6-97e6-bff6a6ead337
Nov 15 09:35:32 user nova-compute[75122]:         Portal: 172.16.0.220:3260,-1
Nov 15 09:35:32 user nova-compute[75122]:                 Iface Name: default
Nov 15 09:35:32 user nova-compute[75122]: FIRMWARE:
Nov 15 09:35:32 user nova-compute[75122]: No targets found.
Nov 15 09:35:32 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-adc52e27-bb5e-477e-95cd-ba2a925ebaf8 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 09:35:32 user nova-compute[75122]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 09:35:32 user nova-compute[75122]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75122) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-adc52e27-bb5e-477e-95cd-ba2a925ebaf8 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3a8a33bb-713e-4109-8306-fe91fd67904f', 0)] {{(pid=75122) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd5a6999-7cc1-4cb6-96cb-413bb79431d6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3a8a33bb-713e-4109-8306-fe91fd67904f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:697acd7d-564d-4149-9ecf-7c7d89f10013\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b9022bc1-82d9-4e14-9d0e-85a8b645e512\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bca4e77f-05f8-4ff6-8a78-6cef699f5667\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:df76fc47-1a36-4bd6-97e6-bff6a6ead337\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[72a91c15-df4c-4215-b99e-0d3df5c27d24]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bca4e77f-05f8-4ff6-8a78-6cef699f5667 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a8a33bb-713e-4109-8306-fe91fd67904f (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:697acd7d-564d-4149-9ecf-7c7d89f10013 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df76fc47-1a36-4bd6-97e6-bff6a6ead337 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9022bc1-82d9-4e14-9d0e-85a8b645e512 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e (non-flash)\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-adc52e27-bb5e-477e-95cd-ba2a925ebaf8 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bca4e77f-05f8-4ff6-8a78-6cef699f5667 (non-flash)
Nov 15 09:35:32 user nova-compute[75122]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a8a33bb-713e-4109-8306-fe91fd67904f (non-flash)
Nov 15 09:35:32 user nova-compute[75122]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16 (non-flash)
Nov 15 09:35:32 user nova-compute[75122]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:697acd7d-564d-4149-9ecf-7c7d89f10013 (non-flash)
Nov 15 09:35:32 user nova-compute[75122]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df76fc47-1a36-4bd6-97e6-bff6a6ead337 (non-flash)
Nov 15 09:35:32 user nova-compute[75122]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9022bc1-82d9-4e14-9d0e-85a8b645e512 (non-flash)
Nov 15 09:35:32 user nova-compute[75122]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e (non-flash)
Nov 15 09:35:32 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-adc52e27-bb5e-477e-95cd-ba2a925ebaf8 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bca4e77f-05f8-4ff6-8a78-6cef699f5667 (non-flash)
Nov 15 09:35:32 user nova-compute[75122]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a8a33bb-713e-4109-8306-fe91fd67904f (non-flash)
Nov 15 09:35:32 user nova-compute[75122]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16 (non-flash)
Nov 15 09:35:32 user nova-compute[75122]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:697acd7d-564d-4149-9ecf-7c7d89f10013 (non-flash)
Nov 15 09:35:32 user nova-compute[75122]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df76fc47-1a36-4bd6-97e6-bff6a6ead337 (non-flash)
Nov 15 09:35:32 user nova-compute[75122]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9022bc1-82d9-4e14-9d0e-85a8b645e512 (non-flash)
Nov 15 09:35:32 user nova-compute[75122]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e (non-flash)
Nov 15 09:35:32 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-adc52e27-bb5e-477e-95cd-ba2a925ebaf8 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff9e45ea0e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3a8a33bb-713e-4109-8306-fe91fd67904f'): ({'sdd'}, set())}) {{(pid=75122) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-adc52e27-bb5e-477e-95cd-ba2a925ebaf8 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] Removing single pathed devices sdd {{(pid=75122) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[133133f3-f6d0-43c3-953e-4f6f98876191]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[b829a3eb-b33a-4f2e-9d3e-52e662be7fdd]: (4, ('ok\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-adc52e27-bb5e-477e-95cd-ba2a925ebaf8 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] Flushing IO for device /dev/sdd {{(pid=75122) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[810ee240-aa34-421c-8a90-b57cfdbad6ea]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-adc52e27-bb5e-477e-95cd-ba2a925ebaf8 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75122) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.043s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce1405cc-a018-4f2a-9d20-c6f4f6f85d03]: (4, ('1', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-adc52e27-bb5e-477e-95cd-ba2a925ebaf8 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75122) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-adc52e27-bb5e-477e-95cd-ba2a925ebaf8 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] SCSI volumes sdd have been removed. {{(pid=75122) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-adc52e27-bb5e-477e-95cd-ba2a925ebaf8 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3a8a33bb-713e-4109-8306-fe91fd67904f')] {{(pid=75122) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a8a33bb-713e-4109-8306-fe91fd67904f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a8a33bb-713e-4109-8306-fe91fd67904f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[e496e906-2665-45ef-9df3-a43b688a6990]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-adc52e27-bb5e-477e-95cd-ba2a925ebaf8 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:35:32 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a8a33bb-713e-4109-8306-fe91fd67904f -p 172.16.0.220:3260 --logout {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:35:33 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a8a33bb-713e-4109-8306-fe91fd67904f -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:35:33 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fa0ce35-5be5-410b-b102-a0834ed90b90]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:3a8a33bb-713e-4109-8306-fe91fd67904f, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:3a8a33bb-713e-4109-8306-fe91fd67904f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:35:33 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-adc52e27-bb5e-477e-95cd-ba2a925ebaf8 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:3a8a33bb-713e-4109-8306-fe91fd67904f, portal: 172.16.0.220,3260]
Nov 15 09:35:33 user nova-compute[75122]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:3a8a33bb-713e-4109-8306-fe91fd67904f, portal: 172.16.0.220,3260] successful.
Nov 15 09:35:33 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:35:33 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a8a33bb-713e-4109-8306-fe91fd67904f -p 172.16.0.220:3260 --op delete {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:35:33 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a8a33bb-713e-4109-8306-fe91fd67904f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:35:33 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[2657f525-d9a0-4528-b106-28051844883c]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:35:33 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-adc52e27-bb5e-477e-95cd-ba2a925ebaf8 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:35:33 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-adc52e27-bb5e-477e-95cd-ba2a925ebaf8 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.317s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 09:35:33 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-adc52e27-bb5e-477e-95cd-ba2a925ebaf8 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] <== disconnect_volume: return (318ms) None {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 09:35:33 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-adc52e27-bb5e-477e-95cd-ba2a925ebaf8 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] Disconnected iSCSI Volume {{(pid=75122) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 09:35:33 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-adc52e27-bb5e-477e-95cd-ba2a925ebaf8 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] calling os-brick to detach iSCSI Volume {{(pid=75122) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 09:35:33 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-adc52e27-bb5e-477e-95cd-ba2a925ebaf8 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffa04060b80>, {'target_iqn': 'iqn.2010-10.org.openstack:bca4e77f-05f8-4ff6-8a78-6cef699f5667', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'efHIqSNO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 09:35:33 user nova-compute[75122]: WARNING os_brick.initiator.connectors.base [None req-adc52e27-bb5e-477e-95cd-ba2a925ebaf8 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 09:35:33 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-adc52e27-bb5e-477e-95cd-ba2a925ebaf8 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 09:35:33 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-adc52e27-bb5e-477e-95cd-ba2a925ebaf8 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 09:35:33 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:35:33 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:35:33 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeed0d37-cc06-4577-a5c6-99ad0fa7e990]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bca4e77f-05f8-4ff6-8a78-6cef699f5667\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b9022bc1-82d9-4e14-9d0e-85a8b645e512\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:697acd7d-564d-4149-9ecf-7c7d89f10013\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:df76fc47-1a36-4bd6-97e6-bff6a6ead337\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:35:33 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-adc52e27-bb5e-477e-95cd-ba2a925ebaf8 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 09:35:33 user nova-compute[75122]: No targets found.
Nov 15 09:35:33 user nova-compute[75122]: iSNS:
Nov 15 09:35:33 user nova-compute[75122]: No targets found.
Nov 15 09:35:33 user nova-compute[75122]: STATIC:
Nov 15 09:35:33 user nova-compute[75122]: Target: iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16
Nov 15 09:35:33 user nova-compute[75122]:         Portal: 172.16.0.220:3260,-1
Nov 15 09:35:33 user nova-compute[75122]:                 Iface Name: default
Nov 15 09:35:33 user nova-compute[75122]: Target: iqn.2010-10.org.openstack:bca4e77f-05f8-4ff6-8a78-6cef699f5667
Nov 15 09:35:33 user nova-compute[75122]:         Portal: 172.16.0.220:3260,-1
Nov 15 09:35:33 user nova-compute[75122]:                 Iface Name: default
Nov 15 09:35:33 user nova-compute[75122]: Target: iqn.2010-10.org.openstack:b9022bc1-82d9-4e14-9d0e-85a8b645e512
Nov 15 09:35:33 user nova-compute[75122]:         Portal: 172.16.0.220:3260,-1
Nov 15 09:35:33 user nova-compute[75122]:                 Iface Name: default
Nov 15 09:35:33 user nova-compute[75122]: Target: iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e
Nov 15 09:35:33 user nova-compute[75122]:         Portal: 172.16.0.220:3260,-1
Nov 15 09:35:33 user nova-compute[75122]:                 Iface Name: default
Nov 15 09:35:33 user nova-compute[75122]: Target: iqn.2010-10.org.openstack:697acd7d-564d-4149-9ecf-7c7d89f10013
Nov 15 09:35:33 user nova-compute[75122]:         Portal: 172.16.0.220:3260,-1
Nov 15 09:35:33 user nova-compute[75122]:                 Iface Name: default
Nov 15 09:35:33 user nova-compute[75122]: Target: iqn.2010-10.org.openstack:df76fc47-1a36-4bd6-97e6-bff6a6ead337
Nov 15 09:35:33 user nova-compute[75122]:         Portal: 172.16.0.220:3260,-1
Nov 15 09:35:33 user nova-compute[75122]:                 Iface Name: default
Nov 15 09:35:33 user nova-compute[75122]: FIRMWARE:
Nov 15 09:35:33 user nova-compute[75122]: No targets found.
Nov 15 09:35:33 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 09:35:33 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-adc52e27-bb5e-477e-95cd-ba2a925ebaf8 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 09:35:33 user nova-compute[75122]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 09:35:33 user nova-compute[75122]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75122) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 09:35:33 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-adc52e27-bb5e-477e-95cd-ba2a925ebaf8 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bca4e77f-05f8-4ff6-8a78-6cef699f5667', 0)] {{(pid=75122) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 09:35:33 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:35:33 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:35:33 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6f83f00-0f1e-4b9b-9b40-eb7c6df6ec04]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:697acd7d-564d-4149-9ecf-7c7d89f10013\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b9022bc1-82d9-4e14-9d0e-85a8b645e512\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bca4e77f-05f8-4ff6-8a78-6cef699f5667\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:df76fc47-1a36-4bd6-97e6-bff6a6ead337\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:35:33 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:35:33 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:35:33 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b91f3a5-a09c-4e03-92ff-ac5338f6c0d9]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bca4e77f-05f8-4ff6-8a78-6cef699f5667 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:697acd7d-564d-4149-9ecf-7c7d89f10013 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df76fc47-1a36-4bd6-97e6-bff6a6ead337 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9022bc1-82d9-4e14-9d0e-85a8b645e512 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e (non-flash)\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:35:33 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-adc52e27-bb5e-477e-95cd-ba2a925ebaf8 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bca4e77f-05f8-4ff6-8a78-6cef699f5667 (non-flash)
Nov 15 09:35:33 user nova-compute[75122]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16 (non-flash)
Nov 15 09:35:33 user nova-compute[75122]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:697acd7d-564d-4149-9ecf-7c7d89f10013 (non-flash)
Nov 15 09:35:33 user nova-compute[75122]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df76fc47-1a36-4bd6-97e6-bff6a6ead337 (non-flash)
Nov 15 09:35:33 user nova-compute[75122]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9022bc1-82d9-4e14-9d0e-85a8b645e512 (non-flash)
Nov 15 09:35:33 user nova-compute[75122]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e (non-flash)
Nov 15 09:35:33 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 09:35:33 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-adc52e27-bb5e-477e-95cd-ba2a925ebaf8 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bca4e77f-05f8-4ff6-8a78-6cef699f5667 (non-flash)
Nov 15 09:35:33 user nova-compute[75122]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16 (non-flash)
Nov 15 09:35:33 user nova-compute[75122]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:697acd7d-564d-4149-9ecf-7c7d89f10013 (non-flash)
Nov 15 09:35:33 user nova-compute[75122]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df76fc47-1a36-4bd6-97e6-bff6a6ead337 (non-flash)
Nov 15 09:35:33 user nova-compute[75122]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9022bc1-82d9-4e14-9d0e-85a8b645e512 (non-flash)
Nov 15 09:35:33 user nova-compute[75122]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e (non-flash)
Nov 15 09:35:33 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 09:35:33 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-adc52e27-bb5e-477e-95cd-ba2a925ebaf8 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff9e45ea0e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bca4e77f-05f8-4ff6-8a78-6cef699f5667'): ({'sdc'}, set())}) {{(pid=75122) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 09:35:33 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-adc52e27-bb5e-477e-95cd-ba2a925ebaf8 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] Removing single pathed devices sdc {{(pid=75122) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 09:35:33 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:35:33 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:35:33 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d137391-3f1f-408e-b1fd-d6e5dd2877c0]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:35:33 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:35:33 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.017s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:35:33 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c5cfe09-19cc-42f8-8eb3-3c8df4dbab56]: (4, ('ok\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:35:33 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-adc52e27-bb5e-477e-95cd-ba2a925ebaf8 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] Flushing IO for device /dev/sdc {{(pid=75122) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 09:35:33 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:35:33 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:35:33 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[1781ef04-8870-4bfb-9dfc-2bc78e83a2fb]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:35:33 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-adc52e27-bb5e-477e-95cd-ba2a925ebaf8 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75122) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 09:35:33 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:35:33 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.043s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:35:33 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb853c4e-28a1-47b6-a021-b4672bfd9698]: (4, ('1', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:35:33 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-adc52e27-bb5e-477e-95cd-ba2a925ebaf8 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75122) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 09:35:33 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-adc52e27-bb5e-477e-95cd-ba2a925ebaf8 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] SCSI volumes sdc have been removed. {{(pid=75122) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 09:35:33 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-adc52e27-bb5e-477e-95cd-ba2a925ebaf8 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bca4e77f-05f8-4ff6-8a78-6cef699f5667')] {{(pid=75122) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 09:35:33 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bca4e77f-05f8-4ff6-8a78-6cef699f5667 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:35:33 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bca4e77f-05f8-4ff6-8a78-6cef699f5667 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:35:33 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[83583e1f-77e9-40ff-95b3-04e31ffe4f6d]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:35:33 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-adc52e27-bb5e-477e-95cd-ba2a925ebaf8 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:35:33 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bca4e77f-05f8-4ff6-8a78-6cef699f5667 -p 172.16.0.220:3260 --logout {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:35:33 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bca4e77f-05f8-4ff6-8a78-6cef699f5667 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:35:33 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbe1b8ee-30ef-4bf7-97c2-daff58d3e094]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:bca4e77f-05f8-4ff6-8a78-6cef699f5667, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:bca4e77f-05f8-4ff6-8a78-6cef699f5667, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:35:33 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-adc52e27-bb5e-477e-95cd-ba2a925ebaf8 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:bca4e77f-05f8-4ff6-8a78-6cef699f5667, portal: 172.16.0.220,3260]
Nov 15 09:35:33 user nova-compute[75122]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:bca4e77f-05f8-4ff6-8a78-6cef699f5667, portal: 172.16.0.220,3260] successful.
Nov 15 09:35:33 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:35:33 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bca4e77f-05f8-4ff6-8a78-6cef699f5667 -p 172.16.0.220:3260 --op delete {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:35:33 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bca4e77f-05f8-4ff6-8a78-6cef699f5667 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:35:33 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[61d53618-db6e-42a6-8d00-b1491ec4c727]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:35:33 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-adc52e27-bb5e-477e-95cd-ba2a925ebaf8 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:35:33 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-adc52e27-bb5e-477e-95cd-ba2a925ebaf8 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.317s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 09:35:33 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-adc52e27-bb5e-477e-95cd-ba2a925ebaf8 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] <== disconnect_volume: return (318ms) None {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 09:35:33 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-adc52e27-bb5e-477e-95cd-ba2a925ebaf8 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] Disconnected iSCSI Volume {{(pid=75122) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 09:35:33 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-adc52e27-bb5e-477e-95cd-ba2a925ebaf8 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] Deleting instance files /opt/stack/data/nova/instances/742d64db-c555-4517-8ec9-cef02f09a6e0_del
Nov 15 09:35:33 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-adc52e27-bb5e-477e-95cd-ba2a925ebaf8 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] Deletion of /opt/stack/data/nova/instances/742d64db-c555-4517-8ec9-cef02f09a6e0_del complete
Nov 15 09:35:33 user nova-compute[75122]: INFO nova.compute.manager [None req-adc52e27-bb5e-477e-95cd-ba2a925ebaf8 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] Took 3.92 seconds to destroy the instance on the hypervisor.
Nov 15 09:35:33 user nova-compute[75122]: DEBUG oslo.service.loopingcall [None req-adc52e27-bb5e-477e-95cd-ba2a925ebaf8 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75122) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 09:35:33 user nova-compute[75122]: DEBUG nova.compute.manager [-] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] Deallocating network for instance {{(pid=75122) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 09:35:33 user nova-compute[75122]: DEBUG nova.network.neutron [-] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] deallocate_for_instance() {{(pid=75122) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 09:35:35 user nova-compute[75122]: DEBUG nova.compute.manager [req-a3e6a739-d9a0-4527-9938-8fc9cdb90da6 req-3c3e271d-2fe4-496c-8cde-5ffdbde7a554 service nova] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] Received event network-vif-deleted-5bf17322-fd6b-4335-9a8e-56e7cd64e180 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:35:35 user nova-compute[75122]: INFO nova.compute.manager [req-a3e6a739-d9a0-4527-9938-8fc9cdb90da6 req-3c3e271d-2fe4-496c-8cde-5ffdbde7a554 service nova] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] Neutron deleted interface 5bf17322-fd6b-4335-9a8e-56e7cd64e180; detaching it from the instance and deleting it from the info cache
Nov 15 09:35:35 user nova-compute[75122]: DEBUG nova.network.neutron [req-a3e6a739-d9a0-4527-9938-8fc9cdb90da6 req-3c3e271d-2fe4-496c-8cde-5ffdbde7a554 service nova] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] Updating instance_info_cache with network_info: [{"id": "7febe2f1-4891-4ad4-ac59-58edfd3d2f03", "address": "fa:16:3e:ec:cb:a9", "network": {"id": "63134c25-66d5-4030-bbf0-b2a2e259df84", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2071889805-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "641f0acd05d8403882a4f6b1b28e9269", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7febe2f1-48", "ovs_interfaceid": "7febe2f1-4891-4ad4-ac59-58edfd3d2f03", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d8bfb09a-3733-4176-beec-aaa512b4ed8c", "address": "fa:16:3e:89:bb:49", "network": {"id": "3bb75c40-fc07-4bf2-8a8a-9f58cd457b67", "bridge": "br-int", "label": "tempest-device-tagging-net1-1158401388", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.130", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "641f0acd05d8403882a4f6b1b28e9269", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8bfb09a-37", "ovs_interfaceid": "d8bfb09a-3733-4176-beec-aaa512b4ed8c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "eaecb293-c647-47d7-8103-6fb8851477f3", "address": "fa:16:3e:3c:b2:b8", "network": {"id": "3bb75c40-fc07-4bf2-8a8a-9f58cd457b67", "bridge": "br-int", "label": "tempest-device-tagging-net1-1158401388", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.163", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "641f0acd05d8403882a4f6b1b28e9269", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeaecb293-c6", "ovs_interfaceid": "eaecb293-c647-47d7-8103-6fb8851477f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5ebcafd9-6939-4928-ae2f-38ec38e15876", "address": "fa:16:3e:ec:d2:98", "network": {"id": "3bb75c40-fc07-4bf2-8a8a-9f58cd457b67", "bridge": "br-int", "label": "tempest-device-tagging-net1-1158401388", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.29", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "641f0acd05d8403882a4f6b1b28e9269", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ebcafd9-69", "ovs_interfaceid": "5ebcafd9-6939-4928-ae2f-38ec38e15876", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "710ae079-0b1c-4c04-bea2-e34fd0d554ae", "address": "fa:16:3e:0e:e7:01", "network": {"id": "b4709ef9-ae05-4eac-b530-da89c65fd367", "bridge": "br-int", "label": "tempest-device-tagging-net2-314948697", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "641f0acd05d8403882a4f6b1b28e9269", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap710ae079-0b", "ovs_interfaceid": "710ae079-0b1c-4c04-bea2-e34fd0d554ae", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d378cd7b-d582-4062-a714-d4456d71ba5f", "address": "fa:16:3e:e1:90:72", "network": {"id": "b4709ef9-ae05-4eac-b530-da89c65fd367", "bridge": "br-int", "label": "tempest-device-tagging-net2-314948697", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "641f0acd05d8403882a4f6b1b28e9269", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd378cd7b-d5", "ovs_interfaceid": "d378cd7b-d582-4062-a714-d4456d71ba5f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:35:35 user nova-compute[75122]: DEBUG nova.compute.manager [req-a3e6a739-d9a0-4527-9938-8fc9cdb90da6 req-3c3e271d-2fe4-496c-8cde-5ffdbde7a554 service nova] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] Detach interface failed, port_id=5bf17322-fd6b-4335-9a8e-56e7cd64e180, reason: Instance 742d64db-c555-4517-8ec9-cef02f09a6e0 could not be found. {{(pid=75122) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 09:35:35 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:35:36 user nova-compute[75122]: DEBUG nova.network.neutron [-] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] Updating instance_info_cache with network_info: [] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:35:36 user nova-compute[75122]: INFO nova.compute.manager [-] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] Took 2.99 seconds to deallocate network for instance.
Nov 15 09:35:37 user nova-compute[75122]: DEBUG nova.compute.manager [req-4f526257-24d9-46d0-8f97-5b8a35ef3699 req-47550b21-2029-4c5e-8ace-281166cb8a9a service nova] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] Received event network-vif-deleted-710ae079-0b1c-4c04-bea2-e34fd0d554ae {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:35:37 user nova-compute[75122]: DEBUG nova.compute.manager [req-4f526257-24d9-46d0-8f97-5b8a35ef3699 req-47550b21-2029-4c5e-8ace-281166cb8a9a service nova] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] Received event network-vif-deleted-5ebcafd9-6939-4928-ae2f-38ec38e15876 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:35:37 user nova-compute[75122]: DEBUG nova.compute.manager [req-4f526257-24d9-46d0-8f97-5b8a35ef3699 req-47550b21-2029-4c5e-8ace-281166cb8a9a service nova] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] Received event network-vif-deleted-7febe2f1-4891-4ad4-ac59-58edfd3d2f03 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:35:37 user nova-compute[75122]: DEBUG nova.compute.manager [req-4f526257-24d9-46d0-8f97-5b8a35ef3699 req-47550b21-2029-4c5e-8ace-281166cb8a9a service nova] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] Received event network-vif-deleted-d378cd7b-d582-4062-a714-d4456d71ba5f {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:35:37 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:35:38 user nova-compute[75122]: INFO nova.compute.manager [None req-adc52e27-bb5e-477e-95cd-ba2a925ebaf8 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] [instance: 742d64db-c555-4517-8ec9-cef02f09a6e0] Took 2.50 seconds to detach 3 volumes for instance.
Nov 15 09:35:39 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-adc52e27-bb5e-477e-95cd-ba2a925ebaf8 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:35:39 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-adc52e27-bb5e-477e-95cd-ba2a925ebaf8 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:35:39 user nova-compute[75122]: DEBUG nova.compute.provider_tree [None req-adc52e27-bb5e-477e-95cd-ba2a925ebaf8 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] Inventory has not changed in ProviderTree for provider: 69a3da65-47be-44c6-b67c-c692b58284ef {{(pid=75122) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 09:35:39 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-adc52e27-bb5e-477e-95cd-ba2a925ebaf8 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] Inventory has not changed for provider 69a3da65-47be-44c6-b67c-c692b58284ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 09:35:39 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-adc52e27-bb5e-477e-95cd-ba2a925ebaf8 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.520s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:35:39 user nova-compute[75122]: INFO nova.scheduler.client.report [None req-adc52e27-bb5e-477e-95cd-ba2a925ebaf8 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] Deleted allocations for instance 742d64db-c555-4517-8ec9-cef02f09a6e0
Nov 15 09:35:39 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-adc52e27-bb5e-477e-95cd-ba2a925ebaf8 tempest-TaggedBootDevicesTest-238803034 tempest-TaggedBootDevicesTest-238803034-project-member] Lock "742d64db-c555-4517-8ec9-cef02f09a6e0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 10.125s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:35:40 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:35:42 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:35:45 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:35:47 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:35:50 user nova-compute[75122]: DEBUG nova.compute.manager [req-1743f3a4-6001-4592-ab73-339ec721008b req-344cae05-9c66-42ec-abea-41a1731af667 service nova] [instance: 7cfd4155-c4b3-4cce-91e5-042cafccab8b] Received event network-changed-3066e71b-c5d6-4e46-980c-2b0d42739f95 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:35:50 user nova-compute[75122]: DEBUG nova.compute.manager [req-1743f3a4-6001-4592-ab73-339ec721008b req-344cae05-9c66-42ec-abea-41a1731af667 service nova] [instance: 7cfd4155-c4b3-4cce-91e5-042cafccab8b] Refreshing instance network info cache due to event network-changed-3066e71b-c5d6-4e46-980c-2b0d42739f95. {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 09:35:50 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-1743f3a4-6001-4592-ab73-339ec721008b req-344cae05-9c66-42ec-abea-41a1731af667 service nova] Acquiring lock "refresh_cache-7cfd4155-c4b3-4cce-91e5-042cafccab8b" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 09:35:50 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-1743f3a4-6001-4592-ab73-339ec721008b req-344cae05-9c66-42ec-abea-41a1731af667 service nova] Acquired lock "refresh_cache-7cfd4155-c4b3-4cce-91e5-042cafccab8b" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 09:35:50 user nova-compute[75122]: DEBUG nova.network.neutron [req-1743f3a4-6001-4592-ab73-339ec721008b req-344cae05-9c66-42ec-abea-41a1731af667 service nova] [instance: 7cfd4155-c4b3-4cce-91e5-042cafccab8b] Refreshing network info cache for port 3066e71b-c5d6-4e46-980c-2b0d42739f95 {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 09:35:50 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:35:50 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-b741a058-fdb4-4c33-9922-28d3ac47bf68 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Acquiring lock "7cfd4155-c4b3-4cce-91e5-042cafccab8b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:35:50 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-b741a058-fdb4-4c33-9922-28d3ac47bf68 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Lock "7cfd4155-c4b3-4cce-91e5-042cafccab8b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:35:50 user nova-compute[75122]: DEBUG nova.objects.instance [None req-b741a058-fdb4-4c33-9922-28d3ac47bf68 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Lazy-loading 'flavor' on Instance uuid 7cfd4155-c4b3-4cce-91e5-042cafccab8b {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:35:50 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-b741a058-fdb4-4c33-9922-28d3ac47bf68 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Lock "7cfd4155-c4b3-4cce-91e5-042cafccab8b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:35:50 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-b741a058-fdb4-4c33-9922-28d3ac47bf68 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Acquiring lock "7cfd4155-c4b3-4cce-91e5-042cafccab8b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:35:50 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-b741a058-fdb4-4c33-9922-28d3ac47bf68 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Lock "7cfd4155-c4b3-4cce-91e5-042cafccab8b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:35:50 user nova-compute[75122]: INFO nova.compute.manager [None req-b741a058-fdb4-4c33-9922-28d3ac47bf68 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] [instance: 7cfd4155-c4b3-4cce-91e5-042cafccab8b] Attaching volume 7524fa0e-0e0f-4da0-bd00-7f099a8a55e8 to /dev/vdb
Nov 15 09:35:50 user nova-compute[75122]: DEBUG nova.network.neutron [req-1743f3a4-6001-4592-ab73-339ec721008b req-344cae05-9c66-42ec-abea-41a1731af667 service nova] [instance: 7cfd4155-c4b3-4cce-91e5-042cafccab8b] Updated VIF entry in instance network info cache for port 3066e71b-c5d6-4e46-980c-2b0d42739f95. {{(pid=75122) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 09:35:50 user nova-compute[75122]: DEBUG nova.network.neutron [req-1743f3a4-6001-4592-ab73-339ec721008b req-344cae05-9c66-42ec-abea-41a1731af667 service nova] [instance: 7cfd4155-c4b3-4cce-91e5-042cafccab8b] Updating instance_info_cache with network_info: [{"id": "3066e71b-c5d6-4e46-980c-2b0d42739f95", "address": "fa:16:3e:e1:ad:0f", "network": {"id": "6e846655-a6f8-4339-a239-65d2f94c8b74", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1923452032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b8e67f8a66a4930be3fb65c397cbeb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3066e71b-c5", "ovs_interfaceid": "3066e71b-c5d6-4e46-980c-2b0d42739f95", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:35:50 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-1743f3a4-6001-4592-ab73-339ec721008b req-344cae05-9c66-42ec-abea-41a1731af667 service nova] Releasing lock "refresh_cache-7cfd4155-c4b3-4cce-91e5-042cafccab8b" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 09:35:50 user nova-compute[75122]: DEBUG os_brick.utils [None req-b741a058-fdb4-4c33-9922-28d3ac47bf68 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 09:35:50 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:35:51 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:35:51 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[15e813fc-e2ad-495b-87ab-e6ecef1d8eff]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:742fb64b3587\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:35:51 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:35:51 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.027s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:35:51 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[166f39b4-f22c-4df4-91ec-a59a941c54df]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:35:51 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:35:51 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:35:51 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[be75b1f9-9cd4-4137-8fd8-54cb995d60dd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:35:51 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[653eb3d9-8d5c-47e1-a911-97eb04a85e1d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:35:51 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-b741a058-fdb4-4c33-9922-28d3ac47bf68 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Running cmd (subprocess): nvme version {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:35:51 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-b741a058-fdb4-4c33-9922-28d3ac47bf68 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] 'nvme version' failed. Not Retrying. {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 09:35:51 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b741a058-fdb4-4c33-9922-28d3ac47bf68 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] nvme not present on system {{(pid=75122) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 09:35:51 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:35:51 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 09:35:51 user nova-compute[75122]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 09:35:51 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[325de8aa-11d5-4171-bed6-f38f5ec6ef3e]: (4, '') {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:35:51 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.lightos [None req-b741a058-fdb4-4c33-9922-28d3ac47bf68 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75122) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 09:35:51 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.lightos [None req-b741a058-fdb4-4c33-9922-28d3ac47bf68 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75122) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 09:35:51 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.lightos [None req-b741a058-fdb4-4c33-9922-28d3ac47bf68 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] LIGHTOS: no hostnqn found. {{(pid=75122) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 09:35:51 user nova-compute[75122]: DEBUG os_brick.utils [None req-b741a058-fdb4-4c33-9922-28d3ac47bf68 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:742fb64b3587', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 09:35:51 user nova-compute[75122]: DEBUG nova.virt.block_device [None req-b741a058-fdb4-4c33-9922-28d3ac47bf68 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] [instance: 7cfd4155-c4b3-4cce-91e5-042cafccab8b] Updating existing volume attachment record: 5913c34f-20d7-4ee4-a3f7-ecdc24a254f1 {{(pid=75122) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 09:35:52 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:35:55 user nova-compute[75122]: DEBUG nova.network.neutron [None req-6c573712-7d5d-4929-96e9-6f0edcc07ce2 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] [instance: ee961d5a-e0d1-4931-9293-eefbe638097a] Port ae8a9c5e-17d1-4aa9-b3fa-b829d1dc6fd2 binding to destination host user is already ACTIVE {{(pid=75122) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 15 09:35:55 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-6c573712-7d5d-4929-96e9-6f0edcc07ce2 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Acquiring lock "refresh_cache-ee961d5a-e0d1-4931-9293-eefbe638097a" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 09:35:55 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-6c573712-7d5d-4929-96e9-6f0edcc07ce2 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Acquired lock "refresh_cache-ee961d5a-e0d1-4931-9293-eefbe638097a" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 09:35:55 user nova-compute[75122]: DEBUG nova.network.neutron [None req-6c573712-7d5d-4929-96e9-6f0edcc07ce2 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] [instance: ee961d5a-e0d1-4931-9293-eefbe638097a] Building network info cache for instance {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 09:35:55 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:35:55 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b741a058-fdb4-4c33-9922-28d3ac47bf68 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] [instance: 7cfd4155-c4b3-4cce-91e5-042cafccab8b] Calling os-brick to attach iSCSI Volume {{(pid=75122) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 09:35:55 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-b741a058-fdb4-4c33-9922-28d3ac47bf68 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffa04060b80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7524fa0e-0e0f-4da0-bd00-7f099a8a55e8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gJBOlMUQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 09:35:55 user nova-compute[75122]: WARNING os_brick.initiator.connectors.base [None req-b741a058-fdb4-4c33-9922-28d3ac47bf68 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 09:35:55 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-b741a058-fdb4-4c33-9922-28d3ac47bf68 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 09:35:55 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-b741a058-fdb4-4c33-9922-28d3ac47bf68 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 09:35:55 user nova-compute[75122]: WARNING os_brick.initiator.connectors.base [None req-b741a058-fdb4-4c33-9922-28d3ac47bf68 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 09:35:55 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-b741a058-fdb4-4c33-9922-28d3ac47bf68 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7524fa0e-0e0f-4da0-bd00-7f099a8a55e8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 09:35:55 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-b741a058-fdb4-4c33-9922-28d3ac47bf68 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7524fa0e-0e0f-4da0-bd00-7f099a8a55e8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 09:35:55 user nova-compute[75122]: INFO os_brick.initiator.connectors.iscsi [None req-b741a058-fdb4-4c33-9922-28d3ac47bf68 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 09:35:55 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7524fa0e-0e0f-4da0-bd00-7f099a8a55e8 -p 172.16.0.220:3260 {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:35:55 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7524fa0e-0e0f-4da0-bd00-7f099a8a55e8 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:35:55 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[f827640b-438b-49c5-9171-558704d040c0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:35:55 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-b741a058-fdb4-4c33-9922-28d3ac47bf68 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 09:35:55 user nova-compute[75122]:  {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:35:55 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7524fa0e-0e0f-4da0-bd00-7f099a8a55e8 -p 172.16.0.220:3260 --interface default --op new {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:35:55 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7524fa0e-0e0f-4da0-bd00-7f099a8a55e8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:35:55 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[9baeeab3-cbea-41d1-81d7-5c6bf1426e4e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7524fa0e-0e0f-4da0-bd00-7f099a8a55e8] added\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:35:55 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-b741a058-fdb4-4c33-9922-28d3ac47bf68 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7524fa0e-0e0f-4da0-bd00-7f099a8a55e8] added
Nov 15 09:35:55 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:35:55 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7524fa0e-0e0f-4da0-bd00-7f099a8a55e8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:35:55 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7524fa0e-0e0f-4da0-bd00-7f099a8a55e8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:35:55 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[68011f57-0524-4893-a62a-a16afcea0a4d]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:35:55 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-b741a058-fdb4-4c33-9922-28d3ac47bf68 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:35:55 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7524fa0e-0e0f-4da0-bd00-7f099a8a55e8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:35:55 user nova-compute[75122]: DEBUG nova.network.neutron [None req-6c573712-7d5d-4929-96e9-6f0edcc07ce2 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] [instance: ee961d5a-e0d1-4931-9293-eefbe638097a] Updating instance_info_cache with network_info: [{"id": "ae8a9c5e-17d1-4aa9-b3fa-b829d1dc6fd2", "address": "fa:16:3e:7d:98:85", "network": {"id": "44caed16-406b-4a76-966a-0dc42b26f133", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-465582303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d672b8845fa849d99e328521d3d1715b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae8a9c5e-17", "ovs_interfaceid": "ae8a9c5e-17d1-4aa9-b3fa-b829d1dc6fd2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:35:55 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-6c573712-7d5d-4929-96e9-6f0edcc07ce2 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Releasing lock "refresh_cache-ee961d5a-e0d1-4931-9293-eefbe638097a" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 09:35:55 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7524fa0e-0e0f-4da0-bd00-7f099a8a55e8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:35:55 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f9d9696-984b-4c1e-8111-6bfad065b428]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:35:55 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-b741a058-fdb4-4c33-9922-28d3ac47bf68 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:35:55 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7524fa0e-0e0f-4da0-bd00-7f099a8a55e8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gJBOlMUQ {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:35:55 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-6c573712-7d5d-4929-96e9-6f0edcc07ce2 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] [instance: ee961d5a-e0d1-4931-9293-eefbe638097a] Creating tmpfile /opt/stack/data/nova/instances/ee961d5a-e0d1-4931-9293-eefbe638097a/tmpbikavclo to verify with other compute node that the instance is on the same shared storage. {{(pid=75122) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9628}}
Nov 15 09:35:55 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7524fa0e-0e0f-4da0-bd00-7f099a8a55e8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gJBOlMUQ" returned: 0 in 0.020s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:35:55 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3af00c1-d655-47d0-a9a7-24571966ddeb]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:35:55 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-b741a058-fdb4-4c33-9922-28d3ac47bf68 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gJBOlMUQ'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:35:55 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7524fa0e-0e0f-4da0-bd00-7f099a8a55e8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:35:55 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7524fa0e-0e0f-4da0-bd00-7f099a8a55e8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:35:55 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[593751f4-6548-4b1a-8ec7-b9f43094d1f6]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:35:55 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-b741a058-fdb4-4c33-9922-28d3ac47bf68 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:35:55 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:35:55 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:35:55 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b2e6780-801c-4325-af5b-d565dd86f620]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:697acd7d-564d-4149-9ecf-7c7d89f10013 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df76fc47-1a36-4bd6-97e6-bff6a6ead337 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9022bc1-82d9-4e14-9d0e-85a8b645e512 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e (non-flash)\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:35:55 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-b741a058-fdb4-4c33-9922-28d3ac47bf68 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16 (non-flash)
Nov 15 09:35:55 user nova-compute[75122]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:697acd7d-564d-4149-9ecf-7c7d89f10013 (non-flash)
Nov 15 09:35:55 user nova-compute[75122]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df76fc47-1a36-4bd6-97e6-bff6a6ead337 (non-flash)
Nov 15 09:35:55 user nova-compute[75122]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9022bc1-82d9-4e14-9d0e-85a8b645e512 (non-flash)
Nov 15 09:35:55 user nova-compute[75122]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e (non-flash)
Nov 15 09:35:55 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 09:35:55 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-b741a058-fdb4-4c33-9922-28d3ac47bf68 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16 (non-flash)
Nov 15 09:35:55 user nova-compute[75122]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:697acd7d-564d-4149-9ecf-7c7d89f10013 (non-flash)
Nov 15 09:35:55 user nova-compute[75122]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df76fc47-1a36-4bd6-97e6-bff6a6ead337 (non-flash)
Nov 15 09:35:55 user nova-compute[75122]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9022bc1-82d9-4e14-9d0e-85a8b645e512 (non-flash)
Nov 15 09:35:55 user nova-compute[75122]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e (non-flash)
Nov 15 09:35:55 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 09:35:55 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7524fa0e-0e0f-4da0-bd00-7f099a8a55e8 -p 172.16.0.220:3260 --login {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:35:55 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:35:55 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:35:55 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:35:55 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7524fa0e-0e0f-4da0-bd00-7f099a8a55e8 -p 172.16.0.220:3260 --login" returned: 0 in 0.080s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:35:55 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[466cbbe5-cd1c-47f9-a5b8-d58cae495969]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7524fa0e-0e0f-4da0-bd00-7f099a8a55e8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7524fa0e-0e0f-4da0-bd00-7f099a8a55e8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:35:55 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-b741a058-fdb4-4c33-9922-28d3ac47bf68 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7524fa0e-0e0f-4da0-bd00-7f099a8a55e8, portal: 172.16.0.220,3260]
Nov 15 09:35:55 user nova-compute[75122]: Login to [iface: default, target: iqn.2010-10.org.openstack:7524fa0e-0e0f-4da0-bd00-7f099a8a55e8, portal: 172.16.0.220,3260] successful.
Nov 15 09:35:55 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:35:55 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7524fa0e-0e0f-4da0-bd00-7f099a8a55e8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:35:55 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7524fa0e-0e0f-4da0-bd00-7f099a8a55e8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:35:55 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9f4b54a-e62c-4b37-ab5c-4021a943f4aa]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:35:55 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-b741a058-fdb4-4c33-9922-28d3ac47bf68 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:35:55 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:35:55 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:35:55 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:35:55 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[9543fc07-6c20-456a-b235-fdff2408b22b]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:697acd7d-564d-4149-9ecf-7c7d89f10013 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df76fc47-1a36-4bd6-97e6-bff6a6ead337 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9022bc1-82d9-4e14-9d0e-85a8b645e512 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7524fa0e-0e0f-4da0-bd00-7f099a8a55e8 (non-flash)\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:35:55 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-b741a058-fdb4-4c33-9922-28d3ac47bf68 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16 (non-flash)
Nov 15 09:35:55 user nova-compute[75122]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:697acd7d-564d-4149-9ecf-7c7d89f10013 (non-flash)
Nov 15 09:35:55 user nova-compute[75122]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df76fc47-1a36-4bd6-97e6-bff6a6ead337 (non-flash)
Nov 15 09:35:55 user nova-compute[75122]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9022bc1-82d9-4e14-9d0e-85a8b645e512 (non-flash)
Nov 15 09:35:55 user nova-compute[75122]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e (non-flash)
Nov 15 09:35:55 user nova-compute[75122]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7524fa0e-0e0f-4da0-bd00-7f099a8a55e8 (non-flash)
Nov 15 09:35:55 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 09:35:55 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-b741a058-fdb4-4c33-9922-28d3ac47bf68 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16 (non-flash)
Nov 15 09:35:55 user nova-compute[75122]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:697acd7d-564d-4149-9ecf-7c7d89f10013 (non-flash)
Nov 15 09:35:55 user nova-compute[75122]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df76fc47-1a36-4bd6-97e6-bff6a6ead337 (non-flash)
Nov 15 09:35:55 user nova-compute[75122]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9022bc1-82d9-4e14-9d0e-85a8b645e512 (non-flash)
Nov 15 09:35:55 user nova-compute[75122]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e (non-flash)
Nov 15 09:35:55 user nova-compute[75122]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7524fa0e-0e0f-4da0-bd00-7f099a8a55e8 (non-flash)
Nov 15 09:35:55 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 09:35:55 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-b741a058-fdb4-4c33-9922-28d3ac47bf68 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7524fa0e-0e0f-4da0-bd00-7f099a8a55e8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.320s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 09:35:55 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-b741a058-fdb4-4c33-9922-28d3ac47bf68 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Connected to 172.16.0.220:3260 {{(pid=75122) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 09:35:55 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-b741a058-fdb4-4c33-9922-28d3ac47bf68 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] HCTL ('33', '-', '-', 0) found on session 22 with lun 0 {{(pid=75122) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 09:35:55 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-b741a058-fdb4-4c33-9922-28d3ac47bf68 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75122) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 09:35:56 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:35:56 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:35:56 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[be7ea67c-52c4-4729-af35-f55f995ae1b7]: (4, ('- - 0', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:35:56 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-b741a058-fdb4-4c33-9922-28d3ac47bf68 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Searching for a device in session 22 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75122) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 09:35:56 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-b741a058-fdb4-4c33-9922-28d3ac47bf68 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:7524fa0e-0e0f-4da0-bd00-7f099a8a55e8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gJBOlMUQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75122) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 09:35:56 user nova-compute[75122]: DEBUG nova.compute.manager [req-53f7232b-b1c9-4ecc-a70e-68f36a21bf27 req-2f950104-24cc-4e5e-b9ce-bff2c774425e service nova] [instance: ee961d5a-e0d1-4931-9293-eefbe638097a] Received event network-vif-unplugged-ae8a9c5e-17d1-4aa9-b3fa-b829d1dc6fd2 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:35:56 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-53f7232b-b1c9-4ecc-a70e-68f36a21bf27 req-2f950104-24cc-4e5e-b9ce-bff2c774425e service nova] Acquiring lock "ee961d5a-e0d1-4931-9293-eefbe638097a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:35:56 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-53f7232b-b1c9-4ecc-a70e-68f36a21bf27 req-2f950104-24cc-4e5e-b9ce-bff2c774425e service nova] Lock "ee961d5a-e0d1-4931-9293-eefbe638097a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:35:56 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-53f7232b-b1c9-4ecc-a70e-68f36a21bf27 req-2f950104-24cc-4e5e-b9ce-bff2c774425e service nova] Lock "ee961d5a-e0d1-4931-9293-eefbe638097a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:35:56 user nova-compute[75122]: DEBUG nova.compute.manager [req-53f7232b-b1c9-4ecc-a70e-68f36a21bf27 req-2f950104-24cc-4e5e-b9ce-bff2c774425e service nova] [instance: ee961d5a-e0d1-4931-9293-eefbe638097a] No waiting events found dispatching network-vif-unplugged-ae8a9c5e-17d1-4aa9-b3fa-b829d1dc6fd2 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:35:56 user nova-compute[75122]: WARNING nova.compute.manager [req-53f7232b-b1c9-4ecc-a70e-68f36a21bf27 req-2f950104-24cc-4e5e-b9ce-bff2c774425e service nova] [instance: ee961d5a-e0d1-4931-9293-eefbe638097a] Received unexpected event network-vif-unplugged-ae8a9c5e-17d1-4aa9-b3fa-b829d1dc6fd2 for instance with vm_state resized and task_state resize_reverting.
Nov 15 09:35:56 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:35:56 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:35:56 user nova-compute[75122]: INFO nova.virt.libvirt.driver [-] [instance: ee961d5a-e0d1-4931-9293-eefbe638097a] Instance destroyed successfully.
Nov 15 09:35:56 user nova-compute[75122]: DEBUG nova.objects.instance [None req-6c573712-7d5d-4929-96e9-6f0edcc07ce2 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Lazy-loading 'resources' on Instance uuid ee961d5a-e0d1-4931-9293-eefbe638097a {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:35:56 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-6c573712-7d5d-4929-96e9-6f0edcc07ce2 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T09:30:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-79968674',display_name='tempest-ServerActionsTestOtherB-server-79968674',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-79968674',id=2,image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJiK6B7/Kn/Opurq4zSOmiWq8yh0HkUVgNM/DkoeYxKo1kQJMVcwOjFbHB9+CscyIIndFz0uf8CUeGmaOLp83QTM6njH0bbr1gC12yHMNGMet8mqfmXy8CIGmj4KMayIOw==',key_name='tempest-keypair-1064498524',keypairs=<?>,launch_index=0,launched_at=2023-11-15T09:34:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d672b8845fa849d99e328521d3d1715b',ramdisk_id='',reservation_id='r-32nlhypw',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-279691748',owner_user_name='tempest-ServerActionsTestOtherB-279691748-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T09:34:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c9bf6f2e607842889cd6593ba114cfc3',uuid=ee961d5a-e0d1-4931-9293-eefbe638097a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "ae8a9c5e-17d1-4aa9-b3fa-b829d1dc6fd2", "address": "fa:16:3e:7d:98:85", "network": {"id": "44caed16-406b-4a76-966a-0dc42b26f133", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-465582303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d672b8845fa849d99e328521d3d1715b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae8a9c5e-17", "ovs_interfaceid": "ae8a9c5e-17d1-4aa9-b3fa-b829d1dc6fd2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 09:35:56 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-6c573712-7d5d-4929-96e9-6f0edcc07ce2 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Converting VIF {"id": "ae8a9c5e-17d1-4aa9-b3fa-b829d1dc6fd2", "address": "fa:16:3e:7d:98:85", "network": {"id": "44caed16-406b-4a76-966a-0dc42b26f133", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-465582303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d672b8845fa849d99e328521d3d1715b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae8a9c5e-17", "ovs_interfaceid": "ae8a9c5e-17d1-4aa9-b3fa-b829d1dc6fd2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 09:35:56 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-6c573712-7d5d-4929-96e9-6f0edcc07ce2 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7d:98:85,bridge_name='br-int',has_traffic_filtering=True,id=ae8a9c5e-17d1-4aa9-b3fa-b829d1dc6fd2,network=Network(44caed16-406b-4a76-966a-0dc42b26f133),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae8a9c5e-17') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 09:35:56 user nova-compute[75122]: DEBUG os_vif [None req-6c573712-7d5d-4929-96e9-6f0edcc07ce2 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7d:98:85,bridge_name='br-int',has_traffic_filtering=True,id=ae8a9c5e-17d1-4aa9-b3fa-b829d1dc6fd2,network=Network(44caed16-406b-4a76-966a-0dc42b26f133),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae8a9c5e-17') {{(pid=75122) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 09:35:56 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:35:56 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapae8a9c5e-17, bridge=br-int, if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:35:56 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:35:56 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:35:56 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:35:56 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=874e2e40-31c1-469c-a1d9-10ce1dc4fe84) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:35:56 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:35:56 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:35:56 user nova-compute[75122]: INFO os_vif [None req-6c573712-7d5d-4929-96e9-6f0edcc07ce2 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7d:98:85,bridge_name='br-int',has_traffic_filtering=True,id=ae8a9c5e-17d1-4aa9-b3fa-b829d1dc6fd2,network=Network(44caed16-406b-4a76-966a-0dc42b26f133),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae8a9c5e-17')
Nov 15 09:35:56 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6c573712-7d5d-4929-96e9-6f0edcc07ce2 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] [instance: ee961d5a-e0d1-4931-9293-eefbe638097a] calling os-brick to detach iSCSI Volume {{(pid=75122) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 09:35:56 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c573712-7d5d-4929-96e9-6f0edcc07ce2 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffa04060b80>, {'target_iqn': 'iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BFRblrMm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 09:35:56 user nova-compute[75122]: WARNING os_brick.initiator.connectors.base [None req-6c573712-7d5d-4929-96e9-6f0edcc07ce2 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 09:35:56 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-6c573712-7d5d-4929-96e9-6f0edcc07ce2 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 09:35:57 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-b741a058-fdb4-4c33-9922-28d3ac47bf68 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.358s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 09:35:57 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-b741a058-fdb4-4c33-9922-28d3ac47bf68 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] <== connect_volume: return (1359ms) {'type': 'block', 'scsi_wwn': '23334383862376266', 'path': '/dev/sdb'} {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 09:35:57 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b741a058-fdb4-4c33-9922-28d3ac47bf68 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] [instance: 7cfd4155-c4b3-4cce-91e5-042cafccab8b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23334383862376266', 'path': '/dev/sdb'} {{(pid=75122) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 09:35:57 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-6c573712-7d5d-4929-96e9-6f0edcc07ce2 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.418s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 09:35:57 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:35:57 user nova-compute[75122]: DEBUG nova.objects.instance [None req-b741a058-fdb4-4c33-9922-28d3ac47bf68 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Lazy-loading 'flavor' on Instance uuid 7cfd4155-c4b3-4cce-91e5-042cafccab8b {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:35:57 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:35:57 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[98e2b239-1697-4b80-b80c-a2e05fd10d60]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7524fa0e-0e0f-4da0-bd00-7f099a8a55e8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b9022bc1-82d9-4e14-9d0e-85a8b645e512\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:697acd7d-564d-4149-9ecf-7c7d89f10013\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:df76fc47-1a36-4bd6-97e6-bff6a6ead337\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:35:57 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c573712-7d5d-4929-96e9-6f0edcc07ce2 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 09:35:57 user nova-compute[75122]: No targets found.
Nov 15 09:35:57 user nova-compute[75122]: iSNS:
Nov 15 09:35:57 user nova-compute[75122]: No targets found.
Nov 15 09:35:57 user nova-compute[75122]: STATIC:
Nov 15 09:35:57 user nova-compute[75122]: Target: iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16
Nov 15 09:35:57 user nova-compute[75122]:         Portal: 172.16.0.220:3260,-1
Nov 15 09:35:57 user nova-compute[75122]:                 Iface Name: default
Nov 15 09:35:57 user nova-compute[75122]: Target: iqn.2010-10.org.openstack:7524fa0e-0e0f-4da0-bd00-7f099a8a55e8
Nov 15 09:35:57 user nova-compute[75122]:         Portal: 172.16.0.220:3260,-1
Nov 15 09:35:57 user nova-compute[75122]:                 Iface Name: default
Nov 15 09:35:57 user nova-compute[75122]: Target: iqn.2010-10.org.openstack:b9022bc1-82d9-4e14-9d0e-85a8b645e512
Nov 15 09:35:57 user nova-compute[75122]:         Portal: 172.16.0.220:3260,-1
Nov 15 09:35:57 user nova-compute[75122]:                 Iface Name: default
Nov 15 09:35:57 user nova-compute[75122]: Target: iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e
Nov 15 09:35:57 user nova-compute[75122]:         Portal: 172.16.0.220:3260,-1
Nov 15 09:35:57 user nova-compute[75122]:                 Iface Name: default
Nov 15 09:35:57 user nova-compute[75122]: Target: iqn.2010-10.org.openstack:697acd7d-564d-4149-9ecf-7c7d89f10013
Nov 15 09:35:57 user nova-compute[75122]:         Portal: 172.16.0.220:3260,-1
Nov 15 09:35:57 user nova-compute[75122]:                 Iface Name: default
Nov 15 09:35:57 user nova-compute[75122]: Target: iqn.2010-10.org.openstack:df76fc47-1a36-4bd6-97e6-bff6a6ead337
Nov 15 09:35:57 user nova-compute[75122]:         Portal: 172.16.0.220:3260,-1
Nov 15 09:35:57 user nova-compute[75122]:                 Iface Name: default
Nov 15 09:35:57 user nova-compute[75122]: FIRMWARE:
Nov 15 09:35:57 user nova-compute[75122]: No targets found.
Nov 15 09:35:57 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 09:35:57 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c573712-7d5d-4929-96e9-6f0edcc07ce2 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 09:35:57 user nova-compute[75122]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 09:35:57 user nova-compute[75122]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75122) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 09:35:57 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c573712-7d5d-4929-96e9-6f0edcc07ce2 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16', 0)] {{(pid=75122) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 09:35:57 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:35:57 user nova-compute[75122]: DEBUG nova.virt.libvirt.guest [None req-b741a058-fdb4-4c33-9922-28d3ac47bf68 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 09:35:57 user nova-compute[75122]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 09:35:57 user nova-compute[75122]:   <source dev="/dev/sdb"/>
Nov 15 09:35:57 user nova-compute[75122]:   <target dev="vdb" bus="virtio"/>
Nov 15 09:35:57 user nova-compute[75122]:   <serial>7524fa0e-0e0f-4da0-bd00-7f099a8a55e8</serial>
Nov 15 09:35:57 user nova-compute[75122]: </disk>
Nov 15 09:35:57 user nova-compute[75122]:  {{(pid=75122) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 09:35:57 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:35:57 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[b705ce0d-597c-4580-a320-ea59e68976b6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:697acd7d-564d-4149-9ecf-7c7d89f10013\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7524fa0e-0e0f-4da0-bd00-7f099a8a55e8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b9022bc1-82d9-4e14-9d0e-85a8b645e512\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:df76fc47-1a36-4bd6-97e6-bff6a6ead337\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:35:57 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:35:57 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:35:57 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e464522-3026-4b59-ba3e-0d6bcfb66ac2]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:697acd7d-564d-4149-9ecf-7c7d89f10013 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df76fc47-1a36-4bd6-97e6-bff6a6ead337 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9022bc1-82d9-4e14-9d0e-85a8b645e512 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7524fa0e-0e0f-4da0-bd00-7f099a8a55e8 (non-flash)\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:35:57 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c573712-7d5d-4929-96e9-6f0edcc07ce2 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16 (non-flash)
Nov 15 09:35:57 user nova-compute[75122]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:697acd7d-564d-4149-9ecf-7c7d89f10013 (non-flash)
Nov 15 09:35:57 user nova-compute[75122]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df76fc47-1a36-4bd6-97e6-bff6a6ead337 (non-flash)
Nov 15 09:35:57 user nova-compute[75122]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9022bc1-82d9-4e14-9d0e-85a8b645e512 (non-flash)
Nov 15 09:35:57 user nova-compute[75122]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e (non-flash)
Nov 15 09:35:57 user nova-compute[75122]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7524fa0e-0e0f-4da0-bd00-7f099a8a55e8 (non-flash)
Nov 15 09:35:57 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 09:35:57 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c573712-7d5d-4929-96e9-6f0edcc07ce2 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16 (non-flash)
Nov 15 09:35:57 user nova-compute[75122]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:697acd7d-564d-4149-9ecf-7c7d89f10013 (non-flash)
Nov 15 09:35:57 user nova-compute[75122]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df76fc47-1a36-4bd6-97e6-bff6a6ead337 (non-flash)
Nov 15 09:35:57 user nova-compute[75122]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9022bc1-82d9-4e14-9d0e-85a8b645e512 (non-flash)
Nov 15 09:35:57 user nova-compute[75122]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e (non-flash)
Nov 15 09:35:57 user nova-compute[75122]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7524fa0e-0e0f-4da0-bd00-7f099a8a55e8 (non-flash)
Nov 15 09:35:57 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 09:35:57 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c573712-7d5d-4929-96e9-6f0edcc07ce2 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff9fc25d630>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16'): ({'sde'}, set())}) {{(pid=75122) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 09:35:57 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-6c573712-7d5d-4929-96e9-6f0edcc07ce2 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Removing single pathed devices sde {{(pid=75122) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 09:35:57 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:35:57 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:35:57 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b36132c-734b-4ab0-b526-79ef123bb5c0]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:35:57 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:35:57 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:35:57 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2b4e553-0fa0-4707-9503-51ed74ce30cd]: (4, ('ok\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:35:57 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-6c573712-7d5d-4929-96e9-6f0edcc07ce2 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Flushing IO for device /dev/sde {{(pid=75122) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 09:35:57 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:35:57 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:35:57 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fb1891f-5b49-4ff0-90bb-147c89aceadb]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:35:57 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-6c573712-7d5d-4929-96e9-6f0edcc07ce2 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75122) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 09:35:57 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:35:57 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.040s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:35:57 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d1c469b-92e6-4f7a-a953-37e365cfdf81]: (4, ('1', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:35:57 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-6c573712-7d5d-4929-96e9-6f0edcc07ce2 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75122) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 09:35:57 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-6c573712-7d5d-4929-96e9-6f0edcc07ce2 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] SCSI volumes sde have been removed. {{(pid=75122) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 09:35:57 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c573712-7d5d-4929-96e9-6f0edcc07ce2 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16')] {{(pid=75122) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 09:35:57 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:35:57 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:35:57 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[ead35ea6-4c31-41a7-ac6a-babaecf79feb]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:35:57 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c573712-7d5d-4929-96e9-6f0edcc07ce2 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:35:57 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16 -p 172.16.0.220:3260 --logout {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:35:57 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:35:57 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9194180-b142-4537-8a95-93e1a61107d1]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:35:57 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c573712-7d5d-4929-96e9-6f0edcc07ce2 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16, portal: 172.16.0.220,3260]
Nov 15 09:35:57 user nova-compute[75122]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16, portal: 172.16.0.220,3260] successful.
Nov 15 09:35:57 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:35:57 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16 -p 172.16.0.220:3260 --op delete {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:35:57 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:35:57 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[a42d3d0a-a79e-4caa-b7d7-61900e2887e6]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:35:57 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c573712-7d5d-4929-96e9-6f0edcc07ce2 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:35:57 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-6c573712-7d5d-4929-96e9-6f0edcc07ce2 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.330s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 09:35:57 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c573712-7d5d-4929-96e9-6f0edcc07ce2 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] <== disconnect_volume: return (748ms) None {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 09:35:57 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6c573712-7d5d-4929-96e9-6f0edcc07ce2 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] [instance: ee961d5a-e0d1-4931-9293-eefbe638097a] Disconnected iSCSI Volume {{(pid=75122) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 09:35:57 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-b741a058-fdb4-4c33-9922-28d3ac47bf68 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] No BDM found with device name vda, not building metadata. {{(pid=75122) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 09:35:57 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-b741a058-fdb4-4c33-9922-28d3ac47bf68 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75122) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 09:35:57 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-b741a058-fdb4-4c33-9922-28d3ac47bf68 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] No VIF found with MAC fa:16:3e:e1:ad:0f, not building metadata {{(pid=75122) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 09:35:57 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-b741a058-fdb4-4c33-9922-28d3ac47bf68 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Lock "7cfd4155-c4b3-4cce-91e5-042cafccab8b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.693s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:35:58 user nova-compute[75122]: DEBUG nova.compute.manager [req-5405667f-39d1-4897-89b1-14f037937c02 req-e72f92b7-6cdd-458c-a640-4be2d072ab64 service nova] [instance: ee961d5a-e0d1-4931-9293-eefbe638097a] Received event network-vif-plugged-ae8a9c5e-17d1-4aa9-b3fa-b829d1dc6fd2 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:35:58 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-5405667f-39d1-4897-89b1-14f037937c02 req-e72f92b7-6cdd-458c-a640-4be2d072ab64 service nova] Acquiring lock "ee961d5a-e0d1-4931-9293-eefbe638097a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:35:58 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-5405667f-39d1-4897-89b1-14f037937c02 req-e72f92b7-6cdd-458c-a640-4be2d072ab64 service nova] Lock "ee961d5a-e0d1-4931-9293-eefbe638097a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:35:58 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-5405667f-39d1-4897-89b1-14f037937c02 req-e72f92b7-6cdd-458c-a640-4be2d072ab64 service nova] Lock "ee961d5a-e0d1-4931-9293-eefbe638097a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:35:58 user nova-compute[75122]: DEBUG nova.compute.manager [req-5405667f-39d1-4897-89b1-14f037937c02 req-e72f92b7-6cdd-458c-a640-4be2d072ab64 service nova] [instance: ee961d5a-e0d1-4931-9293-eefbe638097a] No waiting events found dispatching network-vif-plugged-ae8a9c5e-17d1-4aa9-b3fa-b829d1dc6fd2 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:35:58 user nova-compute[75122]: WARNING nova.compute.manager [req-5405667f-39d1-4897-89b1-14f037937c02 req-e72f92b7-6cdd-458c-a640-4be2d072ab64 service nova] [instance: ee961d5a-e0d1-4931-9293-eefbe638097a] Received unexpected event network-vif-plugged-ae8a9c5e-17d1-4aa9-b3fa-b829d1dc6fd2 for instance with vm_state resized and task_state resize_reverting.
Nov 15 09:35:58 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-6c573712-7d5d-4929-96e9-6f0edcc07ce2 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:35:58 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-6c573712-7d5d-4929-96e9-6f0edcc07ce2 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:35:58 user nova-compute[75122]: DEBUG nova.objects.instance [None req-6c573712-7d5d-4929-96e9-6f0edcc07ce2 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Lazy-loading 'migration_context' on Instance uuid ee961d5a-e0d1-4931-9293-eefbe638097a {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:35:58 user nova-compute[75122]: DEBUG nova.objects.base [None req-6c573712-7d5d-4929-96e9-6f0edcc07ce2 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Object Instance<ee961d5a-e0d1-4931-9293-eefbe638097a> lazy-loaded attributes: resources,migration_context {{(pid=75122) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 09:35:58 user nova-compute[75122]: DEBUG nova.compute.provider_tree [None req-6c573712-7d5d-4929-96e9-6f0edcc07ce2 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Inventory has not changed in ProviderTree for provider: 69a3da65-47be-44c6-b67c-c692b58284ef {{(pid=75122) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 09:35:58 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-6c573712-7d5d-4929-96e9-6f0edcc07ce2 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Inventory has not changed for provider 69a3da65-47be-44c6-b67c-c692b58284ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 09:35:58 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-6c573712-7d5d-4929-96e9-6f0edcc07ce2 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.367s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:35:58 user nova-compute[75122]: INFO nova.compute.manager [None req-6c573712-7d5d-4929-96e9-6f0edcc07ce2 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] [instance: ee961d5a-e0d1-4931-9293-eefbe638097a] Swapping old allocation on dict_keys(['69a3da65-47be-44c6-b67c-c692b58284ef']) held by migration f8a46d00-fb11-44d8-a63f-1ba41a2331d7 for instance
Nov 15 09:35:58 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-6c573712-7d5d-4929-96e9-6f0edcc07ce2 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Overwriting current allocation {'allocations': {'69a3da65-47be-44c6-b67c-c692b58284ef': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 22}}, 'project_id': 'd672b8845fa849d99e328521d3d1715b', 'user_id': 'c9bf6f2e607842889cd6593ba114cfc3', 'consumer_generation': 1} on consumer ee961d5a-e0d1-4931-9293-eefbe638097a {{(pid=75122) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Nov 15 09:35:58 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-6c573712-7d5d-4929-96e9-6f0edcc07ce2 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Acquiring lock "refresh_cache-ee961d5a-e0d1-4931-9293-eefbe638097a" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 09:35:58 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-6c573712-7d5d-4929-96e9-6f0edcc07ce2 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Acquired lock "refresh_cache-ee961d5a-e0d1-4931-9293-eefbe638097a" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 09:35:58 user nova-compute[75122]: DEBUG nova.network.neutron [None req-6c573712-7d5d-4929-96e9-6f0edcc07ce2 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] [instance: ee961d5a-e0d1-4931-9293-eefbe638097a] Building network info cache for instance {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 09:35:59 user nova-compute[75122]: INFO nova.compute.manager [None req-d5a59427-2ad1-4779-b624-e0fbec25edf6 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] [instance: 7cfd4155-c4b3-4cce-91e5-042cafccab8b] Rebuilding instance
Nov 15 09:35:59 user nova-compute[75122]: DEBUG nova.network.neutron [None req-6c573712-7d5d-4929-96e9-6f0edcc07ce2 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] [instance: ee961d5a-e0d1-4931-9293-eefbe638097a] Updating instance_info_cache with network_info: [{"id": "ae8a9c5e-17d1-4aa9-b3fa-b829d1dc6fd2", "address": "fa:16:3e:7d:98:85", "network": {"id": "44caed16-406b-4a76-966a-0dc42b26f133", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-465582303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d672b8845fa849d99e328521d3d1715b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae8a9c5e-17", "ovs_interfaceid": "ae8a9c5e-17d1-4aa9-b3fa-b829d1dc6fd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:35:59 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-6c573712-7d5d-4929-96e9-6f0edcc07ce2 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Releasing lock "refresh_cache-ee961d5a-e0d1-4931-9293-eefbe638097a" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 09:35:59 user nova-compute[75122]: DEBUG os_brick.utils [None req-6c573712-7d5d-4929-96e9-6f0edcc07ce2 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 09:35:59 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:35:59 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:35:59 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e3382ae-54f8-4eb3-9249-fda3f682d5df]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:742fb64b3587\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:35:59 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:35:59 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:35:59 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[089f3ae8-8231-4262-90e5-c36b6153a90c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:35:59 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:35:59 user nova-compute[75122]: DEBUG nova.compute.manager [None req-d5a59427-2ad1-4779-b624-e0fbec25edf6 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] [instance: 7cfd4155-c4b3-4cce-91e5-042cafccab8b] Checking state {{(pid=75122) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 09:35:59 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:35:59 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[63bdbb48-cc44-4822-888e-e298fb248718]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:35:59 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[aefe7578-7120-4f5d-9b0c-b327e795a9ac]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:35:59 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-6c573712-7d5d-4929-96e9-6f0edcc07ce2 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Running cmd (subprocess): nvme version {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:35:59 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-6c573712-7d5d-4929-96e9-6f0edcc07ce2 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] 'nvme version' failed. Not Retrying. {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 09:35:59 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6c573712-7d5d-4929-96e9-6f0edcc07ce2 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] nvme not present on system {{(pid=75122) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 09:35:59 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:35:59 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 09:35:59 user nova-compute[75122]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 09:35:59 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[23fdb0db-5db1-4a2d-a6f0-4a5a9dbd88c3]: (4, '') {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:35:59 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.lightos [None req-6c573712-7d5d-4929-96e9-6f0edcc07ce2 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75122) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 09:35:59 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.lightos [None req-6c573712-7d5d-4929-96e9-6f0edcc07ce2 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75122) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 09:35:59 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.lightos [None req-6c573712-7d5d-4929-96e9-6f0edcc07ce2 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] LIGHTOS: no hostnqn found. {{(pid=75122) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 09:35:59 user nova-compute[75122]: DEBUG os_brick.utils [None req-6c573712-7d5d-4929-96e9-6f0edcc07ce2 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:742fb64b3587', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 09:35:59 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:35:59 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:35:59 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:35:59 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:36:00 user nova-compute[75122]: DEBUG nova.compute.manager [req-934d685b-a5e0-4939-b848-1e4da8932089 req-f69ba9bf-5c85-4ba3-98f4-b2a8f896df89 service nova] [instance: 7cfd4155-c4b3-4cce-91e5-042cafccab8b] Received event network-vif-unplugged-3066e71b-c5d6-4e46-980c-2b0d42739f95 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:36:00 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-934d685b-a5e0-4939-b848-1e4da8932089 req-f69ba9bf-5c85-4ba3-98f4-b2a8f896df89 service nova] Acquiring lock "7cfd4155-c4b3-4cce-91e5-042cafccab8b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:36:00 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-934d685b-a5e0-4939-b848-1e4da8932089 req-f69ba9bf-5c85-4ba3-98f4-b2a8f896df89 service nova] Lock "7cfd4155-c4b3-4cce-91e5-042cafccab8b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:36:00 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-934d685b-a5e0-4939-b848-1e4da8932089 req-f69ba9bf-5c85-4ba3-98f4-b2a8f896df89 service nova] Lock "7cfd4155-c4b3-4cce-91e5-042cafccab8b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:36:00 user nova-compute[75122]: DEBUG nova.compute.manager [req-934d685b-a5e0-4939-b848-1e4da8932089 req-f69ba9bf-5c85-4ba3-98f4-b2a8f896df89 service nova] [instance: 7cfd4155-c4b3-4cce-91e5-042cafccab8b] No waiting events found dispatching network-vif-unplugged-3066e71b-c5d6-4e46-980c-2b0d42739f95 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:36:00 user nova-compute[75122]: WARNING nova.compute.manager [req-934d685b-a5e0-4939-b848-1e4da8932089 req-f69ba9bf-5c85-4ba3-98f4-b2a8f896df89 service nova] [instance: 7cfd4155-c4b3-4cce-91e5-042cafccab8b] Received unexpected event network-vif-unplugged-3066e71b-c5d6-4e46-980c-2b0d42739f95 for instance with vm_state active and task_state rebuilding.
Nov 15 09:36:00 user nova-compute[75122]: DEBUG nova.compute.manager [req-934d685b-a5e0-4939-b848-1e4da8932089 req-f69ba9bf-5c85-4ba3-98f4-b2a8f896df89 service nova] [instance: 7cfd4155-c4b3-4cce-91e5-042cafccab8b] Received event network-vif-plugged-3066e71b-c5d6-4e46-980c-2b0d42739f95 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:36:00 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-934d685b-a5e0-4939-b848-1e4da8932089 req-f69ba9bf-5c85-4ba3-98f4-b2a8f896df89 service nova] Acquiring lock "7cfd4155-c4b3-4cce-91e5-042cafccab8b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:36:00 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-934d685b-a5e0-4939-b848-1e4da8932089 req-f69ba9bf-5c85-4ba3-98f4-b2a8f896df89 service nova] Lock "7cfd4155-c4b3-4cce-91e5-042cafccab8b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:36:00 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-934d685b-a5e0-4939-b848-1e4da8932089 req-f69ba9bf-5c85-4ba3-98f4-b2a8f896df89 service nova] Lock "7cfd4155-c4b3-4cce-91e5-042cafccab8b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:36:00 user nova-compute[75122]: DEBUG nova.compute.manager [req-934d685b-a5e0-4939-b848-1e4da8932089 req-f69ba9bf-5c85-4ba3-98f4-b2a8f896df89 service nova] [instance: 7cfd4155-c4b3-4cce-91e5-042cafccab8b] No waiting events found dispatching network-vif-plugged-3066e71b-c5d6-4e46-980c-2b0d42739f95 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:36:00 user nova-compute[75122]: WARNING nova.compute.manager [req-934d685b-a5e0-4939-b848-1e4da8932089 req-f69ba9bf-5c85-4ba3-98f4-b2a8f896df89 service nova] [instance: 7cfd4155-c4b3-4cce-91e5-042cafccab8b] Received unexpected event network-vif-plugged-3066e71b-c5d6-4e46-980c-2b0d42739f95 for instance with vm_state active and task_state rebuilding.
Nov 15 09:36:00 user nova-compute[75122]: INFO nova.virt.libvirt.driver [-] [instance: 7cfd4155-c4b3-4cce-91e5-042cafccab8b] Instance destroyed successfully.
Nov 15 09:36:00 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:36:00 user nova-compute[75122]: INFO nova.compute.manager [None req-d5a59427-2ad1-4779-b624-e0fbec25edf6 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] [instance: 7cfd4155-c4b3-4cce-91e5-042cafccab8b] Detaching volume 7524fa0e-0e0f-4da0-bd00-7f099a8a55e8
Nov 15 09:36:00 user nova-compute[75122]: INFO nova.virt.block_device [None req-d5a59427-2ad1-4779-b624-e0fbec25edf6 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] [instance: 7cfd4155-c4b3-4cce-91e5-042cafccab8b] Attempting to driver detach volume 7524fa0e-0e0f-4da0-bd00-7f099a8a55e8 from mountpoint /dev/vdb
Nov 15 09:36:00 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-d5a59427-2ad1-4779-b624-e0fbec25edf6 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Attempting to detach device vdb from instance 7cfd4155-c4b3-4cce-91e5-042cafccab8b from the persistent domain config. {{(pid=75122) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 09:36:00 user nova-compute[75122]: DEBUG nova.virt.libvirt.guest [None req-d5a59427-2ad1-4779-b624-e0fbec25edf6 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 09:36:00 user nova-compute[75122]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 09:36:00 user nova-compute[75122]:   <source dev="/dev/sdb"/>
Nov 15 09:36:00 user nova-compute[75122]:   <target dev="vdb" bus="virtio"/>
Nov 15 09:36:00 user nova-compute[75122]:   <serial>7524fa0e-0e0f-4da0-bd00-7f099a8a55e8</serial>
Nov 15 09:36:00 user nova-compute[75122]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 09:36:00 user nova-compute[75122]: </disk>
Nov 15 09:36:00 user nova-compute[75122]:  {{(pid=75122) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 09:36:00 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-d5a59427-2ad1-4779-b624-e0fbec25edf6 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Successfully detached device vdb from instance 7cfd4155-c4b3-4cce-91e5-042cafccab8b from the persistent domain config.
Nov 15 09:36:00 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d5a59427-2ad1-4779-b624-e0fbec25edf6 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] [instance: 7cfd4155-c4b3-4cce-91e5-042cafccab8b] calling os-brick to detach iSCSI Volume {{(pid=75122) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 09:36:00 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a59427-2ad1-4779-b624-e0fbec25edf6 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffa04060b80>, {'target_iqn': 'iqn.2010-10.org.openstack:7524fa0e-0e0f-4da0-bd00-7f099a8a55e8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gJBOlMUQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 09:36:00 user nova-compute[75122]: WARNING os_brick.initiator.connectors.base [None req-d5a59427-2ad1-4779-b624-e0fbec25edf6 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 15 09:36:00 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-d5a59427-2ad1-4779-b624-e0fbec25edf6 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 09:36:00 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-d5a59427-2ad1-4779-b624-e0fbec25edf6 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 09:36:00 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:36:00 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:36:00 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfa39113-d88b-4ec9-a987-930bc5f109eb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7524fa0e-0e0f-4da0-bd00-7f099a8a55e8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b9022bc1-82d9-4e14-9d0e-85a8b645e512\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:697acd7d-564d-4149-9ecf-7c7d89f10013\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:df76fc47-1a36-4bd6-97e6-bff6a6ead337\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:36:00 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a59427-2ad1-4779-b624-e0fbec25edf6 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 09:36:00 user nova-compute[75122]: No targets found.
Nov 15 09:36:00 user nova-compute[75122]: iSNS:
Nov 15 09:36:00 user nova-compute[75122]: No targets found.
Nov 15 09:36:00 user nova-compute[75122]: STATIC:
Nov 15 09:36:00 user nova-compute[75122]: Target: iqn.2010-10.org.openstack:7524fa0e-0e0f-4da0-bd00-7f099a8a55e8
Nov 15 09:36:00 user nova-compute[75122]:         Portal: 172.16.0.220:3260,-1
Nov 15 09:36:00 user nova-compute[75122]:                 Iface Name: default
Nov 15 09:36:00 user nova-compute[75122]: Target: iqn.2010-10.org.openstack:b9022bc1-82d9-4e14-9d0e-85a8b645e512
Nov 15 09:36:00 user nova-compute[75122]:         Portal: 172.16.0.220:3260,-1
Nov 15 09:36:00 user nova-compute[75122]:                 Iface Name: default
Nov 15 09:36:00 user nova-compute[75122]: Target: iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e
Nov 15 09:36:00 user nova-compute[75122]:         Portal: 172.16.0.220:3260,-1
Nov 15 09:36:00 user nova-compute[75122]:                 Iface Name: default
Nov 15 09:36:00 user nova-compute[75122]: Target: iqn.2010-10.org.openstack:697acd7d-564d-4149-9ecf-7c7d89f10013
Nov 15 09:36:00 user nova-compute[75122]:         Portal: 172.16.0.220:3260,-1
Nov 15 09:36:00 user nova-compute[75122]:                 Iface Name: default
Nov 15 09:36:00 user nova-compute[75122]: Target: iqn.2010-10.org.openstack:df76fc47-1a36-4bd6-97e6-bff6a6ead337
Nov 15 09:36:00 user nova-compute[75122]:         Portal: 172.16.0.220:3260,-1
Nov 15 09:36:00 user nova-compute[75122]:                 Iface Name: default
Nov 15 09:36:00 user nova-compute[75122]: FIRMWARE:
Nov 15 09:36:00 user nova-compute[75122]: No targets found.
Nov 15 09:36:00 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 09:36:00 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a59427-2ad1-4779-b624-e0fbec25edf6 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 09:36:00 user nova-compute[75122]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 09:36:00 user nova-compute[75122]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75122) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 09:36:00 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a59427-2ad1-4779-b624-e0fbec25edf6 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7524fa0e-0e0f-4da0-bd00-7f099a8a55e8', 0)] {{(pid=75122) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 09:36:00 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:36:00 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:36:00 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[923381cc-fa7d-44b2-8966-2ff73adedcf5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:697acd7d-564d-4149-9ecf-7c7d89f10013\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7524fa0e-0e0f-4da0-bd00-7f099a8a55e8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b9022bc1-82d9-4e14-9d0e-85a8b645e512\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:df76fc47-1a36-4bd6-97e6-bff6a6ead337\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:36:00 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:36:00 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:36:00 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc10ccc1-bae1-4460-8b40-6072772d50cc]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:697acd7d-564d-4149-9ecf-7c7d89f10013 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df76fc47-1a36-4bd6-97e6-bff6a6ead337 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9022bc1-82d9-4e14-9d0e-85a8b645e512 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7524fa0e-0e0f-4da0-bd00-7f099a8a55e8 (non-flash)\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:36:00 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a59427-2ad1-4779-b624-e0fbec25edf6 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:697acd7d-564d-4149-9ecf-7c7d89f10013 (non-flash)
Nov 15 09:36:00 user nova-compute[75122]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df76fc47-1a36-4bd6-97e6-bff6a6ead337 (non-flash)
Nov 15 09:36:00 user nova-compute[75122]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9022bc1-82d9-4e14-9d0e-85a8b645e512 (non-flash)
Nov 15 09:36:00 user nova-compute[75122]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e (non-flash)
Nov 15 09:36:00 user nova-compute[75122]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7524fa0e-0e0f-4da0-bd00-7f099a8a55e8 (non-flash)
Nov 15 09:36:00 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 09:36:00 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a59427-2ad1-4779-b624-e0fbec25edf6 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:697acd7d-564d-4149-9ecf-7c7d89f10013 (non-flash)
Nov 15 09:36:00 user nova-compute[75122]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df76fc47-1a36-4bd6-97e6-bff6a6ead337 (non-flash)
Nov 15 09:36:00 user nova-compute[75122]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9022bc1-82d9-4e14-9d0e-85a8b645e512 (non-flash)
Nov 15 09:36:00 user nova-compute[75122]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e (non-flash)
Nov 15 09:36:00 user nova-compute[75122]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7524fa0e-0e0f-4da0-bd00-7f099a8a55e8 (non-flash)
Nov 15 09:36:00 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 09:36:00 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a59427-2ad1-4779-b624-e0fbec25edf6 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff9fc25cdc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7524fa0e-0e0f-4da0-bd00-7f099a8a55e8'): ({'sdb'}, set())}) {{(pid=75122) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 09:36:00 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-d5a59427-2ad1-4779-b624-e0fbec25edf6 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Removing single pathed devices sdb {{(pid=75122) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 09:36:00 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:36:00 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:36:00 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[538a92c4-351e-4d97-b16d-891e70480e11]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:36:00 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:36:00 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:36:00 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff26ea96-e768-4d83-82aa-f57cd50038dc]: (4, ('ok\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:36:00 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-d5a59427-2ad1-4779-b624-e0fbec25edf6 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Flushing IO for device /dev/sdb {{(pid=75122) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 09:36:00 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:36:00 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:36:00 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eb1b3f5-5d3c-4f83-bf7c-1031798c2423]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:36:00 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-d5a59427-2ad1-4779-b624-e0fbec25edf6 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75122) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 09:36:00 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:36:00 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.062s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:36:00 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fa1403a-5290-49a1-b18d-90d8b9c948a2]: (4, ('1', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:36:00 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-d5a59427-2ad1-4779-b624-e0fbec25edf6 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75122) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 09:36:00 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-d5a59427-2ad1-4779-b624-e0fbec25edf6 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] SCSI volumes sdb have been removed. {{(pid=75122) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 09:36:00 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a59427-2ad1-4779-b624-e0fbec25edf6 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7524fa0e-0e0f-4da0-bd00-7f099a8a55e8')] {{(pid=75122) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 09:36:00 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7524fa0e-0e0f-4da0-bd00-7f099a8a55e8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:36:00 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7524fa0e-0e0f-4da0-bd00-7f099a8a55e8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.040s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:36:00 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ce9a3aa-a5e6-425f-888c-a5ddcf4aa82e]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:36:00 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a59427-2ad1-4779-b624-e0fbec25edf6 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:36:00 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7524fa0e-0e0f-4da0-bd00-7f099a8a55e8 -p 172.16.0.220:3260 --logout {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:36:01 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7524fa0e-0e0f-4da0-bd00-7f099a8a55e8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.138s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:36:01 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fb67a59-755e-4b94-95dc-18438c186224]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:7524fa0e-0e0f-4da0-bd00-7f099a8a55e8, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:7524fa0e-0e0f-4da0-bd00-7f099a8a55e8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:36:01 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a59427-2ad1-4779-b624-e0fbec25edf6 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:7524fa0e-0e0f-4da0-bd00-7f099a8a55e8, portal: 172.16.0.220,3260]
Nov 15 09:36:01 user nova-compute[75122]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:7524fa0e-0e0f-4da0-bd00-7f099a8a55e8, portal: 172.16.0.220,3260] successful.
Nov 15 09:36:01 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:36:01 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7524fa0e-0e0f-4da0-bd00-7f099a8a55e8 -p 172.16.0.220:3260 --op delete {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:36:01 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7524fa0e-0e0f-4da0-bd00-7f099a8a55e8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:36:01 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7a4266c-9591-4774-a5f0-5bda09911840]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:36:01 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a59427-2ad1-4779-b624-e0fbec25edf6 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:36:01 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-d5a59427-2ad1-4779-b624-e0fbec25edf6 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.445s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 09:36:01 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a59427-2ad1-4779-b624-e0fbec25edf6 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] <== disconnect_volume: return (446ms) None {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 09:36:01 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d5a59427-2ad1-4779-b624-e0fbec25edf6 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] [instance: 7cfd4155-c4b3-4cce-91e5-042cafccab8b] Disconnected iSCSI Volume {{(pid=75122) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 09:36:01 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:36:02 user nova-compute[75122]: INFO nova.virt.libvirt.driver [-] [instance: 7cfd4155-c4b3-4cce-91e5-042cafccab8b] Instance destroyed successfully.
Nov 15 09:36:02 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-d5a59427-2ad1-4779-b624-e0fbec25edf6 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T09:33:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-2104199903',display_name='tempest-ServerActionsTestOtherA-server-1491357968',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-2104199903',id=12,image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBOX8YtQdU9q+dZR5u6ZMUFx1hvdm2NhRUpss/Fu1DkrrAdOur+Gu9G+pa6bDZCG5H+IwYYy1a89zeBb3vsgDOIvqoXhBd6Ue9N9chSVtmlWB+JfvhMU/87GmmYpdmALKw==',key_name='tempest-keypair-2121112573',keypairs=<?>,launch_index=0,launched_at=2023-11-15T09:34:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='8b8e67f8a66a4930be3fb65c397cbeb2',ramdisk_id='',reservation_id='r-93cr0hj1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1521412552',owner_user_name='tempest-ServerActionsTestOtherA-1521412552-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T09:35:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='91f1469b2c7c45d6ac27f2b64fd5cefe',uuid=7cfd4155-c4b3-4cce-91e5-042cafccab8b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3066e71b-c5d6-4e46-980c-2b0d42739f95", "address": "fa:16:3e:e1:ad:0f", "network": {"id": "6e846655-a6f8-4339-a239-65d2f94c8b74", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1923452032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b8e67f8a66a4930be3fb65c397cbeb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3066e71b-c5", "ovs_interfaceid": "3066e71b-c5d6-4e46-980c-2b0d42739f95", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 09:36:02 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-d5a59427-2ad1-4779-b624-e0fbec25edf6 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Converting VIF {"id": "3066e71b-c5d6-4e46-980c-2b0d42739f95", "address": "fa:16:3e:e1:ad:0f", "network": {"id": "6e846655-a6f8-4339-a239-65d2f94c8b74", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1923452032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b8e67f8a66a4930be3fb65c397cbeb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3066e71b-c5", "ovs_interfaceid": "3066e71b-c5d6-4e46-980c-2b0d42739f95", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 09:36:02 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-d5a59427-2ad1-4779-b624-e0fbec25edf6 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e1:ad:0f,bridge_name='br-int',has_traffic_filtering=True,id=3066e71b-c5d6-4e46-980c-2b0d42739f95,network=Network(6e846655-a6f8-4339-a239-65d2f94c8b74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3066e71b-c5') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 09:36:02 user nova-compute[75122]: DEBUG os_vif [None req-d5a59427-2ad1-4779-b624-e0fbec25edf6 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e1:ad:0f,bridge_name='br-int',has_traffic_filtering=True,id=3066e71b-c5d6-4e46-980c-2b0d42739f95,network=Network(6e846655-a6f8-4339-a239-65d2f94c8b74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3066e71b-c5') {{(pid=75122) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 09:36:02 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:36:02 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3066e71b-c5, bridge=br-int, if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:36:02 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:36:02 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:36:02 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:36:02 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f1e5eb3b-a8bc-4485-9300-d2ba010676fb) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:36:02 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:36:02 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:36:02 user nova-compute[75122]: INFO os_vif [None req-d5a59427-2ad1-4779-b624-e0fbec25edf6 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e1:ad:0f,bridge_name='br-int',has_traffic_filtering=True,id=3066e71b-c5d6-4e46-980c-2b0d42739f95,network=Network(6e846655-a6f8-4339-a239-65d2f94c8b74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3066e71b-c5')
Nov 15 09:36:02 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d5a59427-2ad1-4779-b624-e0fbec25edf6 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] [instance: 7cfd4155-c4b3-4cce-91e5-042cafccab8b] calling os-brick to detach iSCSI Volume {{(pid=75122) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 09:36:02 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a59427-2ad1-4779-b624-e0fbec25edf6 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffa04060b80>, {'target_iqn': 'iqn.2010-10.org.openstack:7524fa0e-0e0f-4da0-bd00-7f099a8a55e8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gJBOlMUQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 09:36:02 user nova-compute[75122]: WARNING os_brick.initiator.connectors.base [None req-d5a59427-2ad1-4779-b624-e0fbec25edf6 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 15 09:36:02 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-d5a59427-2ad1-4779-b624-e0fbec25edf6 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 09:36:02 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-d5a59427-2ad1-4779-b624-e0fbec25edf6 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 09:36:02 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:36:02 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:36:02 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e95a75d-033c-4821-ad68-328c63b98144]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b9022bc1-82d9-4e14-9d0e-85a8b645e512\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:697acd7d-564d-4149-9ecf-7c7d89f10013\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:df76fc47-1a36-4bd6-97e6-bff6a6ead337\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:36:02 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a59427-2ad1-4779-b624-e0fbec25edf6 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 09:36:02 user nova-compute[75122]: No targets found.
Nov 15 09:36:02 user nova-compute[75122]: iSNS:
Nov 15 09:36:02 user nova-compute[75122]: No targets found.
Nov 15 09:36:02 user nova-compute[75122]: STATIC:
Nov 15 09:36:02 user nova-compute[75122]: Target: iqn.2010-10.org.openstack:b9022bc1-82d9-4e14-9d0e-85a8b645e512
Nov 15 09:36:02 user nova-compute[75122]:         Portal: 172.16.0.220:3260,-1
Nov 15 09:36:02 user nova-compute[75122]:                 Iface Name: default
Nov 15 09:36:02 user nova-compute[75122]: Target: iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e
Nov 15 09:36:02 user nova-compute[75122]:         Portal: 172.16.0.220:3260,-1
Nov 15 09:36:02 user nova-compute[75122]:                 Iface Name: default
Nov 15 09:36:02 user nova-compute[75122]: Target: iqn.2010-10.org.openstack:697acd7d-564d-4149-9ecf-7c7d89f10013
Nov 15 09:36:02 user nova-compute[75122]:         Portal: 172.16.0.220:3260,-1
Nov 15 09:36:02 user nova-compute[75122]:                 Iface Name: default
Nov 15 09:36:02 user nova-compute[75122]: Target: iqn.2010-10.org.openstack:df76fc47-1a36-4bd6-97e6-bff6a6ead337
Nov 15 09:36:02 user nova-compute[75122]:         Portal: 172.16.0.220:3260,-1
Nov 15 09:36:02 user nova-compute[75122]:                 Iface Name: default
Nov 15 09:36:02 user nova-compute[75122]: FIRMWARE:
Nov 15 09:36:02 user nova-compute[75122]: No targets found.
Nov 15 09:36:02 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 09:36:02 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a59427-2ad1-4779-b624-e0fbec25edf6 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 09:36:02 user nova-compute[75122]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 09:36:02 user nova-compute[75122]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75122) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 09:36:02 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a59427-2ad1-4779-b624-e0fbec25edf6 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7524fa0e-0e0f-4da0-bd00-7f099a8a55e8', 0)] {{(pid=75122) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 09:36:02 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:36:02 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:36:02 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[c221d29b-6386-4f26-a338-b5a46c1a5273]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:697acd7d-564d-4149-9ecf-7c7d89f10013\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b9022bc1-82d9-4e14-9d0e-85a8b645e512\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:df76fc47-1a36-4bd6-97e6-bff6a6ead337\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:36:02 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:36:02 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:36:02 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[a032d3cf-6b21-4010-9422-16fa0092b866]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:697acd7d-564d-4149-9ecf-7c7d89f10013 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df76fc47-1a36-4bd6-97e6-bff6a6ead337 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9022bc1-82d9-4e14-9d0e-85a8b645e512 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e (non-flash)\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:36:02 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a59427-2ad1-4779-b624-e0fbec25edf6 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:697acd7d-564d-4149-9ecf-7c7d89f10013 (non-flash)
Nov 15 09:36:02 user nova-compute[75122]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df76fc47-1a36-4bd6-97e6-bff6a6ead337 (non-flash)
Nov 15 09:36:02 user nova-compute[75122]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9022bc1-82d9-4e14-9d0e-85a8b645e512 (non-flash)
Nov 15 09:36:02 user nova-compute[75122]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e (non-flash)
Nov 15 09:36:02 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 09:36:02 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a59427-2ad1-4779-b624-e0fbec25edf6 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:697acd7d-564d-4149-9ecf-7c7d89f10013 (non-flash)
Nov 15 09:36:02 user nova-compute[75122]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df76fc47-1a36-4bd6-97e6-bff6a6ead337 (non-flash)
Nov 15 09:36:02 user nova-compute[75122]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9022bc1-82d9-4e14-9d0e-85a8b645e512 (non-flash)
Nov 15 09:36:02 user nova-compute[75122]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e (non-flash)
Nov 15 09:36:02 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 09:36:02 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a59427-2ad1-4779-b624-e0fbec25edf6 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff9fc25f1c0>, {}) {{(pid=75122) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 09:36:02 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a59427-2ad1-4779-b624-e0fbec25edf6 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Disconnecting from: [] {{(pid=75122) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 09:36:02 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-d5a59427-2ad1-4779-b624-e0fbec25edf6 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.086s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 09:36:02 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a59427-2ad1-4779-b624-e0fbec25edf6 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] <== disconnect_volume: return (88ms) None {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 09:36:02 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d5a59427-2ad1-4779-b624-e0fbec25edf6 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] [instance: 7cfd4155-c4b3-4cce-91e5-042cafccab8b] Disconnected iSCSI Volume {{(pid=75122) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 09:36:02 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-d5a59427-2ad1-4779-b624-e0fbec25edf6 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] [instance: 7cfd4155-c4b3-4cce-91e5-042cafccab8b] Deleting instance files /opt/stack/data/nova/instances/7cfd4155-c4b3-4cce-91e5-042cafccab8b_del
Nov 15 09:36:02 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-d5a59427-2ad1-4779-b624-e0fbec25edf6 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] [instance: 7cfd4155-c4b3-4cce-91e5-042cafccab8b] Deletion of /opt/stack/data/nova/instances/7cfd4155-c4b3-4cce-91e5-042cafccab8b_del complete
Nov 15 09:36:02 user nova-compute[75122]: INFO nova.virt.block_device [None req-d5a59427-2ad1-4779-b624-e0fbec25edf6 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] [instance: 7cfd4155-c4b3-4cce-91e5-042cafccab8b] Booting with volume 7524fa0e-0e0f-4da0-bd00-7f099a8a55e8 at /dev/vdb
Nov 15 09:36:02 user nova-compute[75122]: DEBUG os_brick.utils [None req-d5a59427-2ad1-4779-b624-e0fbec25edf6 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 09:36:02 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:36:02 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:36:02 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbf3ac49-50b0-4236-8059-0fe0c1cb80aa]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:742fb64b3587\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:36:02 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:36:02 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:36:02 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[054c9da6-9b5c-49c5-b09d-d6ed5e75b494]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:36:02 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:36:02 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:36:02 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[e640f67b-ff3d-4094-84a0-d25308f5c269]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:36:02 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[c123562c-9eaf-42e7-be87-0e45b6bf657d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:36:02 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-d5a59427-2ad1-4779-b624-e0fbec25edf6 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Running cmd (subprocess): nvme version {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:36:02 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-d5a59427-2ad1-4779-b624-e0fbec25edf6 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] 'nvme version' failed. Not Retrying. {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 09:36:02 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d5a59427-2ad1-4779-b624-e0fbec25edf6 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] nvme not present on system {{(pid=75122) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 09:36:02 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:36:02 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 09:36:02 user nova-compute[75122]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 09:36:02 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6507977-4ab8-40f6-8ecf-99375b780043]: (4, '') {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:36:02 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.lightos [None req-d5a59427-2ad1-4779-b624-e0fbec25edf6 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75122) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 09:36:02 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.lightos [None req-d5a59427-2ad1-4779-b624-e0fbec25edf6 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75122) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 09:36:02 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.lightos [None req-d5a59427-2ad1-4779-b624-e0fbec25edf6 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] LIGHTOS: no hostnqn found. {{(pid=75122) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 09:36:02 user nova-compute[75122]: DEBUG os_brick.utils [None req-d5a59427-2ad1-4779-b624-e0fbec25edf6 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:742fb64b3587', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 09:36:02 user nova-compute[75122]: DEBUG nova.virt.block_device [None req-d5a59427-2ad1-4779-b624-e0fbec25edf6 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] [instance: 7cfd4155-c4b3-4cce-91e5-042cafccab8b] Updating existing volume attachment record: aab5fb6b-9c44-4fc5-ac23-d15b96f754b6 {{(pid=75122) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 09:36:04 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-6c573712-7d5d-4929-96e9-6f0edcc07ce2 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] [instance: ee961d5a-e0d1-4931-9293-eefbe638097a] Starting finish_revert_migration {{(pid=75122) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11819}}
Nov 15 09:36:04 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-6c573712-7d5d-4929-96e9-6f0edcc07ce2 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] [instance: ee961d5a-e0d1-4931-9293-eefbe638097a] Start _get_guest_xml network_info=[{"id": "ae8a9c5e-17d1-4aa9-b3fa-b829d1dc6fd2", "address": "fa:16:3e:7d:98:85", "network": {"id": "44caed16-406b-4a76-966a-0dc42b26f133", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-465582303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d672b8845fa849d99e328521d3d1715b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae8a9c5e-17", "ovs_interfaceid": "ae8a9c5e-17d1-4aa9-b3fa-b829d1dc6fd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=5e862cfe-47b8-4725-8292-65761ee6d0f5,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '5e862cfe-47b8-4725-8292-65761ee6d0f5'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BFRblrMm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'ee961d5a-e0d1-4931-9293-eefbe638097a', 'attached_at': '2023-11-15T09:36:04.000000', 'detached_at': '', 'volume_id': '2cd51ed3-2703-4b02-aa7c-ddb113161a16', 'serial': '2cd51ed3-2703-4b02-aa7c-ddb113161a16'}, 'guest_format': None, 'delete_on_termination': False, 'boot_index': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vdb', 'attachment_id': '097a564f-865b-4d3b-96b4-9e36506bd730', 'volume_type': None} {{(pid=75122) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 09:36:04 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-6c573712-7d5d-4929-96e9-6f0edcc07ce2 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 09:36:04 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-6c573712-7d5d-4929-96e9-6f0edcc07ce2 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 09:36:04 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-6c573712-7d5d-4929-96e9-6f0edcc07ce2 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75122) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 09:36:04 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-6c573712-7d5d-4929-96e9-6f0edcc07ce2 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] CPU controller missing on host. {{(pid=75122) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 09:36:04 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-6c573712-7d5d-4929-96e9-6f0edcc07ce2 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75122) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 09:36:04 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-6c573712-7d5d-4929-96e9-6f0edcc07ce2 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] CPU controller found on host. {{(pid=75122) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 09:36:04 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-6c573712-7d5d-4929-96e9-6f0edcc07ce2 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75122) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 09:36:04 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-6c573712-7d5d-4929-96e9-6f0edcc07ce2 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T09:26:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=5e862cfe-47b8-4725-8292-65761ee6d0f5,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 09:36:04 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-6c573712-7d5d-4929-96e9-6f0edcc07ce2 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Flavor limits 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 09:36:04 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-6c573712-7d5d-4929-96e9-6f0edcc07ce2 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Image limits 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 09:36:04 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-6c573712-7d5d-4929-96e9-6f0edcc07ce2 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Flavor pref 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 09:36:04 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-6c573712-7d5d-4929-96e9-6f0edcc07ce2 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Image pref 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 09:36:04 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-6c573712-7d5d-4929-96e9-6f0edcc07ce2 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 09:36:04 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-6c573712-7d5d-4929-96e9-6f0edcc07ce2 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 09:36:04 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-6c573712-7d5d-4929-96e9-6f0edcc07ce2 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75122) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 09:36:04 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-6c573712-7d5d-4929-96e9-6f0edcc07ce2 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Got 1 possible topologies {{(pid=75122) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 09:36:04 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-6c573712-7d5d-4929-96e9-6f0edcc07ce2 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 09:36:04 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-6c573712-7d5d-4929-96e9-6f0edcc07ce2 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 09:36:04 user nova-compute[75122]: DEBUG nova.objects.instance [None req-6c573712-7d5d-4929-96e9-6f0edcc07ce2 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Lazy-loading 'vcpu_model' on Instance uuid ee961d5a-e0d1-4931-9293-eefbe638097a {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:36:04 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6c573712-7d5d-4929-96e9-6f0edcc07ce2 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] [instance: ee961d5a-e0d1-4931-9293-eefbe638097a] Calling os-brick to attach iSCSI Volume {{(pid=75122) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 09:36:04 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c573712-7d5d-4929-96e9-6f0edcc07ce2 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffa04060b80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BFRblrMm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 09:36:04 user nova-compute[75122]: WARNING os_brick.initiator.connectors.base [None req-6c573712-7d5d-4929-96e9-6f0edcc07ce2 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 09:36:04 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-6c573712-7d5d-4929-96e9-6f0edcc07ce2 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 09:36:04 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-6c573712-7d5d-4929-96e9-6f0edcc07ce2 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 09:36:04 user nova-compute[75122]: WARNING os_brick.initiator.connectors.base [None req-6c573712-7d5d-4929-96e9-6f0edcc07ce2 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 09:36:04 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-6c573712-7d5d-4929-96e9-6f0edcc07ce2 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 09:36:04 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-6c573712-7d5d-4929-96e9-6f0edcc07ce2 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 09:36:04 user nova-compute[75122]: INFO os_brick.initiator.connectors.iscsi [None req-6c573712-7d5d-4929-96e9-6f0edcc07ce2 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 09:36:04 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16 -p 172.16.0.220:3260 {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:36:04 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:36:04 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[96fbe5ce-46cd-46a3-b589-74a73fef60c0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:36:04 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c573712-7d5d-4929-96e9-6f0edcc07ce2 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 09:36:04 user nova-compute[75122]:  {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:36:04 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16 -p 172.16.0.220:3260 --interface default --op new {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:36:04 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:36:04 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b0587ec-669c-45da-97d5-f50118356fa1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16] added\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:36:04 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c573712-7d5d-4929-96e9-6f0edcc07ce2 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16] added
Nov 15 09:36:04 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:36:04 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:36:04 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:36:04 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[774c7e6b-80fc-4e8e-9474-44cd94353af0]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:36:04 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c573712-7d5d-4929-96e9-6f0edcc07ce2 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:36:04 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:36:04 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:36:04 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[f763b85f-a8fd-467a-9ae9-d3c4800a3fe8]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:36:04 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c573712-7d5d-4929-96e9-6f0edcc07ce2 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:36:04 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BFRblrMm {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:36:04 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BFRblrMm" returned: 0 in 0.019s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:36:04 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eb9c4f1-83ff-460b-83c7-9f53b9f31c11]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:36:04 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c573712-7d5d-4929-96e9-6f0edcc07ce2 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BFRblrMm'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:36:04 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:36:04 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:36:04 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dd1594d-ea20-4fdc-af4b-d12bd59ec788]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:36:04 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c573712-7d5d-4929-96e9-6f0edcc07ce2 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:36:04 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:36:04 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:36:04 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fc1995c-9193-46c2-a7ca-c3bef9243a9a]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:697acd7d-564d-4149-9ecf-7c7d89f10013 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df76fc47-1a36-4bd6-97e6-bff6a6ead337 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9022bc1-82d9-4e14-9d0e-85a8b645e512 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e (non-flash)\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:36:04 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c573712-7d5d-4929-96e9-6f0edcc07ce2 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:697acd7d-564d-4149-9ecf-7c7d89f10013 (non-flash)
Nov 15 09:36:04 user nova-compute[75122]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df76fc47-1a36-4bd6-97e6-bff6a6ead337 (non-flash)
Nov 15 09:36:04 user nova-compute[75122]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9022bc1-82d9-4e14-9d0e-85a8b645e512 (non-flash)
Nov 15 09:36:04 user nova-compute[75122]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e (non-flash)
Nov 15 09:36:04 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 09:36:04 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c573712-7d5d-4929-96e9-6f0edcc07ce2 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:697acd7d-564d-4149-9ecf-7c7d89f10013 (non-flash)
Nov 15 09:36:04 user nova-compute[75122]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df76fc47-1a36-4bd6-97e6-bff6a6ead337 (non-flash)
Nov 15 09:36:04 user nova-compute[75122]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9022bc1-82d9-4e14-9d0e-85a8b645e512 (non-flash)
Nov 15 09:36:04 user nova-compute[75122]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e (non-flash)
Nov 15 09:36:04 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 09:36:04 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16 -p 172.16.0.220:3260 --login {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:36:04 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:36:04 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c709d17-7f01-4ace-9334-18d26efe2e7d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:36:04 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c573712-7d5d-4929-96e9-6f0edcc07ce2 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16, portal: 172.16.0.220,3260]
Nov 15 09:36:04 user nova-compute[75122]: Login to [iface: default, target: iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16, portal: 172.16.0.220,3260] successful.
Nov 15 09:36:04 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:36:04 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:36:04 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:36:04 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[aed935a3-1643-4d84-9f8d-5d53c9627fe2]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:36:04 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c573712-7d5d-4929-96e9-6f0edcc07ce2 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:36:04 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:36:04 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:36:04 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8f747ed-89dc-4244-ae2d-5a0b36238c7a]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:697acd7d-564d-4149-9ecf-7c7d89f10013 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df76fc47-1a36-4bd6-97e6-bff6a6ead337 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9022bc1-82d9-4e14-9d0e-85a8b645e512 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16 (non-flash)\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:36:04 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c573712-7d5d-4929-96e9-6f0edcc07ce2 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:697acd7d-564d-4149-9ecf-7c7d89f10013 (non-flash)
Nov 15 09:36:04 user nova-compute[75122]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df76fc47-1a36-4bd6-97e6-bff6a6ead337 (non-flash)
Nov 15 09:36:04 user nova-compute[75122]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9022bc1-82d9-4e14-9d0e-85a8b645e512 (non-flash)
Nov 15 09:36:04 user nova-compute[75122]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e (non-flash)
Nov 15 09:36:04 user nova-compute[75122]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16 (non-flash)
Nov 15 09:36:04 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 09:36:04 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c573712-7d5d-4929-96e9-6f0edcc07ce2 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:697acd7d-564d-4149-9ecf-7c7d89f10013 (non-flash)
Nov 15 09:36:04 user nova-compute[75122]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df76fc47-1a36-4bd6-97e6-bff6a6ead337 (non-flash)
Nov 15 09:36:04 user nova-compute[75122]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9022bc1-82d9-4e14-9d0e-85a8b645e512 (non-flash)
Nov 15 09:36:04 user nova-compute[75122]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e (non-flash)
Nov 15 09:36:04 user nova-compute[75122]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16 (non-flash)
Nov 15 09:36:04 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 09:36:04 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-6c573712-7d5d-4929-96e9-6f0edcc07ce2 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.279s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 09:36:04 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c573712-7d5d-4929-96e9-6f0edcc07ce2 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Connected to 172.16.0.220:3260 {{(pid=75122) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 09:36:04 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-6c573712-7d5d-4929-96e9-6f0edcc07ce2 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] HCTL ('33', '-', '-', 0) found on session 23 with lun 0 {{(pid=75122) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 09:36:04 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-6c573712-7d5d-4929-96e9-6f0edcc07ce2 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75122) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 09:36:04 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:36:04 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:36:04 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[760f9e6e-4c66-4970-a8a5-8d9b38b3a440]: (4, ('- - 0', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:36:04 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-6c573712-7d5d-4929-96e9-6f0edcc07ce2 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Searching for a device in session 23 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75122) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 09:36:04 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c573712-7d5d-4929-96e9-6f0edcc07ce2 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BFRblrMm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75122) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 09:36:05 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:36:05 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-6c573712-7d5d-4929-96e9-6f0edcc07ce2 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.314s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 09:36:05 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c573712-7d5d-4929-96e9-6f0edcc07ce2 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] <== connect_volume: return (1315ms) {'type': 'block', 'scsi_wwn': '23231356562353037', 'path': '/dev/sdb'} {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 09:36:05 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6c573712-7d5d-4929-96e9-6f0edcc07ce2 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] [instance: ee961d5a-e0d1-4931-9293-eefbe638097a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23231356562353037', 'path': '/dev/sdb'} {{(pid=75122) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 09:36:05 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-6c573712-7d5d-4929-96e9-6f0edcc07ce2 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T09:30:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-79968674',display_name='tempest-ServerActionsTestOtherB-server-79968674',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-79968674',id=2,image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJiK6B7/Kn/Opurq4zSOmiWq8yh0HkUVgNM/DkoeYxKo1kQJMVcwOjFbHB9+CscyIIndFz0uf8CUeGmaOLp83QTM6njH0bbr1gC12yHMNGMet8mqfmXy8CIGmj4KMayIOw==',key_name='tempest-keypair-1064498524',keypairs=<?>,launch_index=0,launched_at=2023-11-15T09:34:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='d672b8845fa849d99e328521d3d1715b',ramdisk_id='',reservation_id='r-32nlhypw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-279691748',owner_user_name='tempest-ServerActionsTestOtherB-279691748-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T09:35:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c9bf6f2e607842889cd6593ba114cfc3',uuid=ee961d5a-e0d1-4931-9293-eefbe638097a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "ae8a9c5e-17d1-4aa9-b3fa-b829d1dc6fd2", "address": "fa:16:3e:7d:98:85", "network": {"id": "44caed16-406b-4a76-966a-0dc42b26f133", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-465582303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d672b8845fa849d99e328521d3d1715b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae8a9c5e-17", "ovs_interfaceid": "ae8a9c5e-17d1-4aa9-b3fa-b829d1dc6fd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75122) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 09:36:05 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-6c573712-7d5d-4929-96e9-6f0edcc07ce2 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Converting VIF {"id": "ae8a9c5e-17d1-4aa9-b3fa-b829d1dc6fd2", "address": "fa:16:3e:7d:98:85", "network": {"id": "44caed16-406b-4a76-966a-0dc42b26f133", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-465582303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d672b8845fa849d99e328521d3d1715b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae8a9c5e-17", "ovs_interfaceid": "ae8a9c5e-17d1-4aa9-b3fa-b829d1dc6fd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 09:36:05 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-6c573712-7d5d-4929-96e9-6f0edcc07ce2 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:98:85,bridge_name='br-int',has_traffic_filtering=True,id=ae8a9c5e-17d1-4aa9-b3fa-b829d1dc6fd2,network=Network(44caed16-406b-4a76-966a-0dc42b26f133),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae8a9c5e-17') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 09:36:05 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-6c573712-7d5d-4929-96e9-6f0edcc07ce2 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] [instance: ee961d5a-e0d1-4931-9293-eefbe638097a] End _get_guest_xml xml=<domain type="kvm">
Nov 15 09:36:05 user nova-compute[75122]:   <uuid>ee961d5a-e0d1-4931-9293-eefbe638097a</uuid>
Nov 15 09:36:05 user nova-compute[75122]:   <name>instance-00000002</name>
Nov 15 09:36:05 user nova-compute[75122]:   <memory>524288</memory>
Nov 15 09:36:05 user nova-compute[75122]:   <vcpu>1</vcpu>
Nov 15 09:36:05 user nova-compute[75122]:   <metadata>
Nov 15 09:36:05 user nova-compute[75122]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 09:36:05 user nova-compute[75122]:       <nova:package version="0.0.0"/>
Nov 15 09:36:05 user nova-compute[75122]:       <nova:name>tempest-ServerActionsTestOtherB-server-79968674</nova:name>
Nov 15 09:36:05 user nova-compute[75122]:       <nova:creationTime>2023-11-15 09:36:04</nova:creationTime>
Nov 15 09:36:05 user nova-compute[75122]:       <nova:flavor name="m1.tiny">
Nov 15 09:36:05 user nova-compute[75122]:         <nova:memory>512</nova:memory>
Nov 15 09:36:05 user nova-compute[75122]:         <nova:disk>1</nova:disk>
Nov 15 09:36:05 user nova-compute[75122]:         <nova:swap>0</nova:swap>
Nov 15 09:36:05 user nova-compute[75122]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 09:36:05 user nova-compute[75122]:         <nova:vcpus>1</nova:vcpus>
Nov 15 09:36:05 user nova-compute[75122]:       </nova:flavor>
Nov 15 09:36:05 user nova-compute[75122]:       <nova:owner>
Nov 15 09:36:05 user nova-compute[75122]:         <nova:user uuid="c9bf6f2e607842889cd6593ba114cfc3">tempest-ServerActionsTestOtherB-279691748-project-member</nova:user>
Nov 15 09:36:05 user nova-compute[75122]:         <nova:project uuid="d672b8845fa849d99e328521d3d1715b">tempest-ServerActionsTestOtherB-279691748</nova:project>
Nov 15 09:36:05 user nova-compute[75122]:       </nova:owner>
Nov 15 09:36:05 user nova-compute[75122]:       <nova:root type="image" uuid="5e862cfe-47b8-4725-8292-65761ee6d0f5"/>
Nov 15 09:36:05 user nova-compute[75122]:       <nova:ports>
Nov 15 09:36:05 user nova-compute[75122]:         <nova:port uuid="ae8a9c5e-17d1-4aa9-b3fa-b829d1dc6fd2">
Nov 15 09:36:05 user nova-compute[75122]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 15 09:36:05 user nova-compute[75122]:         </nova:port>
Nov 15 09:36:05 user nova-compute[75122]:       </nova:ports>
Nov 15 09:36:05 user nova-compute[75122]:     </nova:instance>
Nov 15 09:36:05 user nova-compute[75122]:   </metadata>
Nov 15 09:36:05 user nova-compute[75122]:   <sysinfo type="smbios">
Nov 15 09:36:05 user nova-compute[75122]:     <system>
Nov 15 09:36:05 user nova-compute[75122]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 09:36:05 user nova-compute[75122]:       <entry name="product">OpenStack Nova</entry>
Nov 15 09:36:05 user nova-compute[75122]:       <entry name="version">0.0.0</entry>
Nov 15 09:36:05 user nova-compute[75122]:       <entry name="serial">ee961d5a-e0d1-4931-9293-eefbe638097a</entry>
Nov 15 09:36:05 user nova-compute[75122]:       <entry name="uuid">ee961d5a-e0d1-4931-9293-eefbe638097a</entry>
Nov 15 09:36:05 user nova-compute[75122]:       <entry name="family">Virtual Machine</entry>
Nov 15 09:36:05 user nova-compute[75122]:     </system>
Nov 15 09:36:05 user nova-compute[75122]:   </sysinfo>
Nov 15 09:36:05 user nova-compute[75122]:   <os>
Nov 15 09:36:05 user nova-compute[75122]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 09:36:05 user nova-compute[75122]:     <boot dev="hd"/>
Nov 15 09:36:05 user nova-compute[75122]:     <smbios mode="sysinfo"/>
Nov 15 09:36:05 user nova-compute[75122]:   </os>
Nov 15 09:36:05 user nova-compute[75122]:   <features>
Nov 15 09:36:05 user nova-compute[75122]:     <acpi/>
Nov 15 09:36:05 user nova-compute[75122]:     <apic/>
Nov 15 09:36:05 user nova-compute[75122]:     <vmcoreinfo/>
Nov 15 09:36:05 user nova-compute[75122]:   </features>
Nov 15 09:36:05 user nova-compute[75122]:   <clock offset="utc">
Nov 15 09:36:05 user nova-compute[75122]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 09:36:05 user nova-compute[75122]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 09:36:05 user nova-compute[75122]:     <timer name="hpet" present="no"/>
Nov 15 09:36:05 user nova-compute[75122]:   </clock>
Nov 15 09:36:05 user nova-compute[75122]:   <cpu mode="custom" match="exact">
Nov 15 09:36:05 user nova-compute[75122]:     <model>Nehalem</model>
Nov 15 09:36:05 user nova-compute[75122]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 09:36:05 user nova-compute[75122]:   </cpu>
Nov 15 09:36:05 user nova-compute[75122]:   <devices>
Nov 15 09:36:05 user nova-compute[75122]:     <disk type="file" device="disk">
Nov 15 09:36:05 user nova-compute[75122]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 09:36:05 user nova-compute[75122]:       <source file="/opt/stack/data/nova/instances/ee961d5a-e0d1-4931-9293-eefbe638097a/disk"/>
Nov 15 09:36:05 user nova-compute[75122]:       <target dev="vda" bus="virtio"/>
Nov 15 09:36:05 user nova-compute[75122]:     </disk>
Nov 15 09:36:05 user nova-compute[75122]:     <disk type="block" device="disk">
Nov 15 09:36:05 user nova-compute[75122]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 09:36:05 user nova-compute[75122]:       <source dev="/dev/sdb"/>
Nov 15 09:36:05 user nova-compute[75122]:       <target dev="vdb" bus="virtio"/>
Nov 15 09:36:05 user nova-compute[75122]:       <serial>2cd51ed3-2703-4b02-aa7c-ddb113161a16</serial>
Nov 15 09:36:05 user nova-compute[75122]:     </disk>
Nov 15 09:36:05 user nova-compute[75122]:     <interface type="ethernet">
Nov 15 09:36:05 user nova-compute[75122]:       <mac address="fa:16:3e:7d:98:85"/>
Nov 15 09:36:05 user nova-compute[75122]:       <model type="virtio"/>
Nov 15 09:36:05 user nova-compute[75122]:       <mtu size="1442"/>
Nov 15 09:36:05 user nova-compute[75122]:       <target dev="tapae8a9c5e-17"/>
Nov 15 09:36:05 user nova-compute[75122]:     </interface>
Nov 15 09:36:05 user nova-compute[75122]:     <serial type="pty">
Nov 15 09:36:05 user nova-compute[75122]:       <log file="/opt/stack/data/nova/instances/ee961d5a-e0d1-4931-9293-eefbe638097a/console.log" append="off"/>
Nov 15 09:36:05 user nova-compute[75122]:     </serial>
Nov 15 09:36:05 user nova-compute[75122]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 09:36:05 user nova-compute[75122]:     <video>
Nov 15 09:36:05 user nova-compute[75122]:       <model type="virtio"/>
Nov 15 09:36:05 user nova-compute[75122]:     </video>
Nov 15 09:36:05 user nova-compute[75122]:     <rng model="virtio">
Nov 15 09:36:05 user nova-compute[75122]:       <backend model="random">/dev/urandom</backend>
Nov 15 09:36:05 user nova-compute[75122]:     </rng>
Nov 15 09:36:05 user nova-compute[75122]:     <controller type="usb" index="0" model="none"/>
Nov 15 09:36:05 user nova-compute[75122]:     <memballoon model="virtio">
Nov 15 09:36:05 user nova-compute[75122]:       <stats period="10"/>
Nov 15 09:36:05 user nova-compute[75122]:     </memballoon>
Nov 15 09:36:05 user nova-compute[75122]:   </devices>
Nov 15 09:36:05 user nova-compute[75122]: </domain>
Nov 15 09:36:05 user nova-compute[75122]:  {{(pid=75122) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 09:36:05 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-6c573712-7d5d-4929-96e9-6f0edcc07ce2 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T09:30:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-79968674',display_name='tempest-ServerActionsTestOtherB-server-79968674',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-79968674',id=2,image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJiK6B7/Kn/Opurq4zSOmiWq8yh0HkUVgNM/DkoeYxKo1kQJMVcwOjFbHB9+CscyIIndFz0uf8CUeGmaOLp83QTM6njH0bbr1gC12yHMNGMet8mqfmXy8CIGmj4KMayIOw==',key_name='tempest-keypair-1064498524',keypairs=<?>,launch_index=0,launched_at=2023-11-15T09:34:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='d672b8845fa849d99e328521d3d1715b',ramdisk_id='',reservation_id='r-32nlhypw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-279691748',owner_user_name='tempest-ServerActionsTestOtherB-279691748-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T09:35:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c9bf6f2e607842889cd6593ba114cfc3',uuid=ee961d5a-e0d1-4931-9293-eefbe638097a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "ae8a9c5e-17d1-4aa9-b3fa-b829d1dc6fd2", "address": "fa:16:3e:7d:98:85", "network": {"id": "44caed16-406b-4a76-966a-0dc42b26f133", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-465582303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d672b8845fa849d99e328521d3d1715b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae8a9c5e-17", "ovs_interfaceid": "ae8a9c5e-17d1-4aa9-b3fa-b829d1dc6fd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 09:36:05 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-6c573712-7d5d-4929-96e9-6f0edcc07ce2 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Converting VIF {"id": "ae8a9c5e-17d1-4aa9-b3fa-b829d1dc6fd2", "address": "fa:16:3e:7d:98:85", "network": {"id": "44caed16-406b-4a76-966a-0dc42b26f133", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-465582303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d672b8845fa849d99e328521d3d1715b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae8a9c5e-17", "ovs_interfaceid": "ae8a9c5e-17d1-4aa9-b3fa-b829d1dc6fd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 09:36:05 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-6c573712-7d5d-4929-96e9-6f0edcc07ce2 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:98:85,bridge_name='br-int',has_traffic_filtering=True,id=ae8a9c5e-17d1-4aa9-b3fa-b829d1dc6fd2,network=Network(44caed16-406b-4a76-966a-0dc42b26f133),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae8a9c5e-17') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 09:36:05 user nova-compute[75122]: DEBUG os_vif [None req-6c573712-7d5d-4929-96e9-6f0edcc07ce2 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:98:85,bridge_name='br-int',has_traffic_filtering=True,id=ae8a9c5e-17d1-4aa9-b3fa-b829d1dc6fd2,network=Network(44caed16-406b-4a76-966a-0dc42b26f133),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae8a9c5e-17') {{(pid=75122) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 09:36:05 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:36:05 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:36:05 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 09:36:05 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:36:05 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3609e1c0-55d8-546a-b83f-6084bd8a23e9', '_type': 'linux-noop'}}, row=False) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:36:05 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:36:05 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:36:05 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:36:05 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapae8a9c5e-17, may_exist=True, interface_attrs={}) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:36:05 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapae8a9c5e-17, col_values=(('qos', UUID('d87af641-a124-4be0-92e8-15bd0b478694')),), if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:36:05 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapae8a9c5e-17, col_values=(('external_ids', {'iface-id': 'ae8a9c5e-17d1-4aa9-b3fa-b829d1dc6fd2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7d:98:85', 'vm-uuid': 'ee961d5a-e0d1-4931-9293-eefbe638097a'}),), if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:36:05 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:36:05 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:36:05 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:36:05 user nova-compute[75122]: INFO os_vif [None req-6c573712-7d5d-4929-96e9-6f0edcc07ce2 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:98:85,bridge_name='br-int',has_traffic_filtering=True,id=ae8a9c5e-17d1-4aa9-b3fa-b829d1dc6fd2,network=Network(44caed16-406b-4a76-966a-0dc42b26f133),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae8a9c5e-17')
Nov 15 09:36:07 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:36:07 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:36:07 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:36:07 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:36:07 user nova-compute[75122]: DEBUG nova.compute.manager [req-423b7b0d-13ec-47a5-81ae-7b95ebf80b2f req-cf910208-7463-4596-90ab-770c93ad5431 service nova] [instance: ee961d5a-e0d1-4931-9293-eefbe638097a] Received event network-vif-plugged-ae8a9c5e-17d1-4aa9-b3fa-b829d1dc6fd2 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:36:07 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-423b7b0d-13ec-47a5-81ae-7b95ebf80b2f req-cf910208-7463-4596-90ab-770c93ad5431 service nova] Acquiring lock "ee961d5a-e0d1-4931-9293-eefbe638097a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:36:07 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-423b7b0d-13ec-47a5-81ae-7b95ebf80b2f req-cf910208-7463-4596-90ab-770c93ad5431 service nova] Lock "ee961d5a-e0d1-4931-9293-eefbe638097a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:36:07 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-423b7b0d-13ec-47a5-81ae-7b95ebf80b2f req-cf910208-7463-4596-90ab-770c93ad5431 service nova] Lock "ee961d5a-e0d1-4931-9293-eefbe638097a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:36:07 user nova-compute[75122]: DEBUG nova.compute.manager [req-423b7b0d-13ec-47a5-81ae-7b95ebf80b2f req-cf910208-7463-4596-90ab-770c93ad5431 service nova] [instance: ee961d5a-e0d1-4931-9293-eefbe638097a] No waiting events found dispatching network-vif-plugged-ae8a9c5e-17d1-4aa9-b3fa-b829d1dc6fd2 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:36:07 user nova-compute[75122]: WARNING nova.compute.manager [req-423b7b0d-13ec-47a5-81ae-7b95ebf80b2f req-cf910208-7463-4596-90ab-770c93ad5431 service nova] [instance: ee961d5a-e0d1-4931-9293-eefbe638097a] Received unexpected event network-vif-plugged-ae8a9c5e-17d1-4aa9-b3fa-b829d1dc6fd2 for instance with vm_state resized and task_state resize_reverting.
Nov 15 09:36:07 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-d5a59427-2ad1-4779-b624-e0fbec25edf6 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] [instance: 7cfd4155-c4b3-4cce-91e5-042cafccab8b] Creating instance directory {{(pid=75122) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 09:36:07 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-d5a59427-2ad1-4779-b624-e0fbec25edf6 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] [instance: 7cfd4155-c4b3-4cce-91e5-042cafccab8b] Creating image(s)
Nov 15 09:36:07 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-d5a59427-2ad1-4779-b624-e0fbec25edf6 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Acquiring lock "/opt/stack/data/nova/instances/7cfd4155-c4b3-4cce-91e5-042cafccab8b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:36:07 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-d5a59427-2ad1-4779-b624-e0fbec25edf6 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Lock "/opt/stack/data/nova/instances/7cfd4155-c4b3-4cce-91e5-042cafccab8b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:36:07 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-d5a59427-2ad1-4779-b624-e0fbec25edf6 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Lock "/opt/stack/data/nova/instances/7cfd4155-c4b3-4cce-91e5-042cafccab8b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:36:07 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-d5a59427-2ad1-4779-b624-e0fbec25edf6 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:36:07 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-d5a59427-2ad1-4779-b624-e0fbec25edf6 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json" returned: 0 in 0.177s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:36:07 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-d5a59427-2ad1-4779-b624-e0fbec25edf6 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Acquiring lock "95d6e29f74d5408f818e32f3bc29bc8270a4c665" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:36:07 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-d5a59427-2ad1-4779-b624-e0fbec25edf6 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Lock "95d6e29f74d5408f818e32f3bc29bc8270a4c665" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:36:07 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-d5a59427-2ad1-4779-b624-e0fbec25edf6 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:36:07 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:36:07 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-d5a59427-2ad1-4779-b624-e0fbec25edf6 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json" returned: 0 in 0.181s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:36:07 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-d5a59427-2ad1-4779-b624-e0fbec25edf6 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665,backing_fmt=raw /opt/stack/data/nova/instances/7cfd4155-c4b3-4cce-91e5-042cafccab8b/disk 1073741824 {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:36:08 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-d5a59427-2ad1-4779-b624-e0fbec25edf6 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665,backing_fmt=raw /opt/stack/data/nova/instances/7cfd4155-c4b3-4cce-91e5-042cafccab8b/disk 1073741824" returned: 0 in 0.057s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:36:08 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-d5a59427-2ad1-4779-b624-e0fbec25edf6 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Lock "95d6e29f74d5408f818e32f3bc29bc8270a4c665" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.244s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:36:08 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-d5a59427-2ad1-4779-b624-e0fbec25edf6 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:36:08 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-d5a59427-2ad1-4779-b624-e0fbec25edf6 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json" returned: 0 in 0.245s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:36:08 user nova-compute[75122]: DEBUG nova.virt.disk.api [None req-d5a59427-2ad1-4779-b624-e0fbec25edf6 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7cfd4155-c4b3-4cce-91e5-042cafccab8b/disk. size=1073741824 {{(pid=75122) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 09:36:08 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-d5a59427-2ad1-4779-b624-e0fbec25edf6 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cfd4155-c4b3-4cce-91e5-042cafccab8b/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:36:08 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-d5a59427-2ad1-4779-b624-e0fbec25edf6 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cfd4155-c4b3-4cce-91e5-042cafccab8b/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:36:08 user nova-compute[75122]: DEBUG nova.virt.disk.api [None req-d5a59427-2ad1-4779-b624-e0fbec25edf6 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Cannot resize image /opt/stack/data/nova/instances/7cfd4155-c4b3-4cce-91e5-042cafccab8b/disk to a smaller size. {{(pid=75122) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 09:36:08 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-d5a59427-2ad1-4779-b624-e0fbec25edf6 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] [instance: 7cfd4155-c4b3-4cce-91e5-042cafccab8b] Created local disks {{(pid=75122) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 09:36:08 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-d5a59427-2ad1-4779-b624-e0fbec25edf6 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] [instance: 7cfd4155-c4b3-4cce-91e5-042cafccab8b] Ensure instance console log exists: /opt/stack/data/nova/instances/7cfd4155-c4b3-4cce-91e5-042cafccab8b/console.log {{(pid=75122) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 09:36:08 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-d5a59427-2ad1-4779-b624-e0fbec25edf6 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:36:08 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-d5a59427-2ad1-4779-b624-e0fbec25edf6 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:36:08 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-d5a59427-2ad1-4779-b624-e0fbec25edf6 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:36:08 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-d5a59427-2ad1-4779-b624-e0fbec25edf6 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] [instance: 7cfd4155-c4b3-4cce-91e5-042cafccab8b] Start _get_guest_xml network_info=[{"id": "3066e71b-c5d6-4e46-980c-2b0d42739f95", "address": "fa:16:3e:e1:ad:0f", "network": {"id": "6e846655-a6f8-4339-a239-65d2f94c8b74", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1923452032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b8e67f8a66a4930be3fb65c397cbeb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3066e71b-c5", "ovs_interfaceid": "3066e71b-c5d6-4e46-980c-2b0d42739f95", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T09:26:31Z,direct_url=<?>,disk_format='qcow2',id=5e862cfe-47b8-4725-8292-65761ee6d0f5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9c57733cb41847c0b4ad31519c382e5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T09:26:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '5e862cfe-47b8-4725-8292-65761ee6d0f5'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7524fa0e-0e0f-4da0-bd00-7f099a8a55e8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gJBOlMUQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '7cfd4155-c4b3-4cce-91e5-042cafccab8b', 'attached_at': '', 'detached_at': '', 'volume_id': '7524fa0e-0e0f-4da0-bd00-7f099a8a55e8', 'serial': '7524fa0e-0e0f-4da0-bd00-7f099a8a55e8'}, 'guest_format': None, 'delete_on_termination': False, 'boot_index': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vdb', 'attachment_id': 'aab5fb6b-9c44-4fc5-ac23-d15b96f754b6', 'volume_type': None} {{(pid=75122) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 09:36:08 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-d5a59427-2ad1-4779-b624-e0fbec25edf6 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 15 09:36:08 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-d5a59427-2ad1-4779-b624-e0fbec25edf6 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 15 09:36:08 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-d5a59427-2ad1-4779-b624-e0fbec25edf6 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75122) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 09:36:08 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-d5a59427-2ad1-4779-b624-e0fbec25edf6 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] CPU controller missing on host. {{(pid=75122) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 09:36:08 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-d5a59427-2ad1-4779-b624-e0fbec25edf6 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75122) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 09:36:08 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-d5a59427-2ad1-4779-b624-e0fbec25edf6 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] CPU controller found on host. {{(pid=75122) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 09:36:08 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-d5a59427-2ad1-4779-b624-e0fbec25edf6 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75122) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 09:36:08 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-d5a59427-2ad1-4779-b624-e0fbec25edf6 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T09:26:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T09:26:31Z,direct_url=<?>,disk_format='qcow2',id=5e862cfe-47b8-4725-8292-65761ee6d0f5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9c57733cb41847c0b4ad31519c382e5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T09:26:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 09:36:08 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-d5a59427-2ad1-4779-b624-e0fbec25edf6 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Flavor limits 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 09:36:08 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-d5a59427-2ad1-4779-b624-e0fbec25edf6 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Image limits 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 09:36:08 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-d5a59427-2ad1-4779-b624-e0fbec25edf6 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Flavor pref 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 09:36:08 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-d5a59427-2ad1-4779-b624-e0fbec25edf6 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Image pref 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 09:36:08 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-d5a59427-2ad1-4779-b624-e0fbec25edf6 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 09:36:08 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-d5a59427-2ad1-4779-b624-e0fbec25edf6 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 09:36:08 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-d5a59427-2ad1-4779-b624-e0fbec25edf6 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75122) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 09:36:08 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-d5a59427-2ad1-4779-b624-e0fbec25edf6 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Got 1 possible topologies {{(pid=75122) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 09:36:08 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-d5a59427-2ad1-4779-b624-e0fbec25edf6 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 09:36:08 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-d5a59427-2ad1-4779-b624-e0fbec25edf6 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 09:36:08 user nova-compute[75122]: DEBUG nova.objects.instance [None req-d5a59427-2ad1-4779-b624-e0fbec25edf6 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Lazy-loading 'vcpu_model' on Instance uuid 7cfd4155-c4b3-4cce-91e5-042cafccab8b {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:36:08 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d5a59427-2ad1-4779-b624-e0fbec25edf6 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] [instance: 7cfd4155-c4b3-4cce-91e5-042cafccab8b] Calling os-brick to attach iSCSI Volume {{(pid=75122) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 09:36:08 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a59427-2ad1-4779-b624-e0fbec25edf6 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffa04060b80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7524fa0e-0e0f-4da0-bd00-7f099a8a55e8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gJBOlMUQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 09:36:08 user nova-compute[75122]: WARNING os_brick.initiator.connectors.base [None req-d5a59427-2ad1-4779-b624-e0fbec25edf6 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 15 09:36:08 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-d5a59427-2ad1-4779-b624-e0fbec25edf6 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 09:36:08 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-d5a59427-2ad1-4779-b624-e0fbec25edf6 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 09:36:08 user nova-compute[75122]: WARNING os_brick.initiator.connectors.base [None req-d5a59427-2ad1-4779-b624-e0fbec25edf6 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 15 09:36:08 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-d5a59427-2ad1-4779-b624-e0fbec25edf6 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7524fa0e-0e0f-4da0-bd00-7f099a8a55e8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 09:36:08 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-d5a59427-2ad1-4779-b624-e0fbec25edf6 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7524fa0e-0e0f-4da0-bd00-7f099a8a55e8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 09:36:08 user nova-compute[75122]: INFO os_brick.initiator.connectors.iscsi [None req-d5a59427-2ad1-4779-b624-e0fbec25edf6 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 09:36:08 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7524fa0e-0e0f-4da0-bd00-7f099a8a55e8 -p 172.16.0.220:3260 {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:36:08 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7524fa0e-0e0f-4da0-bd00-7f099a8a55e8 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:36:08 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6a87962-4c36-41c1-968d-7db4aceb9401]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:36:08 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a59427-2ad1-4779-b624-e0fbec25edf6 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 09:36:08 user nova-compute[75122]:  {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:36:08 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7524fa0e-0e0f-4da0-bd00-7f099a8a55e8 -p 172.16.0.220:3260 --interface default --op new {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:36:08 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7524fa0e-0e0f-4da0-bd00-7f099a8a55e8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:36:08 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[04d63f88-aa36-429e-865a-23f00f4fc60e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7524fa0e-0e0f-4da0-bd00-7f099a8a55e8] added\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:36:08 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a59427-2ad1-4779-b624-e0fbec25edf6 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7524fa0e-0e0f-4da0-bd00-7f099a8a55e8] added
Nov 15 09:36:08 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:36:08 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7524fa0e-0e0f-4da0-bd00-7f099a8a55e8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:36:08 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7524fa0e-0e0f-4da0-bd00-7f099a8a55e8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:36:08 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[98f98f86-e002-4901-8f65-ec9db0bd16c0]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:36:08 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a59427-2ad1-4779-b624-e0fbec25edf6 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:36:08 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7524fa0e-0e0f-4da0-bd00-7f099a8a55e8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:36:08 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7524fa0e-0e0f-4da0-bd00-7f099a8a55e8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:36:08 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3a761f4-25d4-4e27-bdfd-091ef7142fa1]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:36:08 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a59427-2ad1-4779-b624-e0fbec25edf6 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:36:08 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7524fa0e-0e0f-4da0-bd00-7f099a8a55e8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gJBOlMUQ {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:36:08 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7524fa0e-0e0f-4da0-bd00-7f099a8a55e8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gJBOlMUQ" returned: 0 in 0.025s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:36:08 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[df460306-a4df-424c-bf4f-ab7ee15f1355]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:36:08 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a59427-2ad1-4779-b624-e0fbec25edf6 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gJBOlMUQ'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:36:08 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7524fa0e-0e0f-4da0-bd00-7f099a8a55e8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:36:08 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7524fa0e-0e0f-4da0-bd00-7f099a8a55e8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:36:08 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1fbdbcd-253e-4c83-8b2a-995de959619e]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:36:08 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a59427-2ad1-4779-b624-e0fbec25edf6 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:36:08 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:36:08 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:36:08 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[b046508c-dc9d-44e0-8911-862909807f11]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:697acd7d-564d-4149-9ecf-7c7d89f10013 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df76fc47-1a36-4bd6-97e6-bff6a6ead337 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9022bc1-82d9-4e14-9d0e-85a8b645e512 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16 (non-flash)\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:36:08 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a59427-2ad1-4779-b624-e0fbec25edf6 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:697acd7d-564d-4149-9ecf-7c7d89f10013 (non-flash)
Nov 15 09:36:08 user nova-compute[75122]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df76fc47-1a36-4bd6-97e6-bff6a6ead337 (non-flash)
Nov 15 09:36:08 user nova-compute[75122]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9022bc1-82d9-4e14-9d0e-85a8b645e512 (non-flash)
Nov 15 09:36:08 user nova-compute[75122]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e (non-flash)
Nov 15 09:36:08 user nova-compute[75122]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16 (non-flash)
Nov 15 09:36:08 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 09:36:08 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a59427-2ad1-4779-b624-e0fbec25edf6 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:697acd7d-564d-4149-9ecf-7c7d89f10013 (non-flash)
Nov 15 09:36:08 user nova-compute[75122]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df76fc47-1a36-4bd6-97e6-bff6a6ead337 (non-flash)
Nov 15 09:36:08 user nova-compute[75122]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9022bc1-82d9-4e14-9d0e-85a8b645e512 (non-flash)
Nov 15 09:36:08 user nova-compute[75122]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e (non-flash)
Nov 15 09:36:08 user nova-compute[75122]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16 (non-flash)
Nov 15 09:36:08 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 09:36:08 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7524fa0e-0e0f-4da0-bd00-7f099a8a55e8 -p 172.16.0.220:3260 --login {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:36:08 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7524fa0e-0e0f-4da0-bd00-7f099a8a55e8 -p 172.16.0.220:3260 --login" returned: 0 in 0.088s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:36:08 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[b08197b6-6cdf-4241-ac51-c2d0e8285fc1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7524fa0e-0e0f-4da0-bd00-7f099a8a55e8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7524fa0e-0e0f-4da0-bd00-7f099a8a55e8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:36:08 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a59427-2ad1-4779-b624-e0fbec25edf6 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7524fa0e-0e0f-4da0-bd00-7f099a8a55e8, portal: 172.16.0.220,3260]
Nov 15 09:36:08 user nova-compute[75122]: Login to [iface: default, target: iqn.2010-10.org.openstack:7524fa0e-0e0f-4da0-bd00-7f099a8a55e8, portal: 172.16.0.220,3260] successful.
Nov 15 09:36:08 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:36:08 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7524fa0e-0e0f-4da0-bd00-7f099a8a55e8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:36:08 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7524fa0e-0e0f-4da0-bd00-7f099a8a55e8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:36:08 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[719b2f36-d569-4bc7-a196-137240acc9f8]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:36:08 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a59427-2ad1-4779-b624-e0fbec25edf6 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:36:08 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:36:08 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:36:08 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f6e7cb8-c3a3-458b-a5a5-e9e290c1f160]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:697acd7d-564d-4149-9ecf-7c7d89f10013 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df76fc47-1a36-4bd6-97e6-bff6a6ead337 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9022bc1-82d9-4e14-9d0e-85a8b645e512 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7524fa0e-0e0f-4da0-bd00-7f099a8a55e8 (non-flash)\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:36:08 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a59427-2ad1-4779-b624-e0fbec25edf6 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:697acd7d-564d-4149-9ecf-7c7d89f10013 (non-flash)
Nov 15 09:36:08 user nova-compute[75122]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df76fc47-1a36-4bd6-97e6-bff6a6ead337 (non-flash)
Nov 15 09:36:08 user nova-compute[75122]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9022bc1-82d9-4e14-9d0e-85a8b645e512 (non-flash)
Nov 15 09:36:08 user nova-compute[75122]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e (non-flash)
Nov 15 09:36:08 user nova-compute[75122]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16 (non-flash)
Nov 15 09:36:08 user nova-compute[75122]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7524fa0e-0e0f-4da0-bd00-7f099a8a55e8 (non-flash)
Nov 15 09:36:08 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 09:36:08 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a59427-2ad1-4779-b624-e0fbec25edf6 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:697acd7d-564d-4149-9ecf-7c7d89f10013 (non-flash)
Nov 15 09:36:08 user nova-compute[75122]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df76fc47-1a36-4bd6-97e6-bff6a6ead337 (non-flash)
Nov 15 09:36:08 user nova-compute[75122]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9022bc1-82d9-4e14-9d0e-85a8b645e512 (non-flash)
Nov 15 09:36:08 user nova-compute[75122]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e (non-flash)
Nov 15 09:36:08 user nova-compute[75122]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16 (non-flash)
Nov 15 09:36:08 user nova-compute[75122]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7524fa0e-0e0f-4da0-bd00-7f099a8a55e8 (non-flash)
Nov 15 09:36:08 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 09:36:08 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-d5a59427-2ad1-4779-b624-e0fbec25edf6 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7524fa0e-0e0f-4da0-bd00-7f099a8a55e8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.328s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 09:36:08 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a59427-2ad1-4779-b624-e0fbec25edf6 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Connected to 172.16.0.220:3260 {{(pid=75122) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 09:36:08 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-d5a59427-2ad1-4779-b624-e0fbec25edf6 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] HCTL ('34', '-', '-', 0) found on session 24 with lun 0 {{(pid=75122) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 09:36:08 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-d5a59427-2ad1-4779-b624-e0fbec25edf6 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75122) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 09:36:08 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:36:08 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:36:08 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[75a3a72d-9d19-41bf-b28e-457c3cc57b18]: (4, ('- - 0', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:36:08 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-d5a59427-2ad1-4779-b624-e0fbec25edf6 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Searching for a device in session 24 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75122) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 09:36:08 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a59427-2ad1-4779-b624-e0fbec25edf6 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:7524fa0e-0e0f-4da0-bd00-7f099a8a55e8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gJBOlMUQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75122) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 09:36:09 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:36:09 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75122) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 15 09:36:09 user nova-compute[75122]: DEBUG nova.compute.manager [req-10636ac0-e8f4-4a79-92d2-16542e8fed28 req-056a78e6-3c69-4bad-9634-d648f5443f23 service nova] [instance: ee961d5a-e0d1-4931-9293-eefbe638097a] Received event network-vif-plugged-ae8a9c5e-17d1-4aa9-b3fa-b829d1dc6fd2 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:36:09 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-10636ac0-e8f4-4a79-92d2-16542e8fed28 req-056a78e6-3c69-4bad-9634-d648f5443f23 service nova] Acquiring lock "ee961d5a-e0d1-4931-9293-eefbe638097a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:36:09 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-10636ac0-e8f4-4a79-92d2-16542e8fed28 req-056a78e6-3c69-4bad-9634-d648f5443f23 service nova] Lock "ee961d5a-e0d1-4931-9293-eefbe638097a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:36:09 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-10636ac0-e8f4-4a79-92d2-16542e8fed28 req-056a78e6-3c69-4bad-9634-d648f5443f23 service nova] Lock "ee961d5a-e0d1-4931-9293-eefbe638097a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:36:09 user nova-compute[75122]: DEBUG nova.compute.manager [req-10636ac0-e8f4-4a79-92d2-16542e8fed28 req-056a78e6-3c69-4bad-9634-d648f5443f23 service nova] [instance: ee961d5a-e0d1-4931-9293-eefbe638097a] No waiting events found dispatching network-vif-plugged-ae8a9c5e-17d1-4aa9-b3fa-b829d1dc6fd2 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:36:09 user nova-compute[75122]: WARNING nova.compute.manager [req-10636ac0-e8f4-4a79-92d2-16542e8fed28 req-056a78e6-3c69-4bad-9634-d648f5443f23 service nova] [instance: ee961d5a-e0d1-4931-9293-eefbe638097a] Received unexpected event network-vif-plugged-ae8a9c5e-17d1-4aa9-b3fa-b829d1dc6fd2 for instance with vm_state resized and task_state resize_reverting.
Nov 15 09:36:09 user nova-compute[75122]: DEBUG nova.compute.manager [None req-6c573712-7d5d-4929-96e9-6f0edcc07ce2 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] [instance: ee961d5a-e0d1-4931-9293-eefbe638097a] Instance event wait completed in 0 seconds for  {{(pid=75122) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 09:36:09 user nova-compute[75122]: INFO nova.virt.libvirt.driver [-] [instance: ee961d5a-e0d1-4931-9293-eefbe638097a] Instance running successfully.
Nov 15 09:36:09 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-6c573712-7d5d-4929-96e9-6f0edcc07ce2 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] [instance: ee961d5a-e0d1-4931-9293-eefbe638097a] finish_revert_migration finished successfully. {{(pid=75122) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11863}}
Nov 15 09:36:09 user nova-compute[75122]: INFO nova.compute.manager [None req-6c573712-7d5d-4929-96e9-6f0edcc07ce2 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] [instance: ee961d5a-e0d1-4931-9293-eefbe638097a] Updating instance to original state: 'active'
Nov 15 09:36:09 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-d5a59427-2ad1-4779-b624-e0fbec25edf6 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.361s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 09:36:09 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5a59427-2ad1-4779-b624-e0fbec25edf6 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] <== connect_volume: return (1362ms) {'type': 'block', 'scsi_wwn': '23334383862376266', 'path': '/dev/sdc'} {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 09:36:09 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d5a59427-2ad1-4779-b624-e0fbec25edf6 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] [instance: 7cfd4155-c4b3-4cce-91e5-042cafccab8b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23334383862376266', 'path': '/dev/sdc'} {{(pid=75122) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 09:36:09 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-d5a59427-2ad1-4779-b624-e0fbec25edf6 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-15T09:33:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-2104199903',display_name='tempest-ServerActionsTestOtherA-server-1491357968',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-2104199903',id=12,image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBOX8YtQdU9q+dZR5u6ZMUFx1hvdm2NhRUpss/Fu1DkrrAdOur+Gu9G+pa6bDZCG5H+IwYYy1a89zeBb3vsgDOIvqoXhBd6Ue9N9chSVtmlWB+JfvhMU/87GmmYpdmALKw==',key_name='tempest-keypair-2121112573',keypairs=<?>,launch_index=0,launched_at=2023-11-15T09:34:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='8b8e67f8a66a4930be3fb65c397cbeb2',ramdisk_id='',reservation_id='r-93cr0hj1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1521412552',owner_user_name='tempest-ServerActionsTestOtherA-1521412552-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T09:36:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='91f1469b2c7c45d6ac27f2b64fd5cefe',uuid=7cfd4155-c4b3-4cce-91e5-042cafccab8b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3066e71b-c5d6-4e46-980c-2b0d42739f95", "address": "fa:16:3e:e1:ad:0f", "network": {"id": "6e846655-a6f8-4339-a239-65d2f94c8b74", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1923452032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b8e67f8a66a4930be3fb65c397cbeb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3066e71b-c5", "ovs_interfaceid": "3066e71b-c5d6-4e46-980c-2b0d42739f95", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75122) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 09:36:09 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-d5a59427-2ad1-4779-b624-e0fbec25edf6 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Converting VIF {"id": "3066e71b-c5d6-4e46-980c-2b0d42739f95", "address": "fa:16:3e:e1:ad:0f", "network": {"id": "6e846655-a6f8-4339-a239-65d2f94c8b74", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1923452032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b8e67f8a66a4930be3fb65c397cbeb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3066e71b-c5", "ovs_interfaceid": "3066e71b-c5d6-4e46-980c-2b0d42739f95", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 09:36:09 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-d5a59427-2ad1-4779-b624-e0fbec25edf6 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e1:ad:0f,bridge_name='br-int',has_traffic_filtering=True,id=3066e71b-c5d6-4e46-980c-2b0d42739f95,network=Network(6e846655-a6f8-4339-a239-65d2f94c8b74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3066e71b-c5') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 09:36:09 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-d5a59427-2ad1-4779-b624-e0fbec25edf6 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] [instance: 7cfd4155-c4b3-4cce-91e5-042cafccab8b] End _get_guest_xml xml=<domain type="kvm">
Nov 15 09:36:09 user nova-compute[75122]:   <uuid>7cfd4155-c4b3-4cce-91e5-042cafccab8b</uuid>
Nov 15 09:36:09 user nova-compute[75122]:   <name>instance-0000000c</name>
Nov 15 09:36:09 user nova-compute[75122]:   <memory>524288</memory>
Nov 15 09:36:09 user nova-compute[75122]:   <vcpu>1</vcpu>
Nov 15 09:36:09 user nova-compute[75122]:   <metadata>
Nov 15 09:36:09 user nova-compute[75122]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 09:36:09 user nova-compute[75122]:       <nova:package version="0.0.0"/>
Nov 15 09:36:09 user nova-compute[75122]:       <nova:name>tempest-ServerActionsTestOtherA-server-1491357968</nova:name>
Nov 15 09:36:09 user nova-compute[75122]:       <nova:creationTime>2023-11-15 09:36:08</nova:creationTime>
Nov 15 09:36:09 user nova-compute[75122]:       <nova:flavor name="m1.tiny">
Nov 15 09:36:09 user nova-compute[75122]:         <nova:memory>512</nova:memory>
Nov 15 09:36:09 user nova-compute[75122]:         <nova:disk>1</nova:disk>
Nov 15 09:36:09 user nova-compute[75122]:         <nova:swap>0</nova:swap>
Nov 15 09:36:09 user nova-compute[75122]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 09:36:09 user nova-compute[75122]:         <nova:vcpus>1</nova:vcpus>
Nov 15 09:36:09 user nova-compute[75122]:       </nova:flavor>
Nov 15 09:36:09 user nova-compute[75122]:       <nova:owner>
Nov 15 09:36:09 user nova-compute[75122]:         <nova:user uuid="91f1469b2c7c45d6ac27f2b64fd5cefe">tempest-ServerActionsTestOtherA-1521412552-project-member</nova:user>
Nov 15 09:36:09 user nova-compute[75122]:         <nova:project uuid="8b8e67f8a66a4930be3fb65c397cbeb2">tempest-ServerActionsTestOtherA-1521412552</nova:project>
Nov 15 09:36:09 user nova-compute[75122]:       </nova:owner>
Nov 15 09:36:09 user nova-compute[75122]:       <nova:root type="image" uuid="5e862cfe-47b8-4725-8292-65761ee6d0f5"/>
Nov 15 09:36:09 user nova-compute[75122]:       <nova:ports>
Nov 15 09:36:09 user nova-compute[75122]:         <nova:port uuid="3066e71b-c5d6-4e46-980c-2b0d42739f95">
Nov 15 09:36:09 user nova-compute[75122]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 15 09:36:09 user nova-compute[75122]:         </nova:port>
Nov 15 09:36:09 user nova-compute[75122]:       </nova:ports>
Nov 15 09:36:09 user nova-compute[75122]:     </nova:instance>
Nov 15 09:36:09 user nova-compute[75122]:   </metadata>
Nov 15 09:36:09 user nova-compute[75122]:   <sysinfo type="smbios">
Nov 15 09:36:09 user nova-compute[75122]:     <system>
Nov 15 09:36:09 user nova-compute[75122]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 09:36:09 user nova-compute[75122]:       <entry name="product">OpenStack Nova</entry>
Nov 15 09:36:09 user nova-compute[75122]:       <entry name="version">0.0.0</entry>
Nov 15 09:36:09 user nova-compute[75122]:       <entry name="serial">7cfd4155-c4b3-4cce-91e5-042cafccab8b</entry>
Nov 15 09:36:09 user nova-compute[75122]:       <entry name="uuid">7cfd4155-c4b3-4cce-91e5-042cafccab8b</entry>
Nov 15 09:36:09 user nova-compute[75122]:       <entry name="family">Virtual Machine</entry>
Nov 15 09:36:09 user nova-compute[75122]:     </system>
Nov 15 09:36:09 user nova-compute[75122]:   </sysinfo>
Nov 15 09:36:09 user nova-compute[75122]:   <os>
Nov 15 09:36:09 user nova-compute[75122]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 09:36:09 user nova-compute[75122]:     <boot dev="hd"/>
Nov 15 09:36:09 user nova-compute[75122]:     <smbios mode="sysinfo"/>
Nov 15 09:36:09 user nova-compute[75122]:   </os>
Nov 15 09:36:09 user nova-compute[75122]:   <features>
Nov 15 09:36:09 user nova-compute[75122]:     <acpi/>
Nov 15 09:36:09 user nova-compute[75122]:     <apic/>
Nov 15 09:36:09 user nova-compute[75122]:     <vmcoreinfo/>
Nov 15 09:36:09 user nova-compute[75122]:   </features>
Nov 15 09:36:09 user nova-compute[75122]:   <clock offset="utc">
Nov 15 09:36:09 user nova-compute[75122]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 09:36:09 user nova-compute[75122]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 09:36:09 user nova-compute[75122]:     <timer name="hpet" present="no"/>
Nov 15 09:36:09 user nova-compute[75122]:   </clock>
Nov 15 09:36:09 user nova-compute[75122]:   <cpu mode="custom" match="exact">
Nov 15 09:36:09 user nova-compute[75122]:     <model>Nehalem</model>
Nov 15 09:36:09 user nova-compute[75122]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 09:36:09 user nova-compute[75122]:   </cpu>
Nov 15 09:36:09 user nova-compute[75122]:   <devices>
Nov 15 09:36:09 user nova-compute[75122]:     <disk type="file" device="disk">
Nov 15 09:36:09 user nova-compute[75122]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 09:36:09 user nova-compute[75122]:       <source file="/opt/stack/data/nova/instances/7cfd4155-c4b3-4cce-91e5-042cafccab8b/disk"/>
Nov 15 09:36:09 user nova-compute[75122]:       <target dev="vda" bus="virtio"/>
Nov 15 09:36:09 user nova-compute[75122]:     </disk>
Nov 15 09:36:09 user nova-compute[75122]:     <disk type="block" device="disk">
Nov 15 09:36:09 user nova-compute[75122]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 09:36:09 user nova-compute[75122]:       <source dev="/dev/sdc"/>
Nov 15 09:36:09 user nova-compute[75122]:       <target dev="vdb" bus="virtio"/>
Nov 15 09:36:09 user nova-compute[75122]:       <serial>7524fa0e-0e0f-4da0-bd00-7f099a8a55e8</serial>
Nov 15 09:36:09 user nova-compute[75122]:     </disk>
Nov 15 09:36:09 user nova-compute[75122]:     <interface type="ethernet">
Nov 15 09:36:09 user nova-compute[75122]:       <mac address="fa:16:3e:e1:ad:0f"/>
Nov 15 09:36:09 user nova-compute[75122]:       <model type="virtio"/>
Nov 15 09:36:09 user nova-compute[75122]:       <mtu size="1442"/>
Nov 15 09:36:09 user nova-compute[75122]:       <target dev="tap3066e71b-c5"/>
Nov 15 09:36:09 user nova-compute[75122]:     </interface>
Nov 15 09:36:09 user nova-compute[75122]:     <serial type="pty">
Nov 15 09:36:09 user nova-compute[75122]:       <log file="/opt/stack/data/nova/instances/7cfd4155-c4b3-4cce-91e5-042cafccab8b/console.log" append="off"/>
Nov 15 09:36:09 user nova-compute[75122]:     </serial>
Nov 15 09:36:09 user nova-compute[75122]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 09:36:09 user nova-compute[75122]:     <video>
Nov 15 09:36:09 user nova-compute[75122]:       <model type="virtio"/>
Nov 15 09:36:09 user nova-compute[75122]:     </video>
Nov 15 09:36:09 user nova-compute[75122]:     <rng model="virtio">
Nov 15 09:36:09 user nova-compute[75122]:       <backend model="random">/dev/urandom</backend>
Nov 15 09:36:09 user nova-compute[75122]:     </rng>
Nov 15 09:36:09 user nova-compute[75122]:     <controller type="usb" index="0" model="none"/>
Nov 15 09:36:09 user nova-compute[75122]:     <memballoon model="virtio">
Nov 15 09:36:09 user nova-compute[75122]:       <stats period="10"/>
Nov 15 09:36:09 user nova-compute[75122]:     </memballoon>
Nov 15 09:36:09 user nova-compute[75122]:   </devices>
Nov 15 09:36:09 user nova-compute[75122]: </domain>
Nov 15 09:36:09 user nova-compute[75122]:  {{(pid=75122) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 09:36:10 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-d5a59427-2ad1-4779-b624-e0fbec25edf6 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-15T09:33:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-2104199903',display_name='tempest-ServerActionsTestOtherA-server-1491357968',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-2104199903',id=12,image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBOX8YtQdU9q+dZR5u6ZMUFx1hvdm2NhRUpss/Fu1DkrrAdOur+Gu9G+pa6bDZCG5H+IwYYy1a89zeBb3vsgDOIvqoXhBd6Ue9N9chSVtmlWB+JfvhMU/87GmmYpdmALKw==',key_name='tempest-keypair-2121112573',keypairs=<?>,launch_index=0,launched_at=2023-11-15T09:34:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='8b8e67f8a66a4930be3fb65c397cbeb2',ramdisk_id='',reservation_id='r-93cr0hj1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1521412552',owner_user_name='tempest-ServerActionsTestOtherA-1521412552-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T09:36:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='91f1469b2c7c45d6ac27f2b64fd5cefe',uuid=7cfd4155-c4b3-4cce-91e5-042cafccab8b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3066e71b-c5d6-4e46-980c-2b0d42739f95", "address": "fa:16:3e:e1:ad:0f", "network": {"id": "6e846655-a6f8-4339-a239-65d2f94c8b74", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1923452032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b8e67f8a66a4930be3fb65c397cbeb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3066e71b-c5", "ovs_interfaceid": "3066e71b-c5d6-4e46-980c-2b0d42739f95", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 09:36:10 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-d5a59427-2ad1-4779-b624-e0fbec25edf6 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Converting VIF {"id": "3066e71b-c5d6-4e46-980c-2b0d42739f95", "address": "fa:16:3e:e1:ad:0f", "network": {"id": "6e846655-a6f8-4339-a239-65d2f94c8b74", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1923452032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b8e67f8a66a4930be3fb65c397cbeb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3066e71b-c5", "ovs_interfaceid": "3066e71b-c5d6-4e46-980c-2b0d42739f95", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 09:36:10 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-d5a59427-2ad1-4779-b624-e0fbec25edf6 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e1:ad:0f,bridge_name='br-int',has_traffic_filtering=True,id=3066e71b-c5d6-4e46-980c-2b0d42739f95,network=Network(6e846655-a6f8-4339-a239-65d2f94c8b74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3066e71b-c5') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 09:36:10 user nova-compute[75122]: DEBUG os_vif [None req-d5a59427-2ad1-4779-b624-e0fbec25edf6 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e1:ad:0f,bridge_name='br-int',has_traffic_filtering=True,id=3066e71b-c5d6-4e46-980c-2b0d42739f95,network=Network(6e846655-a6f8-4339-a239-65d2f94c8b74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3066e71b-c5') {{(pid=75122) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 09:36:10 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:36:10 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:36:10 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 09:36:10 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:36:10 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c87afcb4-a520-5882-99c8-5a84eb17da0c', '_type': 'linux-noop'}}, row=False) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:36:10 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:36:10 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:36:10 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:36:10 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3066e71b-c5, may_exist=True, interface_attrs={}) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:36:10 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3066e71b-c5, col_values=(('qos', UUID('47c82c05-97c1-402b-9727-431a0d5f454a')),), if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:36:10 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3066e71b-c5, col_values=(('external_ids', {'iface-id': '3066e71b-c5d6-4e46-980c-2b0d42739f95', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e1:ad:0f', 'vm-uuid': '7cfd4155-c4b3-4cce-91e5-042cafccab8b'}),), if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:36:10 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:36:10 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:36:10 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:36:10 user nova-compute[75122]: INFO os_vif [None req-d5a59427-2ad1-4779-b624-e0fbec25edf6 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e1:ad:0f,bridge_name='br-int',has_traffic_filtering=True,id=3066e71b-c5d6-4e46-980c-2b0d42739f95,network=Network(6e846655-a6f8-4339-a239-65d2f94c8b74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3066e71b-c5')
Nov 15 09:36:10 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-d5a59427-2ad1-4779-b624-e0fbec25edf6 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] No BDM found with device name vda, not building metadata. {{(pid=75122) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 09:36:10 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-d5a59427-2ad1-4779-b624-e0fbec25edf6 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75122) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 09:36:10 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-d5a59427-2ad1-4779-b624-e0fbec25edf6 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] No VIF found with MAC fa:16:3e:e1:ad:0f, not building metadata {{(pid=75122) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 09:36:10 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:36:11 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:36:11 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:36:11 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75122) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 09:36:11 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:36:11 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:36:11 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:36:11 user nova-compute[75122]: DEBUG nova.compute.manager [req-232155d0-99d4-40ac-bb34-fbd870e88d66 req-4f593e6a-30ce-40fa-9fbe-a7f09c64441c service nova] [instance: 7cfd4155-c4b3-4cce-91e5-042cafccab8b] Received event network-vif-plugged-3066e71b-c5d6-4e46-980c-2b0d42739f95 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:36:11 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-232155d0-99d4-40ac-bb34-fbd870e88d66 req-4f593e6a-30ce-40fa-9fbe-a7f09c64441c service nova] Acquiring lock "7cfd4155-c4b3-4cce-91e5-042cafccab8b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:36:11 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-232155d0-99d4-40ac-bb34-fbd870e88d66 req-4f593e6a-30ce-40fa-9fbe-a7f09c64441c service nova] Lock "7cfd4155-c4b3-4cce-91e5-042cafccab8b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:36:11 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-232155d0-99d4-40ac-bb34-fbd870e88d66 req-4f593e6a-30ce-40fa-9fbe-a7f09c64441c service nova] Lock "7cfd4155-c4b3-4cce-91e5-042cafccab8b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:36:11 user nova-compute[75122]: DEBUG nova.compute.manager [req-232155d0-99d4-40ac-bb34-fbd870e88d66 req-4f593e6a-30ce-40fa-9fbe-a7f09c64441c service nova] [instance: 7cfd4155-c4b3-4cce-91e5-042cafccab8b] No waiting events found dispatching network-vif-plugged-3066e71b-c5d6-4e46-980c-2b0d42739f95 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:36:11 user nova-compute[75122]: WARNING nova.compute.manager [req-232155d0-99d4-40ac-bb34-fbd870e88d66 req-4f593e6a-30ce-40fa-9fbe-a7f09c64441c service nova] [instance: 7cfd4155-c4b3-4cce-91e5-042cafccab8b] Received unexpected event network-vif-plugged-3066e71b-c5d6-4e46-980c-2b0d42739f95 for instance with vm_state active and task_state rebuild_spawning.
Nov 15 09:36:11 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:36:11 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:36:12 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:36:12 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:36:12 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:36:12 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Cleaning up deleted instances {{(pid=75122) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 15 09:36:12 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] There are 0 instances to clean {{(pid=75122) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 15 09:36:13 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:36:13 user nova-compute[75122]: DEBUG nova.compute.manager [None req-d5a59427-2ad1-4779-b624-e0fbec25edf6 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] [instance: 7cfd4155-c4b3-4cce-91e5-042cafccab8b] Instance event wait completed in 0 seconds for  {{(pid=75122) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 09:36:13 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-d5a59427-2ad1-4779-b624-e0fbec25edf6 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] [instance: 7cfd4155-c4b3-4cce-91e5-042cafccab8b] Guest created on hypervisor {{(pid=75122) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 09:36:13 user nova-compute[75122]: INFO nova.virt.libvirt.driver [-] [instance: 7cfd4155-c4b3-4cce-91e5-042cafccab8b] Instance spawned successfully.
Nov 15 09:36:13 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-d5a59427-2ad1-4779-b624-e0fbec25edf6 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] [instance: 7cfd4155-c4b3-4cce-91e5-042cafccab8b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 09:36:13 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-d5a59427-2ad1-4779-b624-e0fbec25edf6 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] [instance: 7cfd4155-c4b3-4cce-91e5-042cafccab8b] Found default for hw_cdrom_bus of ide {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:36:13 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-d5a59427-2ad1-4779-b624-e0fbec25edf6 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] [instance: 7cfd4155-c4b3-4cce-91e5-042cafccab8b] Found default for hw_disk_bus of virtio {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:36:13 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-d5a59427-2ad1-4779-b624-e0fbec25edf6 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] [instance: 7cfd4155-c4b3-4cce-91e5-042cafccab8b] Found default for hw_input_bus of None {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:36:13 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-d5a59427-2ad1-4779-b624-e0fbec25edf6 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] [instance: 7cfd4155-c4b3-4cce-91e5-042cafccab8b] Found default for hw_pointer_model of None {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:36:13 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-d5a59427-2ad1-4779-b624-e0fbec25edf6 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] [instance: 7cfd4155-c4b3-4cce-91e5-042cafccab8b] Found default for hw_video_model of virtio {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:36:13 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-d5a59427-2ad1-4779-b624-e0fbec25edf6 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] [instance: 7cfd4155-c4b3-4cce-91e5-042cafccab8b] Found default for hw_vif_model of virtio {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:36:13 user nova-compute[75122]: DEBUG nova.compute.manager [req-441f32f7-b92e-4513-98d4-87d04aa86056 req-71a45e76-b5d3-487a-8e35-49d4be81610c service nova] [instance: 7cfd4155-c4b3-4cce-91e5-042cafccab8b] Received event network-vif-plugged-3066e71b-c5d6-4e46-980c-2b0d42739f95 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:36:13 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-441f32f7-b92e-4513-98d4-87d04aa86056 req-71a45e76-b5d3-487a-8e35-49d4be81610c service nova] Acquiring lock "7cfd4155-c4b3-4cce-91e5-042cafccab8b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:36:13 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-441f32f7-b92e-4513-98d4-87d04aa86056 req-71a45e76-b5d3-487a-8e35-49d4be81610c service nova] Lock "7cfd4155-c4b3-4cce-91e5-042cafccab8b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:36:13 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-441f32f7-b92e-4513-98d4-87d04aa86056 req-71a45e76-b5d3-487a-8e35-49d4be81610c service nova] Lock "7cfd4155-c4b3-4cce-91e5-042cafccab8b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:36:13 user nova-compute[75122]: DEBUG nova.compute.manager [req-441f32f7-b92e-4513-98d4-87d04aa86056 req-71a45e76-b5d3-487a-8e35-49d4be81610c service nova] [instance: 7cfd4155-c4b3-4cce-91e5-042cafccab8b] No waiting events found dispatching network-vif-plugged-3066e71b-c5d6-4e46-980c-2b0d42739f95 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:36:13 user nova-compute[75122]: WARNING nova.compute.manager [req-441f32f7-b92e-4513-98d4-87d04aa86056 req-71a45e76-b5d3-487a-8e35-49d4be81610c service nova] [instance: 7cfd4155-c4b3-4cce-91e5-042cafccab8b] Received unexpected event network-vif-plugged-3066e71b-c5d6-4e46-980c-2b0d42739f95 for instance with vm_state active and task_state rebuild_spawning.
Nov 15 09:36:13 user nova-compute[75122]: DEBUG nova.compute.manager [None req-d5a59427-2ad1-4779-b624-e0fbec25edf6 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] [instance: 7cfd4155-c4b3-4cce-91e5-042cafccab8b] Checking state {{(pid=75122) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 09:36:13 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-d5a59427-2ad1-4779-b624-e0fbec25edf6 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:36:13 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-d5a59427-2ad1-4779-b624-e0fbec25edf6 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:36:13 user nova-compute[75122]: DEBUG nova.objects.instance [None req-d5a59427-2ad1-4779-b624-e0fbec25edf6 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] [instance: 7cfd4155-c4b3-4cce-91e5-042cafccab8b] Trying to apply a migration context that does not seem to be set for this instance {{(pid=75122) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 15 09:36:14 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-d5a59427-2ad1-4779-b624-e0fbec25edf6 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.090s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:36:14 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:36:14 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:36:14 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:36:14 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:36:14 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:36:14 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75122) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 09:36:14 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee961d5a-e0d1-4931-9293-eefbe638097a/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:36:14 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee961d5a-e0d1-4931-9293-eefbe638097a/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:36:14 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee961d5a-e0d1-4931-9293-eefbe638097a/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:36:14 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee961d5a-e0d1-4931-9293-eefbe638097a/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:36:14 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75122) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 09:36:14 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] skipping disk /dev/sdi (vda) as it is a volume {{(pid=75122) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 09:36:14 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd9d52bb-6248-48e6-a798-6dbdaaa68cbc/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:36:15 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd9d52bb-6248-48e6-a798-6dbdaaa68cbc/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:36:15 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd9d52bb-6248-48e6-a798-6dbdaaa68cbc/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:36:15 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:36:15 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd9d52bb-6248-48e6-a798-6dbdaaa68cbc/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:36:15 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5a4d58-ba1e-473d-a32a-06fae1c84efc/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:36:15 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5a4d58-ba1e-473d-a32a-06fae1c84efc/disk --force-share --output=json" returned: 0 in 0.251s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:36:15 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5a4d58-ba1e-473d-a32a-06fae1c84efc/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:36:15 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:36:15 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5a4d58-ba1e-473d-a32a-06fae1c84efc/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:36:15 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e19f9e1-69c6-4590-85d2-e90cbdbb3d80/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:36:15 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e19f9e1-69c6-4590-85d2-e90cbdbb3d80/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:36:15 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e19f9e1-69c6-4590-85d2-e90cbdbb3d80/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:36:16 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e19f9e1-69c6-4590-85d2-e90cbdbb3d80/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:36:16 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/131142fd-e8ec-42d1-a518-aa21c7bb7cb1/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:36:16 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/131142fd-e8ec-42d1-a518-aa21c7bb7cb1/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:36:16 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/131142fd-e8ec-42d1-a518-aa21c7bb7cb1/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:36:16 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/131142fd-e8ec-42d1-a518-aa21c7bb7cb1/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:36:16 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cfd4155-c4b3-4cce-91e5-042cafccab8b/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:36:17 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cfd4155-c4b3-4cce-91e5-042cafccab8b/disk --force-share --output=json" returned: 0 in 0.410s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:36:17 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cfd4155-c4b3-4cce-91e5-042cafccab8b/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:36:17 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cfd4155-c4b3-4cce-91e5-042cafccab8b/disk --force-share --output=json" returned: 0 in 0.281s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:36:17 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75122) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 09:36:17 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75122) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 09:36:17 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=75122) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 09:36:17 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] skipping disk /dev/sdh (vdc) as it is a volume {{(pid=75122) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 09:36:17 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00270cc2-4f5b-4f64-8f88-31f21e3b3950/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:36:17 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00270cc2-4f5b-4f64-8f88-31f21e3b3950/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:36:17 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00270cc2-4f5b-4f64-8f88-31f21e3b3950/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:36:18 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00270cc2-4f5b-4f64-8f88-31f21e3b3950/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:36:18 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 09:36:18 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 09:36:18 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Hypervisor/Node resource view: name=user free_ram=7524MB free_disk=25.566272735595703GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75122) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 09:36:18 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:36:18 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:36:18 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance 131142fd-e8ec-42d1-a518-aa21c7bb7cb1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:36:18 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance 7cfd4155-c4b3-4cce-91e5-042cafccab8b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:36:18 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance ee961d5a-e0d1-4931-9293-eefbe638097a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:36:18 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance 6a2fb361-de47-41c4-afa2-46f7107af1f4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:36:18 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance f7d1a157-3228-490e-a6a0-68f6bd2b52ba actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:36:18 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance 5b5a4d58-ba1e-473d-a32a-06fae1c84efc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:36:18 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance 1e19f9e1-69c6-4590-85d2-e90cbdbb3d80 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:36:18 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance fd9d52bb-6248-48e6-a798-6dbdaaa68cbc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:36:18 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance 00270cc2-4f5b-4f64-8f88-31f21e3b3950 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:36:18 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75122) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 09:36:18 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75122) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 09:36:18 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Refreshing inventories for resource provider 69a3da65-47be-44c6-b67c-c692b58284ef {{(pid=75122) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 15 09:36:18 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Updating ProviderTree inventory for provider 69a3da65-47be-44c6-b67c-c692b58284ef from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 15 09:36:18 user nova-compute[75122]: DEBUG nova.compute.provider_tree [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Updating inventory in ProviderTree for provider 69a3da65-47be-44c6-b67c-c692b58284ef with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 15 09:36:18 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Refreshing aggregate associations for resource provider 69a3da65-47be-44c6-b67c-c692b58284ef, aggregates: None {{(pid=75122) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 15 09:36:18 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Refreshing trait associations for resource provider 69a3da65-47be-44c6-b67c-c692b58284ef, traits: COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_RESCUE_BFV,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE,COMPUTE_NODE,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_ACCELERATORS,HW_CPU_X86_MMX {{(pid=75122) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 15 09:36:19 user nova-compute[75122]: DEBUG nova.compute.provider_tree [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Inventory has not changed in ProviderTree for provider: 69a3da65-47be-44c6-b67c-c692b58284ef {{(pid=75122) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 09:36:19 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Inventory has not changed for provider 69a3da65-47be-44c6-b67c-c692b58284ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 09:36:19 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Compute_service record updated for user:user {{(pid=75122) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 09:36:19 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.761s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:36:19 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:36:20 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:36:20 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:36:20 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:36:20 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:36:20 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Starting heal instance info cache {{(pid=75122) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 09:36:20 user nova-compute[75122]: DEBUG nova.compute.manager [req-843dafbf-cde3-4459-8449-edd0a43fb24a req-d35509bc-fe53-4f4f-bd57-8860fa41f84c service nova] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] Received event network-changed-3f2e7e15-d1e1-42b1-8cda-c0ec4cadff4a {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:36:20 user nova-compute[75122]: DEBUG nova.compute.manager [req-843dafbf-cde3-4459-8449-edd0a43fb24a req-d35509bc-fe53-4f4f-bd57-8860fa41f84c service nova] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] Refreshing instance network info cache due to event network-changed-3f2e7e15-d1e1-42b1-8cda-c0ec4cadff4a. {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 09:36:20 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-843dafbf-cde3-4459-8449-edd0a43fb24a req-d35509bc-fe53-4f4f-bd57-8860fa41f84c service nova] Acquiring lock "refresh_cache-6a2fb361-de47-41c4-afa2-46f7107af1f4" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 09:36:20 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-843dafbf-cde3-4459-8449-edd0a43fb24a req-d35509bc-fe53-4f4f-bd57-8860fa41f84c service nova] Acquired lock "refresh_cache-6a2fb361-de47-41c4-afa2-46f7107af1f4" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 09:36:20 user nova-compute[75122]: DEBUG nova.network.neutron [req-843dafbf-cde3-4459-8449-edd0a43fb24a req-d35509bc-fe53-4f4f-bd57-8860fa41f84c service nova] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] Refreshing network info cache for port 3f2e7e15-d1e1-42b1-8cda-c0ec4cadff4a {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 09:36:20 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "refresh_cache-131142fd-e8ec-42d1-a518-aa21c7bb7cb1" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 09:36:20 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquired lock "refresh_cache-131142fd-e8ec-42d1-a518-aa21c7bb7cb1" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 09:36:20 user nova-compute[75122]: DEBUG nova.network.neutron [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] [instance: 131142fd-e8ec-42d1-a518-aa21c7bb7cb1] Forcefully refreshing network info cache for instance {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 09:36:20 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:36:21 user nova-compute[75122]: DEBUG nova.network.neutron [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] [instance: 131142fd-e8ec-42d1-a518-aa21c7bb7cb1] Updating instance_info_cache with network_info: [{"id": "f8302d0d-f140-479c-96da-b21516385381", "address": "fa:16:3e:06:1e:34", "network": {"id": "6e846655-a6f8-4339-a239-65d2f94c8b74", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1923452032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b8e67f8a66a4930be3fb65c397cbeb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8302d0d-f1", "ovs_interfaceid": "f8302d0d-f140-479c-96da-b21516385381", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:36:21 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Releasing lock "refresh_cache-131142fd-e8ec-42d1-a518-aa21c7bb7cb1" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 09:36:21 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] [instance: 131142fd-e8ec-42d1-a518-aa21c7bb7cb1] Updated the network info_cache for instance {{(pid=75122) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 09:36:21 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:36:22 user nova-compute[75122]: DEBUG nova.network.neutron [req-843dafbf-cde3-4459-8449-edd0a43fb24a req-d35509bc-fe53-4f4f-bd57-8860fa41f84c service nova] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] Updated VIF entry in instance network info cache for port 3f2e7e15-d1e1-42b1-8cda-c0ec4cadff4a. {{(pid=75122) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 09:36:22 user nova-compute[75122]: DEBUG nova.network.neutron [req-843dafbf-cde3-4459-8449-edd0a43fb24a req-d35509bc-fe53-4f4f-bd57-8860fa41f84c service nova] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] Updating instance_info_cache with network_info: [{"id": "3f2e7e15-d1e1-42b1-8cda-c0ec4cadff4a", "address": "fa:16:3e:dd:2a:39", "network": {"id": "2d3f0ed7-fd1f-4b58-9e19-c498613e096b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-737425118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71b1beadf771447694e937ffa1453d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f2e7e15-d1", "ovs_interfaceid": "3f2e7e15-d1e1-42b1-8cda-c0ec4cadff4a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ed761290-10dd-41fa-a1c6-479747e0b83d", "address": "fa:16:3e:3b:ea:63", "network": {"id": "10809c12-a24e-41c8-ad4b-4ecab7ab24dd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1109444380", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.229", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "71b1beadf771447694e937ffa1453d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped761290-10", "ovs_interfaceid": "ed761290-10dd-41fa-a1c6-479747e0b83d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c357e948-986d-4592-a7c5-389bd6202867", "address": "fa:16:3e:0a:a9:a9", "network": {"id": "10809c12-a24e-41c8-ad4b-4ecab7ab24dd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1109444380", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.35", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "71b1beadf771447694e937ffa1453d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc357e948-98", "ovs_interfaceid": "c357e948-986d-4592-a7c5-389bd6202867", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1cb107c5-bd60-4ce6-8da3-b6b15bd16ef1", "address": "fa:16:3e:17:4f:64", "network": {"id": "10809c12-a24e-41c8-ad4b-4ecab7ab24dd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1109444380", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.24", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "71b1beadf771447694e937ffa1453d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cb107c5-bd", "ovs_interfaceid": "1cb107c5-bd60-4ce6-8da3-b6b15bd16ef1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2f92aaa6-98e2-4d75-8b96-92c08d77c635", "address": "fa:16:3e:b6:db:04", "network": {"id": "10809c12-a24e-41c8-ad4b-4ecab7ab24dd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1109444380", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.202", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "71b1beadf771447694e937ffa1453d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f92aaa6-98", "ovs_interfaceid": "2f92aaa6-98e2-4d75-8b96-92c08d77c635", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "598c4b32-243b-461b-b9a4-3a2ba2b7537b", "address": "fa:16:3e:3f:ce:07", "network": {"id": "217bd6f7-91ff-488f-855e-32d3a5268c46", "bridge": "br-int", "label": "tempest-device-tagging-net2-1686179832", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "71b1beadf771447694e937ffa1453d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap598c4b32-24", "ovs_interfaceid": "598c4b32-243b-461b-b9a4-3a2ba2b7537b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "917da5e4-bdd2-40d9-9e03-b6f96858805b", "address": "fa:16:3e:ce:f2:9a", "network": {"id": "217bd6f7-91ff-488f-855e-32d3a5268c46", "bridge": "br-int", "label": "tempest-device-tagging-net2-1686179832", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "71b1beadf771447694e937ffa1453d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap917da5e4-bd", "ovs_interfaceid": "917da5e4-bdd2-40d9-9e03-b6f96858805b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:36:22 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-843dafbf-cde3-4459-8449-edd0a43fb24a req-d35509bc-fe53-4f4f-bd57-8860fa41f84c service nova] Releasing lock "refresh_cache-6a2fb361-de47-41c4-afa2-46f7107af1f4" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 09:36:25 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:36:25 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:36:26 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-c899a27c-4cf5-48dd-9ecc-e2a56f7bd9f4 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] Acquiring lock "6a2fb361-de47-41c4-afa2-46f7107af1f4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:36:26 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-c899a27c-4cf5-48dd-9ecc-e2a56f7bd9f4 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] Lock "6a2fb361-de47-41c4-afa2-46f7107af1f4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:36:26 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-c899a27c-4cf5-48dd-9ecc-e2a56f7bd9f4 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] Acquiring lock "6a2fb361-de47-41c4-afa2-46f7107af1f4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:36:26 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-c899a27c-4cf5-48dd-9ecc-e2a56f7bd9f4 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] Lock "6a2fb361-de47-41c4-afa2-46f7107af1f4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.005s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:36:26 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-c899a27c-4cf5-48dd-9ecc-e2a56f7bd9f4 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] Lock "6a2fb361-de47-41c4-afa2-46f7107af1f4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:36:26 user nova-compute[75122]: INFO nova.compute.manager [None req-c899a27c-4cf5-48dd-9ecc-e2a56f7bd9f4 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] Terminating instance
Nov 15 09:36:26 user nova-compute[75122]: DEBUG nova.compute.manager [None req-c899a27c-4cf5-48dd-9ecc-e2a56f7bd9f4 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] Start destroying the instance on the hypervisor. {{(pid=75122) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 09:36:26 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:36:26 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:36:26 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:36:26 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:36:26 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:36:26 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:36:26 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:36:26 user nova-compute[75122]: DEBUG nova.compute.manager [req-fb00e6e7-7205-4cd3-aa82-7ba795295926 req-8cbaafed-5688-42c4-9a0e-2a2a47d4e917 service nova] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] Received event network-vif-unplugged-3f2e7e15-d1e1-42b1-8cda-c0ec4cadff4a {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:36:26 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-fb00e6e7-7205-4cd3-aa82-7ba795295926 req-8cbaafed-5688-42c4-9a0e-2a2a47d4e917 service nova] Acquiring lock "6a2fb361-de47-41c4-afa2-46f7107af1f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:36:26 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-fb00e6e7-7205-4cd3-aa82-7ba795295926 req-8cbaafed-5688-42c4-9a0e-2a2a47d4e917 service nova] Lock "6a2fb361-de47-41c4-afa2-46f7107af1f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:36:26 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-fb00e6e7-7205-4cd3-aa82-7ba795295926 req-8cbaafed-5688-42c4-9a0e-2a2a47d4e917 service nova] Lock "6a2fb361-de47-41c4-afa2-46f7107af1f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:36:26 user nova-compute[75122]: DEBUG nova.compute.manager [req-fb00e6e7-7205-4cd3-aa82-7ba795295926 req-8cbaafed-5688-42c4-9a0e-2a2a47d4e917 service nova] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] No waiting events found dispatching network-vif-unplugged-3f2e7e15-d1e1-42b1-8cda-c0ec4cadff4a {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:36:26 user nova-compute[75122]: DEBUG nova.compute.manager [req-fb00e6e7-7205-4cd3-aa82-7ba795295926 req-8cbaafed-5688-42c4-9a0e-2a2a47d4e917 service nova] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] Received event network-vif-unplugged-3f2e7e15-d1e1-42b1-8cda-c0ec4cadff4a for instance with task_state deleting. {{(pid=75122) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 09:36:26 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:36:26 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:36:27 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:36:27 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:36:27 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:36:27 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:36:27 user nova-compute[75122]: DEBUG nova.compute.manager [req-553a0265-aa9f-4356-b193-a4b4beb02f83 req-4bd5115b-e696-4128-bac2-c3774602adfd service nova] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] Received event network-vif-unplugged-ed761290-10dd-41fa-a1c6-479747e0b83d {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:36:27 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-553a0265-aa9f-4356-b193-a4b4beb02f83 req-4bd5115b-e696-4128-bac2-c3774602adfd service nova] Acquiring lock "6a2fb361-de47-41c4-afa2-46f7107af1f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:36:27 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-553a0265-aa9f-4356-b193-a4b4beb02f83 req-4bd5115b-e696-4128-bac2-c3774602adfd service nova] Lock "6a2fb361-de47-41c4-afa2-46f7107af1f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:36:27 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-553a0265-aa9f-4356-b193-a4b4beb02f83 req-4bd5115b-e696-4128-bac2-c3774602adfd service nova] Lock "6a2fb361-de47-41c4-afa2-46f7107af1f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:36:27 user nova-compute[75122]: DEBUG nova.compute.manager [req-553a0265-aa9f-4356-b193-a4b4beb02f83 req-4bd5115b-e696-4128-bac2-c3774602adfd service nova] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] No waiting events found dispatching network-vif-unplugged-ed761290-10dd-41fa-a1c6-479747e0b83d {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:36:27 user nova-compute[75122]: DEBUG nova.compute.manager [req-553a0265-aa9f-4356-b193-a4b4beb02f83 req-4bd5115b-e696-4128-bac2-c3774602adfd service nova] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] Received event network-vif-unplugged-ed761290-10dd-41fa-a1c6-479747e0b83d for instance with task_state deleting. {{(pid=75122) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 09:36:27 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:36:27 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:36:27 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:36:27 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:36:27 user nova-compute[75122]: DEBUG nova.compute.manager [req-02afde30-a87c-4f66-a4f9-c948a3ea411e req-adadec0d-97b1-4769-b394-34facd893577 service nova] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] Received event network-vif-unplugged-598c4b32-243b-461b-b9a4-3a2ba2b7537b {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:36:27 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-02afde30-a87c-4f66-a4f9-c948a3ea411e req-adadec0d-97b1-4769-b394-34facd893577 service nova] Acquiring lock "6a2fb361-de47-41c4-afa2-46f7107af1f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:36:27 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-02afde30-a87c-4f66-a4f9-c948a3ea411e req-adadec0d-97b1-4769-b394-34facd893577 service nova] Lock "6a2fb361-de47-41c4-afa2-46f7107af1f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:36:27 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-02afde30-a87c-4f66-a4f9-c948a3ea411e req-adadec0d-97b1-4769-b394-34facd893577 service nova] Lock "6a2fb361-de47-41c4-afa2-46f7107af1f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:36:27 user nova-compute[75122]: DEBUG nova.compute.manager [req-02afde30-a87c-4f66-a4f9-c948a3ea411e req-adadec0d-97b1-4769-b394-34facd893577 service nova] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] No waiting events found dispatching network-vif-unplugged-598c4b32-243b-461b-b9a4-3a2ba2b7537b {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:36:27 user nova-compute[75122]: DEBUG nova.compute.manager [req-02afde30-a87c-4f66-a4f9-c948a3ea411e req-adadec0d-97b1-4769-b394-34facd893577 service nova] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] Received event network-vif-unplugged-598c4b32-243b-461b-b9a4-3a2ba2b7537b for instance with task_state deleting. {{(pid=75122) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 09:36:27 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:36:27 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:36:28 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:36:28 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:36:28 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:36:28 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:36:28 user nova-compute[75122]: DEBUG nova.compute.manager [req-1a09d59d-a32c-490e-8407-8d7b521edae5 req-2dd63456-e193-4a1f-805f-08cf89cf7e0b service nova] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] Received event network-vif-plugged-3f2e7e15-d1e1-42b1-8cda-c0ec4cadff4a {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:36:28 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-1a09d59d-a32c-490e-8407-8d7b521edae5 req-2dd63456-e193-4a1f-805f-08cf89cf7e0b service nova] Acquiring lock "6a2fb361-de47-41c4-afa2-46f7107af1f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:36:28 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-1a09d59d-a32c-490e-8407-8d7b521edae5 req-2dd63456-e193-4a1f-805f-08cf89cf7e0b service nova] Lock "6a2fb361-de47-41c4-afa2-46f7107af1f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:36:28 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-1a09d59d-a32c-490e-8407-8d7b521edae5 req-2dd63456-e193-4a1f-805f-08cf89cf7e0b service nova] Lock "6a2fb361-de47-41c4-afa2-46f7107af1f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:36:28 user nova-compute[75122]: DEBUG nova.compute.manager [req-1a09d59d-a32c-490e-8407-8d7b521edae5 req-2dd63456-e193-4a1f-805f-08cf89cf7e0b service nova] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] No waiting events found dispatching network-vif-plugged-3f2e7e15-d1e1-42b1-8cda-c0ec4cadff4a {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:36:28 user nova-compute[75122]: WARNING nova.compute.manager [req-1a09d59d-a32c-490e-8407-8d7b521edae5 req-2dd63456-e193-4a1f-805f-08cf89cf7e0b service nova] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] Received unexpected event network-vif-plugged-3f2e7e15-d1e1-42b1-8cda-c0ec4cadff4a for instance with vm_state active and task_state deleting.
Nov 15 09:36:28 user nova-compute[75122]: DEBUG nova.compute.manager [req-1a09d59d-a32c-490e-8407-8d7b521edae5 req-2dd63456-e193-4a1f-805f-08cf89cf7e0b service nova] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] Received event network-vif-unplugged-c357e948-986d-4592-a7c5-389bd6202867 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:36:28 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-1a09d59d-a32c-490e-8407-8d7b521edae5 req-2dd63456-e193-4a1f-805f-08cf89cf7e0b service nova] Acquiring lock "6a2fb361-de47-41c4-afa2-46f7107af1f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:36:28 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-1a09d59d-a32c-490e-8407-8d7b521edae5 req-2dd63456-e193-4a1f-805f-08cf89cf7e0b service nova] Lock "6a2fb361-de47-41c4-afa2-46f7107af1f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:36:28 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-1a09d59d-a32c-490e-8407-8d7b521edae5 req-2dd63456-e193-4a1f-805f-08cf89cf7e0b service nova] Lock "6a2fb361-de47-41c4-afa2-46f7107af1f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:36:28 user nova-compute[75122]: DEBUG nova.compute.manager [req-1a09d59d-a32c-490e-8407-8d7b521edae5 req-2dd63456-e193-4a1f-805f-08cf89cf7e0b service nova] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] No waiting events found dispatching network-vif-unplugged-c357e948-986d-4592-a7c5-389bd6202867 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:36:28 user nova-compute[75122]: DEBUG nova.compute.manager [req-1a09d59d-a32c-490e-8407-8d7b521edae5 req-2dd63456-e193-4a1f-805f-08cf89cf7e0b service nova] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] Received event network-vif-unplugged-c357e948-986d-4592-a7c5-389bd6202867 for instance with task_state deleting. {{(pid=75122) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 09:36:28 user nova-compute[75122]: DEBUG nova.compute.manager [req-1a09d59d-a32c-490e-8407-8d7b521edae5 req-2dd63456-e193-4a1f-805f-08cf89cf7e0b service nova] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] Received event network-vif-plugged-c357e948-986d-4592-a7c5-389bd6202867 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:36:28 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-1a09d59d-a32c-490e-8407-8d7b521edae5 req-2dd63456-e193-4a1f-805f-08cf89cf7e0b service nova] Acquiring lock "6a2fb361-de47-41c4-afa2-46f7107af1f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:36:28 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-1a09d59d-a32c-490e-8407-8d7b521edae5 req-2dd63456-e193-4a1f-805f-08cf89cf7e0b service nova] Lock "6a2fb361-de47-41c4-afa2-46f7107af1f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:36:28 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-1a09d59d-a32c-490e-8407-8d7b521edae5 req-2dd63456-e193-4a1f-805f-08cf89cf7e0b service nova] Lock "6a2fb361-de47-41c4-afa2-46f7107af1f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:36:28 user nova-compute[75122]: DEBUG nova.compute.manager [req-1a09d59d-a32c-490e-8407-8d7b521edae5 req-2dd63456-e193-4a1f-805f-08cf89cf7e0b service nova] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] No waiting events found dispatching network-vif-plugged-c357e948-986d-4592-a7c5-389bd6202867 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:36:28 user nova-compute[75122]: WARNING nova.compute.manager [req-1a09d59d-a32c-490e-8407-8d7b521edae5 req-2dd63456-e193-4a1f-805f-08cf89cf7e0b service nova] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] Received unexpected event network-vif-plugged-c357e948-986d-4592-a7c5-389bd6202867 for instance with vm_state active and task_state deleting.
Nov 15 09:36:29 user nova-compute[75122]: INFO nova.virt.libvirt.driver [-] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] Instance destroyed successfully.
Nov 15 09:36:29 user nova-compute[75122]: DEBUG nova.objects.instance [None req-c899a27c-4cf5-48dd-9ecc-e2a56f7bd9f4 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] Lazy-loading 'resources' on Instance uuid 6a2fb361-de47-41c4-afa2-46f7107af1f4 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:36:29 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-c899a27c-4cf5-48dd-9ecc-e2a56f7bd9f4 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T09:34:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-779991034',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-779991034',id=13,image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNtzm4oVqy6sf0O7KeIxwJ4JdwiWvUadSQZ0XPCSfdRAZRCJOKze9wXnBI4mMiHsO2k8q5mphaM2/2fNINKbO0ntvDQnZmJp/47MBtzunoCAm54iLS2xZb0FtbX4Gq2CEQ==',key_name='tempest-keypair-985108224',keypairs=<?>,launch_index=0,launched_at=2023-11-15T09:34:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='71b1beadf771447694e937ffa1453d56',ramdisk_id='',reservation_id='r-cviciewg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1167502079',owner_user_name='tempest-TaggedBootDevicesTest_v242-1167502079-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T09:34:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='47d4e4c120fc40a994518ce384652a9b',uuid=6a2fb361-de47-41c4-afa2-46f7107af1f4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3f2e7e15-d1e1-42b1-8cda-c0ec4cadff4a", "address": "fa:16:3e:dd:2a:39", "network": {"id": "2d3f0ed7-fd1f-4b58-9e19-c498613e096b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-737425118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71b1beadf771447694e937ffa1453d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f2e7e15-d1", "ovs_interfaceid": "3f2e7e15-d1e1-42b1-8cda-c0ec4cadff4a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 09:36:29 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-c899a27c-4cf5-48dd-9ecc-e2a56f7bd9f4 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] Converting VIF {"id": "3f2e7e15-d1e1-42b1-8cda-c0ec4cadff4a", "address": "fa:16:3e:dd:2a:39", "network": {"id": "2d3f0ed7-fd1f-4b58-9e19-c498613e096b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-737425118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71b1beadf771447694e937ffa1453d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f2e7e15-d1", "ovs_interfaceid": "3f2e7e15-d1e1-42b1-8cda-c0ec4cadff4a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 09:36:29 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-c899a27c-4cf5-48dd-9ecc-e2a56f7bd9f4 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:dd:2a:39,bridge_name='br-int',has_traffic_filtering=True,id=3f2e7e15-d1e1-42b1-8cda-c0ec4cadff4a,network=Network(2d3f0ed7-fd1f-4b58-9e19-c498613e096b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f2e7e15-d1') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 09:36:29 user nova-compute[75122]: DEBUG os_vif [None req-c899a27c-4cf5-48dd-9ecc-e2a56f7bd9f4 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:dd:2a:39,bridge_name='br-int',has_traffic_filtering=True,id=3f2e7e15-d1e1-42b1-8cda-c0ec4cadff4a,network=Network(2d3f0ed7-fd1f-4b58-9e19-c498613e096b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f2e7e15-d1') {{(pid=75122) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 09:36:29 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:36:29 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3f2e7e15-d1, bridge=br-int, if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:36:29 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:36:29 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:36:29 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:36:29 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:36:29 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=04ed0040-2f1e-47a2-9f73-27640af06230) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:36:29 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:36:29 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:36:29 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:36:29 user nova-compute[75122]: INFO os_vif [None req-c899a27c-4cf5-48dd-9ecc-e2a56f7bd9f4 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:dd:2a:39,bridge_name='br-int',has_traffic_filtering=True,id=3f2e7e15-d1e1-42b1-8cda-c0ec4cadff4a,network=Network(2d3f0ed7-fd1f-4b58-9e19-c498613e096b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f2e7e15-d1')
Nov 15 09:36:29 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-c899a27c-4cf5-48dd-9ecc-e2a56f7bd9f4 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T09:34:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-779991034',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-779991034',id=13,image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNtzm4oVqy6sf0O7KeIxwJ4JdwiWvUadSQZ0XPCSfdRAZRCJOKze9wXnBI4mMiHsO2k8q5mphaM2/2fNINKbO0ntvDQnZmJp/47MBtzunoCAm54iLS2xZb0FtbX4Gq2CEQ==',key_name='tempest-keypair-985108224',keypairs=<?>,launch_index=0,launched_at=2023-11-15T09:34:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='71b1beadf771447694e937ffa1453d56',ramdisk_id='',reservation_id='r-cviciewg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1167502079',owner_user_name='tempest-TaggedBootDevicesTest_v242-1167502079-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T09:34:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='47d4e4c120fc40a994518ce384652a9b',uuid=6a2fb361-de47-41c4-afa2-46f7107af1f4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ed761290-10dd-41fa-a1c6-479747e0b83d", "address": "fa:16:3e:3b:ea:63", "network": {"id": "10809c12-a24e-41c8-ad4b-4ecab7ab24dd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1109444380", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.229", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "71b1beadf771447694e937ffa1453d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped761290-10", "ovs_interfaceid": "ed761290-10dd-41fa-a1c6-479747e0b83d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75122) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 09:36:29 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-c899a27c-4cf5-48dd-9ecc-e2a56f7bd9f4 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] Converting VIF {"id": "ed761290-10dd-41fa-a1c6-479747e0b83d", "address": "fa:16:3e:3b:ea:63", "network": {"id": "10809c12-a24e-41c8-ad4b-4ecab7ab24dd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1109444380", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.229", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "71b1beadf771447694e937ffa1453d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped761290-10", "ovs_interfaceid": "ed761290-10dd-41fa-a1c6-479747e0b83d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 09:36:29 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-c899a27c-4cf5-48dd-9ecc-e2a56f7bd9f4 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:ea:63,bridge_name='br-int',has_traffic_filtering=True,id=ed761290-10dd-41fa-a1c6-479747e0b83d,network=Network(10809c12-a24e-41c8-ad4b-4ecab7ab24dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='taped761290-10') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 09:36:29 user nova-compute[75122]: DEBUG os_vif [None req-c899a27c-4cf5-48dd-9ecc-e2a56f7bd9f4 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:ea:63,bridge_name='br-int',has_traffic_filtering=True,id=ed761290-10dd-41fa-a1c6-479747e0b83d,network=Network(10809c12-a24e-41c8-ad4b-4ecab7ab24dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='taped761290-10') {{(pid=75122) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 09:36:29 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:36:29 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=taped761290-10, bridge=br-int, if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:36:29 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:36:29 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:36:29 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:36:29 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:36:29 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=415283cd-7856-4530-84ed-294d06f2b6e9) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:36:29 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:36:29 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:36:29 user nova-compute[75122]: DEBUG nova.compute.manager [req-cb138329-2276-471e-9c10-e1b105ffe932 req-659054f0-2ca5-43ac-8013-3c2017297bd1 service nova] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] Received event network-vif-plugged-ed761290-10dd-41fa-a1c6-479747e0b83d {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:36:29 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-cb138329-2276-471e-9c10-e1b105ffe932 req-659054f0-2ca5-43ac-8013-3c2017297bd1 service nova] Acquiring lock "6a2fb361-de47-41c4-afa2-46f7107af1f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:36:29 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-cb138329-2276-471e-9c10-e1b105ffe932 req-659054f0-2ca5-43ac-8013-3c2017297bd1 service nova] Lock "6a2fb361-de47-41c4-afa2-46f7107af1f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:36:29 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-cb138329-2276-471e-9c10-e1b105ffe932 req-659054f0-2ca5-43ac-8013-3c2017297bd1 service nova] Lock "6a2fb361-de47-41c4-afa2-46f7107af1f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:36:29 user nova-compute[75122]: DEBUG nova.compute.manager [req-cb138329-2276-471e-9c10-e1b105ffe932 req-659054f0-2ca5-43ac-8013-3c2017297bd1 service nova] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] No waiting events found dispatching network-vif-plugged-ed761290-10dd-41fa-a1c6-479747e0b83d {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:36:29 user nova-compute[75122]: WARNING nova.compute.manager [req-cb138329-2276-471e-9c10-e1b105ffe932 req-659054f0-2ca5-43ac-8013-3c2017297bd1 service nova] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] Received unexpected event network-vif-plugged-ed761290-10dd-41fa-a1c6-479747e0b83d for instance with vm_state active and task_state deleting.
Nov 15 09:36:29 user nova-compute[75122]: DEBUG nova.compute.manager [req-cb138329-2276-471e-9c10-e1b105ffe932 req-659054f0-2ca5-43ac-8013-3c2017297bd1 service nova] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] Received event network-vif-unplugged-1cb107c5-bd60-4ce6-8da3-b6b15bd16ef1 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:36:29 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-cb138329-2276-471e-9c10-e1b105ffe932 req-659054f0-2ca5-43ac-8013-3c2017297bd1 service nova] Acquiring lock "6a2fb361-de47-41c4-afa2-46f7107af1f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:36:29 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-cb138329-2276-471e-9c10-e1b105ffe932 req-659054f0-2ca5-43ac-8013-3c2017297bd1 service nova] Lock "6a2fb361-de47-41c4-afa2-46f7107af1f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:36:29 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-cb138329-2276-471e-9c10-e1b105ffe932 req-659054f0-2ca5-43ac-8013-3c2017297bd1 service nova] Lock "6a2fb361-de47-41c4-afa2-46f7107af1f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:36:29 user nova-compute[75122]: DEBUG nova.compute.manager [req-cb138329-2276-471e-9c10-e1b105ffe932 req-659054f0-2ca5-43ac-8013-3c2017297bd1 service nova] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] No waiting events found dispatching network-vif-unplugged-1cb107c5-bd60-4ce6-8da3-b6b15bd16ef1 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:36:29 user nova-compute[75122]: DEBUG nova.compute.manager [req-cb138329-2276-471e-9c10-e1b105ffe932 req-659054f0-2ca5-43ac-8013-3c2017297bd1 service nova] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] Received event network-vif-unplugged-1cb107c5-bd60-4ce6-8da3-b6b15bd16ef1 for instance with task_state deleting. {{(pid=75122) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 09:36:29 user nova-compute[75122]: DEBUG nova.compute.manager [req-cb138329-2276-471e-9c10-e1b105ffe932 req-659054f0-2ca5-43ac-8013-3c2017297bd1 service nova] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] Received event network-vif-plugged-1cb107c5-bd60-4ce6-8da3-b6b15bd16ef1 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:36:29 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-cb138329-2276-471e-9c10-e1b105ffe932 req-659054f0-2ca5-43ac-8013-3c2017297bd1 service nova] Acquiring lock "6a2fb361-de47-41c4-afa2-46f7107af1f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:36:29 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-cb138329-2276-471e-9c10-e1b105ffe932 req-659054f0-2ca5-43ac-8013-3c2017297bd1 service nova] Lock "6a2fb361-de47-41c4-afa2-46f7107af1f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:36:29 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-cb138329-2276-471e-9c10-e1b105ffe932 req-659054f0-2ca5-43ac-8013-3c2017297bd1 service nova] Lock "6a2fb361-de47-41c4-afa2-46f7107af1f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:36:29 user nova-compute[75122]: DEBUG nova.compute.manager [req-cb138329-2276-471e-9c10-e1b105ffe932 req-659054f0-2ca5-43ac-8013-3c2017297bd1 service nova] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] No waiting events found dispatching network-vif-plugged-1cb107c5-bd60-4ce6-8da3-b6b15bd16ef1 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:36:29 user nova-compute[75122]: WARNING nova.compute.manager [req-cb138329-2276-471e-9c10-e1b105ffe932 req-659054f0-2ca5-43ac-8013-3c2017297bd1 service nova] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] Received unexpected event network-vif-plugged-1cb107c5-bd60-4ce6-8da3-b6b15bd16ef1 for instance with vm_state active and task_state deleting.
Nov 15 09:36:29 user nova-compute[75122]: DEBUG nova.compute.manager [req-cb138329-2276-471e-9c10-e1b105ffe932 req-659054f0-2ca5-43ac-8013-3c2017297bd1 service nova] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] Received event network-vif-unplugged-2f92aaa6-98e2-4d75-8b96-92c08d77c635 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:36:29 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-cb138329-2276-471e-9c10-e1b105ffe932 req-659054f0-2ca5-43ac-8013-3c2017297bd1 service nova] Acquiring lock "6a2fb361-de47-41c4-afa2-46f7107af1f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:36:29 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-cb138329-2276-471e-9c10-e1b105ffe932 req-659054f0-2ca5-43ac-8013-3c2017297bd1 service nova] Lock "6a2fb361-de47-41c4-afa2-46f7107af1f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:36:29 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-cb138329-2276-471e-9c10-e1b105ffe932 req-659054f0-2ca5-43ac-8013-3c2017297bd1 service nova] Lock "6a2fb361-de47-41c4-afa2-46f7107af1f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:36:29 user nova-compute[75122]: DEBUG nova.compute.manager [req-cb138329-2276-471e-9c10-e1b105ffe932 req-659054f0-2ca5-43ac-8013-3c2017297bd1 service nova] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] No waiting events found dispatching network-vif-unplugged-2f92aaa6-98e2-4d75-8b96-92c08d77c635 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:36:29 user nova-compute[75122]: DEBUG nova.compute.manager [req-cb138329-2276-471e-9c10-e1b105ffe932 req-659054f0-2ca5-43ac-8013-3c2017297bd1 service nova] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] Received event network-vif-unplugged-2f92aaa6-98e2-4d75-8b96-92c08d77c635 for instance with task_state deleting. {{(pid=75122) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 09:36:29 user nova-compute[75122]: DEBUG nova.compute.manager [req-cb138329-2276-471e-9c10-e1b105ffe932 req-659054f0-2ca5-43ac-8013-3c2017297bd1 service nova] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] Received event network-vif-plugged-2f92aaa6-98e2-4d75-8b96-92c08d77c635 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:36:29 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-cb138329-2276-471e-9c10-e1b105ffe932 req-659054f0-2ca5-43ac-8013-3c2017297bd1 service nova] Acquiring lock "6a2fb361-de47-41c4-afa2-46f7107af1f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:36:29 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-cb138329-2276-471e-9c10-e1b105ffe932 req-659054f0-2ca5-43ac-8013-3c2017297bd1 service nova] Lock "6a2fb361-de47-41c4-afa2-46f7107af1f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:36:29 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-cb138329-2276-471e-9c10-e1b105ffe932 req-659054f0-2ca5-43ac-8013-3c2017297bd1 service nova] Lock "6a2fb361-de47-41c4-afa2-46f7107af1f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:36:29 user nova-compute[75122]: DEBUG nova.compute.manager [req-cb138329-2276-471e-9c10-e1b105ffe932 req-659054f0-2ca5-43ac-8013-3c2017297bd1 service nova] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] No waiting events found dispatching network-vif-plugged-2f92aaa6-98e2-4d75-8b96-92c08d77c635 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:36:29 user nova-compute[75122]: WARNING nova.compute.manager [req-cb138329-2276-471e-9c10-e1b105ffe932 req-659054f0-2ca5-43ac-8013-3c2017297bd1 service nova] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] Received unexpected event network-vif-plugged-2f92aaa6-98e2-4d75-8b96-92c08d77c635 for instance with vm_state active and task_state deleting.
Nov 15 09:36:29 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:36:29 user nova-compute[75122]: INFO os_vif [None req-c899a27c-4cf5-48dd-9ecc-e2a56f7bd9f4 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:ea:63,bridge_name='br-int',has_traffic_filtering=True,id=ed761290-10dd-41fa-a1c6-479747e0b83d,network=Network(10809c12-a24e-41c8-ad4b-4ecab7ab24dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='taped761290-10')
Nov 15 09:36:29 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-c899a27c-4cf5-48dd-9ecc-e2a56f7bd9f4 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T09:34:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-779991034',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-779991034',id=13,image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNtzm4oVqy6sf0O7KeIxwJ4JdwiWvUadSQZ0XPCSfdRAZRCJOKze9wXnBI4mMiHsO2k8q5mphaM2/2fNINKbO0ntvDQnZmJp/47MBtzunoCAm54iLS2xZb0FtbX4Gq2CEQ==',key_name='tempest-keypair-985108224',keypairs=<?>,launch_index=0,launched_at=2023-11-15T09:34:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='71b1beadf771447694e937ffa1453d56',ramdisk_id='',reservation_id='r-cviciewg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1167502079',owner_user_name='tempest-TaggedBootDevicesTest_v242-1167502079-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T09:34:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='47d4e4c120fc40a994518ce384652a9b',uuid=6a2fb361-de47-41c4-afa2-46f7107af1f4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c357e948-986d-4592-a7c5-389bd6202867", "address": "fa:16:3e:0a:a9:a9", "network": {"id": "10809c12-a24e-41c8-ad4b-4ecab7ab24dd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1109444380", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.35", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "71b1beadf771447694e937ffa1453d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc357e948-98", "ovs_interfaceid": "c357e948-986d-4592-a7c5-389bd6202867", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75122) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 09:36:29 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-c899a27c-4cf5-48dd-9ecc-e2a56f7bd9f4 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] Converting VIF {"id": "c357e948-986d-4592-a7c5-389bd6202867", "address": "fa:16:3e:0a:a9:a9", "network": {"id": "10809c12-a24e-41c8-ad4b-4ecab7ab24dd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1109444380", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.35", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "71b1beadf771447694e937ffa1453d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc357e948-98", "ovs_interfaceid": "c357e948-986d-4592-a7c5-389bd6202867", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 09:36:29 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-c899a27c-4cf5-48dd-9ecc-e2a56f7bd9f4 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0a:a9:a9,bridge_name='br-int',has_traffic_filtering=True,id=c357e948-986d-4592-a7c5-389bd6202867,network=Network(10809c12-a24e-41c8-ad4b-4ecab7ab24dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc357e948-98') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 09:36:29 user nova-compute[75122]: DEBUG os_vif [None req-c899a27c-4cf5-48dd-9ecc-e2a56f7bd9f4 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:a9:a9,bridge_name='br-int',has_traffic_filtering=True,id=c357e948-986d-4592-a7c5-389bd6202867,network=Network(10809c12-a24e-41c8-ad4b-4ecab7ab24dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc357e948-98') {{(pid=75122) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 09:36:29 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:36:29 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc357e948-98, bridge=br-int, if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:36:29 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:36:29 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:36:29 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:36:29 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:36:29 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fadb0e26-9d87-4632-8278-aa7fa10d64ef) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:36:29 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:36:29 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:36:29 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:36:29 user nova-compute[75122]: INFO os_vif [None req-c899a27c-4cf5-48dd-9ecc-e2a56f7bd9f4 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:a9:a9,bridge_name='br-int',has_traffic_filtering=True,id=c357e948-986d-4592-a7c5-389bd6202867,network=Network(10809c12-a24e-41c8-ad4b-4ecab7ab24dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc357e948-98')
Nov 15 09:36:29 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-c899a27c-4cf5-48dd-9ecc-e2a56f7bd9f4 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T09:34:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-779991034',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-779991034',id=13,image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNtzm4oVqy6sf0O7KeIxwJ4JdwiWvUadSQZ0XPCSfdRAZRCJOKze9wXnBI4mMiHsO2k8q5mphaM2/2fNINKbO0ntvDQnZmJp/47MBtzunoCAm54iLS2xZb0FtbX4Gq2CEQ==',key_name='tempest-keypair-985108224',keypairs=<?>,launch_index=0,launched_at=2023-11-15T09:34:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='71b1beadf771447694e937ffa1453d56',ramdisk_id='',reservation_id='r-cviciewg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1167502079',owner_user_name='tempest-TaggedBootDevicesTest_v242-1167502079-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T09:34:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='47d4e4c120fc40a994518ce384652a9b',uuid=6a2fb361-de47-41c4-afa2-46f7107af1f4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1cb107c5-bd60-4ce6-8da3-b6b15bd16ef1", "address": "fa:16:3e:17:4f:64", "network": {"id": "10809c12-a24e-41c8-ad4b-4ecab7ab24dd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1109444380", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.24", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "71b1beadf771447694e937ffa1453d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cb107c5-bd", "ovs_interfaceid": "1cb107c5-bd60-4ce6-8da3-b6b15bd16ef1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 09:36:29 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-c899a27c-4cf5-48dd-9ecc-e2a56f7bd9f4 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] Converting VIF {"id": "1cb107c5-bd60-4ce6-8da3-b6b15bd16ef1", "address": "fa:16:3e:17:4f:64", "network": {"id": "10809c12-a24e-41c8-ad4b-4ecab7ab24dd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1109444380", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.24", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "71b1beadf771447694e937ffa1453d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cb107c5-bd", "ovs_interfaceid": "1cb107c5-bd60-4ce6-8da3-b6b15bd16ef1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 09:36:29 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-c899a27c-4cf5-48dd-9ecc-e2a56f7bd9f4 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:4f:64,bridge_name='br-int',has_traffic_filtering=True,id=1cb107c5-bd60-4ce6-8da3-b6b15bd16ef1,network=Network(10809c12-a24e-41c8-ad4b-4ecab7ab24dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1cb107c5-bd') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 09:36:29 user nova-compute[75122]: DEBUG os_vif [None req-c899a27c-4cf5-48dd-9ecc-e2a56f7bd9f4 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:4f:64,bridge_name='br-int',has_traffic_filtering=True,id=1cb107c5-bd60-4ce6-8da3-b6b15bd16ef1,network=Network(10809c12-a24e-41c8-ad4b-4ecab7ab24dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1cb107c5-bd') {{(pid=75122) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 09:36:29 user nova-compute[75122]: DEBUG nova.compute.manager [req-77d38b82-71cb-4e04-934f-5495908af831 req-82912e8f-1849-47fc-93ac-dd63a11d652f service nova] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] Received event network-vif-plugged-598c4b32-243b-461b-b9a4-3a2ba2b7537b {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:36:29 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-77d38b82-71cb-4e04-934f-5495908af831 req-82912e8f-1849-47fc-93ac-dd63a11d652f service nova] Acquiring lock "6a2fb361-de47-41c4-afa2-46f7107af1f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:36:29 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-77d38b82-71cb-4e04-934f-5495908af831 req-82912e8f-1849-47fc-93ac-dd63a11d652f service nova] Lock "6a2fb361-de47-41c4-afa2-46f7107af1f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:36:29 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-77d38b82-71cb-4e04-934f-5495908af831 req-82912e8f-1849-47fc-93ac-dd63a11d652f service nova] Lock "6a2fb361-de47-41c4-afa2-46f7107af1f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:36:29 user nova-compute[75122]: DEBUG nova.compute.manager [req-77d38b82-71cb-4e04-934f-5495908af831 req-82912e8f-1849-47fc-93ac-dd63a11d652f service nova] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] No waiting events found dispatching network-vif-plugged-598c4b32-243b-461b-b9a4-3a2ba2b7537b {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:36:29 user nova-compute[75122]: WARNING nova.compute.manager [req-77d38b82-71cb-4e04-934f-5495908af831 req-82912e8f-1849-47fc-93ac-dd63a11d652f service nova] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] Received unexpected event network-vif-plugged-598c4b32-243b-461b-b9a4-3a2ba2b7537b for instance with vm_state active and task_state deleting.
Nov 15 09:36:29 user nova-compute[75122]: DEBUG nova.compute.manager [req-77d38b82-71cb-4e04-934f-5495908af831 req-82912e8f-1849-47fc-93ac-dd63a11d652f service nova] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] Received event network-vif-unplugged-917da5e4-bdd2-40d9-9e03-b6f96858805b {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:36:29 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-77d38b82-71cb-4e04-934f-5495908af831 req-82912e8f-1849-47fc-93ac-dd63a11d652f service nova] Acquiring lock "6a2fb361-de47-41c4-afa2-46f7107af1f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:36:29 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-77d38b82-71cb-4e04-934f-5495908af831 req-82912e8f-1849-47fc-93ac-dd63a11d652f service nova] Lock "6a2fb361-de47-41c4-afa2-46f7107af1f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:36:29 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-77d38b82-71cb-4e04-934f-5495908af831 req-82912e8f-1849-47fc-93ac-dd63a11d652f service nova] Lock "6a2fb361-de47-41c4-afa2-46f7107af1f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:36:29 user nova-compute[75122]: DEBUG nova.compute.manager [req-77d38b82-71cb-4e04-934f-5495908af831 req-82912e8f-1849-47fc-93ac-dd63a11d652f service nova] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] No waiting events found dispatching network-vif-unplugged-917da5e4-bdd2-40d9-9e03-b6f96858805b {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:36:29 user nova-compute[75122]: DEBUG nova.compute.manager [req-77d38b82-71cb-4e04-934f-5495908af831 req-82912e8f-1849-47fc-93ac-dd63a11d652f service nova] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] Received event network-vif-unplugged-917da5e4-bdd2-40d9-9e03-b6f96858805b for instance with task_state deleting. {{(pid=75122) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 09:36:29 user nova-compute[75122]: DEBUG nova.compute.manager [req-77d38b82-71cb-4e04-934f-5495908af831 req-82912e8f-1849-47fc-93ac-dd63a11d652f service nova] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] Received event network-vif-plugged-917da5e4-bdd2-40d9-9e03-b6f96858805b {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:36:29 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-77d38b82-71cb-4e04-934f-5495908af831 req-82912e8f-1849-47fc-93ac-dd63a11d652f service nova] Acquiring lock "6a2fb361-de47-41c4-afa2-46f7107af1f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:36:29 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-77d38b82-71cb-4e04-934f-5495908af831 req-82912e8f-1849-47fc-93ac-dd63a11d652f service nova] Lock "6a2fb361-de47-41c4-afa2-46f7107af1f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:36:29 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-77d38b82-71cb-4e04-934f-5495908af831 req-82912e8f-1849-47fc-93ac-dd63a11d652f service nova] Lock "6a2fb361-de47-41c4-afa2-46f7107af1f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:36:29 user nova-compute[75122]: DEBUG nova.compute.manager [req-77d38b82-71cb-4e04-934f-5495908af831 req-82912e8f-1849-47fc-93ac-dd63a11d652f service nova] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] No waiting events found dispatching network-vif-plugged-917da5e4-bdd2-40d9-9e03-b6f96858805b {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:36:29 user nova-compute[75122]: WARNING nova.compute.manager [req-77d38b82-71cb-4e04-934f-5495908af831 req-82912e8f-1849-47fc-93ac-dd63a11d652f service nova] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] Received unexpected event network-vif-plugged-917da5e4-bdd2-40d9-9e03-b6f96858805b for instance with vm_state active and task_state deleting.
Nov 15 09:36:29 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:36:29 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1cb107c5-bd, bridge=br-int, if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:36:29 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:36:29 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:36:29 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:36:29 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:36:29 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=79b62e41-57de-473f-8716-e996e41186d7) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:36:29 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:36:29 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:36:29 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:36:29 user nova-compute[75122]: INFO os_vif [None req-c899a27c-4cf5-48dd-9ecc-e2a56f7bd9f4 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:4f:64,bridge_name='br-int',has_traffic_filtering=True,id=1cb107c5-bd60-4ce6-8da3-b6b15bd16ef1,network=Network(10809c12-a24e-41c8-ad4b-4ecab7ab24dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1cb107c5-bd')
Nov 15 09:36:29 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-c899a27c-4cf5-48dd-9ecc-e2a56f7bd9f4 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T09:34:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-779991034',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-779991034',id=13,image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNtzm4oVqy6sf0O7KeIxwJ4JdwiWvUadSQZ0XPCSfdRAZRCJOKze9wXnBI4mMiHsO2k8q5mphaM2/2fNINKbO0ntvDQnZmJp/47MBtzunoCAm54iLS2xZb0FtbX4Gq2CEQ==',key_name='tempest-keypair-985108224',keypairs=<?>,launch_index=0,launched_at=2023-11-15T09:34:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='71b1beadf771447694e937ffa1453d56',ramdisk_id='',reservation_id='r-cviciewg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1167502079',owner_user_name='tempest-TaggedBootDevicesTest_v242-1167502079-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T09:34:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='47d4e4c120fc40a994518ce384652a9b',uuid=6a2fb361-de47-41c4-afa2-46f7107af1f4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2f92aaa6-98e2-4d75-8b96-92c08d77c635", "address": "fa:16:3e:b6:db:04", "network": {"id": "10809c12-a24e-41c8-ad4b-4ecab7ab24dd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1109444380", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.202", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "71b1beadf771447694e937ffa1453d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f92aaa6-98", "ovs_interfaceid": "2f92aaa6-98e2-4d75-8b96-92c08d77c635", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 09:36:29 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-c899a27c-4cf5-48dd-9ecc-e2a56f7bd9f4 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] Converting VIF {"id": "2f92aaa6-98e2-4d75-8b96-92c08d77c635", "address": "fa:16:3e:b6:db:04", "network": {"id": "10809c12-a24e-41c8-ad4b-4ecab7ab24dd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1109444380", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.202", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "71b1beadf771447694e937ffa1453d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f92aaa6-98", "ovs_interfaceid": "2f92aaa6-98e2-4d75-8b96-92c08d77c635", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 09:36:29 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-c899a27c-4cf5-48dd-9ecc-e2a56f7bd9f4 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:db:04,bridge_name='br-int',has_traffic_filtering=True,id=2f92aaa6-98e2-4d75-8b96-92c08d77c635,network=Network(10809c12-a24e-41c8-ad4b-4ecab7ab24dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f92aaa6-98') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 09:36:29 user nova-compute[75122]: DEBUG os_vif [None req-c899a27c-4cf5-48dd-9ecc-e2a56f7bd9f4 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:db:04,bridge_name='br-int',has_traffic_filtering=True,id=2f92aaa6-98e2-4d75-8b96-92c08d77c635,network=Network(10809c12-a24e-41c8-ad4b-4ecab7ab24dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f92aaa6-98') {{(pid=75122) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 09:36:29 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:36:29 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2f92aaa6-98, bridge=br-int, if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:36:29 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:36:29 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:36:29 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:36:29 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:36:29 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1db03a35-3afb-4d56-ab11-064825cedd10) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:36:29 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:36:29 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:36:29 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:36:29 user nova-compute[75122]: INFO os_vif [None req-c899a27c-4cf5-48dd-9ecc-e2a56f7bd9f4 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:db:04,bridge_name='br-int',has_traffic_filtering=True,id=2f92aaa6-98e2-4d75-8b96-92c08d77c635,network=Network(10809c12-a24e-41c8-ad4b-4ecab7ab24dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f92aaa6-98')
Nov 15 09:36:29 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-c899a27c-4cf5-48dd-9ecc-e2a56f7bd9f4 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T09:34:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-779991034',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-779991034',id=13,image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNtzm4oVqy6sf0O7KeIxwJ4JdwiWvUadSQZ0XPCSfdRAZRCJOKze9wXnBI4mMiHsO2k8q5mphaM2/2fNINKbO0ntvDQnZmJp/47MBtzunoCAm54iLS2xZb0FtbX4Gq2CEQ==',key_name='tempest-keypair-985108224',keypairs=<?>,launch_index=0,launched_at=2023-11-15T09:34:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='71b1beadf771447694e937ffa1453d56',ramdisk_id='',reservation_id='r-cviciewg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1167502079',owner_user_name='tempest-TaggedBootDevicesTest_v242-1167502079-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T09:34:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='47d4e4c120fc40a994518ce384652a9b',uuid=6a2fb361-de47-41c4-afa2-46f7107af1f4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "598c4b32-243b-461b-b9a4-3a2ba2b7537b", "address": "fa:16:3e:3f:ce:07", "network": {"id": "217bd6f7-91ff-488f-855e-32d3a5268c46", "bridge": "br-int", "label": "tempest-device-tagging-net2-1686179832", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "71b1beadf771447694e937ffa1453d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap598c4b32-24", "ovs_interfaceid": "598c4b32-243b-461b-b9a4-3a2ba2b7537b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 09:36:29 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-c899a27c-4cf5-48dd-9ecc-e2a56f7bd9f4 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] Converting VIF {"id": "598c4b32-243b-461b-b9a4-3a2ba2b7537b", "address": "fa:16:3e:3f:ce:07", "network": {"id": "217bd6f7-91ff-488f-855e-32d3a5268c46", "bridge": "br-int", "label": "tempest-device-tagging-net2-1686179832", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "71b1beadf771447694e937ffa1453d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap598c4b32-24", "ovs_interfaceid": "598c4b32-243b-461b-b9a4-3a2ba2b7537b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 09:36:29 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-c899a27c-4cf5-48dd-9ecc-e2a56f7bd9f4 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:ce:07,bridge_name='br-int',has_traffic_filtering=True,id=598c4b32-243b-461b-b9a4-3a2ba2b7537b,network=Network(217bd6f7-91ff-488f-855e-32d3a5268c46),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap598c4b32-24') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 09:36:29 user nova-compute[75122]: DEBUG os_vif [None req-c899a27c-4cf5-48dd-9ecc-e2a56f7bd9f4 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:ce:07,bridge_name='br-int',has_traffic_filtering=True,id=598c4b32-243b-461b-b9a4-3a2ba2b7537b,network=Network(217bd6f7-91ff-488f-855e-32d3a5268c46),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap598c4b32-24') {{(pid=75122) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 09:36:29 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:36:29 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap598c4b32-24, bridge=br-int, if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:36:29 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:36:29 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:36:29 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:36:29 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:36:29 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2fec64b1-a4e9-423c-878b-c6b6675a642d) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:36:29 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:36:29 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:36:29 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:36:29 user nova-compute[75122]: INFO os_vif [None req-c899a27c-4cf5-48dd-9ecc-e2a56f7bd9f4 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:ce:07,bridge_name='br-int',has_traffic_filtering=True,id=598c4b32-243b-461b-b9a4-3a2ba2b7537b,network=Network(217bd6f7-91ff-488f-855e-32d3a5268c46),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap598c4b32-24')
Nov 15 09:36:29 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-c899a27c-4cf5-48dd-9ecc-e2a56f7bd9f4 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T09:34:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-779991034',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-779991034',id=13,image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNtzm4oVqy6sf0O7KeIxwJ4JdwiWvUadSQZ0XPCSfdRAZRCJOKze9wXnBI4mMiHsO2k8q5mphaM2/2fNINKbO0ntvDQnZmJp/47MBtzunoCAm54iLS2xZb0FtbX4Gq2CEQ==',key_name='tempest-keypair-985108224',keypairs=<?>,launch_index=0,launched_at=2023-11-15T09:34:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='71b1beadf771447694e937ffa1453d56',ramdisk_id='',reservation_id='r-cviciewg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1167502079',owner_user_name='tempest-TaggedBootDevicesTest_v242-1167502079-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T09:34:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='47d4e4c120fc40a994518ce384652a9b',uuid=6a2fb361-de47-41c4-afa2-46f7107af1f4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "917da5e4-bdd2-40d9-9e03-b6f96858805b", "address": "fa:16:3e:ce:f2:9a", "network": {"id": "217bd6f7-91ff-488f-855e-32d3a5268c46", "bridge": "br-int", "label": "tempest-device-tagging-net2-1686179832", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "71b1beadf771447694e937ffa1453d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap917da5e4-bd", "ovs_interfaceid": "917da5e4-bdd2-40d9-9e03-b6f96858805b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 09:36:29 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-c899a27c-4cf5-48dd-9ecc-e2a56f7bd9f4 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] Converting VIF {"id": "917da5e4-bdd2-40d9-9e03-b6f96858805b", "address": "fa:16:3e:ce:f2:9a", "network": {"id": "217bd6f7-91ff-488f-855e-32d3a5268c46", "bridge": "br-int", "label": "tempest-device-tagging-net2-1686179832", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "71b1beadf771447694e937ffa1453d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap917da5e4-bd", "ovs_interfaceid": "917da5e4-bdd2-40d9-9e03-b6f96858805b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 09:36:29 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-c899a27c-4cf5-48dd-9ecc-e2a56f7bd9f4 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:f2:9a,bridge_name='br-int',has_traffic_filtering=True,id=917da5e4-bdd2-40d9-9e03-b6f96858805b,network=Network(217bd6f7-91ff-488f-855e-32d3a5268c46),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap917da5e4-bd') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 09:36:29 user nova-compute[75122]: DEBUG os_vif [None req-c899a27c-4cf5-48dd-9ecc-e2a56f7bd9f4 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:f2:9a,bridge_name='br-int',has_traffic_filtering=True,id=917da5e4-bdd2-40d9-9e03-b6f96858805b,network=Network(217bd6f7-91ff-488f-855e-32d3a5268c46),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap917da5e4-bd') {{(pid=75122) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 09:36:29 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:36:29 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap917da5e4-bd, bridge=br-int, if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:36:29 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:36:29 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:36:29 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:36:29 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=427eb655-9f6e-4f98-b7a1-74b3d63e4e3e) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:36:29 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:36:29 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:36:29 user nova-compute[75122]: INFO os_vif [None req-c899a27c-4cf5-48dd-9ecc-e2a56f7bd9f4 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:f2:9a,bridge_name='br-int',has_traffic_filtering=True,id=917da5e4-bdd2-40d9-9e03-b6f96858805b,network=Network(217bd6f7-91ff-488f-855e-32d3a5268c46),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap917da5e4-bd')
Nov 15 09:36:29 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c899a27c-4cf5-48dd-9ecc-e2a56f7bd9f4 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] calling os-brick to detach iSCSI Volume {{(pid=75122) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 09:36:29 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-c899a27c-4cf5-48dd-9ecc-e2a56f7bd9f4 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffa04060b80>, {'target_iqn': 'iqn.2010-10.org.openstack:697acd7d-564d-4149-9ecf-7c7d89f10013', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vAcWakYy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 09:36:29 user nova-compute[75122]: WARNING os_brick.initiator.connectors.base [None req-c899a27c-4cf5-48dd-9ecc-e2a56f7bd9f4 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 09:36:29 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-c899a27c-4cf5-48dd-9ecc-e2a56f7bd9f4 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 09:36:29 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-c899a27c-4cf5-48dd-9ecc-e2a56f7bd9f4 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 09:36:29 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:36:30 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.138s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:36:30 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[5997754b-0988-416d-8ccc-ecc9e0928662]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1fb89b98-0060-4ce2-a0da-b63c7dc9a307\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7524fa0e-0e0f-4da0-bd00-7f099a8a55e8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b9022bc1-82d9-4e14-9d0e-85a8b645e512\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:697acd7d-564d-4149-9ecf-7c7d89f10013\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:df76fc47-1a36-4bd6-97e6-bff6a6ead337\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:36:30 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-c899a27c-4cf5-48dd-9ecc-e2a56f7bd9f4 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 09:36:30 user nova-compute[75122]: No targets found.
Nov 15 09:36:30 user nova-compute[75122]: iSNS:
Nov 15 09:36:30 user nova-compute[75122]: No targets found.
Nov 15 09:36:30 user nova-compute[75122]: STATIC:
Nov 15 09:36:30 user nova-compute[75122]: Target: iqn.2010-10.org.openstack:1fb89b98-0060-4ce2-a0da-b63c7dc9a307
Nov 15 09:36:30 user nova-compute[75122]:         Portal: 172.16.0.220:3260,-1
Nov 15 09:36:30 user nova-compute[75122]:                 Iface Name: default
Nov 15 09:36:30 user nova-compute[75122]: Target: iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16
Nov 15 09:36:30 user nova-compute[75122]:         Portal: 172.16.0.220:3260,-1
Nov 15 09:36:30 user nova-compute[75122]:                 Iface Name: default
Nov 15 09:36:30 user nova-compute[75122]: Target: iqn.2010-10.org.openstack:7524fa0e-0e0f-4da0-bd00-7f099a8a55e8
Nov 15 09:36:30 user nova-compute[75122]:         Portal: 172.16.0.220:3260,-1
Nov 15 09:36:30 user nova-compute[75122]:                 Iface Name: default
Nov 15 09:36:30 user nova-compute[75122]: Target: iqn.2010-10.org.openstack:b9022bc1-82d9-4e14-9d0e-85a8b645e512
Nov 15 09:36:30 user nova-compute[75122]:         Portal: 172.16.0.220:3260,-1
Nov 15 09:36:30 user nova-compute[75122]:                 Iface Name: default
Nov 15 09:36:30 user nova-compute[75122]: Target: iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e
Nov 15 09:36:30 user nova-compute[75122]:         Portal: 172.16.0.220:3260,-1
Nov 15 09:36:30 user nova-compute[75122]:                 Iface Name: default
Nov 15 09:36:30 user nova-compute[75122]: Target: iqn.2010-10.org.openstack:697acd7d-564d-4149-9ecf-7c7d89f10013
Nov 15 09:36:30 user nova-compute[75122]:         Portal: 172.16.0.220:3260,-1
Nov 15 09:36:30 user nova-compute[75122]:                 Iface Name: default
Nov 15 09:36:30 user nova-compute[75122]: Target: iqn.2010-10.org.openstack:df76fc47-1a36-4bd6-97e6-bff6a6ead337
Nov 15 09:36:30 user nova-compute[75122]:         Portal: 172.16.0.220:3260,-1
Nov 15 09:36:30 user nova-compute[75122]:                 Iface Name: default
Nov 15 09:36:30 user nova-compute[75122]: FIRMWARE:
Nov 15 09:36:30 user nova-compute[75122]: No targets found.
Nov 15 09:36:30 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 09:36:30 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-c899a27c-4cf5-48dd-9ecc-e2a56f7bd9f4 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 09:36:30 user nova-compute[75122]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 09:36:30 user nova-compute[75122]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75122) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 09:36:30 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-c899a27c-4cf5-48dd-9ecc-e2a56f7bd9f4 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:697acd7d-564d-4149-9ecf-7c7d89f10013', 0)] {{(pid=75122) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 09:36:30 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:36:30 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:36:30 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ff0b49e-31ef-474b-bbe4-808fb1774c76]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1fb89b98-0060-4ce2-a0da-b63c7dc9a307\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:697acd7d-564d-4149-9ecf-7c7d89f10013\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7524fa0e-0e0f-4da0-bd00-7f099a8a55e8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b9022bc1-82d9-4e14-9d0e-85a8b645e512\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:df76fc47-1a36-4bd6-97e6-bff6a6ead337\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:36:30 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:36:30 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:36:30 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[73614544-d7dc-4ee5-ada3-0cbcc0a6e469]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:697acd7d-564d-4149-9ecf-7c7d89f10013 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df76fc47-1a36-4bd6-97e6-bff6a6ead337 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9022bc1-82d9-4e14-9d0e-85a8b645e512 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7524fa0e-0e0f-4da0-bd00-7f099a8a55e8 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fb89b98-0060-4ce2-a0da-b63c7dc9a307 (non-flash)\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:36:30 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-c899a27c-4cf5-48dd-9ecc-e2a56f7bd9f4 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:697acd7d-564d-4149-9ecf-7c7d89f10013 (non-flash)
Nov 15 09:36:30 user nova-compute[75122]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df76fc47-1a36-4bd6-97e6-bff6a6ead337 (non-flash)
Nov 15 09:36:30 user nova-compute[75122]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9022bc1-82d9-4e14-9d0e-85a8b645e512 (non-flash)
Nov 15 09:36:30 user nova-compute[75122]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e (non-flash)
Nov 15 09:36:30 user nova-compute[75122]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16 (non-flash)
Nov 15 09:36:30 user nova-compute[75122]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7524fa0e-0e0f-4da0-bd00-7f099a8a55e8 (non-flash)
Nov 15 09:36:30 user nova-compute[75122]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fb89b98-0060-4ce2-a0da-b63c7dc9a307 (non-flash)
Nov 15 09:36:30 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 09:36:30 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-c899a27c-4cf5-48dd-9ecc-e2a56f7bd9f4 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:697acd7d-564d-4149-9ecf-7c7d89f10013 (non-flash)
Nov 15 09:36:30 user nova-compute[75122]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df76fc47-1a36-4bd6-97e6-bff6a6ead337 (non-flash)
Nov 15 09:36:30 user nova-compute[75122]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9022bc1-82d9-4e14-9d0e-85a8b645e512 (non-flash)
Nov 15 09:36:30 user nova-compute[75122]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e (non-flash)
Nov 15 09:36:30 user nova-compute[75122]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16 (non-flash)
Nov 15 09:36:30 user nova-compute[75122]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7524fa0e-0e0f-4da0-bd00-7f099a8a55e8 (non-flash)
Nov 15 09:36:30 user nova-compute[75122]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fb89b98-0060-4ce2-a0da-b63c7dc9a307 (non-flash)
Nov 15 09:36:30 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 09:36:30 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-c899a27c-4cf5-48dd-9ecc-e2a56f7bd9f4 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff9e44ef2e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:697acd7d-564d-4149-9ecf-7c7d89f10013'): ({'sdf'}, set())}) {{(pid=75122) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 09:36:30 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-c899a27c-4cf5-48dd-9ecc-e2a56f7bd9f4 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] Removing single pathed devices sdf {{(pid=75122) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 09:36:30 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:36:30 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:36:30 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fe80f74-372c-41fa-ba8c-c00eead13f8c]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:36:30 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:36:30 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.020s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:36:30 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeb7ac38-cc47-46db-beb6-0aa3fbe724f8]: (4, ('ok\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:36:30 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-c899a27c-4cf5-48dd-9ecc-e2a56f7bd9f4 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] Flushing IO for device /dev/sdf {{(pid=75122) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 09:36:30 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:36:30 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.041s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:36:30 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[73ba8a5c-ba5a-4f68-aad5-0d8fed366739]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:36:30 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-c899a27c-4cf5-48dd-9ecc-e2a56f7bd9f4 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75122) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 09:36:30 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:36:30 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.037s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:36:30 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[e01bc3d2-84e1-4af7-850f-f64c2fbe9717]: (4, ('1', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:36:30 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-c899a27c-4cf5-48dd-9ecc-e2a56f7bd9f4 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75122) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 09:36:30 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-c899a27c-4cf5-48dd-9ecc-e2a56f7bd9f4 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] SCSI volumes sdf have been removed. {{(pid=75122) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 09:36:30 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-c899a27c-4cf5-48dd-9ecc-e2a56f7bd9f4 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:697acd7d-564d-4149-9ecf-7c7d89f10013')] {{(pid=75122) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 09:36:30 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:697acd7d-564d-4149-9ecf-7c7d89f10013 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:36:30 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:697acd7d-564d-4149-9ecf-7c7d89f10013 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:36:30 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[b02e4afe-ad11-4566-827c-058fd714a4f4]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:36:30 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-c899a27c-4cf5-48dd-9ecc-e2a56f7bd9f4 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:36:30 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:697acd7d-564d-4149-9ecf-7c7d89f10013 -p 172.16.0.220:3260 --logout {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:36:30 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:697acd7d-564d-4149-9ecf-7c7d89f10013 -p 172.16.0.220:3260 --logout" returned: 0 in 0.086s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:36:30 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[80b298e1-8ae3-41de-93de-5dab24fa3b03]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:697acd7d-564d-4149-9ecf-7c7d89f10013, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:697acd7d-564d-4149-9ecf-7c7d89f10013, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:36:30 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-c899a27c-4cf5-48dd-9ecc-e2a56f7bd9f4 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:697acd7d-564d-4149-9ecf-7c7d89f10013, portal: 172.16.0.220,3260]
Nov 15 09:36:30 user nova-compute[75122]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:697acd7d-564d-4149-9ecf-7c7d89f10013, portal: 172.16.0.220,3260] successful.
Nov 15 09:36:30 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:36:30 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:697acd7d-564d-4149-9ecf-7c7d89f10013 -p 172.16.0.220:3260 --op delete {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:36:30 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:697acd7d-564d-4149-9ecf-7c7d89f10013 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.049s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:36:30 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[9625e5b0-de24-4d03-b89b-643aa2da4046]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:36:30 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-c899a27c-4cf5-48dd-9ecc-e2a56f7bd9f4 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:36:30 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-c899a27c-4cf5-48dd-9ecc-e2a56f7bd9f4 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.528s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 09:36:30 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-c899a27c-4cf5-48dd-9ecc-e2a56f7bd9f4 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] <== disconnect_volume: return (530ms) None {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 09:36:30 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c899a27c-4cf5-48dd-9ecc-e2a56f7bd9f4 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] Disconnected iSCSI Volume {{(pid=75122) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 09:36:30 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c899a27c-4cf5-48dd-9ecc-e2a56f7bd9f4 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] calling os-brick to detach iSCSI Volume {{(pid=75122) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 09:36:30 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-c899a27c-4cf5-48dd-9ecc-e2a56f7bd9f4 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffa04060b80>, {'target_iqn': 'iqn.2010-10.org.openstack:b9022bc1-82d9-4e14-9d0e-85a8b645e512', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'scRJzhVO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 09:36:30 user nova-compute[75122]: WARNING os_brick.initiator.connectors.base [None req-c899a27c-4cf5-48dd-9ecc-e2a56f7bd9f4 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 09:36:30 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-c899a27c-4cf5-48dd-9ecc-e2a56f7bd9f4 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 09:36:30 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-c899a27c-4cf5-48dd-9ecc-e2a56f7bd9f4 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.005s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 09:36:30 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:36:30 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:36:30 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[4907ca59-299d-41c9-b430-83be9c0b3112]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1fb89b98-0060-4ce2-a0da-b63c7dc9a307\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7524fa0e-0e0f-4da0-bd00-7f099a8a55e8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b9022bc1-82d9-4e14-9d0e-85a8b645e512\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:df76fc47-1a36-4bd6-97e6-bff6a6ead337\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:36:30 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-c899a27c-4cf5-48dd-9ecc-e2a56f7bd9f4 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 09:36:30 user nova-compute[75122]: No targets found.
Nov 15 09:36:30 user nova-compute[75122]: iSNS:
Nov 15 09:36:30 user nova-compute[75122]: No targets found.
Nov 15 09:36:30 user nova-compute[75122]: STATIC:
Nov 15 09:36:30 user nova-compute[75122]: Target: iqn.2010-10.org.openstack:1fb89b98-0060-4ce2-a0da-b63c7dc9a307
Nov 15 09:36:30 user nova-compute[75122]:         Portal: 172.16.0.220:3260,-1
Nov 15 09:36:30 user nova-compute[75122]:                 Iface Name: default
Nov 15 09:36:30 user nova-compute[75122]: Target: iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16
Nov 15 09:36:30 user nova-compute[75122]:         Portal: 172.16.0.220:3260,-1
Nov 15 09:36:30 user nova-compute[75122]:                 Iface Name: default
Nov 15 09:36:30 user nova-compute[75122]: Target: iqn.2010-10.org.openstack:7524fa0e-0e0f-4da0-bd00-7f099a8a55e8
Nov 15 09:36:30 user nova-compute[75122]:         Portal: 172.16.0.220:3260,-1
Nov 15 09:36:30 user nova-compute[75122]:                 Iface Name: default
Nov 15 09:36:30 user nova-compute[75122]: Target: iqn.2010-10.org.openstack:b9022bc1-82d9-4e14-9d0e-85a8b645e512
Nov 15 09:36:30 user nova-compute[75122]:         Portal: 172.16.0.220:3260,-1
Nov 15 09:36:30 user nova-compute[75122]:                 Iface Name: default
Nov 15 09:36:30 user nova-compute[75122]: Target: iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e
Nov 15 09:36:30 user nova-compute[75122]:         Portal: 172.16.0.220:3260,-1
Nov 15 09:36:30 user nova-compute[75122]:                 Iface Name: default
Nov 15 09:36:30 user nova-compute[75122]: Target: iqn.2010-10.org.openstack:df76fc47-1a36-4bd6-97e6-bff6a6ead337
Nov 15 09:36:30 user nova-compute[75122]:         Portal: 172.16.0.220:3260,-1
Nov 15 09:36:30 user nova-compute[75122]:                 Iface Name: default
Nov 15 09:36:30 user nova-compute[75122]: FIRMWARE:
Nov 15 09:36:30 user nova-compute[75122]: No targets found.
Nov 15 09:36:30 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 09:36:30 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-c899a27c-4cf5-48dd-9ecc-e2a56f7bd9f4 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 09:36:30 user nova-compute[75122]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 09:36:30 user nova-compute[75122]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75122) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 09:36:30 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-c899a27c-4cf5-48dd-9ecc-e2a56f7bd9f4 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b9022bc1-82d9-4e14-9d0e-85a8b645e512', 0)] {{(pid=75122) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 09:36:30 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:36:30 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:36:30 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[81bd5e20-fd4f-4432-b92e-1e62aa2f8034]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1fb89b98-0060-4ce2-a0da-b63c7dc9a307\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7524fa0e-0e0f-4da0-bd00-7f099a8a55e8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b9022bc1-82d9-4e14-9d0e-85a8b645e512\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:df76fc47-1a36-4bd6-97e6-bff6a6ead337\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:36:30 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:36:30 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:36:30 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[64da8a14-d20a-4c74-9b10-d97055cbd5ed]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df76fc47-1a36-4bd6-97e6-bff6a6ead337 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9022bc1-82d9-4e14-9d0e-85a8b645e512 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7524fa0e-0e0f-4da0-bd00-7f099a8a55e8 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fb89b98-0060-4ce2-a0da-b63c7dc9a307 (non-flash)\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:36:30 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-c899a27c-4cf5-48dd-9ecc-e2a56f7bd9f4 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df76fc47-1a36-4bd6-97e6-bff6a6ead337 (non-flash)
Nov 15 09:36:30 user nova-compute[75122]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9022bc1-82d9-4e14-9d0e-85a8b645e512 (non-flash)
Nov 15 09:36:30 user nova-compute[75122]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e (non-flash)
Nov 15 09:36:30 user nova-compute[75122]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16 (non-flash)
Nov 15 09:36:30 user nova-compute[75122]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7524fa0e-0e0f-4da0-bd00-7f099a8a55e8 (non-flash)
Nov 15 09:36:30 user nova-compute[75122]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fb89b98-0060-4ce2-a0da-b63c7dc9a307 (non-flash)
Nov 15 09:36:30 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 09:36:30 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-c899a27c-4cf5-48dd-9ecc-e2a56f7bd9f4 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df76fc47-1a36-4bd6-97e6-bff6a6ead337 (non-flash)
Nov 15 09:36:30 user nova-compute[75122]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9022bc1-82d9-4e14-9d0e-85a8b645e512 (non-flash)
Nov 15 09:36:30 user nova-compute[75122]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e (non-flash)
Nov 15 09:36:30 user nova-compute[75122]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16 (non-flash)
Nov 15 09:36:30 user nova-compute[75122]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7524fa0e-0e0f-4da0-bd00-7f099a8a55e8 (non-flash)
Nov 15 09:36:30 user nova-compute[75122]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fb89b98-0060-4ce2-a0da-b63c7dc9a307 (non-flash)
Nov 15 09:36:30 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 09:36:30 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-c899a27c-4cf5-48dd-9ecc-e2a56f7bd9f4 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff9e44ee680>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b9022bc1-82d9-4e14-9d0e-85a8b645e512'): ({'sdh'}, set())}) {{(pid=75122) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 09:36:30 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-c899a27c-4cf5-48dd-9ecc-e2a56f7bd9f4 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] Removing single pathed devices sdh {{(pid=75122) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 09:36:30 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:36:30 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:36:30 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[00058408-8d09-4f27-80e7-436cbdf0aa86]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:36:30 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:36:30 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.029s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:36:30 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[48aa7048-8800-4146-a7de-5d25afc4509c]: (4, ('ok\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:36:30 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-c899a27c-4cf5-48dd-9ecc-e2a56f7bd9f4 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] Flushing IO for device /dev/sdh {{(pid=75122) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 09:36:30 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:36:30 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.016s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:36:30 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[d783508e-e40c-49ed-b8d7-f705d811f1d8]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:36:30 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-c899a27c-4cf5-48dd-9ecc-e2a56f7bd9f4 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=75122) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 09:36:30 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:36:30 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:36:30 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.045s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:36:30 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[df37169c-35a0-4e8e-aa36-a1ee1d9f4fa2]: (4, ('1', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:36:30 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-c899a27c-4cf5-48dd-9ecc-e2a56f7bd9f4 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=75122) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 09:36:30 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-c899a27c-4cf5-48dd-9ecc-e2a56f7bd9f4 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] SCSI volumes sdh have been removed. {{(pid=75122) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 09:36:30 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-c899a27c-4cf5-48dd-9ecc-e2a56f7bd9f4 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b9022bc1-82d9-4e14-9d0e-85a8b645e512')] {{(pid=75122) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 09:36:30 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9022bc1-82d9-4e14-9d0e-85a8b645e512 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:36:30 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9022bc1-82d9-4e14-9d0e-85a8b645e512 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:36:30 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6d7ddcb-3c62-46bf-8768-61e6a325975c]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:36:30 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-c899a27c-4cf5-48dd-9ecc-e2a56f7bd9f4 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:36:30 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9022bc1-82d9-4e14-9d0e-85a8b645e512 -p 172.16.0.220:3260 --logout {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:36:30 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9022bc1-82d9-4e14-9d0e-85a8b645e512 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:36:30 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a420683-73c9-441a-89b1-277707bafaac]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:b9022bc1-82d9-4e14-9d0e-85a8b645e512, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:b9022bc1-82d9-4e14-9d0e-85a8b645e512, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:36:30 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-c899a27c-4cf5-48dd-9ecc-e2a56f7bd9f4 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:b9022bc1-82d9-4e14-9d0e-85a8b645e512, portal: 172.16.0.220,3260]
Nov 15 09:36:30 user nova-compute[75122]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:b9022bc1-82d9-4e14-9d0e-85a8b645e512, portal: 172.16.0.220,3260] successful.
Nov 15 09:36:30 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:36:30 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9022bc1-82d9-4e14-9d0e-85a8b645e512 -p 172.16.0.220:3260 --op delete {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:36:30 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9022bc1-82d9-4e14-9d0e-85a8b645e512 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:36:30 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[738bca0f-0a92-4576-9e48-1b37bfc0c136]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:36:30 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-c899a27c-4cf5-48dd-9ecc-e2a56f7bd9f4 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:36:30 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-c899a27c-4cf5-48dd-9ecc-e2a56f7bd9f4 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.384s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 09:36:30 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-c899a27c-4cf5-48dd-9ecc-e2a56f7bd9f4 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] <== disconnect_volume: return (390ms) None {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 09:36:30 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c899a27c-4cf5-48dd-9ecc-e2a56f7bd9f4 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] Disconnected iSCSI Volume {{(pid=75122) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 09:36:30 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c899a27c-4cf5-48dd-9ecc-e2a56f7bd9f4 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] calling os-brick to detach iSCSI Volume {{(pid=75122) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 09:36:30 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-c899a27c-4cf5-48dd-9ecc-e2a56f7bd9f4 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffa04060b80>, {'target_iqn': 'iqn.2010-10.org.openstack:df76fc47-1a36-4bd6-97e6-bff6a6ead337', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aVqcQmhZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 09:36:30 user nova-compute[75122]: WARNING os_brick.initiator.connectors.base [None req-c899a27c-4cf5-48dd-9ecc-e2a56f7bd9f4 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 09:36:30 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-c899a27c-4cf5-48dd-9ecc-e2a56f7bd9f4 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 09:36:30 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-c899a27c-4cf5-48dd-9ecc-e2a56f7bd9f4 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 09:36:30 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:36:30 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:36:30 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[47ffe269-bac6-471e-bafe-8bf3d29bb11a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1fb89b98-0060-4ce2-a0da-b63c7dc9a307\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7524fa0e-0e0f-4da0-bd00-7f099a8a55e8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:df76fc47-1a36-4bd6-97e6-bff6a6ead337\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:36:30 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-c899a27c-4cf5-48dd-9ecc-e2a56f7bd9f4 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 09:36:30 user nova-compute[75122]: No targets found.
Nov 15 09:36:30 user nova-compute[75122]: iSNS:
Nov 15 09:36:30 user nova-compute[75122]: No targets found.
Nov 15 09:36:30 user nova-compute[75122]: STATIC:
Nov 15 09:36:30 user nova-compute[75122]: Target: iqn.2010-10.org.openstack:1fb89b98-0060-4ce2-a0da-b63c7dc9a307
Nov 15 09:36:30 user nova-compute[75122]:         Portal: 172.16.0.220:3260,-1
Nov 15 09:36:30 user nova-compute[75122]:                 Iface Name: default
Nov 15 09:36:30 user nova-compute[75122]: Target: iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16
Nov 15 09:36:30 user nova-compute[75122]:         Portal: 172.16.0.220:3260,-1
Nov 15 09:36:30 user nova-compute[75122]:                 Iface Name: default
Nov 15 09:36:30 user nova-compute[75122]: Target: iqn.2010-10.org.openstack:7524fa0e-0e0f-4da0-bd00-7f099a8a55e8
Nov 15 09:36:30 user nova-compute[75122]:         Portal: 172.16.0.220:3260,-1
Nov 15 09:36:30 user nova-compute[75122]:                 Iface Name: default
Nov 15 09:36:30 user nova-compute[75122]: Target: iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e
Nov 15 09:36:30 user nova-compute[75122]:         Portal: 172.16.0.220:3260,-1
Nov 15 09:36:30 user nova-compute[75122]:                 Iface Name: default
Nov 15 09:36:30 user nova-compute[75122]: Target: iqn.2010-10.org.openstack:df76fc47-1a36-4bd6-97e6-bff6a6ead337
Nov 15 09:36:30 user nova-compute[75122]:         Portal: 172.16.0.220:3260,-1
Nov 15 09:36:30 user nova-compute[75122]:                 Iface Name: default
Nov 15 09:36:30 user nova-compute[75122]: FIRMWARE:
Nov 15 09:36:30 user nova-compute[75122]: No targets found.
Nov 15 09:36:30 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 09:36:30 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-c899a27c-4cf5-48dd-9ecc-e2a56f7bd9f4 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 09:36:30 user nova-compute[75122]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 09:36:30 user nova-compute[75122]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75122) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 09:36:30 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-c899a27c-4cf5-48dd-9ecc-e2a56f7bd9f4 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:df76fc47-1a36-4bd6-97e6-bff6a6ead337', 0)] {{(pid=75122) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 09:36:30 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:36:30 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:36:30 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6f0201e-5673-4dd8-a773-7ed27d7d2a26]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1fb89b98-0060-4ce2-a0da-b63c7dc9a307\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7524fa0e-0e0f-4da0-bd00-7f099a8a55e8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:df76fc47-1a36-4bd6-97e6-bff6a6ead337\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:36:30 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:36:30 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:36:30 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d2940d6-cebf-4396-a8db-157f601f4d32]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df76fc47-1a36-4bd6-97e6-bff6a6ead337 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7524fa0e-0e0f-4da0-bd00-7f099a8a55e8 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fb89b98-0060-4ce2-a0da-b63c7dc9a307 (non-flash)\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:36:30 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-c899a27c-4cf5-48dd-9ecc-e2a56f7bd9f4 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df76fc47-1a36-4bd6-97e6-bff6a6ead337 (non-flash)
Nov 15 09:36:30 user nova-compute[75122]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e (non-flash)
Nov 15 09:36:30 user nova-compute[75122]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16 (non-flash)
Nov 15 09:36:30 user nova-compute[75122]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7524fa0e-0e0f-4da0-bd00-7f099a8a55e8 (non-flash)
Nov 15 09:36:30 user nova-compute[75122]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fb89b98-0060-4ce2-a0da-b63c7dc9a307 (non-flash)
Nov 15 09:36:30 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 09:36:30 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-c899a27c-4cf5-48dd-9ecc-e2a56f7bd9f4 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df76fc47-1a36-4bd6-97e6-bff6a6ead337 (non-flash)
Nov 15 09:36:30 user nova-compute[75122]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e (non-flash)
Nov 15 09:36:30 user nova-compute[75122]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16 (non-flash)
Nov 15 09:36:30 user nova-compute[75122]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7524fa0e-0e0f-4da0-bd00-7f099a8a55e8 (non-flash)
Nov 15 09:36:30 user nova-compute[75122]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1fb89b98-0060-4ce2-a0da-b63c7dc9a307 (non-flash)
Nov 15 09:36:30 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 09:36:30 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-c899a27c-4cf5-48dd-9ecc-e2a56f7bd9f4 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff9e44eeb00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:df76fc47-1a36-4bd6-97e6-bff6a6ead337'): ({'sdg'}, set())}) {{(pid=75122) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 09:36:30 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-c899a27c-4cf5-48dd-9ecc-e2a56f7bd9f4 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] Removing single pathed devices sdg {{(pid=75122) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 09:36:30 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:36:30 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:36:30 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[6350726e-aea1-4f0e-ae0e-0fef0856c226]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:36:30 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:36:30 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.020s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:36:30 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[afa65b9d-8898-46f8-993c-d51d44bad4a8]: (4, ('ok\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:36:30 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-c899a27c-4cf5-48dd-9ecc-e2a56f7bd9f4 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] Flushing IO for device /dev/sdg {{(pid=75122) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 09:36:30 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:36:30 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.014s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:36:30 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b84b2dd-12e9-451e-aca6-18e62c3ca002]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:36:30 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-c899a27c-4cf5-48dd-9ecc-e2a56f7bd9f4 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75122) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 09:36:30 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:36:31 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.048s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:36:31 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[11eacfb6-a81d-4492-882f-23ca1048aa6b]: (4, ('1', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:36:31 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-c899a27c-4cf5-48dd-9ecc-e2a56f7bd9f4 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75122) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 09:36:31 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-c899a27c-4cf5-48dd-9ecc-e2a56f7bd9f4 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] SCSI volumes sdg have been removed. {{(pid=75122) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 09:36:31 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-c899a27c-4cf5-48dd-9ecc-e2a56f7bd9f4 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:df76fc47-1a36-4bd6-97e6-bff6a6ead337')] {{(pid=75122) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 09:36:31 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df76fc47-1a36-4bd6-97e6-bff6a6ead337 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:36:31 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df76fc47-1a36-4bd6-97e6-bff6a6ead337 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:36:31 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[458a0134-95f3-44b1-b001-7c9eaa226ae5]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:36:31 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-c899a27c-4cf5-48dd-9ecc-e2a56f7bd9f4 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:36:31 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df76fc47-1a36-4bd6-97e6-bff6a6ead337 -p 172.16.0.220:3260 --logout {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:36:31 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df76fc47-1a36-4bd6-97e6-bff6a6ead337 -p 172.16.0.220:3260 --logout" returned: 0 in 0.082s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:36:31 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ede2e68-88a6-4d8e-8753-27b35823b6eb]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:df76fc47-1a36-4bd6-97e6-bff6a6ead337, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:df76fc47-1a36-4bd6-97e6-bff6a6ead337, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:36:31 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-c899a27c-4cf5-48dd-9ecc-e2a56f7bd9f4 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:df76fc47-1a36-4bd6-97e6-bff6a6ead337, portal: 172.16.0.220,3260]
Nov 15 09:36:31 user nova-compute[75122]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:df76fc47-1a36-4bd6-97e6-bff6a6ead337, portal: 172.16.0.220,3260] successful.
Nov 15 09:36:31 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:36:31 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df76fc47-1a36-4bd6-97e6-bff6a6ead337 -p 172.16.0.220:3260 --op delete {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:36:31 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df76fc47-1a36-4bd6-97e6-bff6a6ead337 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.043s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:36:31 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4a0de24-5477-43ac-8d36-9cbc5690b6ce]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:36:31 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-c899a27c-4cf5-48dd-9ecc-e2a56f7bd9f4 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:36:31 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-c899a27c-4cf5-48dd-9ecc-e2a56f7bd9f4 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.390s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 09:36:31 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-c899a27c-4cf5-48dd-9ecc-e2a56f7bd9f4 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] <== disconnect_volume: return (392ms) None {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 09:36:31 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c899a27c-4cf5-48dd-9ecc-e2a56f7bd9f4 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] Disconnected iSCSI Volume {{(pid=75122) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 09:36:31 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-c899a27c-4cf5-48dd-9ecc-e2a56f7bd9f4 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] Deleting instance files /opt/stack/data/nova/instances/6a2fb361-de47-41c4-afa2-46f7107af1f4_del
Nov 15 09:36:31 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-c899a27c-4cf5-48dd-9ecc-e2a56f7bd9f4 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] Deletion of /opt/stack/data/nova/instances/6a2fb361-de47-41c4-afa2-46f7107af1f4_del complete
Nov 15 09:36:31 user nova-compute[75122]: INFO nova.compute.manager [None req-c899a27c-4cf5-48dd-9ecc-e2a56f7bd9f4 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] Took 4.91 seconds to destroy the instance on the hypervisor.
Nov 15 09:36:31 user nova-compute[75122]: DEBUG oslo.service.loopingcall [None req-c899a27c-4cf5-48dd-9ecc-e2a56f7bd9f4 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75122) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 09:36:31 user nova-compute[75122]: DEBUG nova.compute.manager [-] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] Deallocating network for instance {{(pid=75122) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 09:36:31 user nova-compute[75122]: DEBUG nova.network.neutron [-] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] deallocate_for_instance() {{(pid=75122) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 09:36:32 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:36:32 user nova-compute[75122]: WARNING nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] While synchronizing instance power states, found 9 instances in the database and 8 instances on the hypervisor.
Nov 15 09:36:32 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Triggering sync for uuid ee961d5a-e0d1-4931-9293-eefbe638097a {{(pid=75122) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 09:36:32 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Triggering sync for uuid 131142fd-e8ec-42d1-a518-aa21c7bb7cb1 {{(pid=75122) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 09:36:32 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Triggering sync for uuid 5b5a4d58-ba1e-473d-a32a-06fae1c84efc {{(pid=75122) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 09:36:32 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Triggering sync for uuid 1e19f9e1-69c6-4590-85d2-e90cbdbb3d80 {{(pid=75122) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 09:36:32 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Triggering sync for uuid fd9d52bb-6248-48e6-a798-6dbdaaa68cbc {{(pid=75122) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 09:36:32 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Triggering sync for uuid 00270cc2-4f5b-4f64-8f88-31f21e3b3950 {{(pid=75122) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 09:36:32 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Triggering sync for uuid f7d1a157-3228-490e-a6a0-68f6bd2b52ba {{(pid=75122) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 09:36:32 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Triggering sync for uuid 7cfd4155-c4b3-4cce-91e5-042cafccab8b {{(pid=75122) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 09:36:32 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Triggering sync for uuid 6a2fb361-de47-41c4-afa2-46f7107af1f4 {{(pid=75122) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 09:36:32 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "ee961d5a-e0d1-4931-9293-eefbe638097a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:36:32 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "ee961d5a-e0d1-4931-9293-eefbe638097a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:36:32 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "131142fd-e8ec-42d1-a518-aa21c7bb7cb1" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:36:32 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "131142fd-e8ec-42d1-a518-aa21c7bb7cb1" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:36:32 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "5b5a4d58-ba1e-473d-a32a-06fae1c84efc" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:36:32 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "5b5a4d58-ba1e-473d-a32a-06fae1c84efc" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:36:32 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "1e19f9e1-69c6-4590-85d2-e90cbdbb3d80" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:36:32 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "1e19f9e1-69c6-4590-85d2-e90cbdbb3d80" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:36:32 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "fd9d52bb-6248-48e6-a798-6dbdaaa68cbc" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:36:32 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "fd9d52bb-6248-48e6-a798-6dbdaaa68cbc" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:36:32 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "00270cc2-4f5b-4f64-8f88-31f21e3b3950" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:36:32 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "00270cc2-4f5b-4f64-8f88-31f21e3b3950" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:36:32 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "f7d1a157-3228-490e-a6a0-68f6bd2b52ba" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:36:32 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "f7d1a157-3228-490e-a6a0-68f6bd2b52ba" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:36:32 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "7cfd4155-c4b3-4cce-91e5-042cafccab8b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:36:32 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "7cfd4155-c4b3-4cce-91e5-042cafccab8b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:36:32 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "6a2fb361-de47-41c4-afa2-46f7107af1f4" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:36:32 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "ee961d5a-e0d1-4931-9293-eefbe638097a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.079s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:36:32 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "1e19f9e1-69c6-4590-85d2-e90cbdbb3d80" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.086s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:36:32 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "5b5a4d58-ba1e-473d-a32a-06fae1c84efc" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.087s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:36:32 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "00270cc2-4f5b-4f64-8f88-31f21e3b3950" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.092s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:36:32 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "131142fd-e8ec-42d1-a518-aa21c7bb7cb1" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.104s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:36:32 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "f7d1a157-3228-490e-a6a0-68f6bd2b52ba" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.100s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:36:32 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "fd9d52bb-6248-48e6-a798-6dbdaaa68cbc" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.115s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:36:32 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "7cfd4155-c4b3-4cce-91e5-042cafccab8b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.134s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:36:33 user nova-compute[75122]: DEBUG nova.compute.manager [req-8253d3f7-387a-4cf4-a68f-dc897a26dcb0 req-31d44463-0794-40f8-b3f0-63047c1d60d2 service nova] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] Received event network-vif-deleted-917da5e4-bdd2-40d9-9e03-b6f96858805b {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:36:33 user nova-compute[75122]: INFO nova.compute.manager [req-8253d3f7-387a-4cf4-a68f-dc897a26dcb0 req-31d44463-0794-40f8-b3f0-63047c1d60d2 service nova] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] Neutron deleted interface 917da5e4-bdd2-40d9-9e03-b6f96858805b; detaching it from the instance and deleting it from the info cache
Nov 15 09:36:33 user nova-compute[75122]: DEBUG nova.network.neutron [req-8253d3f7-387a-4cf4-a68f-dc897a26dcb0 req-31d44463-0794-40f8-b3f0-63047c1d60d2 service nova] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] Updating instance_info_cache with network_info: [{"id": "3f2e7e15-d1e1-42b1-8cda-c0ec4cadff4a", "address": "fa:16:3e:dd:2a:39", "network": {"id": "2d3f0ed7-fd1f-4b58-9e19-c498613e096b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-737425118-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "71b1beadf771447694e937ffa1453d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f2e7e15-d1", "ovs_interfaceid": "3f2e7e15-d1e1-42b1-8cda-c0ec4cadff4a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ed761290-10dd-41fa-a1c6-479747e0b83d", "address": "fa:16:3e:3b:ea:63", "network": {"id": "10809c12-a24e-41c8-ad4b-4ecab7ab24dd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1109444380", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.229", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "71b1beadf771447694e937ffa1453d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped761290-10", "ovs_interfaceid": "ed761290-10dd-41fa-a1c6-479747e0b83d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "c357e948-986d-4592-a7c5-389bd6202867", "address": "fa:16:3e:0a:a9:a9", "network": {"id": "10809c12-a24e-41c8-ad4b-4ecab7ab24dd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1109444380", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.35", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "71b1beadf771447694e937ffa1453d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc357e948-98", "ovs_interfaceid": "c357e948-986d-4592-a7c5-389bd6202867", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "1cb107c5-bd60-4ce6-8da3-b6b15bd16ef1", "address": "fa:16:3e:17:4f:64", "network": {"id": "10809c12-a24e-41c8-ad4b-4ecab7ab24dd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1109444380", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.24", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "71b1beadf771447694e937ffa1453d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1cb107c5-bd", "ovs_interfaceid": "1cb107c5-bd60-4ce6-8da3-b6b15bd16ef1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2f92aaa6-98e2-4d75-8b96-92c08d77c635", "address": "fa:16:3e:b6:db:04", "network": {"id": "10809c12-a24e-41c8-ad4b-4ecab7ab24dd", "bridge": "br-int", "label": "tempest-device-tagging-net1-1109444380", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.202", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "71b1beadf771447694e937ffa1453d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f92aaa6-98", "ovs_interfaceid": "2f92aaa6-98e2-4d75-8b96-92c08d77c635", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "598c4b32-243b-461b-b9a4-3a2ba2b7537b", "address": "fa:16:3e:3f:ce:07", "network": {"id": "217bd6f7-91ff-488f-855e-32d3a5268c46", "bridge": "br-int", "label": "tempest-device-tagging-net2-1686179832", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "71b1beadf771447694e937ffa1453d56", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap598c4b32-24", "ovs_interfaceid": "598c4b32-243b-461b-b9a4-3a2ba2b7537b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:36:33 user nova-compute[75122]: DEBUG nova.compute.manager [req-8253d3f7-387a-4cf4-a68f-dc897a26dcb0 req-31d44463-0794-40f8-b3f0-63047c1d60d2 service nova] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] Detach interface failed, port_id=917da5e4-bdd2-40d9-9e03-b6f96858805b, reason: Instance 6a2fb361-de47-41c4-afa2-46f7107af1f4 could not be found. {{(pid=75122) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 09:36:34 user nova-compute[75122]: DEBUG nova.network.neutron [-] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] Updating instance_info_cache with network_info: [] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:36:34 user nova-compute[75122]: INFO nova.compute.manager [-] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] Took 3.45 seconds to deallocate network for instance.
Nov 15 09:36:34 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:36:35 user nova-compute[75122]: DEBUG nova.compute.manager [req-5ad45d4d-6478-4d36-85b4-871c1b9dee29 req-fa5eba27-5d84-4aaa-b270-da823f033224 service nova] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] Received event network-vif-deleted-3f2e7e15-d1e1-42b1-8cda-c0ec4cadff4a {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:36:35 user nova-compute[75122]: DEBUG nova.compute.manager [req-5ad45d4d-6478-4d36-85b4-871c1b9dee29 req-fa5eba27-5d84-4aaa-b270-da823f033224 service nova] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] Received event network-vif-deleted-2f92aaa6-98e2-4d75-8b96-92c08d77c635 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:36:35 user nova-compute[75122]: DEBUG nova.compute.manager [req-5ad45d4d-6478-4d36-85b4-871c1b9dee29 req-fa5eba27-5d84-4aaa-b270-da823f033224 service nova] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] Received event network-vif-deleted-598c4b32-243b-461b-b9a4-3a2ba2b7537b {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:36:35 user nova-compute[75122]: DEBUG nova.compute.manager [req-5ad45d4d-6478-4d36-85b4-871c1b9dee29 req-fa5eba27-5d84-4aaa-b270-da823f033224 service nova] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] Received event network-vif-deleted-1cb107c5-bd60-4ce6-8da3-b6b15bd16ef1 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:36:35 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:36:36 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:36:37 user nova-compute[75122]: INFO nova.compute.manager [None req-c899a27c-4cf5-48dd-9ecc-e2a56f7bd9f4 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] Took 2.31 seconds to detach 3 volumes for instance.
Nov 15 09:36:37 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-c899a27c-4cf5-48dd-9ecc-e2a56f7bd9f4 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:36:37 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-c899a27c-4cf5-48dd-9ecc-e2a56f7bd9f4 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:36:37 user nova-compute[75122]: DEBUG nova.compute.provider_tree [None req-c899a27c-4cf5-48dd-9ecc-e2a56f7bd9f4 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] Inventory has not changed in ProviderTree for provider: 69a3da65-47be-44c6-b67c-c692b58284ef {{(pid=75122) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 09:36:37 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-c899a27c-4cf5-48dd-9ecc-e2a56f7bd9f4 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] Inventory has not changed for provider 69a3da65-47be-44c6-b67c-c692b58284ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 09:36:37 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-c899a27c-4cf5-48dd-9ecc-e2a56f7bd9f4 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.385s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:36:37 user nova-compute[75122]: INFO nova.scheduler.client.report [None req-c899a27c-4cf5-48dd-9ecc-e2a56f7bd9f4 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] Deleted allocations for instance 6a2fb361-de47-41c4-afa2-46f7107af1f4
Nov 15 09:36:37 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-c899a27c-4cf5-48dd-9ecc-e2a56f7bd9f4 tempest-TaggedBootDevicesTest_v242-1167502079 tempest-TaggedBootDevicesTest_v242-1167502079-project-member] Lock "6a2fb361-de47-41c4-afa2-46f7107af1f4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 11.302s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:36:37 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "6a2fb361-de47-41c4-afa2-46f7107af1f4" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 5.403s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:36:37 user nova-compute[75122]: INFO nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] [instance: 6a2fb361-de47-41c4-afa2-46f7107af1f4] During sync_power_state the instance has a pending task (deleting). Skip.
Nov 15 09:36:37 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "6a2fb361-de47-41c4-afa2-46f7107af1f4" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:36:39 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:36:39 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:36:40 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:36:41 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:36:43 user nova-compute[75122]: DEBUG nova.compute.manager [req-7c79d087-e4f6-4f84-b6c8-0e5e09c0588d req-1a5b0015-7efa-45f5-bfcb-bec257607e9a service nova] [instance: f7d1a157-3228-490e-a6a0-68f6bd2b52ba] Received event network-changed-caf104ef-b652-4038-8203-76f14e4b666b {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:36:43 user nova-compute[75122]: DEBUG nova.compute.manager [req-7c79d087-e4f6-4f84-b6c8-0e5e09c0588d req-1a5b0015-7efa-45f5-bfcb-bec257607e9a service nova] [instance: f7d1a157-3228-490e-a6a0-68f6bd2b52ba] Refreshing instance network info cache due to event network-changed-caf104ef-b652-4038-8203-76f14e4b666b. {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 09:36:43 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-7c79d087-e4f6-4f84-b6c8-0e5e09c0588d req-1a5b0015-7efa-45f5-bfcb-bec257607e9a service nova] Acquiring lock "refresh_cache-f7d1a157-3228-490e-a6a0-68f6bd2b52ba" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 09:36:43 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-7c79d087-e4f6-4f84-b6c8-0e5e09c0588d req-1a5b0015-7efa-45f5-bfcb-bec257607e9a service nova] Acquired lock "refresh_cache-f7d1a157-3228-490e-a6a0-68f6bd2b52ba" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 09:36:43 user nova-compute[75122]: DEBUG nova.network.neutron [req-7c79d087-e4f6-4f84-b6c8-0e5e09c0588d req-1a5b0015-7efa-45f5-bfcb-bec257607e9a service nova] [instance: f7d1a157-3228-490e-a6a0-68f6bd2b52ba] Refreshing network info cache for port caf104ef-b652-4038-8203-76f14e4b666b {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 09:36:43 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-80d74b9d-c242-4b15-9dac-244d845fe89f tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] Acquiring lock "f7d1a157-3228-490e-a6a0-68f6bd2b52ba" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:36:43 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-80d74b9d-c242-4b15-9dac-244d845fe89f tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] Lock "f7d1a157-3228-490e-a6a0-68f6bd2b52ba" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:36:43 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-80d74b9d-c242-4b15-9dac-244d845fe89f tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] Acquiring lock "f7d1a157-3228-490e-a6a0-68f6bd2b52ba-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:36:43 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-80d74b9d-c242-4b15-9dac-244d845fe89f tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] Lock "f7d1a157-3228-490e-a6a0-68f6bd2b52ba-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:36:43 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-80d74b9d-c242-4b15-9dac-244d845fe89f tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] Lock "f7d1a157-3228-490e-a6a0-68f6bd2b52ba-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:36:43 user nova-compute[75122]: INFO nova.compute.manager [None req-80d74b9d-c242-4b15-9dac-244d845fe89f tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] [instance: f7d1a157-3228-490e-a6a0-68f6bd2b52ba] Terminating instance
Nov 15 09:36:43 user nova-compute[75122]: DEBUG nova.compute.manager [None req-80d74b9d-c242-4b15-9dac-244d845fe89f tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] [instance: f7d1a157-3228-490e-a6a0-68f6bd2b52ba] Start destroying the instance on the hypervisor. {{(pid=75122) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 09:36:43 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:36:43 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:36:43 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:36:43 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:36:43 user nova-compute[75122]: DEBUG nova.compute.manager [req-9300c215-c90a-4a4b-93ae-b1b5f2860362 req-68d09e85-a488-4e92-9c50-1477ee8ffbb1 service nova] [instance: f7d1a157-3228-490e-a6a0-68f6bd2b52ba] Received event network-vif-unplugged-caf104ef-b652-4038-8203-76f14e4b666b {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:36:43 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-9300c215-c90a-4a4b-93ae-b1b5f2860362 req-68d09e85-a488-4e92-9c50-1477ee8ffbb1 service nova] Acquiring lock "f7d1a157-3228-490e-a6a0-68f6bd2b52ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:36:43 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-9300c215-c90a-4a4b-93ae-b1b5f2860362 req-68d09e85-a488-4e92-9c50-1477ee8ffbb1 service nova] Lock "f7d1a157-3228-490e-a6a0-68f6bd2b52ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:36:43 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-9300c215-c90a-4a4b-93ae-b1b5f2860362 req-68d09e85-a488-4e92-9c50-1477ee8ffbb1 service nova] Lock "f7d1a157-3228-490e-a6a0-68f6bd2b52ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:36:43 user nova-compute[75122]: DEBUG nova.compute.manager [req-9300c215-c90a-4a4b-93ae-b1b5f2860362 req-68d09e85-a488-4e92-9c50-1477ee8ffbb1 service nova] [instance: f7d1a157-3228-490e-a6a0-68f6bd2b52ba] No waiting events found dispatching network-vif-unplugged-caf104ef-b652-4038-8203-76f14e4b666b {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:36:43 user nova-compute[75122]: DEBUG nova.compute.manager [req-9300c215-c90a-4a4b-93ae-b1b5f2860362 req-68d09e85-a488-4e92-9c50-1477ee8ffbb1 service nova] [instance: f7d1a157-3228-490e-a6a0-68f6bd2b52ba] Received event network-vif-unplugged-caf104ef-b652-4038-8203-76f14e4b666b for instance with task_state deleting. {{(pid=75122) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 09:36:43 user nova-compute[75122]: DEBUG nova.network.neutron [req-7c79d087-e4f6-4f84-b6c8-0e5e09c0588d req-1a5b0015-7efa-45f5-bfcb-bec257607e9a service nova] [instance: f7d1a157-3228-490e-a6a0-68f6bd2b52ba] Updated VIF entry in instance network info cache for port caf104ef-b652-4038-8203-76f14e4b666b. {{(pid=75122) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 09:36:43 user nova-compute[75122]: DEBUG nova.network.neutron [req-7c79d087-e4f6-4f84-b6c8-0e5e09c0588d req-1a5b0015-7efa-45f5-bfcb-bec257607e9a service nova] [instance: f7d1a157-3228-490e-a6a0-68f6bd2b52ba] Updating instance_info_cache with network_info: [{"id": "caf104ef-b652-4038-8203-76f14e4b666b", "address": "fa:16:3e:6f:84:74", "network": {"id": "a2e4fc06-5a74-45cd-b530-6dd240bfd068", "bridge": "br-int", "label": "tempest-TestShelveInstance-1307896814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea59215474b04143951de2b9453a33ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcaf104ef-b6", "ovs_interfaceid": "caf104ef-b652-4038-8203-76f14e4b666b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:36:43 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-7c79d087-e4f6-4f84-b6c8-0e5e09c0588d req-1a5b0015-7efa-45f5-bfcb-bec257607e9a service nova] Releasing lock "refresh_cache-f7d1a157-3228-490e-a6a0-68f6bd2b52ba" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 09:36:44 user nova-compute[75122]: INFO nova.virt.libvirt.driver [-] [instance: f7d1a157-3228-490e-a6a0-68f6bd2b52ba] Instance destroyed successfully.
Nov 15 09:36:44 user nova-compute[75122]: DEBUG nova.objects.instance [None req-80d74b9d-c242-4b15-9dac-244d845fe89f tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] Lazy-loading 'resources' on Instance uuid f7d1a157-3228-490e-a6a0-68f6bd2b52ba {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:36:44 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-80d74b9d-c242-4b15-9dac-244d845fe89f tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-15T09:31:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-603494418',display_name='tempest-TestShelveInstance-server-603494418',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-603494418',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM1TXRuKGvJllPKsSM4nK/OBu35HIJIsxtD/v6uaAXCLNb3zEXMlSeDAMlpm1t/haK5aaWNbGgYXswqBLiz9PJ0GAIgGVUKBoNe3Kg7RG2viWDF+pHu6wjy1e1B8GyF19A==',key_name='tempest-TestShelveInstance-571538458',keypairs=<?>,launch_index=0,launched_at=2023-11-15T09:35:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ea59215474b04143951de2b9453a33ad',ramdisk_id='',reservation_id='r-rwg3hjam',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1849491535',owner_user_name='tempest-TestShelveInstance-1849491535-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T09:35:09Z,user_data=None,user_id='f9f813d56e87487498cb9f8454ea1651',uuid=f7d1a157-3228-490e-a6a0-68f6bd2b52ba,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "caf104ef-b652-4038-8203-76f14e4b666b", "address": "fa:16:3e:6f:84:74", "network": {"id": "a2e4fc06-5a74-45cd-b530-6dd240bfd068", "bridge": "br-int", "label": "tempest-TestShelveInstance-1307896814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea59215474b04143951de2b9453a33ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcaf104ef-b6", "ovs_interfaceid": "caf104ef-b652-4038-8203-76f14e4b666b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 09:36:44 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-80d74b9d-c242-4b15-9dac-244d845fe89f tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] Converting VIF {"id": "caf104ef-b652-4038-8203-76f14e4b666b", "address": "fa:16:3e:6f:84:74", "network": {"id": "a2e4fc06-5a74-45cd-b530-6dd240bfd068", "bridge": "br-int", "label": "tempest-TestShelveInstance-1307896814-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea59215474b04143951de2b9453a33ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcaf104ef-b6", "ovs_interfaceid": "caf104ef-b652-4038-8203-76f14e4b666b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 09:36:44 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-80d74b9d-c242-4b15-9dac-244d845fe89f tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:84:74,bridge_name='br-int',has_traffic_filtering=True,id=caf104ef-b652-4038-8203-76f14e4b666b,network=Network(a2e4fc06-5a74-45cd-b530-6dd240bfd068),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcaf104ef-b6') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 09:36:44 user nova-compute[75122]: DEBUG os_vif [None req-80d74b9d-c242-4b15-9dac-244d845fe89f tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:84:74,bridge_name='br-int',has_traffic_filtering=True,id=caf104ef-b652-4038-8203-76f14e4b666b,network=Network(a2e4fc06-5a74-45cd-b530-6dd240bfd068),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcaf104ef-b6') {{(pid=75122) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 09:36:44 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:36:44 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcaf104ef-b6, bridge=br-int, if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:36:44 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:36:44 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:36:44 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:36:44 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a5b4784c-80bb-4b35-afee-c804d04c63d5) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:36:44 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:36:44 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:36:44 user nova-compute[75122]: INFO os_vif [None req-80d74b9d-c242-4b15-9dac-244d845fe89f tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:84:74,bridge_name='br-int',has_traffic_filtering=True,id=caf104ef-b652-4038-8203-76f14e4b666b,network=Network(a2e4fc06-5a74-45cd-b530-6dd240bfd068),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcaf104ef-b6')
Nov 15 09:36:44 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-80d74b9d-c242-4b15-9dac-244d845fe89f tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] [instance: f7d1a157-3228-490e-a6a0-68f6bd2b52ba] calling os-brick to detach iSCSI Volume {{(pid=75122) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 09:36:44 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-80d74b9d-c242-4b15-9dac-244d845fe89f tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffa04060b80>, {'target_iqn': 'iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pufAUkHv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': True}}" {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 09:36:44 user nova-compute[75122]: WARNING os_brick.initiator.connectors.base [None req-80d74b9d-c242-4b15-9dac-244d845fe89f tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 09:36:44 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-80d74b9d-c242-4b15-9dac-244d845fe89f tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 09:36:44 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-80d74b9d-c242-4b15-9dac-244d845fe89f tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 09:36:44 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:36:44 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:36:44 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d30626a-948c-4a73-8175-da17614040eb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7524fa0e-0e0f-4da0-bd00-7f099a8a55e8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:36:44 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-80d74b9d-c242-4b15-9dac-244d845fe89f tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 09:36:44 user nova-compute[75122]: No targets found.
Nov 15 09:36:44 user nova-compute[75122]: iSNS:
Nov 15 09:36:44 user nova-compute[75122]: No targets found.
Nov 15 09:36:44 user nova-compute[75122]: STATIC:
Nov 15 09:36:44 user nova-compute[75122]: Target: iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16
Nov 15 09:36:44 user nova-compute[75122]:         Portal: 172.16.0.220:3260,-1
Nov 15 09:36:44 user nova-compute[75122]:                 Iface Name: default
Nov 15 09:36:44 user nova-compute[75122]: Target: iqn.2010-10.org.openstack:7524fa0e-0e0f-4da0-bd00-7f099a8a55e8
Nov 15 09:36:44 user nova-compute[75122]:         Portal: 172.16.0.220:3260,-1
Nov 15 09:36:44 user nova-compute[75122]:                 Iface Name: default
Nov 15 09:36:44 user nova-compute[75122]: Target: iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e
Nov 15 09:36:44 user nova-compute[75122]:         Portal: 172.16.0.220:3260,-1
Nov 15 09:36:44 user nova-compute[75122]:                 Iface Name: default
Nov 15 09:36:44 user nova-compute[75122]: FIRMWARE:
Nov 15 09:36:44 user nova-compute[75122]: No targets found.
Nov 15 09:36:44 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 09:36:44 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-80d74b9d-c242-4b15-9dac-244d845fe89f tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 09:36:44 user nova-compute[75122]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 09:36:44 user nova-compute[75122]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75122) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 09:36:44 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-80d74b9d-c242-4b15-9dac-244d845fe89f tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e', 0)] {{(pid=75122) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 09:36:44 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:36:44 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:36:44 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[a828bc46-a05b-425d-be5f-a9ce3982c4a1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7524fa0e-0e0f-4da0-bd00-7f099a8a55e8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:36:44 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:36:44 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:36:44 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6adc8f7-1a8f-408f-9180-f4b0f8359943]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7524fa0e-0e0f-4da0-bd00-7f099a8a55e8 (non-flash)\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:36:44 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-80d74b9d-c242-4b15-9dac-244d845fe89f tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e (non-flash)
Nov 15 09:36:44 user nova-compute[75122]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16 (non-flash)
Nov 15 09:36:44 user nova-compute[75122]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7524fa0e-0e0f-4da0-bd00-7f099a8a55e8 (non-flash)
Nov 15 09:36:44 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 09:36:44 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-80d74b9d-c242-4b15-9dac-244d845fe89f tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e (non-flash)
Nov 15 09:36:44 user nova-compute[75122]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16 (non-flash)
Nov 15 09:36:44 user nova-compute[75122]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7524fa0e-0e0f-4da0-bd00-7f099a8a55e8 (non-flash)
Nov 15 09:36:44 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 09:36:44 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-80d74b9d-c242-4b15-9dac-244d845fe89f tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff9e434e3b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e'): ({'sdi'}, set())}) {{(pid=75122) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 09:36:44 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-80d74b9d-c242-4b15-9dac-244d845fe89f tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] Removing single pathed devices sdi {{(pid=75122) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 09:36:44 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:36:44 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:36:44 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a9e1788-ea79-4f12-b7e9-64cfa23bbcc9]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:36:44 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:36:44 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:36:44 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b412ec3-cc7f-4f9b-a1db-4b142e35f6e1]: (4, ('ok\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:36:44 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-80d74b9d-c242-4b15-9dac-244d845fe89f tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] Flushing IO for device /dev/sdi {{(pid=75122) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 09:36:44 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:36:44 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.013s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:36:44 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[6087bf1f-f7c4-4107-ae46-1e15bbe182af]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:36:44 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-80d74b9d-c242-4b15-9dac-244d845fe89f tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=75122) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 09:36:44 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:36:44 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.034s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:36:44 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[e62be48d-b94b-4053-9ab3-7c31a1644f7f]: (4, ('1', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:36:44 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-80d74b9d-c242-4b15-9dac-244d845fe89f tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=75122) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 09:36:44 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-80d74b9d-c242-4b15-9dac-244d845fe89f tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] SCSI volumes sdi have been removed. {{(pid=75122) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 09:36:44 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-80d74b9d-c242-4b15-9dac-244d845fe89f tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e')] {{(pid=75122) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 09:36:44 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:36:44 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:36:44 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[45a98914-e65f-4a45-8b44-dd1e20807e0c]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:36:44 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-80d74b9d-c242-4b15-9dac-244d845fe89f tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:36:44 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e -p 172.16.0.220:3260 --logout {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:36:44 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:36:44 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d647db0-02db-46ee-b24a-a5d9e91a4eb6]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:36:44 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-80d74b9d-c242-4b15-9dac-244d845fe89f tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e, portal: 172.16.0.220,3260]
Nov 15 09:36:44 user nova-compute[75122]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e, portal: 172.16.0.220,3260] successful.
Nov 15 09:36:44 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:36:44 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e -p 172.16.0.220:3260 --op delete {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:36:44 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1b088a7-71ac-43f7-8ee4-c9a32a33681e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:36:44 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[443a4feb-2556-4a43-bcb0-0528a45a17d9]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:36:44 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-80d74b9d-c242-4b15-9dac-244d845fe89f tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:36:44 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-80d74b9d-c242-4b15-9dac-244d845fe89f tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.558s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 09:36:44 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-80d74b9d-c242-4b15-9dac-244d845fe89f tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] <== disconnect_volume: return (561ms) None {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 09:36:44 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-80d74b9d-c242-4b15-9dac-244d845fe89f tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] [instance: f7d1a157-3228-490e-a6a0-68f6bd2b52ba] Disconnected iSCSI Volume {{(pid=75122) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 09:36:44 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-80d74b9d-c242-4b15-9dac-244d845fe89f tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] [instance: f7d1a157-3228-490e-a6a0-68f6bd2b52ba] Deleting instance files /opt/stack/data/nova/instances/f7d1a157-3228-490e-a6a0-68f6bd2b52ba_del
Nov 15 09:36:44 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-80d74b9d-c242-4b15-9dac-244d845fe89f tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] [instance: f7d1a157-3228-490e-a6a0-68f6bd2b52ba] Deletion of /opt/stack/data/nova/instances/f7d1a157-3228-490e-a6a0-68f6bd2b52ba_del complete
Nov 15 09:36:44 user nova-compute[75122]: INFO nova.compute.manager [None req-80d74b9d-c242-4b15-9dac-244d845fe89f tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] [instance: f7d1a157-3228-490e-a6a0-68f6bd2b52ba] Took 1.50 seconds to destroy the instance on the hypervisor.
Nov 15 09:36:44 user nova-compute[75122]: DEBUG oslo.service.loopingcall [None req-80d74b9d-c242-4b15-9dac-244d845fe89f tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75122) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 09:36:44 user nova-compute[75122]: DEBUG nova.compute.manager [-] [instance: f7d1a157-3228-490e-a6a0-68f6bd2b52ba] Deallocating network for instance {{(pid=75122) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 09:36:44 user nova-compute[75122]: DEBUG nova.network.neutron [-] [instance: f7d1a157-3228-490e-a6a0-68f6bd2b52ba] deallocate_for_instance() {{(pid=75122) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 09:36:45 user nova-compute[75122]: DEBUG nova.network.neutron [-] [instance: f7d1a157-3228-490e-a6a0-68f6bd2b52ba] Updating instance_info_cache with network_info: [] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:36:45 user nova-compute[75122]: INFO nova.compute.manager [-] [instance: f7d1a157-3228-490e-a6a0-68f6bd2b52ba] Took 0.47 seconds to deallocate network for instance.
Nov 15 09:36:45 user nova-compute[75122]: DEBUG nova.compute.manager [req-05ebcaa4-b49f-4078-bf3b-a7e4ab670fcc req-58e54e77-f3b0-49a0-b111-de420d765b52 service nova] [instance: f7d1a157-3228-490e-a6a0-68f6bd2b52ba] Received event network-vif-deleted-caf104ef-b652-4038-8203-76f14e4b666b {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:36:45 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:36:45 user nova-compute[75122]: DEBUG nova.compute.manager [req-1dc4da53-b43a-4e3b-a174-82f580407331 req-31bd5009-fcdd-4cfd-9cee-8dc3d92ea4bb service nova] [instance: f7d1a157-3228-490e-a6a0-68f6bd2b52ba] Received event network-vif-plugged-caf104ef-b652-4038-8203-76f14e4b666b {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:36:45 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-1dc4da53-b43a-4e3b-a174-82f580407331 req-31bd5009-fcdd-4cfd-9cee-8dc3d92ea4bb service nova] Acquiring lock "f7d1a157-3228-490e-a6a0-68f6bd2b52ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:36:45 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-1dc4da53-b43a-4e3b-a174-82f580407331 req-31bd5009-fcdd-4cfd-9cee-8dc3d92ea4bb service nova] Lock "f7d1a157-3228-490e-a6a0-68f6bd2b52ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:36:45 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-1dc4da53-b43a-4e3b-a174-82f580407331 req-31bd5009-fcdd-4cfd-9cee-8dc3d92ea4bb service nova] Lock "f7d1a157-3228-490e-a6a0-68f6bd2b52ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:36:45 user nova-compute[75122]: DEBUG nova.compute.manager [req-1dc4da53-b43a-4e3b-a174-82f580407331 req-31bd5009-fcdd-4cfd-9cee-8dc3d92ea4bb service nova] [instance: f7d1a157-3228-490e-a6a0-68f6bd2b52ba] No waiting events found dispatching network-vif-plugged-caf104ef-b652-4038-8203-76f14e4b666b {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:36:45 user nova-compute[75122]: WARNING nova.compute.manager [req-1dc4da53-b43a-4e3b-a174-82f580407331 req-31bd5009-fcdd-4cfd-9cee-8dc3d92ea4bb service nova] [instance: f7d1a157-3228-490e-a6a0-68f6bd2b52ba] Received unexpected event network-vif-plugged-caf104ef-b652-4038-8203-76f14e4b666b for instance with vm_state active and task_state deleting.
Nov 15 09:36:45 user nova-compute[75122]: INFO nova.compute.manager [None req-80d74b9d-c242-4b15-9dac-244d845fe89f tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] [instance: f7d1a157-3228-490e-a6a0-68f6bd2b52ba] Took 0.74 seconds to detach 1 volumes for instance.
Nov 15 09:36:45 user nova-compute[75122]: DEBUG nova.compute.manager [None req-80d74b9d-c242-4b15-9dac-244d845fe89f tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] [instance: f7d1a157-3228-490e-a6a0-68f6bd2b52ba] Deleting volume: d1b088a7-71ac-43f7-8ee4-c9a32a33681e {{(pid=75122) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 15 09:36:46 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-80d74b9d-c242-4b15-9dac-244d845fe89f tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:36:46 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-80d74b9d-c242-4b15-9dac-244d845fe89f tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:36:46 user nova-compute[75122]: DEBUG nova.compute.provider_tree [None req-80d74b9d-c242-4b15-9dac-244d845fe89f tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] Inventory has not changed in ProviderTree for provider: 69a3da65-47be-44c6-b67c-c692b58284ef {{(pid=75122) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 09:36:46 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-80d74b9d-c242-4b15-9dac-244d845fe89f tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] Inventory has not changed for provider 69a3da65-47be-44c6-b67c-c692b58284ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 09:36:46 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-80d74b9d-c242-4b15-9dac-244d845fe89f tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.351s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:36:46 user nova-compute[75122]: INFO nova.scheduler.client.report [None req-80d74b9d-c242-4b15-9dac-244d845fe89f tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] Deleted allocations for instance f7d1a157-3228-490e-a6a0-68f6bd2b52ba
Nov 15 09:36:46 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-80d74b9d-c242-4b15-9dac-244d845fe89f tempest-TestShelveInstance-1849491535 tempest-TestShelveInstance-1849491535-project-member] Lock "f7d1a157-3228-490e-a6a0-68f6bd2b52ba" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.335s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:36:47 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:36:49 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:36:49 user nova-compute[75122]: DEBUG nova.compute.manager [req-07c400f7-557b-4558-bb00-56ed7393edf9 req-8ecbaaeb-00a7-4a1d-a809-b63e8e63c38e service nova] [instance: 5b5a4d58-ba1e-473d-a32a-06fae1c84efc] Received event network-changed-b245a5c2-e523-4d4e-a343-f5b2352337ab {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:36:49 user nova-compute[75122]: DEBUG nova.compute.manager [req-07c400f7-557b-4558-bb00-56ed7393edf9 req-8ecbaaeb-00a7-4a1d-a809-b63e8e63c38e service nova] [instance: 5b5a4d58-ba1e-473d-a32a-06fae1c84efc] Refreshing instance network info cache due to event network-changed-b245a5c2-e523-4d4e-a343-f5b2352337ab. {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 09:36:49 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-07c400f7-557b-4558-bb00-56ed7393edf9 req-8ecbaaeb-00a7-4a1d-a809-b63e8e63c38e service nova] Acquiring lock "refresh_cache-5b5a4d58-ba1e-473d-a32a-06fae1c84efc" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 09:36:49 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-07c400f7-557b-4558-bb00-56ed7393edf9 req-8ecbaaeb-00a7-4a1d-a809-b63e8e63c38e service nova] Acquired lock "refresh_cache-5b5a4d58-ba1e-473d-a32a-06fae1c84efc" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 09:36:49 user nova-compute[75122]: DEBUG nova.network.neutron [req-07c400f7-557b-4558-bb00-56ed7393edf9 req-8ecbaaeb-00a7-4a1d-a809-b63e8e63c38e service nova] [instance: 5b5a4d58-ba1e-473d-a32a-06fae1c84efc] Refreshing network info cache for port b245a5c2-e523-4d4e-a343-f5b2352337ab {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 09:36:50 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:36:50 user nova-compute[75122]: DEBUG nova.network.neutron [req-07c400f7-557b-4558-bb00-56ed7393edf9 req-8ecbaaeb-00a7-4a1d-a809-b63e8e63c38e service nova] [instance: 5b5a4d58-ba1e-473d-a32a-06fae1c84efc] Updated VIF entry in instance network info cache for port b245a5c2-e523-4d4e-a343-f5b2352337ab. {{(pid=75122) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 09:36:50 user nova-compute[75122]: DEBUG nova.network.neutron [req-07c400f7-557b-4558-bb00-56ed7393edf9 req-8ecbaaeb-00a7-4a1d-a809-b63e8e63c38e service nova] [instance: 5b5a4d58-ba1e-473d-a32a-06fae1c84efc] Updating instance_info_cache with network_info: [{"id": "b245a5c2-e523-4d4e-a343-f5b2352337ab", "address": "fa:16:3e:cd:ac:71", "network": {"id": "53e8c131-26be-4b3f-beca-dd48fe06ffbe", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-888345656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6aed61f0071f44ac901b94cd9a4a909d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb245a5c2-e5", "ovs_interfaceid": "b245a5c2-e523-4d4e-a343-f5b2352337ab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:36:50 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-07c400f7-557b-4558-bb00-56ed7393edf9 req-8ecbaaeb-00a7-4a1d-a809-b63e8e63c38e service nova] Releasing lock "refresh_cache-5b5a4d58-ba1e-473d-a32a-06fae1c84efc" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 09:36:51 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:36:51 user nova-compute[75122]: DEBUG nova.compute.manager [None req-72cec03e-0b41-4790-97f0-d41732a8b329 tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] [instance: 5b5a4d58-ba1e-473d-a32a-06fae1c84efc] Checking state {{(pid=75122) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 09:36:51 user nova-compute[75122]: INFO nova.compute.manager [None req-72cec03e-0b41-4790-97f0-d41732a8b329 tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] [instance: 5b5a4d58-ba1e-473d-a32a-06fae1c84efc] instance snapshotting
Nov 15 09:36:51 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-72cec03e-0b41-4790-97f0-d41732a8b329 tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] [instance: 5b5a4d58-ba1e-473d-a32a-06fae1c84efc] Beginning live snapshot process
Nov 15 09:36:51 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-72cec03e-0b41-4790-97f0-d41732a8b329 tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5a4d58-ba1e-473d-a32a-06fae1c84efc/disk --force-share --output=json -f qcow2 {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:36:51 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-72cec03e-0b41-4790-97f0-d41732a8b329 tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5a4d58-ba1e-473d-a32a-06fae1c84efc/disk --force-share --output=json -f qcow2" returned: 0 in 0.193s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:36:51 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-72cec03e-0b41-4790-97f0-d41732a8b329 tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5a4d58-ba1e-473d-a32a-06fae1c84efc/disk --force-share --output=json -f qcow2 {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:36:51 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-72cec03e-0b41-4790-97f0-d41732a8b329 tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5a4d58-ba1e-473d-a32a-06fae1c84efc/disk --force-share --output=json -f qcow2" returned: 0 in 0.196s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:36:51 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-72cec03e-0b41-4790-97f0-d41732a8b329 tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:36:52 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-72cec03e-0b41-4790-97f0-d41732a8b329 tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json" returned: 0 in 0.177s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:36:52 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-72cec03e-0b41-4790-97f0-d41732a8b329 tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpc2_cu0dr/6cab8321290a40aaa0c2051cbd63c909.delta 1073741824 {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:36:52 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-72cec03e-0b41-4790-97f0-d41732a8b329 tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpc2_cu0dr/6cab8321290a40aaa0c2051cbd63c909.delta 1073741824" returned: 0 in 0.209s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:36:52 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-72cec03e-0b41-4790-97f0-d41732a8b329 tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] [instance: 5b5a4d58-ba1e-473d-a32a-06fae1c84efc] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 15 09:36:53 user nova-compute[75122]: DEBUG nova.virt.libvirt.guest [None req-72cec03e-0b41-4790-97f0-d41732a8b329 tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=75122) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 09:36:53 user nova-compute[75122]: DEBUG nova.virt.libvirt.guest [None req-72cec03e-0b41-4790-97f0-d41732a8b329 tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] COPY block job progress, current cursor: 75366400 final cursor: 75497472 {{(pid=75122) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 09:36:54 user nova-compute[75122]: DEBUG nova.virt.libvirt.guest [None req-72cec03e-0b41-4790-97f0-d41732a8b329 tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75122) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 09:36:54 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-72cec03e-0b41-4790-97f0-d41732a8b329 tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] [instance: 5b5a4d58-ba1e-473d-a32a-06fae1c84efc] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 15 09:36:54 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:36:54 user nova-compute[75122]: DEBUG nova.privsep.utils [None req-72cec03e-0b41-4790-97f0-d41732a8b329 tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75122) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 09:36:54 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-72cec03e-0b41-4790-97f0-d41732a8b329 tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpc2_cu0dr/6cab8321290a40aaa0c2051cbd63c909.delta /opt/stack/data/nova/instances/snapshots/tmpc2_cu0dr/6cab8321290a40aaa0c2051cbd63c909 {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:36:54 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-72cec03e-0b41-4790-97f0-d41732a8b329 tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpc2_cu0dr/6cab8321290a40aaa0c2051cbd63c909.delta /opt/stack/data/nova/instances/snapshots/tmpc2_cu0dr/6cab8321290a40aaa0c2051cbd63c909" returned: 0 in 0.761s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:36:54 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-72cec03e-0b41-4790-97f0-d41732a8b329 tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] [instance: 5b5a4d58-ba1e-473d-a32a-06fae1c84efc] Snapshot extracted, beginning image upload
Nov 15 09:36:55 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:36:57 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-72cec03e-0b41-4790-97f0-d41732a8b329 tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] [instance: 5b5a4d58-ba1e-473d-a32a-06fae1c84efc] Snapshot image upload complete
Nov 15 09:36:57 user nova-compute[75122]: INFO nova.compute.manager [None req-72cec03e-0b41-4790-97f0-d41732a8b329 tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] [instance: 5b5a4d58-ba1e-473d-a32a-06fae1c84efc] Took 6.40 seconds to snapshot the instance on the hypervisor.
Nov 15 09:36:58 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-35ac78ab-0032-43fe-b000-e73f01f9265f tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Acquiring lock "fe0a6436-87c4-4826-a2f4-8d07c7fab59a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:36:58 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-35ac78ab-0032-43fe-b000-e73f01f9265f tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Lock "fe0a6436-87c4-4826-a2f4-8d07c7fab59a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:36:58 user nova-compute[75122]: DEBUG nova.compute.manager [None req-35ac78ab-0032-43fe-b000-e73f01f9265f tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] [instance: fe0a6436-87c4-4826-a2f4-8d07c7fab59a] Starting instance... {{(pid=75122) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 09:36:58 user nova-compute[75122]: DEBUG nova.compute.manager [req-f83a88f9-1d57-4055-a0d2-8c6ce8d21ec9 req-846a3de9-4269-4e9a-b486-eaf9aef03b4a service nova] [instance: 1e19f9e1-69c6-4590-85d2-e90cbdbb3d80] Received event network-changed-a9170e2e-32f0-422c-becf-e1b2792b9b75 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:36:58 user nova-compute[75122]: DEBUG nova.compute.manager [req-f83a88f9-1d57-4055-a0d2-8c6ce8d21ec9 req-846a3de9-4269-4e9a-b486-eaf9aef03b4a service nova] [instance: 1e19f9e1-69c6-4590-85d2-e90cbdbb3d80] Refreshing instance network info cache due to event network-changed-a9170e2e-32f0-422c-becf-e1b2792b9b75. {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 09:36:58 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-f83a88f9-1d57-4055-a0d2-8c6ce8d21ec9 req-846a3de9-4269-4e9a-b486-eaf9aef03b4a service nova] Acquiring lock "refresh_cache-1e19f9e1-69c6-4590-85d2-e90cbdbb3d80" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 09:36:58 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-f83a88f9-1d57-4055-a0d2-8c6ce8d21ec9 req-846a3de9-4269-4e9a-b486-eaf9aef03b4a service nova] Acquired lock "refresh_cache-1e19f9e1-69c6-4590-85d2-e90cbdbb3d80" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 09:36:58 user nova-compute[75122]: DEBUG nova.network.neutron [req-f83a88f9-1d57-4055-a0d2-8c6ce8d21ec9 req-846a3de9-4269-4e9a-b486-eaf9aef03b4a service nova] [instance: 1e19f9e1-69c6-4590-85d2-e90cbdbb3d80] Refreshing network info cache for port a9170e2e-32f0-422c-becf-e1b2792b9b75 {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 09:36:58 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-35ac78ab-0032-43fe-b000-e73f01f9265f tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:36:58 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-35ac78ab-0032-43fe-b000-e73f01f9265f tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:36:58 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-35ac78ab-0032-43fe-b000-e73f01f9265f tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75122) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 09:36:58 user nova-compute[75122]: INFO nova.compute.claims [None req-35ac78ab-0032-43fe-b000-e73f01f9265f tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] [instance: fe0a6436-87c4-4826-a2f4-8d07c7fab59a] Claim successful on node user
Nov 15 09:36:59 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:36:59 user nova-compute[75122]: DEBUG nova.compute.provider_tree [None req-35ac78ab-0032-43fe-b000-e73f01f9265f tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Inventory has not changed in ProviderTree for provider: 69a3da65-47be-44c6-b67c-c692b58284ef {{(pid=75122) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 09:36:59 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-35ac78ab-0032-43fe-b000-e73f01f9265f tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Inventory has not changed for provider 69a3da65-47be-44c6-b67c-c692b58284ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 09:36:59 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-35ac78ab-0032-43fe-b000-e73f01f9265f tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.437s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:36:59 user nova-compute[75122]: DEBUG nova.compute.manager [None req-35ac78ab-0032-43fe-b000-e73f01f9265f tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] [instance: fe0a6436-87c4-4826-a2f4-8d07c7fab59a] Start building networks asynchronously for instance. {{(pid=75122) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 09:36:59 user nova-compute[75122]: DEBUG nova.network.neutron [req-f83a88f9-1d57-4055-a0d2-8c6ce8d21ec9 req-846a3de9-4269-4e9a-b486-eaf9aef03b4a service nova] [instance: 1e19f9e1-69c6-4590-85d2-e90cbdbb3d80] Updated VIF entry in instance network info cache for port a9170e2e-32f0-422c-becf-e1b2792b9b75. {{(pid=75122) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 09:36:59 user nova-compute[75122]: DEBUG nova.network.neutron [req-f83a88f9-1d57-4055-a0d2-8c6ce8d21ec9 req-846a3de9-4269-4e9a-b486-eaf9aef03b4a service nova] [instance: 1e19f9e1-69c6-4590-85d2-e90cbdbb3d80] Updating instance_info_cache with network_info: [{"id": "a9170e2e-32f0-422c-becf-e1b2792b9b75", "address": "fa:16:3e:4c:61:a8", "network": {"id": "cd65f44e-6f5f-40c7-87f0-de082fb2bda9", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-635927865-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f97007ed06a04d7ebbc6cd3543a23d96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9170e2e-32", "ovs_interfaceid": "a9170e2e-32f0-422c-becf-e1b2792b9b75", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:36:59 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-f83a88f9-1d57-4055-a0d2-8c6ce8d21ec9 req-846a3de9-4269-4e9a-b486-eaf9aef03b4a service nova] Releasing lock "refresh_cache-1e19f9e1-69c6-4590-85d2-e90cbdbb3d80" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 09:36:59 user nova-compute[75122]: DEBUG nova.compute.manager [None req-35ac78ab-0032-43fe-b000-e73f01f9265f tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] [instance: fe0a6436-87c4-4826-a2f4-8d07c7fab59a] Allocating IP information in the background. {{(pid=75122) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 09:36:59 user nova-compute[75122]: DEBUG nova.network.neutron [None req-35ac78ab-0032-43fe-b000-e73f01f9265f tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] [instance: fe0a6436-87c4-4826-a2f4-8d07c7fab59a] allocate_for_instance() {{(pid=75122) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 09:36:59 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-35ac78ab-0032-43fe-b000-e73f01f9265f tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] [instance: fe0a6436-87c4-4826-a2f4-8d07c7fab59a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 09:36:59 user nova-compute[75122]: DEBUG nova.compute.manager [None req-35ac78ab-0032-43fe-b000-e73f01f9265f tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] [instance: fe0a6436-87c4-4826-a2f4-8d07c7fab59a] Start building block device mappings for instance. {{(pid=75122) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 09:36:59 user nova-compute[75122]: DEBUG nova.policy [None req-35ac78ab-0032-43fe-b000-e73f01f9265f tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7e5545ae1ca743d4ada8e28d28fca540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8ea42f6a3446e8a8edcf3dcb016b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75122) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 09:36:59 user nova-compute[75122]: DEBUG nova.compute.manager [None req-35ac78ab-0032-43fe-b000-e73f01f9265f tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] [instance: fe0a6436-87c4-4826-a2f4-8d07c7fab59a] Start spawning the instance on the hypervisor. {{(pid=75122) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 09:36:59 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-35ac78ab-0032-43fe-b000-e73f01f9265f tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] [instance: fe0a6436-87c4-4826-a2f4-8d07c7fab59a] Creating instance directory {{(pid=75122) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 09:36:59 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-35ac78ab-0032-43fe-b000-e73f01f9265f tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] [instance: fe0a6436-87c4-4826-a2f4-8d07c7fab59a] Creating image(s)
Nov 15 09:36:59 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-35ac78ab-0032-43fe-b000-e73f01f9265f tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Acquiring lock "/opt/stack/data/nova/instances/fe0a6436-87c4-4826-a2f4-8d07c7fab59a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:36:59 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-35ac78ab-0032-43fe-b000-e73f01f9265f tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Lock "/opt/stack/data/nova/instances/fe0a6436-87c4-4826-a2f4-8d07c7fab59a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:36:59 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-35ac78ab-0032-43fe-b000-e73f01f9265f tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Lock "/opt/stack/data/nova/instances/fe0a6436-87c4-4826-a2f4-8d07c7fab59a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:36:59 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-35ac78ab-0032-43fe-b000-e73f01f9265f tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:36:59 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-35ac78ab-0032-43fe-b000-e73f01f9265f tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json" returned: 0 in 0.177s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:36:59 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-35ac78ab-0032-43fe-b000-e73f01f9265f tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Acquiring lock "95d6e29f74d5408f818e32f3bc29bc8270a4c665" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:36:59 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-35ac78ab-0032-43fe-b000-e73f01f9265f tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Lock "95d6e29f74d5408f818e32f3bc29bc8270a4c665" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:36:59 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-35ac78ab-0032-43fe-b000-e73f01f9265f tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:36:59 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-35ac78ab-0032-43fe-b000-e73f01f9265f tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json" returned: 0 in 0.178s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:36:59 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-35ac78ab-0032-43fe-b000-e73f01f9265f tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665,backing_fmt=raw /opt/stack/data/nova/instances/fe0a6436-87c4-4826-a2f4-8d07c7fab59a/disk 1073741824 {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:36:59 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-35ac78ab-0032-43fe-b000-e73f01f9265f tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665,backing_fmt=raw /opt/stack/data/nova/instances/fe0a6436-87c4-4826-a2f4-8d07c7fab59a/disk 1073741824" returned: 0 in 0.074s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:36:59 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-35ac78ab-0032-43fe-b000-e73f01f9265f tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Lock "95d6e29f74d5408f818e32f3bc29bc8270a4c665" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.260s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:36:59 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-35ac78ab-0032-43fe-b000-e73f01f9265f tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:37:00 user nova-compute[75122]: DEBUG nova.network.neutron [None req-35ac78ab-0032-43fe-b000-e73f01f9265f tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] [instance: fe0a6436-87c4-4826-a2f4-8d07c7fab59a] Successfully created port: 80aa86de-4dda-46e9-bb33-424ce423cf85 {{(pid=75122) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 09:37:00 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-35ac78ab-0032-43fe-b000-e73f01f9265f tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json" returned: 0 in 0.200s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:37:00 user nova-compute[75122]: DEBUG nova.virt.disk.api [None req-35ac78ab-0032-43fe-b000-e73f01f9265f tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fe0a6436-87c4-4826-a2f4-8d07c7fab59a/disk. size=1073741824 {{(pid=75122) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 09:37:00 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-35ac78ab-0032-43fe-b000-e73f01f9265f tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe0a6436-87c4-4826-a2f4-8d07c7fab59a/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:37:00 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-35ac78ab-0032-43fe-b000-e73f01f9265f tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe0a6436-87c4-4826-a2f4-8d07c7fab59a/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:37:00 user nova-compute[75122]: DEBUG nova.virt.disk.api [None req-35ac78ab-0032-43fe-b000-e73f01f9265f tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Cannot resize image /opt/stack/data/nova/instances/fe0a6436-87c4-4826-a2f4-8d07c7fab59a/disk to a smaller size. {{(pid=75122) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 09:37:00 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-35ac78ab-0032-43fe-b000-e73f01f9265f tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] [instance: fe0a6436-87c4-4826-a2f4-8d07c7fab59a] Created local disks {{(pid=75122) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 09:37:00 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-35ac78ab-0032-43fe-b000-e73f01f9265f tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] [instance: fe0a6436-87c4-4826-a2f4-8d07c7fab59a] Ensure instance console log exists: /opt/stack/data/nova/instances/fe0a6436-87c4-4826-a2f4-8d07c7fab59a/console.log {{(pid=75122) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 09:37:00 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-35ac78ab-0032-43fe-b000-e73f01f9265f tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:37:00 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-35ac78ab-0032-43fe-b000-e73f01f9265f tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:37:00 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-35ac78ab-0032-43fe-b000-e73f01f9265f tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:37:00 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:37:01 user nova-compute[75122]: DEBUG nova.network.neutron [None req-35ac78ab-0032-43fe-b000-e73f01f9265f tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] [instance: fe0a6436-87c4-4826-a2f4-8d07c7fab59a] Successfully updated port: 80aa86de-4dda-46e9-bb33-424ce423cf85 {{(pid=75122) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 09:37:01 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-35ac78ab-0032-43fe-b000-e73f01f9265f tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Acquiring lock "refresh_cache-fe0a6436-87c4-4826-a2f4-8d07c7fab59a" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 09:37:01 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-35ac78ab-0032-43fe-b000-e73f01f9265f tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Acquired lock "refresh_cache-fe0a6436-87c4-4826-a2f4-8d07c7fab59a" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 09:37:01 user nova-compute[75122]: DEBUG nova.network.neutron [None req-35ac78ab-0032-43fe-b000-e73f01f9265f tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] [instance: fe0a6436-87c4-4826-a2f4-8d07c7fab59a] Building network info cache for instance {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 09:37:01 user nova-compute[75122]: DEBUG nova.compute.manager [req-c8118351-a7d3-45cf-9f1e-fd8f30d6d967 req-ffd1c412-f3dd-4fea-8ae8-341365031a83 service nova] [instance: fe0a6436-87c4-4826-a2f4-8d07c7fab59a] Received event network-changed-80aa86de-4dda-46e9-bb33-424ce423cf85 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:37:01 user nova-compute[75122]: DEBUG nova.compute.manager [req-c8118351-a7d3-45cf-9f1e-fd8f30d6d967 req-ffd1c412-f3dd-4fea-8ae8-341365031a83 service nova] [instance: fe0a6436-87c4-4826-a2f4-8d07c7fab59a] Refreshing instance network info cache due to event network-changed-80aa86de-4dda-46e9-bb33-424ce423cf85. {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 09:37:01 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-c8118351-a7d3-45cf-9f1e-fd8f30d6d967 req-ffd1c412-f3dd-4fea-8ae8-341365031a83 service nova] Acquiring lock "refresh_cache-fe0a6436-87c4-4826-a2f4-8d07c7fab59a" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 09:37:01 user nova-compute[75122]: DEBUG nova.network.neutron [None req-35ac78ab-0032-43fe-b000-e73f01f9265f tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] [instance: fe0a6436-87c4-4826-a2f4-8d07c7fab59a] Instance cache missing network info. {{(pid=75122) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 09:37:01 user nova-compute[75122]: DEBUG nova.network.neutron [None req-35ac78ab-0032-43fe-b000-e73f01f9265f tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] [instance: fe0a6436-87c4-4826-a2f4-8d07c7fab59a] Updating instance_info_cache with network_info: [{"id": "80aa86de-4dda-46e9-bb33-424ce423cf85", "address": "fa:16:3e:ce:ac:dd", "network": {"id": "cd74302c-bfd9-495b-887f-0de0d94f4ffc", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-692728798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac8ea42f6a3446e8a8edcf3dcb016b84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80aa86de-4d", "ovs_interfaceid": "80aa86de-4dda-46e9-bb33-424ce423cf85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:37:01 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-35ac78ab-0032-43fe-b000-e73f01f9265f tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Releasing lock "refresh_cache-fe0a6436-87c4-4826-a2f4-8d07c7fab59a" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 09:37:01 user nova-compute[75122]: DEBUG nova.compute.manager [None req-35ac78ab-0032-43fe-b000-e73f01f9265f tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] [instance: fe0a6436-87c4-4826-a2f4-8d07c7fab59a] Instance network_info: |[{"id": "80aa86de-4dda-46e9-bb33-424ce423cf85", "address": "fa:16:3e:ce:ac:dd", "network": {"id": "cd74302c-bfd9-495b-887f-0de0d94f4ffc", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-692728798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac8ea42f6a3446e8a8edcf3dcb016b84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80aa86de-4d", "ovs_interfaceid": "80aa86de-4dda-46e9-bb33-424ce423cf85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75122) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 09:37:01 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-c8118351-a7d3-45cf-9f1e-fd8f30d6d967 req-ffd1c412-f3dd-4fea-8ae8-341365031a83 service nova] Acquired lock "refresh_cache-fe0a6436-87c4-4826-a2f4-8d07c7fab59a" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 09:37:01 user nova-compute[75122]: DEBUG nova.network.neutron [req-c8118351-a7d3-45cf-9f1e-fd8f30d6d967 req-ffd1c412-f3dd-4fea-8ae8-341365031a83 service nova] [instance: fe0a6436-87c4-4826-a2f4-8d07c7fab59a] Refreshing network info cache for port 80aa86de-4dda-46e9-bb33-424ce423cf85 {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 09:37:01 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-35ac78ab-0032-43fe-b000-e73f01f9265f tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] [instance: fe0a6436-87c4-4826-a2f4-8d07c7fab59a] Start _get_guest_xml network_info=[{"id": "80aa86de-4dda-46e9-bb33-424ce423cf85", "address": "fa:16:3e:ce:ac:dd", "network": {"id": "cd74302c-bfd9-495b-887f-0de0d94f4ffc", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-692728798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac8ea42f6a3446e8a8edcf3dcb016b84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80aa86de-4d", "ovs_interfaceid": "80aa86de-4dda-46e9-bb33-424ce423cf85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T09:26:31Z,direct_url=<?>,disk_format='qcow2',id=5e862cfe-47b8-4725-8292-65761ee6d0f5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9c57733cb41847c0b4ad31519c382e5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T09:26:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '5e862cfe-47b8-4725-8292-65761ee6d0f5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75122) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 09:37:01 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-35ac78ab-0032-43fe-b000-e73f01f9265f tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 09:37:01 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-35ac78ab-0032-43fe-b000-e73f01f9265f tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 09:37:01 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-35ac78ab-0032-43fe-b000-e73f01f9265f tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75122) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 09:37:01 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-35ac78ab-0032-43fe-b000-e73f01f9265f tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] CPU controller missing on host. {{(pid=75122) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 09:37:01 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-35ac78ab-0032-43fe-b000-e73f01f9265f tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75122) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 09:37:01 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-35ac78ab-0032-43fe-b000-e73f01f9265f tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] CPU controller found on host. {{(pid=75122) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 09:37:01 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-35ac78ab-0032-43fe-b000-e73f01f9265f tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75122) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 09:37:01 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-35ac78ab-0032-43fe-b000-e73f01f9265f tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T09:26:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T09:26:31Z,direct_url=<?>,disk_format='qcow2',id=5e862cfe-47b8-4725-8292-65761ee6d0f5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9c57733cb41847c0b4ad31519c382e5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T09:26:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 09:37:01 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-35ac78ab-0032-43fe-b000-e73f01f9265f tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Flavor limits 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 09:37:01 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-35ac78ab-0032-43fe-b000-e73f01f9265f tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Image limits 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 09:37:01 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-35ac78ab-0032-43fe-b000-e73f01f9265f tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Flavor pref 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 09:37:01 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-35ac78ab-0032-43fe-b000-e73f01f9265f tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Image pref 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 09:37:01 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-35ac78ab-0032-43fe-b000-e73f01f9265f tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 09:37:01 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-35ac78ab-0032-43fe-b000-e73f01f9265f tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 09:37:01 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-35ac78ab-0032-43fe-b000-e73f01f9265f tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75122) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 09:37:01 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-35ac78ab-0032-43fe-b000-e73f01f9265f tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Got 1 possible topologies {{(pid=75122) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 09:37:01 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-35ac78ab-0032-43fe-b000-e73f01f9265f tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 09:37:01 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-35ac78ab-0032-43fe-b000-e73f01f9265f tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 09:37:01 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-35ac78ab-0032-43fe-b000-e73f01f9265f tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T09:36:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-960828433',display_name='tempest-VolumesSnapshotTestJSON-instance-960828433',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-960828433',id=18,image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF7gCzYY2MSnm+KajBEGrPFU6EBcjWF4hOElMVD+RFTzhFjwaGpN0ruANY/LGZ8CyVaVi5Rs9LWmP+gAl6zX80LlYOoFgjM/x2foBgj5ztFjebn/8L3Fb6x6BIlBx3wvnQ==',key_name='tempest-keypair-1479237151',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ac8ea42f6a3446e8a8edcf3dcb016b84',ramdisk_id='',reservation_id='r-ctzmidsp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1852829755',owner_user_name='tempest-VolumesSnapshotTestJSON-1852829755-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T09:36:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7e5545ae1ca743d4ada8e28d28fca540',uuid=fe0a6436-87c4-4826-a2f4-8d07c7fab59a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "80aa86de-4dda-46e9-bb33-424ce423cf85", "address": "fa:16:3e:ce:ac:dd", "network": {"id": "cd74302c-bfd9-495b-887f-0de0d94f4ffc", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-692728798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac8ea42f6a3446e8a8edcf3dcb016b84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80aa86de-4d", "ovs_interfaceid": "80aa86de-4dda-46e9-bb33-424ce423cf85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75122) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 09:37:01 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-35ac78ab-0032-43fe-b000-e73f01f9265f tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Converting VIF {"id": "80aa86de-4dda-46e9-bb33-424ce423cf85", "address": "fa:16:3e:ce:ac:dd", "network": {"id": "cd74302c-bfd9-495b-887f-0de0d94f4ffc", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-692728798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac8ea42f6a3446e8a8edcf3dcb016b84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80aa86de-4d", "ovs_interfaceid": "80aa86de-4dda-46e9-bb33-424ce423cf85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 09:37:01 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-35ac78ab-0032-43fe-b000-e73f01f9265f tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:ac:dd,bridge_name='br-int',has_traffic_filtering=True,id=80aa86de-4dda-46e9-bb33-424ce423cf85,network=Network(cd74302c-bfd9-495b-887f-0de0d94f4ffc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80aa86de-4d') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 09:37:01 user nova-compute[75122]: DEBUG nova.objects.instance [None req-35ac78ab-0032-43fe-b000-e73f01f9265f tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Lazy-loading 'pci_devices' on Instance uuid fe0a6436-87c4-4826-a2f4-8d07c7fab59a {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:37:01 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-19c31d49-a398-4d19-aec9-8eabf0794c94 tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] Acquiring lock "1e19f9e1-69c6-4590-85d2-e90cbdbb3d80" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:37:01 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-19c31d49-a398-4d19-aec9-8eabf0794c94 tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] Lock "1e19f9e1-69c6-4590-85d2-e90cbdbb3d80" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:37:01 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-35ac78ab-0032-43fe-b000-e73f01f9265f tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] [instance: fe0a6436-87c4-4826-a2f4-8d07c7fab59a] End _get_guest_xml xml=<domain type="kvm">
Nov 15 09:37:01 user nova-compute[75122]:   <uuid>fe0a6436-87c4-4826-a2f4-8d07c7fab59a</uuid>
Nov 15 09:37:01 user nova-compute[75122]:   <name>instance-00000012</name>
Nov 15 09:37:01 user nova-compute[75122]:   <memory>524288</memory>
Nov 15 09:37:01 user nova-compute[75122]:   <vcpu>1</vcpu>
Nov 15 09:37:01 user nova-compute[75122]:   <metadata>
Nov 15 09:37:01 user nova-compute[75122]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 09:37:01 user nova-compute[75122]:       <nova:package version="0.0.0"/>
Nov 15 09:37:01 user nova-compute[75122]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-960828433</nova:name>
Nov 15 09:37:01 user nova-compute[75122]:       <nova:creationTime>2023-11-15 09:37:01</nova:creationTime>
Nov 15 09:37:01 user nova-compute[75122]:       <nova:flavor name="m1.tiny">
Nov 15 09:37:01 user nova-compute[75122]:         <nova:memory>512</nova:memory>
Nov 15 09:37:01 user nova-compute[75122]:         <nova:disk>1</nova:disk>
Nov 15 09:37:01 user nova-compute[75122]:         <nova:swap>0</nova:swap>
Nov 15 09:37:01 user nova-compute[75122]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 09:37:01 user nova-compute[75122]:         <nova:vcpus>1</nova:vcpus>
Nov 15 09:37:01 user nova-compute[75122]:       </nova:flavor>
Nov 15 09:37:01 user nova-compute[75122]:       <nova:owner>
Nov 15 09:37:01 user nova-compute[75122]:         <nova:user uuid="7e5545ae1ca743d4ada8e28d28fca540">tempest-VolumesSnapshotTestJSON-1852829755-project-member</nova:user>
Nov 15 09:37:01 user nova-compute[75122]:         <nova:project uuid="ac8ea42f6a3446e8a8edcf3dcb016b84">tempest-VolumesSnapshotTestJSON-1852829755</nova:project>
Nov 15 09:37:01 user nova-compute[75122]:       </nova:owner>
Nov 15 09:37:01 user nova-compute[75122]:       <nova:root type="image" uuid="5e862cfe-47b8-4725-8292-65761ee6d0f5"/>
Nov 15 09:37:01 user nova-compute[75122]:       <nova:ports>
Nov 15 09:37:01 user nova-compute[75122]:         <nova:port uuid="80aa86de-4dda-46e9-bb33-424ce423cf85">
Nov 15 09:37:01 user nova-compute[75122]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 15 09:37:01 user nova-compute[75122]:         </nova:port>
Nov 15 09:37:01 user nova-compute[75122]:       </nova:ports>
Nov 15 09:37:01 user nova-compute[75122]:     </nova:instance>
Nov 15 09:37:01 user nova-compute[75122]:   </metadata>
Nov 15 09:37:01 user nova-compute[75122]:   <sysinfo type="smbios">
Nov 15 09:37:01 user nova-compute[75122]:     <system>
Nov 15 09:37:01 user nova-compute[75122]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 09:37:01 user nova-compute[75122]:       <entry name="product">OpenStack Nova</entry>
Nov 15 09:37:01 user nova-compute[75122]:       <entry name="version">0.0.0</entry>
Nov 15 09:37:01 user nova-compute[75122]:       <entry name="serial">fe0a6436-87c4-4826-a2f4-8d07c7fab59a</entry>
Nov 15 09:37:01 user nova-compute[75122]:       <entry name="uuid">fe0a6436-87c4-4826-a2f4-8d07c7fab59a</entry>
Nov 15 09:37:01 user nova-compute[75122]:       <entry name="family">Virtual Machine</entry>
Nov 15 09:37:01 user nova-compute[75122]:     </system>
Nov 15 09:37:01 user nova-compute[75122]:   </sysinfo>
Nov 15 09:37:01 user nova-compute[75122]:   <os>
Nov 15 09:37:01 user nova-compute[75122]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 09:37:01 user nova-compute[75122]:     <boot dev="hd"/>
Nov 15 09:37:01 user nova-compute[75122]:     <smbios mode="sysinfo"/>
Nov 15 09:37:01 user nova-compute[75122]:   </os>
Nov 15 09:37:01 user nova-compute[75122]:   <features>
Nov 15 09:37:01 user nova-compute[75122]:     <acpi/>
Nov 15 09:37:01 user nova-compute[75122]:     <apic/>
Nov 15 09:37:01 user nova-compute[75122]:     <vmcoreinfo/>
Nov 15 09:37:01 user nova-compute[75122]:   </features>
Nov 15 09:37:01 user nova-compute[75122]:   <clock offset="utc">
Nov 15 09:37:01 user nova-compute[75122]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 09:37:01 user nova-compute[75122]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 09:37:01 user nova-compute[75122]:     <timer name="hpet" present="no"/>
Nov 15 09:37:01 user nova-compute[75122]:   </clock>
Nov 15 09:37:01 user nova-compute[75122]:   <cpu mode="custom" match="exact">
Nov 15 09:37:01 user nova-compute[75122]:     <model>Nehalem</model>
Nov 15 09:37:01 user nova-compute[75122]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 09:37:01 user nova-compute[75122]:   </cpu>
Nov 15 09:37:01 user nova-compute[75122]:   <devices>
Nov 15 09:37:01 user nova-compute[75122]:     <disk type="file" device="disk">
Nov 15 09:37:01 user nova-compute[75122]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 09:37:01 user nova-compute[75122]:       <source file="/opt/stack/data/nova/instances/fe0a6436-87c4-4826-a2f4-8d07c7fab59a/disk"/>
Nov 15 09:37:01 user nova-compute[75122]:       <target dev="vda" bus="virtio"/>
Nov 15 09:37:01 user nova-compute[75122]:     </disk>
Nov 15 09:37:01 user nova-compute[75122]:     <interface type="ethernet">
Nov 15 09:37:01 user nova-compute[75122]:       <mac address="fa:16:3e:ce:ac:dd"/>
Nov 15 09:37:01 user nova-compute[75122]:       <model type="virtio"/>
Nov 15 09:37:01 user nova-compute[75122]:       <mtu size="1442"/>
Nov 15 09:37:01 user nova-compute[75122]:       <target dev="tap80aa86de-4d"/>
Nov 15 09:37:01 user nova-compute[75122]:     </interface>
Nov 15 09:37:01 user nova-compute[75122]:     <serial type="pty">
Nov 15 09:37:01 user nova-compute[75122]:       <log file="/opt/stack/data/nova/instances/fe0a6436-87c4-4826-a2f4-8d07c7fab59a/console.log" append="off"/>
Nov 15 09:37:01 user nova-compute[75122]:     </serial>
Nov 15 09:37:01 user nova-compute[75122]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 09:37:01 user nova-compute[75122]:     <video>
Nov 15 09:37:01 user nova-compute[75122]:       <model type="virtio"/>
Nov 15 09:37:01 user nova-compute[75122]:     </video>
Nov 15 09:37:01 user nova-compute[75122]:     <rng model="virtio">
Nov 15 09:37:01 user nova-compute[75122]:       <backend model="random">/dev/urandom</backend>
Nov 15 09:37:01 user nova-compute[75122]:     </rng>
Nov 15 09:37:01 user nova-compute[75122]:     <controller type="usb" index="0" model="none"/>
Nov 15 09:37:01 user nova-compute[75122]:     <memballoon model="virtio">
Nov 15 09:37:01 user nova-compute[75122]:       <stats period="10"/>
Nov 15 09:37:01 user nova-compute[75122]:     </memballoon>
Nov 15 09:37:01 user nova-compute[75122]:   </devices>
Nov 15 09:37:01 user nova-compute[75122]: </domain>
Nov 15 09:37:01 user nova-compute[75122]:  {{(pid=75122) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 09:37:01 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-35ac78ab-0032-43fe-b000-e73f01f9265f tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T09:36:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-960828433',display_name='tempest-VolumesSnapshotTestJSON-instance-960828433',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-960828433',id=18,image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF7gCzYY2MSnm+KajBEGrPFU6EBcjWF4hOElMVD+RFTzhFjwaGpN0ruANY/LGZ8CyVaVi5Rs9LWmP+gAl6zX80LlYOoFgjM/x2foBgj5ztFjebn/8L3Fb6x6BIlBx3wvnQ==',key_name='tempest-keypair-1479237151',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ac8ea42f6a3446e8a8edcf3dcb016b84',ramdisk_id='',reservation_id='r-ctzmidsp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1852829755',owner_user_name='tempest-VolumesSnapshotTestJSON-1852829755-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T09:36:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7e5545ae1ca743d4ada8e28d28fca540',uuid=fe0a6436-87c4-4826-a2f4-8d07c7fab59a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "80aa86de-4dda-46e9-bb33-424ce423cf85", "address": "fa:16:3e:ce:ac:dd", "network": {"id": "cd74302c-bfd9-495b-887f-0de0d94f4ffc", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-692728798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac8ea42f6a3446e8a8edcf3dcb016b84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80aa86de-4d", "ovs_interfaceid": "80aa86de-4dda-46e9-bb33-424ce423cf85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 09:37:01 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-35ac78ab-0032-43fe-b000-e73f01f9265f tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Converting VIF {"id": "80aa86de-4dda-46e9-bb33-424ce423cf85", "address": "fa:16:3e:ce:ac:dd", "network": {"id": "cd74302c-bfd9-495b-887f-0de0d94f4ffc", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-692728798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac8ea42f6a3446e8a8edcf3dcb016b84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80aa86de-4d", "ovs_interfaceid": "80aa86de-4dda-46e9-bb33-424ce423cf85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 09:37:01 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-35ac78ab-0032-43fe-b000-e73f01f9265f tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:ac:dd,bridge_name='br-int',has_traffic_filtering=True,id=80aa86de-4dda-46e9-bb33-424ce423cf85,network=Network(cd74302c-bfd9-495b-887f-0de0d94f4ffc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80aa86de-4d') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 09:37:01 user nova-compute[75122]: DEBUG os_vif [None req-35ac78ab-0032-43fe-b000-e73f01f9265f tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:ac:dd,bridge_name='br-int',has_traffic_filtering=True,id=80aa86de-4dda-46e9-bb33-424ce423cf85,network=Network(cd74302c-bfd9-495b-887f-0de0d94f4ffc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80aa86de-4d') {{(pid=75122) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 09:37:01 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:37:01 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:37:01 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 09:37:01 user nova-compute[75122]: DEBUG nova.objects.instance [None req-19c31d49-a398-4d19-aec9-8eabf0794c94 tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] Lazy-loading 'flavor' on Instance uuid 1e19f9e1-69c6-4590-85d2-e90cbdbb3d80 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:37:01 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:37:01 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8cd52389-dcef-569f-a1b9-5d501343eca3', '_type': 'linux-noop'}}, row=False) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:37:01 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:37:01 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:37:01 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:37:01 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:37:01 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap80aa86de-4d, may_exist=True, interface_attrs={}) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:37:01 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap80aa86de-4d, col_values=(('qos', UUID('1e42c6e8-50bc-4af4-ba32-26cb2b99f7da')),), if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:37:01 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap80aa86de-4d, col_values=(('external_ids', {'iface-id': '80aa86de-4dda-46e9-bb33-424ce423cf85', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ce:ac:dd', 'vm-uuid': 'fe0a6436-87c4-4826-a2f4-8d07c7fab59a'}),), if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:37:01 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:37:01 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:37:01 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:37:01 user nova-compute[75122]: INFO os_vif [None req-35ac78ab-0032-43fe-b000-e73f01f9265f tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:ac:dd,bridge_name='br-int',has_traffic_filtering=True,id=80aa86de-4dda-46e9-bb33-424ce423cf85,network=Network(cd74302c-bfd9-495b-887f-0de0d94f4ffc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80aa86de-4d')
Nov 15 09:37:01 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-19c31d49-a398-4d19-aec9-8eabf0794c94 tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] Lock "1e19f9e1-69c6-4590-85d2-e90cbdbb3d80" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.076s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:37:01 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-35ac78ab-0032-43fe-b000-e73f01f9265f tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] No BDM found with device name vda, not building metadata. {{(pid=75122) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 09:37:01 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-35ac78ab-0032-43fe-b000-e73f01f9265f tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] No VIF found with MAC fa:16:3e:ce:ac:dd, not building metadata {{(pid=75122) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 09:37:01 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-19c31d49-a398-4d19-aec9-8eabf0794c94 tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] Acquiring lock "1e19f9e1-69c6-4590-85d2-e90cbdbb3d80" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:37:01 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-19c31d49-a398-4d19-aec9-8eabf0794c94 tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] Lock "1e19f9e1-69c6-4590-85d2-e90cbdbb3d80" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:37:01 user nova-compute[75122]: INFO nova.compute.manager [None req-19c31d49-a398-4d19-aec9-8eabf0794c94 tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] [instance: 1e19f9e1-69c6-4590-85d2-e90cbdbb3d80] Attaching volume 2a774235-5aba-4753-8407-7616ef6162ee to /dev/vdb
Nov 15 09:37:01 user nova-compute[75122]: DEBUG os_brick.utils [None req-19c31d49-a398-4d19-aec9-8eabf0794c94 tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 09:37:01 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:37:01 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:37:01 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0fd0128-5ca2-44cd-833a-e148b845c85c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:742fb64b3587\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:37:01 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:37:01 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:37:01 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc2a4d92-8091-4d23-bbc8-ae1319a70d67]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:37:01 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:37:01 user nova-compute[75122]: DEBUG nova.network.neutron [req-c8118351-a7d3-45cf-9f1e-fd8f30d6d967 req-ffd1c412-f3dd-4fea-8ae8-341365031a83 service nova] [instance: fe0a6436-87c4-4826-a2f4-8d07c7fab59a] Updated VIF entry in instance network info cache for port 80aa86de-4dda-46e9-bb33-424ce423cf85. {{(pid=75122) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 09:37:01 user nova-compute[75122]: DEBUG nova.network.neutron [req-c8118351-a7d3-45cf-9f1e-fd8f30d6d967 req-ffd1c412-f3dd-4fea-8ae8-341365031a83 service nova] [instance: fe0a6436-87c4-4826-a2f4-8d07c7fab59a] Updating instance_info_cache with network_info: [{"id": "80aa86de-4dda-46e9-bb33-424ce423cf85", "address": "fa:16:3e:ce:ac:dd", "network": {"id": "cd74302c-bfd9-495b-887f-0de0d94f4ffc", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-692728798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac8ea42f6a3446e8a8edcf3dcb016b84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80aa86de-4d", "ovs_interfaceid": "80aa86de-4dda-46e9-bb33-424ce423cf85", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:37:01 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-c8118351-a7d3-45cf-9f1e-fd8f30d6d967 req-ffd1c412-f3dd-4fea-8ae8-341365031a83 service nova] Releasing lock "refresh_cache-fe0a6436-87c4-4826-a2f4-8d07c7fab59a" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 09:37:01 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.079s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:37:01 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[1329556b-0b23-4da8-a129-4ca144137b99]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:37:01 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[2461afe5-7799-49e1-b568-34051e98af8e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:37:01 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-19c31d49-a398-4d19-aec9-8eabf0794c94 tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] Running cmd (subprocess): nvme version {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:37:01 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-19c31d49-a398-4d19-aec9-8eabf0794c94 tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] 'nvme version' failed. Not Retrying. {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 09:37:01 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.nvmeof [None req-19c31d49-a398-4d19-aec9-8eabf0794c94 tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] nvme not present on system {{(pid=75122) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 09:37:01 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:37:02 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 09:37:02 user nova-compute[75122]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 09:37:02 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[31e84f43-5f4a-4cb0-a57d-cb215536ac30]: (4, '') {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:37:02 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.lightos [None req-19c31d49-a398-4d19-aec9-8eabf0794c94 tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75122) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 09:37:02 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.lightos [None req-19c31d49-a398-4d19-aec9-8eabf0794c94 tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75122) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 09:37:02 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.lightos [None req-19c31d49-a398-4d19-aec9-8eabf0794c94 tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] LIGHTOS: no hostnqn found. {{(pid=75122) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 09:37:02 user nova-compute[75122]: DEBUG os_brick.utils [None req-19c31d49-a398-4d19-aec9-8eabf0794c94 tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] <== get_connector_properties: return (205ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:742fb64b3587', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 09:37:02 user nova-compute[75122]: DEBUG nova.virt.block_device [None req-19c31d49-a398-4d19-aec9-8eabf0794c94 tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] [instance: 1e19f9e1-69c6-4590-85d2-e90cbdbb3d80] Updating existing volume attachment record: db534a90-cc28-4419-82da-256b01353d9a {{(pid=75122) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 09:37:02 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:37:02 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:37:02 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:37:03 user nova-compute[75122]: DEBUG nova.compute.manager [req-0e6730fa-1fda-4086-8a96-695bab29b0cb req-97a60647-0960-404e-971a-275323b180e3 service nova] [instance: fe0a6436-87c4-4826-a2f4-8d07c7fab59a] Received event network-vif-plugged-80aa86de-4dda-46e9-bb33-424ce423cf85 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:37:03 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-0e6730fa-1fda-4086-8a96-695bab29b0cb req-97a60647-0960-404e-971a-275323b180e3 service nova] Acquiring lock "fe0a6436-87c4-4826-a2f4-8d07c7fab59a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:37:03 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-0e6730fa-1fda-4086-8a96-695bab29b0cb req-97a60647-0960-404e-971a-275323b180e3 service nova] Lock "fe0a6436-87c4-4826-a2f4-8d07c7fab59a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:37:03 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-0e6730fa-1fda-4086-8a96-695bab29b0cb req-97a60647-0960-404e-971a-275323b180e3 service nova] Lock "fe0a6436-87c4-4826-a2f4-8d07c7fab59a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:37:03 user nova-compute[75122]: DEBUG nova.compute.manager [req-0e6730fa-1fda-4086-8a96-695bab29b0cb req-97a60647-0960-404e-971a-275323b180e3 service nova] [instance: fe0a6436-87c4-4826-a2f4-8d07c7fab59a] No waiting events found dispatching network-vif-plugged-80aa86de-4dda-46e9-bb33-424ce423cf85 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:37:03 user nova-compute[75122]: WARNING nova.compute.manager [req-0e6730fa-1fda-4086-8a96-695bab29b0cb req-97a60647-0960-404e-971a-275323b180e3 service nova] [instance: fe0a6436-87c4-4826-a2f4-8d07c7fab59a] Received unexpected event network-vif-plugged-80aa86de-4dda-46e9-bb33-424ce423cf85 for instance with vm_state building and task_state spawning.
Nov 15 09:37:03 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:37:03 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:37:03 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:37:05 user nova-compute[75122]: INFO nova.compute.manager [None req-17ac09bb-1497-4292-993f-c8fbdfa0e3e5 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] [instance: 00270cc2-4f5b-4f64-8f88-31f21e3b3950] Rescuing
Nov 15 09:37:05 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-17ac09bb-1497-4292-993f-c8fbdfa0e3e5 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Acquiring lock "refresh_cache-00270cc2-4f5b-4f64-8f88-31f21e3b3950" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 09:37:05 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-17ac09bb-1497-4292-993f-c8fbdfa0e3e5 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Acquired lock "refresh_cache-00270cc2-4f5b-4f64-8f88-31f21e3b3950" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 09:37:05 user nova-compute[75122]: DEBUG nova.network.neutron [None req-17ac09bb-1497-4292-993f-c8fbdfa0e3e5 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] [instance: 00270cc2-4f5b-4f64-8f88-31f21e3b3950] Building network info cache for instance {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 09:37:05 user nova-compute[75122]: DEBUG nova.compute.manager [None req-35ac78ab-0032-43fe-b000-e73f01f9265f tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] [instance: fe0a6436-87c4-4826-a2f4-8d07c7fab59a] Instance event wait completed in 0 seconds for  {{(pid=75122) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 09:37:05 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-35ac78ab-0032-43fe-b000-e73f01f9265f tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] [instance: fe0a6436-87c4-4826-a2f4-8d07c7fab59a] Guest created on hypervisor {{(pid=75122) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 09:37:05 user nova-compute[75122]: INFO nova.virt.libvirt.driver [-] [instance: fe0a6436-87c4-4826-a2f4-8d07c7fab59a] Instance spawned successfully.
Nov 15 09:37:05 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-35ac78ab-0032-43fe-b000-e73f01f9265f tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] [instance: fe0a6436-87c4-4826-a2f4-8d07c7fab59a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 09:37:05 user nova-compute[75122]: DEBUG nova.compute.manager [req-e1ba75ac-e6ed-4459-9a20-e856d3262667 req-6e3810b8-2cb7-444b-bcae-f212feed905c service nova] [instance: fe0a6436-87c4-4826-a2f4-8d07c7fab59a] Received event network-vif-plugged-80aa86de-4dda-46e9-bb33-424ce423cf85 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:37:05 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-e1ba75ac-e6ed-4459-9a20-e856d3262667 req-6e3810b8-2cb7-444b-bcae-f212feed905c service nova] Acquiring lock "fe0a6436-87c4-4826-a2f4-8d07c7fab59a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:37:05 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-e1ba75ac-e6ed-4459-9a20-e856d3262667 req-6e3810b8-2cb7-444b-bcae-f212feed905c service nova] Lock "fe0a6436-87c4-4826-a2f4-8d07c7fab59a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:37:05 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-e1ba75ac-e6ed-4459-9a20-e856d3262667 req-6e3810b8-2cb7-444b-bcae-f212feed905c service nova] Lock "fe0a6436-87c4-4826-a2f4-8d07c7fab59a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:37:05 user nova-compute[75122]: DEBUG nova.compute.manager [req-e1ba75ac-e6ed-4459-9a20-e856d3262667 req-6e3810b8-2cb7-444b-bcae-f212feed905c service nova] [instance: fe0a6436-87c4-4826-a2f4-8d07c7fab59a] No waiting events found dispatching network-vif-plugged-80aa86de-4dda-46e9-bb33-424ce423cf85 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:37:05 user nova-compute[75122]: WARNING nova.compute.manager [req-e1ba75ac-e6ed-4459-9a20-e856d3262667 req-6e3810b8-2cb7-444b-bcae-f212feed905c service nova] [instance: fe0a6436-87c4-4826-a2f4-8d07c7fab59a] Received unexpected event network-vif-plugged-80aa86de-4dda-46e9-bb33-424ce423cf85 for instance with vm_state building and task_state spawning.
Nov 15 09:37:05 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-35ac78ab-0032-43fe-b000-e73f01f9265f tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] [instance: fe0a6436-87c4-4826-a2f4-8d07c7fab59a] Found default for hw_cdrom_bus of ide {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:37:05 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-35ac78ab-0032-43fe-b000-e73f01f9265f tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] [instance: fe0a6436-87c4-4826-a2f4-8d07c7fab59a] Found default for hw_disk_bus of virtio {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:37:05 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-35ac78ab-0032-43fe-b000-e73f01f9265f tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] [instance: fe0a6436-87c4-4826-a2f4-8d07c7fab59a] Found default for hw_input_bus of None {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:37:05 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-35ac78ab-0032-43fe-b000-e73f01f9265f tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] [instance: fe0a6436-87c4-4826-a2f4-8d07c7fab59a] Found default for hw_pointer_model of None {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:37:05 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-35ac78ab-0032-43fe-b000-e73f01f9265f tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] [instance: fe0a6436-87c4-4826-a2f4-8d07c7fab59a] Found default for hw_video_model of virtio {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:37:05 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-35ac78ab-0032-43fe-b000-e73f01f9265f tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] [instance: fe0a6436-87c4-4826-a2f4-8d07c7fab59a] Found default for hw_vif_model of virtio {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:37:05 user nova-compute[75122]: INFO nova.compute.manager [None req-35ac78ab-0032-43fe-b000-e73f01f9265f tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] [instance: fe0a6436-87c4-4826-a2f4-8d07c7fab59a] Took 5.82 seconds to spawn the instance on the hypervisor.
Nov 15 09:37:05 user nova-compute[75122]: DEBUG nova.compute.manager [None req-35ac78ab-0032-43fe-b000-e73f01f9265f tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] [instance: fe0a6436-87c4-4826-a2f4-8d07c7fab59a] Checking state {{(pid=75122) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 09:37:05 user nova-compute[75122]: INFO nova.compute.manager [None req-35ac78ab-0032-43fe-b000-e73f01f9265f tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] [instance: fe0a6436-87c4-4826-a2f4-8d07c7fab59a] Took 6.60 seconds to build instance.
Nov 15 09:37:05 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-35ac78ab-0032-43fe-b000-e73f01f9265f tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Lock "fe0a6436-87c4-4826-a2f4-8d07c7fab59a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.926s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:37:05 user nova-compute[75122]: DEBUG nova.network.neutron [None req-17ac09bb-1497-4292-993f-c8fbdfa0e3e5 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] [instance: 00270cc2-4f5b-4f64-8f88-31f21e3b3950] Updating instance_info_cache with network_info: [{"id": "bb6552dc-ebef-427a-beea-b41083f05e70", "address": "fa:16:3e:44:9c:f9", "network": {"id": "c2062f64-d925-42d2-9687-5d2511ef6697", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1134087048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eeff24cb28f5481fa3941ba399ce82ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb6552dc-eb", "ovs_interfaceid": "bb6552dc-ebef-427a-beea-b41083f05e70", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:37:05 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-17ac09bb-1497-4292-993f-c8fbdfa0e3e5 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Releasing lock "refresh_cache-00270cc2-4f5b-4f64-8f88-31f21e3b3950" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 09:37:05 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:37:05 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:37:05 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:37:05 user nova-compute[75122]: DEBUG nova.compute.manager [req-7de75a36-ef3a-410f-be1f-9f1dc971ec00 req-f3a6d09c-1a1d-44c1-9fbc-fbb152ff5f46 service nova] [instance: 00270cc2-4f5b-4f64-8f88-31f21e3b3950] Received event network-vif-unplugged-bb6552dc-ebef-427a-beea-b41083f05e70 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:37:05 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-7de75a36-ef3a-410f-be1f-9f1dc971ec00 req-f3a6d09c-1a1d-44c1-9fbc-fbb152ff5f46 service nova] Acquiring lock "00270cc2-4f5b-4f64-8f88-31f21e3b3950-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:37:05 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-7de75a36-ef3a-410f-be1f-9f1dc971ec00 req-f3a6d09c-1a1d-44c1-9fbc-fbb152ff5f46 service nova] Lock "00270cc2-4f5b-4f64-8f88-31f21e3b3950-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:37:05 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-7de75a36-ef3a-410f-be1f-9f1dc971ec00 req-f3a6d09c-1a1d-44c1-9fbc-fbb152ff5f46 service nova] Lock "00270cc2-4f5b-4f64-8f88-31f21e3b3950-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:37:05 user nova-compute[75122]: DEBUG nova.compute.manager [req-7de75a36-ef3a-410f-be1f-9f1dc971ec00 req-f3a6d09c-1a1d-44c1-9fbc-fbb152ff5f46 service nova] [instance: 00270cc2-4f5b-4f64-8f88-31f21e3b3950] No waiting events found dispatching network-vif-unplugged-bb6552dc-ebef-427a-beea-b41083f05e70 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:37:05 user nova-compute[75122]: WARNING nova.compute.manager [req-7de75a36-ef3a-410f-be1f-9f1dc971ec00 req-f3a6d09c-1a1d-44c1-9fbc-fbb152ff5f46 service nova] [instance: 00270cc2-4f5b-4f64-8f88-31f21e3b3950] Received unexpected event network-vif-unplugged-bb6552dc-ebef-427a-beea-b41083f05e70 for instance with vm_state active and task_state rescuing.
Nov 15 09:37:06 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:37:06 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:37:06 user nova-compute[75122]: INFO nova.virt.libvirt.driver [-] [instance: 00270cc2-4f5b-4f64-8f88-31f21e3b3950] Instance destroyed successfully.
Nov 15 09:37:06 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-17ac09bb-1497-4292-993f-c8fbdfa0e3e5 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] [instance: 00270cc2-4f5b-4f64-8f88-31f21e3b3950] Attempting rescue
Nov 15 09:37:06 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-17ac09bb-1497-4292-993f-c8fbdfa0e3e5 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75122) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 15 09:37:06 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-17ac09bb-1497-4292-993f-c8fbdfa0e3e5 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] [instance: 00270cc2-4f5b-4f64-8f88-31f21e3b3950] Instance directory exists: not creating {{(pid=75122) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 15 09:37:06 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-17ac09bb-1497-4292-993f-c8fbdfa0e3e5 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] [instance: 00270cc2-4f5b-4f64-8f88-31f21e3b3950] Creating image(s)
Nov 15 09:37:06 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-17ac09bb-1497-4292-993f-c8fbdfa0e3e5 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Acquiring lock "/opt/stack/data/nova/instances/00270cc2-4f5b-4f64-8f88-31f21e3b3950/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:37:06 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-17ac09bb-1497-4292-993f-c8fbdfa0e3e5 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Lock "/opt/stack/data/nova/instances/00270cc2-4f5b-4f64-8f88-31f21e3b3950/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:37:06 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-17ac09bb-1497-4292-993f-c8fbdfa0e3e5 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Lock "/opt/stack/data/nova/instances/00270cc2-4f5b-4f64-8f88-31f21e3b3950/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.050s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:37:06 user nova-compute[75122]: DEBUG nova.objects.instance [None req-17ac09bb-1497-4292-993f-c8fbdfa0e3e5 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Lazy-loading 'trusted_certs' on Instance uuid 00270cc2-4f5b-4f64-8f88-31f21e3b3950 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:37:06 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-17ac09bb-1497-4292-993f-c8fbdfa0e3e5 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Acquiring lock "95d6e29f74d5408f818e32f3bc29bc8270a4c665" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:37:06 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-17ac09bb-1497-4292-993f-c8fbdfa0e3e5 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Lock "95d6e29f74d5408f818e32f3bc29bc8270a4c665" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:37:06 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-17ac09bb-1497-4292-993f-c8fbdfa0e3e5 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:37:06 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:37:06 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-17ac09bb-1497-4292-993f-c8fbdfa0e3e5 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json" returned: 0 in 0.181s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:37:06 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-17ac09bb-1497-4292-993f-c8fbdfa0e3e5 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665,backing_fmt=raw /opt/stack/data/nova/instances/00270cc2-4f5b-4f64-8f88-31f21e3b3950/disk.rescue {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:37:06 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-17ac09bb-1497-4292-993f-c8fbdfa0e3e5 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665,backing_fmt=raw /opt/stack/data/nova/instances/00270cc2-4f5b-4f64-8f88-31f21e3b3950/disk.rescue" returned: 0 in 0.046s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:37:06 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-17ac09bb-1497-4292-993f-c8fbdfa0e3e5 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Lock "95d6e29f74d5408f818e32f3bc29bc8270a4c665" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.233s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:37:06 user nova-compute[75122]: DEBUG nova.objects.instance [None req-17ac09bb-1497-4292-993f-c8fbdfa0e3e5 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Lazy-loading 'migration_context' on Instance uuid 00270cc2-4f5b-4f64-8f88-31f21e3b3950 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:37:06 user nova-compute[75122]: DEBUG nova.objects.base [None req-17ac09bb-1497-4292-993f-c8fbdfa0e3e5 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Object Instance<00270cc2-4f5b-4f64-8f88-31f21e3b3950> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75122) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 09:37:06 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-17ac09bb-1497-4292-993f-c8fbdfa0e3e5 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] [instance: 00270cc2-4f5b-4f64-8f88-31f21e3b3950] Created local disks {{(pid=75122) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 09:37:06 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-17ac09bb-1497-4292-993f-c8fbdfa0e3e5 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] [instance: 00270cc2-4f5b-4f64-8f88-31f21e3b3950] Start _get_guest_xml network_info=[{"id": "bb6552dc-ebef-427a-beea-b41083f05e70", "address": "fa:16:3e:44:9c:f9", "network": {"id": "c2062f64-d925-42d2-9687-5d2511ef6697", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1134087048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1134087048-network", "vif_mac": "fa:16:3e:44:9c:f9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eeff24cb28f5481fa3941ba399ce82ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb6552dc-eb", "ovs_interfaceid": "bb6552dc-ebef-427a-beea-b41083f05e70", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T09:26:31Z,direct_url=<?>,disk_format='qcow2',id=5e862cfe-47b8-4725-8292-65761ee6d0f5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9c57733cb41847c0b4ad31519c382e5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T09:26:33Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '5e862cfe-47b8-4725-8292-65761ee6d0f5', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75122) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 09:37:06 user nova-compute[75122]: DEBUG nova.objects.instance [None req-17ac09bb-1497-4292-993f-c8fbdfa0e3e5 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Lazy-loading 'resources' on Instance uuid 00270cc2-4f5b-4f64-8f88-31f21e3b3950 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:37:06 user nova-compute[75122]: DEBUG nova.objects.base [None req-17ac09bb-1497-4292-993f-c8fbdfa0e3e5 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Object Instance<00270cc2-4f5b-4f64-8f88-31f21e3b3950> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75122) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 09:37:06 user nova-compute[75122]: DEBUG nova.objects.instance [None req-17ac09bb-1497-4292-993f-c8fbdfa0e3e5 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Lazy-loading 'numa_topology' on Instance uuid 00270cc2-4f5b-4f64-8f88-31f21e3b3950 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:37:06 user nova-compute[75122]: DEBUG nova.objects.base [None req-17ac09bb-1497-4292-993f-c8fbdfa0e3e5 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Object Instance<00270cc2-4f5b-4f64-8f88-31f21e3b3950> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75122) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 09:37:06 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-17ac09bb-1497-4292-993f-c8fbdfa0e3e5 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 09:37:06 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-17ac09bb-1497-4292-993f-c8fbdfa0e3e5 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 09:37:06 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-17ac09bb-1497-4292-993f-c8fbdfa0e3e5 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75122) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 09:37:06 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-17ac09bb-1497-4292-993f-c8fbdfa0e3e5 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] CPU controller missing on host. {{(pid=75122) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 09:37:06 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-17ac09bb-1497-4292-993f-c8fbdfa0e3e5 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75122) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 09:37:06 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-17ac09bb-1497-4292-993f-c8fbdfa0e3e5 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] CPU controller found on host. {{(pid=75122) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 09:37:06 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-17ac09bb-1497-4292-993f-c8fbdfa0e3e5 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75122) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 09:37:06 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-17ac09bb-1497-4292-993f-c8fbdfa0e3e5 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T09:26:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T09:26:31Z,direct_url=<?>,disk_format='qcow2',id=5e862cfe-47b8-4725-8292-65761ee6d0f5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9c57733cb41847c0b4ad31519c382e5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T09:26:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 09:37:06 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-17ac09bb-1497-4292-993f-c8fbdfa0e3e5 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Flavor limits 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 09:37:06 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-17ac09bb-1497-4292-993f-c8fbdfa0e3e5 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Image limits 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 09:37:06 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-17ac09bb-1497-4292-993f-c8fbdfa0e3e5 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Flavor pref 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 09:37:06 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-17ac09bb-1497-4292-993f-c8fbdfa0e3e5 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Image pref 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 09:37:06 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-17ac09bb-1497-4292-993f-c8fbdfa0e3e5 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 09:37:06 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-17ac09bb-1497-4292-993f-c8fbdfa0e3e5 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 09:37:06 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-17ac09bb-1497-4292-993f-c8fbdfa0e3e5 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75122) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 09:37:06 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-17ac09bb-1497-4292-993f-c8fbdfa0e3e5 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Got 1 possible topologies {{(pid=75122) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 09:37:06 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-17ac09bb-1497-4292-993f-c8fbdfa0e3e5 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 09:37:06 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-17ac09bb-1497-4292-993f-c8fbdfa0e3e5 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 09:37:06 user nova-compute[75122]: DEBUG nova.objects.instance [None req-17ac09bb-1497-4292-993f-c8fbdfa0e3e5 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Lazy-loading 'vcpu_model' on Instance uuid 00270cc2-4f5b-4f64-8f88-31f21e3b3950 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:37:06 user nova-compute[75122]: DEBUG nova.objects.base [None req-17ac09bb-1497-4292-993f-c8fbdfa0e3e5 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Object Instance<00270cc2-4f5b-4f64-8f88-31f21e3b3950> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75122) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 09:37:06 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-17ac09bb-1497-4292-993f-c8fbdfa0e3e5 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T09:35:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1776429290',display_name='tempest-ServerRescueNegativeTestJSON-server-1776429290',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1776429290',id=17,image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T09:35:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='eeff24cb28f5481fa3941ba399ce82ff',ramdisk_id='',reservation_id='r-rom8e8vs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-59965354',owner_user_name='tempest-ServerRescueNegativeTestJSON-59965354-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T09:35:25Z,user_data=None,user_id='d05ef35b07ba45afb142f406d418d8d4',uuid=00270cc2-4f5b-4f64-8f88-31f21e3b3950,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bb6552dc-ebef-427a-beea-b41083f05e70", "address": "fa:16:3e:44:9c:f9", "network": {"id": "c2062f64-d925-42d2-9687-5d2511ef6697", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1134087048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1134087048-network", "vif_mac": "fa:16:3e:44:9c:f9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eeff24cb28f5481fa3941ba399ce82ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb6552dc-eb", "ovs_interfaceid": "bb6552dc-ebef-427a-beea-b41083f05e70", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75122) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 09:37:06 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-17ac09bb-1497-4292-993f-c8fbdfa0e3e5 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Converting VIF {"id": "bb6552dc-ebef-427a-beea-b41083f05e70", "address": "fa:16:3e:44:9c:f9", "network": {"id": "c2062f64-d925-42d2-9687-5d2511ef6697", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1134087048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1134087048-network", "vif_mac": "fa:16:3e:44:9c:f9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eeff24cb28f5481fa3941ba399ce82ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb6552dc-eb", "ovs_interfaceid": "bb6552dc-ebef-427a-beea-b41083f05e70", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 09:37:06 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-17ac09bb-1497-4292-993f-c8fbdfa0e3e5 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:44:9c:f9,bridge_name='br-int',has_traffic_filtering=True,id=bb6552dc-ebef-427a-beea-b41083f05e70,network=Network(c2062f64-d925-42d2-9687-5d2511ef6697),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb6552dc-eb') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 09:37:06 user nova-compute[75122]: DEBUG nova.objects.instance [None req-17ac09bb-1497-4292-993f-c8fbdfa0e3e5 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Lazy-loading 'pci_devices' on Instance uuid 00270cc2-4f5b-4f64-8f88-31f21e3b3950 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:37:06 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-19c31d49-a398-4d19-aec9-8eabf0794c94 tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] [instance: 1e19f9e1-69c6-4590-85d2-e90cbdbb3d80] Calling os-brick to attach iSCSI Volume {{(pid=75122) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 09:37:06 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-19c31d49-a398-4d19-aec9-8eabf0794c94 tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffa04060b80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2a774235-5aba-4753-8407-7616ef6162ee', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fuRHUWjh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 09:37:06 user nova-compute[75122]: WARNING os_brick.initiator.connectors.base [None req-19c31d49-a398-4d19-aec9-8eabf0794c94 tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 09:37:06 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-19c31d49-a398-4d19-aec9-8eabf0794c94 tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 09:37:06 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-19c31d49-a398-4d19-aec9-8eabf0794c94 tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 09:37:06 user nova-compute[75122]: WARNING os_brick.initiator.connectors.base [None req-19c31d49-a398-4d19-aec9-8eabf0794c94 tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 09:37:06 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-19c31d49-a398-4d19-aec9-8eabf0794c94 tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2a774235-5aba-4753-8407-7616ef6162ee" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 09:37:06 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-19c31d49-a398-4d19-aec9-8eabf0794c94 tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2a774235-5aba-4753-8407-7616ef6162ee" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 09:37:06 user nova-compute[75122]: INFO os_brick.initiator.connectors.iscsi [None req-19c31d49-a398-4d19-aec9-8eabf0794c94 tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 09:37:06 user nova-compute[75122]: DEBUG nova.objects.base [None req-17ac09bb-1497-4292-993f-c8fbdfa0e3e5 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Object Instance<00270cc2-4f5b-4f64-8f88-31f21e3b3950> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75122) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 09:37:06 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-17ac09bb-1497-4292-993f-c8fbdfa0e3e5 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] [instance: 00270cc2-4f5b-4f64-8f88-31f21e3b3950] End _get_guest_xml xml=<domain type="kvm">
Nov 15 09:37:06 user nova-compute[75122]:   <uuid>00270cc2-4f5b-4f64-8f88-31f21e3b3950</uuid>
Nov 15 09:37:06 user nova-compute[75122]:   <name>instance-00000011</name>
Nov 15 09:37:06 user nova-compute[75122]:   <memory>524288</memory>
Nov 15 09:37:06 user nova-compute[75122]:   <vcpu>1</vcpu>
Nov 15 09:37:06 user nova-compute[75122]:   <metadata>
Nov 15 09:37:06 user nova-compute[75122]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 09:37:06 user nova-compute[75122]:       <nova:package version="0.0.0"/>
Nov 15 09:37:06 user nova-compute[75122]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1776429290</nova:name>
Nov 15 09:37:06 user nova-compute[75122]:       <nova:creationTime>2023-11-15 09:37:06</nova:creationTime>
Nov 15 09:37:06 user nova-compute[75122]:       <nova:flavor name="m1.tiny">
Nov 15 09:37:06 user nova-compute[75122]:         <nova:memory>512</nova:memory>
Nov 15 09:37:06 user nova-compute[75122]:         <nova:disk>1</nova:disk>
Nov 15 09:37:06 user nova-compute[75122]:         <nova:swap>0</nova:swap>
Nov 15 09:37:06 user nova-compute[75122]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 09:37:06 user nova-compute[75122]:         <nova:vcpus>1</nova:vcpus>
Nov 15 09:37:06 user nova-compute[75122]:       </nova:flavor>
Nov 15 09:37:06 user nova-compute[75122]:       <nova:owner>
Nov 15 09:37:06 user nova-compute[75122]:         <nova:user uuid="d05ef35b07ba45afb142f406d418d8d4">tempest-ServerRescueNegativeTestJSON-59965354-project-member</nova:user>
Nov 15 09:37:06 user nova-compute[75122]:         <nova:project uuid="eeff24cb28f5481fa3941ba399ce82ff">tempest-ServerRescueNegativeTestJSON-59965354</nova:project>
Nov 15 09:37:06 user nova-compute[75122]:       </nova:owner>
Nov 15 09:37:06 user nova-compute[75122]:       <nova:root type="image" uuid="5e862cfe-47b8-4725-8292-65761ee6d0f5"/>
Nov 15 09:37:06 user nova-compute[75122]:       <nova:ports>
Nov 15 09:37:06 user nova-compute[75122]:         <nova:port uuid="bb6552dc-ebef-427a-beea-b41083f05e70">
Nov 15 09:37:06 user nova-compute[75122]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 15 09:37:06 user nova-compute[75122]:         </nova:port>
Nov 15 09:37:06 user nova-compute[75122]:       </nova:ports>
Nov 15 09:37:06 user nova-compute[75122]:     </nova:instance>
Nov 15 09:37:06 user nova-compute[75122]:   </metadata>
Nov 15 09:37:06 user nova-compute[75122]:   <sysinfo type="smbios">
Nov 15 09:37:06 user nova-compute[75122]:     <system>
Nov 15 09:37:06 user nova-compute[75122]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 09:37:06 user nova-compute[75122]:       <entry name="product">OpenStack Nova</entry>
Nov 15 09:37:06 user nova-compute[75122]:       <entry name="version">0.0.0</entry>
Nov 15 09:37:06 user nova-compute[75122]:       <entry name="serial">00270cc2-4f5b-4f64-8f88-31f21e3b3950</entry>
Nov 15 09:37:06 user nova-compute[75122]:       <entry name="uuid">00270cc2-4f5b-4f64-8f88-31f21e3b3950</entry>
Nov 15 09:37:06 user nova-compute[75122]:       <entry name="family">Virtual Machine</entry>
Nov 15 09:37:06 user nova-compute[75122]:     </system>
Nov 15 09:37:06 user nova-compute[75122]:   </sysinfo>
Nov 15 09:37:06 user nova-compute[75122]:   <os>
Nov 15 09:37:06 user nova-compute[75122]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 09:37:06 user nova-compute[75122]:     <smbios mode="sysinfo"/>
Nov 15 09:37:06 user nova-compute[75122]:   </os>
Nov 15 09:37:06 user nova-compute[75122]:   <features>
Nov 15 09:37:06 user nova-compute[75122]:     <acpi/>
Nov 15 09:37:06 user nova-compute[75122]:     <apic/>
Nov 15 09:37:06 user nova-compute[75122]:     <vmcoreinfo/>
Nov 15 09:37:06 user nova-compute[75122]:   </features>
Nov 15 09:37:06 user nova-compute[75122]:   <clock offset="utc">
Nov 15 09:37:06 user nova-compute[75122]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 09:37:06 user nova-compute[75122]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 09:37:06 user nova-compute[75122]:     <timer name="hpet" present="no"/>
Nov 15 09:37:06 user nova-compute[75122]:   </clock>
Nov 15 09:37:06 user nova-compute[75122]:   <cpu mode="custom" match="exact">
Nov 15 09:37:06 user nova-compute[75122]:     <model>Nehalem</model>
Nov 15 09:37:06 user nova-compute[75122]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 09:37:06 user nova-compute[75122]:   </cpu>
Nov 15 09:37:06 user nova-compute[75122]:   <devices>
Nov 15 09:37:06 user nova-compute[75122]:     <disk type="file" device="disk">
Nov 15 09:37:06 user nova-compute[75122]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 09:37:06 user nova-compute[75122]:       <source file="/opt/stack/data/nova/instances/00270cc2-4f5b-4f64-8f88-31f21e3b3950/disk.rescue"/>
Nov 15 09:37:06 user nova-compute[75122]:       <target dev="vda" bus="virtio"/>
Nov 15 09:37:06 user nova-compute[75122]:     </disk>
Nov 15 09:37:06 user nova-compute[75122]:     <disk type="file" device="disk">
Nov 15 09:37:06 user nova-compute[75122]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 09:37:06 user nova-compute[75122]:       <source file="/opt/stack/data/nova/instances/00270cc2-4f5b-4f64-8f88-31f21e3b3950/disk"/>
Nov 15 09:37:06 user nova-compute[75122]:       <target dev="vdb" bus="virtio"/>
Nov 15 09:37:06 user nova-compute[75122]:     </disk>
Nov 15 09:37:06 user nova-compute[75122]:     <interface type="ethernet">
Nov 15 09:37:06 user nova-compute[75122]:       <mac address="fa:16:3e:44:9c:f9"/>
Nov 15 09:37:06 user nova-compute[75122]:       <model type="virtio"/>
Nov 15 09:37:06 user nova-compute[75122]:       <mtu size="1442"/>
Nov 15 09:37:06 user nova-compute[75122]:       <target dev="tapbb6552dc-eb"/>
Nov 15 09:37:06 user nova-compute[75122]:     </interface>
Nov 15 09:37:06 user nova-compute[75122]:     <serial type="pty">
Nov 15 09:37:06 user nova-compute[75122]:       <log file="/opt/stack/data/nova/instances/00270cc2-4f5b-4f64-8f88-31f21e3b3950/console.log" append="off"/>
Nov 15 09:37:06 user nova-compute[75122]:     </serial>
Nov 15 09:37:06 user nova-compute[75122]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 09:37:06 user nova-compute[75122]:     <video>
Nov 15 09:37:06 user nova-compute[75122]:       <model type="virtio"/>
Nov 15 09:37:06 user nova-compute[75122]:     </video>
Nov 15 09:37:06 user nova-compute[75122]:     <rng model="virtio">
Nov 15 09:37:06 user nova-compute[75122]:       <backend model="random">/dev/urandom</backend>
Nov 15 09:37:06 user nova-compute[75122]:     </rng>
Nov 15 09:37:06 user nova-compute[75122]:     <controller type="usb" index="0" model="none"/>
Nov 15 09:37:06 user nova-compute[75122]:     <memballoon model="virtio">
Nov 15 09:37:06 user nova-compute[75122]:       <stats period="10"/>
Nov 15 09:37:06 user nova-compute[75122]:     </memballoon>
Nov 15 09:37:06 user nova-compute[75122]:   </devices>
Nov 15 09:37:06 user nova-compute[75122]: </domain>
Nov 15 09:37:06 user nova-compute[75122]:  {{(pid=75122) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 09:37:06 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a774235-5aba-4753-8407-7616ef6162ee -p 172.16.0.220:3260 {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:37:06 user nova-compute[75122]: INFO nova.virt.libvirt.driver [-] [instance: 00270cc2-4f5b-4f64-8f88-31f21e3b3950] Instance destroyed successfully.
Nov 15 09:37:06 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a774235-5aba-4753-8407-7616ef6162ee -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:37:06 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[658d6423-b6a8-44f8-8724-ba5dbdb090db]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:37:06 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-19c31d49-a398-4d19-aec9-8eabf0794c94 tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 09:37:06 user nova-compute[75122]:  {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:37:06 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a774235-5aba-4753-8407-7616ef6162ee -p 172.16.0.220:3260 --interface default --op new {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:37:06 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a774235-5aba-4753-8407-7616ef6162ee -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.034s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:37:06 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[085c8849-19df-4cf2-b6bc-8d1df2689a29]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2a774235-5aba-4753-8407-7616ef6162ee] added\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:37:06 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-19c31d49-a398-4d19-aec9-8eabf0794c94 tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2a774235-5aba-4753-8407-7616ef6162ee] added
Nov 15 09:37:06 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:37:06 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a774235-5aba-4753-8407-7616ef6162ee -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:37:06 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a774235-5aba-4753-8407-7616ef6162ee -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:37:06 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[58a70afe-691a-405f-b543-7a05b777bda0]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:37:06 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-19c31d49-a398-4d19-aec9-8eabf0794c94 tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:37:06 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a774235-5aba-4753-8407-7616ef6162ee -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:37:07 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-17ac09bb-1497-4292-993f-c8fbdfa0e3e5 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] No BDM found with device name vda, not building metadata. {{(pid=75122) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 09:37:07 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-17ac09bb-1497-4292-993f-c8fbdfa0e3e5 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75122) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 09:37:07 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-17ac09bb-1497-4292-993f-c8fbdfa0e3e5 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] No VIF found with MAC fa:16:3e:44:9c:f9, not building metadata {{(pid=75122) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 09:37:07 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a774235-5aba-4753-8407-7616ef6162ee -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:37:07 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbe3d474-2e9e-4e88-abe8-3eb0e6598736]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:37:07 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-19c31d49-a398-4d19-aec9-8eabf0794c94 tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:37:07 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a774235-5aba-4753-8407-7616ef6162ee -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fuRHUWjh {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:37:07 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a774235-5aba-4753-8407-7616ef6162ee -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fuRHUWjh" returned: 0 in 0.020s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:37:07 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[412ada82-cef5-4e74-afa7-9da837d5b8f9]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:37:07 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-19c31d49-a398-4d19-aec9-8eabf0794c94 tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fuRHUWjh'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:37:07 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a774235-5aba-4753-8407-7616ef6162ee -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:37:07 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a774235-5aba-4753-8407-7616ef6162ee -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:37:07 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[b88cd341-8f9d-4c58-b650-8dcc0088ee86]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:37:07 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-19c31d49-a398-4d19-aec9-8eabf0794c94 tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:37:07 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:37:07 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:37:07 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[09715298-4ccb-4189-8c4e-8095e07f3e29]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7524fa0e-0e0f-4da0-bd00-7f099a8a55e8 (non-flash)\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:37:07 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-19c31d49-a398-4d19-aec9-8eabf0794c94 tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16 (non-flash)
Nov 15 09:37:07 user nova-compute[75122]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7524fa0e-0e0f-4da0-bd00-7f099a8a55e8 (non-flash)
Nov 15 09:37:07 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 09:37:07 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-19c31d49-a398-4d19-aec9-8eabf0794c94 tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16 (non-flash)
Nov 15 09:37:07 user nova-compute[75122]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7524fa0e-0e0f-4da0-bd00-7f099a8a55e8 (non-flash)
Nov 15 09:37:07 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 09:37:07 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a774235-5aba-4753-8407-7616ef6162ee -p 172.16.0.220:3260 --login {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:37:07 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a774235-5aba-4753-8407-7616ef6162ee -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:37:07 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[28100f43-2219-410d-9d7a-aa07eee4bc80]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2a774235-5aba-4753-8407-7616ef6162ee, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2a774235-5aba-4753-8407-7616ef6162ee, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:37:07 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-19c31d49-a398-4d19-aec9-8eabf0794c94 tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2a774235-5aba-4753-8407-7616ef6162ee, portal: 172.16.0.220,3260]
Nov 15 09:37:07 user nova-compute[75122]: Login to [iface: default, target: iqn.2010-10.org.openstack:2a774235-5aba-4753-8407-7616ef6162ee, portal: 172.16.0.220,3260] successful.
Nov 15 09:37:07 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:37:07 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a774235-5aba-4753-8407-7616ef6162ee -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:37:07 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a774235-5aba-4753-8407-7616ef6162ee -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:37:07 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[af08328e-fe66-4334-876d-fd4079007b06]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:37:07 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-19c31d49-a398-4d19-aec9-8eabf0794c94 tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:37:07 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:37:07 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:37:07 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[5346a7c6-915e-4128-8584-80189c4127a6]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7524fa0e-0e0f-4da0-bd00-7f099a8a55e8 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a774235-5aba-4753-8407-7616ef6162ee (non-flash)\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:37:07 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-19c31d49-a398-4d19-aec9-8eabf0794c94 tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16 (non-flash)
Nov 15 09:37:07 user nova-compute[75122]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7524fa0e-0e0f-4da0-bd00-7f099a8a55e8 (non-flash)
Nov 15 09:37:07 user nova-compute[75122]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a774235-5aba-4753-8407-7616ef6162ee (non-flash)
Nov 15 09:37:07 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 09:37:07 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-19c31d49-a398-4d19-aec9-8eabf0794c94 tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16 (non-flash)
Nov 15 09:37:07 user nova-compute[75122]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7524fa0e-0e0f-4da0-bd00-7f099a8a55e8 (non-flash)
Nov 15 09:37:07 user nova-compute[75122]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a774235-5aba-4753-8407-7616ef6162ee (non-flash)
Nov 15 09:37:07 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 09:37:07 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-19c31d49-a398-4d19-aec9-8eabf0794c94 tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2a774235-5aba-4753-8407-7616ef6162ee" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.354s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 09:37:07 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-19c31d49-a398-4d19-aec9-8eabf0794c94 tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] Connected to 172.16.0.220:3260 {{(pid=75122) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 09:37:07 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-19c31d49-a398-4d19-aec9-8eabf0794c94 tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] HCTL ('35', '-', '-', 0) found on session 26 with lun 0 {{(pid=75122) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 09:37:07 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-19c31d49-a398-4d19-aec9-8eabf0794c94 tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75122) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 09:37:07 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:37:07 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.021s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:37:07 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[e28266d6-4a17-48d7-81c8-1abd7a57b2d9]: (4, ('- - 0', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:37:07 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-19c31d49-a398-4d19-aec9-8eabf0794c94 tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] Searching for a device in session 26 and hctl ['35', '*', '*', 0] yield: None {{(pid=75122) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 09:37:08 user nova-compute[75122]: DEBUG nova.compute.manager [req-81773852-ba8d-42f4-882f-14cb8f100857 req-a472da6e-ef3a-46df-b031-6ba37d3222ea service nova] [instance: 00270cc2-4f5b-4f64-8f88-31f21e3b3950] Received event network-vif-plugged-bb6552dc-ebef-427a-beea-b41083f05e70 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:37:08 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-81773852-ba8d-42f4-882f-14cb8f100857 req-a472da6e-ef3a-46df-b031-6ba37d3222ea service nova] Acquiring lock "00270cc2-4f5b-4f64-8f88-31f21e3b3950-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:37:08 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-81773852-ba8d-42f4-882f-14cb8f100857 req-a472da6e-ef3a-46df-b031-6ba37d3222ea service nova] Lock "00270cc2-4f5b-4f64-8f88-31f21e3b3950-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:37:08 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-81773852-ba8d-42f4-882f-14cb8f100857 req-a472da6e-ef3a-46df-b031-6ba37d3222ea service nova] Lock "00270cc2-4f5b-4f64-8f88-31f21e3b3950-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:37:08 user nova-compute[75122]: DEBUG nova.compute.manager [req-81773852-ba8d-42f4-882f-14cb8f100857 req-a472da6e-ef3a-46df-b031-6ba37d3222ea service nova] [instance: 00270cc2-4f5b-4f64-8f88-31f21e3b3950] No waiting events found dispatching network-vif-plugged-bb6552dc-ebef-427a-beea-b41083f05e70 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:37:08 user nova-compute[75122]: WARNING nova.compute.manager [req-81773852-ba8d-42f4-882f-14cb8f100857 req-a472da6e-ef3a-46df-b031-6ba37d3222ea service nova] [instance: 00270cc2-4f5b-4f64-8f88-31f21e3b3950] Received unexpected event network-vif-plugged-bb6552dc-ebef-427a-beea-b41083f05e70 for instance with vm_state active and task_state rescuing.
Nov 15 09:37:08 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-19c31d49-a398-4d19-aec9-8eabf0794c94 tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] Searching for a device in session 26 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75122) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 09:37:08 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-19c31d49-a398-4d19-aec9-8eabf0794c94 tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:2a774235-5aba-4753-8407-7616ef6162ee', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fuRHUWjh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75122) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 09:37:08 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-19c31d49-a398-4d19-aec9-8eabf0794c94 tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.391s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 09:37:08 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-19c31d49-a398-4d19-aec9-8eabf0794c94 tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] <== connect_volume: return (1392ms) {'type': 'block', 'scsi_wwn': '26334346461326331', 'path': '/dev/sdd'} {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 09:37:08 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-19c31d49-a398-4d19-aec9-8eabf0794c94 tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] [instance: 1e19f9e1-69c6-4590-85d2-e90cbdbb3d80] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26334346461326331', 'path': '/dev/sdd'} {{(pid=75122) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 09:37:08 user nova-compute[75122]: DEBUG nova.objects.instance [None req-19c31d49-a398-4d19-aec9-8eabf0794c94 tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] Lazy-loading 'flavor' on Instance uuid 1e19f9e1-69c6-4590-85d2-e90cbdbb3d80 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:37:08 user nova-compute[75122]: DEBUG nova.virt.libvirt.guest [None req-19c31d49-a398-4d19-aec9-8eabf0794c94 tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 09:37:08 user nova-compute[75122]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 09:37:08 user nova-compute[75122]:   <source dev="/dev/sdd"/>
Nov 15 09:37:08 user nova-compute[75122]:   <target dev="vdb" bus="virtio"/>
Nov 15 09:37:08 user nova-compute[75122]:   <serial>2a774235-5aba-4753-8407-7616ef6162ee</serial>
Nov 15 09:37:08 user nova-compute[75122]: </disk>
Nov 15 09:37:08 user nova-compute[75122]:  {{(pid=75122) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 09:37:08 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:37:08 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:37:08 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:37:08 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:37:08 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:37:08 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-19c31d49-a398-4d19-aec9-8eabf0794c94 tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] No BDM found with device name vda, not building metadata. {{(pid=75122) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 09:37:08 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-19c31d49-a398-4d19-aec9-8eabf0794c94 tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75122) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 09:37:08 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-19c31d49-a398-4d19-aec9-8eabf0794c94 tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] No VIF found with MAC fa:16:3e:4c:61:a8, not building metadata {{(pid=75122) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 09:37:08 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-19c31d49-a398-4d19-aec9-8eabf0794c94 tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] Lock "1e19f9e1-69c6-4590-85d2-e90cbdbb3d80" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.208s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:37:10 user nova-compute[75122]: DEBUG nova.compute.manager [req-5e7220d1-a554-40c6-bbdc-0ea70fb87e69 req-1826f0e7-bf83-4e7c-9e38-96688b322d53 service nova] [instance: 00270cc2-4f5b-4f64-8f88-31f21e3b3950] Received event network-vif-plugged-bb6552dc-ebef-427a-beea-b41083f05e70 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:37:10 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-5e7220d1-a554-40c6-bbdc-0ea70fb87e69 req-1826f0e7-bf83-4e7c-9e38-96688b322d53 service nova] Acquiring lock "00270cc2-4f5b-4f64-8f88-31f21e3b3950-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:37:10 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-5e7220d1-a554-40c6-bbdc-0ea70fb87e69 req-1826f0e7-bf83-4e7c-9e38-96688b322d53 service nova] Lock "00270cc2-4f5b-4f64-8f88-31f21e3b3950-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:37:10 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-5e7220d1-a554-40c6-bbdc-0ea70fb87e69 req-1826f0e7-bf83-4e7c-9e38-96688b322d53 service nova] Lock "00270cc2-4f5b-4f64-8f88-31f21e3b3950-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:37:10 user nova-compute[75122]: DEBUG nova.compute.manager [req-5e7220d1-a554-40c6-bbdc-0ea70fb87e69 req-1826f0e7-bf83-4e7c-9e38-96688b322d53 service nova] [instance: 00270cc2-4f5b-4f64-8f88-31f21e3b3950] No waiting events found dispatching network-vif-plugged-bb6552dc-ebef-427a-beea-b41083f05e70 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:37:10 user nova-compute[75122]: WARNING nova.compute.manager [req-5e7220d1-a554-40c6-bbdc-0ea70fb87e69 req-1826f0e7-bf83-4e7c-9e38-96688b322d53 service nova] [instance: 00270cc2-4f5b-4f64-8f88-31f21e3b3950] Received unexpected event network-vif-plugged-bb6552dc-ebef-427a-beea-b41083f05e70 for instance with vm_state active and task_state rescuing.
Nov 15 09:37:10 user nova-compute[75122]: DEBUG nova.compute.manager [req-5e7220d1-a554-40c6-bbdc-0ea70fb87e69 req-1826f0e7-bf83-4e7c-9e38-96688b322d53 service nova] [instance: 00270cc2-4f5b-4f64-8f88-31f21e3b3950] Received event network-vif-plugged-bb6552dc-ebef-427a-beea-b41083f05e70 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:37:10 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-5e7220d1-a554-40c6-bbdc-0ea70fb87e69 req-1826f0e7-bf83-4e7c-9e38-96688b322d53 service nova] Acquiring lock "00270cc2-4f5b-4f64-8f88-31f21e3b3950-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:37:10 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-5e7220d1-a554-40c6-bbdc-0ea70fb87e69 req-1826f0e7-bf83-4e7c-9e38-96688b322d53 service nova] Lock "00270cc2-4f5b-4f64-8f88-31f21e3b3950-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:37:10 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-5e7220d1-a554-40c6-bbdc-0ea70fb87e69 req-1826f0e7-bf83-4e7c-9e38-96688b322d53 service nova] Lock "00270cc2-4f5b-4f64-8f88-31f21e3b3950-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:37:10 user nova-compute[75122]: DEBUG nova.compute.manager [req-5e7220d1-a554-40c6-bbdc-0ea70fb87e69 req-1826f0e7-bf83-4e7c-9e38-96688b322d53 service nova] [instance: 00270cc2-4f5b-4f64-8f88-31f21e3b3950] No waiting events found dispatching network-vif-plugged-bb6552dc-ebef-427a-beea-b41083f05e70 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:37:10 user nova-compute[75122]: WARNING nova.compute.manager [req-5e7220d1-a554-40c6-bbdc-0ea70fb87e69 req-1826f0e7-bf83-4e7c-9e38-96688b322d53 service nova] [instance: 00270cc2-4f5b-4f64-8f88-31f21e3b3950] Received unexpected event network-vif-plugged-bb6552dc-ebef-427a-beea-b41083f05e70 for instance with vm_state active and task_state rescuing.
Nov 15 09:37:10 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-65dc2e02-2837-4b56-8ce0-69e17b9b29d2 tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] Acquiring lock "1e19f9e1-69c6-4590-85d2-e90cbdbb3d80" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:37:10 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-65dc2e02-2837-4b56-8ce0-69e17b9b29d2 tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] Lock "1e19f9e1-69c6-4590-85d2-e90cbdbb3d80" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:37:10 user nova-compute[75122]: INFO nova.compute.manager [None req-65dc2e02-2837-4b56-8ce0-69e17b9b29d2 tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] [instance: 1e19f9e1-69c6-4590-85d2-e90cbdbb3d80] Detaching volume 2a774235-5aba-4753-8407-7616ef6162ee
Nov 15 09:37:10 user nova-compute[75122]: INFO nova.virt.block_device [None req-65dc2e02-2837-4b56-8ce0-69e17b9b29d2 tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] [instance: 1e19f9e1-69c6-4590-85d2-e90cbdbb3d80] Attempting to driver detach volume 2a774235-5aba-4753-8407-7616ef6162ee from mountpoint /dev/vdb
Nov 15 09:37:10 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-65dc2e02-2837-4b56-8ce0-69e17b9b29d2 tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] Attempting to detach device vdb from instance 1e19f9e1-69c6-4590-85d2-e90cbdbb3d80 from the persistent domain config. {{(pid=75122) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 09:37:10 user nova-compute[75122]: DEBUG nova.virt.libvirt.guest [None req-65dc2e02-2837-4b56-8ce0-69e17b9b29d2 tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 09:37:10 user nova-compute[75122]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 09:37:10 user nova-compute[75122]:   <source dev="/dev/sdd"/>
Nov 15 09:37:10 user nova-compute[75122]:   <target dev="vdb" bus="virtio"/>
Nov 15 09:37:10 user nova-compute[75122]:   <serial>2a774235-5aba-4753-8407-7616ef6162ee</serial>
Nov 15 09:37:10 user nova-compute[75122]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 09:37:10 user nova-compute[75122]: </disk>
Nov 15 09:37:10 user nova-compute[75122]:  {{(pid=75122) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 09:37:10 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-65dc2e02-2837-4b56-8ce0-69e17b9b29d2 tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] Successfully detached device vdb from instance 1e19f9e1-69c6-4590-85d2-e90cbdbb3d80 from the persistent domain config.
Nov 15 09:37:10 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-65dc2e02-2837-4b56-8ce0-69e17b9b29d2 tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 1e19f9e1-69c6-4590-85d2-e90cbdbb3d80 from the live domain config. {{(pid=75122) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 09:37:10 user nova-compute[75122]: DEBUG nova.virt.libvirt.guest [None req-65dc2e02-2837-4b56-8ce0-69e17b9b29d2 tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 09:37:10 user nova-compute[75122]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 09:37:10 user nova-compute[75122]:   <source dev="/dev/sdd"/>
Nov 15 09:37:10 user nova-compute[75122]:   <target dev="vdb" bus="virtio"/>
Nov 15 09:37:10 user nova-compute[75122]:   <serial>2a774235-5aba-4753-8407-7616ef6162ee</serial>
Nov 15 09:37:10 user nova-compute[75122]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 09:37:10 user nova-compute[75122]: </disk>
Nov 15 09:37:10 user nova-compute[75122]:  {{(pid=75122) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 09:37:10 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:37:10 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-65dc2e02-2837-4b56-8ce0-69e17b9b29d2 tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 1e19f9e1-69c6-4590-85d2-e90cbdbb3d80 {{(pid=75122) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 09:37:11 user nova-compute[75122]: DEBUG nova.compute.manager [None req-17ac09bb-1497-4292-993f-c8fbdfa0e3e5 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] [instance: 00270cc2-4f5b-4f64-8f88-31f21e3b3950] Checking state {{(pid=75122) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 09:37:11 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:37:13 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:37:13 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:37:13 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:37:13 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75122) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 09:37:14 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:37:15 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:37:15 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Starting heal instance info cache {{(pid=75122) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 09:37:15 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "refresh_cache-7cfd4155-c4b3-4cce-91e5-042cafccab8b" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 09:37:15 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquired lock "refresh_cache-7cfd4155-c4b3-4cce-91e5-042cafccab8b" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 09:37:15 user nova-compute[75122]: DEBUG nova.network.neutron [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] [instance: 7cfd4155-c4b3-4cce-91e5-042cafccab8b] Forcefully refreshing network info cache for instance {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 09:37:15 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:37:15 user nova-compute[75122]: DEBUG nova.network.neutron [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] [instance: 7cfd4155-c4b3-4cce-91e5-042cafccab8b] Updating instance_info_cache with network_info: [{"id": "3066e71b-c5d6-4e46-980c-2b0d42739f95", "address": "fa:16:3e:e1:ad:0f", "network": {"id": "6e846655-a6f8-4339-a239-65d2f94c8b74", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1923452032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b8e67f8a66a4930be3fb65c397cbeb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3066e71b-c5", "ovs_interfaceid": "3066e71b-c5d6-4e46-980c-2b0d42739f95", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:37:15 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Releasing lock "refresh_cache-7cfd4155-c4b3-4cce-91e5-042cafccab8b" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 09:37:15 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] [instance: 7cfd4155-c4b3-4cce-91e5-042cafccab8b] Updated the network info_cache for instance {{(pid=75122) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 09:37:15 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:37:16 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:37:16 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:37:16 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:37:16 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:37:16 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75122) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 09:37:16 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee961d5a-e0d1-4931-9293-eefbe638097a/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:37:16 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee961d5a-e0d1-4931-9293-eefbe638097a/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:37:16 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:37:16 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee961d5a-e0d1-4931-9293-eefbe638097a/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:37:16 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee961d5a-e0d1-4931-9293-eefbe638097a/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:37:16 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75122) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 09:37:16 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd9d52bb-6248-48e6-a798-6dbdaaa68cbc/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:37:16 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd9d52bb-6248-48e6-a798-6dbdaaa68cbc/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:37:16 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd9d52bb-6248-48e6-a798-6dbdaaa68cbc/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:37:17 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd9d52bb-6248-48e6-a798-6dbdaaa68cbc/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:37:17 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5a4d58-ba1e-473d-a32a-06fae1c84efc/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:37:17 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5a4d58-ba1e-473d-a32a-06fae1c84efc/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:37:17 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5a4d58-ba1e-473d-a32a-06fae1c84efc/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:37:17 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5a4d58-ba1e-473d-a32a-06fae1c84efc/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:37:17 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e19f9e1-69c6-4590-85d2-e90cbdbb3d80/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:37:17 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e19f9e1-69c6-4590-85d2-e90cbdbb3d80/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:37:17 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e19f9e1-69c6-4590-85d2-e90cbdbb3d80/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:37:17 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e19f9e1-69c6-4590-85d2-e90cbdbb3d80/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:37:17 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/131142fd-e8ec-42d1-a518-aa21c7bb7cb1/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:37:18 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/131142fd-e8ec-42d1-a518-aa21c7bb7cb1/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:37:18 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/131142fd-e8ec-42d1-a518-aa21c7bb7cb1/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:37:18 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/131142fd-e8ec-42d1-a518-aa21c7bb7cb1/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:37:18 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cfd4155-c4b3-4cce-91e5-042cafccab8b/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:37:18 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cfd4155-c4b3-4cce-91e5-042cafccab8b/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:37:18 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cfd4155-c4b3-4cce-91e5-042cafccab8b/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:37:18 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cfd4155-c4b3-4cce-91e5-042cafccab8b/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:37:18 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75122) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 09:37:18 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe0a6436-87c4-4826-a2f4-8d07c7fab59a/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:37:18 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe0a6436-87c4-4826-a2f4-8d07c7fab59a/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:37:18 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe0a6436-87c4-4826-a2f4-8d07c7fab59a/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:37:19 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe0a6436-87c4-4826-a2f4-8d07c7fab59a/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:37:19 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00270cc2-4f5b-4f64-8f88-31f21e3b3950/disk.rescue --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:37:19 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00270cc2-4f5b-4f64-8f88-31f21e3b3950/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:37:19 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00270cc2-4f5b-4f64-8f88-31f21e3b3950/disk.rescue --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:37:19 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00270cc2-4f5b-4f64-8f88-31f21e3b3950/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:37:19 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00270cc2-4f5b-4f64-8f88-31f21e3b3950/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:37:19 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00270cc2-4f5b-4f64-8f88-31f21e3b3950/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:37:19 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00270cc2-4f5b-4f64-8f88-31f21e3b3950/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:37:19 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00270cc2-4f5b-4f64-8f88-31f21e3b3950/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:37:20 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 09:37:20 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 09:37:20 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Hypervisor/Node resource view: name=user free_ram=7765MB free_disk=25.4583740234375GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75122) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 09:37:20 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:37:20 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:37:20 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance 131142fd-e8ec-42d1-a518-aa21c7bb7cb1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:37:20 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance 7cfd4155-c4b3-4cce-91e5-042cafccab8b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:37:20 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance ee961d5a-e0d1-4931-9293-eefbe638097a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:37:20 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance 5b5a4d58-ba1e-473d-a32a-06fae1c84efc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:37:20 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance 1e19f9e1-69c6-4590-85d2-e90cbdbb3d80 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:37:20 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance fd9d52bb-6248-48e6-a798-6dbdaaa68cbc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:37:20 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance 00270cc2-4f5b-4f64-8f88-31f21e3b3950 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:37:20 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance fe0a6436-87c4-4826-a2f4-8d07c7fab59a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:37:20 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75122) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 09:37:20 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75122) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 09:37:20 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:37:20 user nova-compute[75122]: DEBUG nova.compute.provider_tree [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Inventory has not changed in ProviderTree for provider: 69a3da65-47be-44c6-b67c-c692b58284ef {{(pid=75122) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 09:37:20 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Inventory has not changed for provider 69a3da65-47be-44c6-b67c-c692b58284ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 09:37:20 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Compute_service record updated for user:user {{(pid=75122) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 09:37:20 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.482s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:37:21 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:37:21 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:37:21 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:37:25 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:37:26 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:37:28 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:37:30 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-65dc2e02-2837-4b56-8ce0-69e17b9b29d2 tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 1e19f9e1-69c6-4590-85d2-e90cbdbb3d80 is timed out.
Nov 15 09:37:30 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-65dc2e02-2837-4b56-8ce0-69e17b9b29d2 tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] Successfully detached device vdb from instance 1e19f9e1-69c6-4590-85d2-e90cbdbb3d80 from the live domain config.
Nov 15 09:37:30 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-65dc2e02-2837-4b56-8ce0-69e17b9b29d2 tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] [instance: 1e19f9e1-69c6-4590-85d2-e90cbdbb3d80] calling os-brick to detach iSCSI Volume {{(pid=75122) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 09:37:30 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-65dc2e02-2837-4b56-8ce0-69e17b9b29d2 tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffa04060b80>, {'target_iqn': 'iqn.2010-10.org.openstack:2a774235-5aba-4753-8407-7616ef6162ee', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fuRHUWjh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 09:37:30 user nova-compute[75122]: WARNING os_brick.initiator.connectors.base [None req-65dc2e02-2837-4b56-8ce0-69e17b9b29d2 tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 09:37:30 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-65dc2e02-2837-4b56-8ce0-69e17b9b29d2 tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 09:37:30 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-65dc2e02-2837-4b56-8ce0-69e17b9b29d2 tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 09:37:30 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:37:30 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:37:30 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[43a13cda-e02e-4653-bb88-b750f5ec527f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7524fa0e-0e0f-4da0-bd00-7f099a8a55e8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2a774235-5aba-4753-8407-7616ef6162ee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:37:30 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-65dc2e02-2837-4b56-8ce0-69e17b9b29d2 tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 09:37:30 user nova-compute[75122]: No targets found.
Nov 15 09:37:30 user nova-compute[75122]: iSNS:
Nov 15 09:37:30 user nova-compute[75122]: No targets found.
Nov 15 09:37:30 user nova-compute[75122]: STATIC:
Nov 15 09:37:30 user nova-compute[75122]: Target: iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16
Nov 15 09:37:30 user nova-compute[75122]:         Portal: 172.16.0.220:3260,-1
Nov 15 09:37:30 user nova-compute[75122]:                 Iface Name: default
Nov 15 09:37:30 user nova-compute[75122]: Target: iqn.2010-10.org.openstack:7524fa0e-0e0f-4da0-bd00-7f099a8a55e8
Nov 15 09:37:30 user nova-compute[75122]:         Portal: 172.16.0.220:3260,-1
Nov 15 09:37:30 user nova-compute[75122]:                 Iface Name: default
Nov 15 09:37:30 user nova-compute[75122]: Target: iqn.2010-10.org.openstack:2a774235-5aba-4753-8407-7616ef6162ee
Nov 15 09:37:30 user nova-compute[75122]:         Portal: 172.16.0.220:3260,-1
Nov 15 09:37:30 user nova-compute[75122]:                 Iface Name: default
Nov 15 09:37:30 user nova-compute[75122]: FIRMWARE:
Nov 15 09:37:30 user nova-compute[75122]: No targets found.
Nov 15 09:37:30 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 09:37:30 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-65dc2e02-2837-4b56-8ce0-69e17b9b29d2 tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 09:37:30 user nova-compute[75122]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 09:37:30 user nova-compute[75122]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75122) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 09:37:30 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-65dc2e02-2837-4b56-8ce0-69e17b9b29d2 tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2a774235-5aba-4753-8407-7616ef6162ee', 0)] {{(pid=75122) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 09:37:30 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:37:30 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:37:30 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd3b01fa-8d45-4519-961e-01f0f7872899]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2a774235-5aba-4753-8407-7616ef6162ee\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7524fa0e-0e0f-4da0-bd00-7f099a8a55e8\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:37:30 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:37:30 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:37:30 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[48b944a8-af39-465f-bed4-9257d4064ff1]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7524fa0e-0e0f-4da0-bd00-7f099a8a55e8 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a774235-5aba-4753-8407-7616ef6162ee (non-flash)\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:37:30 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-65dc2e02-2837-4b56-8ce0-69e17b9b29d2 tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16 (non-flash)
Nov 15 09:37:30 user nova-compute[75122]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7524fa0e-0e0f-4da0-bd00-7f099a8a55e8 (non-flash)
Nov 15 09:37:30 user nova-compute[75122]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a774235-5aba-4753-8407-7616ef6162ee (non-flash)
Nov 15 09:37:30 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 09:37:30 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-65dc2e02-2837-4b56-8ce0-69e17b9b29d2 tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16 (non-flash)
Nov 15 09:37:30 user nova-compute[75122]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7524fa0e-0e0f-4da0-bd00-7f099a8a55e8 (non-flash)
Nov 15 09:37:30 user nova-compute[75122]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a774235-5aba-4753-8407-7616ef6162ee (non-flash)
Nov 15 09:37:30 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 09:37:30 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-65dc2e02-2837-4b56-8ce0-69e17b9b29d2 tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff9e434e320>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2a774235-5aba-4753-8407-7616ef6162ee'): ({'sdd'}, set())}) {{(pid=75122) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 09:37:30 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-65dc2e02-2837-4b56-8ce0-69e17b9b29d2 tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] Removing single pathed devices sdd {{(pid=75122) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 09:37:30 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:37:30 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:37:30 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:37:30 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[950777cc-409d-457f-93c1-163a260ad27b]: (4, ('path checker states:\nup                  2\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:37:30 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:37:30 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.022s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:37:30 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4e7642a-ca96-4b4a-9a59-ed60728c6c5f]: (4, ('ok\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:37:30 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-65dc2e02-2837-4b56-8ce0-69e17b9b29d2 tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] Flushing IO for device /dev/sdd {{(pid=75122) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 09:37:30 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:37:30 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.017s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:37:30 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[98c0d644-9b27-4f80-be77-b31ab56cb0df]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:37:30 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-65dc2e02-2837-4b56-8ce0-69e17b9b29d2 tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75122) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 09:37:30 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:37:30 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.056s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:37:30 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b722f47-a837-4133-9cad-fc1516b687d2]: (4, ('1', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:37:30 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-65dc2e02-2837-4b56-8ce0-69e17b9b29d2 tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75122) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 09:37:30 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-65dc2e02-2837-4b56-8ce0-69e17b9b29d2 tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] SCSI volumes sdd have been removed. {{(pid=75122) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 09:37:30 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-65dc2e02-2837-4b56-8ce0-69e17b9b29d2 tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2a774235-5aba-4753-8407-7616ef6162ee')] {{(pid=75122) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 09:37:30 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a774235-5aba-4753-8407-7616ef6162ee -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:37:30 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a774235-5aba-4753-8407-7616ef6162ee -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:37:30 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[57b8cd47-63f8-49aa-81e3-2e7892d40640]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:37:30 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-65dc2e02-2837-4b56-8ce0-69e17b9b29d2 tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:37:30 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a774235-5aba-4753-8407-7616ef6162ee -p 172.16.0.220:3260 --logout {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:37:30 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a774235-5aba-4753-8407-7616ef6162ee -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:37:30 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[425a7fcd-9b43-44d9-9ece-2f116a80be6b]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:2a774235-5aba-4753-8407-7616ef6162ee, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:2a774235-5aba-4753-8407-7616ef6162ee, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:37:30 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-65dc2e02-2837-4b56-8ce0-69e17b9b29d2 tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:2a774235-5aba-4753-8407-7616ef6162ee, portal: 172.16.0.220,3260]
Nov 15 09:37:30 user nova-compute[75122]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:2a774235-5aba-4753-8407-7616ef6162ee, portal: 172.16.0.220,3260] successful.
Nov 15 09:37:30 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:37:30 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a774235-5aba-4753-8407-7616ef6162ee -p 172.16.0.220:3260 --op delete {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:37:30 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a774235-5aba-4753-8407-7616ef6162ee -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:37:30 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cf591b1-0214-40f8-8b04-908fae5b22c7]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:37:30 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-65dc2e02-2837-4b56-8ce0-69e17b9b29d2 tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:37:30 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-65dc2e02-2837-4b56-8ce0-69e17b9b29d2 tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.342s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 09:37:30 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-65dc2e02-2837-4b56-8ce0-69e17b9b29d2 tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] <== disconnect_volume: return (343ms) None {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 09:37:30 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-65dc2e02-2837-4b56-8ce0-69e17b9b29d2 tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] [instance: 1e19f9e1-69c6-4590-85d2-e90cbdbb3d80] Disconnected iSCSI Volume {{(pid=75122) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 09:37:31 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:37:31 user nova-compute[75122]: DEBUG nova.objects.instance [None req-65dc2e02-2837-4b56-8ce0-69e17b9b29d2 tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] Lazy-loading 'flavor' on Instance uuid 1e19f9e1-69c6-4590-85d2-e90cbdbb3d80 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:37:31 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-65dc2e02-2837-4b56-8ce0-69e17b9b29d2 tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] Lock "1e19f9e1-69c6-4590-85d2-e90cbdbb3d80" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.743s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:37:34 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:37:35 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:37:36 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:37:36 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:37:39 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:37:40 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:37:40 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:37:41 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:37:42 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:37:45 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-858b2aa7-ba43-4643-a8d9-cba87c2c2ad1 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Acquiring lock "df913b3e-218d-4ae6-b7b3-70f64fdd3896" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:37:45 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-858b2aa7-ba43-4643-a8d9-cba87c2c2ad1 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Lock "df913b3e-218d-4ae6-b7b3-70f64fdd3896" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:37:45 user nova-compute[75122]: DEBUG nova.compute.manager [None req-858b2aa7-ba43-4643-a8d9-cba87c2c2ad1 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] [instance: df913b3e-218d-4ae6-b7b3-70f64fdd3896] Starting instance... {{(pid=75122) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 09:37:45 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-858b2aa7-ba43-4643-a8d9-cba87c2c2ad1 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:37:45 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-858b2aa7-ba43-4643-a8d9-cba87c2c2ad1 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:37:45 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:37:45 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-858b2aa7-ba43-4643-a8d9-cba87c2c2ad1 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75122) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 09:37:45 user nova-compute[75122]: INFO nova.compute.claims [None req-858b2aa7-ba43-4643-a8d9-cba87c2c2ad1 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] [instance: df913b3e-218d-4ae6-b7b3-70f64fdd3896] Claim successful on node user
Nov 15 09:37:46 user nova-compute[75122]: DEBUG nova.compute.provider_tree [None req-858b2aa7-ba43-4643-a8d9-cba87c2c2ad1 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Inventory has not changed in ProviderTree for provider: 69a3da65-47be-44c6-b67c-c692b58284ef {{(pid=75122) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 09:37:46 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-858b2aa7-ba43-4643-a8d9-cba87c2c2ad1 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Inventory has not changed for provider 69a3da65-47be-44c6-b67c-c692b58284ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 09:37:46 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-858b2aa7-ba43-4643-a8d9-cba87c2c2ad1 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.416s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:37:46 user nova-compute[75122]: DEBUG nova.compute.manager [None req-858b2aa7-ba43-4643-a8d9-cba87c2c2ad1 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] [instance: df913b3e-218d-4ae6-b7b3-70f64fdd3896] Start building networks asynchronously for instance. {{(pid=75122) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 09:37:46 user nova-compute[75122]: DEBUG nova.compute.manager [None req-858b2aa7-ba43-4643-a8d9-cba87c2c2ad1 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] [instance: df913b3e-218d-4ae6-b7b3-70f64fdd3896] Allocating IP information in the background. {{(pid=75122) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 09:37:46 user nova-compute[75122]: DEBUG nova.network.neutron [None req-858b2aa7-ba43-4643-a8d9-cba87c2c2ad1 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] [instance: df913b3e-218d-4ae6-b7b3-70f64fdd3896] allocate_for_instance() {{(pid=75122) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 09:37:46 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-858b2aa7-ba43-4643-a8d9-cba87c2c2ad1 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] [instance: df913b3e-218d-4ae6-b7b3-70f64fdd3896] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 09:37:46 user nova-compute[75122]: DEBUG nova.compute.manager [None req-858b2aa7-ba43-4643-a8d9-cba87c2c2ad1 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] [instance: df913b3e-218d-4ae6-b7b3-70f64fdd3896] Start building block device mappings for instance. {{(pid=75122) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 09:37:46 user nova-compute[75122]: DEBUG nova.policy [None req-858b2aa7-ba43-4643-a8d9-cba87c2c2ad1 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd52d39a644924944be943a3200bd5b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f29cd64a8a674d73936b8a0c90bf2d34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75122) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 09:37:46 user nova-compute[75122]: DEBUG nova.compute.manager [None req-858b2aa7-ba43-4643-a8d9-cba87c2c2ad1 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] [instance: df913b3e-218d-4ae6-b7b3-70f64fdd3896] Start spawning the instance on the hypervisor. {{(pid=75122) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 09:37:46 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-858b2aa7-ba43-4643-a8d9-cba87c2c2ad1 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] [instance: df913b3e-218d-4ae6-b7b3-70f64fdd3896] Creating instance directory {{(pid=75122) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 09:37:46 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-858b2aa7-ba43-4643-a8d9-cba87c2c2ad1 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] [instance: df913b3e-218d-4ae6-b7b3-70f64fdd3896] Creating image(s)
Nov 15 09:37:46 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-858b2aa7-ba43-4643-a8d9-cba87c2c2ad1 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Acquiring lock "/opt/stack/data/nova/instances/df913b3e-218d-4ae6-b7b3-70f64fdd3896/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:37:46 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-858b2aa7-ba43-4643-a8d9-cba87c2c2ad1 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Lock "/opt/stack/data/nova/instances/df913b3e-218d-4ae6-b7b3-70f64fdd3896/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:37:46 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-858b2aa7-ba43-4643-a8d9-cba87c2c2ad1 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Lock "/opt/stack/data/nova/instances/df913b3e-218d-4ae6-b7b3-70f64fdd3896/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:37:46 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-858b2aa7-ba43-4643-a8d9-cba87c2c2ad1 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:37:46 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:37:46 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-858b2aa7-ba43-4643-a8d9-cba87c2c2ad1 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json" returned: 0 in 0.194s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:37:46 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-858b2aa7-ba43-4643-a8d9-cba87c2c2ad1 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Acquiring lock "95d6e29f74d5408f818e32f3bc29bc8270a4c665" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:37:46 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-858b2aa7-ba43-4643-a8d9-cba87c2c2ad1 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Lock "95d6e29f74d5408f818e32f3bc29bc8270a4c665" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:37:46 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-858b2aa7-ba43-4643-a8d9-cba87c2c2ad1 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:37:46 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-858b2aa7-ba43-4643-a8d9-cba87c2c2ad1 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json" returned: 0 in 0.187s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:37:46 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-858b2aa7-ba43-4643-a8d9-cba87c2c2ad1 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665,backing_fmt=raw /opt/stack/data/nova/instances/df913b3e-218d-4ae6-b7b3-70f64fdd3896/disk 1073741824 {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:37:46 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:37:46 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-858b2aa7-ba43-4643-a8d9-cba87c2c2ad1 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665,backing_fmt=raw /opt/stack/data/nova/instances/df913b3e-218d-4ae6-b7b3-70f64fdd3896/disk 1073741824" returned: 0 in 0.061s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:37:46 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-858b2aa7-ba43-4643-a8d9-cba87c2c2ad1 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Lock "95d6e29f74d5408f818e32f3bc29bc8270a4c665" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.254s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:37:46 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-858b2aa7-ba43-4643-a8d9-cba87c2c2ad1 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:37:47 user nova-compute[75122]: DEBUG nova.network.neutron [None req-858b2aa7-ba43-4643-a8d9-cba87c2c2ad1 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] [instance: df913b3e-218d-4ae6-b7b3-70f64fdd3896] Successfully created port: 1a900796-9d0d-43a8-8ccd-21307e17f875 {{(pid=75122) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 09:37:47 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-858b2aa7-ba43-4643-a8d9-cba87c2c2ad1 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json" returned: 0 in 0.187s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:37:47 user nova-compute[75122]: DEBUG nova.virt.disk.api [None req-858b2aa7-ba43-4643-a8d9-cba87c2c2ad1 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Checking if we can resize image /opt/stack/data/nova/instances/df913b3e-218d-4ae6-b7b3-70f64fdd3896/disk. size=1073741824 {{(pid=75122) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 09:37:47 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-858b2aa7-ba43-4643-a8d9-cba87c2c2ad1 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df913b3e-218d-4ae6-b7b3-70f64fdd3896/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:37:47 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-858b2aa7-ba43-4643-a8d9-cba87c2c2ad1 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df913b3e-218d-4ae6-b7b3-70f64fdd3896/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:37:47 user nova-compute[75122]: DEBUG nova.virt.disk.api [None req-858b2aa7-ba43-4643-a8d9-cba87c2c2ad1 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Cannot resize image /opt/stack/data/nova/instances/df913b3e-218d-4ae6-b7b3-70f64fdd3896/disk to a smaller size. {{(pid=75122) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 09:37:47 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-858b2aa7-ba43-4643-a8d9-cba87c2c2ad1 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] [instance: df913b3e-218d-4ae6-b7b3-70f64fdd3896] Created local disks {{(pid=75122) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 09:37:47 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-858b2aa7-ba43-4643-a8d9-cba87c2c2ad1 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] [instance: df913b3e-218d-4ae6-b7b3-70f64fdd3896] Ensure instance console log exists: /opt/stack/data/nova/instances/df913b3e-218d-4ae6-b7b3-70f64fdd3896/console.log {{(pid=75122) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 09:37:47 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-858b2aa7-ba43-4643-a8d9-cba87c2c2ad1 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:37:47 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-858b2aa7-ba43-4643-a8d9-cba87c2c2ad1 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:37:47 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-858b2aa7-ba43-4643-a8d9-cba87c2c2ad1 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:37:48 user nova-compute[75122]: DEBUG nova.network.neutron [None req-858b2aa7-ba43-4643-a8d9-cba87c2c2ad1 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] [instance: df913b3e-218d-4ae6-b7b3-70f64fdd3896] Successfully updated port: 1a900796-9d0d-43a8-8ccd-21307e17f875 {{(pid=75122) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 09:37:48 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-858b2aa7-ba43-4643-a8d9-cba87c2c2ad1 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Acquiring lock "refresh_cache-df913b3e-218d-4ae6-b7b3-70f64fdd3896" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 09:37:48 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-858b2aa7-ba43-4643-a8d9-cba87c2c2ad1 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Acquired lock "refresh_cache-df913b3e-218d-4ae6-b7b3-70f64fdd3896" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 09:37:48 user nova-compute[75122]: DEBUG nova.network.neutron [None req-858b2aa7-ba43-4643-a8d9-cba87c2c2ad1 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] [instance: df913b3e-218d-4ae6-b7b3-70f64fdd3896] Building network info cache for instance {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 09:37:48 user nova-compute[75122]: DEBUG nova.compute.manager [req-d7607999-c62a-4c6f-ac0d-6238a5fd2c36 req-21fb2dbc-040f-4ddf-b4c7-266cfa3e64c7 service nova] [instance: df913b3e-218d-4ae6-b7b3-70f64fdd3896] Received event network-changed-1a900796-9d0d-43a8-8ccd-21307e17f875 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:37:48 user nova-compute[75122]: DEBUG nova.compute.manager [req-d7607999-c62a-4c6f-ac0d-6238a5fd2c36 req-21fb2dbc-040f-4ddf-b4c7-266cfa3e64c7 service nova] [instance: df913b3e-218d-4ae6-b7b3-70f64fdd3896] Refreshing instance network info cache due to event network-changed-1a900796-9d0d-43a8-8ccd-21307e17f875. {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 09:37:48 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-d7607999-c62a-4c6f-ac0d-6238a5fd2c36 req-21fb2dbc-040f-4ddf-b4c7-266cfa3e64c7 service nova] Acquiring lock "refresh_cache-df913b3e-218d-4ae6-b7b3-70f64fdd3896" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 09:37:48 user nova-compute[75122]: DEBUG nova.network.neutron [None req-858b2aa7-ba43-4643-a8d9-cba87c2c2ad1 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] [instance: df913b3e-218d-4ae6-b7b3-70f64fdd3896] Instance cache missing network info. {{(pid=75122) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 09:37:48 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:37:48 user nova-compute[75122]: DEBUG nova.network.neutron [None req-858b2aa7-ba43-4643-a8d9-cba87c2c2ad1 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] [instance: df913b3e-218d-4ae6-b7b3-70f64fdd3896] Updating instance_info_cache with network_info: [{"id": "1a900796-9d0d-43a8-8ccd-21307e17f875", "address": "fa:16:3e:1b:53:31", "network": {"id": "cc80acf3-8a44-4d7e-aaa0-1214700564b3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1084984321-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f29cd64a8a674d73936b8a0c90bf2d34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a900796-9d", "ovs_interfaceid": "1a900796-9d0d-43a8-8ccd-21307e17f875", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:37:48 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-858b2aa7-ba43-4643-a8d9-cba87c2c2ad1 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Releasing lock "refresh_cache-df913b3e-218d-4ae6-b7b3-70f64fdd3896" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 09:37:48 user nova-compute[75122]: DEBUG nova.compute.manager [None req-858b2aa7-ba43-4643-a8d9-cba87c2c2ad1 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] [instance: df913b3e-218d-4ae6-b7b3-70f64fdd3896] Instance network_info: |[{"id": "1a900796-9d0d-43a8-8ccd-21307e17f875", "address": "fa:16:3e:1b:53:31", "network": {"id": "cc80acf3-8a44-4d7e-aaa0-1214700564b3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1084984321-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f29cd64a8a674d73936b8a0c90bf2d34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a900796-9d", "ovs_interfaceid": "1a900796-9d0d-43a8-8ccd-21307e17f875", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75122) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 09:37:48 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-d7607999-c62a-4c6f-ac0d-6238a5fd2c36 req-21fb2dbc-040f-4ddf-b4c7-266cfa3e64c7 service nova] Acquired lock "refresh_cache-df913b3e-218d-4ae6-b7b3-70f64fdd3896" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 09:37:48 user nova-compute[75122]: DEBUG nova.network.neutron [req-d7607999-c62a-4c6f-ac0d-6238a5fd2c36 req-21fb2dbc-040f-4ddf-b4c7-266cfa3e64c7 service nova] [instance: df913b3e-218d-4ae6-b7b3-70f64fdd3896] Refreshing network info cache for port 1a900796-9d0d-43a8-8ccd-21307e17f875 {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 09:37:48 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-858b2aa7-ba43-4643-a8d9-cba87c2c2ad1 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] [instance: df913b3e-218d-4ae6-b7b3-70f64fdd3896] Start _get_guest_xml network_info=[{"id": "1a900796-9d0d-43a8-8ccd-21307e17f875", "address": "fa:16:3e:1b:53:31", "network": {"id": "cc80acf3-8a44-4d7e-aaa0-1214700564b3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1084984321-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f29cd64a8a674d73936b8a0c90bf2d34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a900796-9d", "ovs_interfaceid": "1a900796-9d0d-43a8-8ccd-21307e17f875", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T09:26:31Z,direct_url=<?>,disk_format='qcow2',id=5e862cfe-47b8-4725-8292-65761ee6d0f5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9c57733cb41847c0b4ad31519c382e5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T09:26:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '5e862cfe-47b8-4725-8292-65761ee6d0f5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75122) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 09:37:48 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-858b2aa7-ba43-4643-a8d9-cba87c2c2ad1 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 09:37:48 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-858b2aa7-ba43-4643-a8d9-cba87c2c2ad1 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 09:37:48 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-858b2aa7-ba43-4643-a8d9-cba87c2c2ad1 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75122) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 09:37:48 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-858b2aa7-ba43-4643-a8d9-cba87c2c2ad1 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] CPU controller missing on host. {{(pid=75122) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 09:37:48 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-858b2aa7-ba43-4643-a8d9-cba87c2c2ad1 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75122) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 09:37:48 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-858b2aa7-ba43-4643-a8d9-cba87c2c2ad1 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] CPU controller found on host. {{(pid=75122) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 09:37:48 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-858b2aa7-ba43-4643-a8d9-cba87c2c2ad1 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75122) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 09:37:48 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-858b2aa7-ba43-4643-a8d9-cba87c2c2ad1 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T09:26:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T09:26:31Z,direct_url=<?>,disk_format='qcow2',id=5e862cfe-47b8-4725-8292-65761ee6d0f5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9c57733cb41847c0b4ad31519c382e5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T09:26:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 09:37:48 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-858b2aa7-ba43-4643-a8d9-cba87c2c2ad1 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Flavor limits 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 09:37:48 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-858b2aa7-ba43-4643-a8d9-cba87c2c2ad1 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Image limits 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 09:37:48 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-858b2aa7-ba43-4643-a8d9-cba87c2c2ad1 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Flavor pref 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 09:37:48 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-858b2aa7-ba43-4643-a8d9-cba87c2c2ad1 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Image pref 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 09:37:48 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-858b2aa7-ba43-4643-a8d9-cba87c2c2ad1 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 09:37:48 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-858b2aa7-ba43-4643-a8d9-cba87c2c2ad1 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 09:37:48 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-858b2aa7-ba43-4643-a8d9-cba87c2c2ad1 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75122) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 09:37:48 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-858b2aa7-ba43-4643-a8d9-cba87c2c2ad1 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Got 1 possible topologies {{(pid=75122) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 09:37:48 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-858b2aa7-ba43-4643-a8d9-cba87c2c2ad1 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 09:37:48 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-858b2aa7-ba43-4643-a8d9-cba87c2c2ad1 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 09:37:48 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-858b2aa7-ba43-4643-a8d9-cba87c2c2ad1 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T09:37:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1839546565',display_name='tempest-AttachVolumeNegativeTest-server-1839546565',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1839546565',id=19,image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAElWj3x5xtshAY2VAWdnuBmoQjsm3lrwT9SyzEHcMAu/Y7+WZUQjuYaN/GPFaf4V6uT8GArSNheaFBNuhiZRVhd/T9NIo/d+O9kv0GY3FAf3m/it2t9MbWrCboHuAE1XQ==',key_name='tempest-keypair-191892403',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f29cd64a8a674d73936b8a0c90bf2d34',ramdisk_id='',reservation_id='r-hea6qvh1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-475232131',owner_user_name='tempest-AttachVolumeNegativeTest-475232131-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T09:37:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d52d39a644924944be943a3200bd5b33',uuid=df913b3e-218d-4ae6-b7b3-70f64fdd3896,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1a900796-9d0d-43a8-8ccd-21307e17f875", "address": "fa:16:3e:1b:53:31", "network": {"id": "cc80acf3-8a44-4d7e-aaa0-1214700564b3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1084984321-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f29cd64a8a674d73936b8a0c90bf2d34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a900796-9d", "ovs_interfaceid": "1a900796-9d0d-43a8-8ccd-21307e17f875", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75122) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 09:37:48 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-858b2aa7-ba43-4643-a8d9-cba87c2c2ad1 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Converting VIF {"id": "1a900796-9d0d-43a8-8ccd-21307e17f875", "address": "fa:16:3e:1b:53:31", "network": {"id": "cc80acf3-8a44-4d7e-aaa0-1214700564b3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1084984321-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f29cd64a8a674d73936b8a0c90bf2d34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a900796-9d", "ovs_interfaceid": "1a900796-9d0d-43a8-8ccd-21307e17f875", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 09:37:48 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-858b2aa7-ba43-4643-a8d9-cba87c2c2ad1 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:53:31,bridge_name='br-int',has_traffic_filtering=True,id=1a900796-9d0d-43a8-8ccd-21307e17f875,network=Network(cc80acf3-8a44-4d7e-aaa0-1214700564b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a900796-9d') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 09:37:48 user nova-compute[75122]: DEBUG nova.objects.instance [None req-858b2aa7-ba43-4643-a8d9-cba87c2c2ad1 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Lazy-loading 'pci_devices' on Instance uuid df913b3e-218d-4ae6-b7b3-70f64fdd3896 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:37:48 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-858b2aa7-ba43-4643-a8d9-cba87c2c2ad1 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] [instance: df913b3e-218d-4ae6-b7b3-70f64fdd3896] End _get_guest_xml xml=<domain type="kvm">
Nov 15 09:37:48 user nova-compute[75122]:   <uuid>df913b3e-218d-4ae6-b7b3-70f64fdd3896</uuid>
Nov 15 09:37:48 user nova-compute[75122]:   <name>instance-00000013</name>
Nov 15 09:37:48 user nova-compute[75122]:   <memory>524288</memory>
Nov 15 09:37:48 user nova-compute[75122]:   <vcpu>1</vcpu>
Nov 15 09:37:48 user nova-compute[75122]:   <metadata>
Nov 15 09:37:48 user nova-compute[75122]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 09:37:48 user nova-compute[75122]:       <nova:package version="0.0.0"/>
Nov 15 09:37:48 user nova-compute[75122]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1839546565</nova:name>
Nov 15 09:37:48 user nova-compute[75122]:       <nova:creationTime>2023-11-15 09:37:48</nova:creationTime>
Nov 15 09:37:48 user nova-compute[75122]:       <nova:flavor name="m1.tiny">
Nov 15 09:37:48 user nova-compute[75122]:         <nova:memory>512</nova:memory>
Nov 15 09:37:48 user nova-compute[75122]:         <nova:disk>1</nova:disk>
Nov 15 09:37:48 user nova-compute[75122]:         <nova:swap>0</nova:swap>
Nov 15 09:37:48 user nova-compute[75122]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 09:37:48 user nova-compute[75122]:         <nova:vcpus>1</nova:vcpus>
Nov 15 09:37:48 user nova-compute[75122]:       </nova:flavor>
Nov 15 09:37:48 user nova-compute[75122]:       <nova:owner>
Nov 15 09:37:48 user nova-compute[75122]:         <nova:user uuid="d52d39a644924944be943a3200bd5b33">tempest-AttachVolumeNegativeTest-475232131-project-member</nova:user>
Nov 15 09:37:48 user nova-compute[75122]:         <nova:project uuid="f29cd64a8a674d73936b8a0c90bf2d34">tempest-AttachVolumeNegativeTest-475232131</nova:project>
Nov 15 09:37:48 user nova-compute[75122]:       </nova:owner>
Nov 15 09:37:48 user nova-compute[75122]:       <nova:root type="image" uuid="5e862cfe-47b8-4725-8292-65761ee6d0f5"/>
Nov 15 09:37:48 user nova-compute[75122]:       <nova:ports>
Nov 15 09:37:48 user nova-compute[75122]:         <nova:port uuid="1a900796-9d0d-43a8-8ccd-21307e17f875">
Nov 15 09:37:48 user nova-compute[75122]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 15 09:37:48 user nova-compute[75122]:         </nova:port>
Nov 15 09:37:48 user nova-compute[75122]:       </nova:ports>
Nov 15 09:37:48 user nova-compute[75122]:     </nova:instance>
Nov 15 09:37:48 user nova-compute[75122]:   </metadata>
Nov 15 09:37:48 user nova-compute[75122]:   <sysinfo type="smbios">
Nov 15 09:37:48 user nova-compute[75122]:     <system>
Nov 15 09:37:48 user nova-compute[75122]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 09:37:48 user nova-compute[75122]:       <entry name="product">OpenStack Nova</entry>
Nov 15 09:37:48 user nova-compute[75122]:       <entry name="version">0.0.0</entry>
Nov 15 09:37:48 user nova-compute[75122]:       <entry name="serial">df913b3e-218d-4ae6-b7b3-70f64fdd3896</entry>
Nov 15 09:37:48 user nova-compute[75122]:       <entry name="uuid">df913b3e-218d-4ae6-b7b3-70f64fdd3896</entry>
Nov 15 09:37:48 user nova-compute[75122]:       <entry name="family">Virtual Machine</entry>
Nov 15 09:37:48 user nova-compute[75122]:     </system>
Nov 15 09:37:48 user nova-compute[75122]:   </sysinfo>
Nov 15 09:37:48 user nova-compute[75122]:   <os>
Nov 15 09:37:48 user nova-compute[75122]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 09:37:48 user nova-compute[75122]:     <boot dev="hd"/>
Nov 15 09:37:48 user nova-compute[75122]:     <smbios mode="sysinfo"/>
Nov 15 09:37:48 user nova-compute[75122]:   </os>
Nov 15 09:37:48 user nova-compute[75122]:   <features>
Nov 15 09:37:48 user nova-compute[75122]:     <acpi/>
Nov 15 09:37:48 user nova-compute[75122]:     <apic/>
Nov 15 09:37:48 user nova-compute[75122]:     <vmcoreinfo/>
Nov 15 09:37:48 user nova-compute[75122]:   </features>
Nov 15 09:37:48 user nova-compute[75122]:   <clock offset="utc">
Nov 15 09:37:48 user nova-compute[75122]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 09:37:48 user nova-compute[75122]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 09:37:48 user nova-compute[75122]:     <timer name="hpet" present="no"/>
Nov 15 09:37:48 user nova-compute[75122]:   </clock>
Nov 15 09:37:48 user nova-compute[75122]:   <cpu mode="custom" match="exact">
Nov 15 09:37:48 user nova-compute[75122]:     <model>Nehalem</model>
Nov 15 09:37:48 user nova-compute[75122]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 09:37:48 user nova-compute[75122]:   </cpu>
Nov 15 09:37:48 user nova-compute[75122]:   <devices>
Nov 15 09:37:48 user nova-compute[75122]:     <disk type="file" device="disk">
Nov 15 09:37:48 user nova-compute[75122]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 09:37:48 user nova-compute[75122]:       <source file="/opt/stack/data/nova/instances/df913b3e-218d-4ae6-b7b3-70f64fdd3896/disk"/>
Nov 15 09:37:48 user nova-compute[75122]:       <target dev="vda" bus="virtio"/>
Nov 15 09:37:48 user nova-compute[75122]:     </disk>
Nov 15 09:37:48 user nova-compute[75122]:     <interface type="ethernet">
Nov 15 09:37:48 user nova-compute[75122]:       <mac address="fa:16:3e:1b:53:31"/>
Nov 15 09:37:48 user nova-compute[75122]:       <model type="virtio"/>
Nov 15 09:37:48 user nova-compute[75122]:       <mtu size="1442"/>
Nov 15 09:37:48 user nova-compute[75122]:       <target dev="tap1a900796-9d"/>
Nov 15 09:37:48 user nova-compute[75122]:     </interface>
Nov 15 09:37:48 user nova-compute[75122]:     <serial type="pty">
Nov 15 09:37:48 user nova-compute[75122]:       <log file="/opt/stack/data/nova/instances/df913b3e-218d-4ae6-b7b3-70f64fdd3896/console.log" append="off"/>
Nov 15 09:37:48 user nova-compute[75122]:     </serial>
Nov 15 09:37:48 user nova-compute[75122]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 09:37:48 user nova-compute[75122]:     <video>
Nov 15 09:37:48 user nova-compute[75122]:       <model type="virtio"/>
Nov 15 09:37:48 user nova-compute[75122]:     </video>
Nov 15 09:37:48 user nova-compute[75122]:     <rng model="virtio">
Nov 15 09:37:48 user nova-compute[75122]:       <backend model="random">/dev/urandom</backend>
Nov 15 09:37:48 user nova-compute[75122]:     </rng>
Nov 15 09:37:48 user nova-compute[75122]:     <controller type="usb" index="0" model="none"/>
Nov 15 09:37:48 user nova-compute[75122]:     <memballoon model="virtio">
Nov 15 09:37:48 user nova-compute[75122]:       <stats period="10"/>
Nov 15 09:37:48 user nova-compute[75122]:     </memballoon>
Nov 15 09:37:48 user nova-compute[75122]:   </devices>
Nov 15 09:37:48 user nova-compute[75122]: </domain>
Nov 15 09:37:48 user nova-compute[75122]:  {{(pid=75122) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 09:37:48 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-858b2aa7-ba43-4643-a8d9-cba87c2c2ad1 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T09:37:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1839546565',display_name='tempest-AttachVolumeNegativeTest-server-1839546565',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1839546565',id=19,image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAElWj3x5xtshAY2VAWdnuBmoQjsm3lrwT9SyzEHcMAu/Y7+WZUQjuYaN/GPFaf4V6uT8GArSNheaFBNuhiZRVhd/T9NIo/d+O9kv0GY3FAf3m/it2t9MbWrCboHuAE1XQ==',key_name='tempest-keypair-191892403',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f29cd64a8a674d73936b8a0c90bf2d34',ramdisk_id='',reservation_id='r-hea6qvh1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-475232131',owner_user_name='tempest-AttachVolumeNegativeTest-475232131-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T09:37:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d52d39a644924944be943a3200bd5b33',uuid=df913b3e-218d-4ae6-b7b3-70f64fdd3896,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1a900796-9d0d-43a8-8ccd-21307e17f875", "address": "fa:16:3e:1b:53:31", "network": {"id": "cc80acf3-8a44-4d7e-aaa0-1214700564b3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1084984321-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f29cd64a8a674d73936b8a0c90bf2d34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a900796-9d", "ovs_interfaceid": "1a900796-9d0d-43a8-8ccd-21307e17f875", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 09:37:48 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-858b2aa7-ba43-4643-a8d9-cba87c2c2ad1 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Converting VIF {"id": "1a900796-9d0d-43a8-8ccd-21307e17f875", "address": "fa:16:3e:1b:53:31", "network": {"id": "cc80acf3-8a44-4d7e-aaa0-1214700564b3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1084984321-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f29cd64a8a674d73936b8a0c90bf2d34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a900796-9d", "ovs_interfaceid": "1a900796-9d0d-43a8-8ccd-21307e17f875", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 09:37:48 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-858b2aa7-ba43-4643-a8d9-cba87c2c2ad1 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:53:31,bridge_name='br-int',has_traffic_filtering=True,id=1a900796-9d0d-43a8-8ccd-21307e17f875,network=Network(cc80acf3-8a44-4d7e-aaa0-1214700564b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a900796-9d') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 09:37:48 user nova-compute[75122]: DEBUG os_vif [None req-858b2aa7-ba43-4643-a8d9-cba87c2c2ad1 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:53:31,bridge_name='br-int',has_traffic_filtering=True,id=1a900796-9d0d-43a8-8ccd-21307e17f875,network=Network(cc80acf3-8a44-4d7e-aaa0-1214700564b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a900796-9d') {{(pid=75122) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 09:37:48 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:37:48 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:37:48 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 09:37:48 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:37:48 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a83391dc-7bdb-5177-b38f-ef907ff5db2e', '_type': 'linux-noop'}}, row=False) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:37:48 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:37:48 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:37:48 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:37:48 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1a900796-9d, may_exist=True, interface_attrs={}) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:37:48 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1a900796-9d, col_values=(('qos', UUID('c2073906-06c4-4e59-833a-1c9ba9ac6291')),), if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:37:48 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1a900796-9d, col_values=(('external_ids', {'iface-id': '1a900796-9d0d-43a8-8ccd-21307e17f875', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1b:53:31', 'vm-uuid': 'df913b3e-218d-4ae6-b7b3-70f64fdd3896'}),), if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:37:48 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:37:48 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:37:48 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:37:48 user nova-compute[75122]: INFO os_vif [None req-858b2aa7-ba43-4643-a8d9-cba87c2c2ad1 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:53:31,bridge_name='br-int',has_traffic_filtering=True,id=1a900796-9d0d-43a8-8ccd-21307e17f875,network=Network(cc80acf3-8a44-4d7e-aaa0-1214700564b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a900796-9d')
Nov 15 09:37:49 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-858b2aa7-ba43-4643-a8d9-cba87c2c2ad1 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] No BDM found with device name vda, not building metadata. {{(pid=75122) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 09:37:49 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-858b2aa7-ba43-4643-a8d9-cba87c2c2ad1 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] No VIF found with MAC fa:16:3e:1b:53:31, not building metadata {{(pid=75122) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 09:37:49 user nova-compute[75122]: DEBUG nova.network.neutron [req-d7607999-c62a-4c6f-ac0d-6238a5fd2c36 req-21fb2dbc-040f-4ddf-b4c7-266cfa3e64c7 service nova] [instance: df913b3e-218d-4ae6-b7b3-70f64fdd3896] Updated VIF entry in instance network info cache for port 1a900796-9d0d-43a8-8ccd-21307e17f875. {{(pid=75122) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 09:37:49 user nova-compute[75122]: DEBUG nova.network.neutron [req-d7607999-c62a-4c6f-ac0d-6238a5fd2c36 req-21fb2dbc-040f-4ddf-b4c7-266cfa3e64c7 service nova] [instance: df913b3e-218d-4ae6-b7b3-70f64fdd3896] Updating instance_info_cache with network_info: [{"id": "1a900796-9d0d-43a8-8ccd-21307e17f875", "address": "fa:16:3e:1b:53:31", "network": {"id": "cc80acf3-8a44-4d7e-aaa0-1214700564b3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1084984321-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f29cd64a8a674d73936b8a0c90bf2d34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a900796-9d", "ovs_interfaceid": "1a900796-9d0d-43a8-8ccd-21307e17f875", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:37:49 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-d7607999-c62a-4c6f-ac0d-6238a5fd2c36 req-21fb2dbc-040f-4ddf-b4c7-266cfa3e64c7 service nova] Releasing lock "refresh_cache-df913b3e-218d-4ae6-b7b3-70f64fdd3896" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 09:37:50 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:37:50 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:37:50 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:37:50 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:37:50 user nova-compute[75122]: DEBUG nova.compute.manager [req-d80bfab0-40e9-4c4a-9904-93359484cf31 req-9d4bc2d4-8e48-4841-800e-070b024172c1 service nova] [instance: df913b3e-218d-4ae6-b7b3-70f64fdd3896] Received event network-vif-plugged-1a900796-9d0d-43a8-8ccd-21307e17f875 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:37:50 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-d80bfab0-40e9-4c4a-9904-93359484cf31 req-9d4bc2d4-8e48-4841-800e-070b024172c1 service nova] Acquiring lock "df913b3e-218d-4ae6-b7b3-70f64fdd3896-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:37:50 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-d80bfab0-40e9-4c4a-9904-93359484cf31 req-9d4bc2d4-8e48-4841-800e-070b024172c1 service nova] Lock "df913b3e-218d-4ae6-b7b3-70f64fdd3896-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:37:50 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-d80bfab0-40e9-4c4a-9904-93359484cf31 req-9d4bc2d4-8e48-4841-800e-070b024172c1 service nova] Lock "df913b3e-218d-4ae6-b7b3-70f64fdd3896-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:37:50 user nova-compute[75122]: DEBUG nova.compute.manager [req-d80bfab0-40e9-4c4a-9904-93359484cf31 req-9d4bc2d4-8e48-4841-800e-070b024172c1 service nova] [instance: df913b3e-218d-4ae6-b7b3-70f64fdd3896] No waiting events found dispatching network-vif-plugged-1a900796-9d0d-43a8-8ccd-21307e17f875 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:37:50 user nova-compute[75122]: WARNING nova.compute.manager [req-d80bfab0-40e9-4c4a-9904-93359484cf31 req-9d4bc2d4-8e48-4841-800e-070b024172c1 service nova] [instance: df913b3e-218d-4ae6-b7b3-70f64fdd3896] Received unexpected event network-vif-plugged-1a900796-9d0d-43a8-8ccd-21307e17f875 for instance with vm_state building and task_state spawning.
Nov 15 09:37:50 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:37:51 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:37:51 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:37:51 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:37:51 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:37:52 user nova-compute[75122]: DEBUG nova.compute.manager [None req-858b2aa7-ba43-4643-a8d9-cba87c2c2ad1 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] [instance: df913b3e-218d-4ae6-b7b3-70f64fdd3896] Instance event wait completed in 0 seconds for  {{(pid=75122) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 09:37:52 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-858b2aa7-ba43-4643-a8d9-cba87c2c2ad1 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] [instance: df913b3e-218d-4ae6-b7b3-70f64fdd3896] Guest created on hypervisor {{(pid=75122) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 09:37:52 user nova-compute[75122]: INFO nova.virt.libvirt.driver [-] [instance: df913b3e-218d-4ae6-b7b3-70f64fdd3896] Instance spawned successfully.
Nov 15 09:37:52 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-858b2aa7-ba43-4643-a8d9-cba87c2c2ad1 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] [instance: df913b3e-218d-4ae6-b7b3-70f64fdd3896] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 09:37:52 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-858b2aa7-ba43-4643-a8d9-cba87c2c2ad1 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] [instance: df913b3e-218d-4ae6-b7b3-70f64fdd3896] Found default for hw_cdrom_bus of ide {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:37:52 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-858b2aa7-ba43-4643-a8d9-cba87c2c2ad1 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] [instance: df913b3e-218d-4ae6-b7b3-70f64fdd3896] Found default for hw_disk_bus of virtio {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:37:52 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-858b2aa7-ba43-4643-a8d9-cba87c2c2ad1 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] [instance: df913b3e-218d-4ae6-b7b3-70f64fdd3896] Found default for hw_input_bus of None {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:37:52 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-858b2aa7-ba43-4643-a8d9-cba87c2c2ad1 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] [instance: df913b3e-218d-4ae6-b7b3-70f64fdd3896] Found default for hw_pointer_model of None {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:37:52 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-858b2aa7-ba43-4643-a8d9-cba87c2c2ad1 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] [instance: df913b3e-218d-4ae6-b7b3-70f64fdd3896] Found default for hw_video_model of virtio {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:37:52 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-858b2aa7-ba43-4643-a8d9-cba87c2c2ad1 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] [instance: df913b3e-218d-4ae6-b7b3-70f64fdd3896] Found default for hw_vif_model of virtio {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:37:52 user nova-compute[75122]: INFO nova.compute.manager [None req-858b2aa7-ba43-4643-a8d9-cba87c2c2ad1 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] [instance: df913b3e-218d-4ae6-b7b3-70f64fdd3896] Took 6.27 seconds to spawn the instance on the hypervisor.
Nov 15 09:37:52 user nova-compute[75122]: DEBUG nova.compute.manager [None req-858b2aa7-ba43-4643-a8d9-cba87c2c2ad1 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] [instance: df913b3e-218d-4ae6-b7b3-70f64fdd3896] Checking state {{(pid=75122) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 09:37:52 user nova-compute[75122]: INFO nova.compute.manager [None req-858b2aa7-ba43-4643-a8d9-cba87c2c2ad1 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] [instance: df913b3e-218d-4ae6-b7b3-70f64fdd3896] Took 7.06 seconds to build instance.
Nov 15 09:37:52 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-858b2aa7-ba43-4643-a8d9-cba87c2c2ad1 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Lock "df913b3e-218d-4ae6-b7b3-70f64fdd3896" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.196s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:37:52 user nova-compute[75122]: DEBUG nova.compute.manager [req-49437c4a-1db3-476c-bac6-6191aad53c90 req-5cc9c54f-759e-499a-b29e-d20951c22e44 service nova] [instance: df913b3e-218d-4ae6-b7b3-70f64fdd3896] Received event network-vif-plugged-1a900796-9d0d-43a8-8ccd-21307e17f875 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:37:52 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-49437c4a-1db3-476c-bac6-6191aad53c90 req-5cc9c54f-759e-499a-b29e-d20951c22e44 service nova] Acquiring lock "df913b3e-218d-4ae6-b7b3-70f64fdd3896-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:37:52 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-49437c4a-1db3-476c-bac6-6191aad53c90 req-5cc9c54f-759e-499a-b29e-d20951c22e44 service nova] Lock "df913b3e-218d-4ae6-b7b3-70f64fdd3896-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:37:52 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-49437c4a-1db3-476c-bac6-6191aad53c90 req-5cc9c54f-759e-499a-b29e-d20951c22e44 service nova] Lock "df913b3e-218d-4ae6-b7b3-70f64fdd3896-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:37:52 user nova-compute[75122]: DEBUG nova.compute.manager [req-49437c4a-1db3-476c-bac6-6191aad53c90 req-5cc9c54f-759e-499a-b29e-d20951c22e44 service nova] [instance: df913b3e-218d-4ae6-b7b3-70f64fdd3896] No waiting events found dispatching network-vif-plugged-1a900796-9d0d-43a8-8ccd-21307e17f875 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:37:52 user nova-compute[75122]: WARNING nova.compute.manager [req-49437c4a-1db3-476c-bac6-6191aad53c90 req-5cc9c54f-759e-499a-b29e-d20951c22e44 service nova] [instance: df913b3e-218d-4ae6-b7b3-70f64fdd3896] Received unexpected event network-vif-plugged-1a900796-9d0d-43a8-8ccd-21307e17f875 for instance with vm_state active and task_state None.
Nov 15 09:37:53 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:37:53 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:37:55 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:37:55 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:37:58 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-9b7a3680-199e-4ede-8d59-21ce2165e06d tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Acquiring lock "c2f45f49-0bca-4ae2-bc2a-eed293143489" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:37:58 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-9b7a3680-199e-4ede-8d59-21ce2165e06d tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Lock "c2f45f49-0bca-4ae2-bc2a-eed293143489" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:37:58 user nova-compute[75122]: DEBUG nova.compute.manager [None req-9b7a3680-199e-4ede-8d59-21ce2165e06d tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] [instance: c2f45f49-0bca-4ae2-bc2a-eed293143489] Starting instance... {{(pid=75122) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 09:37:58 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:37:59 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-9b7a3680-199e-4ede-8d59-21ce2165e06d tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:37:59 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-9b7a3680-199e-4ede-8d59-21ce2165e06d tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:37:59 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-9b7a3680-199e-4ede-8d59-21ce2165e06d tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75122) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 09:37:59 user nova-compute[75122]: INFO nova.compute.claims [None req-9b7a3680-199e-4ede-8d59-21ce2165e06d tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] [instance: c2f45f49-0bca-4ae2-bc2a-eed293143489] Claim successful on node user
Nov 15 09:37:59 user nova-compute[75122]: DEBUG nova.compute.provider_tree [None req-9b7a3680-199e-4ede-8d59-21ce2165e06d tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Inventory has not changed in ProviderTree for provider: 69a3da65-47be-44c6-b67c-c692b58284ef {{(pid=75122) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 09:37:59 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-9b7a3680-199e-4ede-8d59-21ce2165e06d tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Inventory has not changed for provider 69a3da65-47be-44c6-b67c-c692b58284ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 09:37:59 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-9b7a3680-199e-4ede-8d59-21ce2165e06d tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.394s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:37:59 user nova-compute[75122]: DEBUG nova.compute.manager [None req-9b7a3680-199e-4ede-8d59-21ce2165e06d tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] [instance: c2f45f49-0bca-4ae2-bc2a-eed293143489] Start building networks asynchronously for instance. {{(pid=75122) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 09:37:59 user nova-compute[75122]: DEBUG nova.compute.manager [None req-9b7a3680-199e-4ede-8d59-21ce2165e06d tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] [instance: c2f45f49-0bca-4ae2-bc2a-eed293143489] Allocating IP information in the background. {{(pid=75122) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 09:37:59 user nova-compute[75122]: DEBUG nova.network.neutron [None req-9b7a3680-199e-4ede-8d59-21ce2165e06d tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] [instance: c2f45f49-0bca-4ae2-bc2a-eed293143489] allocate_for_instance() {{(pid=75122) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 09:37:59 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-9b7a3680-199e-4ede-8d59-21ce2165e06d tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] [instance: c2f45f49-0bca-4ae2-bc2a-eed293143489] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 09:37:59 user nova-compute[75122]: DEBUG nova.compute.manager [None req-9b7a3680-199e-4ede-8d59-21ce2165e06d tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] [instance: c2f45f49-0bca-4ae2-bc2a-eed293143489] Start building block device mappings for instance. {{(pid=75122) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 09:37:59 user nova-compute[75122]: DEBUG nova.policy [None req-9b7a3680-199e-4ede-8d59-21ce2165e06d tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '15a69b87dd164c74af2fed014a3c5f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc0f52b1c744b91b4f1a4ecd07e07c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75122) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 09:37:59 user nova-compute[75122]: DEBUG nova.compute.manager [None req-9b7a3680-199e-4ede-8d59-21ce2165e06d tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] [instance: c2f45f49-0bca-4ae2-bc2a-eed293143489] Start spawning the instance on the hypervisor. {{(pid=75122) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 09:37:59 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-9b7a3680-199e-4ede-8d59-21ce2165e06d tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] [instance: c2f45f49-0bca-4ae2-bc2a-eed293143489] Creating instance directory {{(pid=75122) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 09:37:59 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-9b7a3680-199e-4ede-8d59-21ce2165e06d tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] [instance: c2f45f49-0bca-4ae2-bc2a-eed293143489] Creating image(s)
Nov 15 09:37:59 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-9b7a3680-199e-4ede-8d59-21ce2165e06d tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Acquiring lock "/opt/stack/data/nova/instances/c2f45f49-0bca-4ae2-bc2a-eed293143489/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:37:59 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-9b7a3680-199e-4ede-8d59-21ce2165e06d tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Lock "/opt/stack/data/nova/instances/c2f45f49-0bca-4ae2-bc2a-eed293143489/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:37:59 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-9b7a3680-199e-4ede-8d59-21ce2165e06d tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Lock "/opt/stack/data/nova/instances/c2f45f49-0bca-4ae2-bc2a-eed293143489/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:37:59 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-9b7a3680-199e-4ede-8d59-21ce2165e06d tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:37:59 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-9b7a3680-199e-4ede-8d59-21ce2165e06d tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json" returned: 0 in 0.177s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:37:59 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-9b7a3680-199e-4ede-8d59-21ce2165e06d tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Acquiring lock "95d6e29f74d5408f818e32f3bc29bc8270a4c665" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:37:59 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-9b7a3680-199e-4ede-8d59-21ce2165e06d tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Lock "95d6e29f74d5408f818e32f3bc29bc8270a4c665" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:37:59 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-9b7a3680-199e-4ede-8d59-21ce2165e06d tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:38:00 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-9b7a3680-199e-4ede-8d59-21ce2165e06d tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json" returned: 0 in 0.178s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:38:00 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-9b7a3680-199e-4ede-8d59-21ce2165e06d tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665,backing_fmt=raw /opt/stack/data/nova/instances/c2f45f49-0bca-4ae2-bc2a-eed293143489/disk 1073741824 {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:38:00 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-9b7a3680-199e-4ede-8d59-21ce2165e06d tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665,backing_fmt=raw /opt/stack/data/nova/instances/c2f45f49-0bca-4ae2-bc2a-eed293143489/disk 1073741824" returned: 0 in 0.047s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:38:00 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-9b7a3680-199e-4ede-8d59-21ce2165e06d tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Lock "95d6e29f74d5408f818e32f3bc29bc8270a4c665" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.233s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:38:00 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-9b7a3680-199e-4ede-8d59-21ce2165e06d tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:38:00 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-9b7a3680-199e-4ede-8d59-21ce2165e06d tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json" returned: 0 in 0.205s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:38:00 user nova-compute[75122]: DEBUG nova.virt.disk.api [None req-9b7a3680-199e-4ede-8d59-21ce2165e06d tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c2f45f49-0bca-4ae2-bc2a-eed293143489/disk. size=1073741824 {{(pid=75122) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 09:38:00 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-9b7a3680-199e-4ede-8d59-21ce2165e06d tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2f45f49-0bca-4ae2-bc2a-eed293143489/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:38:00 user nova-compute[75122]: DEBUG nova.network.neutron [None req-9b7a3680-199e-4ede-8d59-21ce2165e06d tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] [instance: c2f45f49-0bca-4ae2-bc2a-eed293143489] Successfully created port: 24f9619f-42ba-42cf-b39c-43e14754e913 {{(pid=75122) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 09:38:00 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-9b7a3680-199e-4ede-8d59-21ce2165e06d tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2f45f49-0bca-4ae2-bc2a-eed293143489/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:38:00 user nova-compute[75122]: DEBUG nova.virt.disk.api [None req-9b7a3680-199e-4ede-8d59-21ce2165e06d tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Cannot resize image /opt/stack/data/nova/instances/c2f45f49-0bca-4ae2-bc2a-eed293143489/disk to a smaller size. {{(pid=75122) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 09:38:00 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-9b7a3680-199e-4ede-8d59-21ce2165e06d tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] [instance: c2f45f49-0bca-4ae2-bc2a-eed293143489] Created local disks {{(pid=75122) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 09:38:00 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-9b7a3680-199e-4ede-8d59-21ce2165e06d tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] [instance: c2f45f49-0bca-4ae2-bc2a-eed293143489] Ensure instance console log exists: /opt/stack/data/nova/instances/c2f45f49-0bca-4ae2-bc2a-eed293143489/console.log {{(pid=75122) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 09:38:00 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-9b7a3680-199e-4ede-8d59-21ce2165e06d tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:38:00 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-9b7a3680-199e-4ede-8d59-21ce2165e06d tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:38:00 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-9b7a3680-199e-4ede-8d59-21ce2165e06d tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:38:00 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:38:01 user nova-compute[75122]: DEBUG nova.network.neutron [None req-9b7a3680-199e-4ede-8d59-21ce2165e06d tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] [instance: c2f45f49-0bca-4ae2-bc2a-eed293143489] Successfully updated port: 24f9619f-42ba-42cf-b39c-43e14754e913 {{(pid=75122) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 09:38:01 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-9b7a3680-199e-4ede-8d59-21ce2165e06d tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Acquiring lock "refresh_cache-c2f45f49-0bca-4ae2-bc2a-eed293143489" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 09:38:01 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-9b7a3680-199e-4ede-8d59-21ce2165e06d tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Acquired lock "refresh_cache-c2f45f49-0bca-4ae2-bc2a-eed293143489" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 09:38:01 user nova-compute[75122]: DEBUG nova.network.neutron [None req-9b7a3680-199e-4ede-8d59-21ce2165e06d tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] [instance: c2f45f49-0bca-4ae2-bc2a-eed293143489] Building network info cache for instance {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 09:38:01 user nova-compute[75122]: DEBUG nova.compute.manager [req-d903c7bc-104a-4e10-bd9e-1f7bf496252b req-d7acfcba-d0d6-454e-9552-64d6df165bb6 service nova] [instance: c2f45f49-0bca-4ae2-bc2a-eed293143489] Received event network-changed-24f9619f-42ba-42cf-b39c-43e14754e913 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:38:01 user nova-compute[75122]: DEBUG nova.compute.manager [req-d903c7bc-104a-4e10-bd9e-1f7bf496252b req-d7acfcba-d0d6-454e-9552-64d6df165bb6 service nova] [instance: c2f45f49-0bca-4ae2-bc2a-eed293143489] Refreshing instance network info cache due to event network-changed-24f9619f-42ba-42cf-b39c-43e14754e913. {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 09:38:01 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-d903c7bc-104a-4e10-bd9e-1f7bf496252b req-d7acfcba-d0d6-454e-9552-64d6df165bb6 service nova] Acquiring lock "refresh_cache-c2f45f49-0bca-4ae2-bc2a-eed293143489" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 09:38:01 user nova-compute[75122]: DEBUG nova.network.neutron [None req-9b7a3680-199e-4ede-8d59-21ce2165e06d tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] [instance: c2f45f49-0bca-4ae2-bc2a-eed293143489] Instance cache missing network info. {{(pid=75122) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 09:38:01 user nova-compute[75122]: DEBUG nova.network.neutron [None req-9b7a3680-199e-4ede-8d59-21ce2165e06d tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] [instance: c2f45f49-0bca-4ae2-bc2a-eed293143489] Updating instance_info_cache with network_info: [{"id": "24f9619f-42ba-42cf-b39c-43e14754e913", "address": "fa:16:3e:92:99:9d", "network": {"id": "387b4fc3-39ad-40c3-bcd7-7526b09e30b7", "bridge": "br-int", "label": "tempest-TestStampPattern-1501769990-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bdc0f52b1c744b91b4f1a4ecd07e07c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24f9619f-42", "ovs_interfaceid": "24f9619f-42ba-42cf-b39c-43e14754e913", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:38:01 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-9b7a3680-199e-4ede-8d59-21ce2165e06d tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Releasing lock "refresh_cache-c2f45f49-0bca-4ae2-bc2a-eed293143489" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 09:38:01 user nova-compute[75122]: DEBUG nova.compute.manager [None req-9b7a3680-199e-4ede-8d59-21ce2165e06d tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] [instance: c2f45f49-0bca-4ae2-bc2a-eed293143489] Instance network_info: |[{"id": "24f9619f-42ba-42cf-b39c-43e14754e913", "address": "fa:16:3e:92:99:9d", "network": {"id": "387b4fc3-39ad-40c3-bcd7-7526b09e30b7", "bridge": "br-int", "label": "tempest-TestStampPattern-1501769990-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bdc0f52b1c744b91b4f1a4ecd07e07c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24f9619f-42", "ovs_interfaceid": "24f9619f-42ba-42cf-b39c-43e14754e913", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75122) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 09:38:01 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-d903c7bc-104a-4e10-bd9e-1f7bf496252b req-d7acfcba-d0d6-454e-9552-64d6df165bb6 service nova] Acquired lock "refresh_cache-c2f45f49-0bca-4ae2-bc2a-eed293143489" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 09:38:01 user nova-compute[75122]: DEBUG nova.network.neutron [req-d903c7bc-104a-4e10-bd9e-1f7bf496252b req-d7acfcba-d0d6-454e-9552-64d6df165bb6 service nova] [instance: c2f45f49-0bca-4ae2-bc2a-eed293143489] Refreshing network info cache for port 24f9619f-42ba-42cf-b39c-43e14754e913 {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 09:38:01 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-9b7a3680-199e-4ede-8d59-21ce2165e06d tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] [instance: c2f45f49-0bca-4ae2-bc2a-eed293143489] Start _get_guest_xml network_info=[{"id": "24f9619f-42ba-42cf-b39c-43e14754e913", "address": "fa:16:3e:92:99:9d", "network": {"id": "387b4fc3-39ad-40c3-bcd7-7526b09e30b7", "bridge": "br-int", "label": "tempest-TestStampPattern-1501769990-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bdc0f52b1c744b91b4f1a4ecd07e07c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24f9619f-42", "ovs_interfaceid": "24f9619f-42ba-42cf-b39c-43e14754e913", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T09:26:31Z,direct_url=<?>,disk_format='qcow2',id=5e862cfe-47b8-4725-8292-65761ee6d0f5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9c57733cb41847c0b4ad31519c382e5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T09:26:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '5e862cfe-47b8-4725-8292-65761ee6d0f5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75122) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 09:38:01 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-9b7a3680-199e-4ede-8d59-21ce2165e06d tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 09:38:01 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-9b7a3680-199e-4ede-8d59-21ce2165e06d tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 09:38:01 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-9b7a3680-199e-4ede-8d59-21ce2165e06d tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75122) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 09:38:01 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-9b7a3680-199e-4ede-8d59-21ce2165e06d tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] CPU controller missing on host. {{(pid=75122) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 09:38:01 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-9b7a3680-199e-4ede-8d59-21ce2165e06d tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75122) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 09:38:01 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-9b7a3680-199e-4ede-8d59-21ce2165e06d tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] CPU controller found on host. {{(pid=75122) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 09:38:01 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-9b7a3680-199e-4ede-8d59-21ce2165e06d tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75122) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 09:38:01 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-9b7a3680-199e-4ede-8d59-21ce2165e06d tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T09:26:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T09:26:31Z,direct_url=<?>,disk_format='qcow2',id=5e862cfe-47b8-4725-8292-65761ee6d0f5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9c57733cb41847c0b4ad31519c382e5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T09:26:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 09:38:01 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-9b7a3680-199e-4ede-8d59-21ce2165e06d tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Flavor limits 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 09:38:01 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-9b7a3680-199e-4ede-8d59-21ce2165e06d tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Image limits 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 09:38:01 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-9b7a3680-199e-4ede-8d59-21ce2165e06d tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Flavor pref 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 09:38:01 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-9b7a3680-199e-4ede-8d59-21ce2165e06d tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Image pref 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 09:38:01 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-9b7a3680-199e-4ede-8d59-21ce2165e06d tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 09:38:01 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-9b7a3680-199e-4ede-8d59-21ce2165e06d tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 09:38:01 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-9b7a3680-199e-4ede-8d59-21ce2165e06d tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75122) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 09:38:01 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-9b7a3680-199e-4ede-8d59-21ce2165e06d tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Got 1 possible topologies {{(pid=75122) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 09:38:01 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-9b7a3680-199e-4ede-8d59-21ce2165e06d tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 09:38:01 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-9b7a3680-199e-4ede-8d59-21ce2165e06d tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 09:38:01 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-9b7a3680-199e-4ede-8d59-21ce2165e06d tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T09:37:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-928964176',display_name='tempest-TestStampPattern-server-928964176',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-928964176',id=20,image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLTuyc1m0Na8NQ5VH/Tfx2UBRmDQ41qC6ACQUu2KLBVZhr2oW2YpfUnFSSho5blcWwWbXMeGc1bLerwgE7lxS0HgCpcrAeG55ew3eBiC1wjNqqSI1GsVKLlgwinFMYycdQ==',key_name='tempest-TestStampPattern-625128858',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bdc0f52b1c744b91b4f1a4ecd07e07c1',ramdisk_id='',reservation_id='r-luv17aa6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1896212913',owner_user_name='tempest-TestStampPattern-1896212913-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T09:38:00Z,user_data=None,user_id='15a69b87dd164c74af2fed014a3c5f37',uuid=c2f45f49-0bca-4ae2-bc2a-eed293143489,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "24f9619f-42ba-42cf-b39c-43e14754e913", "address": "fa:16:3e:92:99:9d", "network": {"id": "387b4fc3-39ad-40c3-bcd7-7526b09e30b7", "bridge": "br-int", "label": "tempest-TestStampPattern-1501769990-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bdc0f52b1c744b91b4f1a4ecd07e07c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24f9619f-42", "ovs_interfaceid": "24f9619f-42ba-42cf-b39c-43e14754e913", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75122) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 09:38:01 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-9b7a3680-199e-4ede-8d59-21ce2165e06d tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Converting VIF {"id": "24f9619f-42ba-42cf-b39c-43e14754e913", "address": "fa:16:3e:92:99:9d", "network": {"id": "387b4fc3-39ad-40c3-bcd7-7526b09e30b7", "bridge": "br-int", "label": "tempest-TestStampPattern-1501769990-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bdc0f52b1c744b91b4f1a4ecd07e07c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24f9619f-42", "ovs_interfaceid": "24f9619f-42ba-42cf-b39c-43e14754e913", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 09:38:01 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-9b7a3680-199e-4ede-8d59-21ce2165e06d tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:99:9d,bridge_name='br-int',has_traffic_filtering=True,id=24f9619f-42ba-42cf-b39c-43e14754e913,network=Network(387b4fc3-39ad-40c3-bcd7-7526b09e30b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24f9619f-42') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 09:38:01 user nova-compute[75122]: DEBUG nova.objects.instance [None req-9b7a3680-199e-4ede-8d59-21ce2165e06d tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Lazy-loading 'pci_devices' on Instance uuid c2f45f49-0bca-4ae2-bc2a-eed293143489 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:38:01 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-9b7a3680-199e-4ede-8d59-21ce2165e06d tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] [instance: c2f45f49-0bca-4ae2-bc2a-eed293143489] End _get_guest_xml xml=<domain type="kvm">
Nov 15 09:38:01 user nova-compute[75122]:   <uuid>c2f45f49-0bca-4ae2-bc2a-eed293143489</uuid>
Nov 15 09:38:01 user nova-compute[75122]:   <name>instance-00000014</name>
Nov 15 09:38:01 user nova-compute[75122]:   <memory>524288</memory>
Nov 15 09:38:01 user nova-compute[75122]:   <vcpu>1</vcpu>
Nov 15 09:38:01 user nova-compute[75122]:   <metadata>
Nov 15 09:38:01 user nova-compute[75122]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 09:38:01 user nova-compute[75122]:       <nova:package version="0.0.0"/>
Nov 15 09:38:01 user nova-compute[75122]:       <nova:name>tempest-TestStampPattern-server-928964176</nova:name>
Nov 15 09:38:01 user nova-compute[75122]:       <nova:creationTime>2023-11-15 09:38:01</nova:creationTime>
Nov 15 09:38:01 user nova-compute[75122]:       <nova:flavor name="m1.tiny">
Nov 15 09:38:01 user nova-compute[75122]:         <nova:memory>512</nova:memory>
Nov 15 09:38:01 user nova-compute[75122]:         <nova:disk>1</nova:disk>
Nov 15 09:38:01 user nova-compute[75122]:         <nova:swap>0</nova:swap>
Nov 15 09:38:01 user nova-compute[75122]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 09:38:01 user nova-compute[75122]:         <nova:vcpus>1</nova:vcpus>
Nov 15 09:38:01 user nova-compute[75122]:       </nova:flavor>
Nov 15 09:38:01 user nova-compute[75122]:       <nova:owner>
Nov 15 09:38:01 user nova-compute[75122]:         <nova:user uuid="15a69b87dd164c74af2fed014a3c5f37">tempest-TestStampPattern-1896212913-project-member</nova:user>
Nov 15 09:38:01 user nova-compute[75122]:         <nova:project uuid="bdc0f52b1c744b91b4f1a4ecd07e07c1">tempest-TestStampPattern-1896212913</nova:project>
Nov 15 09:38:01 user nova-compute[75122]:       </nova:owner>
Nov 15 09:38:01 user nova-compute[75122]:       <nova:root type="image" uuid="5e862cfe-47b8-4725-8292-65761ee6d0f5"/>
Nov 15 09:38:01 user nova-compute[75122]:       <nova:ports>
Nov 15 09:38:01 user nova-compute[75122]:         <nova:port uuid="24f9619f-42ba-42cf-b39c-43e14754e913">
Nov 15 09:38:01 user nova-compute[75122]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 15 09:38:01 user nova-compute[75122]:         </nova:port>
Nov 15 09:38:01 user nova-compute[75122]:       </nova:ports>
Nov 15 09:38:01 user nova-compute[75122]:     </nova:instance>
Nov 15 09:38:01 user nova-compute[75122]:   </metadata>
Nov 15 09:38:01 user nova-compute[75122]:   <sysinfo type="smbios">
Nov 15 09:38:01 user nova-compute[75122]:     <system>
Nov 15 09:38:01 user nova-compute[75122]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 09:38:01 user nova-compute[75122]:       <entry name="product">OpenStack Nova</entry>
Nov 15 09:38:01 user nova-compute[75122]:       <entry name="version">0.0.0</entry>
Nov 15 09:38:01 user nova-compute[75122]:       <entry name="serial">c2f45f49-0bca-4ae2-bc2a-eed293143489</entry>
Nov 15 09:38:01 user nova-compute[75122]:       <entry name="uuid">c2f45f49-0bca-4ae2-bc2a-eed293143489</entry>
Nov 15 09:38:01 user nova-compute[75122]:       <entry name="family">Virtual Machine</entry>
Nov 15 09:38:01 user nova-compute[75122]:     </system>
Nov 15 09:38:01 user nova-compute[75122]:   </sysinfo>
Nov 15 09:38:01 user nova-compute[75122]:   <os>
Nov 15 09:38:01 user nova-compute[75122]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 09:38:01 user nova-compute[75122]:     <boot dev="hd"/>
Nov 15 09:38:01 user nova-compute[75122]:     <smbios mode="sysinfo"/>
Nov 15 09:38:01 user nova-compute[75122]:   </os>
Nov 15 09:38:01 user nova-compute[75122]:   <features>
Nov 15 09:38:01 user nova-compute[75122]:     <acpi/>
Nov 15 09:38:01 user nova-compute[75122]:     <apic/>
Nov 15 09:38:01 user nova-compute[75122]:     <vmcoreinfo/>
Nov 15 09:38:01 user nova-compute[75122]:   </features>
Nov 15 09:38:01 user nova-compute[75122]:   <clock offset="utc">
Nov 15 09:38:01 user nova-compute[75122]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 09:38:01 user nova-compute[75122]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 09:38:01 user nova-compute[75122]:     <timer name="hpet" present="no"/>
Nov 15 09:38:01 user nova-compute[75122]:   </clock>
Nov 15 09:38:01 user nova-compute[75122]:   <cpu mode="custom" match="exact">
Nov 15 09:38:01 user nova-compute[75122]:     <model>Nehalem</model>
Nov 15 09:38:01 user nova-compute[75122]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 09:38:01 user nova-compute[75122]:   </cpu>
Nov 15 09:38:01 user nova-compute[75122]:   <devices>
Nov 15 09:38:01 user nova-compute[75122]:     <disk type="file" device="disk">
Nov 15 09:38:01 user nova-compute[75122]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 09:38:01 user nova-compute[75122]:       <source file="/opt/stack/data/nova/instances/c2f45f49-0bca-4ae2-bc2a-eed293143489/disk"/>
Nov 15 09:38:01 user nova-compute[75122]:       <target dev="vda" bus="virtio"/>
Nov 15 09:38:01 user nova-compute[75122]:     </disk>
Nov 15 09:38:01 user nova-compute[75122]:     <interface type="ethernet">
Nov 15 09:38:01 user nova-compute[75122]:       <mac address="fa:16:3e:92:99:9d"/>
Nov 15 09:38:01 user nova-compute[75122]:       <model type="virtio"/>
Nov 15 09:38:01 user nova-compute[75122]:       <mtu size="1442"/>
Nov 15 09:38:01 user nova-compute[75122]:       <target dev="tap24f9619f-42"/>
Nov 15 09:38:01 user nova-compute[75122]:     </interface>
Nov 15 09:38:01 user nova-compute[75122]:     <serial type="pty">
Nov 15 09:38:01 user nova-compute[75122]:       <log file="/opt/stack/data/nova/instances/c2f45f49-0bca-4ae2-bc2a-eed293143489/console.log" append="off"/>
Nov 15 09:38:01 user nova-compute[75122]:     </serial>
Nov 15 09:38:01 user nova-compute[75122]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 09:38:01 user nova-compute[75122]:     <video>
Nov 15 09:38:01 user nova-compute[75122]:       <model type="virtio"/>
Nov 15 09:38:01 user nova-compute[75122]:     </video>
Nov 15 09:38:01 user nova-compute[75122]:     <rng model="virtio">
Nov 15 09:38:01 user nova-compute[75122]:       <backend model="random">/dev/urandom</backend>
Nov 15 09:38:01 user nova-compute[75122]:     </rng>
Nov 15 09:38:01 user nova-compute[75122]:     <controller type="usb" index="0" model="none"/>
Nov 15 09:38:01 user nova-compute[75122]:     <memballoon model="virtio">
Nov 15 09:38:01 user nova-compute[75122]:       <stats period="10"/>
Nov 15 09:38:01 user nova-compute[75122]:     </memballoon>
Nov 15 09:38:01 user nova-compute[75122]:   </devices>
Nov 15 09:38:01 user nova-compute[75122]: </domain>
Nov 15 09:38:01 user nova-compute[75122]:  {{(pid=75122) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 09:38:01 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-9b7a3680-199e-4ede-8d59-21ce2165e06d tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T09:37:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-928964176',display_name='tempest-TestStampPattern-server-928964176',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-928964176',id=20,image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLTuyc1m0Na8NQ5VH/Tfx2UBRmDQ41qC6ACQUu2KLBVZhr2oW2YpfUnFSSho5blcWwWbXMeGc1bLerwgE7lxS0HgCpcrAeG55ew3eBiC1wjNqqSI1GsVKLlgwinFMYycdQ==',key_name='tempest-TestStampPattern-625128858',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bdc0f52b1c744b91b4f1a4ecd07e07c1',ramdisk_id='',reservation_id='r-luv17aa6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1896212913',owner_user_name='tempest-TestStampPattern-1896212913-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T09:38:00Z,user_data=None,user_id='15a69b87dd164c74af2fed014a3c5f37',uuid=c2f45f49-0bca-4ae2-bc2a-eed293143489,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "24f9619f-42ba-42cf-b39c-43e14754e913", "address": "fa:16:3e:92:99:9d", "network": {"id": "387b4fc3-39ad-40c3-bcd7-7526b09e30b7", "bridge": "br-int", "label": "tempest-TestStampPattern-1501769990-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bdc0f52b1c744b91b4f1a4ecd07e07c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24f9619f-42", "ovs_interfaceid": "24f9619f-42ba-42cf-b39c-43e14754e913", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 09:38:01 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-9b7a3680-199e-4ede-8d59-21ce2165e06d tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Converting VIF {"id": "24f9619f-42ba-42cf-b39c-43e14754e913", "address": "fa:16:3e:92:99:9d", "network": {"id": "387b4fc3-39ad-40c3-bcd7-7526b09e30b7", "bridge": "br-int", "label": "tempest-TestStampPattern-1501769990-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bdc0f52b1c744b91b4f1a4ecd07e07c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24f9619f-42", "ovs_interfaceid": "24f9619f-42ba-42cf-b39c-43e14754e913", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 09:38:01 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-9b7a3680-199e-4ede-8d59-21ce2165e06d tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:99:9d,bridge_name='br-int',has_traffic_filtering=True,id=24f9619f-42ba-42cf-b39c-43e14754e913,network=Network(387b4fc3-39ad-40c3-bcd7-7526b09e30b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24f9619f-42') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 09:38:01 user nova-compute[75122]: DEBUG os_vif [None req-9b7a3680-199e-4ede-8d59-21ce2165e06d tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:99:9d,bridge_name='br-int',has_traffic_filtering=True,id=24f9619f-42ba-42cf-b39c-43e14754e913,network=Network(387b4fc3-39ad-40c3-bcd7-7526b09e30b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24f9619f-42') {{(pid=75122) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 09:38:01 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:38:01 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:38:01 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 09:38:01 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:38:01 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4136562b-b4aa-5bdb-a8d7-92ea83bc82bf', '_type': 'linux-noop'}}, row=False) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:38:01 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:38:01 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:38:01 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:38:01 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap24f9619f-42, may_exist=True, interface_attrs={}) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:38:01 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap24f9619f-42, col_values=(('qos', UUID('ea778172-9bfe-49a9-ad85-dc0913f85954')),), if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:38:01 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap24f9619f-42, col_values=(('external_ids', {'iface-id': '24f9619f-42ba-42cf-b39c-43e14754e913', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:92:99:9d', 'vm-uuid': 'c2f45f49-0bca-4ae2-bc2a-eed293143489'}),), if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:38:01 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:38:01 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:38:01 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:38:01 user nova-compute[75122]: INFO os_vif [None req-9b7a3680-199e-4ede-8d59-21ce2165e06d tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:99:9d,bridge_name='br-int',has_traffic_filtering=True,id=24f9619f-42ba-42cf-b39c-43e14754e913,network=Network(387b4fc3-39ad-40c3-bcd7-7526b09e30b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24f9619f-42')
Nov 15 09:38:01 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-4ff8696a-e75f-441f-aea5-e8fb047238ef tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] Acquiring lock "e4d3e4f5-b48f-4fd4-9299-091469824217" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:38:01 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-4ff8696a-e75f-441f-aea5-e8fb047238ef tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] Lock "e4d3e4f5-b48f-4fd4-9299-091469824217" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:38:01 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-9b7a3680-199e-4ede-8d59-21ce2165e06d tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] No BDM found with device name vda, not building metadata. {{(pid=75122) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 09:38:01 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-9b7a3680-199e-4ede-8d59-21ce2165e06d tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] No VIF found with MAC fa:16:3e:92:99:9d, not building metadata {{(pid=75122) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 09:38:01 user nova-compute[75122]: DEBUG nova.compute.manager [None req-4ff8696a-e75f-441f-aea5-e8fb047238ef tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] [instance: e4d3e4f5-b48f-4fd4-9299-091469824217] Starting instance... {{(pid=75122) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 09:38:01 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-4ff8696a-e75f-441f-aea5-e8fb047238ef tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:38:01 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-4ff8696a-e75f-441f-aea5-e8fb047238ef tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:38:01 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-4ff8696a-e75f-441f-aea5-e8fb047238ef tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75122) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 09:38:01 user nova-compute[75122]: INFO nova.compute.claims [None req-4ff8696a-e75f-441f-aea5-e8fb047238ef tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] [instance: e4d3e4f5-b48f-4fd4-9299-091469824217] Claim successful on node user
Nov 15 09:38:02 user nova-compute[75122]: DEBUG nova.network.neutron [req-d903c7bc-104a-4e10-bd9e-1f7bf496252b req-d7acfcba-d0d6-454e-9552-64d6df165bb6 service nova] [instance: c2f45f49-0bca-4ae2-bc2a-eed293143489] Updated VIF entry in instance network info cache for port 24f9619f-42ba-42cf-b39c-43e14754e913. {{(pid=75122) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 09:38:02 user nova-compute[75122]: DEBUG nova.network.neutron [req-d903c7bc-104a-4e10-bd9e-1f7bf496252b req-d7acfcba-d0d6-454e-9552-64d6df165bb6 service nova] [instance: c2f45f49-0bca-4ae2-bc2a-eed293143489] Updating instance_info_cache with network_info: [{"id": "24f9619f-42ba-42cf-b39c-43e14754e913", "address": "fa:16:3e:92:99:9d", "network": {"id": "387b4fc3-39ad-40c3-bcd7-7526b09e30b7", "bridge": "br-int", "label": "tempest-TestStampPattern-1501769990-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bdc0f52b1c744b91b4f1a4ecd07e07c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24f9619f-42", "ovs_interfaceid": "24f9619f-42ba-42cf-b39c-43e14754e913", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:38:02 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-d903c7bc-104a-4e10-bd9e-1f7bf496252b req-d7acfcba-d0d6-454e-9552-64d6df165bb6 service nova] Releasing lock "refresh_cache-c2f45f49-0bca-4ae2-bc2a-eed293143489" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 09:38:02 user nova-compute[75122]: DEBUG nova.compute.provider_tree [None req-4ff8696a-e75f-441f-aea5-e8fb047238ef tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] Inventory has not changed in ProviderTree for provider: 69a3da65-47be-44c6-b67c-c692b58284ef {{(pid=75122) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 09:38:02 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-4ff8696a-e75f-441f-aea5-e8fb047238ef tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] Inventory has not changed for provider 69a3da65-47be-44c6-b67c-c692b58284ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 09:38:02 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-4ff8696a-e75f-441f-aea5-e8fb047238ef tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.437s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:38:02 user nova-compute[75122]: DEBUG nova.compute.manager [None req-4ff8696a-e75f-441f-aea5-e8fb047238ef tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] [instance: e4d3e4f5-b48f-4fd4-9299-091469824217] Start building networks asynchronously for instance. {{(pid=75122) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 09:38:02 user nova-compute[75122]: DEBUG nova.compute.manager [None req-4ff8696a-e75f-441f-aea5-e8fb047238ef tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] [instance: e4d3e4f5-b48f-4fd4-9299-091469824217] Allocating IP information in the background. {{(pid=75122) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 09:38:02 user nova-compute[75122]: DEBUG nova.network.neutron [None req-4ff8696a-e75f-441f-aea5-e8fb047238ef tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] [instance: e4d3e4f5-b48f-4fd4-9299-091469824217] allocate_for_instance() {{(pid=75122) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 09:38:02 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-4ff8696a-e75f-441f-aea5-e8fb047238ef tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] [instance: e4d3e4f5-b48f-4fd4-9299-091469824217] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 09:38:02 user nova-compute[75122]: DEBUG nova.compute.manager [None req-4ff8696a-e75f-441f-aea5-e8fb047238ef tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] [instance: e4d3e4f5-b48f-4fd4-9299-091469824217] Start building block device mappings for instance. {{(pid=75122) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 09:38:02 user nova-compute[75122]: DEBUG nova.policy [None req-4ff8696a-e75f-441f-aea5-e8fb047238ef tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bf43ec7daef3486cbcd5e5d2831e4615', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f97007ed06a04d7ebbc6cd3543a23d96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75122) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 09:38:02 user nova-compute[75122]: DEBUG nova.compute.manager [None req-4ff8696a-e75f-441f-aea5-e8fb047238ef tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] [instance: e4d3e4f5-b48f-4fd4-9299-091469824217] Start spawning the instance on the hypervisor. {{(pid=75122) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 09:38:02 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-4ff8696a-e75f-441f-aea5-e8fb047238ef tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] [instance: e4d3e4f5-b48f-4fd4-9299-091469824217] Creating instance directory {{(pid=75122) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 09:38:02 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-4ff8696a-e75f-441f-aea5-e8fb047238ef tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] [instance: e4d3e4f5-b48f-4fd4-9299-091469824217] Creating image(s)
Nov 15 09:38:02 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-4ff8696a-e75f-441f-aea5-e8fb047238ef tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] Acquiring lock "/opt/stack/data/nova/instances/e4d3e4f5-b48f-4fd4-9299-091469824217/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:38:02 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-4ff8696a-e75f-441f-aea5-e8fb047238ef tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] Lock "/opt/stack/data/nova/instances/e4d3e4f5-b48f-4fd4-9299-091469824217/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:38:02 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-4ff8696a-e75f-441f-aea5-e8fb047238ef tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] Lock "/opt/stack/data/nova/instances/e4d3e4f5-b48f-4fd4-9299-091469824217/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:38:02 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-4ff8696a-e75f-441f-aea5-e8fb047238ef tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:38:02 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-4ff8696a-e75f-441f-aea5-e8fb047238ef tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json" returned: 0 in 0.174s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:38:02 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-4ff8696a-e75f-441f-aea5-e8fb047238ef tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] Acquiring lock "95d6e29f74d5408f818e32f3bc29bc8270a4c665" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:38:02 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-4ff8696a-e75f-441f-aea5-e8fb047238ef tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] Lock "95d6e29f74d5408f818e32f3bc29bc8270a4c665" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:38:02 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-4ff8696a-e75f-441f-aea5-e8fb047238ef tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:38:02 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-4ff8696a-e75f-441f-aea5-e8fb047238ef tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json" returned: 0 in 0.187s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:38:02 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-4ff8696a-e75f-441f-aea5-e8fb047238ef tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665,backing_fmt=raw /opt/stack/data/nova/instances/e4d3e4f5-b48f-4fd4-9299-091469824217/disk 1073741824 {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:38:03 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-4ff8696a-e75f-441f-aea5-e8fb047238ef tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665,backing_fmt=raw /opt/stack/data/nova/instances/e4d3e4f5-b48f-4fd4-9299-091469824217/disk 1073741824" returned: 0 in 0.122s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:38:03 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-4ff8696a-e75f-441f-aea5-e8fb047238ef tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] Lock "95d6e29f74d5408f818e32f3bc29bc8270a4c665" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.316s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:38:03 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-4ff8696a-e75f-441f-aea5-e8fb047238ef tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:38:03 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:38:03 user nova-compute[75122]: DEBUG nova.network.neutron [None req-4ff8696a-e75f-441f-aea5-e8fb047238ef tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] [instance: e4d3e4f5-b48f-4fd4-9299-091469824217] Successfully created port: a3f00d6e-75c6-4c47-b4a4-366a791c3f24 {{(pid=75122) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 09:38:03 user nova-compute[75122]: DEBUG nova.compute.manager [req-2c00879b-a202-41e9-bbaf-e85824c3d96a req-75cb5bf1-06db-42e2-af57-a4ec45a28a75 service nova] [instance: c2f45f49-0bca-4ae2-bc2a-eed293143489] Received event network-vif-plugged-24f9619f-42ba-42cf-b39c-43e14754e913 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:38:03 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-2c00879b-a202-41e9-bbaf-e85824c3d96a req-75cb5bf1-06db-42e2-af57-a4ec45a28a75 service nova] Acquiring lock "c2f45f49-0bca-4ae2-bc2a-eed293143489-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:38:03 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-2c00879b-a202-41e9-bbaf-e85824c3d96a req-75cb5bf1-06db-42e2-af57-a4ec45a28a75 service nova] Lock "c2f45f49-0bca-4ae2-bc2a-eed293143489-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:38:03 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-2c00879b-a202-41e9-bbaf-e85824c3d96a req-75cb5bf1-06db-42e2-af57-a4ec45a28a75 service nova] Lock "c2f45f49-0bca-4ae2-bc2a-eed293143489-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:38:03 user nova-compute[75122]: DEBUG nova.compute.manager [req-2c00879b-a202-41e9-bbaf-e85824c3d96a req-75cb5bf1-06db-42e2-af57-a4ec45a28a75 service nova] [instance: c2f45f49-0bca-4ae2-bc2a-eed293143489] No waiting events found dispatching network-vif-plugged-24f9619f-42ba-42cf-b39c-43e14754e913 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:38:03 user nova-compute[75122]: WARNING nova.compute.manager [req-2c00879b-a202-41e9-bbaf-e85824c3d96a req-75cb5bf1-06db-42e2-af57-a4ec45a28a75 service nova] [instance: c2f45f49-0bca-4ae2-bc2a-eed293143489] Received unexpected event network-vif-plugged-24f9619f-42ba-42cf-b39c-43e14754e913 for instance with vm_state building and task_state spawning.
Nov 15 09:38:03 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-4ff8696a-e75f-441f-aea5-e8fb047238ef tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json" returned: 0 in 0.238s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:38:03 user nova-compute[75122]: DEBUG nova.virt.disk.api [None req-4ff8696a-e75f-441f-aea5-e8fb047238ef tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e4d3e4f5-b48f-4fd4-9299-091469824217/disk. size=1073741824 {{(pid=75122) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 09:38:03 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-4ff8696a-e75f-441f-aea5-e8fb047238ef tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4d3e4f5-b48f-4fd4-9299-091469824217/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:38:03 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-4ff8696a-e75f-441f-aea5-e8fb047238ef tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4d3e4f5-b48f-4fd4-9299-091469824217/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:38:03 user nova-compute[75122]: DEBUG nova.virt.disk.api [None req-4ff8696a-e75f-441f-aea5-e8fb047238ef tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] Cannot resize image /opt/stack/data/nova/instances/e4d3e4f5-b48f-4fd4-9299-091469824217/disk to a smaller size. {{(pid=75122) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 09:38:03 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-4ff8696a-e75f-441f-aea5-e8fb047238ef tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] [instance: e4d3e4f5-b48f-4fd4-9299-091469824217] Created local disks {{(pid=75122) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 09:38:03 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-4ff8696a-e75f-441f-aea5-e8fb047238ef tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] [instance: e4d3e4f5-b48f-4fd4-9299-091469824217] Ensure instance console log exists: /opt/stack/data/nova/instances/e4d3e4f5-b48f-4fd4-9299-091469824217/console.log {{(pid=75122) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 09:38:03 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-4ff8696a-e75f-441f-aea5-e8fb047238ef tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:38:03 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-4ff8696a-e75f-441f-aea5-e8fb047238ef tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:38:03 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-4ff8696a-e75f-441f-aea5-e8fb047238ef tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:38:03 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:38:03 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:38:03 user nova-compute[75122]: DEBUG nova.network.neutron [None req-4ff8696a-e75f-441f-aea5-e8fb047238ef tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] [instance: e4d3e4f5-b48f-4fd4-9299-091469824217] Successfully updated port: a3f00d6e-75c6-4c47-b4a4-366a791c3f24 {{(pid=75122) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 09:38:03 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-4ff8696a-e75f-441f-aea5-e8fb047238ef tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] Acquiring lock "refresh_cache-e4d3e4f5-b48f-4fd4-9299-091469824217" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 09:38:03 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-4ff8696a-e75f-441f-aea5-e8fb047238ef tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] Acquired lock "refresh_cache-e4d3e4f5-b48f-4fd4-9299-091469824217" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 09:38:03 user nova-compute[75122]: DEBUG nova.network.neutron [None req-4ff8696a-e75f-441f-aea5-e8fb047238ef tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] [instance: e4d3e4f5-b48f-4fd4-9299-091469824217] Building network info cache for instance {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 09:38:03 user nova-compute[75122]: DEBUG nova.compute.manager [req-35ff3cc5-beb4-4d20-b874-527cf80f22de req-ccc95435-6da9-4172-b6ed-0d9b1d7b095e service nova] [instance: e4d3e4f5-b48f-4fd4-9299-091469824217] Received event network-changed-a3f00d6e-75c6-4c47-b4a4-366a791c3f24 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:38:03 user nova-compute[75122]: DEBUG nova.compute.manager [req-35ff3cc5-beb4-4d20-b874-527cf80f22de req-ccc95435-6da9-4172-b6ed-0d9b1d7b095e service nova] [instance: e4d3e4f5-b48f-4fd4-9299-091469824217] Refreshing instance network info cache due to event network-changed-a3f00d6e-75c6-4c47-b4a4-366a791c3f24. {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 09:38:03 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-35ff3cc5-beb4-4d20-b874-527cf80f22de req-ccc95435-6da9-4172-b6ed-0d9b1d7b095e service nova] Acquiring lock "refresh_cache-e4d3e4f5-b48f-4fd4-9299-091469824217" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 09:38:04 user nova-compute[75122]: DEBUG nova.network.neutron [None req-4ff8696a-e75f-441f-aea5-e8fb047238ef tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] [instance: e4d3e4f5-b48f-4fd4-9299-091469824217] Instance cache missing network info. {{(pid=75122) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 09:38:04 user nova-compute[75122]: DEBUG nova.network.neutron [None req-4ff8696a-e75f-441f-aea5-e8fb047238ef tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] [instance: e4d3e4f5-b48f-4fd4-9299-091469824217] Updating instance_info_cache with network_info: [{"id": "a3f00d6e-75c6-4c47-b4a4-366a791c3f24", "address": "fa:16:3e:da:d5:b8", "network": {"id": "cd65f44e-6f5f-40c7-87f0-de082fb2bda9", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-635927865-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f97007ed06a04d7ebbc6cd3543a23d96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3f00d6e-75", "ovs_interfaceid": "a3f00d6e-75c6-4c47-b4a4-366a791c3f24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:38:04 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-4ff8696a-e75f-441f-aea5-e8fb047238ef tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] Releasing lock "refresh_cache-e4d3e4f5-b48f-4fd4-9299-091469824217" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 09:38:04 user nova-compute[75122]: DEBUG nova.compute.manager [None req-4ff8696a-e75f-441f-aea5-e8fb047238ef tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] [instance: e4d3e4f5-b48f-4fd4-9299-091469824217] Instance network_info: |[{"id": "a3f00d6e-75c6-4c47-b4a4-366a791c3f24", "address": "fa:16:3e:da:d5:b8", "network": {"id": "cd65f44e-6f5f-40c7-87f0-de082fb2bda9", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-635927865-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f97007ed06a04d7ebbc6cd3543a23d96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3f00d6e-75", "ovs_interfaceid": "a3f00d6e-75c6-4c47-b4a4-366a791c3f24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75122) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 09:38:04 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-35ff3cc5-beb4-4d20-b874-527cf80f22de req-ccc95435-6da9-4172-b6ed-0d9b1d7b095e service nova] Acquired lock "refresh_cache-e4d3e4f5-b48f-4fd4-9299-091469824217" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 09:38:04 user nova-compute[75122]: DEBUG nova.network.neutron [req-35ff3cc5-beb4-4d20-b874-527cf80f22de req-ccc95435-6da9-4172-b6ed-0d9b1d7b095e service nova] [instance: e4d3e4f5-b48f-4fd4-9299-091469824217] Refreshing network info cache for port a3f00d6e-75c6-4c47-b4a4-366a791c3f24 {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 09:38:04 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-4ff8696a-e75f-441f-aea5-e8fb047238ef tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] [instance: e4d3e4f5-b48f-4fd4-9299-091469824217] Start _get_guest_xml network_info=[{"id": "a3f00d6e-75c6-4c47-b4a4-366a791c3f24", "address": "fa:16:3e:da:d5:b8", "network": {"id": "cd65f44e-6f5f-40c7-87f0-de082fb2bda9", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-635927865-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f97007ed06a04d7ebbc6cd3543a23d96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3f00d6e-75", "ovs_interfaceid": "a3f00d6e-75c6-4c47-b4a4-366a791c3f24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T09:26:31Z,direct_url=<?>,disk_format='qcow2',id=5e862cfe-47b8-4725-8292-65761ee6d0f5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9c57733cb41847c0b4ad31519c382e5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T09:26:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '5e862cfe-47b8-4725-8292-65761ee6d0f5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75122) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 09:38:04 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-4ff8696a-e75f-441f-aea5-e8fb047238ef tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 09:38:04 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-4ff8696a-e75f-441f-aea5-e8fb047238ef tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 09:38:04 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-4ff8696a-e75f-441f-aea5-e8fb047238ef tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75122) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 09:38:04 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-4ff8696a-e75f-441f-aea5-e8fb047238ef tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] CPU controller missing on host. {{(pid=75122) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 09:38:04 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-4ff8696a-e75f-441f-aea5-e8fb047238ef tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75122) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 09:38:04 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-4ff8696a-e75f-441f-aea5-e8fb047238ef tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] CPU controller found on host. {{(pid=75122) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 09:38:04 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-4ff8696a-e75f-441f-aea5-e8fb047238ef tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75122) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 09:38:04 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-4ff8696a-e75f-441f-aea5-e8fb047238ef tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T09:26:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T09:26:31Z,direct_url=<?>,disk_format='qcow2',id=5e862cfe-47b8-4725-8292-65761ee6d0f5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9c57733cb41847c0b4ad31519c382e5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T09:26:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 09:38:04 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-4ff8696a-e75f-441f-aea5-e8fb047238ef tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] Flavor limits 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 09:38:04 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-4ff8696a-e75f-441f-aea5-e8fb047238ef tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] Image limits 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 09:38:04 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-4ff8696a-e75f-441f-aea5-e8fb047238ef tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] Flavor pref 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 09:38:04 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-4ff8696a-e75f-441f-aea5-e8fb047238ef tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] Image pref 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 09:38:04 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-4ff8696a-e75f-441f-aea5-e8fb047238ef tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 09:38:04 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-4ff8696a-e75f-441f-aea5-e8fb047238ef tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 09:38:04 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-4ff8696a-e75f-441f-aea5-e8fb047238ef tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75122) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 09:38:04 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-4ff8696a-e75f-441f-aea5-e8fb047238ef tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] Got 1 possible topologies {{(pid=75122) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 09:38:04 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-4ff8696a-e75f-441f-aea5-e8fb047238ef tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 09:38:04 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-4ff8696a-e75f-441f-aea5-e8fb047238ef tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 09:38:04 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-4ff8696a-e75f-441f-aea5-e8fb047238ef tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T09:38:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-803024308',display_name='tempest-VolumesAdminNegativeTest-server-803024308',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-803024308',id=21,image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f97007ed06a04d7ebbc6cd3543a23d96',ramdisk_id='',reservation_id='r-w7tso5dz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1303240267',owner_user_name='tempest-VolumesAdminNegativeTest-1303240267-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T09:38:03Z,user_data=None,user_id='bf43ec7daef3486cbcd5e5d2831e4615',uuid=e4d3e4f5-b48f-4fd4-9299-091469824217,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a3f00d6e-75c6-4c47-b4a4-366a791c3f24", "address": "fa:16:3e:da:d5:b8", "network": {"id": "cd65f44e-6f5f-40c7-87f0-de082fb2bda9", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-635927865-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f97007ed06a04d7ebbc6cd3543a23d96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3f00d6e-75", "ovs_interfaceid": "a3f00d6e-75c6-4c47-b4a4-366a791c3f24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75122) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 09:38:04 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-4ff8696a-e75f-441f-aea5-e8fb047238ef tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] Converting VIF {"id": "a3f00d6e-75c6-4c47-b4a4-366a791c3f24", "address": "fa:16:3e:da:d5:b8", "network": {"id": "cd65f44e-6f5f-40c7-87f0-de082fb2bda9", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-635927865-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f97007ed06a04d7ebbc6cd3543a23d96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3f00d6e-75", "ovs_interfaceid": "a3f00d6e-75c6-4c47-b4a4-366a791c3f24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 09:38:04 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-4ff8696a-e75f-441f-aea5-e8fb047238ef tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:d5:b8,bridge_name='br-int',has_traffic_filtering=True,id=a3f00d6e-75c6-4c47-b4a4-366a791c3f24,network=Network(cd65f44e-6f5f-40c7-87f0-de082fb2bda9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3f00d6e-75') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 09:38:04 user nova-compute[75122]: DEBUG nova.objects.instance [None req-4ff8696a-e75f-441f-aea5-e8fb047238ef tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] Lazy-loading 'pci_devices' on Instance uuid e4d3e4f5-b48f-4fd4-9299-091469824217 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:38:04 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-4ff8696a-e75f-441f-aea5-e8fb047238ef tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] [instance: e4d3e4f5-b48f-4fd4-9299-091469824217] End _get_guest_xml xml=<domain type="kvm">
Nov 15 09:38:04 user nova-compute[75122]:   <uuid>e4d3e4f5-b48f-4fd4-9299-091469824217</uuid>
Nov 15 09:38:04 user nova-compute[75122]:   <name>instance-00000015</name>
Nov 15 09:38:04 user nova-compute[75122]:   <memory>524288</memory>
Nov 15 09:38:04 user nova-compute[75122]:   <vcpu>1</vcpu>
Nov 15 09:38:04 user nova-compute[75122]:   <metadata>
Nov 15 09:38:04 user nova-compute[75122]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 09:38:04 user nova-compute[75122]:       <nova:package version="0.0.0"/>
Nov 15 09:38:04 user nova-compute[75122]:       <nova:name>tempest-VolumesAdminNegativeTest-server-803024308</nova:name>
Nov 15 09:38:04 user nova-compute[75122]:       <nova:creationTime>2023-11-15 09:38:04</nova:creationTime>
Nov 15 09:38:04 user nova-compute[75122]:       <nova:flavor name="m1.tiny">
Nov 15 09:38:04 user nova-compute[75122]:         <nova:memory>512</nova:memory>
Nov 15 09:38:04 user nova-compute[75122]:         <nova:disk>1</nova:disk>
Nov 15 09:38:04 user nova-compute[75122]:         <nova:swap>0</nova:swap>
Nov 15 09:38:04 user nova-compute[75122]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 09:38:04 user nova-compute[75122]:         <nova:vcpus>1</nova:vcpus>
Nov 15 09:38:04 user nova-compute[75122]:       </nova:flavor>
Nov 15 09:38:04 user nova-compute[75122]:       <nova:owner>
Nov 15 09:38:04 user nova-compute[75122]:         <nova:user uuid="bf43ec7daef3486cbcd5e5d2831e4615">tempest-VolumesAdminNegativeTest-1303240267-project-member</nova:user>
Nov 15 09:38:04 user nova-compute[75122]:         <nova:project uuid="f97007ed06a04d7ebbc6cd3543a23d96">tempest-VolumesAdminNegativeTest-1303240267</nova:project>
Nov 15 09:38:04 user nova-compute[75122]:       </nova:owner>
Nov 15 09:38:04 user nova-compute[75122]:       <nova:root type="image" uuid="5e862cfe-47b8-4725-8292-65761ee6d0f5"/>
Nov 15 09:38:04 user nova-compute[75122]:       <nova:ports>
Nov 15 09:38:04 user nova-compute[75122]:         <nova:port uuid="a3f00d6e-75c6-4c47-b4a4-366a791c3f24">
Nov 15 09:38:04 user nova-compute[75122]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 15 09:38:04 user nova-compute[75122]:         </nova:port>
Nov 15 09:38:04 user nova-compute[75122]:       </nova:ports>
Nov 15 09:38:04 user nova-compute[75122]:     </nova:instance>
Nov 15 09:38:04 user nova-compute[75122]:   </metadata>
Nov 15 09:38:04 user nova-compute[75122]:   <sysinfo type="smbios">
Nov 15 09:38:04 user nova-compute[75122]:     <system>
Nov 15 09:38:04 user nova-compute[75122]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 09:38:04 user nova-compute[75122]:       <entry name="product">OpenStack Nova</entry>
Nov 15 09:38:04 user nova-compute[75122]:       <entry name="version">0.0.0</entry>
Nov 15 09:38:04 user nova-compute[75122]:       <entry name="serial">e4d3e4f5-b48f-4fd4-9299-091469824217</entry>
Nov 15 09:38:04 user nova-compute[75122]:       <entry name="uuid">e4d3e4f5-b48f-4fd4-9299-091469824217</entry>
Nov 15 09:38:04 user nova-compute[75122]:       <entry name="family">Virtual Machine</entry>
Nov 15 09:38:04 user nova-compute[75122]:     </system>
Nov 15 09:38:04 user nova-compute[75122]:   </sysinfo>
Nov 15 09:38:04 user nova-compute[75122]:   <os>
Nov 15 09:38:04 user nova-compute[75122]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 09:38:04 user nova-compute[75122]:     <boot dev="hd"/>
Nov 15 09:38:04 user nova-compute[75122]:     <smbios mode="sysinfo"/>
Nov 15 09:38:04 user nova-compute[75122]:   </os>
Nov 15 09:38:04 user nova-compute[75122]:   <features>
Nov 15 09:38:04 user nova-compute[75122]:     <acpi/>
Nov 15 09:38:04 user nova-compute[75122]:     <apic/>
Nov 15 09:38:04 user nova-compute[75122]:     <vmcoreinfo/>
Nov 15 09:38:04 user nova-compute[75122]:   </features>
Nov 15 09:38:04 user nova-compute[75122]:   <clock offset="utc">
Nov 15 09:38:04 user nova-compute[75122]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 09:38:04 user nova-compute[75122]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 09:38:04 user nova-compute[75122]:     <timer name="hpet" present="no"/>
Nov 15 09:38:04 user nova-compute[75122]:   </clock>
Nov 15 09:38:04 user nova-compute[75122]:   <cpu mode="custom" match="exact">
Nov 15 09:38:04 user nova-compute[75122]:     <model>Nehalem</model>
Nov 15 09:38:04 user nova-compute[75122]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 09:38:04 user nova-compute[75122]:   </cpu>
Nov 15 09:38:04 user nova-compute[75122]:   <devices>
Nov 15 09:38:04 user nova-compute[75122]:     <disk type="file" device="disk">
Nov 15 09:38:04 user nova-compute[75122]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 09:38:04 user nova-compute[75122]:       <source file="/opt/stack/data/nova/instances/e4d3e4f5-b48f-4fd4-9299-091469824217/disk"/>
Nov 15 09:38:04 user nova-compute[75122]:       <target dev="vda" bus="virtio"/>
Nov 15 09:38:04 user nova-compute[75122]:     </disk>
Nov 15 09:38:04 user nova-compute[75122]:     <interface type="ethernet">
Nov 15 09:38:04 user nova-compute[75122]:       <mac address="fa:16:3e:da:d5:b8"/>
Nov 15 09:38:04 user nova-compute[75122]:       <model type="virtio"/>
Nov 15 09:38:04 user nova-compute[75122]:       <mtu size="1442"/>
Nov 15 09:38:04 user nova-compute[75122]:       <target dev="tapa3f00d6e-75"/>
Nov 15 09:38:04 user nova-compute[75122]:     </interface>
Nov 15 09:38:04 user nova-compute[75122]:     <serial type="pty">
Nov 15 09:38:04 user nova-compute[75122]:       <log file="/opt/stack/data/nova/instances/e4d3e4f5-b48f-4fd4-9299-091469824217/console.log" append="off"/>
Nov 15 09:38:04 user nova-compute[75122]:     </serial>
Nov 15 09:38:04 user nova-compute[75122]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 09:38:04 user nova-compute[75122]:     <video>
Nov 15 09:38:04 user nova-compute[75122]:       <model type="virtio"/>
Nov 15 09:38:04 user nova-compute[75122]:     </video>
Nov 15 09:38:04 user nova-compute[75122]:     <rng model="virtio">
Nov 15 09:38:04 user nova-compute[75122]:       <backend model="random">/dev/urandom</backend>
Nov 15 09:38:04 user nova-compute[75122]:     </rng>
Nov 15 09:38:04 user nova-compute[75122]:     <controller type="usb" index="0" model="none"/>
Nov 15 09:38:04 user nova-compute[75122]:     <memballoon model="virtio">
Nov 15 09:38:04 user nova-compute[75122]:       <stats period="10"/>
Nov 15 09:38:04 user nova-compute[75122]:     </memballoon>
Nov 15 09:38:04 user nova-compute[75122]:   </devices>
Nov 15 09:38:04 user nova-compute[75122]: </domain>
Nov 15 09:38:04 user nova-compute[75122]:  {{(pid=75122) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 09:38:04 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-4ff8696a-e75f-441f-aea5-e8fb047238ef tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T09:38:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-803024308',display_name='tempest-VolumesAdminNegativeTest-server-803024308',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-803024308',id=21,image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f97007ed06a04d7ebbc6cd3543a23d96',ramdisk_id='',reservation_id='r-w7tso5dz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1303240267',owner_user_name='tempest-VolumesAdminNegativeTest-1303240267-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T09:38:03Z,user_data=None,user_id='bf43ec7daef3486cbcd5e5d2831e4615',uuid=e4d3e4f5-b48f-4fd4-9299-091469824217,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a3f00d6e-75c6-4c47-b4a4-366a791c3f24", "address": "fa:16:3e:da:d5:b8", "network": {"id": "cd65f44e-6f5f-40c7-87f0-de082fb2bda9", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-635927865-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f97007ed06a04d7ebbc6cd3543a23d96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3f00d6e-75", "ovs_interfaceid": "a3f00d6e-75c6-4c47-b4a4-366a791c3f24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 09:38:04 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-4ff8696a-e75f-441f-aea5-e8fb047238ef tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] Converting VIF {"id": "a3f00d6e-75c6-4c47-b4a4-366a791c3f24", "address": "fa:16:3e:da:d5:b8", "network": {"id": "cd65f44e-6f5f-40c7-87f0-de082fb2bda9", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-635927865-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f97007ed06a04d7ebbc6cd3543a23d96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3f00d6e-75", "ovs_interfaceid": "a3f00d6e-75c6-4c47-b4a4-366a791c3f24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 09:38:04 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-4ff8696a-e75f-441f-aea5-e8fb047238ef tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:d5:b8,bridge_name='br-int',has_traffic_filtering=True,id=a3f00d6e-75c6-4c47-b4a4-366a791c3f24,network=Network(cd65f44e-6f5f-40c7-87f0-de082fb2bda9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3f00d6e-75') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 09:38:04 user nova-compute[75122]: DEBUG os_vif [None req-4ff8696a-e75f-441f-aea5-e8fb047238ef tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:d5:b8,bridge_name='br-int',has_traffic_filtering=True,id=a3f00d6e-75c6-4c47-b4a4-366a791c3f24,network=Network(cd65f44e-6f5f-40c7-87f0-de082fb2bda9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3f00d6e-75') {{(pid=75122) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 09:38:04 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:38:04 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:38:04 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 09:38:04 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:38:04 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1ae6c526-81c3-5024-a45c-ec2b62607100', '_type': 'linux-noop'}}, row=False) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:38:04 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:38:04 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:38:04 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:38:04 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa3f00d6e-75, may_exist=True, interface_attrs={}) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:38:04 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa3f00d6e-75, col_values=(('qos', UUID('a63d12dc-42ca-4a68-a666-367113c9d093')),), if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:38:04 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa3f00d6e-75, col_values=(('external_ids', {'iface-id': 'a3f00d6e-75c6-4c47-b4a4-366a791c3f24', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:da:d5:b8', 'vm-uuid': 'e4d3e4f5-b48f-4fd4-9299-091469824217'}),), if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:38:04 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:38:04 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:38:04 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:38:04 user nova-compute[75122]: INFO os_vif [None req-4ff8696a-e75f-441f-aea5-e8fb047238ef tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:d5:b8,bridge_name='br-int',has_traffic_filtering=True,id=a3f00d6e-75c6-4c47-b4a4-366a791c3f24,network=Network(cd65f44e-6f5f-40c7-87f0-de082fb2bda9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3f00d6e-75')
Nov 15 09:38:04 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-4ff8696a-e75f-441f-aea5-e8fb047238ef tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] No BDM found with device name vda, not building metadata. {{(pid=75122) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 09:38:04 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-4ff8696a-e75f-441f-aea5-e8fb047238ef tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] No VIF found with MAC fa:16:3e:da:d5:b8, not building metadata {{(pid=75122) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 09:38:04 user nova-compute[75122]: DEBUG nova.network.neutron [req-35ff3cc5-beb4-4d20-b874-527cf80f22de req-ccc95435-6da9-4172-b6ed-0d9b1d7b095e service nova] [instance: e4d3e4f5-b48f-4fd4-9299-091469824217] Updated VIF entry in instance network info cache for port a3f00d6e-75c6-4c47-b4a4-366a791c3f24. {{(pid=75122) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 09:38:04 user nova-compute[75122]: DEBUG nova.network.neutron [req-35ff3cc5-beb4-4d20-b874-527cf80f22de req-ccc95435-6da9-4172-b6ed-0d9b1d7b095e service nova] [instance: e4d3e4f5-b48f-4fd4-9299-091469824217] Updating instance_info_cache with network_info: [{"id": "a3f00d6e-75c6-4c47-b4a4-366a791c3f24", "address": "fa:16:3e:da:d5:b8", "network": {"id": "cd65f44e-6f5f-40c7-87f0-de082fb2bda9", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-635927865-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f97007ed06a04d7ebbc6cd3543a23d96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3f00d6e-75", "ovs_interfaceid": "a3f00d6e-75c6-4c47-b4a4-366a791c3f24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:38:04 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-35ff3cc5-beb4-4d20-b874-527cf80f22de req-ccc95435-6da9-4172-b6ed-0d9b1d7b095e service nova] Releasing lock "refresh_cache-e4d3e4f5-b48f-4fd4-9299-091469824217" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 09:38:05 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-ee8c3666-c77c-426b-a8bb-d09746711753 tempest-VolumesNegativeTest-1736222970 tempest-VolumesNegativeTest-1736222970-project-member] Acquiring lock "ff1c5639-9d63-409a-bbd7-1de63f57b189" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:38:05 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-ee8c3666-c77c-426b-a8bb-d09746711753 tempest-VolumesNegativeTest-1736222970 tempest-VolumesNegativeTest-1736222970-project-member] Lock "ff1c5639-9d63-409a-bbd7-1de63f57b189" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:38:05 user nova-compute[75122]: DEBUG nova.compute.manager [None req-ee8c3666-c77c-426b-a8bb-d09746711753 tempest-VolumesNegativeTest-1736222970 tempest-VolumesNegativeTest-1736222970-project-member] [instance: ff1c5639-9d63-409a-bbd7-1de63f57b189] Starting instance... {{(pid=75122) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 09:38:05 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-ee8c3666-c77c-426b-a8bb-d09746711753 tempest-VolumesNegativeTest-1736222970 tempest-VolumesNegativeTest-1736222970-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:38:05 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-ee8c3666-c77c-426b-a8bb-d09746711753 tempest-VolumesNegativeTest-1736222970 tempest-VolumesNegativeTest-1736222970-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:38:05 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-ee8c3666-c77c-426b-a8bb-d09746711753 tempest-VolumesNegativeTest-1736222970 tempest-VolumesNegativeTest-1736222970-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75122) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 09:38:05 user nova-compute[75122]: INFO nova.compute.claims [None req-ee8c3666-c77c-426b-a8bb-d09746711753 tempest-VolumesNegativeTest-1736222970 tempest-VolumesNegativeTest-1736222970-project-member] [instance: ff1c5639-9d63-409a-bbd7-1de63f57b189] Claim successful on node user
Nov 15 09:38:05 user nova-compute[75122]: DEBUG nova.compute.manager [req-ffcae06f-1798-4833-86bb-1443f72188ee req-0197d3b4-3968-43c0-ab5d-9590b96b8b28 service nova] [instance: c2f45f49-0bca-4ae2-bc2a-eed293143489] Received event network-vif-plugged-24f9619f-42ba-42cf-b39c-43e14754e913 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:38:05 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-ffcae06f-1798-4833-86bb-1443f72188ee req-0197d3b4-3968-43c0-ab5d-9590b96b8b28 service nova] Acquiring lock "c2f45f49-0bca-4ae2-bc2a-eed293143489-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:38:05 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-ffcae06f-1798-4833-86bb-1443f72188ee req-0197d3b4-3968-43c0-ab5d-9590b96b8b28 service nova] Lock "c2f45f49-0bca-4ae2-bc2a-eed293143489-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:38:05 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-ffcae06f-1798-4833-86bb-1443f72188ee req-0197d3b4-3968-43c0-ab5d-9590b96b8b28 service nova] Lock "c2f45f49-0bca-4ae2-bc2a-eed293143489-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:38:05 user nova-compute[75122]: DEBUG nova.compute.manager [req-ffcae06f-1798-4833-86bb-1443f72188ee req-0197d3b4-3968-43c0-ab5d-9590b96b8b28 service nova] [instance: c2f45f49-0bca-4ae2-bc2a-eed293143489] No waiting events found dispatching network-vif-plugged-24f9619f-42ba-42cf-b39c-43e14754e913 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:38:05 user nova-compute[75122]: WARNING nova.compute.manager [req-ffcae06f-1798-4833-86bb-1443f72188ee req-0197d3b4-3968-43c0-ab5d-9590b96b8b28 service nova] [instance: c2f45f49-0bca-4ae2-bc2a-eed293143489] Received unexpected event network-vif-plugged-24f9619f-42ba-42cf-b39c-43e14754e913 for instance with vm_state building and task_state spawning.
Nov 15 09:38:05 user nova-compute[75122]: DEBUG nova.compute.manager [None req-9b7a3680-199e-4ede-8d59-21ce2165e06d tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] [instance: c2f45f49-0bca-4ae2-bc2a-eed293143489] Instance event wait completed in 0 seconds for  {{(pid=75122) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 09:38:05 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-9b7a3680-199e-4ede-8d59-21ce2165e06d tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] [instance: c2f45f49-0bca-4ae2-bc2a-eed293143489] Guest created on hypervisor {{(pid=75122) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 09:38:05 user nova-compute[75122]: INFO nova.virt.libvirt.driver [-] [instance: c2f45f49-0bca-4ae2-bc2a-eed293143489] Instance spawned successfully.
Nov 15 09:38:05 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-9b7a3680-199e-4ede-8d59-21ce2165e06d tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] [instance: c2f45f49-0bca-4ae2-bc2a-eed293143489] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 09:38:05 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-9b7a3680-199e-4ede-8d59-21ce2165e06d tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] [instance: c2f45f49-0bca-4ae2-bc2a-eed293143489] Found default for hw_cdrom_bus of ide {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:38:05 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-9b7a3680-199e-4ede-8d59-21ce2165e06d tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] [instance: c2f45f49-0bca-4ae2-bc2a-eed293143489] Found default for hw_disk_bus of virtio {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:38:05 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-9b7a3680-199e-4ede-8d59-21ce2165e06d tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] [instance: c2f45f49-0bca-4ae2-bc2a-eed293143489] Found default for hw_input_bus of None {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:38:05 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-9b7a3680-199e-4ede-8d59-21ce2165e06d tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] [instance: c2f45f49-0bca-4ae2-bc2a-eed293143489] Found default for hw_pointer_model of None {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:38:05 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-9b7a3680-199e-4ede-8d59-21ce2165e06d tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] [instance: c2f45f49-0bca-4ae2-bc2a-eed293143489] Found default for hw_video_model of virtio {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:38:05 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-9b7a3680-199e-4ede-8d59-21ce2165e06d tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] [instance: c2f45f49-0bca-4ae2-bc2a-eed293143489] Found default for hw_vif_model of virtio {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:38:05 user nova-compute[75122]: INFO nova.compute.manager [None req-9b7a3680-199e-4ede-8d59-21ce2165e06d tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] [instance: c2f45f49-0bca-4ae2-bc2a-eed293143489] Took 5.88 seconds to spawn the instance on the hypervisor.
Nov 15 09:38:05 user nova-compute[75122]: DEBUG nova.compute.manager [None req-9b7a3680-199e-4ede-8d59-21ce2165e06d tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] [instance: c2f45f49-0bca-4ae2-bc2a-eed293143489] Checking state {{(pid=75122) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 09:38:05 user nova-compute[75122]: INFO nova.compute.manager [None req-9b7a3680-199e-4ede-8d59-21ce2165e06d tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] [instance: c2f45f49-0bca-4ae2-bc2a-eed293143489] Took 6.63 seconds to build instance.
Nov 15 09:38:05 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-9b7a3680-199e-4ede-8d59-21ce2165e06d tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Lock "c2f45f49-0bca-4ae2-bc2a-eed293143489" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.751s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:38:05 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:38:05 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:38:05 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:38:05 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:38:05 user nova-compute[75122]: DEBUG nova.compute.provider_tree [None req-ee8c3666-c77c-426b-a8bb-d09746711753 tempest-VolumesNegativeTest-1736222970 tempest-VolumesNegativeTest-1736222970-project-member] Inventory has not changed in ProviderTree for provider: 69a3da65-47be-44c6-b67c-c692b58284ef {{(pid=75122) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 09:38:05 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-ee8c3666-c77c-426b-a8bb-d09746711753 tempest-VolumesNegativeTest-1736222970 tempest-VolumesNegativeTest-1736222970-project-member] Inventory has not changed for provider 69a3da65-47be-44c6-b67c-c692b58284ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 09:38:05 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-ee8c3666-c77c-426b-a8bb-d09746711753 tempest-VolumesNegativeTest-1736222970 tempest-VolumesNegativeTest-1736222970-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.634s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:38:05 user nova-compute[75122]: DEBUG nova.compute.manager [None req-ee8c3666-c77c-426b-a8bb-d09746711753 tempest-VolumesNegativeTest-1736222970 tempest-VolumesNegativeTest-1736222970-project-member] [instance: ff1c5639-9d63-409a-bbd7-1de63f57b189] Start building networks asynchronously for instance. {{(pid=75122) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 09:38:06 user nova-compute[75122]: DEBUG nova.compute.manager [None req-ee8c3666-c77c-426b-a8bb-d09746711753 tempest-VolumesNegativeTest-1736222970 tempest-VolumesNegativeTest-1736222970-project-member] [instance: ff1c5639-9d63-409a-bbd7-1de63f57b189] Allocating IP information in the background. {{(pid=75122) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 09:38:06 user nova-compute[75122]: DEBUG nova.network.neutron [None req-ee8c3666-c77c-426b-a8bb-d09746711753 tempest-VolumesNegativeTest-1736222970 tempest-VolumesNegativeTest-1736222970-project-member] [instance: ff1c5639-9d63-409a-bbd7-1de63f57b189] allocate_for_instance() {{(pid=75122) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 09:38:06 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-ee8c3666-c77c-426b-a8bb-d09746711753 tempest-VolumesNegativeTest-1736222970 tempest-VolumesNegativeTest-1736222970-project-member] [instance: ff1c5639-9d63-409a-bbd7-1de63f57b189] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 09:38:06 user nova-compute[75122]: DEBUG nova.compute.manager [None req-ee8c3666-c77c-426b-a8bb-d09746711753 tempest-VolumesNegativeTest-1736222970 tempest-VolumesNegativeTest-1736222970-project-member] [instance: ff1c5639-9d63-409a-bbd7-1de63f57b189] Start building block device mappings for instance. {{(pid=75122) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 09:38:06 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:38:06 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:38:06 user nova-compute[75122]: DEBUG nova.policy [None req-ee8c3666-c77c-426b-a8bb-d09746711753 tempest-VolumesNegativeTest-1736222970 tempest-VolumesNegativeTest-1736222970-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cb654b10f5564000833bdeb1dac7da8e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a012486d55e4d64abb55a8681e53608', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75122) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 09:38:06 user nova-compute[75122]: DEBUG nova.compute.manager [None req-ee8c3666-c77c-426b-a8bb-d09746711753 tempest-VolumesNegativeTest-1736222970 tempest-VolumesNegativeTest-1736222970-project-member] [instance: ff1c5639-9d63-409a-bbd7-1de63f57b189] Start spawning the instance on the hypervisor. {{(pid=75122) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 09:38:06 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-ee8c3666-c77c-426b-a8bb-d09746711753 tempest-VolumesNegativeTest-1736222970 tempest-VolumesNegativeTest-1736222970-project-member] [instance: ff1c5639-9d63-409a-bbd7-1de63f57b189] Creating instance directory {{(pid=75122) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 09:38:06 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-ee8c3666-c77c-426b-a8bb-d09746711753 tempest-VolumesNegativeTest-1736222970 tempest-VolumesNegativeTest-1736222970-project-member] [instance: ff1c5639-9d63-409a-bbd7-1de63f57b189] Creating image(s)
Nov 15 09:38:06 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-ee8c3666-c77c-426b-a8bb-d09746711753 tempest-VolumesNegativeTest-1736222970 tempest-VolumesNegativeTest-1736222970-project-member] Acquiring lock "/opt/stack/data/nova/instances/ff1c5639-9d63-409a-bbd7-1de63f57b189/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:38:06 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-ee8c3666-c77c-426b-a8bb-d09746711753 tempest-VolumesNegativeTest-1736222970 tempest-VolumesNegativeTest-1736222970-project-member] Lock "/opt/stack/data/nova/instances/ff1c5639-9d63-409a-bbd7-1de63f57b189/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:38:06 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-ee8c3666-c77c-426b-a8bb-d09746711753 tempest-VolumesNegativeTest-1736222970 tempest-VolumesNegativeTest-1736222970-project-member] Lock "/opt/stack/data/nova/instances/ff1c5639-9d63-409a-bbd7-1de63f57b189/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:38:06 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-ee8c3666-c77c-426b-a8bb-d09746711753 tempest-VolumesNegativeTest-1736222970 tempest-VolumesNegativeTest-1736222970-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:38:06 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-ee8c3666-c77c-426b-a8bb-d09746711753 tempest-VolumesNegativeTest-1736222970 tempest-VolumesNegativeTest-1736222970-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json" returned: 0 in 0.191s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:38:06 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-ee8c3666-c77c-426b-a8bb-d09746711753 tempest-VolumesNegativeTest-1736222970 tempest-VolumesNegativeTest-1736222970-project-member] Acquiring lock "95d6e29f74d5408f818e32f3bc29bc8270a4c665" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:38:06 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-ee8c3666-c77c-426b-a8bb-d09746711753 tempest-VolumesNegativeTest-1736222970 tempest-VolumesNegativeTest-1736222970-project-member] Lock "95d6e29f74d5408f818e32f3bc29bc8270a4c665" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:38:06 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-ee8c3666-c77c-426b-a8bb-d09746711753 tempest-VolumesNegativeTest-1736222970 tempest-VolumesNegativeTest-1736222970-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:38:06 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-ee8c3666-c77c-426b-a8bb-d09746711753 tempest-VolumesNegativeTest-1736222970 tempest-VolumesNegativeTest-1736222970-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json" returned: 0 in 0.192s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:38:06 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-ee8c3666-c77c-426b-a8bb-d09746711753 tempest-VolumesNegativeTest-1736222970 tempest-VolumesNegativeTest-1736222970-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665,backing_fmt=raw /opt/stack/data/nova/instances/ff1c5639-9d63-409a-bbd7-1de63f57b189/disk 1073741824 {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:38:06 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-ee8c3666-c77c-426b-a8bb-d09746711753 tempest-VolumesNegativeTest-1736222970 tempest-VolumesNegativeTest-1736222970-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665,backing_fmt=raw /opt/stack/data/nova/instances/ff1c5639-9d63-409a-bbd7-1de63f57b189/disk 1073741824" returned: 0 in 0.126s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:38:06 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-ee8c3666-c77c-426b-a8bb-d09746711753 tempest-VolumesNegativeTest-1736222970 tempest-VolumesNegativeTest-1736222970-project-member] Lock "95d6e29f74d5408f818e32f3bc29bc8270a4c665" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.324s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:38:06 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-ee8c3666-c77c-426b-a8bb-d09746711753 tempest-VolumesNegativeTest-1736222970 tempest-VolumesNegativeTest-1736222970-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:38:06 user nova-compute[75122]: DEBUG nova.network.neutron [None req-ee8c3666-c77c-426b-a8bb-d09746711753 tempest-VolumesNegativeTest-1736222970 tempest-VolumesNegativeTest-1736222970-project-member] [instance: ff1c5639-9d63-409a-bbd7-1de63f57b189] Successfully created port: fb9bb294-6cbe-46c1-9214-229ff766f28e {{(pid=75122) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 09:38:06 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-ee8c3666-c77c-426b-a8bb-d09746711753 tempest-VolumesNegativeTest-1736222970 tempest-VolumesNegativeTest-1736222970-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json" returned: 0 in 0.192s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:38:06 user nova-compute[75122]: DEBUG nova.virt.disk.api [None req-ee8c3666-c77c-426b-a8bb-d09746711753 tempest-VolumesNegativeTest-1736222970 tempest-VolumesNegativeTest-1736222970-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ff1c5639-9d63-409a-bbd7-1de63f57b189/disk. size=1073741824 {{(pid=75122) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 09:38:06 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-ee8c3666-c77c-426b-a8bb-d09746711753 tempest-VolumesNegativeTest-1736222970 tempest-VolumesNegativeTest-1736222970-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff1c5639-9d63-409a-bbd7-1de63f57b189/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:38:07 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-ee8c3666-c77c-426b-a8bb-d09746711753 tempest-VolumesNegativeTest-1736222970 tempest-VolumesNegativeTest-1736222970-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff1c5639-9d63-409a-bbd7-1de63f57b189/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:38:07 user nova-compute[75122]: DEBUG nova.virt.disk.api [None req-ee8c3666-c77c-426b-a8bb-d09746711753 tempest-VolumesNegativeTest-1736222970 tempest-VolumesNegativeTest-1736222970-project-member] Cannot resize image /opt/stack/data/nova/instances/ff1c5639-9d63-409a-bbd7-1de63f57b189/disk to a smaller size. {{(pid=75122) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 09:38:07 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-ee8c3666-c77c-426b-a8bb-d09746711753 tempest-VolumesNegativeTest-1736222970 tempest-VolumesNegativeTest-1736222970-project-member] [instance: ff1c5639-9d63-409a-bbd7-1de63f57b189] Created local disks {{(pid=75122) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 09:38:07 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-ee8c3666-c77c-426b-a8bb-d09746711753 tempest-VolumesNegativeTest-1736222970 tempest-VolumesNegativeTest-1736222970-project-member] [instance: ff1c5639-9d63-409a-bbd7-1de63f57b189] Ensure instance console log exists: /opt/stack/data/nova/instances/ff1c5639-9d63-409a-bbd7-1de63f57b189/console.log {{(pid=75122) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 09:38:07 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-ee8c3666-c77c-426b-a8bb-d09746711753 tempest-VolumesNegativeTest-1736222970 tempest-VolumesNegativeTest-1736222970-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:38:07 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-ee8c3666-c77c-426b-a8bb-d09746711753 tempest-VolumesNegativeTest-1736222970 tempest-VolumesNegativeTest-1736222970-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:38:07 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-ee8c3666-c77c-426b-a8bb-d09746711753 tempest-VolumesNegativeTest-1736222970 tempest-VolumesNegativeTest-1736222970-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:38:07 user nova-compute[75122]: DEBUG nova.compute.manager [req-ce8db081-757b-43a0-81db-e1121803b4c0 req-f43d10c3-5c83-4b9a-b7bb-7c5119a37b51 service nova] [instance: e4d3e4f5-b48f-4fd4-9299-091469824217] Received event network-vif-plugged-a3f00d6e-75c6-4c47-b4a4-366a791c3f24 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:38:07 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-ce8db081-757b-43a0-81db-e1121803b4c0 req-f43d10c3-5c83-4b9a-b7bb-7c5119a37b51 service nova] Acquiring lock "e4d3e4f5-b48f-4fd4-9299-091469824217-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:38:07 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-ce8db081-757b-43a0-81db-e1121803b4c0 req-f43d10c3-5c83-4b9a-b7bb-7c5119a37b51 service nova] Lock "e4d3e4f5-b48f-4fd4-9299-091469824217-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:38:07 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-ce8db081-757b-43a0-81db-e1121803b4c0 req-f43d10c3-5c83-4b9a-b7bb-7c5119a37b51 service nova] Lock "e4d3e4f5-b48f-4fd4-9299-091469824217-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:38:07 user nova-compute[75122]: DEBUG nova.compute.manager [req-ce8db081-757b-43a0-81db-e1121803b4c0 req-f43d10c3-5c83-4b9a-b7bb-7c5119a37b51 service nova] [instance: e4d3e4f5-b48f-4fd4-9299-091469824217] No waiting events found dispatching network-vif-plugged-a3f00d6e-75c6-4c47-b4a4-366a791c3f24 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:38:07 user nova-compute[75122]: WARNING nova.compute.manager [req-ce8db081-757b-43a0-81db-e1121803b4c0 req-f43d10c3-5c83-4b9a-b7bb-7c5119a37b51 service nova] [instance: e4d3e4f5-b48f-4fd4-9299-091469824217] Received unexpected event network-vif-plugged-a3f00d6e-75c6-4c47-b4a4-366a791c3f24 for instance with vm_state building and task_state spawning.
Nov 15 09:38:07 user nova-compute[75122]: DEBUG nova.compute.manager [req-ce8db081-757b-43a0-81db-e1121803b4c0 req-f43d10c3-5c83-4b9a-b7bb-7c5119a37b51 service nova] [instance: e4d3e4f5-b48f-4fd4-9299-091469824217] Received event network-vif-plugged-a3f00d6e-75c6-4c47-b4a4-366a791c3f24 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:38:07 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-ce8db081-757b-43a0-81db-e1121803b4c0 req-f43d10c3-5c83-4b9a-b7bb-7c5119a37b51 service nova] Acquiring lock "e4d3e4f5-b48f-4fd4-9299-091469824217-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:38:07 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-ce8db081-757b-43a0-81db-e1121803b4c0 req-f43d10c3-5c83-4b9a-b7bb-7c5119a37b51 service nova] Lock "e4d3e4f5-b48f-4fd4-9299-091469824217-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:38:07 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-ce8db081-757b-43a0-81db-e1121803b4c0 req-f43d10c3-5c83-4b9a-b7bb-7c5119a37b51 service nova] Lock "e4d3e4f5-b48f-4fd4-9299-091469824217-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:38:07 user nova-compute[75122]: DEBUG nova.compute.manager [req-ce8db081-757b-43a0-81db-e1121803b4c0 req-f43d10c3-5c83-4b9a-b7bb-7c5119a37b51 service nova] [instance: e4d3e4f5-b48f-4fd4-9299-091469824217] No waiting events found dispatching network-vif-plugged-a3f00d6e-75c6-4c47-b4a4-366a791c3f24 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:38:07 user nova-compute[75122]: WARNING nova.compute.manager [req-ce8db081-757b-43a0-81db-e1121803b4c0 req-f43d10c3-5c83-4b9a-b7bb-7c5119a37b51 service nova] [instance: e4d3e4f5-b48f-4fd4-9299-091469824217] Received unexpected event network-vif-plugged-a3f00d6e-75c6-4c47-b4a4-366a791c3f24 for instance with vm_state building and task_state spawning.
Nov 15 09:38:07 user nova-compute[75122]: DEBUG nova.network.neutron [None req-ee8c3666-c77c-426b-a8bb-d09746711753 tempest-VolumesNegativeTest-1736222970 tempest-VolumesNegativeTest-1736222970-project-member] [instance: ff1c5639-9d63-409a-bbd7-1de63f57b189] Successfully updated port: fb9bb294-6cbe-46c1-9214-229ff766f28e {{(pid=75122) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 09:38:07 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-ee8c3666-c77c-426b-a8bb-d09746711753 tempest-VolumesNegativeTest-1736222970 tempest-VolumesNegativeTest-1736222970-project-member] Acquiring lock "refresh_cache-ff1c5639-9d63-409a-bbd7-1de63f57b189" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 09:38:07 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-ee8c3666-c77c-426b-a8bb-d09746711753 tempest-VolumesNegativeTest-1736222970 tempest-VolumesNegativeTest-1736222970-project-member] Acquired lock "refresh_cache-ff1c5639-9d63-409a-bbd7-1de63f57b189" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 09:38:07 user nova-compute[75122]: DEBUG nova.network.neutron [None req-ee8c3666-c77c-426b-a8bb-d09746711753 tempest-VolumesNegativeTest-1736222970 tempest-VolumesNegativeTest-1736222970-project-member] [instance: ff1c5639-9d63-409a-bbd7-1de63f57b189] Building network info cache for instance {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 09:38:07 user nova-compute[75122]: DEBUG nova.compute.manager [req-ca5fe84a-d3e3-4c9f-9734-5fc7608e3ea1 req-00ceb27e-5db8-41bd-affa-ec8432ebcceb service nova] [instance: ff1c5639-9d63-409a-bbd7-1de63f57b189] Received event network-changed-fb9bb294-6cbe-46c1-9214-229ff766f28e {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:38:07 user nova-compute[75122]: DEBUG nova.compute.manager [req-ca5fe84a-d3e3-4c9f-9734-5fc7608e3ea1 req-00ceb27e-5db8-41bd-affa-ec8432ebcceb service nova] [instance: ff1c5639-9d63-409a-bbd7-1de63f57b189] Refreshing instance network info cache due to event network-changed-fb9bb294-6cbe-46c1-9214-229ff766f28e. {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 09:38:07 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-ca5fe84a-d3e3-4c9f-9734-5fc7608e3ea1 req-00ceb27e-5db8-41bd-affa-ec8432ebcceb service nova] Acquiring lock "refresh_cache-ff1c5639-9d63-409a-bbd7-1de63f57b189" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 09:38:07 user nova-compute[75122]: DEBUG nova.network.neutron [None req-ee8c3666-c77c-426b-a8bb-d09746711753 tempest-VolumesNegativeTest-1736222970 tempest-VolumesNegativeTest-1736222970-project-member] [instance: ff1c5639-9d63-409a-bbd7-1de63f57b189] Instance cache missing network info. {{(pid=75122) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 09:38:07 user nova-compute[75122]: DEBUG nova.network.neutron [None req-ee8c3666-c77c-426b-a8bb-d09746711753 tempest-VolumesNegativeTest-1736222970 tempest-VolumesNegativeTest-1736222970-project-member] [instance: ff1c5639-9d63-409a-bbd7-1de63f57b189] Updating instance_info_cache with network_info: [{"id": "fb9bb294-6cbe-46c1-9214-229ff766f28e", "address": "fa:16:3e:d1:90:86", "network": {"id": "63c86f13-cbfa-4e48-af71-0b48ffa99834", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "9c57733cb41847c0b4ad31519c382e5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb9bb294-6c", "ovs_interfaceid": "fb9bb294-6cbe-46c1-9214-229ff766f28e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:38:07 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-ee8c3666-c77c-426b-a8bb-d09746711753 tempest-VolumesNegativeTest-1736222970 tempest-VolumesNegativeTest-1736222970-project-member] Releasing lock "refresh_cache-ff1c5639-9d63-409a-bbd7-1de63f57b189" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 09:38:07 user nova-compute[75122]: DEBUG nova.compute.manager [None req-ee8c3666-c77c-426b-a8bb-d09746711753 tempest-VolumesNegativeTest-1736222970 tempest-VolumesNegativeTest-1736222970-project-member] [instance: ff1c5639-9d63-409a-bbd7-1de63f57b189] Instance network_info: |[{"id": "fb9bb294-6cbe-46c1-9214-229ff766f28e", "address": "fa:16:3e:d1:90:86", "network": {"id": "63c86f13-cbfa-4e48-af71-0b48ffa99834", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "9c57733cb41847c0b4ad31519c382e5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb9bb294-6c", "ovs_interfaceid": "fb9bb294-6cbe-46c1-9214-229ff766f28e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75122) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 09:38:07 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-ca5fe84a-d3e3-4c9f-9734-5fc7608e3ea1 req-00ceb27e-5db8-41bd-affa-ec8432ebcceb service nova] Acquired lock "refresh_cache-ff1c5639-9d63-409a-bbd7-1de63f57b189" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 09:38:07 user nova-compute[75122]: DEBUG nova.network.neutron [req-ca5fe84a-d3e3-4c9f-9734-5fc7608e3ea1 req-00ceb27e-5db8-41bd-affa-ec8432ebcceb service nova] [instance: ff1c5639-9d63-409a-bbd7-1de63f57b189] Refreshing network info cache for port fb9bb294-6cbe-46c1-9214-229ff766f28e {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 09:38:07 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-ee8c3666-c77c-426b-a8bb-d09746711753 tempest-VolumesNegativeTest-1736222970 tempest-VolumesNegativeTest-1736222970-project-member] [instance: ff1c5639-9d63-409a-bbd7-1de63f57b189] Start _get_guest_xml network_info=[{"id": "fb9bb294-6cbe-46c1-9214-229ff766f28e", "address": "fa:16:3e:d1:90:86", "network": {"id": "63c86f13-cbfa-4e48-af71-0b48ffa99834", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "9c57733cb41847c0b4ad31519c382e5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb9bb294-6c", "ovs_interfaceid": "fb9bb294-6cbe-46c1-9214-229ff766f28e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T09:26:31Z,direct_url=<?>,disk_format='qcow2',id=5e862cfe-47b8-4725-8292-65761ee6d0f5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9c57733cb41847c0b4ad31519c382e5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T09:26:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '5e862cfe-47b8-4725-8292-65761ee6d0f5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75122) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 09:38:07 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-ee8c3666-c77c-426b-a8bb-d09746711753 tempest-VolumesNegativeTest-1736222970 tempest-VolumesNegativeTest-1736222970-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 09:38:07 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-ee8c3666-c77c-426b-a8bb-d09746711753 tempest-VolumesNegativeTest-1736222970 tempest-VolumesNegativeTest-1736222970-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 09:38:07 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-ee8c3666-c77c-426b-a8bb-d09746711753 tempest-VolumesNegativeTest-1736222970 tempest-VolumesNegativeTest-1736222970-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75122) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 09:38:07 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-ee8c3666-c77c-426b-a8bb-d09746711753 tempest-VolumesNegativeTest-1736222970 tempest-VolumesNegativeTest-1736222970-project-member] CPU controller missing on host. {{(pid=75122) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 09:38:07 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-ee8c3666-c77c-426b-a8bb-d09746711753 tempest-VolumesNegativeTest-1736222970 tempest-VolumesNegativeTest-1736222970-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75122) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 09:38:07 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-ee8c3666-c77c-426b-a8bb-d09746711753 tempest-VolumesNegativeTest-1736222970 tempest-VolumesNegativeTest-1736222970-project-member] CPU controller found on host. {{(pid=75122) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 09:38:07 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-ee8c3666-c77c-426b-a8bb-d09746711753 tempest-VolumesNegativeTest-1736222970 tempest-VolumesNegativeTest-1736222970-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75122) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 09:38:07 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-ee8c3666-c77c-426b-a8bb-d09746711753 tempest-VolumesNegativeTest-1736222970 tempest-VolumesNegativeTest-1736222970-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T09:26:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T09:26:31Z,direct_url=<?>,disk_format='qcow2',id=5e862cfe-47b8-4725-8292-65761ee6d0f5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9c57733cb41847c0b4ad31519c382e5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T09:26:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 09:38:07 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-ee8c3666-c77c-426b-a8bb-d09746711753 tempest-VolumesNegativeTest-1736222970 tempest-VolumesNegativeTest-1736222970-project-member] Flavor limits 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 09:38:07 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-ee8c3666-c77c-426b-a8bb-d09746711753 tempest-VolumesNegativeTest-1736222970 tempest-VolumesNegativeTest-1736222970-project-member] Image limits 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 09:38:07 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-ee8c3666-c77c-426b-a8bb-d09746711753 tempest-VolumesNegativeTest-1736222970 tempest-VolumesNegativeTest-1736222970-project-member] Flavor pref 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 09:38:07 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-ee8c3666-c77c-426b-a8bb-d09746711753 tempest-VolumesNegativeTest-1736222970 tempest-VolumesNegativeTest-1736222970-project-member] Image pref 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 09:38:07 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-ee8c3666-c77c-426b-a8bb-d09746711753 tempest-VolumesNegativeTest-1736222970 tempest-VolumesNegativeTest-1736222970-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 09:38:07 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-ee8c3666-c77c-426b-a8bb-d09746711753 tempest-VolumesNegativeTest-1736222970 tempest-VolumesNegativeTest-1736222970-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 09:38:07 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-ee8c3666-c77c-426b-a8bb-d09746711753 tempest-VolumesNegativeTest-1736222970 tempest-VolumesNegativeTest-1736222970-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75122) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 09:38:07 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-ee8c3666-c77c-426b-a8bb-d09746711753 tempest-VolumesNegativeTest-1736222970 tempest-VolumesNegativeTest-1736222970-project-member] Got 1 possible topologies {{(pid=75122) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 09:38:07 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-ee8c3666-c77c-426b-a8bb-d09746711753 tempest-VolumesNegativeTest-1736222970 tempest-VolumesNegativeTest-1736222970-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 09:38:07 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-ee8c3666-c77c-426b-a8bb-d09746711753 tempest-VolumesNegativeTest-1736222970 tempest-VolumesNegativeTest-1736222970-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 09:38:07 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-ee8c3666-c77c-426b-a8bb-d09746711753 tempest-VolumesNegativeTest-1736222970 tempest-VolumesNegativeTest-1736222970-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T09:38:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1967951168',display_name='tempest-VolumesNegativeTest-instance-1967951168',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1967951168',id=22,image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6a012486d55e4d64abb55a8681e53608',ramdisk_id='',reservation_id='r-v4523elx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1736222970',owner_user_name='tempest-VolumesNegativeTest-1736222970-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T09:38:06Z,user_data=None,user_id='cb654b10f5564000833bdeb1dac7da8e',uuid=ff1c5639-9d63-409a-bbd7-1de63f57b189,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fb9bb294-6cbe-46c1-9214-229ff766f28e", "address": "fa:16:3e:d1:90:86", "network": {"id": "63c86f13-cbfa-4e48-af71-0b48ffa99834", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "9c57733cb41847c0b4ad31519c382e5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb9bb294-6c", "ovs_interfaceid": "fb9bb294-6cbe-46c1-9214-229ff766f28e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75122) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 09:38:07 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-ee8c3666-c77c-426b-a8bb-d09746711753 tempest-VolumesNegativeTest-1736222970 tempest-VolumesNegativeTest-1736222970-project-member] Converting VIF {"id": "fb9bb294-6cbe-46c1-9214-229ff766f28e", "address": "fa:16:3e:d1:90:86", "network": {"id": "63c86f13-cbfa-4e48-af71-0b48ffa99834", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "9c57733cb41847c0b4ad31519c382e5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb9bb294-6c", "ovs_interfaceid": "fb9bb294-6cbe-46c1-9214-229ff766f28e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 09:38:07 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-ee8c3666-c77c-426b-a8bb-d09746711753 tempest-VolumesNegativeTest-1736222970 tempest-VolumesNegativeTest-1736222970-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:90:86,bridge_name='br-int',has_traffic_filtering=True,id=fb9bb294-6cbe-46c1-9214-229ff766f28e,network=Network(63c86f13-cbfa-4e48-af71-0b48ffa99834),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb9bb294-6c') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 09:38:07 user nova-compute[75122]: DEBUG nova.objects.instance [None req-ee8c3666-c77c-426b-a8bb-d09746711753 tempest-VolumesNegativeTest-1736222970 tempest-VolumesNegativeTest-1736222970-project-member] Lazy-loading 'pci_devices' on Instance uuid ff1c5639-9d63-409a-bbd7-1de63f57b189 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:38:07 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-ee8c3666-c77c-426b-a8bb-d09746711753 tempest-VolumesNegativeTest-1736222970 tempest-VolumesNegativeTest-1736222970-project-member] [instance: ff1c5639-9d63-409a-bbd7-1de63f57b189] End _get_guest_xml xml=<domain type="kvm">
Nov 15 09:38:07 user nova-compute[75122]:   <uuid>ff1c5639-9d63-409a-bbd7-1de63f57b189</uuid>
Nov 15 09:38:07 user nova-compute[75122]:   <name>instance-00000016</name>
Nov 15 09:38:07 user nova-compute[75122]:   <memory>524288</memory>
Nov 15 09:38:07 user nova-compute[75122]:   <vcpu>1</vcpu>
Nov 15 09:38:07 user nova-compute[75122]:   <metadata>
Nov 15 09:38:07 user nova-compute[75122]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 09:38:07 user nova-compute[75122]:       <nova:package version="0.0.0"/>
Nov 15 09:38:07 user nova-compute[75122]:       <nova:name>tempest-VolumesNegativeTest-instance-1967951168</nova:name>
Nov 15 09:38:07 user nova-compute[75122]:       <nova:creationTime>2023-11-15 09:38:07</nova:creationTime>
Nov 15 09:38:07 user nova-compute[75122]:       <nova:flavor name="m1.tiny">
Nov 15 09:38:07 user nova-compute[75122]:         <nova:memory>512</nova:memory>
Nov 15 09:38:07 user nova-compute[75122]:         <nova:disk>1</nova:disk>
Nov 15 09:38:07 user nova-compute[75122]:         <nova:swap>0</nova:swap>
Nov 15 09:38:07 user nova-compute[75122]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 09:38:07 user nova-compute[75122]:         <nova:vcpus>1</nova:vcpus>
Nov 15 09:38:07 user nova-compute[75122]:       </nova:flavor>
Nov 15 09:38:07 user nova-compute[75122]:       <nova:owner>
Nov 15 09:38:07 user nova-compute[75122]:         <nova:user uuid="cb654b10f5564000833bdeb1dac7da8e">tempest-VolumesNegativeTest-1736222970-project-member</nova:user>
Nov 15 09:38:07 user nova-compute[75122]:         <nova:project uuid="6a012486d55e4d64abb55a8681e53608">tempest-VolumesNegativeTest-1736222970</nova:project>
Nov 15 09:38:07 user nova-compute[75122]:       </nova:owner>
Nov 15 09:38:07 user nova-compute[75122]:       <nova:root type="image" uuid="5e862cfe-47b8-4725-8292-65761ee6d0f5"/>
Nov 15 09:38:07 user nova-compute[75122]:       <nova:ports>
Nov 15 09:38:07 user nova-compute[75122]:         <nova:port uuid="fb9bb294-6cbe-46c1-9214-229ff766f28e">
Nov 15 09:38:07 user nova-compute[75122]:           <nova:ip type="fixed" address="192.168.233.66" ipVersion="4"/>
Nov 15 09:38:07 user nova-compute[75122]:         </nova:port>
Nov 15 09:38:07 user nova-compute[75122]:       </nova:ports>
Nov 15 09:38:07 user nova-compute[75122]:     </nova:instance>
Nov 15 09:38:07 user nova-compute[75122]:   </metadata>
Nov 15 09:38:07 user nova-compute[75122]:   <sysinfo type="smbios">
Nov 15 09:38:07 user nova-compute[75122]:     <system>
Nov 15 09:38:07 user nova-compute[75122]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 09:38:07 user nova-compute[75122]:       <entry name="product">OpenStack Nova</entry>
Nov 15 09:38:07 user nova-compute[75122]:       <entry name="version">0.0.0</entry>
Nov 15 09:38:07 user nova-compute[75122]:       <entry name="serial">ff1c5639-9d63-409a-bbd7-1de63f57b189</entry>
Nov 15 09:38:07 user nova-compute[75122]:       <entry name="uuid">ff1c5639-9d63-409a-bbd7-1de63f57b189</entry>
Nov 15 09:38:07 user nova-compute[75122]:       <entry name="family">Virtual Machine</entry>
Nov 15 09:38:07 user nova-compute[75122]:     </system>
Nov 15 09:38:07 user nova-compute[75122]:   </sysinfo>
Nov 15 09:38:07 user nova-compute[75122]:   <os>
Nov 15 09:38:07 user nova-compute[75122]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 09:38:07 user nova-compute[75122]:     <boot dev="hd"/>
Nov 15 09:38:07 user nova-compute[75122]:     <smbios mode="sysinfo"/>
Nov 15 09:38:07 user nova-compute[75122]:   </os>
Nov 15 09:38:07 user nova-compute[75122]:   <features>
Nov 15 09:38:07 user nova-compute[75122]:     <acpi/>
Nov 15 09:38:07 user nova-compute[75122]:     <apic/>
Nov 15 09:38:07 user nova-compute[75122]:     <vmcoreinfo/>
Nov 15 09:38:07 user nova-compute[75122]:   </features>
Nov 15 09:38:07 user nova-compute[75122]:   <clock offset="utc">
Nov 15 09:38:07 user nova-compute[75122]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 09:38:07 user nova-compute[75122]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 09:38:07 user nova-compute[75122]:     <timer name="hpet" present="no"/>
Nov 15 09:38:07 user nova-compute[75122]:   </clock>
Nov 15 09:38:07 user nova-compute[75122]:   <cpu mode="custom" match="exact">
Nov 15 09:38:07 user nova-compute[75122]:     <model>Nehalem</model>
Nov 15 09:38:07 user nova-compute[75122]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 09:38:07 user nova-compute[75122]:   </cpu>
Nov 15 09:38:07 user nova-compute[75122]:   <devices>
Nov 15 09:38:07 user nova-compute[75122]:     <disk type="file" device="disk">
Nov 15 09:38:07 user nova-compute[75122]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 09:38:07 user nova-compute[75122]:       <source file="/opt/stack/data/nova/instances/ff1c5639-9d63-409a-bbd7-1de63f57b189/disk"/>
Nov 15 09:38:07 user nova-compute[75122]:       <target dev="vda" bus="virtio"/>
Nov 15 09:38:07 user nova-compute[75122]:     </disk>
Nov 15 09:38:07 user nova-compute[75122]:     <interface type="ethernet">
Nov 15 09:38:07 user nova-compute[75122]:       <mac address="fa:16:3e:d1:90:86"/>
Nov 15 09:38:07 user nova-compute[75122]:       <model type="virtio"/>
Nov 15 09:38:07 user nova-compute[75122]:       <mtu size="1442"/>
Nov 15 09:38:07 user nova-compute[75122]:       <target dev="tapfb9bb294-6c"/>
Nov 15 09:38:07 user nova-compute[75122]:     </interface>
Nov 15 09:38:07 user nova-compute[75122]:     <serial type="pty">
Nov 15 09:38:07 user nova-compute[75122]:       <log file="/opt/stack/data/nova/instances/ff1c5639-9d63-409a-bbd7-1de63f57b189/console.log" append="off"/>
Nov 15 09:38:07 user nova-compute[75122]:     </serial>
Nov 15 09:38:07 user nova-compute[75122]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 09:38:07 user nova-compute[75122]:     <video>
Nov 15 09:38:07 user nova-compute[75122]:       <model type="virtio"/>
Nov 15 09:38:07 user nova-compute[75122]:     </video>
Nov 15 09:38:07 user nova-compute[75122]:     <rng model="virtio">
Nov 15 09:38:07 user nova-compute[75122]:       <backend model="random">/dev/urandom</backend>
Nov 15 09:38:07 user nova-compute[75122]:     </rng>
Nov 15 09:38:07 user nova-compute[75122]:     <controller type="usb" index="0" model="none"/>
Nov 15 09:38:07 user nova-compute[75122]:     <memballoon model="virtio">
Nov 15 09:38:07 user nova-compute[75122]:       <stats period="10"/>
Nov 15 09:38:07 user nova-compute[75122]:     </memballoon>
Nov 15 09:38:07 user nova-compute[75122]:   </devices>
Nov 15 09:38:07 user nova-compute[75122]: </domain>
Nov 15 09:38:07 user nova-compute[75122]:  {{(pid=75122) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 09:38:07 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-ee8c3666-c77c-426b-a8bb-d09746711753 tempest-VolumesNegativeTest-1736222970 tempest-VolumesNegativeTest-1736222970-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T09:38:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1967951168',display_name='tempest-VolumesNegativeTest-instance-1967951168',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1967951168',id=22,image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6a012486d55e4d64abb55a8681e53608',ramdisk_id='',reservation_id='r-v4523elx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1736222970',owner_user_name='tempest-VolumesNegativeTest-1736222970-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T09:38:06Z,user_data=None,user_id='cb654b10f5564000833bdeb1dac7da8e',uuid=ff1c5639-9d63-409a-bbd7-1de63f57b189,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fb9bb294-6cbe-46c1-9214-229ff766f28e", "address": "fa:16:3e:d1:90:86", "network": {"id": "63c86f13-cbfa-4e48-af71-0b48ffa99834", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "9c57733cb41847c0b4ad31519c382e5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb9bb294-6c", "ovs_interfaceid": "fb9bb294-6cbe-46c1-9214-229ff766f28e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 09:38:07 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-ee8c3666-c77c-426b-a8bb-d09746711753 tempest-VolumesNegativeTest-1736222970 tempest-VolumesNegativeTest-1736222970-project-member] Converting VIF {"id": "fb9bb294-6cbe-46c1-9214-229ff766f28e", "address": "fa:16:3e:d1:90:86", "network": {"id": "63c86f13-cbfa-4e48-af71-0b48ffa99834", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "9c57733cb41847c0b4ad31519c382e5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb9bb294-6c", "ovs_interfaceid": "fb9bb294-6cbe-46c1-9214-229ff766f28e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 09:38:07 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-ee8c3666-c77c-426b-a8bb-d09746711753 tempest-VolumesNegativeTest-1736222970 tempest-VolumesNegativeTest-1736222970-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:90:86,bridge_name='br-int',has_traffic_filtering=True,id=fb9bb294-6cbe-46c1-9214-229ff766f28e,network=Network(63c86f13-cbfa-4e48-af71-0b48ffa99834),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb9bb294-6c') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 09:38:07 user nova-compute[75122]: DEBUG os_vif [None req-ee8c3666-c77c-426b-a8bb-d09746711753 tempest-VolumesNegativeTest-1736222970 tempest-VolumesNegativeTest-1736222970-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:90:86,bridge_name='br-int',has_traffic_filtering=True,id=fb9bb294-6cbe-46c1-9214-229ff766f28e,network=Network(63c86f13-cbfa-4e48-af71-0b48ffa99834),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb9bb294-6c') {{(pid=75122) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 09:38:07 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:38:07 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:38:07 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 09:38:07 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:38:07 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '92fba9fe-184e-5f31-851a-3ad6e8a0a788', '_type': 'linux-noop'}}, row=False) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:38:07 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:38:07 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:38:07 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfb9bb294-6c, may_exist=True, interface_attrs={}) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:38:07 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfb9bb294-6c, col_values=(('qos', UUID('0cf7ac34-35f8-4c20-a897-782ec2c1e86c')),), if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:38:07 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfb9bb294-6c, col_values=(('external_ids', {'iface-id': 'fb9bb294-6cbe-46c1-9214-229ff766f28e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d1:90:86', 'vm-uuid': 'ff1c5639-9d63-409a-bbd7-1de63f57b189'}),), if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:38:07 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:38:07 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:38:07 user nova-compute[75122]: INFO os_vif [None req-ee8c3666-c77c-426b-a8bb-d09746711753 tempest-VolumesNegativeTest-1736222970 tempest-VolumesNegativeTest-1736222970-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:90:86,bridge_name='br-int',has_traffic_filtering=True,id=fb9bb294-6cbe-46c1-9214-229ff766f28e,network=Network(63c86f13-cbfa-4e48-af71-0b48ffa99834),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb9bb294-6c')
Nov 15 09:38:07 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-ee8c3666-c77c-426b-a8bb-d09746711753 tempest-VolumesNegativeTest-1736222970 tempest-VolumesNegativeTest-1736222970-project-member] No BDM found with device name vda, not building metadata. {{(pid=75122) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 09:38:07 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-ee8c3666-c77c-426b-a8bb-d09746711753 tempest-VolumesNegativeTest-1736222970 tempest-VolumesNegativeTest-1736222970-project-member] No VIF found with MAC fa:16:3e:d1:90:86, not building metadata {{(pid=75122) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 09:38:08 user nova-compute[75122]: DEBUG nova.network.neutron [req-ca5fe84a-d3e3-4c9f-9734-5fc7608e3ea1 req-00ceb27e-5db8-41bd-affa-ec8432ebcceb service nova] [instance: ff1c5639-9d63-409a-bbd7-1de63f57b189] Updated VIF entry in instance network info cache for port fb9bb294-6cbe-46c1-9214-229ff766f28e. {{(pid=75122) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 09:38:08 user nova-compute[75122]: DEBUG nova.network.neutron [req-ca5fe84a-d3e3-4c9f-9734-5fc7608e3ea1 req-00ceb27e-5db8-41bd-affa-ec8432ebcceb service nova] [instance: ff1c5639-9d63-409a-bbd7-1de63f57b189] Updating instance_info_cache with network_info: [{"id": "fb9bb294-6cbe-46c1-9214-229ff766f28e", "address": "fa:16:3e:d1:90:86", "network": {"id": "63c86f13-cbfa-4e48-af71-0b48ffa99834", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "9c57733cb41847c0b4ad31519c382e5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb9bb294-6c", "ovs_interfaceid": "fb9bb294-6cbe-46c1-9214-229ff766f28e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:38:08 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-ca5fe84a-d3e3-4c9f-9734-5fc7608e3ea1 req-00ceb27e-5db8-41bd-affa-ec8432ebcceb service nova] Releasing lock "refresh_cache-ff1c5639-9d63-409a-bbd7-1de63f57b189" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 09:38:08 user nova-compute[75122]: DEBUG nova.compute.manager [None req-4ff8696a-e75f-441f-aea5-e8fb047238ef tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] [instance: e4d3e4f5-b48f-4fd4-9299-091469824217] Instance event wait completed in 0 seconds for  {{(pid=75122) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 09:38:08 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-4ff8696a-e75f-441f-aea5-e8fb047238ef tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] [instance: e4d3e4f5-b48f-4fd4-9299-091469824217] Guest created on hypervisor {{(pid=75122) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 09:38:08 user nova-compute[75122]: INFO nova.virt.libvirt.driver [-] [instance: e4d3e4f5-b48f-4fd4-9299-091469824217] Instance spawned successfully.
Nov 15 09:38:08 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-4ff8696a-e75f-441f-aea5-e8fb047238ef tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] [instance: e4d3e4f5-b48f-4fd4-9299-091469824217] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 09:38:08 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-4ff8696a-e75f-441f-aea5-e8fb047238ef tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] [instance: e4d3e4f5-b48f-4fd4-9299-091469824217] Found default for hw_cdrom_bus of ide {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:38:08 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-4ff8696a-e75f-441f-aea5-e8fb047238ef tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] [instance: e4d3e4f5-b48f-4fd4-9299-091469824217] Found default for hw_disk_bus of virtio {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:38:08 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-4ff8696a-e75f-441f-aea5-e8fb047238ef tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] [instance: e4d3e4f5-b48f-4fd4-9299-091469824217] Found default for hw_input_bus of None {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:38:08 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-4ff8696a-e75f-441f-aea5-e8fb047238ef tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] [instance: e4d3e4f5-b48f-4fd4-9299-091469824217] Found default for hw_pointer_model of None {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:38:08 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-4ff8696a-e75f-441f-aea5-e8fb047238ef tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] [instance: e4d3e4f5-b48f-4fd4-9299-091469824217] Found default for hw_video_model of virtio {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:38:08 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-4ff8696a-e75f-441f-aea5-e8fb047238ef tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] [instance: e4d3e4f5-b48f-4fd4-9299-091469824217] Found default for hw_vif_model of virtio {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:38:08 user nova-compute[75122]: INFO nova.compute.manager [None req-4ff8696a-e75f-441f-aea5-e8fb047238ef tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] [instance: e4d3e4f5-b48f-4fd4-9299-091469824217] Took 5.71 seconds to spawn the instance on the hypervisor.
Nov 15 09:38:08 user nova-compute[75122]: DEBUG nova.compute.manager [None req-4ff8696a-e75f-441f-aea5-e8fb047238ef tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] [instance: e4d3e4f5-b48f-4fd4-9299-091469824217] Checking state {{(pid=75122) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 09:38:08 user nova-compute[75122]: INFO nova.compute.manager [None req-4ff8696a-e75f-441f-aea5-e8fb047238ef tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] [instance: e4d3e4f5-b48f-4fd4-9299-091469824217] Took 6.54 seconds to build instance.
Nov 15 09:38:08 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-4ff8696a-e75f-441f-aea5-e8fb047238ef tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] Lock "e4d3e4f5-b48f-4fd4-9299-091469824217" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.684s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:38:09 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:38:09 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:38:09 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:38:09 user nova-compute[75122]: DEBUG nova.compute.manager [req-169a3931-4cf5-464d-97e0-b8c21bc364ce req-47b46914-d5ee-40ff-afa9-2cfb5da7ce8d service nova] [instance: ff1c5639-9d63-409a-bbd7-1de63f57b189] Received event network-vif-plugged-fb9bb294-6cbe-46c1-9214-229ff766f28e {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:38:09 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-169a3931-4cf5-464d-97e0-b8c21bc364ce req-47b46914-d5ee-40ff-afa9-2cfb5da7ce8d service nova] Acquiring lock "ff1c5639-9d63-409a-bbd7-1de63f57b189-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:38:09 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-169a3931-4cf5-464d-97e0-b8c21bc364ce req-47b46914-d5ee-40ff-afa9-2cfb5da7ce8d service nova] Lock "ff1c5639-9d63-409a-bbd7-1de63f57b189-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:38:09 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-169a3931-4cf5-464d-97e0-b8c21bc364ce req-47b46914-d5ee-40ff-afa9-2cfb5da7ce8d service nova] Lock "ff1c5639-9d63-409a-bbd7-1de63f57b189-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:38:09 user nova-compute[75122]: DEBUG nova.compute.manager [req-169a3931-4cf5-464d-97e0-b8c21bc364ce req-47b46914-d5ee-40ff-afa9-2cfb5da7ce8d service nova] [instance: ff1c5639-9d63-409a-bbd7-1de63f57b189] No waiting events found dispatching network-vif-plugged-fb9bb294-6cbe-46c1-9214-229ff766f28e {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:38:09 user nova-compute[75122]: WARNING nova.compute.manager [req-169a3931-4cf5-464d-97e0-b8c21bc364ce req-47b46914-d5ee-40ff-afa9-2cfb5da7ce8d service nova] [instance: ff1c5639-9d63-409a-bbd7-1de63f57b189] Received unexpected event network-vif-plugged-fb9bb294-6cbe-46c1-9214-229ff766f28e for instance with vm_state building and task_state spawning.
Nov 15 09:38:10 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:38:10 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:38:10 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:38:10 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:38:11 user nova-compute[75122]: DEBUG nova.compute.manager [req-3354aa7f-ca06-4606-b5e9-5788635958d9 req-779fd8d8-a753-4da5-b9bf-fd3a80ca438b service nova] [instance: ff1c5639-9d63-409a-bbd7-1de63f57b189] Received event network-vif-plugged-fb9bb294-6cbe-46c1-9214-229ff766f28e {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:38:11 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-3354aa7f-ca06-4606-b5e9-5788635958d9 req-779fd8d8-a753-4da5-b9bf-fd3a80ca438b service nova] Acquiring lock "ff1c5639-9d63-409a-bbd7-1de63f57b189-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:38:11 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-3354aa7f-ca06-4606-b5e9-5788635958d9 req-779fd8d8-a753-4da5-b9bf-fd3a80ca438b service nova] Lock "ff1c5639-9d63-409a-bbd7-1de63f57b189-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:38:11 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-3354aa7f-ca06-4606-b5e9-5788635958d9 req-779fd8d8-a753-4da5-b9bf-fd3a80ca438b service nova] Lock "ff1c5639-9d63-409a-bbd7-1de63f57b189-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:38:11 user nova-compute[75122]: DEBUG nova.compute.manager [req-3354aa7f-ca06-4606-b5e9-5788635958d9 req-779fd8d8-a753-4da5-b9bf-fd3a80ca438b service nova] [instance: ff1c5639-9d63-409a-bbd7-1de63f57b189] No waiting events found dispatching network-vif-plugged-fb9bb294-6cbe-46c1-9214-229ff766f28e {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:38:11 user nova-compute[75122]: WARNING nova.compute.manager [req-3354aa7f-ca06-4606-b5e9-5788635958d9 req-779fd8d8-a753-4da5-b9bf-fd3a80ca438b service nova] [instance: ff1c5639-9d63-409a-bbd7-1de63f57b189] Received unexpected event network-vif-plugged-fb9bb294-6cbe-46c1-9214-229ff766f28e for instance with vm_state building and task_state spawning.
Nov 15 09:38:11 user nova-compute[75122]: DEBUG nova.compute.manager [None req-ee8c3666-c77c-426b-a8bb-d09746711753 tempest-VolumesNegativeTest-1736222970 tempest-VolumesNegativeTest-1736222970-project-member] [instance: ff1c5639-9d63-409a-bbd7-1de63f57b189] Instance event wait completed in 0 seconds for  {{(pid=75122) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 09:38:11 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-ee8c3666-c77c-426b-a8bb-d09746711753 tempest-VolumesNegativeTest-1736222970 tempest-VolumesNegativeTest-1736222970-project-member] [instance: ff1c5639-9d63-409a-bbd7-1de63f57b189] Guest created on hypervisor {{(pid=75122) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 09:38:11 user nova-compute[75122]: INFO nova.virt.libvirt.driver [-] [instance: ff1c5639-9d63-409a-bbd7-1de63f57b189] Instance spawned successfully.
Nov 15 09:38:11 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-ee8c3666-c77c-426b-a8bb-d09746711753 tempest-VolumesNegativeTest-1736222970 tempest-VolumesNegativeTest-1736222970-project-member] [instance: ff1c5639-9d63-409a-bbd7-1de63f57b189] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 09:38:11 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-ee8c3666-c77c-426b-a8bb-d09746711753 tempest-VolumesNegativeTest-1736222970 tempest-VolumesNegativeTest-1736222970-project-member] [instance: ff1c5639-9d63-409a-bbd7-1de63f57b189] Found default for hw_cdrom_bus of ide {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:38:11 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-ee8c3666-c77c-426b-a8bb-d09746711753 tempest-VolumesNegativeTest-1736222970 tempest-VolumesNegativeTest-1736222970-project-member] [instance: ff1c5639-9d63-409a-bbd7-1de63f57b189] Found default for hw_disk_bus of virtio {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:38:11 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-ee8c3666-c77c-426b-a8bb-d09746711753 tempest-VolumesNegativeTest-1736222970 tempest-VolumesNegativeTest-1736222970-project-member] [instance: ff1c5639-9d63-409a-bbd7-1de63f57b189] Found default for hw_input_bus of None {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:38:11 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-ee8c3666-c77c-426b-a8bb-d09746711753 tempest-VolumesNegativeTest-1736222970 tempest-VolumesNegativeTest-1736222970-project-member] [instance: ff1c5639-9d63-409a-bbd7-1de63f57b189] Found default for hw_pointer_model of None {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:38:11 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-ee8c3666-c77c-426b-a8bb-d09746711753 tempest-VolumesNegativeTest-1736222970 tempest-VolumesNegativeTest-1736222970-project-member] [instance: ff1c5639-9d63-409a-bbd7-1de63f57b189] Found default for hw_video_model of virtio {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:38:11 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-ee8c3666-c77c-426b-a8bb-d09746711753 tempest-VolumesNegativeTest-1736222970 tempest-VolumesNegativeTest-1736222970-project-member] [instance: ff1c5639-9d63-409a-bbd7-1de63f57b189] Found default for hw_vif_model of virtio {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:38:11 user nova-compute[75122]: INFO nova.compute.manager [None req-ee8c3666-c77c-426b-a8bb-d09746711753 tempest-VolumesNegativeTest-1736222970 tempest-VolumesNegativeTest-1736222970-project-member] [instance: ff1c5639-9d63-409a-bbd7-1de63f57b189] Took 5.60 seconds to spawn the instance on the hypervisor.
Nov 15 09:38:11 user nova-compute[75122]: DEBUG nova.compute.manager [None req-ee8c3666-c77c-426b-a8bb-d09746711753 tempest-VolumesNegativeTest-1736222970 tempest-VolumesNegativeTest-1736222970-project-member] [instance: ff1c5639-9d63-409a-bbd7-1de63f57b189] Checking state {{(pid=75122) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 09:38:11 user nova-compute[75122]: INFO nova.compute.manager [None req-ee8c3666-c77c-426b-a8bb-d09746711753 tempest-VolumesNegativeTest-1736222970 tempest-VolumesNegativeTest-1736222970-project-member] [instance: ff1c5639-9d63-409a-bbd7-1de63f57b189] Took 6.60 seconds to build instance.
Nov 15 09:38:11 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-ee8c3666-c77c-426b-a8bb-d09746711753 tempest-VolumesNegativeTest-1736222970 tempest-VolumesNegativeTest-1736222970-project-member] Lock "ff1c5639-9d63-409a-bbd7-1de63f57b189" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.718s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:38:12 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:38:13 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:38:13 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:38:13 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75122) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 09:38:14 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:38:15 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:38:15 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:38:15 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Starting heal instance info cache {{(pid=75122) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 09:38:15 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "refresh_cache-5b5a4d58-ba1e-473d-a32a-06fae1c84efc" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 09:38:15 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquired lock "refresh_cache-5b5a4d58-ba1e-473d-a32a-06fae1c84efc" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 09:38:15 user nova-compute[75122]: DEBUG nova.network.neutron [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] [instance: 5b5a4d58-ba1e-473d-a32a-06fae1c84efc] Forcefully refreshing network info cache for instance {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 09:38:15 user nova-compute[75122]: DEBUG nova.network.neutron [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] [instance: 5b5a4d58-ba1e-473d-a32a-06fae1c84efc] Updating instance_info_cache with network_info: [{"id": "b245a5c2-e523-4d4e-a343-f5b2352337ab", "address": "fa:16:3e:cd:ac:71", "network": {"id": "53e8c131-26be-4b3f-beca-dd48fe06ffbe", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-888345656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6aed61f0071f44ac901b94cd9a4a909d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb245a5c2-e5", "ovs_interfaceid": "b245a5c2-e523-4d4e-a343-f5b2352337ab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:38:15 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:38:15 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Releasing lock "refresh_cache-5b5a4d58-ba1e-473d-a32a-06fae1c84efc" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 09:38:15 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] [instance: 5b5a4d58-ba1e-473d-a32a-06fae1c84efc] Updated the network info_cache for instance {{(pid=75122) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 09:38:15 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:38:16 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:38:17 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:38:17 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:38:17 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:38:17 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:38:17 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:38:17 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75122) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 09:38:17 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee961d5a-e0d1-4931-9293-eefbe638097a/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:38:17 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee961d5a-e0d1-4931-9293-eefbe638097a/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:38:17 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee961d5a-e0d1-4931-9293-eefbe638097a/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:38:17 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee961d5a-e0d1-4931-9293-eefbe638097a/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:38:17 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75122) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 09:38:17 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2f45f49-0bca-4ae2-bc2a-eed293143489/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:38:17 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:38:17 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2f45f49-0bca-4ae2-bc2a-eed293143489/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:38:17 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2f45f49-0bca-4ae2-bc2a-eed293143489/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:38:18 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2f45f49-0bca-4ae2-bc2a-eed293143489/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:38:18 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd9d52bb-6248-48e6-a798-6dbdaaa68cbc/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:38:18 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd9d52bb-6248-48e6-a798-6dbdaaa68cbc/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:38:18 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd9d52bb-6248-48e6-a798-6dbdaaa68cbc/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:38:18 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd9d52bb-6248-48e6-a798-6dbdaaa68cbc/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:38:18 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5a4d58-ba1e-473d-a32a-06fae1c84efc/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:38:18 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5a4d58-ba1e-473d-a32a-06fae1c84efc/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:38:18 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5a4d58-ba1e-473d-a32a-06fae1c84efc/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:38:18 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5a4d58-ba1e-473d-a32a-06fae1c84efc/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:38:18 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df913b3e-218d-4ae6-b7b3-70f64fdd3896/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:38:19 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df913b3e-218d-4ae6-b7b3-70f64fdd3896/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:38:19 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df913b3e-218d-4ae6-b7b3-70f64fdd3896/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:38:19 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df913b3e-218d-4ae6-b7b3-70f64fdd3896/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:38:19 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e19f9e1-69c6-4590-85d2-e90cbdbb3d80/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:38:19 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e19f9e1-69c6-4590-85d2-e90cbdbb3d80/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:38:19 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e19f9e1-69c6-4590-85d2-e90cbdbb3d80/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:38:19 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e19f9e1-69c6-4590-85d2-e90cbdbb3d80/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:38:19 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/131142fd-e8ec-42d1-a518-aa21c7bb7cb1/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:38:19 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/131142fd-e8ec-42d1-a518-aa21c7bb7cb1/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:38:19 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/131142fd-e8ec-42d1-a518-aa21c7bb7cb1/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:38:20 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/131142fd-e8ec-42d1-a518-aa21c7bb7cb1/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:38:20 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cfd4155-c4b3-4cce-91e5-042cafccab8b/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:38:20 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cfd4155-c4b3-4cce-91e5-042cafccab8b/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:38:20 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cfd4155-c4b3-4cce-91e5-042cafccab8b/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:38:20 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cfd4155-c4b3-4cce-91e5-042cafccab8b/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:38:20 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75122) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 09:38:20 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe0a6436-87c4-4826-a2f4-8d07c7fab59a/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:38:20 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe0a6436-87c4-4826-a2f4-8d07c7fab59a/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:38:20 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe0a6436-87c4-4826-a2f4-8d07c7fab59a/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:38:20 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe0a6436-87c4-4826-a2f4-8d07c7fab59a/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:38:20 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff1c5639-9d63-409a-bbd7-1de63f57b189/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:38:20 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:38:20 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff1c5639-9d63-409a-bbd7-1de63f57b189/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:38:20 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff1c5639-9d63-409a-bbd7-1de63f57b189/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:38:21 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff1c5639-9d63-409a-bbd7-1de63f57b189/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:38:21 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4d3e4f5-b48f-4fd4-9299-091469824217/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:38:21 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4d3e4f5-b48f-4fd4-9299-091469824217/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:38:21 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4d3e4f5-b48f-4fd4-9299-091469824217/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:38:21 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4d3e4f5-b48f-4fd4-9299-091469824217/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:38:21 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00270cc2-4f5b-4f64-8f88-31f21e3b3950/disk.rescue --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:38:21 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00270cc2-4f5b-4f64-8f88-31f21e3b3950/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:38:21 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00270cc2-4f5b-4f64-8f88-31f21e3b3950/disk.rescue --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:38:21 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00270cc2-4f5b-4f64-8f88-31f21e3b3950/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:38:21 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00270cc2-4f5b-4f64-8f88-31f21e3b3950/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:38:22 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00270cc2-4f5b-4f64-8f88-31f21e3b3950/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:38:22 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00270cc2-4f5b-4f64-8f88-31f21e3b3950/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:38:22 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00270cc2-4f5b-4f64-8f88-31f21e3b3950/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:38:22 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 09:38:22 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 09:38:22 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Hypervisor/Node resource view: name=user free_ram=7283MB free_disk=25.38520050048828GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75122) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 09:38:22 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:38:22 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:38:22 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance 131142fd-e8ec-42d1-a518-aa21c7bb7cb1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:38:22 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance 7cfd4155-c4b3-4cce-91e5-042cafccab8b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:38:22 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance ee961d5a-e0d1-4931-9293-eefbe638097a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:38:22 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance 5b5a4d58-ba1e-473d-a32a-06fae1c84efc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:38:22 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance 1e19f9e1-69c6-4590-85d2-e90cbdbb3d80 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:38:22 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance fd9d52bb-6248-48e6-a798-6dbdaaa68cbc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:38:22 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance 00270cc2-4f5b-4f64-8f88-31f21e3b3950 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:38:22 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance fe0a6436-87c4-4826-a2f4-8d07c7fab59a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:38:22 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance df913b3e-218d-4ae6-b7b3-70f64fdd3896 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:38:22 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance c2f45f49-0bca-4ae2-bc2a-eed293143489 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:38:22 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance e4d3e4f5-b48f-4fd4-9299-091469824217 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:38:22 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance ff1c5639-9d63-409a-bbd7-1de63f57b189 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:38:22 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75122) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 09:38:22 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=12GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75122) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 09:38:22 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:38:23 user nova-compute[75122]: DEBUG nova.compute.provider_tree [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Inventory has not changed in ProviderTree for provider: 69a3da65-47be-44c6-b67c-c692b58284ef {{(pid=75122) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 09:38:23 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Inventory has not changed for provider 69a3da65-47be-44c6-b67c-c692b58284ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 09:38:23 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Compute_service record updated for user:user {{(pid=75122) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 09:38:23 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.565s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:38:25 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:38:27 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:38:27 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:38:30 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:38:32 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:38:35 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:38:37 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:38:40 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:38:42 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-81a03eb2-7856-429f-afbe-bc4e9045869b tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] Acquiring lock "5b5a4d58-ba1e-473d-a32a-06fae1c84efc" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:38:42 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-81a03eb2-7856-429f-afbe-bc4e9045869b tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] Lock "5b5a4d58-ba1e-473d-a32a-06fae1c84efc" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:38:42 user nova-compute[75122]: DEBUG nova.objects.instance [None req-81a03eb2-7856-429f-afbe-bc4e9045869b tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] Lazy-loading 'flavor' on Instance uuid 5b5a4d58-ba1e-473d-a32a-06fae1c84efc {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:38:42 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-81a03eb2-7856-429f-afbe-bc4e9045869b tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] Lock "5b5a4d58-ba1e-473d-a32a-06fae1c84efc" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:38:42 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-81a03eb2-7856-429f-afbe-bc4e9045869b tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] Acquiring lock "5b5a4d58-ba1e-473d-a32a-06fae1c84efc" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:38:42 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-81a03eb2-7856-429f-afbe-bc4e9045869b tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] Lock "5b5a4d58-ba1e-473d-a32a-06fae1c84efc" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:38:42 user nova-compute[75122]: INFO nova.compute.manager [None req-81a03eb2-7856-429f-afbe-bc4e9045869b tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] [instance: 5b5a4d58-ba1e-473d-a32a-06fae1c84efc] Attaching volume 0b366dd5-506b-4ee0-9e25-990a31acf3eb to /dev/vdb
Nov 15 09:38:42 user nova-compute[75122]: DEBUG os_brick.utils [None req-81a03eb2-7856-429f-afbe-bc4e9045869b tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 09:38:42 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:38:42 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:38:42 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[440daf7f-73b9-4f14-8da9-0193696ccaaf]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:742fb64b3587\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:38:42 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:38:42 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:38:42 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[69925d1c-818e-4838-b0e3-565c2845adcf]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:38:42 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:38:42 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:38:42 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8d687e8-164f-4888-aeb0-6d9a59b01305]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:38:42 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[fba6a343-0919-4556-b465-251029e68743]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:38:42 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-81a03eb2-7856-429f-afbe-bc4e9045869b tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] Running cmd (subprocess): nvme version {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:38:42 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-81a03eb2-7856-429f-afbe-bc4e9045869b tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] 'nvme version' failed. Not Retrying. {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 09:38:42 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.nvmeof [None req-81a03eb2-7856-429f-afbe-bc4e9045869b tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] nvme not present on system {{(pid=75122) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 09:38:42 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:38:42 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 09:38:42 user nova-compute[75122]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 09:38:42 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec1dbc1c-23d9-4fff-b0b1-77e05ce2ec99]: (4, '') {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:38:42 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.lightos [None req-81a03eb2-7856-429f-afbe-bc4e9045869b tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75122) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 09:38:42 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.lightos [None req-81a03eb2-7856-429f-afbe-bc4e9045869b tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75122) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 09:38:42 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.lightos [None req-81a03eb2-7856-429f-afbe-bc4e9045869b tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] LIGHTOS: no hostnqn found. {{(pid=75122) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 09:38:42 user nova-compute[75122]: DEBUG os_brick.utils [None req-81a03eb2-7856-429f-afbe-bc4e9045869b tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] <== get_connector_properties: return (112ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:742fb64b3587', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 09:38:42 user nova-compute[75122]: DEBUG nova.virt.block_device [None req-81a03eb2-7856-429f-afbe-bc4e9045869b tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] [instance: 5b5a4d58-ba1e-473d-a32a-06fae1c84efc] Updating existing volume attachment record: aa273939-d371-468d-aa3f-5703df012339 {{(pid=75122) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 09:38:42 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:38:45 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:38:46 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-9ef562b5-f0cd-4b74-b8a8-7dc28381e3f2 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Acquiring lock "ee961d5a-e0d1-4931-9293-eefbe638097a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:38:46 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-9ef562b5-f0cd-4b74-b8a8-7dc28381e3f2 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Lock "ee961d5a-e0d1-4931-9293-eefbe638097a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:38:46 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-9ef562b5-f0cd-4b74-b8a8-7dc28381e3f2 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Acquiring lock "ee961d5a-e0d1-4931-9293-eefbe638097a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:38:46 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-9ef562b5-f0cd-4b74-b8a8-7dc28381e3f2 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Lock "ee961d5a-e0d1-4931-9293-eefbe638097a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:38:46 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-9ef562b5-f0cd-4b74-b8a8-7dc28381e3f2 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Lock "ee961d5a-e0d1-4931-9293-eefbe638097a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:38:46 user nova-compute[75122]: INFO nova.compute.manager [None req-9ef562b5-f0cd-4b74-b8a8-7dc28381e3f2 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] [instance: ee961d5a-e0d1-4931-9293-eefbe638097a] Terminating instance
Nov 15 09:38:46 user nova-compute[75122]: DEBUG nova.compute.manager [None req-9ef562b5-f0cd-4b74-b8a8-7dc28381e3f2 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] [instance: ee961d5a-e0d1-4931-9293-eefbe638097a] Start destroying the instance on the hypervisor. {{(pid=75122) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 09:38:46 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:38:46 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:38:46 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:38:46 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:38:47 user nova-compute[75122]: DEBUG nova.compute.manager [req-390cce4e-9c70-49cf-b070-f1c82c418913 req-b760a655-3c54-4b62-8fd9-518c087f1f37 service nova] [instance: ee961d5a-e0d1-4931-9293-eefbe638097a] Received event network-vif-unplugged-ae8a9c5e-17d1-4aa9-b3fa-b829d1dc6fd2 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:38:47 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-390cce4e-9c70-49cf-b070-f1c82c418913 req-b760a655-3c54-4b62-8fd9-518c087f1f37 service nova] Acquiring lock "ee961d5a-e0d1-4931-9293-eefbe638097a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:38:47 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-390cce4e-9c70-49cf-b070-f1c82c418913 req-b760a655-3c54-4b62-8fd9-518c087f1f37 service nova] Lock "ee961d5a-e0d1-4931-9293-eefbe638097a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:38:47 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-390cce4e-9c70-49cf-b070-f1c82c418913 req-b760a655-3c54-4b62-8fd9-518c087f1f37 service nova] Lock "ee961d5a-e0d1-4931-9293-eefbe638097a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:38:47 user nova-compute[75122]: DEBUG nova.compute.manager [req-390cce4e-9c70-49cf-b070-f1c82c418913 req-b760a655-3c54-4b62-8fd9-518c087f1f37 service nova] [instance: ee961d5a-e0d1-4931-9293-eefbe638097a] No waiting events found dispatching network-vif-unplugged-ae8a9c5e-17d1-4aa9-b3fa-b829d1dc6fd2 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:38:47 user nova-compute[75122]: DEBUG nova.compute.manager [req-390cce4e-9c70-49cf-b070-f1c82c418913 req-b760a655-3c54-4b62-8fd9-518c087f1f37 service nova] [instance: ee961d5a-e0d1-4931-9293-eefbe638097a] Received event network-vif-unplugged-ae8a9c5e-17d1-4aa9-b3fa-b829d1dc6fd2 for instance with task_state deleting. {{(pid=75122) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 09:38:47 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:38:47 user nova-compute[75122]: INFO nova.virt.libvirt.driver [-] [instance: ee961d5a-e0d1-4931-9293-eefbe638097a] Instance destroyed successfully.
Nov 15 09:38:47 user nova-compute[75122]: DEBUG nova.objects.instance [None req-9ef562b5-f0cd-4b74-b8a8-7dc28381e3f2 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Lazy-loading 'resources' on Instance uuid ee961d5a-e0d1-4931-9293-eefbe638097a {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:38:47 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-9ef562b5-f0cd-4b74-b8a8-7dc28381e3f2 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T09:30:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-79968674',display_name='tempest-ServerActionsTestOtherB-server-79968674',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-79968674',id=2,image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJiK6B7/Kn/Opurq4zSOmiWq8yh0HkUVgNM/DkoeYxKo1kQJMVcwOjFbHB9+CscyIIndFz0uf8CUeGmaOLp83QTM6njH0bbr1gC12yHMNGMet8mqfmXy8CIGmj4KMayIOw==',key_name='tempest-keypair-1064498524',keypairs=<?>,launch_index=0,launched_at=2023-11-15T09:36:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d672b8845fa849d99e328521d3d1715b',ramdisk_id='',reservation_id='r-32nlhypw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-279691748',owner_user_name='tempest-ServerActionsTestOtherB-279691748-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T09:36:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c9bf6f2e607842889cd6593ba114cfc3',uuid=ee961d5a-e0d1-4931-9293-eefbe638097a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ae8a9c5e-17d1-4aa9-b3fa-b829d1dc6fd2", "address": "fa:16:3e:7d:98:85", "network": {"id": "44caed16-406b-4a76-966a-0dc42b26f133", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-465582303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d672b8845fa849d99e328521d3d1715b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae8a9c5e-17", "ovs_interfaceid": "ae8a9c5e-17d1-4aa9-b3fa-b829d1dc6fd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 09:38:47 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-9ef562b5-f0cd-4b74-b8a8-7dc28381e3f2 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Converting VIF {"id": "ae8a9c5e-17d1-4aa9-b3fa-b829d1dc6fd2", "address": "fa:16:3e:7d:98:85", "network": {"id": "44caed16-406b-4a76-966a-0dc42b26f133", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-465582303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d672b8845fa849d99e328521d3d1715b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae8a9c5e-17", "ovs_interfaceid": "ae8a9c5e-17d1-4aa9-b3fa-b829d1dc6fd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 09:38:47 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-9ef562b5-f0cd-4b74-b8a8-7dc28381e3f2 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:98:85,bridge_name='br-int',has_traffic_filtering=True,id=ae8a9c5e-17d1-4aa9-b3fa-b829d1dc6fd2,network=Network(44caed16-406b-4a76-966a-0dc42b26f133),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae8a9c5e-17') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 09:38:47 user nova-compute[75122]: DEBUG os_vif [None req-9ef562b5-f0cd-4b74-b8a8-7dc28381e3f2 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:98:85,bridge_name='br-int',has_traffic_filtering=True,id=ae8a9c5e-17d1-4aa9-b3fa-b829d1dc6fd2,network=Network(44caed16-406b-4a76-966a-0dc42b26f133),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae8a9c5e-17') {{(pid=75122) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 09:38:47 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:38:47 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapae8a9c5e-17, bridge=br-int, if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:38:47 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:38:47 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:38:47 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:38:47 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d87af641-a124-4be0-92e8-15bd0b478694) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:38:47 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:38:47 user nova-compute[75122]: INFO os_vif [None req-9ef562b5-f0cd-4b74-b8a8-7dc28381e3f2 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:98:85,bridge_name='br-int',has_traffic_filtering=True,id=ae8a9c5e-17d1-4aa9-b3fa-b829d1dc6fd2,network=Network(44caed16-406b-4a76-966a-0dc42b26f133),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae8a9c5e-17')
Nov 15 09:38:47 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-81a03eb2-7856-429f-afbe-bc4e9045869b tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] [instance: 5b5a4d58-ba1e-473d-a32a-06fae1c84efc] Calling os-brick to attach iSCSI Volume {{(pid=75122) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 09:38:47 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-81a03eb2-7856-429f-afbe-bc4e9045869b tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffa04060b80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0b366dd5-506b-4ee0-9e25-990a31acf3eb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pgnaQueR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 09:38:47 user nova-compute[75122]: WARNING os_brick.initiator.connectors.base [None req-81a03eb2-7856-429f-afbe-bc4e9045869b tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 09:38:47 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-81a03eb2-7856-429f-afbe-bc4e9045869b tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 09:38:47 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-81a03eb2-7856-429f-afbe-bc4e9045869b tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 09:38:47 user nova-compute[75122]: WARNING os_brick.initiator.connectors.base [None req-81a03eb2-7856-429f-afbe-bc4e9045869b tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 09:38:47 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-81a03eb2-7856-429f-afbe-bc4e9045869b tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0b366dd5-506b-4ee0-9e25-990a31acf3eb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 09:38:47 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-81a03eb2-7856-429f-afbe-bc4e9045869b tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0b366dd5-506b-4ee0-9e25-990a31acf3eb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 09:38:47 user nova-compute[75122]: INFO os_brick.initiator.connectors.iscsi [None req-81a03eb2-7856-429f-afbe-bc4e9045869b tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 09:38:47 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b366dd5-506b-4ee0-9e25-990a31acf3eb -p 172.16.0.220:3260 {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:38:47 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ef562b5-f0cd-4b74-b8a8-7dc28381e3f2 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] [instance: ee961d5a-e0d1-4931-9293-eefbe638097a] calling os-brick to detach iSCSI Volume {{(pid=75122) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 09:38:47 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef562b5-f0cd-4b74-b8a8-7dc28381e3f2 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffa04060b80>, {'target_iqn': 'iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BFRblrMm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 09:38:47 user nova-compute[75122]: WARNING os_brick.initiator.connectors.base [None req-9ef562b5-f0cd-4b74-b8a8-7dc28381e3f2 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 09:38:47 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-9ef562b5-f0cd-4b74-b8a8-7dc28381e3f2 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 09:38:47 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b366dd5-506b-4ee0-9e25-990a31acf3eb -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:38:47 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e8e8877-9a87-4e44-8251-3d61a8882244]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:38:47 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-81a03eb2-7856-429f-afbe-bc4e9045869b tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 09:38:47 user nova-compute[75122]:  {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:38:47 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b366dd5-506b-4ee0-9e25-990a31acf3eb -p 172.16.0.220:3260 --interface default --op new {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:38:47 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b366dd5-506b-4ee0-9e25-990a31acf3eb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:38:47 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfb4d649-0038-4568-9d3b-b3b0f053039b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0b366dd5-506b-4ee0-9e25-990a31acf3eb] added\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:38:47 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-81a03eb2-7856-429f-afbe-bc4e9045869b tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0b366dd5-506b-4ee0-9e25-990a31acf3eb] added
Nov 15 09:38:47 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:38:47 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b366dd5-506b-4ee0-9e25-990a31acf3eb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:38:47 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b366dd5-506b-4ee0-9e25-990a31acf3eb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:38:47 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[661eab52-724f-43fa-a143-26c80c4fb7ad]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:38:47 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-81a03eb2-7856-429f-afbe-bc4e9045869b tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:38:47 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b366dd5-506b-4ee0-9e25-990a31acf3eb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:38:47 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b366dd5-506b-4ee0-9e25-990a31acf3eb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:38:47 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[329c6abb-b826-4741-90f4-8b3130c01bf0]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:38:47 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-81a03eb2-7856-429f-afbe-bc4e9045869b tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:38:47 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b366dd5-506b-4ee0-9e25-990a31acf3eb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pgnaQueR {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:38:47 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b366dd5-506b-4ee0-9e25-990a31acf3eb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pgnaQueR" returned: 0 in 0.021s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:38:47 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[8901303c-32c6-471e-8f34-ceac11371eb9]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:38:47 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-81a03eb2-7856-429f-afbe-bc4e9045869b tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pgnaQueR'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:38:47 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b366dd5-506b-4ee0-9e25-990a31acf3eb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:38:47 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b366dd5-506b-4ee0-9e25-990a31acf3eb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:38:47 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[52c23bf3-90f3-48db-afdb-168c7d12cb1c]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:38:47 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-81a03eb2-7856-429f-afbe-bc4e9045869b tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:38:47 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:38:47 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:38:47 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ecc21f8-9b36-4db5-b76d-7afe113ff89b]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7524fa0e-0e0f-4da0-bd00-7f099a8a55e8 (non-flash)\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:38:47 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-81a03eb2-7856-429f-afbe-bc4e9045869b tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16 (non-flash)
Nov 15 09:38:47 user nova-compute[75122]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7524fa0e-0e0f-4da0-bd00-7f099a8a55e8 (non-flash)
Nov 15 09:38:47 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 09:38:47 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-81a03eb2-7856-429f-afbe-bc4e9045869b tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16 (non-flash)
Nov 15 09:38:47 user nova-compute[75122]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7524fa0e-0e0f-4da0-bd00-7f099a8a55e8 (non-flash)
Nov 15 09:38:47 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 09:38:47 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b366dd5-506b-4ee0-9e25-990a31acf3eb -p 172.16.0.220:3260 --login {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:38:47 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b366dd5-506b-4ee0-9e25-990a31acf3eb -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:38:47 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd38bca1-7734-4ac9-a930-4830f46c431d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0b366dd5-506b-4ee0-9e25-990a31acf3eb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0b366dd5-506b-4ee0-9e25-990a31acf3eb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:38:47 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-81a03eb2-7856-429f-afbe-bc4e9045869b tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0b366dd5-506b-4ee0-9e25-990a31acf3eb, portal: 172.16.0.220,3260]
Nov 15 09:38:47 user nova-compute[75122]: Login to [iface: default, target: iqn.2010-10.org.openstack:0b366dd5-506b-4ee0-9e25-990a31acf3eb, portal: 172.16.0.220,3260] successful.
Nov 15 09:38:47 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:38:47 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b366dd5-506b-4ee0-9e25-990a31acf3eb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:38:47 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b366dd5-506b-4ee0-9e25-990a31acf3eb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:38:47 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca0a4aaa-52ed-49ea-8d83-18d23318046d]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:38:47 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-81a03eb2-7856-429f-afbe-bc4e9045869b tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:38:47 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:38:47 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:38:47 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecc99b93-e24f-4895-a498-bd9bfb102eee]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7524fa0e-0e0f-4da0-bd00-7f099a8a55e8 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b366dd5-506b-4ee0-9e25-990a31acf3eb (non-flash)\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:38:47 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-81a03eb2-7856-429f-afbe-bc4e9045869b tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16 (non-flash)
Nov 15 09:38:47 user nova-compute[75122]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7524fa0e-0e0f-4da0-bd00-7f099a8a55e8 (non-flash)
Nov 15 09:38:47 user nova-compute[75122]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b366dd5-506b-4ee0-9e25-990a31acf3eb (non-flash)
Nov 15 09:38:47 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 09:38:47 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-81a03eb2-7856-429f-afbe-bc4e9045869b tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16 (non-flash)
Nov 15 09:38:47 user nova-compute[75122]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7524fa0e-0e0f-4da0-bd00-7f099a8a55e8 (non-flash)
Nov 15 09:38:47 user nova-compute[75122]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b366dd5-506b-4ee0-9e25-990a31acf3eb (non-flash)
Nov 15 09:38:47 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 09:38:47 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-81a03eb2-7856-429f-afbe-bc4e9045869b tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0b366dd5-506b-4ee0-9e25-990a31acf3eb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.274s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 09:38:47 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-81a03eb2-7856-429f-afbe-bc4e9045869b tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] Connected to 172.16.0.220:3260 {{(pid=75122) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 09:38:47 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-81a03eb2-7856-429f-afbe-bc4e9045869b tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] HCTL ('35', '-', '-', 0) found on session 27 with lun 0 {{(pid=75122) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 09:38:47 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-81a03eb2-7856-429f-afbe-bc4e9045869b tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75122) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 09:38:47 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:38:47 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:38:47 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[067b4049-bfc5-48a3-a8b8-09979ad76c82]: (4, ('- - 0', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:38:47 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-81a03eb2-7856-429f-afbe-bc4e9045869b tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] Searching for a device in session 27 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75122) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 09:38:47 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-81a03eb2-7856-429f-afbe-bc4e9045869b tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:0b366dd5-506b-4ee0-9e25-990a31acf3eb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pgnaQueR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75122) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 09:38:48 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-81a03eb2-7856-429f-afbe-bc4e9045869b tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.304s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 09:38:48 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-81a03eb2-7856-429f-afbe-bc4e9045869b tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] <== connect_volume: return (1306ms) {'type': 'block', 'scsi_wwn': '26239373962383563', 'path': '/dev/sdd'} {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 09:38:48 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-81a03eb2-7856-429f-afbe-bc4e9045869b tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] [instance: 5b5a4d58-ba1e-473d-a32a-06fae1c84efc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26239373962383563', 'path': '/dev/sdd'} {{(pid=75122) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 09:38:48 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-9ef562b5-f0cd-4b74-b8a8-7dc28381e3f2 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.299s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 09:38:48 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:38:48 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:38:48 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[76758a23-5732-485a-96f4-c04537c41165]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7524fa0e-0e0f-4da0-bd00-7f099a8a55e8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0b366dd5-506b-4ee0-9e25-990a31acf3eb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:38:48 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef562b5-f0cd-4b74-b8a8-7dc28381e3f2 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 09:38:48 user nova-compute[75122]: No targets found.
Nov 15 09:38:48 user nova-compute[75122]: iSNS:
Nov 15 09:38:48 user nova-compute[75122]: No targets found.
Nov 15 09:38:48 user nova-compute[75122]: STATIC:
Nov 15 09:38:48 user nova-compute[75122]: Target: iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16
Nov 15 09:38:48 user nova-compute[75122]:         Portal: 172.16.0.220:3260,-1
Nov 15 09:38:48 user nova-compute[75122]:                 Iface Name: default
Nov 15 09:38:48 user nova-compute[75122]: Target: iqn.2010-10.org.openstack:7524fa0e-0e0f-4da0-bd00-7f099a8a55e8
Nov 15 09:38:48 user nova-compute[75122]:         Portal: 172.16.0.220:3260,-1
Nov 15 09:38:48 user nova-compute[75122]:                 Iface Name: default
Nov 15 09:38:48 user nova-compute[75122]: Target: iqn.2010-10.org.openstack:0b366dd5-506b-4ee0-9e25-990a31acf3eb
Nov 15 09:38:48 user nova-compute[75122]:         Portal: 172.16.0.220:3260,-1
Nov 15 09:38:48 user nova-compute[75122]:                 Iface Name: default
Nov 15 09:38:48 user nova-compute[75122]: FIRMWARE:
Nov 15 09:38:48 user nova-compute[75122]: No targets found.
Nov 15 09:38:48 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 09:38:48 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef562b5-f0cd-4b74-b8a8-7dc28381e3f2 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 09:38:48 user nova-compute[75122]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 09:38:48 user nova-compute[75122]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75122) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 09:38:48 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef562b5-f0cd-4b74-b8a8-7dc28381e3f2 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16', 0)] {{(pid=75122) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 09:38:48 user nova-compute[75122]: DEBUG nova.objects.instance [None req-81a03eb2-7856-429f-afbe-bc4e9045869b tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] Lazy-loading 'flavor' on Instance uuid 5b5a4d58-ba1e-473d-a32a-06fae1c84efc {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:38:48 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:38:48 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:38:48 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[2daf886d-4815-455c-ace3-b0f7762c53f9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0b366dd5-506b-4ee0-9e25-990a31acf3eb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7524fa0e-0e0f-4da0-bd00-7f099a8a55e8\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:38:48 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:38:48 user nova-compute[75122]: DEBUG nova.virt.libvirt.guest [None req-81a03eb2-7856-429f-afbe-bc4e9045869b tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 09:38:48 user nova-compute[75122]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 09:38:48 user nova-compute[75122]:   <source dev="/dev/sdd"/>
Nov 15 09:38:48 user nova-compute[75122]:   <target dev="vdb" bus="virtio"/>
Nov 15 09:38:48 user nova-compute[75122]:   <serial>0b366dd5-506b-4ee0-9e25-990a31acf3eb</serial>
Nov 15 09:38:48 user nova-compute[75122]: </disk>
Nov 15 09:38:48 user nova-compute[75122]:  {{(pid=75122) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 09:38:48 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:38:48 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae87919e-6bee-4242-a2ec-5b849b2aff23]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7524fa0e-0e0f-4da0-bd00-7f099a8a55e8 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b366dd5-506b-4ee0-9e25-990a31acf3eb (non-flash)\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:38:49 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef562b5-f0cd-4b74-b8a8-7dc28381e3f2 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16 (non-flash)
Nov 15 09:38:49 user nova-compute[75122]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7524fa0e-0e0f-4da0-bd00-7f099a8a55e8 (non-flash)
Nov 15 09:38:49 user nova-compute[75122]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b366dd5-506b-4ee0-9e25-990a31acf3eb (non-flash)
Nov 15 09:38:49 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 09:38:49 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef562b5-f0cd-4b74-b8a8-7dc28381e3f2 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16 (non-flash)
Nov 15 09:38:49 user nova-compute[75122]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7524fa0e-0e0f-4da0-bd00-7f099a8a55e8 (non-flash)
Nov 15 09:38:49 user nova-compute[75122]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b366dd5-506b-4ee0-9e25-990a31acf3eb (non-flash)
Nov 15 09:38:49 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 09:38:49 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef562b5-f0cd-4b74-b8a8-7dc28381e3f2 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ffa04494b80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16'): ({'sdb'}, set())}) {{(pid=75122) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 09:38:49 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-9ef562b5-f0cd-4b74-b8a8-7dc28381e3f2 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Removing single pathed devices sdb {{(pid=75122) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 09:38:49 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:38:49 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:38:49 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[3156c499-b63a-47b8-a344-17606364e7c3]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:38:49 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:38:49 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:38:49 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ea5503b-6664-42b4-aec0-d037cb7b4b12]: (4, ('ok\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:38:49 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-9ef562b5-f0cd-4b74-b8a8-7dc28381e3f2 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Flushing IO for device /dev/sdb {{(pid=75122) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 09:38:49 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:38:49 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:38:49 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[23ec00a3-e6c3-46de-9d92-298b8f49b6b9]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:38:49 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-9ef562b5-f0cd-4b74-b8a8-7dc28381e3f2 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75122) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 09:38:49 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:38:49 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.049s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:38:49 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f26275d-4f41-434e-921d-53594cb323b2]: (4, ('1', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:38:49 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-9ef562b5-f0cd-4b74-b8a8-7dc28381e3f2 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75122) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 09:38:49 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-9ef562b5-f0cd-4b74-b8a8-7dc28381e3f2 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] SCSI volumes sdb have been removed. {{(pid=75122) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 09:38:49 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef562b5-f0cd-4b74-b8a8-7dc28381e3f2 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16')] {{(pid=75122) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 09:38:49 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:38:49 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:38:49 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[f24b9081-7aba-4bb7-8c62-8fb1113532ae]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:38:49 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef562b5-f0cd-4b74-b8a8-7dc28381e3f2 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:38:49 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16 -p 172.16.0.220:3260 --logout {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:38:49 user nova-compute[75122]: DEBUG nova.compute.manager [req-ec6be1fb-9a3b-4f6c-b079-e35c1c66896c req-69393e67-d1ea-4ddb-ae3d-6c9e9c6b9d59 service nova] [instance: ee961d5a-e0d1-4931-9293-eefbe638097a] Received event network-vif-plugged-ae8a9c5e-17d1-4aa9-b3fa-b829d1dc6fd2 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:38:49 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-ec6be1fb-9a3b-4f6c-b079-e35c1c66896c req-69393e67-d1ea-4ddb-ae3d-6c9e9c6b9d59 service nova] Acquiring lock "ee961d5a-e0d1-4931-9293-eefbe638097a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:38:49 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-ec6be1fb-9a3b-4f6c-b079-e35c1c66896c req-69393e67-d1ea-4ddb-ae3d-6c9e9c6b9d59 service nova] Lock "ee961d5a-e0d1-4931-9293-eefbe638097a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:38:49 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-ec6be1fb-9a3b-4f6c-b079-e35c1c66896c req-69393e67-d1ea-4ddb-ae3d-6c9e9c6b9d59 service nova] Lock "ee961d5a-e0d1-4931-9293-eefbe638097a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:38:49 user nova-compute[75122]: DEBUG nova.compute.manager [req-ec6be1fb-9a3b-4f6c-b079-e35c1c66896c req-69393e67-d1ea-4ddb-ae3d-6c9e9c6b9d59 service nova] [instance: ee961d5a-e0d1-4931-9293-eefbe638097a] No waiting events found dispatching network-vif-plugged-ae8a9c5e-17d1-4aa9-b3fa-b829d1dc6fd2 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:38:49 user nova-compute[75122]: WARNING nova.compute.manager [req-ec6be1fb-9a3b-4f6c-b079-e35c1c66896c req-69393e67-d1ea-4ddb-ae3d-6c9e9c6b9d59 service nova] [instance: ee961d5a-e0d1-4931-9293-eefbe638097a] Received unexpected event network-vif-plugged-ae8a9c5e-17d1-4aa9-b3fa-b829d1dc6fd2 for instance with vm_state active and task_state deleting.
Nov 15 09:38:49 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:38:49 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7e1e6d7-f845-47f1-9b90-9e905f617d8d]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:38:49 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef562b5-f0cd-4b74-b8a8-7dc28381e3f2 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16, portal: 172.16.0.220,3260]
Nov 15 09:38:49 user nova-compute[75122]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16, portal: 172.16.0.220,3260] successful.
Nov 15 09:38:49 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:38:49 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16 -p 172.16.0.220:3260 --op delete {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:38:49 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2cd51ed3-2703-4b02-aa7c-ddb113161a16 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:38:49 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7557242-f92b-4969-98f3-332d4760b006]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:38:49 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef562b5-f0cd-4b74-b8a8-7dc28381e3f2 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:38:49 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-9ef562b5-f0cd-4b74-b8a8-7dc28381e3f2 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.322s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 09:38:49 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ef562b5-f0cd-4b74-b8a8-7dc28381e3f2 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] <== disconnect_volume: return (1620ms) None {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 09:38:49 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ef562b5-f0cd-4b74-b8a8-7dc28381e3f2 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] [instance: ee961d5a-e0d1-4931-9293-eefbe638097a] Disconnected iSCSI Volume {{(pid=75122) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 09:38:49 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-9ef562b5-f0cd-4b74-b8a8-7dc28381e3f2 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] [instance: ee961d5a-e0d1-4931-9293-eefbe638097a] Deleting instance files /opt/stack/data/nova/instances/ee961d5a-e0d1-4931-9293-eefbe638097a_del
Nov 15 09:38:49 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-9ef562b5-f0cd-4b74-b8a8-7dc28381e3f2 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] [instance: ee961d5a-e0d1-4931-9293-eefbe638097a] Deletion of /opt/stack/data/nova/instances/ee961d5a-e0d1-4931-9293-eefbe638097a_del complete
Nov 15 09:38:49 user nova-compute[75122]: INFO nova.compute.manager [None req-9ef562b5-f0cd-4b74-b8a8-7dc28381e3f2 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] [instance: ee961d5a-e0d1-4931-9293-eefbe638097a] Took 2.54 seconds to destroy the instance on the hypervisor.
Nov 15 09:38:49 user nova-compute[75122]: DEBUG oslo.service.loopingcall [None req-9ef562b5-f0cd-4b74-b8a8-7dc28381e3f2 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75122) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 09:38:49 user nova-compute[75122]: DEBUG nova.compute.manager [-] [instance: ee961d5a-e0d1-4931-9293-eefbe638097a] Deallocating network for instance {{(pid=75122) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 09:38:49 user nova-compute[75122]: DEBUG nova.network.neutron [-] [instance: ee961d5a-e0d1-4931-9293-eefbe638097a] deallocate_for_instance() {{(pid=75122) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 09:38:49 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-81a03eb2-7856-429f-afbe-bc4e9045869b tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] No BDM found with device name vda, not building metadata. {{(pid=75122) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 09:38:49 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-81a03eb2-7856-429f-afbe-bc4e9045869b tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75122) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 09:38:49 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-81a03eb2-7856-429f-afbe-bc4e9045869b tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] No VIF found with MAC fa:16:3e:cd:ac:71, not building metadata {{(pid=75122) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 09:38:49 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-81a03eb2-7856-429f-afbe-bc4e9045869b tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] Lock "5b5a4d58-ba1e-473d-a32a-06fae1c84efc" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.826s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:38:50 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-676df6b4-4103-481e-bff3-10f2c0d6d27f tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Acquiring lock "fe0a6436-87c4-4826-a2f4-8d07c7fab59a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:38:50 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-676df6b4-4103-481e-bff3-10f2c0d6d27f tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Lock "fe0a6436-87c4-4826-a2f4-8d07c7fab59a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:38:50 user nova-compute[75122]: DEBUG nova.objects.instance [None req-676df6b4-4103-481e-bff3-10f2c0d6d27f tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Lazy-loading 'flavor' on Instance uuid fe0a6436-87c4-4826-a2f4-8d07c7fab59a {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:38:50 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-676df6b4-4103-481e-bff3-10f2c0d6d27f tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] [instance: fe0a6436-87c4-4826-a2f4-8d07c7fab59a] Ignoring supplied device name: /dev/vdb
Nov 15 09:38:50 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-676df6b4-4103-481e-bff3-10f2c0d6d27f tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Lock "fe0a6436-87c4-4826-a2f4-8d07c7fab59a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:38:50 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-676df6b4-4103-481e-bff3-10f2c0d6d27f tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Acquiring lock "fe0a6436-87c4-4826-a2f4-8d07c7fab59a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:38:50 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-676df6b4-4103-481e-bff3-10f2c0d6d27f tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Lock "fe0a6436-87c4-4826-a2f4-8d07c7fab59a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:38:50 user nova-compute[75122]: INFO nova.compute.manager [None req-676df6b4-4103-481e-bff3-10f2c0d6d27f tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] [instance: fe0a6436-87c4-4826-a2f4-8d07c7fab59a] Attaching volume 9a69584d-f417-452a-867a-3b79df307bf6 to /dev/vdb
Nov 15 09:38:50 user nova-compute[75122]: DEBUG os_brick.utils [None req-676df6b4-4103-481e-bff3-10f2c0d6d27f tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 09:38:50 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:38:50 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:38:50 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fa39710-250a-43b6-8945-df8eb29a7888]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:742fb64b3587\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:38:50 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:38:50 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:38:50 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf0aea51-3c2c-400b-87f4-d1bbeabc273d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:38:50 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:38:50 user nova-compute[75122]: DEBUG nova.network.neutron [-] [instance: ee961d5a-e0d1-4931-9293-eefbe638097a] Updating instance_info_cache with network_info: [] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:38:50 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:38:50 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cbff8ad-cdd3-47aa-9bc7-6a98328dd465]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:38:50 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[2712faba-ded4-4cf9-b506-435aedd53664]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:38:50 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-676df6b4-4103-481e-bff3-10f2c0d6d27f tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Running cmd (subprocess): nvme version {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:38:50 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-676df6b4-4103-481e-bff3-10f2c0d6d27f tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] 'nvme version' failed. Not Retrying. {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 09:38:50 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.nvmeof [None req-676df6b4-4103-481e-bff3-10f2c0d6d27f tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] nvme not present on system {{(pid=75122) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 09:38:50 user nova-compute[75122]: DEBUG nova.compute.manager [req-705afebe-1833-45c2-84a8-2db285fe6f82 req-8cb90aed-e88b-4d92-8a82-b19ba3449625 service nova] [instance: ee961d5a-e0d1-4931-9293-eefbe638097a] Received event network-vif-deleted-ae8a9c5e-17d1-4aa9-b3fa-b829d1dc6fd2 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:38:50 user nova-compute[75122]: INFO nova.compute.manager [req-705afebe-1833-45c2-84a8-2db285fe6f82 req-8cb90aed-e88b-4d92-8a82-b19ba3449625 service nova] [instance: ee961d5a-e0d1-4931-9293-eefbe638097a] Neutron deleted interface ae8a9c5e-17d1-4aa9-b3fa-b829d1dc6fd2; detaching it from the instance and deleting it from the info cache
Nov 15 09:38:50 user nova-compute[75122]: DEBUG nova.network.neutron [req-705afebe-1833-45c2-84a8-2db285fe6f82 req-8cb90aed-e88b-4d92-8a82-b19ba3449625 service nova] [instance: ee961d5a-e0d1-4931-9293-eefbe638097a] Updating instance_info_cache with network_info: [] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:38:50 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:38:50 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 09:38:50 user nova-compute[75122]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 09:38:50 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[62e40722-b876-4e0a-96d5-2410e8428569]: (4, '') {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:38:50 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.lightos [None req-676df6b4-4103-481e-bff3-10f2c0d6d27f tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75122) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 09:38:50 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.lightos [None req-676df6b4-4103-481e-bff3-10f2c0d6d27f tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75122) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 09:38:50 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.lightos [None req-676df6b4-4103-481e-bff3-10f2c0d6d27f tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] LIGHTOS: no hostnqn found. {{(pid=75122) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 09:38:50 user nova-compute[75122]: DEBUG os_brick.utils [None req-676df6b4-4103-481e-bff3-10f2c0d6d27f tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] <== get_connector_properties: return (141ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:742fb64b3587', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 09:38:50 user nova-compute[75122]: DEBUG nova.virt.block_device [None req-676df6b4-4103-481e-bff3-10f2c0d6d27f tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] [instance: fe0a6436-87c4-4826-a2f4-8d07c7fab59a] Updating existing volume attachment record: 052445c4-ba39-4c25-8f75-9498886ee1fe {{(pid=75122) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 09:38:50 user nova-compute[75122]: INFO nova.compute.manager [-] [instance: ee961d5a-e0d1-4931-9293-eefbe638097a] Took 1.29 seconds to deallocate network for instance.
Nov 15 09:38:50 user nova-compute[75122]: DEBUG nova.compute.manager [req-705afebe-1833-45c2-84a8-2db285fe6f82 req-8cb90aed-e88b-4d92-8a82-b19ba3449625 service nova] [instance: ee961d5a-e0d1-4931-9293-eefbe638097a] Detach interface failed, port_id=ae8a9c5e-17d1-4aa9-b3fa-b829d1dc6fd2, reason: Instance ee961d5a-e0d1-4931-9293-eefbe638097a could not be found. {{(pid=75122) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 09:38:50 user nova-compute[75122]: INFO nova.compute.manager [None req-6b6acaa2-ded9-4cc9-852f-998c6dda9ccb tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] [instance: 5b5a4d58-ba1e-473d-a32a-06fae1c84efc] Rescuing
Nov 15 09:38:50 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-6b6acaa2-ded9-4cc9-852f-998c6dda9ccb tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] Acquiring lock "refresh_cache-5b5a4d58-ba1e-473d-a32a-06fae1c84efc" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 09:38:50 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-6b6acaa2-ded9-4cc9-852f-998c6dda9ccb tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] Acquired lock "refresh_cache-5b5a4d58-ba1e-473d-a32a-06fae1c84efc" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 09:38:50 user nova-compute[75122]: DEBUG nova.network.neutron [None req-6b6acaa2-ded9-4cc9-852f-998c6dda9ccb tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] [instance: 5b5a4d58-ba1e-473d-a32a-06fae1c84efc] Building network info cache for instance {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 09:38:50 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:38:51 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-947f4232-efa6-4265-8ede-51bb7cfc1c6f tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Acquiring lock "7cfd4155-c4b3-4cce-91e5-042cafccab8b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:38:51 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-947f4232-efa6-4265-8ede-51bb7cfc1c6f tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Lock "7cfd4155-c4b3-4cce-91e5-042cafccab8b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:38:51 user nova-compute[75122]: INFO nova.compute.manager [None req-947f4232-efa6-4265-8ede-51bb7cfc1c6f tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] [instance: 7cfd4155-c4b3-4cce-91e5-042cafccab8b] Detaching volume 7524fa0e-0e0f-4da0-bd00-7f099a8a55e8
Nov 15 09:38:51 user nova-compute[75122]: DEBUG nova.network.neutron [None req-6b6acaa2-ded9-4cc9-852f-998c6dda9ccb tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] [instance: 5b5a4d58-ba1e-473d-a32a-06fae1c84efc] Updating instance_info_cache with network_info: [{"id": "b245a5c2-e523-4d4e-a343-f5b2352337ab", "address": "fa:16:3e:cd:ac:71", "network": {"id": "53e8c131-26be-4b3f-beca-dd48fe06ffbe", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-888345656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6aed61f0071f44ac901b94cd9a4a909d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb245a5c2-e5", "ovs_interfaceid": "b245a5c2-e523-4d4e-a343-f5b2352337ab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:38:51 user nova-compute[75122]: INFO nova.virt.block_device [None req-947f4232-efa6-4265-8ede-51bb7cfc1c6f tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] [instance: 7cfd4155-c4b3-4cce-91e5-042cafccab8b] Attempting to driver detach volume 7524fa0e-0e0f-4da0-bd00-7f099a8a55e8 from mountpoint /dev/vdb
Nov 15 09:38:51 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-6b6acaa2-ded9-4cc9-852f-998c6dda9ccb tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] Releasing lock "refresh_cache-5b5a4d58-ba1e-473d-a32a-06fae1c84efc" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 09:38:51 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-947f4232-efa6-4265-8ede-51bb7cfc1c6f tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Attempting to detach device vdb from instance 7cfd4155-c4b3-4cce-91e5-042cafccab8b from the persistent domain config. {{(pid=75122) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 09:38:51 user nova-compute[75122]: DEBUG nova.virt.libvirt.guest [None req-947f4232-efa6-4265-8ede-51bb7cfc1c6f tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 09:38:51 user nova-compute[75122]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 09:38:51 user nova-compute[75122]:   <source dev="/dev/sdc"/>
Nov 15 09:38:51 user nova-compute[75122]:   <target dev="vdb" bus="virtio"/>
Nov 15 09:38:51 user nova-compute[75122]:   <serial>7524fa0e-0e0f-4da0-bd00-7f099a8a55e8</serial>
Nov 15 09:38:51 user nova-compute[75122]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 15 09:38:51 user nova-compute[75122]: </disk>
Nov 15 09:38:51 user nova-compute[75122]:  {{(pid=75122) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 09:38:51 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-947f4232-efa6-4265-8ede-51bb7cfc1c6f tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Successfully detached device vdb from instance 7cfd4155-c4b3-4cce-91e5-042cafccab8b from the persistent domain config.
Nov 15 09:38:51 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-947f4232-efa6-4265-8ede-51bb7cfc1c6f tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7cfd4155-c4b3-4cce-91e5-042cafccab8b from the live domain config. {{(pid=75122) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 09:38:51 user nova-compute[75122]: DEBUG nova.virt.libvirt.guest [None req-947f4232-efa6-4265-8ede-51bb7cfc1c6f tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 09:38:51 user nova-compute[75122]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 09:38:51 user nova-compute[75122]:   <source dev="/dev/sdc"/>
Nov 15 09:38:51 user nova-compute[75122]:   <target dev="vdb" bus="virtio"/>
Nov 15 09:38:51 user nova-compute[75122]:   <serial>7524fa0e-0e0f-4da0-bd00-7f099a8a55e8</serial>
Nov 15 09:38:51 user nova-compute[75122]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 15 09:38:51 user nova-compute[75122]: </disk>
Nov 15 09:38:51 user nova-compute[75122]:  {{(pid=75122) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 09:38:51 user nova-compute[75122]: DEBUG nova.compute.manager [req-d3857e49-f09c-47da-a0bf-47863c687cf9 req-c04110ef-2e51-413e-ab76-04a40b43f653 service nova] [instance: fe0a6436-87c4-4826-a2f4-8d07c7fab59a] Received event network-changed-80aa86de-4dda-46e9-bb33-424ce423cf85 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:38:51 user nova-compute[75122]: DEBUG nova.compute.manager [req-d3857e49-f09c-47da-a0bf-47863c687cf9 req-c04110ef-2e51-413e-ab76-04a40b43f653 service nova] [instance: fe0a6436-87c4-4826-a2f4-8d07c7fab59a] Refreshing instance network info cache due to event network-changed-80aa86de-4dda-46e9-bb33-424ce423cf85. {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 09:38:51 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-d3857e49-f09c-47da-a0bf-47863c687cf9 req-c04110ef-2e51-413e-ab76-04a40b43f653 service nova] Acquiring lock "refresh_cache-fe0a6436-87c4-4826-a2f4-8d07c7fab59a" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 09:38:51 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-d3857e49-f09c-47da-a0bf-47863c687cf9 req-c04110ef-2e51-413e-ab76-04a40b43f653 service nova] Acquired lock "refresh_cache-fe0a6436-87c4-4826-a2f4-8d07c7fab59a" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 09:38:51 user nova-compute[75122]: DEBUG nova.network.neutron [req-d3857e49-f09c-47da-a0bf-47863c687cf9 req-c04110ef-2e51-413e-ab76-04a40b43f653 service nova] [instance: fe0a6436-87c4-4826-a2f4-8d07c7fab59a] Refreshing network info cache for port 80aa86de-4dda-46e9-bb33-424ce423cf85 {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 09:38:51 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:38:51 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:38:51 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:38:51 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:38:51 user nova-compute[75122]: DEBUG nova.compute.manager [req-8ef55b16-861e-4d13-808a-15aab8a79094 req-45b61948-a1dc-475a-89da-770de8d354a4 service nova] [instance: 5b5a4d58-ba1e-473d-a32a-06fae1c84efc] Received event network-vif-unplugged-b245a5c2-e523-4d4e-a343-f5b2352337ab {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:38:51 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-8ef55b16-861e-4d13-808a-15aab8a79094 req-45b61948-a1dc-475a-89da-770de8d354a4 service nova] Acquiring lock "5b5a4d58-ba1e-473d-a32a-06fae1c84efc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:38:51 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-8ef55b16-861e-4d13-808a-15aab8a79094 req-45b61948-a1dc-475a-89da-770de8d354a4 service nova] Lock "5b5a4d58-ba1e-473d-a32a-06fae1c84efc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:38:51 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-8ef55b16-861e-4d13-808a-15aab8a79094 req-45b61948-a1dc-475a-89da-770de8d354a4 service nova] Lock "5b5a4d58-ba1e-473d-a32a-06fae1c84efc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:38:51 user nova-compute[75122]: DEBUG nova.compute.manager [req-8ef55b16-861e-4d13-808a-15aab8a79094 req-45b61948-a1dc-475a-89da-770de8d354a4 service nova] [instance: 5b5a4d58-ba1e-473d-a32a-06fae1c84efc] No waiting events found dispatching network-vif-unplugged-b245a5c2-e523-4d4e-a343-f5b2352337ab {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:38:51 user nova-compute[75122]: WARNING nova.compute.manager [req-8ef55b16-861e-4d13-808a-15aab8a79094 req-45b61948-a1dc-475a-89da-770de8d354a4 service nova] [instance: 5b5a4d58-ba1e-473d-a32a-06fae1c84efc] Received unexpected event network-vif-unplugged-b245a5c2-e523-4d4e-a343-f5b2352337ab for instance with vm_state active and task_state rescuing.
Nov 15 09:38:51 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-947f4232-efa6-4265-8ede-51bb7cfc1c6f tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7cfd4155-c4b3-4cce-91e5-042cafccab8b {{(pid=75122) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 09:38:51 user nova-compute[75122]: DEBUG nova.network.neutron [req-d3857e49-f09c-47da-a0bf-47863c687cf9 req-c04110ef-2e51-413e-ab76-04a40b43f653 service nova] [instance: fe0a6436-87c4-4826-a2f4-8d07c7fab59a] Updated VIF entry in instance network info cache for port 80aa86de-4dda-46e9-bb33-424ce423cf85. {{(pid=75122) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 09:38:51 user nova-compute[75122]: DEBUG nova.network.neutron [req-d3857e49-f09c-47da-a0bf-47863c687cf9 req-c04110ef-2e51-413e-ab76-04a40b43f653 service nova] [instance: fe0a6436-87c4-4826-a2f4-8d07c7fab59a] Updating instance_info_cache with network_info: [{"id": "80aa86de-4dda-46e9-bb33-424ce423cf85", "address": "fa:16:3e:ce:ac:dd", "network": {"id": "cd74302c-bfd9-495b-887f-0de0d94f4ffc", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-692728798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac8ea42f6a3446e8a8edcf3dcb016b84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80aa86de-4d", "ovs_interfaceid": "80aa86de-4dda-46e9-bb33-424ce423cf85", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:38:51 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-d3857e49-f09c-47da-a0bf-47863c687cf9 req-c04110ef-2e51-413e-ab76-04a40b43f653 service nova] Releasing lock "refresh_cache-fe0a6436-87c4-4826-a2f4-8d07c7fab59a" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 09:38:52 user nova-compute[75122]: INFO nova.virt.libvirt.driver [-] [instance: 5b5a4d58-ba1e-473d-a32a-06fae1c84efc] Instance destroyed successfully.
Nov 15 09:38:52 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-6b6acaa2-ded9-4cc9-852f-998c6dda9ccb tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] [instance: 5b5a4d58-ba1e-473d-a32a-06fae1c84efc] Attempting a stable device rescue
Nov 15 09:38:52 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-6b6acaa2-ded9-4cc9-852f-998c6dda9ccb tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=75122) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 15 09:38:52 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-6b6acaa2-ded9-4cc9-852f-998c6dda9ccb tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] [instance: 5b5a4d58-ba1e-473d-a32a-06fae1c84efc] Instance directory exists: not creating {{(pid=75122) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 15 09:38:52 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-6b6acaa2-ded9-4cc9-852f-998c6dda9ccb tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] [instance: 5b5a4d58-ba1e-473d-a32a-06fae1c84efc] Creating image(s)
Nov 15 09:38:52 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-6b6acaa2-ded9-4cc9-852f-998c6dda9ccb tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] Acquiring lock "/opt/stack/data/nova/instances/5b5a4d58-ba1e-473d-a32a-06fae1c84efc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:38:52 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-6b6acaa2-ded9-4cc9-852f-998c6dda9ccb tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] Lock "/opt/stack/data/nova/instances/5b5a4d58-ba1e-473d-a32a-06fae1c84efc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:38:52 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-6b6acaa2-ded9-4cc9-852f-998c6dda9ccb tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] Lock "/opt/stack/data/nova/instances/5b5a4d58-ba1e-473d-a32a-06fae1c84efc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:38:52 user nova-compute[75122]: DEBUG nova.objects.instance [None req-6b6acaa2-ded9-4cc9-852f-998c6dda9ccb tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] Lazy-loading 'trusted_certs' on Instance uuid 5b5a4d58-ba1e-473d-a32a-06fae1c84efc {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:38:52 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-6b6acaa2-ded9-4cc9-852f-998c6dda9ccb tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] Acquiring lock "0074bdc91483d34219af75dab5bc825f3f26328d" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:38:52 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-6b6acaa2-ded9-4cc9-852f-998c6dda9ccb tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] Lock "0074bdc91483d34219af75dab5bc825f3f26328d" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:38:53 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-6b6acaa2-ded9-4cc9-852f-998c6dda9ccb tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0074bdc91483d34219af75dab5bc825f3f26328d.part --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:38:53 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:38:53 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-6b6acaa2-ded9-4cc9-852f-998c6dda9ccb tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0074bdc91483d34219af75dab5bc825f3f26328d.part --force-share --output=json" returned: 0 in 0.194s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:38:53 user nova-compute[75122]: DEBUG nova.virt.images [None req-6b6acaa2-ded9-4cc9-852f-998c6dda9ccb tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] f75cce5d-2d6b-435b-b39e-e09b82dad0aa was qcow2, converting to raw {{(pid=75122) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 15 09:38:53 user nova-compute[75122]: DEBUG nova.privsep.utils [None req-6b6acaa2-ded9-4cc9-852f-998c6dda9ccb tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75122) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 09:38:53 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-6b6acaa2-ded9-4cc9-852f-998c6dda9ccb tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/0074bdc91483d34219af75dab5bc825f3f26328d.part /opt/stack/data/nova/instances/_base/0074bdc91483d34219af75dab5bc825f3f26328d.converted {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:38:53 user nova-compute[75122]: DEBUG nova.compute.manager [req-a920b593-71f6-46aa-bd80-604a9c7cc9c2 req-c7ba2d07-4f73-49dd-8c92-cb0e2b967887 service nova] [instance: 5b5a4d58-ba1e-473d-a32a-06fae1c84efc] Received event network-vif-plugged-b245a5c2-e523-4d4e-a343-f5b2352337ab {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:38:53 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-a920b593-71f6-46aa-bd80-604a9c7cc9c2 req-c7ba2d07-4f73-49dd-8c92-cb0e2b967887 service nova] Acquiring lock "5b5a4d58-ba1e-473d-a32a-06fae1c84efc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:38:53 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-a920b593-71f6-46aa-bd80-604a9c7cc9c2 req-c7ba2d07-4f73-49dd-8c92-cb0e2b967887 service nova] Lock "5b5a4d58-ba1e-473d-a32a-06fae1c84efc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:38:53 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-a920b593-71f6-46aa-bd80-604a9c7cc9c2 req-c7ba2d07-4f73-49dd-8c92-cb0e2b967887 service nova] Lock "5b5a4d58-ba1e-473d-a32a-06fae1c84efc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:38:53 user nova-compute[75122]: DEBUG nova.compute.manager [req-a920b593-71f6-46aa-bd80-604a9c7cc9c2 req-c7ba2d07-4f73-49dd-8c92-cb0e2b967887 service nova] [instance: 5b5a4d58-ba1e-473d-a32a-06fae1c84efc] No waiting events found dispatching network-vif-plugged-b245a5c2-e523-4d4e-a343-f5b2352337ab {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:38:53 user nova-compute[75122]: WARNING nova.compute.manager [req-a920b593-71f6-46aa-bd80-604a9c7cc9c2 req-c7ba2d07-4f73-49dd-8c92-cb0e2b967887 service nova] [instance: 5b5a4d58-ba1e-473d-a32a-06fae1c84efc] Received unexpected event network-vif-plugged-b245a5c2-e523-4d4e-a343-f5b2352337ab for instance with vm_state active and task_state rescuing.
Nov 15 09:38:54 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-6b6acaa2-ded9-4cc9-852f-998c6dda9ccb tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/0074bdc91483d34219af75dab5bc825f3f26328d.part /opt/stack/data/nova/instances/_base/0074bdc91483d34219af75dab5bc825f3f26328d.converted" returned: 0 in 0.802s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:38:54 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-6b6acaa2-ded9-4cc9-852f-998c6dda9ccb tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0074bdc91483d34219af75dab5bc825f3f26328d.converted --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:38:54 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-6b6acaa2-ded9-4cc9-852f-998c6dda9ccb tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0074bdc91483d34219af75dab5bc825f3f26328d.converted --force-share --output=json" returned: 0 in 0.173s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:38:54 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-6b6acaa2-ded9-4cc9-852f-998c6dda9ccb tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] Lock "0074bdc91483d34219af75dab5bc825f3f26328d" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.399s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:38:54 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-6b6acaa2-ded9-4cc9-852f-998c6dda9ccb tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] Acquiring lock "0074bdc91483d34219af75dab5bc825f3f26328d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:38:54 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-6b6acaa2-ded9-4cc9-852f-998c6dda9ccb tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] Lock "0074bdc91483d34219af75dab5bc825f3f26328d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:38:54 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-6b6acaa2-ded9-4cc9-852f-998c6dda9ccb tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0074bdc91483d34219af75dab5bc825f3f26328d --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:38:54 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-6b6acaa2-ded9-4cc9-852f-998c6dda9ccb tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0074bdc91483d34219af75dab5bc825f3f26328d --force-share --output=json" returned: 0 in 0.180s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:38:54 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-6b6acaa2-ded9-4cc9-852f-998c6dda9ccb tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0074bdc91483d34219af75dab5bc825f3f26328d,backing_fmt=raw /opt/stack/data/nova/instances/5b5a4d58-ba1e-473d-a32a-06fae1c84efc/disk.rescue {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:38:54 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-6b6acaa2-ded9-4cc9-852f-998c6dda9ccb tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0074bdc91483d34219af75dab5bc825f3f26328d,backing_fmt=raw /opt/stack/data/nova/instances/5b5a4d58-ba1e-473d-a32a-06fae1c84efc/disk.rescue" returned: 0 in 0.047s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:38:54 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-6b6acaa2-ded9-4cc9-852f-998c6dda9ccb tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] Lock "0074bdc91483d34219af75dab5bc825f3f26328d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.234s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:38:54 user nova-compute[75122]: DEBUG nova.objects.instance [None req-6b6acaa2-ded9-4cc9-852f-998c6dda9ccb tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] Lazy-loading 'migration_context' on Instance uuid 5b5a4d58-ba1e-473d-a32a-06fae1c84efc {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:38:54 user nova-compute[75122]: DEBUG nova.objects.base [None req-6b6acaa2-ded9-4cc9-852f-998c6dda9ccb tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] Object Instance<5b5a4d58-ba1e-473d-a32a-06fae1c84efc> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75122) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 09:38:54 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-6b6acaa2-ded9-4cc9-852f-998c6dda9ccb tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] [instance: 5b5a4d58-ba1e-473d-a32a-06fae1c84efc] Created local disks {{(pid=75122) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 09:38:54 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-6b6acaa2-ded9-4cc9-852f-998c6dda9ccb tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] [instance: 5b5a4d58-ba1e-473d-a32a-06fae1c84efc] Start _get_guest_xml network_info=[{"id": "b245a5c2-e523-4d4e-a343-f5b2352337ab", "address": "fa:16:3e:cd:ac:71", "network": {"id": "53e8c131-26be-4b3f-beca-dd48fe06ffbe", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-888345656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-888345656-network", "vif_mac": "fa:16:3e:cd:ac:71"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6aed61f0071f44ac901b94cd9a4a909d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb245a5c2-e5", "ovs_interfaceid": "b245a5c2-e523-4d4e-a343-f5b2352337ab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T09:26:31Z,direct_url=<?>,disk_format='qcow2',id=5e862cfe-47b8-4725-8292-65761ee6d0f5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9c57733cb41847c0b4ad31519c382e5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T09:26:33Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'f75cce5d-2d6b-435b-b39e-e09b82dad0aa', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '5e862cfe-47b8-4725-8292-65761ee6d0f5'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0b366dd5-506b-4ee0-9e25-990a31acf3eb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pgnaQueR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': '5b5a4d58-ba1e-473d-a32a-06fae1c84efc', 'attached_at': '', 'detached_at': '', 'volume_id': '0b366dd5-506b-4ee0-9e25-990a31acf3eb', 'serial': '0b366dd5-506b-4ee0-9e25-990a31acf3eb'}, 'guest_format': None, 'delete_on_termination': False, 'boot_index': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vdb', 'attachment_id': 'aa273939-d371-468d-aa3f-5703df012339', 'volume_type': None} {{(pid=75122) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 09:38:54 user nova-compute[75122]: DEBUG nova.objects.instance [None req-6b6acaa2-ded9-4cc9-852f-998c6dda9ccb tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] Lazy-loading 'resources' on Instance uuid 5b5a4d58-ba1e-473d-a32a-06fae1c84efc {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:38:54 user nova-compute[75122]: DEBUG nova.objects.base [None req-6b6acaa2-ded9-4cc9-852f-998c6dda9ccb tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] Object Instance<5b5a4d58-ba1e-473d-a32a-06fae1c84efc> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75122) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 09:38:54 user nova-compute[75122]: DEBUG nova.objects.instance [None req-6b6acaa2-ded9-4cc9-852f-998c6dda9ccb tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] Lazy-loading 'numa_topology' on Instance uuid 5b5a4d58-ba1e-473d-a32a-06fae1c84efc {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:38:54 user nova-compute[75122]: DEBUG nova.objects.base [None req-6b6acaa2-ded9-4cc9-852f-998c6dda9ccb tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] Object Instance<5b5a4d58-ba1e-473d-a32a-06fae1c84efc> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75122) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 09:38:54 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-6b6acaa2-ded9-4cc9-852f-998c6dda9ccb tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 09:38:54 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-6b6acaa2-ded9-4cc9-852f-998c6dda9ccb tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 09:38:54 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-6b6acaa2-ded9-4cc9-852f-998c6dda9ccb tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75122) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 09:38:54 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-6b6acaa2-ded9-4cc9-852f-998c6dda9ccb tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] CPU controller missing on host. {{(pid=75122) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 09:38:54 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-6b6acaa2-ded9-4cc9-852f-998c6dda9ccb tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75122) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 09:38:54 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-6b6acaa2-ded9-4cc9-852f-998c6dda9ccb tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] CPU controller found on host. {{(pid=75122) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 09:38:54 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-6b6acaa2-ded9-4cc9-852f-998c6dda9ccb tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75122) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 09:38:54 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-6b6acaa2-ded9-4cc9-852f-998c6dda9ccb tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T09:26:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T09:26:31Z,direct_url=<?>,disk_format='qcow2',id=5e862cfe-47b8-4725-8292-65761ee6d0f5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9c57733cb41847c0b4ad31519c382e5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T09:26:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 09:38:54 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-6b6acaa2-ded9-4cc9-852f-998c6dda9ccb tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] Flavor limits 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 09:38:54 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-6b6acaa2-ded9-4cc9-852f-998c6dda9ccb tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] Image limits 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 09:38:54 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-6b6acaa2-ded9-4cc9-852f-998c6dda9ccb tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] Flavor pref 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 09:38:54 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-6b6acaa2-ded9-4cc9-852f-998c6dda9ccb tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] Image pref 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 09:38:54 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-6b6acaa2-ded9-4cc9-852f-998c6dda9ccb tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 09:38:54 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-6b6acaa2-ded9-4cc9-852f-998c6dda9ccb tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 09:38:54 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-6b6acaa2-ded9-4cc9-852f-998c6dda9ccb tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75122) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 09:38:54 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-6b6acaa2-ded9-4cc9-852f-998c6dda9ccb tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] Got 1 possible topologies {{(pid=75122) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 09:38:54 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-6b6acaa2-ded9-4cc9-852f-998c6dda9ccb tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 09:38:54 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-6b6acaa2-ded9-4cc9-852f-998c6dda9ccb tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 09:38:54 user nova-compute[75122]: DEBUG nova.objects.instance [None req-6b6acaa2-ded9-4cc9-852f-998c6dda9ccb tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] Lazy-loading 'vcpu_model' on Instance uuid 5b5a4d58-ba1e-473d-a32a-06fae1c84efc {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:38:54 user nova-compute[75122]: DEBUG nova.objects.base [None req-6b6acaa2-ded9-4cc9-852f-998c6dda9ccb tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] Object Instance<5b5a4d58-ba1e-473d-a32a-06fae1c84efc> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75122) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 09:38:54 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b6acaa2-ded9-4cc9-852f-998c6dda9ccb tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] [instance: 5b5a4d58-ba1e-473d-a32a-06fae1c84efc] Calling os-brick to attach iSCSI Volume {{(pid=75122) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 09:38:54 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b6acaa2-ded9-4cc9-852f-998c6dda9ccb tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffa04060b80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0b366dd5-506b-4ee0-9e25-990a31acf3eb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pgnaQueR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 09:38:54 user nova-compute[75122]: WARNING os_brick.initiator.connectors.base [None req-6b6acaa2-ded9-4cc9-852f-998c6dda9ccb tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 09:38:54 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-6b6acaa2-ded9-4cc9-852f-998c6dda9ccb tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 09:38:54 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-6b6acaa2-ded9-4cc9-852f-998c6dda9ccb tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 09:38:54 user nova-compute[75122]: WARNING os_brick.initiator.connectors.base [None req-6b6acaa2-ded9-4cc9-852f-998c6dda9ccb tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 09:38:54 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-6b6acaa2-ded9-4cc9-852f-998c6dda9ccb tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0b366dd5-506b-4ee0-9e25-990a31acf3eb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 09:38:54 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-6b6acaa2-ded9-4cc9-852f-998c6dda9ccb tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0b366dd5-506b-4ee0-9e25-990a31acf3eb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 09:38:54 user nova-compute[75122]: INFO os_brick.initiator.connectors.iscsi [None req-6b6acaa2-ded9-4cc9-852f-998c6dda9ccb tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 09:38:54 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b366dd5-506b-4ee0-9e25-990a31acf3eb -p 172.16.0.220:3260 {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:38:54 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b366dd5-506b-4ee0-9e25-990a31acf3eb -p 172.16.0.220:3260" returned: 0 in 0.017s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:38:54 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cdcc12f-a82a-4eae-ac36-d190c00b19d1]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:0b366dd5-506b-4ee0-9e25-990a31acf3eb\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = pgnaQueR\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:38:54 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b6acaa2-ded9-4cc9-852f-998c6dda9ccb tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 15 09:38:54 user nova-compute[75122]: node.name = iqn.2010-10.org.openstack:0b366dd5-506b-4ee0-9e25-990a31acf3eb
Nov 15 09:38:54 user nova-compute[75122]: node.tpgt = -1
Nov 15 09:38:54 user nova-compute[75122]: node.startup = automatic
Nov 15 09:38:54 user nova-compute[75122]: node.leading_login = No
Nov 15 09:38:54 user nova-compute[75122]: iface.iscsi_ifacename = default
Nov 15 09:38:54 user nova-compute[75122]: iface.net_ifacename = <empty>
Nov 15 09:38:54 user nova-compute[75122]: iface.ipaddress = <empty>
Nov 15 09:38:54 user nova-compute[75122]: iface.prefix_len = 0
Nov 15 09:38:54 user nova-compute[75122]: iface.hwaddress = <empty>
Nov 15 09:38:54 user nova-compute[75122]: iface.transport_name = tcp
Nov 15 09:38:54 user nova-compute[75122]: iface.initiatorname = <empty>
Nov 15 09:38:54 user nova-compute[75122]: iface.state = <empty>
Nov 15 09:38:54 user nova-compute[75122]: iface.vlan_id = 0
Nov 15 09:38:54 user nova-compute[75122]: iface.vlan_priority = 0
Nov 15 09:38:54 user nova-compute[75122]: iface.vlan_state = <empty>
Nov 15 09:38:54 user nova-compute[75122]: iface.iface_num = 0
Nov 15 09:38:54 user nova-compute[75122]: iface.mtu = 0
Nov 15 09:38:54 user nova-compute[75122]: iface.port = 0
Nov 15 09:38:54 user nova-compute[75122]: iface.bootproto = <empty>
Nov 15 09:38:54 user nova-compute[75122]: iface.subnet_mask = <empty>
Nov 15 09:38:54 user nova-compute[75122]: iface.gateway = <empty>
Nov 15 09:38:54 user nova-compute[75122]: iface.dhcp_alt_client_id_state = <empty>
Nov 15 09:38:54 user nova-compute[75122]: iface.dhcp_alt_client_id = <empty>
Nov 15 09:38:54 user nova-compute[75122]: iface.dhcp_dns = <empty>
Nov 15 09:38:54 user nova-compute[75122]: iface.dhcp_learn_iqn = <empty>
Nov 15 09:38:54 user nova-compute[75122]: iface.dhcp_req_vendor_id_state = <empty>
Nov 15 09:38:54 user nova-compute[75122]: iface.dhcp_vendor_id_state = <empty>
Nov 15 09:38:54 user nova-compute[75122]: iface.dhcp_vendor_id = <empty>
Nov 15 09:38:54 user nova-compute[75122]: iface.dhcp_slp_da = <empty>
Nov 15 09:38:54 user nova-compute[75122]: iface.fragmentation = <empty>
Nov 15 09:38:54 user nova-compute[75122]: iface.gratuitous_arp = <empty>
Nov 15 09:38:54 user nova-compute[75122]: iface.incoming_forwarding = <empty>
Nov 15 09:38:54 user nova-compute[75122]: iface.tos_state = <empty>
Nov 15 09:38:54 user nova-compute[75122]: iface.tos = 0
Nov 15 09:38:54 user nova-compute[75122]: iface.ttl = 0
Nov 15 09:38:54 user nova-compute[75122]: iface.delayed_ack = <empty>
Nov 15 09:38:54 user nova-compute[75122]: iface.tcp_nagle = <empty>
Nov 15 09:38:54 user nova-compute[75122]: iface.tcp_wsf_state = <empty>
Nov 15 09:38:54 user nova-compute[75122]: iface.tcp_wsf = 0
Nov 15 09:38:54 user nova-compute[75122]: iface.tcp_timer_scale = 0
Nov 15 09:38:54 user nova-compute[75122]: iface.tcp_timestamp = <empty>
Nov 15 09:38:54 user nova-compute[75122]: iface.redirect = <empty>
Nov 15 09:38:54 user nova-compute[75122]: iface.def_task_mgmt_timeout = 0
Nov 15 09:38:54 user nova-compute[75122]: iface.header_digest = <empty>
Nov 15 09:38:54 user nova-compute[75122]: iface.data_digest = <empty>
Nov 15 09:38:54 user nova-compute[75122]: iface.immediate_data = <empty>
Nov 15 09:38:54 user nova-compute[75122]: iface.initial_r2t = <empty>
Nov 15 09:38:54 user nova-compute[75122]: iface.data_seq_inorder = <empty>
Nov 15 09:38:54 user nova-compute[75122]: iface.data_pdu_inorder = <empty>
Nov 15 09:38:54 user nova-compute[75122]: iface.erl = 0
Nov 15 09:38:54 user nova-compute[75122]: iface.max_receive_data_len = 0
Nov 15 09:38:54 user nova-compute[75122]: iface.first_burst_len = 0
Nov 15 09:38:54 user nova-compute[75122]: iface.max_outstanding_r2t = 0
Nov 15 09:38:54 user nova-compute[75122]: iface.max_burst_len = 0
Nov 15 09:38:54 user nova-compute[75122]: iface.chap_auth = <empty>
Nov 15 09:38:54 user nova-compute[75122]: iface.bidi_chap = <empty>
Nov 15 09:38:54 user nova-compute[75122]: iface.strict_login_compliance = <empty>
Nov 15 09:38:54 user nova-compute[75122]: iface.discovery_auth = <empty>
Nov 15 09:38:54 user nova-compute[75122]: iface.discovery_logout = <empty>
Nov 15 09:38:54 user nova-compute[75122]: node.discovery_address = <empty>
Nov 15 09:38:54 user nova-compute[75122]: node.discovery_port = 0
Nov 15 09:38:54 user nova-compute[75122]: node.discovery_type = static
Nov 15 09:38:54 user nova-compute[75122]: node.session.initial_cmdsn = 0
Nov 15 09:38:54 user nova-compute[75122]: node.session.initial_login_retry_max = 8
Nov 15 09:38:54 user nova-compute[75122]: node.session.xmit_thread_priority = -20
Nov 15 09:38:54 user nova-compute[75122]: node.session.cmds_max = 128
Nov 15 09:38:54 user nova-compute[75122]: node.session.queue_depth = 32
Nov 15 09:38:54 user nova-compute[75122]: node.session.nr_sessions = 1
Nov 15 09:38:54 user nova-compute[75122]: node.session.auth.authmethod = CHAP
Nov 15 09:38:54 user nova-compute[75122]: node.session.auth.username = pgnaQueR
Nov 15 09:38:54 user nova-compute[75122]: node.session.auth.password = ***
Nov 15 09:38:54 user nova-compute[75122]: node.session.auth.username_in = <empty>
Nov 15 09:38:54 user nova-compute[75122]: node.session.auth.password_in = <empty>
Nov 15 09:38:54 user nova-compute[75122]: node.session.auth.chap_algs = MD5
Nov 15 09:38:54 user nova-compute[75122]: node.session.timeo.replacement_timeout = 120
Nov 15 09:38:54 user nova-compute[75122]: node.session.err_timeo.abort_timeout = 15
Nov 15 09:38:54 user nova-compute[75122]: node.session.err_timeo.lu_reset_timeout = 30
Nov 15 09:38:54 user nova-compute[75122]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 15 09:38:54 user nova-compute[75122]: node.session.err_timeo.host_reset_timeout = 60
Nov 15 09:38:54 user nova-compute[75122]: node.session.iscsi.FastAbort = Yes
Nov 15 09:38:54 user nova-compute[75122]: node.session.iscsi.InitialR2T = No
Nov 15 09:38:54 user nova-compute[75122]: node.session.iscsi.ImmediateData = Yes
Nov 15 09:38:54 user nova-compute[75122]: node.session.iscsi.FirstBurstLength = 262144
Nov 15 09:38:54 user nova-compute[75122]: node.session.iscsi.MaxBurstLength = 16776192
Nov 15 09:38:54 user nova-compute[75122]: node.session.iscsi.DefaultTime2Retain = 0
Nov 15 09:38:54 user nova-compute[75122]: node.session.iscsi.DefaultTime2Wait = 2
Nov 15 09:38:54 user nova-compute[75122]: node.session.iscsi.MaxConnections = 1
Nov 15 09:38:54 user nova-compute[75122]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 15 09:38:54 user nova-compute[75122]: node.session.iscsi.ERL = 0
Nov 15 09:38:54 user nova-compute[75122]: node.session.scan = manual
Nov 15 09:38:54 user nova-compute[75122]: node.session.reopen_max = 0
Nov 15 09:38:54 user nova-compute[75122]: node.conn[0].address = 172.16.0.220
Nov 15 09:38:54 user nova-compute[75122]: node.conn[0].port = 3260
Nov 15 09:38:54 user nova-compute[75122]: node.conn[0].startup = manual
Nov 15 09:38:54 user nova-compute[75122]: node.conn[0].tcp.window_size = 524288
Nov 15 09:38:54 user nova-compute[75122]: node.conn[0].tcp.type_of_service = 0
Nov 15 09:38:54 user nova-compute[75122]: node.conn[0].timeo.logout_timeout = 15
Nov 15 09:38:54 user nova-compute[75122]: node.conn[0].timeo.login_timeout = 15
Nov 15 09:38:54 user nova-compute[75122]: node.conn[0].timeo.auth_timeout = 45
Nov 15 09:38:54 user nova-compute[75122]: node.conn[0].timeo.noop_out_interval = 5
Nov 15 09:38:54 user nova-compute[75122]: node.conn[0].timeo.noop_out_timeout = 5
Nov 15 09:38:54 user nova-compute[75122]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 15 09:38:54 user nova-compute[75122]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 15 09:38:54 user nova-compute[75122]: node.conn[0].iscsi.HeaderDigest = None
Nov 15 09:38:54 user nova-compute[75122]: node.conn[0].iscsi.DataDigest = None
Nov 15 09:38:54 user nova-compute[75122]: node.conn[0].iscsi.IFMarker = No
Nov 15 09:38:54 user nova-compute[75122]: node.conn[0].iscsi.OFMarker = No
Nov 15 09:38:54 user nova-compute[75122]: # END RECORD
Nov 15 09:38:54 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:38:54 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b366dd5-506b-4ee0-9e25-990a31acf3eb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:38:54 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b366dd5-506b-4ee0-9e25-990a31acf3eb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:38:54 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec983372-6874-4b45-83a7-05865d9dc8f7]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:38:54 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b6acaa2-ded9-4cc9-852f-998c6dda9ccb tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:38:54 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b366dd5-506b-4ee0-9e25-990a31acf3eb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:38:54 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b366dd5-506b-4ee0-9e25-990a31acf3eb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:38:54 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[f18a418a-be5b-4bed-8b35-600f6b218e08]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:38:54 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b6acaa2-ded9-4cc9-852f-998c6dda9ccb tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:38:54 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b366dd5-506b-4ee0-9e25-990a31acf3eb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pgnaQueR {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:38:54 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b366dd5-506b-4ee0-9e25-990a31acf3eb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pgnaQueR" returned: 0 in 0.027s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:38:54 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c65c509-bef7-4123-b6c7-cae00adfab4b]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:38:54 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b6acaa2-ded9-4cc9-852f-998c6dda9ccb tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pgnaQueR'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:38:54 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b366dd5-506b-4ee0-9e25-990a31acf3eb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:38:55 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b366dd5-506b-4ee0-9e25-990a31acf3eb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:38:55 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[50a25a16-f21a-4308-b136-2d4504ff0db8]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:38:55 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b6acaa2-ded9-4cc9-852f-998c6dda9ccb tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:38:55 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:38:55 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:38:55 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5835951-29cc-4c4c-86f0-91286b765970]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7524fa0e-0e0f-4da0-bd00-7f099a8a55e8 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b366dd5-506b-4ee0-9e25-990a31acf3eb (non-flash)\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:38:55 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b6acaa2-ded9-4cc9-852f-998c6dda9ccb tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7524fa0e-0e0f-4da0-bd00-7f099a8a55e8 (non-flash)
Nov 15 09:38:55 user nova-compute[75122]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b366dd5-506b-4ee0-9e25-990a31acf3eb (non-flash)
Nov 15 09:38:55 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 09:38:55 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b6acaa2-ded9-4cc9-852f-998c6dda9ccb tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7524fa0e-0e0f-4da0-bd00-7f099a8a55e8 (non-flash)
Nov 15 09:38:55 user nova-compute[75122]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b366dd5-506b-4ee0-9e25-990a31acf3eb (non-flash)
Nov 15 09:38:55 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 09:38:55 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-6b6acaa2-ded9-4cc9-852f-998c6dda9ccb tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0b366dd5-506b-4ee0-9e25-990a31acf3eb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.139s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 09:38:55 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b6acaa2-ded9-4cc9-852f-998c6dda9ccb tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] Connected to 172.16.0.220:3260 {{(pid=75122) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 09:38:55 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-6b6acaa2-ded9-4cc9-852f-998c6dda9ccb tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] HCTL ('35', '0', '0', 0) found on session 27 with lun 0 {{(pid=75122) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 09:38:55 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-6b6acaa2-ded9-4cc9-852f-998c6dda9ccb tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] Scanning host 35 c: 0, t: 0, l: 0) {{(pid=75122) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 09:38:55 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:38:55 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.012s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:38:55 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[39ddccbd-8fce-48e5-9f11-83c77879f5b0]: (4, ('0 0 0', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:38:55 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-6b6acaa2-ded9-4cc9-852f-998c6dda9ccb tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] Searching for a device in session 27 and hctl ('35', '0', '0', 0) yield: sdd {{(pid=75122) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 09:38:55 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b6acaa2-ded9-4cc9-852f-998c6dda9ccb tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:0b366dd5-506b-4ee0-9e25-990a31acf3eb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pgnaQueR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75122) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 09:38:55 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-6b6acaa2-ded9-4cc9-852f-998c6dda9ccb tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.160s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 09:38:55 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b6acaa2-ded9-4cc9-852f-998c6dda9ccb tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] <== connect_volume: return (162ms) {'type': 'block', 'scsi_wwn': '26239373962383563', 'path': '/dev/sdd'} {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 09:38:55 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b6acaa2-ded9-4cc9-852f-998c6dda9ccb tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] [instance: 5b5a4d58-ba1e-473d-a32a-06fae1c84efc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26239373962383563', 'path': '/dev/sdd'} {{(pid=75122) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 09:38:55 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-6b6acaa2-ded9-4cc9-852f-998c6dda9ccb tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T09:34:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-180143653',display_name='tempest-ServerStableDeviceRescueTest-server-180143653',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-180143653',id=14,image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKac38UUwHVGlBpF/6pXojX0cRWwmcLLAWsTVnSZWVmiaULTNSXXsfMP/wFHtldyqrM46US3c5PHqGscE2t9cqcjfXRdmnAO58flpaqENX0njs5rEgrRIIKZ8U9R5OYa5Q==',key_name='tempest-keypair-537753446',keypairs=<?>,launch_index=0,launched_at=2023-11-15T09:35:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6aed61f0071f44ac901b94cd9a4a909d',ramdisk_id='',reservation_id='r-v0tsii3q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-813673110',owner_user_name='tempest-ServerStableDeviceRescueTest-813673110-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T09:36:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2940f4a7d03a4c9b97a832c436ae4b76',uuid=5b5a4d58-ba1e-473d-a32a-06fae1c84efc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b245a5c2-e523-4d4e-a343-f5b2352337ab", "address": "fa:16:3e:cd:ac:71", "network": {"id": "53e8c131-26be-4b3f-beca-dd48fe06ffbe", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-888345656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-888345656-network", "vif_mac": "fa:16:3e:cd:ac:71"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6aed61f0071f44ac901b94cd9a4a909d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb245a5c2-e5", "ovs_interfaceid": "b245a5c2-e523-4d4e-a343-f5b2352337ab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75122) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 09:38:55 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-6b6acaa2-ded9-4cc9-852f-998c6dda9ccb tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] Converting VIF {"id": "b245a5c2-e523-4d4e-a343-f5b2352337ab", "address": "fa:16:3e:cd:ac:71", "network": {"id": "53e8c131-26be-4b3f-beca-dd48fe06ffbe", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-888345656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-888345656-network", "vif_mac": "fa:16:3e:cd:ac:71"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6aed61f0071f44ac901b94cd9a4a909d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb245a5c2-e5", "ovs_interfaceid": "b245a5c2-e523-4d4e-a343-f5b2352337ab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 09:38:55 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-6b6acaa2-ded9-4cc9-852f-998c6dda9ccb tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cd:ac:71,bridge_name='br-int',has_traffic_filtering=True,id=b245a5c2-e523-4d4e-a343-f5b2352337ab,network=Network(53e8c131-26be-4b3f-beca-dd48fe06ffbe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb245a5c2-e5') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 09:38:55 user nova-compute[75122]: DEBUG nova.objects.instance [None req-6b6acaa2-ded9-4cc9-852f-998c6dda9ccb tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] Lazy-loading 'pci_devices' on Instance uuid 5b5a4d58-ba1e-473d-a32a-06fae1c84efc {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:38:55 user nova-compute[75122]: DEBUG nova.objects.base [None req-6b6acaa2-ded9-4cc9-852f-998c6dda9ccb tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] Object Instance<5b5a4d58-ba1e-473d-a32a-06fae1c84efc> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75122) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 09:38:55 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-6b6acaa2-ded9-4cc9-852f-998c6dda9ccb tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] [instance: 5b5a4d58-ba1e-473d-a32a-06fae1c84efc] End _get_guest_xml xml=<domain type="kvm">
Nov 15 09:38:55 user nova-compute[75122]:   <uuid>5b5a4d58-ba1e-473d-a32a-06fae1c84efc</uuid>
Nov 15 09:38:55 user nova-compute[75122]:   <name>instance-0000000e</name>
Nov 15 09:38:55 user nova-compute[75122]:   <memory>524288</memory>
Nov 15 09:38:55 user nova-compute[75122]:   <vcpu>1</vcpu>
Nov 15 09:38:55 user nova-compute[75122]:   <metadata>
Nov 15 09:38:55 user nova-compute[75122]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 09:38:55 user nova-compute[75122]:       <nova:package version="0.0.0"/>
Nov 15 09:38:55 user nova-compute[75122]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-180143653</nova:name>
Nov 15 09:38:55 user nova-compute[75122]:       <nova:creationTime>2023-11-15 09:38:54</nova:creationTime>
Nov 15 09:38:55 user nova-compute[75122]:       <nova:flavor name="m1.tiny">
Nov 15 09:38:55 user nova-compute[75122]:         <nova:memory>512</nova:memory>
Nov 15 09:38:55 user nova-compute[75122]:         <nova:disk>1</nova:disk>
Nov 15 09:38:55 user nova-compute[75122]:         <nova:swap>0</nova:swap>
Nov 15 09:38:55 user nova-compute[75122]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 09:38:55 user nova-compute[75122]:         <nova:vcpus>1</nova:vcpus>
Nov 15 09:38:55 user nova-compute[75122]:       </nova:flavor>
Nov 15 09:38:55 user nova-compute[75122]:       <nova:owner>
Nov 15 09:38:55 user nova-compute[75122]:         <nova:user uuid="2940f4a7d03a4c9b97a832c436ae4b76">tempest-ServerStableDeviceRescueTest-813673110-project-member</nova:user>
Nov 15 09:38:55 user nova-compute[75122]:         <nova:project uuid="6aed61f0071f44ac901b94cd9a4a909d">tempest-ServerStableDeviceRescueTest-813673110</nova:project>
Nov 15 09:38:55 user nova-compute[75122]:       </nova:owner>
Nov 15 09:38:55 user nova-compute[75122]:       <nova:root type="image" uuid="5e862cfe-47b8-4725-8292-65761ee6d0f5"/>
Nov 15 09:38:55 user nova-compute[75122]:       <nova:ports>
Nov 15 09:38:55 user nova-compute[75122]:         <nova:port uuid="b245a5c2-e523-4d4e-a343-f5b2352337ab">
Nov 15 09:38:55 user nova-compute[75122]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 15 09:38:55 user nova-compute[75122]:         </nova:port>
Nov 15 09:38:55 user nova-compute[75122]:       </nova:ports>
Nov 15 09:38:55 user nova-compute[75122]:     </nova:instance>
Nov 15 09:38:55 user nova-compute[75122]:   </metadata>
Nov 15 09:38:55 user nova-compute[75122]:   <sysinfo type="smbios">
Nov 15 09:38:55 user nova-compute[75122]:     <system>
Nov 15 09:38:55 user nova-compute[75122]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 09:38:55 user nova-compute[75122]:       <entry name="product">OpenStack Nova</entry>
Nov 15 09:38:55 user nova-compute[75122]:       <entry name="version">0.0.0</entry>
Nov 15 09:38:55 user nova-compute[75122]:       <entry name="serial">5b5a4d58-ba1e-473d-a32a-06fae1c84efc</entry>
Nov 15 09:38:55 user nova-compute[75122]:       <entry name="uuid">5b5a4d58-ba1e-473d-a32a-06fae1c84efc</entry>
Nov 15 09:38:55 user nova-compute[75122]:       <entry name="family">Virtual Machine</entry>
Nov 15 09:38:55 user nova-compute[75122]:     </system>
Nov 15 09:38:55 user nova-compute[75122]:   </sysinfo>
Nov 15 09:38:55 user nova-compute[75122]:   <os>
Nov 15 09:38:55 user nova-compute[75122]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 09:38:55 user nova-compute[75122]:     <smbios mode="sysinfo"/>
Nov 15 09:38:55 user nova-compute[75122]:   </os>
Nov 15 09:38:55 user nova-compute[75122]:   <features>
Nov 15 09:38:55 user nova-compute[75122]:     <acpi/>
Nov 15 09:38:55 user nova-compute[75122]:     <apic/>
Nov 15 09:38:55 user nova-compute[75122]:     <vmcoreinfo/>
Nov 15 09:38:55 user nova-compute[75122]:   </features>
Nov 15 09:38:55 user nova-compute[75122]:   <clock offset="utc">
Nov 15 09:38:55 user nova-compute[75122]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 09:38:55 user nova-compute[75122]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 09:38:55 user nova-compute[75122]:     <timer name="hpet" present="no"/>
Nov 15 09:38:55 user nova-compute[75122]:   </clock>
Nov 15 09:38:55 user nova-compute[75122]:   <cpu mode="custom" match="exact">
Nov 15 09:38:55 user nova-compute[75122]:     <model>Nehalem</model>
Nov 15 09:38:55 user nova-compute[75122]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 09:38:55 user nova-compute[75122]:   </cpu>
Nov 15 09:38:55 user nova-compute[75122]:   <devices>
Nov 15 09:38:55 user nova-compute[75122]:     <disk type="file" device="disk">
Nov 15 09:38:55 user nova-compute[75122]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 09:38:55 user nova-compute[75122]:       <source file="/opt/stack/data/nova/instances/5b5a4d58-ba1e-473d-a32a-06fae1c84efc/disk"/>
Nov 15 09:38:55 user nova-compute[75122]:       <target dev="vda" bus="virtio"/>
Nov 15 09:38:55 user nova-compute[75122]:     </disk>
Nov 15 09:38:55 user nova-compute[75122]:     <disk type="block" device="disk">
Nov 15 09:38:55 user nova-compute[75122]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 09:38:55 user nova-compute[75122]:       <source dev="/dev/sdd"/>
Nov 15 09:38:55 user nova-compute[75122]:       <target dev="vdb" bus="virtio"/>
Nov 15 09:38:55 user nova-compute[75122]:       <serial>0b366dd5-506b-4ee0-9e25-990a31acf3eb</serial>
Nov 15 09:38:55 user nova-compute[75122]:     </disk>
Nov 15 09:38:55 user nova-compute[75122]:     <disk type="file" device="disk">
Nov 15 09:38:55 user nova-compute[75122]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 09:38:55 user nova-compute[75122]:       <source file="/opt/stack/data/nova/instances/5b5a4d58-ba1e-473d-a32a-06fae1c84efc/disk.rescue"/>
Nov 15 09:38:55 user nova-compute[75122]:       <target dev="vdc" bus="virtio"/>
Nov 15 09:38:55 user nova-compute[75122]:       <boot order="1"/>
Nov 15 09:38:55 user nova-compute[75122]:     </disk>
Nov 15 09:38:55 user nova-compute[75122]:     <interface type="ethernet">
Nov 15 09:38:55 user nova-compute[75122]:       <mac address="fa:16:3e:cd:ac:71"/>
Nov 15 09:38:55 user nova-compute[75122]:       <model type="virtio"/>
Nov 15 09:38:55 user nova-compute[75122]:       <mtu size="1442"/>
Nov 15 09:38:55 user nova-compute[75122]:       <target dev="tapb245a5c2-e5"/>
Nov 15 09:38:55 user nova-compute[75122]:     </interface>
Nov 15 09:38:55 user nova-compute[75122]:     <serial type="pty">
Nov 15 09:38:55 user nova-compute[75122]:       <log file="/opt/stack/data/nova/instances/5b5a4d58-ba1e-473d-a32a-06fae1c84efc/console.log" append="off"/>
Nov 15 09:38:55 user nova-compute[75122]:     </serial>
Nov 15 09:38:55 user nova-compute[75122]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 09:38:55 user nova-compute[75122]:     <video>
Nov 15 09:38:55 user nova-compute[75122]:       <model type="virtio"/>
Nov 15 09:38:55 user nova-compute[75122]:     </video>
Nov 15 09:38:55 user nova-compute[75122]:     <rng model="virtio">
Nov 15 09:38:55 user nova-compute[75122]:       <backend model="random">/dev/urandom</backend>
Nov 15 09:38:55 user nova-compute[75122]:     </rng>
Nov 15 09:38:55 user nova-compute[75122]:     <controller type="usb" index="0" model="none"/>
Nov 15 09:38:55 user nova-compute[75122]:     <memballoon model="virtio">
Nov 15 09:38:55 user nova-compute[75122]:       <stats period="10"/>
Nov 15 09:38:55 user nova-compute[75122]:     </memballoon>
Nov 15 09:38:55 user nova-compute[75122]:   </devices>
Nov 15 09:38:55 user nova-compute[75122]: </domain>
Nov 15 09:38:55 user nova-compute[75122]:  {{(pid=75122) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 09:38:55 user nova-compute[75122]: INFO nova.virt.libvirt.driver [-] [instance: 5b5a4d58-ba1e-473d-a32a-06fae1c84efc] Instance destroyed successfully.
Nov 15 09:38:55 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-6b6acaa2-ded9-4cc9-852f-998c6dda9ccb tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] No BDM found with device name vda, not building metadata. {{(pid=75122) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 09:38:55 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-6b6acaa2-ded9-4cc9-852f-998c6dda9ccb tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75122) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 09:38:55 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-6b6acaa2-ded9-4cc9-852f-998c6dda9ccb tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75122) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 09:38:55 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-6b6acaa2-ded9-4cc9-852f-998c6dda9ccb tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] No VIF found with MAC fa:16:3e:cd:ac:71, not building metadata {{(pid=75122) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 09:38:55 user nova-compute[75122]: INFO nova.compute.manager [None req-9ef562b5-f0cd-4b74-b8a8-7dc28381e3f2 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] [instance: ee961d5a-e0d1-4931-9293-eefbe638097a] Took 4.96 seconds to detach 1 volumes for instance.
Nov 15 09:38:55 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-9ef562b5-f0cd-4b74-b8a8-7dc28381e3f2 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:38:55 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-9ef562b5-f0cd-4b74-b8a8-7dc28381e3f2 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:38:55 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:38:55 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-676df6b4-4103-481e-bff3-10f2c0d6d27f tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] [instance: fe0a6436-87c4-4826-a2f4-8d07c7fab59a] Calling os-brick to attach iSCSI Volume {{(pid=75122) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 09:38:55 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-676df6b4-4103-481e-bff3-10f2c0d6d27f tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffa04060b80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9a69584d-f417-452a-867a-3b79df307bf6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vSUZVhBx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 09:38:55 user nova-compute[75122]: WARNING os_brick.initiator.connectors.base [None req-676df6b4-4103-481e-bff3-10f2c0d6d27f tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 09:38:55 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-676df6b4-4103-481e-bff3-10f2c0d6d27f tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 09:38:55 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-676df6b4-4103-481e-bff3-10f2c0d6d27f tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 09:38:55 user nova-compute[75122]: WARNING os_brick.initiator.connectors.base [None req-676df6b4-4103-481e-bff3-10f2c0d6d27f tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 09:38:55 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-676df6b4-4103-481e-bff3-10f2c0d6d27f tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9a69584d-f417-452a-867a-3b79df307bf6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 09:38:55 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-676df6b4-4103-481e-bff3-10f2c0d6d27f tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9a69584d-f417-452a-867a-3b79df307bf6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 09:38:55 user nova-compute[75122]: INFO os_brick.initiator.connectors.iscsi [None req-676df6b4-4103-481e-bff3-10f2c0d6d27f tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 09:38:55 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a69584d-f417-452a-867a-3b79df307bf6 -p 172.16.0.220:3260 {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:38:55 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a69584d-f417-452a-867a-3b79df307bf6 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:38:55 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c8aa6c3-5d3b-4e6d-8100-3ce33644eb70]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:38:55 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-676df6b4-4103-481e-bff3-10f2c0d6d27f tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 09:38:55 user nova-compute[75122]:  {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:38:55 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a69584d-f417-452a-867a-3b79df307bf6 -p 172.16.0.220:3260 --interface default --op new {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:38:55 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a69584d-f417-452a-867a-3b79df307bf6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:38:55 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[25a0a50e-efdd-4b3e-9e1d-bf8b3d796e76]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9a69584d-f417-452a-867a-3b79df307bf6] added\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:38:55 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-676df6b4-4103-481e-bff3-10f2c0d6d27f tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9a69584d-f417-452a-867a-3b79df307bf6] added
Nov 15 09:38:55 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:38:55 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a69584d-f417-452a-867a-3b79df307bf6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:38:55 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a69584d-f417-452a-867a-3b79df307bf6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:38:55 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[85188233-0b5a-4801-b0b2-ccf6210a40a2]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:38:55 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-676df6b4-4103-481e-bff3-10f2c0d6d27f tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:38:55 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a69584d-f417-452a-867a-3b79df307bf6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:38:55 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a69584d-f417-452a-867a-3b79df307bf6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:38:55 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[b237b9a0-e8cf-4460-9253-dde4cff56fd8]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:38:55 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-676df6b4-4103-481e-bff3-10f2c0d6d27f tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:38:55 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a69584d-f417-452a-867a-3b79df307bf6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vSUZVhBx {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:38:55 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a69584d-f417-452a-867a-3b79df307bf6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vSUZVhBx" returned: 0 in 0.023s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:38:55 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[12871b08-6b33-46d9-8f91-b8c5aca23b5a]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:38:55 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-676df6b4-4103-481e-bff3-10f2c0d6d27f tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vSUZVhBx'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:38:55 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a69584d-f417-452a-867a-3b79df307bf6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:38:55 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a69584d-f417-452a-867a-3b79df307bf6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:38:55 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0b84ed3-eaf3-4763-adeb-60773004dda3]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:38:55 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-676df6b4-4103-481e-bff3-10f2c0d6d27f tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:38:55 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:38:56 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:38:56 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[42bda3c2-ec1e-4a76-8439-002b397caa38]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7524fa0e-0e0f-4da0-bd00-7f099a8a55e8 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b366dd5-506b-4ee0-9e25-990a31acf3eb (non-flash)\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:38:56 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-676df6b4-4103-481e-bff3-10f2c0d6d27f tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7524fa0e-0e0f-4da0-bd00-7f099a8a55e8 (non-flash)
Nov 15 09:38:56 user nova-compute[75122]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b366dd5-506b-4ee0-9e25-990a31acf3eb (non-flash)
Nov 15 09:38:56 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 09:38:56 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-676df6b4-4103-481e-bff3-10f2c0d6d27f tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7524fa0e-0e0f-4da0-bd00-7f099a8a55e8 (non-flash)
Nov 15 09:38:56 user nova-compute[75122]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b366dd5-506b-4ee0-9e25-990a31acf3eb (non-flash)
Nov 15 09:38:56 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 09:38:56 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a69584d-f417-452a-867a-3b79df307bf6 -p 172.16.0.220:3260 --login {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:38:56 user nova-compute[75122]: DEBUG nova.compute.provider_tree [None req-9ef562b5-f0cd-4b74-b8a8-7dc28381e3f2 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Inventory has not changed in ProviderTree for provider: 69a3da65-47be-44c6-b67c-c692b58284ef {{(pid=75122) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 09:38:56 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-9ef562b5-f0cd-4b74-b8a8-7dc28381e3f2 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Inventory has not changed for provider 69a3da65-47be-44c6-b67c-c692b58284ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 09:38:56 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a69584d-f417-452a-867a-3b79df307bf6 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:38:56 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[00f4e3a7-91bb-4518-bcff-31c24402c161]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9a69584d-f417-452a-867a-3b79df307bf6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9a69584d-f417-452a-867a-3b79df307bf6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:38:56 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-676df6b4-4103-481e-bff3-10f2c0d6d27f tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9a69584d-f417-452a-867a-3b79df307bf6, portal: 172.16.0.220,3260]
Nov 15 09:38:56 user nova-compute[75122]: Login to [iface: default, target: iqn.2010-10.org.openstack:9a69584d-f417-452a-867a-3b79df307bf6, portal: 172.16.0.220,3260] successful.
Nov 15 09:38:56 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:38:56 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-9ef562b5-f0cd-4b74-b8a8-7dc28381e3f2 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.436s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:38:56 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a69584d-f417-452a-867a-3b79df307bf6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:38:56 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a69584d-f417-452a-867a-3b79df307bf6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:38:56 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[b95656ed-54ff-4c14-9251-8c5ff80335cf]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:38:56 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-676df6b4-4103-481e-bff3-10f2c0d6d27f tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:38:56 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:38:56 user nova-compute[75122]: INFO nova.scheduler.client.report [None req-9ef562b5-f0cd-4b74-b8a8-7dc28381e3f2 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Deleted allocations for instance ee961d5a-e0d1-4931-9293-eefbe638097a
Nov 15 09:38:56 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:38:56 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[315c8038-91aa-4b5f-905c-c13f0933a1e4]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7524fa0e-0e0f-4da0-bd00-7f099a8a55e8 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b366dd5-506b-4ee0-9e25-990a31acf3eb (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a69584d-f417-452a-867a-3b79df307bf6 (non-flash)\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:38:56 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-676df6b4-4103-481e-bff3-10f2c0d6d27f tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7524fa0e-0e0f-4da0-bd00-7f099a8a55e8 (non-flash)
Nov 15 09:38:56 user nova-compute[75122]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b366dd5-506b-4ee0-9e25-990a31acf3eb (non-flash)
Nov 15 09:38:56 user nova-compute[75122]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a69584d-f417-452a-867a-3b79df307bf6 (non-flash)
Nov 15 09:38:56 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 09:38:56 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-676df6b4-4103-481e-bff3-10f2c0d6d27f tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7524fa0e-0e0f-4da0-bd00-7f099a8a55e8 (non-flash)
Nov 15 09:38:56 user nova-compute[75122]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b366dd5-506b-4ee0-9e25-990a31acf3eb (non-flash)
Nov 15 09:38:56 user nova-compute[75122]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a69584d-f417-452a-867a-3b79df307bf6 (non-flash)
Nov 15 09:38:56 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 09:38:56 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-676df6b4-4103-481e-bff3-10f2c0d6d27f tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9a69584d-f417-452a-867a-3b79df307bf6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.274s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 09:38:56 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-676df6b4-4103-481e-bff3-10f2c0d6d27f tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Connected to 172.16.0.220:3260 {{(pid=75122) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 09:38:56 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-676df6b4-4103-481e-bff3-10f2c0d6d27f tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] HCTL ('33', '-', '-', 0) found on session 28 with lun 0 {{(pid=75122) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 09:38:56 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-676df6b4-4103-481e-bff3-10f2c0d6d27f tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75122) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 09:38:56 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:38:56 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:38:56 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[857be76d-cb76-45ec-9c9e-857d351be29a]: (4, ('- - 0', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:38:56 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-676df6b4-4103-481e-bff3-10f2c0d6d27f tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Searching for a device in session 28 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75122) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 09:38:56 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-676df6b4-4103-481e-bff3-10f2c0d6d27f tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:9a69584d-f417-452a-867a-3b79df307bf6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vSUZVhBx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75122) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 09:38:56 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-9ef562b5-f0cd-4b74-b8a8-7dc28381e3f2 tempest-ServerActionsTestOtherB-279691748 tempest-ServerActionsTestOtherB-279691748-project-member] Lock "ee961d5a-e0d1-4931-9293-eefbe638097a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 9.437s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:38:56 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:38:56 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:38:56 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:38:56 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:38:56 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:38:56 user nova-compute[75122]: DEBUG nova.compute.manager [req-6ba1273e-7e94-43b9-97c4-c22bc70da58d req-1363900c-dceb-4ee5-bb2d-9b2ecf463a29 service nova] [instance: 5b5a4d58-ba1e-473d-a32a-06fae1c84efc] Received event network-vif-plugged-b245a5c2-e523-4d4e-a343-f5b2352337ab {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:38:56 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-6ba1273e-7e94-43b9-97c4-c22bc70da58d req-1363900c-dceb-4ee5-bb2d-9b2ecf463a29 service nova] Acquiring lock "5b5a4d58-ba1e-473d-a32a-06fae1c84efc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:38:56 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-6ba1273e-7e94-43b9-97c4-c22bc70da58d req-1363900c-dceb-4ee5-bb2d-9b2ecf463a29 service nova] Lock "5b5a4d58-ba1e-473d-a32a-06fae1c84efc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:38:56 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-6ba1273e-7e94-43b9-97c4-c22bc70da58d req-1363900c-dceb-4ee5-bb2d-9b2ecf463a29 service nova] Lock "5b5a4d58-ba1e-473d-a32a-06fae1c84efc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:38:56 user nova-compute[75122]: DEBUG nova.compute.manager [req-6ba1273e-7e94-43b9-97c4-c22bc70da58d req-1363900c-dceb-4ee5-bb2d-9b2ecf463a29 service nova] [instance: 5b5a4d58-ba1e-473d-a32a-06fae1c84efc] No waiting events found dispatching network-vif-plugged-b245a5c2-e523-4d4e-a343-f5b2352337ab {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:38:56 user nova-compute[75122]: WARNING nova.compute.manager [req-6ba1273e-7e94-43b9-97c4-c22bc70da58d req-1363900c-dceb-4ee5-bb2d-9b2ecf463a29 service nova] [instance: 5b5a4d58-ba1e-473d-a32a-06fae1c84efc] Received unexpected event network-vif-plugged-b245a5c2-e523-4d4e-a343-f5b2352337ab for instance with vm_state active and task_state rescuing.
Nov 15 09:38:57 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:38:57 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:38:57 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:38:57 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-676df6b4-4103-481e-bff3-10f2c0d6d27f tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.310s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 09:38:57 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-676df6b4-4103-481e-bff3-10f2c0d6d27f tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] <== connect_volume: return (1311ms) {'type': 'block', 'scsi_wwn': '26134303564623764', 'path': '/dev/sdb'} {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 09:38:57 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-676df6b4-4103-481e-bff3-10f2c0d6d27f tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] [instance: fe0a6436-87c4-4826-a2f4-8d07c7fab59a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26134303564623764', 'path': '/dev/sdb'} {{(pid=75122) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 09:38:57 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:38:57 user nova-compute[75122]: DEBUG nova.objects.instance [None req-676df6b4-4103-481e-bff3-10f2c0d6d27f tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Lazy-loading 'flavor' on Instance uuid fe0a6436-87c4-4826-a2f4-8d07c7fab59a {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:38:57 user nova-compute[75122]: DEBUG nova.virt.libvirt.guest [None req-676df6b4-4103-481e-bff3-10f2c0d6d27f tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 09:38:57 user nova-compute[75122]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 09:38:57 user nova-compute[75122]:   <source dev="/dev/sdb"/>
Nov 15 09:38:57 user nova-compute[75122]:   <target dev="vdb" bus="virtio"/>
Nov 15 09:38:57 user nova-compute[75122]:   <serial>9a69584d-f417-452a-867a-3b79df307bf6</serial>
Nov 15 09:38:57 user nova-compute[75122]: </disk>
Nov 15 09:38:57 user nova-compute[75122]:  {{(pid=75122) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 09:38:57 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-676df6b4-4103-481e-bff3-10f2c0d6d27f tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] No BDM found with device name vda, not building metadata. {{(pid=75122) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 09:38:57 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-676df6b4-4103-481e-bff3-10f2c0d6d27f tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75122) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 09:38:57 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-676df6b4-4103-481e-bff3-10f2c0d6d27f tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] No VIF found with MAC fa:16:3e:ce:ac:dd, not building metadata {{(pid=75122) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 09:38:57 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-676df6b4-4103-481e-bff3-10f2c0d6d27f tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Lock "fe0a6436-87c4-4826-a2f4-8d07c7fab59a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.552s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:38:58 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:38:58 user nova-compute[75122]: DEBUG nova.compute.manager [req-5c50ef70-b845-45bc-b5eb-81bcf48f2e8d req-8b1e37d4-bc17-4151-92d6-3d426a1eb5ab service nova] [instance: 5b5a4d58-ba1e-473d-a32a-06fae1c84efc] Received event network-vif-plugged-b245a5c2-e523-4d4e-a343-f5b2352337ab {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:38:58 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-5c50ef70-b845-45bc-b5eb-81bcf48f2e8d req-8b1e37d4-bc17-4151-92d6-3d426a1eb5ab service nova] Acquiring lock "5b5a4d58-ba1e-473d-a32a-06fae1c84efc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:38:58 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-5c50ef70-b845-45bc-b5eb-81bcf48f2e8d req-8b1e37d4-bc17-4151-92d6-3d426a1eb5ab service nova] Lock "5b5a4d58-ba1e-473d-a32a-06fae1c84efc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:38:58 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-5c50ef70-b845-45bc-b5eb-81bcf48f2e8d req-8b1e37d4-bc17-4151-92d6-3d426a1eb5ab service nova] Lock "5b5a4d58-ba1e-473d-a32a-06fae1c84efc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:38:58 user nova-compute[75122]: DEBUG nova.compute.manager [req-5c50ef70-b845-45bc-b5eb-81bcf48f2e8d req-8b1e37d4-bc17-4151-92d6-3d426a1eb5ab service nova] [instance: 5b5a4d58-ba1e-473d-a32a-06fae1c84efc] No waiting events found dispatching network-vif-plugged-b245a5c2-e523-4d4e-a343-f5b2352337ab {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:38:58 user nova-compute[75122]: WARNING nova.compute.manager [req-5c50ef70-b845-45bc-b5eb-81bcf48f2e8d req-8b1e37d4-bc17-4151-92d6-3d426a1eb5ab service nova] [instance: 5b5a4d58-ba1e-473d-a32a-06fae1c84efc] Received unexpected event network-vif-plugged-b245a5c2-e523-4d4e-a343-f5b2352337ab for instance with vm_state active and task_state rescuing.
Nov 15 09:38:58 user nova-compute[75122]: DEBUG nova.compute.manager [None req-6b6acaa2-ded9-4cc9-852f-998c6dda9ccb tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] [instance: 5b5a4d58-ba1e-473d-a32a-06fae1c84efc] Checking state {{(pid=75122) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 09:39:00 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:39:03 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:39:05 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:39:08 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:39:09 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-1107537b-4ab6-4e0a-b7e5-66ac78d9847c tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Acquiring lock "fe0a6436-87c4-4826-a2f4-8d07c7fab59a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:39:09 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-1107537b-4ab6-4e0a-b7e5-66ac78d9847c tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Lock "fe0a6436-87c4-4826-a2f4-8d07c7fab59a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:39:09 user nova-compute[75122]: INFO nova.compute.manager [None req-1107537b-4ab6-4e0a-b7e5-66ac78d9847c tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] [instance: fe0a6436-87c4-4826-a2f4-8d07c7fab59a] Detaching volume 9a69584d-f417-452a-867a-3b79df307bf6
Nov 15 09:39:09 user nova-compute[75122]: INFO nova.virt.block_device [None req-1107537b-4ab6-4e0a-b7e5-66ac78d9847c tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] [instance: fe0a6436-87c4-4826-a2f4-8d07c7fab59a] Attempting to driver detach volume 9a69584d-f417-452a-867a-3b79df307bf6 from mountpoint /dev/vdb
Nov 15 09:39:09 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-1107537b-4ab6-4e0a-b7e5-66ac78d9847c tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Attempting to detach device vdb from instance fe0a6436-87c4-4826-a2f4-8d07c7fab59a from the persistent domain config. {{(pid=75122) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 09:39:09 user nova-compute[75122]: DEBUG nova.virt.libvirt.guest [None req-1107537b-4ab6-4e0a-b7e5-66ac78d9847c tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 09:39:09 user nova-compute[75122]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 09:39:09 user nova-compute[75122]:   <source dev="/dev/sdb"/>
Nov 15 09:39:09 user nova-compute[75122]:   <target dev="vdb" bus="virtio"/>
Nov 15 09:39:09 user nova-compute[75122]:   <serial>9a69584d-f417-452a-867a-3b79df307bf6</serial>
Nov 15 09:39:09 user nova-compute[75122]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 09:39:09 user nova-compute[75122]: </disk>
Nov 15 09:39:09 user nova-compute[75122]:  {{(pid=75122) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 09:39:09 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-1107537b-4ab6-4e0a-b7e5-66ac78d9847c tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Successfully detached device vdb from instance fe0a6436-87c4-4826-a2f4-8d07c7fab59a from the persistent domain config.
Nov 15 09:39:09 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-1107537b-4ab6-4e0a-b7e5-66ac78d9847c tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance fe0a6436-87c4-4826-a2f4-8d07c7fab59a from the live domain config. {{(pid=75122) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 09:39:09 user nova-compute[75122]: DEBUG nova.virt.libvirt.guest [None req-1107537b-4ab6-4e0a-b7e5-66ac78d9847c tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 09:39:09 user nova-compute[75122]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 09:39:09 user nova-compute[75122]:   <source dev="/dev/sdb"/>
Nov 15 09:39:09 user nova-compute[75122]:   <target dev="vdb" bus="virtio"/>
Nov 15 09:39:09 user nova-compute[75122]:   <serial>9a69584d-f417-452a-867a-3b79df307bf6</serial>
Nov 15 09:39:09 user nova-compute[75122]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 09:39:09 user nova-compute[75122]: </disk>
Nov 15 09:39:09 user nova-compute[75122]:  {{(pid=75122) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 09:39:09 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0b90b16c-d1b3-4a50-855a-3570e82e898a tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Acquiring lock "fe0a6436-87c4-4826-a2f4-8d07c7fab59a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:39:10 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-1107537b-4ab6-4e0a-b7e5-66ac78d9847c tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance fe0a6436-87c4-4826-a2f4-8d07c7fab59a {{(pid=75122) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 09:39:11 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-947f4232-efa6-4265-8ede-51bb7cfc1c6f tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 7cfd4155-c4b3-4cce-91e5-042cafccab8b is timed out.
Nov 15 09:39:11 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-947f4232-efa6-4265-8ede-51bb7cfc1c6f tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Successfully detached device vdb from instance 7cfd4155-c4b3-4cce-91e5-042cafccab8b from the live domain config.
Nov 15 09:39:11 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-947f4232-efa6-4265-8ede-51bb7cfc1c6f tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] [instance: 7cfd4155-c4b3-4cce-91e5-042cafccab8b] calling os-brick to detach iSCSI Volume {{(pid=75122) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 09:39:11 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-947f4232-efa6-4265-8ede-51bb7cfc1c6f tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffa04060b80>, {'target_iqn': 'iqn.2010-10.org.openstack:7524fa0e-0e0f-4da0-bd00-7f099a8a55e8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gJBOlMUQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 09:39:11 user nova-compute[75122]: WARNING os_brick.initiator.connectors.base [None req-947f4232-efa6-4265-8ede-51bb7cfc1c6f tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 09:39:11 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-947f4232-efa6-4265-8ede-51bb7cfc1c6f tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 09:39:11 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-947f4232-efa6-4265-8ede-51bb7cfc1c6f tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 09:39:11 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:39:11 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:39:11 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd439de3-ba56-4d90-bac2-c148e2ac56c1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7524fa0e-0e0f-4da0-bd00-7f099a8a55e8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0b366dd5-506b-4ee0-9e25-990a31acf3eb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9a69584d-f417-452a-867a-3b79df307bf6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:39:11 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-947f4232-efa6-4265-8ede-51bb7cfc1c6f tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 09:39:11 user nova-compute[75122]: No targets found.
Nov 15 09:39:11 user nova-compute[75122]: iSNS:
Nov 15 09:39:11 user nova-compute[75122]: No targets found.
Nov 15 09:39:11 user nova-compute[75122]: STATIC:
Nov 15 09:39:11 user nova-compute[75122]: Target: iqn.2010-10.org.openstack:7524fa0e-0e0f-4da0-bd00-7f099a8a55e8
Nov 15 09:39:11 user nova-compute[75122]:         Portal: 172.16.0.220:3260,-1
Nov 15 09:39:11 user nova-compute[75122]:                 Iface Name: default
Nov 15 09:39:11 user nova-compute[75122]: Target: iqn.2010-10.org.openstack:0b366dd5-506b-4ee0-9e25-990a31acf3eb
Nov 15 09:39:11 user nova-compute[75122]:         Portal: 172.16.0.220:3260,-1
Nov 15 09:39:11 user nova-compute[75122]:                 Iface Name: default
Nov 15 09:39:11 user nova-compute[75122]: Target: iqn.2010-10.org.openstack:9a69584d-f417-452a-867a-3b79df307bf6
Nov 15 09:39:11 user nova-compute[75122]:         Portal: 172.16.0.220:3260,-1
Nov 15 09:39:11 user nova-compute[75122]:                 Iface Name: default
Nov 15 09:39:11 user nova-compute[75122]: FIRMWARE:
Nov 15 09:39:11 user nova-compute[75122]: No targets found.
Nov 15 09:39:11 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 09:39:11 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-947f4232-efa6-4265-8ede-51bb7cfc1c6f tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 09:39:11 user nova-compute[75122]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 09:39:11 user nova-compute[75122]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75122) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 09:39:11 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-947f4232-efa6-4265-8ede-51bb7cfc1c6f tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7524fa0e-0e0f-4da0-bd00-7f099a8a55e8', 0)] {{(pid=75122) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 09:39:11 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:39:11 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:39:11 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec433356-a44f-4c73-a9a3-80ea086a57c0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0b366dd5-506b-4ee0-9e25-990a31acf3eb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7524fa0e-0e0f-4da0-bd00-7f099a8a55e8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9a69584d-f417-452a-867a-3b79df307bf6\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:39:11 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:39:11 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:39:11 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f01efa2-c2f2-4c0c-b2b7-ab21b301661f]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7524fa0e-0e0f-4da0-bd00-7f099a8a55e8 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b366dd5-506b-4ee0-9e25-990a31acf3eb (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a69584d-f417-452a-867a-3b79df307bf6 (non-flash)\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:39:11 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-947f4232-efa6-4265-8ede-51bb7cfc1c6f tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7524fa0e-0e0f-4da0-bd00-7f099a8a55e8 (non-flash)
Nov 15 09:39:11 user nova-compute[75122]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b366dd5-506b-4ee0-9e25-990a31acf3eb (non-flash)
Nov 15 09:39:11 user nova-compute[75122]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a69584d-f417-452a-867a-3b79df307bf6 (non-flash)
Nov 15 09:39:11 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 09:39:11 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-947f4232-efa6-4265-8ede-51bb7cfc1c6f tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7524fa0e-0e0f-4da0-bd00-7f099a8a55e8 (non-flash)
Nov 15 09:39:11 user nova-compute[75122]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b366dd5-506b-4ee0-9e25-990a31acf3eb (non-flash)
Nov 15 09:39:11 user nova-compute[75122]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a69584d-f417-452a-867a-3b79df307bf6 (non-flash)
Nov 15 09:39:11 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 09:39:11 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-947f4232-efa6-4265-8ede-51bb7cfc1c6f tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ffa0413cca0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7524fa0e-0e0f-4da0-bd00-7f099a8a55e8'): ({'sdc'}, set())}) {{(pid=75122) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 09:39:11 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-947f4232-efa6-4265-8ede-51bb7cfc1c6f tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Removing single pathed devices sdc {{(pid=75122) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 09:39:11 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:39:11 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:39:11 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d1e1004-adc8-41c0-b4f4-d712ed58c585]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:39:11 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:39:11 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:39:11 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e78f159-c3cc-4bfc-a35d-ed1b55de6033]: (4, ('ok\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:39:11 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-947f4232-efa6-4265-8ede-51bb7cfc1c6f tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Flushing IO for device /dev/sdc {{(pid=75122) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 09:39:11 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:39:11 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:39:11 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[3518c048-a5b0-445f-8ce2-69cf2f505ff3]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:39:11 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-947f4232-efa6-4265-8ede-51bb7cfc1c6f tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75122) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 09:39:11 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:39:11 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.051s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:39:11 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[556ca206-e66e-4e16-bbd5-efcaca135b9a]: (4, ('1', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:39:11 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-947f4232-efa6-4265-8ede-51bb7cfc1c6f tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75122) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 09:39:11 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-947f4232-efa6-4265-8ede-51bb7cfc1c6f tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] SCSI volumes sdc have been removed. {{(pid=75122) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 09:39:11 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-947f4232-efa6-4265-8ede-51bb7cfc1c6f tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7524fa0e-0e0f-4da0-bd00-7f099a8a55e8')] {{(pid=75122) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 09:39:11 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7524fa0e-0e0f-4da0-bd00-7f099a8a55e8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:39:11 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7524fa0e-0e0f-4da0-bd00-7f099a8a55e8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:39:11 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd3de5a5-727c-4747-920d-2c1ef87ec6ed]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:39:11 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-947f4232-efa6-4265-8ede-51bb7cfc1c6f tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:39:11 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7524fa0e-0e0f-4da0-bd00-7f099a8a55e8 -p 172.16.0.220:3260 --logout {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:39:11 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7524fa0e-0e0f-4da0-bd00-7f099a8a55e8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:39:11 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f587758-bea0-49e6-aa40-82a12fda4ec8]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:7524fa0e-0e0f-4da0-bd00-7f099a8a55e8, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:7524fa0e-0e0f-4da0-bd00-7f099a8a55e8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:39:11 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-947f4232-efa6-4265-8ede-51bb7cfc1c6f tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:7524fa0e-0e0f-4da0-bd00-7f099a8a55e8, portal: 172.16.0.220,3260]
Nov 15 09:39:11 user nova-compute[75122]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:7524fa0e-0e0f-4da0-bd00-7f099a8a55e8, portal: 172.16.0.220,3260] successful.
Nov 15 09:39:11 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:39:11 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7524fa0e-0e0f-4da0-bd00-7f099a8a55e8 -p 172.16.0.220:3260 --op delete {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:39:11 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7524fa0e-0e0f-4da0-bd00-7f099a8a55e8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:39:11 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[837a23f8-5f38-456d-b23a-c5877e8d3473]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:39:11 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-947f4232-efa6-4265-8ede-51bb7cfc1c6f tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:39:11 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-947f4232-efa6-4265-8ede-51bb7cfc1c6f tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.293s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 09:39:11 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-947f4232-efa6-4265-8ede-51bb7cfc1c6f tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] <== disconnect_volume: return (294ms) None {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 09:39:11 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-947f4232-efa6-4265-8ede-51bb7cfc1c6f tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] [instance: 7cfd4155-c4b3-4cce-91e5-042cafccab8b] Disconnected iSCSI Volume {{(pid=75122) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 09:39:12 user nova-compute[75122]: DEBUG nova.objects.instance [None req-947f4232-efa6-4265-8ede-51bb7cfc1c6f tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Lazy-loading 'flavor' on Instance uuid 7cfd4155-c4b3-4cce-91e5-042cafccab8b {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:39:12 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-947f4232-efa6-4265-8ede-51bb7cfc1c6f tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Lock "7cfd4155-c4b3-4cce-91e5-042cafccab8b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.669s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:39:13 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:39:13 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:39:14 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:39:14 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75122) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 09:39:15 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:39:15 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Starting heal instance info cache {{(pid=75122) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 09:39:15 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "refresh_cache-1e19f9e1-69c6-4590-85d2-e90cbdbb3d80" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 09:39:15 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquired lock "refresh_cache-1e19f9e1-69c6-4590-85d2-e90cbdbb3d80" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 09:39:15 user nova-compute[75122]: DEBUG nova.network.neutron [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] [instance: 1e19f9e1-69c6-4590-85d2-e90cbdbb3d80] Forcefully refreshing network info cache for instance {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 09:39:15 user nova-compute[75122]: DEBUG nova.network.neutron [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] [instance: 1e19f9e1-69c6-4590-85d2-e90cbdbb3d80] Updating instance_info_cache with network_info: [{"id": "a9170e2e-32f0-422c-becf-e1b2792b9b75", "address": "fa:16:3e:4c:61:a8", "network": {"id": "cd65f44e-6f5f-40c7-87f0-de082fb2bda9", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-635927865-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f97007ed06a04d7ebbc6cd3543a23d96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9170e2e-32", "ovs_interfaceid": "a9170e2e-32f0-422c-becf-e1b2792b9b75", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:39:15 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Releasing lock "refresh_cache-1e19f9e1-69c6-4590-85d2-e90cbdbb3d80" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 09:39:15 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] [instance: 1e19f9e1-69c6-4590-85d2-e90cbdbb3d80] Updated the network info_cache for instance {{(pid=75122) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 09:39:15 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:39:15 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:39:16 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:39:16 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:39:17 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:39:18 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:39:19 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:39:19 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:39:19 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:39:19 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:39:19 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75122) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 09:39:19 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2f45f49-0bca-4ae2-bc2a-eed293143489/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:39:19 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2f45f49-0bca-4ae2-bc2a-eed293143489/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:39:19 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2f45f49-0bca-4ae2-bc2a-eed293143489/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:39:19 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2f45f49-0bca-4ae2-bc2a-eed293143489/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:39:19 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd9d52bb-6248-48e6-a798-6dbdaaa68cbc/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:39:19 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd9d52bb-6248-48e6-a798-6dbdaaa68cbc/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:39:19 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd9d52bb-6248-48e6-a798-6dbdaaa68cbc/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:39:20 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd9d52bb-6248-48e6-a798-6dbdaaa68cbc/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:39:20 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5a4d58-ba1e-473d-a32a-06fae1c84efc/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:39:20 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5a4d58-ba1e-473d-a32a-06fae1c84efc/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:39:20 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5a4d58-ba1e-473d-a32a-06fae1c84efc/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:39:20 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5a4d58-ba1e-473d-a32a-06fae1c84efc/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:39:20 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75122) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 09:39:20 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5a4d58-ba1e-473d-a32a-06fae1c84efc/disk.rescue --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:39:20 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5a4d58-ba1e-473d-a32a-06fae1c84efc/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:39:20 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5a4d58-ba1e-473d-a32a-06fae1c84efc/disk.rescue --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:39:20 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5a4d58-ba1e-473d-a32a-06fae1c84efc/disk.rescue --force-share --output=json" returned: 0 in 0.166s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:39:20 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df913b3e-218d-4ae6-b7b3-70f64fdd3896/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:39:20 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:39:20 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df913b3e-218d-4ae6-b7b3-70f64fdd3896/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:39:20 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df913b3e-218d-4ae6-b7b3-70f64fdd3896/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:39:21 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df913b3e-218d-4ae6-b7b3-70f64fdd3896/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:39:21 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e19f9e1-69c6-4590-85d2-e90cbdbb3d80/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:39:21 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e19f9e1-69c6-4590-85d2-e90cbdbb3d80/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:39:21 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e19f9e1-69c6-4590-85d2-e90cbdbb3d80/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:39:21 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e19f9e1-69c6-4590-85d2-e90cbdbb3d80/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:39:21 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/131142fd-e8ec-42d1-a518-aa21c7bb7cb1/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:39:21 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/131142fd-e8ec-42d1-a518-aa21c7bb7cb1/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:39:21 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/131142fd-e8ec-42d1-a518-aa21c7bb7cb1/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:39:21 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/131142fd-e8ec-42d1-a518-aa21c7bb7cb1/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:39:21 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cfd4155-c4b3-4cce-91e5-042cafccab8b/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:39:22 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cfd4155-c4b3-4cce-91e5-042cafccab8b/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:39:22 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cfd4155-c4b3-4cce-91e5-042cafccab8b/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:39:22 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cfd4155-c4b3-4cce-91e5-042cafccab8b/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:39:22 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe0a6436-87c4-4826-a2f4-8d07c7fab59a/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:39:22 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe0a6436-87c4-4826-a2f4-8d07c7fab59a/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:39:22 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe0a6436-87c4-4826-a2f4-8d07c7fab59a/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:39:22 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe0a6436-87c4-4826-a2f4-8d07c7fab59a/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:39:22 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff1c5639-9d63-409a-bbd7-1de63f57b189/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:39:22 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff1c5639-9d63-409a-bbd7-1de63f57b189/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:39:22 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff1c5639-9d63-409a-bbd7-1de63f57b189/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:39:22 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff1c5639-9d63-409a-bbd7-1de63f57b189/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:39:22 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4d3e4f5-b48f-4fd4-9299-091469824217/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:39:23 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4d3e4f5-b48f-4fd4-9299-091469824217/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:39:23 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4d3e4f5-b48f-4fd4-9299-091469824217/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:39:23 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4d3e4f5-b48f-4fd4-9299-091469824217/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:39:23 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00270cc2-4f5b-4f64-8f88-31f21e3b3950/disk.rescue --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:39:23 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:39:23 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00270cc2-4f5b-4f64-8f88-31f21e3b3950/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:39:23 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00270cc2-4f5b-4f64-8f88-31f21e3b3950/disk.rescue --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:39:23 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00270cc2-4f5b-4f64-8f88-31f21e3b3950/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:39:23 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00270cc2-4f5b-4f64-8f88-31f21e3b3950/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:39:23 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00270cc2-4f5b-4f64-8f88-31f21e3b3950/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:39:23 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00270cc2-4f5b-4f64-8f88-31f21e3b3950/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:39:24 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00270cc2-4f5b-4f64-8f88-31f21e3b3950/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:39:24 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 09:39:24 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 09:39:24 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Hypervisor/Node resource view: name=user free_ram=7306MB free_disk=25.23202133178711GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75122) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 09:39:24 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:39:24 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:39:24 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance 131142fd-e8ec-42d1-a518-aa21c7bb7cb1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:39:24 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance 7cfd4155-c4b3-4cce-91e5-042cafccab8b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:39:24 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance 5b5a4d58-ba1e-473d-a32a-06fae1c84efc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:39:24 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance 1e19f9e1-69c6-4590-85d2-e90cbdbb3d80 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:39:24 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance fd9d52bb-6248-48e6-a798-6dbdaaa68cbc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:39:24 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance 00270cc2-4f5b-4f64-8f88-31f21e3b3950 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:39:24 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance fe0a6436-87c4-4826-a2f4-8d07c7fab59a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:39:24 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance df913b3e-218d-4ae6-b7b3-70f64fdd3896 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:39:24 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance c2f45f49-0bca-4ae2-bc2a-eed293143489 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:39:24 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance e4d3e4f5-b48f-4fd4-9299-091469824217 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:39:24 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance ff1c5639-9d63-409a-bbd7-1de63f57b189 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:39:24 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75122) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 09:39:24 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75122) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 09:39:24 user nova-compute[75122]: DEBUG nova.compute.provider_tree [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Inventory has not changed in ProviderTree for provider: 69a3da65-47be-44c6-b67c-c692b58284ef {{(pid=75122) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 09:39:24 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Inventory has not changed for provider 69a3da65-47be-44c6-b67c-c692b58284ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 09:39:24 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Compute_service record updated for user:user {{(pid=75122) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 09:39:24 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.500s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:39:25 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:39:28 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:39:28 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:39:30 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-1107537b-4ab6-4e0a-b7e5-66ac78d9847c tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance fe0a6436-87c4-4826-a2f4-8d07c7fab59a is timed out.
Nov 15 09:39:30 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-1107537b-4ab6-4e0a-b7e5-66ac78d9847c tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Successfully detached device vdb from instance fe0a6436-87c4-4826-a2f4-8d07c7fab59a from the live domain config.
Nov 15 09:39:30 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1107537b-4ab6-4e0a-b7e5-66ac78d9847c tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] [instance: fe0a6436-87c4-4826-a2f4-8d07c7fab59a] calling os-brick to detach iSCSI Volume {{(pid=75122) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 09:39:30 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-1107537b-4ab6-4e0a-b7e5-66ac78d9847c tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffa04060b80>, {'target_iqn': 'iqn.2010-10.org.openstack:9a69584d-f417-452a-867a-3b79df307bf6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vSUZVhBx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 09:39:30 user nova-compute[75122]: WARNING os_brick.initiator.connectors.base [None req-1107537b-4ab6-4e0a-b7e5-66ac78d9847c tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 09:39:30 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-1107537b-4ab6-4e0a-b7e5-66ac78d9847c tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 09:39:30 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-1107537b-4ab6-4e0a-b7e5-66ac78d9847c tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 09:39:30 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:39:30 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:39:30 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3727f78-5353-486c-a53c-8e7bc83f371a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0b366dd5-506b-4ee0-9e25-990a31acf3eb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9a69584d-f417-452a-867a-3b79df307bf6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:39:30 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-1107537b-4ab6-4e0a-b7e5-66ac78d9847c tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 09:39:30 user nova-compute[75122]: No targets found.
Nov 15 09:39:30 user nova-compute[75122]: iSNS:
Nov 15 09:39:30 user nova-compute[75122]: No targets found.
Nov 15 09:39:30 user nova-compute[75122]: STATIC:
Nov 15 09:39:30 user nova-compute[75122]: Target: iqn.2010-10.org.openstack:0b366dd5-506b-4ee0-9e25-990a31acf3eb
Nov 15 09:39:30 user nova-compute[75122]:         Portal: 172.16.0.220:3260,-1
Nov 15 09:39:30 user nova-compute[75122]:                 Iface Name: default
Nov 15 09:39:30 user nova-compute[75122]: Target: iqn.2010-10.org.openstack:9a69584d-f417-452a-867a-3b79df307bf6
Nov 15 09:39:30 user nova-compute[75122]:         Portal: 172.16.0.220:3260,-1
Nov 15 09:39:30 user nova-compute[75122]:                 Iface Name: default
Nov 15 09:39:30 user nova-compute[75122]: FIRMWARE:
Nov 15 09:39:30 user nova-compute[75122]: No targets found.
Nov 15 09:39:30 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 09:39:30 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-1107537b-4ab6-4e0a-b7e5-66ac78d9847c tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 09:39:30 user nova-compute[75122]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 09:39:30 user nova-compute[75122]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75122) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 09:39:30 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-1107537b-4ab6-4e0a-b7e5-66ac78d9847c tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9a69584d-f417-452a-867a-3b79df307bf6', 0)] {{(pid=75122) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 09:39:30 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:39:30 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:39:30 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[cccbcc88-d00a-42cb-ab03-42f0e3618596]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0b366dd5-506b-4ee0-9e25-990a31acf3eb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9a69584d-f417-452a-867a-3b79df307bf6\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:39:30 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:39:30 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:39:30 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[08749183-3916-4021-b2b7-0fb875965f5a]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b366dd5-506b-4ee0-9e25-990a31acf3eb (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a69584d-f417-452a-867a-3b79df307bf6 (non-flash)\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:39:30 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-1107537b-4ab6-4e0a-b7e5-66ac78d9847c tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b366dd5-506b-4ee0-9e25-990a31acf3eb (non-flash)
Nov 15 09:39:30 user nova-compute[75122]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a69584d-f417-452a-867a-3b79df307bf6 (non-flash)
Nov 15 09:39:30 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 09:39:30 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-1107537b-4ab6-4e0a-b7e5-66ac78d9847c tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b366dd5-506b-4ee0-9e25-990a31acf3eb (non-flash)
Nov 15 09:39:30 user nova-compute[75122]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a69584d-f417-452a-867a-3b79df307bf6 (non-flash)
Nov 15 09:39:30 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 09:39:30 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-1107537b-4ab6-4e0a-b7e5-66ac78d9847c tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ffa0413d870>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9a69584d-f417-452a-867a-3b79df307bf6'): ({'sdb'}, set())}) {{(pid=75122) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 09:39:30 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-1107537b-4ab6-4e0a-b7e5-66ac78d9847c tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Removing single pathed devices sdb {{(pid=75122) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 09:39:30 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:39:30 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:39:30 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1170172-fc37-48a1-a453-55f6e6076155]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:39:30 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:39:30 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:39:30 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[0772760f-e779-4644-8550-a551e505182d]: (4, ('ok\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:39:30 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-1107537b-4ab6-4e0a-b7e5-66ac78d9847c tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Flushing IO for device /dev/sdb {{(pid=75122) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 09:39:30 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:39:30 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:39:30 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7de3af8-e18a-460f-ab65-294fc84ff4b0]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:39:30 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-1107537b-4ab6-4e0a-b7e5-66ac78d9847c tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75122) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 09:39:30 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:39:30 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:39:30 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae9da419-7a20-4342-9e5f-389259929f4a]: (4, ('1', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:39:30 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-1107537b-4ab6-4e0a-b7e5-66ac78d9847c tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75122) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 09:39:30 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-1107537b-4ab6-4e0a-b7e5-66ac78d9847c tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] SCSI volumes sdb have been removed. {{(pid=75122) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 09:39:30 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-1107537b-4ab6-4e0a-b7e5-66ac78d9847c tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9a69584d-f417-452a-867a-3b79df307bf6')] {{(pid=75122) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 09:39:30 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a69584d-f417-452a-867a-3b79df307bf6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:39:30 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a69584d-f417-452a-867a-3b79df307bf6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.111s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:39:30 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f548a98-f2de-4d86-b5c5-db19fa32cb64]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:39:30 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-1107537b-4ab6-4e0a-b7e5-66ac78d9847c tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:39:30 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a69584d-f417-452a-867a-3b79df307bf6 -p 172.16.0.220:3260 --logout {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:39:30 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a69584d-f417-452a-867a-3b79df307bf6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:39:30 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd66190d-3e4b-4327-befc-bd92f803dc92]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:9a69584d-f417-452a-867a-3b79df307bf6, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:9a69584d-f417-452a-867a-3b79df307bf6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:39:30 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-1107537b-4ab6-4e0a-b7e5-66ac78d9847c tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:9a69584d-f417-452a-867a-3b79df307bf6, portal: 172.16.0.220,3260]
Nov 15 09:39:30 user nova-compute[75122]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:9a69584d-f417-452a-867a-3b79df307bf6, portal: 172.16.0.220,3260] successful.
Nov 15 09:39:30 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:39:30 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a69584d-f417-452a-867a-3b79df307bf6 -p 172.16.0.220:3260 --op delete {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:39:30 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a69584d-f417-452a-867a-3b79df307bf6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:39:30 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[e52bf8c8-cb9f-44cc-bdb3-c7ada61c0496]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:39:30 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-1107537b-4ab6-4e0a-b7e5-66ac78d9847c tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:39:30 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-1107537b-4ab6-4e0a-b7e5-66ac78d9847c tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.388s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 09:39:30 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-1107537b-4ab6-4e0a-b7e5-66ac78d9847c tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] <== disconnect_volume: return (390ms) None {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 09:39:30 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1107537b-4ab6-4e0a-b7e5-66ac78d9847c tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] [instance: fe0a6436-87c4-4826-a2f4-8d07c7fab59a] Disconnected iSCSI Volume {{(pid=75122) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 09:39:30 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:39:31 user nova-compute[75122]: DEBUG nova.objects.instance [None req-1107537b-4ab6-4e0a-b7e5-66ac78d9847c tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Lazy-loading 'flavor' on Instance uuid fe0a6436-87c4-4826-a2f4-8d07c7fab59a {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:39:31 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-1107537b-4ab6-4e0a-b7e5-66ac78d9847c tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Lock "fe0a6436-87c4-4826-a2f4-8d07c7fab59a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.716s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:39:31 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0b90b16c-d1b3-4a50-855a-3570e82e898a tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Lock "fe0a6436-87c4-4826-a2f4-8d07c7fab59a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.602s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:39:31 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0b90b16c-d1b3-4a50-855a-3570e82e898a tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Acquiring lock "fe0a6436-87c4-4826-a2f4-8d07c7fab59a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:39:31 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0b90b16c-d1b3-4a50-855a-3570e82e898a tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Lock "fe0a6436-87c4-4826-a2f4-8d07c7fab59a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:39:31 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0b90b16c-d1b3-4a50-855a-3570e82e898a tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Lock "fe0a6436-87c4-4826-a2f4-8d07c7fab59a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:39:31 user nova-compute[75122]: INFO nova.compute.manager [None req-0b90b16c-d1b3-4a50-855a-3570e82e898a tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] [instance: fe0a6436-87c4-4826-a2f4-8d07c7fab59a] Terminating instance
Nov 15 09:39:31 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0b90b16c-d1b3-4a50-855a-3570e82e898a tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] [instance: fe0a6436-87c4-4826-a2f4-8d07c7fab59a] Start destroying the instance on the hypervisor. {{(pid=75122) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 09:39:31 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:39:31 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:39:31 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:39:31 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:39:31 user nova-compute[75122]: DEBUG nova.compute.manager [req-29824824-d991-49a8-bb2c-4e50f7fb6020 req-60419356-be3c-43d3-8edb-32b129428d34 service nova] [instance: fe0a6436-87c4-4826-a2f4-8d07c7fab59a] Received event network-vif-unplugged-80aa86de-4dda-46e9-bb33-424ce423cf85 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:39:31 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-29824824-d991-49a8-bb2c-4e50f7fb6020 req-60419356-be3c-43d3-8edb-32b129428d34 service nova] Acquiring lock "fe0a6436-87c4-4826-a2f4-8d07c7fab59a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:39:31 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-29824824-d991-49a8-bb2c-4e50f7fb6020 req-60419356-be3c-43d3-8edb-32b129428d34 service nova] Lock "fe0a6436-87c4-4826-a2f4-8d07c7fab59a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:39:31 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-29824824-d991-49a8-bb2c-4e50f7fb6020 req-60419356-be3c-43d3-8edb-32b129428d34 service nova] Lock "fe0a6436-87c4-4826-a2f4-8d07c7fab59a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:39:31 user nova-compute[75122]: DEBUG nova.compute.manager [req-29824824-d991-49a8-bb2c-4e50f7fb6020 req-60419356-be3c-43d3-8edb-32b129428d34 service nova] [instance: fe0a6436-87c4-4826-a2f4-8d07c7fab59a] No waiting events found dispatching network-vif-unplugged-80aa86de-4dda-46e9-bb33-424ce423cf85 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:39:31 user nova-compute[75122]: DEBUG nova.compute.manager [req-29824824-d991-49a8-bb2c-4e50f7fb6020 req-60419356-be3c-43d3-8edb-32b129428d34 service nova] [instance: fe0a6436-87c4-4826-a2f4-8d07c7fab59a] Received event network-vif-unplugged-80aa86de-4dda-46e9-bb33-424ce423cf85 for instance with task_state deleting. {{(pid=75122) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 09:39:32 user nova-compute[75122]: INFO nova.virt.libvirt.driver [-] [instance: fe0a6436-87c4-4826-a2f4-8d07c7fab59a] Instance destroyed successfully.
Nov 15 09:39:32 user nova-compute[75122]: DEBUG nova.objects.instance [None req-0b90b16c-d1b3-4a50-855a-3570e82e898a tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Lazy-loading 'resources' on Instance uuid fe0a6436-87c4-4826-a2f4-8d07c7fab59a {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:39:32 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-0b90b16c-d1b3-4a50-855a-3570e82e898a tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T09:36:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-960828433',display_name='tempest-VolumesSnapshotTestJSON-instance-960828433',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-960828433',id=18,image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF7gCzYY2MSnm+KajBEGrPFU6EBcjWF4hOElMVD+RFTzhFjwaGpN0ruANY/LGZ8CyVaVi5Rs9LWmP+gAl6zX80LlYOoFgjM/x2foBgj5ztFjebn/8L3Fb6x6BIlBx3wvnQ==',key_name='tempest-keypair-1479237151',keypairs=<?>,launch_index=0,launched_at=2023-11-15T09:37:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ac8ea42f6a3446e8a8edcf3dcb016b84',ramdisk_id='',reservation_id='r-ctzmidsp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1852829755',owner_user_name='tempest-VolumesSnapshotTestJSON-1852829755-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T09:37:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7e5545ae1ca743d4ada8e28d28fca540',uuid=fe0a6436-87c4-4826-a2f4-8d07c7fab59a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "80aa86de-4dda-46e9-bb33-424ce423cf85", "address": "fa:16:3e:ce:ac:dd", "network": {"id": "cd74302c-bfd9-495b-887f-0de0d94f4ffc", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-692728798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac8ea42f6a3446e8a8edcf3dcb016b84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80aa86de-4d", "ovs_interfaceid": "80aa86de-4dda-46e9-bb33-424ce423cf85", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 09:39:32 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-0b90b16c-d1b3-4a50-855a-3570e82e898a tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Converting VIF {"id": "80aa86de-4dda-46e9-bb33-424ce423cf85", "address": "fa:16:3e:ce:ac:dd", "network": {"id": "cd74302c-bfd9-495b-887f-0de0d94f4ffc", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-692728798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac8ea42f6a3446e8a8edcf3dcb016b84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80aa86de-4d", "ovs_interfaceid": "80aa86de-4dda-46e9-bb33-424ce423cf85", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 09:39:32 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-0b90b16c-d1b3-4a50-855a-3570e82e898a tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ce:ac:dd,bridge_name='br-int',has_traffic_filtering=True,id=80aa86de-4dda-46e9-bb33-424ce423cf85,network=Network(cd74302c-bfd9-495b-887f-0de0d94f4ffc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80aa86de-4d') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 09:39:32 user nova-compute[75122]: DEBUG os_vif [None req-0b90b16c-d1b3-4a50-855a-3570e82e898a tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ce:ac:dd,bridge_name='br-int',has_traffic_filtering=True,id=80aa86de-4dda-46e9-bb33-424ce423cf85,network=Network(cd74302c-bfd9-495b-887f-0de0d94f4ffc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80aa86de-4d') {{(pid=75122) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 09:39:32 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:39:32 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap80aa86de-4d, bridge=br-int, if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:39:32 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:39:32 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:39:32 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:39:32 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1e42c6e8-50bc-4af4-ba32-26cb2b99f7da) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:39:32 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:39:32 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:39:32 user nova-compute[75122]: INFO os_vif [None req-0b90b16c-d1b3-4a50-855a-3570e82e898a tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ce:ac:dd,bridge_name='br-int',has_traffic_filtering=True,id=80aa86de-4dda-46e9-bb33-424ce423cf85,network=Network(cd74302c-bfd9-495b-887f-0de0d94f4ffc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80aa86de-4d')
Nov 15 09:39:32 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0b90b16c-d1b3-4a50-855a-3570e82e898a tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] [instance: fe0a6436-87c4-4826-a2f4-8d07c7fab59a] calling os-brick to detach iSCSI Volume {{(pid=75122) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 09:39:32 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b90b16c-d1b3-4a50-855a-3570e82e898a tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffa04060b80>, {'target_iqn': 'iqn.2010-10.org.openstack:9a69584d-f417-452a-867a-3b79df307bf6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vSUZVhBx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 09:39:32 user nova-compute[75122]: WARNING os_brick.initiator.connectors.base [None req-0b90b16c-d1b3-4a50-855a-3570e82e898a tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 09:39:32 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-0b90b16c-d1b3-4a50-855a-3570e82e898a tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 09:39:32 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-0b90b16c-d1b3-4a50-855a-3570e82e898a tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 09:39:32 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:39:32 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:39:32 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ff217b3-0fed-4a4d-b3cf-a5bba87cd3d7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0b366dd5-506b-4ee0-9e25-990a31acf3eb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:39:32 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b90b16c-d1b3-4a50-855a-3570e82e898a tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 09:39:32 user nova-compute[75122]: No targets found.
Nov 15 09:39:32 user nova-compute[75122]: iSNS:
Nov 15 09:39:32 user nova-compute[75122]: No targets found.
Nov 15 09:39:32 user nova-compute[75122]: STATIC:
Nov 15 09:39:32 user nova-compute[75122]: Target: iqn.2010-10.org.openstack:0b366dd5-506b-4ee0-9e25-990a31acf3eb
Nov 15 09:39:32 user nova-compute[75122]:         Portal: 172.16.0.220:3260,-1
Nov 15 09:39:32 user nova-compute[75122]:                 Iface Name: default
Nov 15 09:39:32 user nova-compute[75122]: FIRMWARE:
Nov 15 09:39:32 user nova-compute[75122]: No targets found.
Nov 15 09:39:32 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 09:39:32 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b90b16c-d1b3-4a50-855a-3570e82e898a tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 09:39:32 user nova-compute[75122]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 09:39:32 user nova-compute[75122]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75122) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 09:39:32 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b90b16c-d1b3-4a50-855a-3570e82e898a tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9a69584d-f417-452a-867a-3b79df307bf6', 0)] {{(pid=75122) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 09:39:32 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:39:32 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:39:32 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eea94da-4f9e-4739-9820-b11c5d1d6fe8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0b366dd5-506b-4ee0-9e25-990a31acf3eb\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:39:32 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:39:32 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:39:32 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4afd524-9527-42b9-822e-cf7b44ee90dd]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b366dd5-506b-4ee0-9e25-990a31acf3eb (non-flash)\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:39:32 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b90b16c-d1b3-4a50-855a-3570e82e898a tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b366dd5-506b-4ee0-9e25-990a31acf3eb (non-flash)
Nov 15 09:39:32 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 09:39:32 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b90b16c-d1b3-4a50-855a-3570e82e898a tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b366dd5-506b-4ee0-9e25-990a31acf3eb (non-flash)
Nov 15 09:39:32 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 09:39:32 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b90b16c-d1b3-4a50-855a-3570e82e898a tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ffa0417e680>, {}) {{(pid=75122) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 09:39:32 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b90b16c-d1b3-4a50-855a-3570e82e898a tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Disconnecting from: [] {{(pid=75122) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 09:39:32 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-0b90b16c-d1b3-4a50-855a-3570e82e898a tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.064s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 09:39:32 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b90b16c-d1b3-4a50-855a-3570e82e898a tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] <== disconnect_volume: return (65ms) None {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 09:39:32 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0b90b16c-d1b3-4a50-855a-3570e82e898a tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] [instance: fe0a6436-87c4-4826-a2f4-8d07c7fab59a] Disconnected iSCSI Volume {{(pid=75122) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 09:39:32 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-0b90b16c-d1b3-4a50-855a-3570e82e898a tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] [instance: fe0a6436-87c4-4826-a2f4-8d07c7fab59a] Deleting instance files /opt/stack/data/nova/instances/fe0a6436-87c4-4826-a2f4-8d07c7fab59a_del
Nov 15 09:39:32 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-0b90b16c-d1b3-4a50-855a-3570e82e898a tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] [instance: fe0a6436-87c4-4826-a2f4-8d07c7fab59a] Deletion of /opt/stack/data/nova/instances/fe0a6436-87c4-4826-a2f4-8d07c7fab59a_del complete
Nov 15 09:39:32 user nova-compute[75122]: INFO nova.compute.manager [None req-0b90b16c-d1b3-4a50-855a-3570e82e898a tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] [instance: fe0a6436-87c4-4826-a2f4-8d07c7fab59a] Took 0.94 seconds to destroy the instance on the hypervisor.
Nov 15 09:39:32 user nova-compute[75122]: DEBUG oslo.service.loopingcall [None req-0b90b16c-d1b3-4a50-855a-3570e82e898a tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75122) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 09:39:32 user nova-compute[75122]: DEBUG nova.compute.manager [-] [instance: fe0a6436-87c4-4826-a2f4-8d07c7fab59a] Deallocating network for instance {{(pid=75122) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 09:39:32 user nova-compute[75122]: DEBUG nova.network.neutron [-] [instance: fe0a6436-87c4-4826-a2f4-8d07c7fab59a] deallocate_for_instance() {{(pid=75122) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 09:39:32 user nova-compute[75122]: DEBUG nova.network.neutron [-] [instance: fe0a6436-87c4-4826-a2f4-8d07c7fab59a] Updating instance_info_cache with network_info: [] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:39:32 user nova-compute[75122]: INFO nova.compute.manager [-] [instance: fe0a6436-87c4-4826-a2f4-8d07c7fab59a] Took 0.68 seconds to deallocate network for instance.
Nov 15 09:39:33 user nova-compute[75122]: DEBUG nova.compute.manager [req-14a063fc-26ca-4c3b-99e4-2c2a8d38983e req-c823ca4a-a25a-4b9e-8209-7f318358419e service nova] [instance: fe0a6436-87c4-4826-a2f4-8d07c7fab59a] Received event network-vif-deleted-80aa86de-4dda-46e9-bb33-424ce423cf85 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:39:33 user nova-compute[75122]: WARNING nova.volume.cinder [None req-0b90b16c-d1b3-4a50-855a-3570e82e898a tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Attachment 052445c4-ba39-4c25-8f75-9498886ee1fe does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 052445c4-ba39-4c25-8f75-9498886ee1fe. (HTTP 404) (Request-ID: req-a2f28818-ba6d-4e24-bd14-1ce107db56cd)
Nov 15 09:39:33 user nova-compute[75122]: INFO nova.compute.manager [None req-0b90b16c-d1b3-4a50-855a-3570e82e898a tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] [instance: fe0a6436-87c4-4826-a2f4-8d07c7fab59a] Took 0.02 seconds to detach 1 volumes for instance.
Nov 15 09:39:33 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0b90b16c-d1b3-4a50-855a-3570e82e898a tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:39:33 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0b90b16c-d1b3-4a50-855a-3570e82e898a tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:39:33 user nova-compute[75122]: DEBUG nova.compute.provider_tree [None req-0b90b16c-d1b3-4a50-855a-3570e82e898a tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Inventory has not changed in ProviderTree for provider: 69a3da65-47be-44c6-b67c-c692b58284ef {{(pid=75122) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 09:39:33 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-0b90b16c-d1b3-4a50-855a-3570e82e898a tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Inventory has not changed for provider 69a3da65-47be-44c6-b67c-c692b58284ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 09:39:33 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0b90b16c-d1b3-4a50-855a-3570e82e898a tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.321s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:39:33 user nova-compute[75122]: INFO nova.scheduler.client.report [None req-0b90b16c-d1b3-4a50-855a-3570e82e898a tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Deleted allocations for instance fe0a6436-87c4-4826-a2f4-8d07c7fab59a
Nov 15 09:39:33 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0b90b16c-d1b3-4a50-855a-3570e82e898a tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Lock "fe0a6436-87c4-4826-a2f4-8d07c7fab59a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.149s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:39:33 user nova-compute[75122]: DEBUG nova.compute.manager [req-68e96b2a-d27d-4c81-bb47-10b32d66ca95 req-846072de-6ef4-47f1-9626-deb55bd126d0 service nova] [instance: fe0a6436-87c4-4826-a2f4-8d07c7fab59a] Received event network-vif-plugged-80aa86de-4dda-46e9-bb33-424ce423cf85 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:39:33 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-68e96b2a-d27d-4c81-bb47-10b32d66ca95 req-846072de-6ef4-47f1-9626-deb55bd126d0 service nova] Acquiring lock "fe0a6436-87c4-4826-a2f4-8d07c7fab59a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:39:33 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-68e96b2a-d27d-4c81-bb47-10b32d66ca95 req-846072de-6ef4-47f1-9626-deb55bd126d0 service nova] Lock "fe0a6436-87c4-4826-a2f4-8d07c7fab59a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:39:33 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-68e96b2a-d27d-4c81-bb47-10b32d66ca95 req-846072de-6ef4-47f1-9626-deb55bd126d0 service nova] Lock "fe0a6436-87c4-4826-a2f4-8d07c7fab59a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:39:33 user nova-compute[75122]: DEBUG nova.compute.manager [req-68e96b2a-d27d-4c81-bb47-10b32d66ca95 req-846072de-6ef4-47f1-9626-deb55bd126d0 service nova] [instance: fe0a6436-87c4-4826-a2f4-8d07c7fab59a] No waiting events found dispatching network-vif-plugged-80aa86de-4dda-46e9-bb33-424ce423cf85 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:39:33 user nova-compute[75122]: WARNING nova.compute.manager [req-68e96b2a-d27d-4c81-bb47-10b32d66ca95 req-846072de-6ef4-47f1-9626-deb55bd126d0 service nova] [instance: fe0a6436-87c4-4826-a2f4-8d07c7fab59a] Received unexpected event network-vif-plugged-80aa86de-4dda-46e9-bb33-424ce423cf85 for instance with vm_state deleted and task_state None.
Nov 15 09:39:36 user nova-compute[75122]: DEBUG nova.compute.manager [req-f967726e-f45b-48c6-bccf-2869f2fee29c req-2b87b8b3-f5fc-453a-aad9-da7ea9220033 service nova] [instance: df913b3e-218d-4ae6-b7b3-70f64fdd3896] Received event network-changed-1a900796-9d0d-43a8-8ccd-21307e17f875 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:39:36 user nova-compute[75122]: DEBUG nova.compute.manager [req-f967726e-f45b-48c6-bccf-2869f2fee29c req-2b87b8b3-f5fc-453a-aad9-da7ea9220033 service nova] [instance: df913b3e-218d-4ae6-b7b3-70f64fdd3896] Refreshing instance network info cache due to event network-changed-1a900796-9d0d-43a8-8ccd-21307e17f875. {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 09:39:36 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-f967726e-f45b-48c6-bccf-2869f2fee29c req-2b87b8b3-f5fc-453a-aad9-da7ea9220033 service nova] Acquiring lock "refresh_cache-df913b3e-218d-4ae6-b7b3-70f64fdd3896" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 09:39:36 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-f967726e-f45b-48c6-bccf-2869f2fee29c req-2b87b8b3-f5fc-453a-aad9-da7ea9220033 service nova] Acquired lock "refresh_cache-df913b3e-218d-4ae6-b7b3-70f64fdd3896" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 09:39:36 user nova-compute[75122]: DEBUG nova.network.neutron [req-f967726e-f45b-48c6-bccf-2869f2fee29c req-2b87b8b3-f5fc-453a-aad9-da7ea9220033 service nova] [instance: df913b3e-218d-4ae6-b7b3-70f64fdd3896] Refreshing network info cache for port 1a900796-9d0d-43a8-8ccd-21307e17f875 {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 09:39:36 user nova-compute[75122]: DEBUG nova.network.neutron [req-f967726e-f45b-48c6-bccf-2869f2fee29c req-2b87b8b3-f5fc-453a-aad9-da7ea9220033 service nova] [instance: df913b3e-218d-4ae6-b7b3-70f64fdd3896] Updated VIF entry in instance network info cache for port 1a900796-9d0d-43a8-8ccd-21307e17f875. {{(pid=75122) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 09:39:36 user nova-compute[75122]: DEBUG nova.network.neutron [req-f967726e-f45b-48c6-bccf-2869f2fee29c req-2b87b8b3-f5fc-453a-aad9-da7ea9220033 service nova] [instance: df913b3e-218d-4ae6-b7b3-70f64fdd3896] Updating instance_info_cache with network_info: [{"id": "1a900796-9d0d-43a8-8ccd-21307e17f875", "address": "fa:16:3e:1b:53:31", "network": {"id": "cc80acf3-8a44-4d7e-aaa0-1214700564b3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1084984321-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f29cd64a8a674d73936b8a0c90bf2d34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a900796-9d", "ovs_interfaceid": "1a900796-9d0d-43a8-8ccd-21307e17f875", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:39:36 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-f967726e-f45b-48c6-bccf-2869f2fee29c req-2b87b8b3-f5fc-453a-aad9-da7ea9220033 service nova] Releasing lock "refresh_cache-df913b3e-218d-4ae6-b7b3-70f64fdd3896" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 09:39:37 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:39:37 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-1a65b524-1de8-4241-acb6-38eca9b46b19 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Acquiring lock "df913b3e-218d-4ae6-b7b3-70f64fdd3896" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:39:37 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-1a65b524-1de8-4241-acb6-38eca9b46b19 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Lock "df913b3e-218d-4ae6-b7b3-70f64fdd3896" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:39:38 user nova-compute[75122]: DEBUG nova.objects.instance [None req-1a65b524-1de8-4241-acb6-38eca9b46b19 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Lazy-loading 'flavor' on Instance uuid df913b3e-218d-4ae6-b7b3-70f64fdd3896 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:39:38 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-1a65b524-1de8-4241-acb6-38eca9b46b19 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Lock "df913b3e-218d-4ae6-b7b3-70f64fdd3896" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:39:38 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-1a65b524-1de8-4241-acb6-38eca9b46b19 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Acquiring lock "df913b3e-218d-4ae6-b7b3-70f64fdd3896" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:39:38 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-1a65b524-1de8-4241-acb6-38eca9b46b19 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Lock "df913b3e-218d-4ae6-b7b3-70f64fdd3896" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:39:38 user nova-compute[75122]: INFO nova.compute.manager [None req-1a65b524-1de8-4241-acb6-38eca9b46b19 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] [instance: df913b3e-218d-4ae6-b7b3-70f64fdd3896] Attaching volume fdf09a1b-a065-4b88-815d-ee54c1c68464 to /dev/vdb
Nov 15 09:39:38 user nova-compute[75122]: DEBUG os_brick.utils [None req-1a65b524-1de8-4241-acb6-38eca9b46b19 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 09:39:38 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:39:38 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:39:38 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1674d07-3205-425a-9241-f88bafe850e3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:742fb64b3587\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:39:38 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:39:38 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:39:38 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[96060662-19f1-4b25-b126-7dbfe5d020d7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:39:38 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:39:38 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:39:38 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[82cba0a9-dea9-4480-a3cf-08b98ef09d60]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:39:38 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[9acaf172-35e0-4b9e-b042-93af4f400dca]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:39:38 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-1a65b524-1de8-4241-acb6-38eca9b46b19 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Running cmd (subprocess): nvme version {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:39:38 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-1a65b524-1de8-4241-acb6-38eca9b46b19 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] 'nvme version' failed. Not Retrying. {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 09:39:38 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1a65b524-1de8-4241-acb6-38eca9b46b19 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] nvme not present on system {{(pid=75122) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 09:39:38 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:39:38 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 09:39:38 user nova-compute[75122]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 09:39:38 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[75dc7c72-f3ad-423a-ac7c-30cd5bc6eb74]: (4, '') {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:39:38 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.lightos [None req-1a65b524-1de8-4241-acb6-38eca9b46b19 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75122) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 09:39:38 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.lightos [None req-1a65b524-1de8-4241-acb6-38eca9b46b19 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75122) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 09:39:38 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.lightos [None req-1a65b524-1de8-4241-acb6-38eca9b46b19 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] LIGHTOS: no hostnqn found. {{(pid=75122) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 09:39:38 user nova-compute[75122]: DEBUG os_brick.utils [None req-1a65b524-1de8-4241-acb6-38eca9b46b19 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:742fb64b3587', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 09:39:38 user nova-compute[75122]: DEBUG nova.virt.block_device [None req-1a65b524-1de8-4241-acb6-38eca9b46b19 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] [instance: df913b3e-218d-4ae6-b7b3-70f64fdd3896] Updating existing volume attachment record: f6190263-781c-445d-855c-bafe4f56c854 {{(pid=75122) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 09:39:40 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:39:41 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-dee89599-f53c-4f81-9773-049da4bbd2f7 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Acquiring lock "7cfd4155-c4b3-4cce-91e5-042cafccab8b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:39:41 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-dee89599-f53c-4f81-9773-049da4bbd2f7 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Lock "7cfd4155-c4b3-4cce-91e5-042cafccab8b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:39:41 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-dee89599-f53c-4f81-9773-049da4bbd2f7 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Acquiring lock "7cfd4155-c4b3-4cce-91e5-042cafccab8b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:39:41 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-dee89599-f53c-4f81-9773-049da4bbd2f7 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Lock "7cfd4155-c4b3-4cce-91e5-042cafccab8b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:39:41 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-dee89599-f53c-4f81-9773-049da4bbd2f7 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Lock "7cfd4155-c4b3-4cce-91e5-042cafccab8b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:39:41 user nova-compute[75122]: INFO nova.compute.manager [None req-dee89599-f53c-4f81-9773-049da4bbd2f7 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] [instance: 7cfd4155-c4b3-4cce-91e5-042cafccab8b] Terminating instance
Nov 15 09:39:41 user nova-compute[75122]: DEBUG nova.compute.manager [None req-dee89599-f53c-4f81-9773-049da4bbd2f7 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] [instance: 7cfd4155-c4b3-4cce-91e5-042cafccab8b] Start destroying the instance on the hypervisor. {{(pid=75122) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 09:39:41 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:39:41 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:39:41 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:39:41 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:39:41 user nova-compute[75122]: DEBUG nova.compute.manager [req-abb1c614-addb-4132-b31d-e0be8c193d78 req-e265c678-d4da-4db4-b885-661eee34f084 service nova] [instance: 7cfd4155-c4b3-4cce-91e5-042cafccab8b] Received event network-vif-unplugged-3066e71b-c5d6-4e46-980c-2b0d42739f95 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:39:41 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-abb1c614-addb-4132-b31d-e0be8c193d78 req-e265c678-d4da-4db4-b885-661eee34f084 service nova] Acquiring lock "7cfd4155-c4b3-4cce-91e5-042cafccab8b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:39:41 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-abb1c614-addb-4132-b31d-e0be8c193d78 req-e265c678-d4da-4db4-b885-661eee34f084 service nova] Lock "7cfd4155-c4b3-4cce-91e5-042cafccab8b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:39:41 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-abb1c614-addb-4132-b31d-e0be8c193d78 req-e265c678-d4da-4db4-b885-661eee34f084 service nova] Lock "7cfd4155-c4b3-4cce-91e5-042cafccab8b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:39:41 user nova-compute[75122]: DEBUG nova.compute.manager [req-abb1c614-addb-4132-b31d-e0be8c193d78 req-e265c678-d4da-4db4-b885-661eee34f084 service nova] [instance: 7cfd4155-c4b3-4cce-91e5-042cafccab8b] No waiting events found dispatching network-vif-unplugged-3066e71b-c5d6-4e46-980c-2b0d42739f95 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:39:41 user nova-compute[75122]: DEBUG nova.compute.manager [req-abb1c614-addb-4132-b31d-e0be8c193d78 req-e265c678-d4da-4db4-b885-661eee34f084 service nova] [instance: 7cfd4155-c4b3-4cce-91e5-042cafccab8b] Received event network-vif-unplugged-3066e71b-c5d6-4e46-980c-2b0d42739f95 for instance with task_state deleting. {{(pid=75122) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 09:39:42 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:39:42 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:39:42 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:39:42 user nova-compute[75122]: INFO nova.virt.libvirt.driver [-] [instance: 7cfd4155-c4b3-4cce-91e5-042cafccab8b] Instance destroyed successfully.
Nov 15 09:39:42 user nova-compute[75122]: DEBUG nova.objects.instance [None req-dee89599-f53c-4f81-9773-049da4bbd2f7 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Lazy-loading 'resources' on Instance uuid 7cfd4155-c4b3-4cce-91e5-042cafccab8b {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:39:42 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-dee89599-f53c-4f81-9773-049da4bbd2f7 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-15T09:33:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-2104199903',display_name='tempest-ServerActionsTestOtherA-server-1491357968',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-2104199903',id=12,image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBOX8YtQdU9q+dZR5u6ZMUFx1hvdm2NhRUpss/Fu1DkrrAdOur+Gu9G+pa6bDZCG5H+IwYYy1a89zeBb3vsgDOIvqoXhBd6Ue9N9chSVtmlWB+JfvhMU/87GmmYpdmALKw==',key_name='tempest-keypair-2121112573',keypairs=<?>,launch_index=0,launched_at=2023-11-15T09:36:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8b8e67f8a66a4930be3fb65c397cbeb2',ramdisk_id='',reservation_id='r-93cr0hj1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1521412552',owner_user_name='tempest-ServerActionsTestOtherA-1521412552-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T09:36:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='91f1469b2c7c45d6ac27f2b64fd5cefe',uuid=7cfd4155-c4b3-4cce-91e5-042cafccab8b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3066e71b-c5d6-4e46-980c-2b0d42739f95", "address": "fa:16:3e:e1:ad:0f", "network": {"id": "6e846655-a6f8-4339-a239-65d2f94c8b74", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1923452032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b8e67f8a66a4930be3fb65c397cbeb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3066e71b-c5", "ovs_interfaceid": "3066e71b-c5d6-4e46-980c-2b0d42739f95", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 09:39:42 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-dee89599-f53c-4f81-9773-049da4bbd2f7 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Converting VIF {"id": "3066e71b-c5d6-4e46-980c-2b0d42739f95", "address": "fa:16:3e:e1:ad:0f", "network": {"id": "6e846655-a6f8-4339-a239-65d2f94c8b74", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1923452032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b8e67f8a66a4930be3fb65c397cbeb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3066e71b-c5", "ovs_interfaceid": "3066e71b-c5d6-4e46-980c-2b0d42739f95", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 09:39:42 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-dee89599-f53c-4f81-9773-049da4bbd2f7 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e1:ad:0f,bridge_name='br-int',has_traffic_filtering=True,id=3066e71b-c5d6-4e46-980c-2b0d42739f95,network=Network(6e846655-a6f8-4339-a239-65d2f94c8b74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3066e71b-c5') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 09:39:42 user nova-compute[75122]: DEBUG os_vif [None req-dee89599-f53c-4f81-9773-049da4bbd2f7 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e1:ad:0f,bridge_name='br-int',has_traffic_filtering=True,id=3066e71b-c5d6-4e46-980c-2b0d42739f95,network=Network(6e846655-a6f8-4339-a239-65d2f94c8b74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3066e71b-c5') {{(pid=75122) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 09:39:42 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:39:42 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3066e71b-c5, bridge=br-int, if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:39:42 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:39:42 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:39:42 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:39:42 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=47c82c05-97c1-402b-9727-431a0d5f454a) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:39:42 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:39:42 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:39:42 user nova-compute[75122]: INFO os_vif [None req-dee89599-f53c-4f81-9773-049da4bbd2f7 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e1:ad:0f,bridge_name='br-int',has_traffic_filtering=True,id=3066e71b-c5d6-4e46-980c-2b0d42739f95,network=Network(6e846655-a6f8-4339-a239-65d2f94c8b74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3066e71b-c5')
Nov 15 09:39:42 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-dee89599-f53c-4f81-9773-049da4bbd2f7 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] [instance: 7cfd4155-c4b3-4cce-91e5-042cafccab8b] Deleting instance files /opt/stack/data/nova/instances/7cfd4155-c4b3-4cce-91e5-042cafccab8b_del
Nov 15 09:39:42 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-dee89599-f53c-4f81-9773-049da4bbd2f7 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] [instance: 7cfd4155-c4b3-4cce-91e5-042cafccab8b] Deletion of /opt/stack/data/nova/instances/7cfd4155-c4b3-4cce-91e5-042cafccab8b_del complete
Nov 15 09:39:42 user nova-compute[75122]: INFO nova.compute.manager [None req-dee89599-f53c-4f81-9773-049da4bbd2f7 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] [instance: 7cfd4155-c4b3-4cce-91e5-042cafccab8b] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 15 09:39:42 user nova-compute[75122]: DEBUG oslo.service.loopingcall [None req-dee89599-f53c-4f81-9773-049da4bbd2f7 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75122) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 09:39:42 user nova-compute[75122]: DEBUG nova.compute.manager [-] [instance: 7cfd4155-c4b3-4cce-91e5-042cafccab8b] Deallocating network for instance {{(pid=75122) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 09:39:42 user nova-compute[75122]: DEBUG nova.network.neutron [-] [instance: 7cfd4155-c4b3-4cce-91e5-042cafccab8b] deallocate_for_instance() {{(pid=75122) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 09:39:43 user nova-compute[75122]: DEBUG nova.network.neutron [-] [instance: 7cfd4155-c4b3-4cce-91e5-042cafccab8b] Updating instance_info_cache with network_info: [] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:39:43 user nova-compute[75122]: INFO nova.compute.manager [-] [instance: 7cfd4155-c4b3-4cce-91e5-042cafccab8b] Took 0.85 seconds to deallocate network for instance.
Nov 15 09:39:43 user nova-compute[75122]: DEBUG nova.compute.manager [req-77bd9015-0a47-4362-ace5-3df01f643304 req-848c6ea8-5c5d-4e07-9bf8-e23c2d481b19 service nova] [instance: 7cfd4155-c4b3-4cce-91e5-042cafccab8b] Received event network-vif-deleted-3066e71b-c5d6-4e46-980c-2b0d42739f95 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:39:43 user nova-compute[75122]: INFO nova.compute.manager [req-77bd9015-0a47-4362-ace5-3df01f643304 req-848c6ea8-5c5d-4e07-9bf8-e23c2d481b19 service nova] [instance: 7cfd4155-c4b3-4cce-91e5-042cafccab8b] Neutron deleted interface 3066e71b-c5d6-4e46-980c-2b0d42739f95; detaching it from the instance and deleting it from the info cache
Nov 15 09:39:43 user nova-compute[75122]: DEBUG nova.network.neutron [req-77bd9015-0a47-4362-ace5-3df01f643304 req-848c6ea8-5c5d-4e07-9bf8-e23c2d481b19 service nova] [instance: 7cfd4155-c4b3-4cce-91e5-042cafccab8b] Updating instance_info_cache with network_info: [] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:39:43 user nova-compute[75122]: DEBUG nova.compute.manager [req-77bd9015-0a47-4362-ace5-3df01f643304 req-848c6ea8-5c5d-4e07-9bf8-e23c2d481b19 service nova] [instance: 7cfd4155-c4b3-4cce-91e5-042cafccab8b] Detach interface failed, port_id=3066e71b-c5d6-4e46-980c-2b0d42739f95, reason: Instance 7cfd4155-c4b3-4cce-91e5-042cafccab8b could not be found. {{(pid=75122) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 09:39:43 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-dee89599-f53c-4f81-9773-049da4bbd2f7 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:39:43 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-dee89599-f53c-4f81-9773-049da4bbd2f7 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:39:43 user nova-compute[75122]: DEBUG nova.compute.provider_tree [None req-dee89599-f53c-4f81-9773-049da4bbd2f7 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Inventory has not changed in ProviderTree for provider: 69a3da65-47be-44c6-b67c-c692b58284ef {{(pid=75122) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 09:39:43 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-dee89599-f53c-4f81-9773-049da4bbd2f7 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Inventory has not changed for provider 69a3da65-47be-44c6-b67c-c692b58284ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 09:39:43 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-dee89599-f53c-4f81-9773-049da4bbd2f7 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.335s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:39:43 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:39:43 user nova-compute[75122]: INFO nova.scheduler.client.report [None req-dee89599-f53c-4f81-9773-049da4bbd2f7 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Deleted allocations for instance 7cfd4155-c4b3-4cce-91e5-042cafccab8b
Nov 15 09:39:43 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-dee89599-f53c-4f81-9773-049da4bbd2f7 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Lock "7cfd4155-c4b3-4cce-91e5-042cafccab8b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.272s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:39:43 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1a65b524-1de8-4241-acb6-38eca9b46b19 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] [instance: df913b3e-218d-4ae6-b7b3-70f64fdd3896] Calling os-brick to attach iSCSI Volume {{(pid=75122) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 09:39:43 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a65b524-1de8-4241-acb6-38eca9b46b19 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffa04060b80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fdf09a1b-a065-4b88-815d-ee54c1c68464', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QfwYZitq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 09:39:43 user nova-compute[75122]: WARNING os_brick.initiator.connectors.base [None req-1a65b524-1de8-4241-acb6-38eca9b46b19 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 09:39:43 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-1a65b524-1de8-4241-acb6-38eca9b46b19 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 09:39:43 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-1a65b524-1de8-4241-acb6-38eca9b46b19 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 09:39:43 user nova-compute[75122]: WARNING os_brick.initiator.connectors.base [None req-1a65b524-1de8-4241-acb6-38eca9b46b19 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 09:39:43 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-1a65b524-1de8-4241-acb6-38eca9b46b19 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fdf09a1b-a065-4b88-815d-ee54c1c68464" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 09:39:43 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-1a65b524-1de8-4241-acb6-38eca9b46b19 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fdf09a1b-a065-4b88-815d-ee54c1c68464" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 09:39:43 user nova-compute[75122]: INFO os_brick.initiator.connectors.iscsi [None req-1a65b524-1de8-4241-acb6-38eca9b46b19 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 09:39:43 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fdf09a1b-a065-4b88-815d-ee54c1c68464 -p 172.16.0.220:3260 {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:39:43 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fdf09a1b-a065-4b88-815d-ee54c1c68464 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:39:43 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9a6bc4a-8d5f-4bb1-906c-f537822e404a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:39:43 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a65b524-1de8-4241-acb6-38eca9b46b19 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 09:39:43 user nova-compute[75122]:  {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:39:43 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fdf09a1b-a065-4b88-815d-ee54c1c68464 -p 172.16.0.220:3260 --interface default --op new {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:39:43 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fdf09a1b-a065-4b88-815d-ee54c1c68464 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:39:43 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[68c86280-5cb5-49e3-8fbc-ddcd804040a3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fdf09a1b-a065-4b88-815d-ee54c1c68464] added\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:39:43 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a65b524-1de8-4241-acb6-38eca9b46b19 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fdf09a1b-a065-4b88-815d-ee54c1c68464] added
Nov 15 09:39:43 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:39:43 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fdf09a1b-a065-4b88-815d-ee54c1c68464 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:39:43 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fdf09a1b-a065-4b88-815d-ee54c1c68464 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:39:43 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2c96230-5464-42b3-9f66-c4f676036ccf]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:39:43 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a65b524-1de8-4241-acb6-38eca9b46b19 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:39:43 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fdf09a1b-a065-4b88-815d-ee54c1c68464 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:39:43 user nova-compute[75122]: DEBUG nova.compute.manager [req-099b62ad-5ba3-40f2-983d-4995ce6f476d req-a2036b7f-9c38-41bc-a6fb-0dc9e3993c7b service nova] [instance: 7cfd4155-c4b3-4cce-91e5-042cafccab8b] Received event network-vif-plugged-3066e71b-c5d6-4e46-980c-2b0d42739f95 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:39:43 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-099b62ad-5ba3-40f2-983d-4995ce6f476d req-a2036b7f-9c38-41bc-a6fb-0dc9e3993c7b service nova] Acquiring lock "7cfd4155-c4b3-4cce-91e5-042cafccab8b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:39:43 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-099b62ad-5ba3-40f2-983d-4995ce6f476d req-a2036b7f-9c38-41bc-a6fb-0dc9e3993c7b service nova] Lock "7cfd4155-c4b3-4cce-91e5-042cafccab8b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:39:43 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-099b62ad-5ba3-40f2-983d-4995ce6f476d req-a2036b7f-9c38-41bc-a6fb-0dc9e3993c7b service nova] Lock "7cfd4155-c4b3-4cce-91e5-042cafccab8b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:39:43 user nova-compute[75122]: DEBUG nova.compute.manager [req-099b62ad-5ba3-40f2-983d-4995ce6f476d req-a2036b7f-9c38-41bc-a6fb-0dc9e3993c7b service nova] [instance: 7cfd4155-c4b3-4cce-91e5-042cafccab8b] No waiting events found dispatching network-vif-plugged-3066e71b-c5d6-4e46-980c-2b0d42739f95 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:39:43 user nova-compute[75122]: WARNING nova.compute.manager [req-099b62ad-5ba3-40f2-983d-4995ce6f476d req-a2036b7f-9c38-41bc-a6fb-0dc9e3993c7b service nova] [instance: 7cfd4155-c4b3-4cce-91e5-042cafccab8b] Received unexpected event network-vif-plugged-3066e71b-c5d6-4e46-980c-2b0d42739f95 for instance with vm_state deleted and task_state None.
Nov 15 09:39:43 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fdf09a1b-a065-4b88-815d-ee54c1c68464 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:39:43 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa641b6c-8c8c-4934-8835-c8c3ee5f82b1]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:39:43 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a65b524-1de8-4241-acb6-38eca9b46b19 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:39:43 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fdf09a1b-a065-4b88-815d-ee54c1c68464 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QfwYZitq {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:39:43 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fdf09a1b-a065-4b88-815d-ee54c1c68464 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QfwYZitq" returned: 0 in 0.024s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:39:43 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[a26be118-9187-4ecd-94de-3db1ef1bb6a1]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:39:43 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a65b524-1de8-4241-acb6-38eca9b46b19 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QfwYZitq'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:39:43 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fdf09a1b-a065-4b88-815d-ee54c1c68464 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:39:43 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fdf09a1b-a065-4b88-815d-ee54c1c68464 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:39:43 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[f756b844-b398-4540-b468-04a5659b5b9f]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:39:43 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a65b524-1de8-4241-acb6-38eca9b46b19 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:39:43 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:39:43 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:39:43 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc6fc369-ad86-4431-8d2d-8f02dd610d99]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b366dd5-506b-4ee0-9e25-990a31acf3eb (non-flash)\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:39:43 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a65b524-1de8-4241-acb6-38eca9b46b19 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b366dd5-506b-4ee0-9e25-990a31acf3eb (non-flash)
Nov 15 09:39:43 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 09:39:43 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a65b524-1de8-4241-acb6-38eca9b46b19 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b366dd5-506b-4ee0-9e25-990a31acf3eb (non-flash)
Nov 15 09:39:43 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 09:39:43 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fdf09a1b-a065-4b88-815d-ee54c1c68464 -p 172.16.0.220:3260 --login {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:39:44 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fdf09a1b-a065-4b88-815d-ee54c1c68464 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:39:44 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0fec811-d9f4-4625-8389-4751ca0be0e1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fdf09a1b-a065-4b88-815d-ee54c1c68464, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fdf09a1b-a065-4b88-815d-ee54c1c68464, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:39:44 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a65b524-1de8-4241-acb6-38eca9b46b19 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fdf09a1b-a065-4b88-815d-ee54c1c68464, portal: 172.16.0.220,3260]
Nov 15 09:39:44 user nova-compute[75122]: Login to [iface: default, target: iqn.2010-10.org.openstack:fdf09a1b-a065-4b88-815d-ee54c1c68464, portal: 172.16.0.220,3260] successful.
Nov 15 09:39:44 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:39:44 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fdf09a1b-a065-4b88-815d-ee54c1c68464 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:39:44 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fdf09a1b-a065-4b88-815d-ee54c1c68464 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:39:44 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f5e5dd7-8938-4dc6-91b3-45a6c7861ac1]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:39:44 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a65b524-1de8-4241-acb6-38eca9b46b19 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:39:44 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:39:44 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:39:44 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[633d5656-61f2-4b7a-9a5d-578094f4600a]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b366dd5-506b-4ee0-9e25-990a31acf3eb (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdf09a1b-a065-4b88-815d-ee54c1c68464 (non-flash)\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:39:44 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a65b524-1de8-4241-acb6-38eca9b46b19 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b366dd5-506b-4ee0-9e25-990a31acf3eb (non-flash)
Nov 15 09:39:44 user nova-compute[75122]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdf09a1b-a065-4b88-815d-ee54c1c68464 (non-flash)
Nov 15 09:39:44 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 09:39:44 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a65b524-1de8-4241-acb6-38eca9b46b19 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b366dd5-506b-4ee0-9e25-990a31acf3eb (non-flash)
Nov 15 09:39:44 user nova-compute[75122]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdf09a1b-a065-4b88-815d-ee54c1c68464 (non-flash)
Nov 15 09:39:44 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 09:39:44 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-1a65b524-1de8-4241-acb6-38eca9b46b19 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fdf09a1b-a065-4b88-815d-ee54c1c68464" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.265s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 09:39:44 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a65b524-1de8-4241-acb6-38eca9b46b19 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Connected to 172.16.0.220:3260 {{(pid=75122) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 09:39:44 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-1a65b524-1de8-4241-acb6-38eca9b46b19 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] HCTL ('33', '-', '-', 0) found on session 29 with lun 0 {{(pid=75122) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 09:39:44 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-1a65b524-1de8-4241-acb6-38eca9b46b19 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75122) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 09:39:44 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:39:44 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:39:44 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eced805-ac89-4049-8d7d-18f06e447302]: (4, ('- - 0', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:39:44 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-1a65b524-1de8-4241-acb6-38eca9b46b19 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Searching for a device in session 29 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75122) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 09:39:44 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a65b524-1de8-4241-acb6-38eca9b46b19 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:fdf09a1b-a065-4b88-815d-ee54c1c68464', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QfwYZitq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75122) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 09:39:45 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-1a65b524-1de8-4241-acb6-38eca9b46b19 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.302s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 09:39:45 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a65b524-1de8-4241-acb6-38eca9b46b19 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] <== connect_volume: return (1303ms) {'type': 'block', 'scsi_wwn': '26431356433333864', 'path': '/dev/sdb'} {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 09:39:45 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1a65b524-1de8-4241-acb6-38eca9b46b19 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] [instance: df913b3e-218d-4ae6-b7b3-70f64fdd3896] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26431356433333864', 'path': '/dev/sdb'} {{(pid=75122) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 09:39:45 user nova-compute[75122]: DEBUG nova.objects.instance [None req-1a65b524-1de8-4241-acb6-38eca9b46b19 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Lazy-loading 'flavor' on Instance uuid df913b3e-218d-4ae6-b7b3-70f64fdd3896 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:39:45 user nova-compute[75122]: DEBUG nova.virt.libvirt.guest [None req-1a65b524-1de8-4241-acb6-38eca9b46b19 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 09:39:45 user nova-compute[75122]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 09:39:45 user nova-compute[75122]:   <source dev="/dev/sdb"/>
Nov 15 09:39:45 user nova-compute[75122]:   <target dev="vdb" bus="virtio"/>
Nov 15 09:39:45 user nova-compute[75122]:   <serial>fdf09a1b-a065-4b88-815d-ee54c1c68464</serial>
Nov 15 09:39:45 user nova-compute[75122]: </disk>
Nov 15 09:39:45 user nova-compute[75122]:  {{(pid=75122) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 09:39:45 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-1a65b524-1de8-4241-acb6-38eca9b46b19 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] No BDM found with device name vda, not building metadata. {{(pid=75122) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 09:39:45 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-1a65b524-1de8-4241-acb6-38eca9b46b19 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75122) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 09:39:45 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-1a65b524-1de8-4241-acb6-38eca9b46b19 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] No VIF found with MAC fa:16:3e:1b:53:31, not building metadata {{(pid=75122) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 09:39:45 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-1a65b524-1de8-4241-acb6-38eca9b46b19 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Lock "df913b3e-218d-4ae6-b7b3-70f64fdd3896" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.462s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:39:45 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:39:47 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:39:47 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:39:48 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-a7a3de79-bdf6-4340-9f56-a01fbf8e3fb5 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Acquiring lock "594aff52-4f70-48bc-9a7d-87b984e223b8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:39:48 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-a7a3de79-bdf6-4340-9f56-a01fbf8e3fb5 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Lock "594aff52-4f70-48bc-9a7d-87b984e223b8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:39:48 user nova-compute[75122]: DEBUG nova.compute.manager [None req-a7a3de79-bdf6-4340-9f56-a01fbf8e3fb5 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] [instance: 594aff52-4f70-48bc-9a7d-87b984e223b8] Starting instance... {{(pid=75122) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 09:39:48 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-a7a3de79-bdf6-4340-9f56-a01fbf8e3fb5 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:39:48 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-a7a3de79-bdf6-4340-9f56-a01fbf8e3fb5 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:39:48 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-a7a3de79-bdf6-4340-9f56-a01fbf8e3fb5 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75122) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 09:39:48 user nova-compute[75122]: INFO nova.compute.claims [None req-a7a3de79-bdf6-4340-9f56-a01fbf8e3fb5 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] [instance: 594aff52-4f70-48bc-9a7d-87b984e223b8] Claim successful on node user
Nov 15 09:39:48 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:39:49 user nova-compute[75122]: DEBUG nova.compute.provider_tree [None req-a7a3de79-bdf6-4340-9f56-a01fbf8e3fb5 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Inventory has not changed in ProviderTree for provider: 69a3da65-47be-44c6-b67c-c692b58284ef {{(pid=75122) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 09:39:49 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-a7a3de79-bdf6-4340-9f56-a01fbf8e3fb5 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Inventory has not changed for provider 69a3da65-47be-44c6-b67c-c692b58284ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 09:39:49 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-a7a3de79-bdf6-4340-9f56-a01fbf8e3fb5 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.415s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:39:49 user nova-compute[75122]: DEBUG nova.compute.manager [None req-a7a3de79-bdf6-4340-9f56-a01fbf8e3fb5 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] [instance: 594aff52-4f70-48bc-9a7d-87b984e223b8] Start building networks asynchronously for instance. {{(pid=75122) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 09:39:49 user nova-compute[75122]: DEBUG nova.compute.manager [None req-a7a3de79-bdf6-4340-9f56-a01fbf8e3fb5 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] [instance: 594aff52-4f70-48bc-9a7d-87b984e223b8] Allocating IP information in the background. {{(pid=75122) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 09:39:49 user nova-compute[75122]: DEBUG nova.network.neutron [None req-a7a3de79-bdf6-4340-9f56-a01fbf8e3fb5 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] [instance: 594aff52-4f70-48bc-9a7d-87b984e223b8] allocate_for_instance() {{(pid=75122) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 09:39:49 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-a7a3de79-bdf6-4340-9f56-a01fbf8e3fb5 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] [instance: 594aff52-4f70-48bc-9a7d-87b984e223b8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 09:39:49 user nova-compute[75122]: DEBUG nova.compute.manager [None req-a7a3de79-bdf6-4340-9f56-a01fbf8e3fb5 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] [instance: 594aff52-4f70-48bc-9a7d-87b984e223b8] Start building block device mappings for instance. {{(pid=75122) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 09:39:49 user nova-compute[75122]: DEBUG nova.policy [None req-a7a3de79-bdf6-4340-9f56-a01fbf8e3fb5 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd52d39a644924944be943a3200bd5b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f29cd64a8a674d73936b8a0c90bf2d34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75122) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 09:39:49 user nova-compute[75122]: DEBUG nova.compute.manager [None req-a7a3de79-bdf6-4340-9f56-a01fbf8e3fb5 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] [instance: 594aff52-4f70-48bc-9a7d-87b984e223b8] Start spawning the instance on the hypervisor. {{(pid=75122) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 09:39:49 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-a7a3de79-bdf6-4340-9f56-a01fbf8e3fb5 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] [instance: 594aff52-4f70-48bc-9a7d-87b984e223b8] Creating instance directory {{(pid=75122) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 09:39:49 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-a7a3de79-bdf6-4340-9f56-a01fbf8e3fb5 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] [instance: 594aff52-4f70-48bc-9a7d-87b984e223b8] Creating image(s)
Nov 15 09:39:49 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-a7a3de79-bdf6-4340-9f56-a01fbf8e3fb5 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Acquiring lock "/opt/stack/data/nova/instances/594aff52-4f70-48bc-9a7d-87b984e223b8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:39:49 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-a7a3de79-bdf6-4340-9f56-a01fbf8e3fb5 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Lock "/opt/stack/data/nova/instances/594aff52-4f70-48bc-9a7d-87b984e223b8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:39:49 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-a7a3de79-bdf6-4340-9f56-a01fbf8e3fb5 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Lock "/opt/stack/data/nova/instances/594aff52-4f70-48bc-9a7d-87b984e223b8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:39:49 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-a7a3de79-bdf6-4340-9f56-a01fbf8e3fb5 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:39:49 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-a7a3de79-bdf6-4340-9f56-a01fbf8e3fb5 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json" returned: 0 in 0.186s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:39:49 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-a7a3de79-bdf6-4340-9f56-a01fbf8e3fb5 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Acquiring lock "95d6e29f74d5408f818e32f3bc29bc8270a4c665" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:39:49 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-a7a3de79-bdf6-4340-9f56-a01fbf8e3fb5 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Lock "95d6e29f74d5408f818e32f3bc29bc8270a4c665" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:39:49 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-a7a3de79-bdf6-4340-9f56-a01fbf8e3fb5 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:39:49 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-a7a3de79-bdf6-4340-9f56-a01fbf8e3fb5 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json" returned: 0 in 0.189s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:39:49 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-a7a3de79-bdf6-4340-9f56-a01fbf8e3fb5 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665,backing_fmt=raw /opt/stack/data/nova/instances/594aff52-4f70-48bc-9a7d-87b984e223b8/disk 1073741824 {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:39:49 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-a7a3de79-bdf6-4340-9f56-a01fbf8e3fb5 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665,backing_fmt=raw /opt/stack/data/nova/instances/594aff52-4f70-48bc-9a7d-87b984e223b8/disk 1073741824" returned: 0 in 0.054s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:39:49 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-a7a3de79-bdf6-4340-9f56-a01fbf8e3fb5 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Lock "95d6e29f74d5408f818e32f3bc29bc8270a4c665" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.250s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:39:49 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-a7a3de79-bdf6-4340-9f56-a01fbf8e3fb5 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:39:50 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-a7a3de79-bdf6-4340-9f56-a01fbf8e3fb5 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json" returned: 0 in 0.204s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:39:50 user nova-compute[75122]: DEBUG nova.virt.disk.api [None req-a7a3de79-bdf6-4340-9f56-a01fbf8e3fb5 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Checking if we can resize image /opt/stack/data/nova/instances/594aff52-4f70-48bc-9a7d-87b984e223b8/disk. size=1073741824 {{(pid=75122) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 09:39:50 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-a7a3de79-bdf6-4340-9f56-a01fbf8e3fb5 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/594aff52-4f70-48bc-9a7d-87b984e223b8/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:39:50 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-a7a3de79-bdf6-4340-9f56-a01fbf8e3fb5 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/594aff52-4f70-48bc-9a7d-87b984e223b8/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:39:50 user nova-compute[75122]: DEBUG nova.virt.disk.api [None req-a7a3de79-bdf6-4340-9f56-a01fbf8e3fb5 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Cannot resize image /opt/stack/data/nova/instances/594aff52-4f70-48bc-9a7d-87b984e223b8/disk to a smaller size. {{(pid=75122) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 09:39:50 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-a7a3de79-bdf6-4340-9f56-a01fbf8e3fb5 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] [instance: 594aff52-4f70-48bc-9a7d-87b984e223b8] Created local disks {{(pid=75122) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 09:39:50 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-a7a3de79-bdf6-4340-9f56-a01fbf8e3fb5 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] [instance: 594aff52-4f70-48bc-9a7d-87b984e223b8] Ensure instance console log exists: /opt/stack/data/nova/instances/594aff52-4f70-48bc-9a7d-87b984e223b8/console.log {{(pid=75122) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 09:39:50 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-a7a3de79-bdf6-4340-9f56-a01fbf8e3fb5 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:39:50 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-a7a3de79-bdf6-4340-9f56-a01fbf8e3fb5 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:39:50 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-a7a3de79-bdf6-4340-9f56-a01fbf8e3fb5 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:39:50 user nova-compute[75122]: DEBUG nova.network.neutron [None req-a7a3de79-bdf6-4340-9f56-a01fbf8e3fb5 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] [instance: 594aff52-4f70-48bc-9a7d-87b984e223b8] Successfully created port: 8166d3f5-5c5b-493f-8194-3bfa42d0ff32 {{(pid=75122) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 09:39:50 user nova-compute[75122]: DEBUG nova.compute.manager [req-8961fedc-4072-4bf3-bac9-61a9e07ccd0c req-ba36a0b7-6b21-4168-808a-143faeb13b37 service nova] [instance: c2f45f49-0bca-4ae2-bc2a-eed293143489] Received event network-changed-24f9619f-42ba-42cf-b39c-43e14754e913 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:39:50 user nova-compute[75122]: DEBUG nova.compute.manager [req-8961fedc-4072-4bf3-bac9-61a9e07ccd0c req-ba36a0b7-6b21-4168-808a-143faeb13b37 service nova] [instance: c2f45f49-0bca-4ae2-bc2a-eed293143489] Refreshing instance network info cache due to event network-changed-24f9619f-42ba-42cf-b39c-43e14754e913. {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 09:39:50 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-8961fedc-4072-4bf3-bac9-61a9e07ccd0c req-ba36a0b7-6b21-4168-808a-143faeb13b37 service nova] Acquiring lock "refresh_cache-c2f45f49-0bca-4ae2-bc2a-eed293143489" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 09:39:50 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-8961fedc-4072-4bf3-bac9-61a9e07ccd0c req-ba36a0b7-6b21-4168-808a-143faeb13b37 service nova] Acquired lock "refresh_cache-c2f45f49-0bca-4ae2-bc2a-eed293143489" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 09:39:50 user nova-compute[75122]: DEBUG nova.network.neutron [req-8961fedc-4072-4bf3-bac9-61a9e07ccd0c req-ba36a0b7-6b21-4168-808a-143faeb13b37 service nova] [instance: c2f45f49-0bca-4ae2-bc2a-eed293143489] Refreshing network info cache for port 24f9619f-42ba-42cf-b39c-43e14754e913 {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 09:39:50 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:39:51 user nova-compute[75122]: DEBUG nova.network.neutron [req-8961fedc-4072-4bf3-bac9-61a9e07ccd0c req-ba36a0b7-6b21-4168-808a-143faeb13b37 service nova] [instance: c2f45f49-0bca-4ae2-bc2a-eed293143489] Updated VIF entry in instance network info cache for port 24f9619f-42ba-42cf-b39c-43e14754e913. {{(pid=75122) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 09:39:51 user nova-compute[75122]: DEBUG nova.network.neutron [req-8961fedc-4072-4bf3-bac9-61a9e07ccd0c req-ba36a0b7-6b21-4168-808a-143faeb13b37 service nova] [instance: c2f45f49-0bca-4ae2-bc2a-eed293143489] Updating instance_info_cache with network_info: [{"id": "24f9619f-42ba-42cf-b39c-43e14754e913", "address": "fa:16:3e:92:99:9d", "network": {"id": "387b4fc3-39ad-40c3-bcd7-7526b09e30b7", "bridge": "br-int", "label": "tempest-TestStampPattern-1501769990-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bdc0f52b1c744b91b4f1a4ecd07e07c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24f9619f-42", "ovs_interfaceid": "24f9619f-42ba-42cf-b39c-43e14754e913", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:39:51 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-8961fedc-4072-4bf3-bac9-61a9e07ccd0c req-ba36a0b7-6b21-4168-808a-143faeb13b37 service nova] Releasing lock "refresh_cache-c2f45f49-0bca-4ae2-bc2a-eed293143489" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 09:39:51 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-b7236e54-f686-4306-a929-e75b7e4162b8 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Acquiring lock "c2f45f49-0bca-4ae2-bc2a-eed293143489" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:39:51 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-b7236e54-f686-4306-a929-e75b7e4162b8 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Lock "c2f45f49-0bca-4ae2-bc2a-eed293143489" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:39:51 user nova-compute[75122]: DEBUG nova.objects.instance [None req-b7236e54-f686-4306-a929-e75b7e4162b8 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Lazy-loading 'flavor' on Instance uuid c2f45f49-0bca-4ae2-bc2a-eed293143489 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:39:51 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-b7236e54-f686-4306-a929-e75b7e4162b8 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Lock "c2f45f49-0bca-4ae2-bc2a-eed293143489" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:39:51 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-b7236e54-f686-4306-a929-e75b7e4162b8 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Acquiring lock "c2f45f49-0bca-4ae2-bc2a-eed293143489" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:39:51 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-b7236e54-f686-4306-a929-e75b7e4162b8 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Lock "c2f45f49-0bca-4ae2-bc2a-eed293143489" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:39:51 user nova-compute[75122]: INFO nova.compute.manager [None req-b7236e54-f686-4306-a929-e75b7e4162b8 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] [instance: c2f45f49-0bca-4ae2-bc2a-eed293143489] Attaching volume 984b3190-31e5-432a-9602-cedead354720 to /dev/vdb
Nov 15 09:39:51 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:39:51 user nova-compute[75122]: DEBUG os_brick.utils [None req-b7236e54-f686-4306-a929-e75b7e4162b8 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 09:39:51 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:39:51 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:39:51 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1c7b980-25e5-4771-9aa2-92b9e63f3c30]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:742fb64b3587\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:39:51 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:39:51 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:39:51 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[fddeda50-0c29-4784-95b4-b5b3938df9e8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:39:51 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:39:51 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:39:51 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[f15f2641-fb5e-4578-ae00-e51405f17690]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:39:51 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[e01d1722-baba-4385-a194-70cb8f035c29]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:39:51 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-b7236e54-f686-4306-a929-e75b7e4162b8 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Running cmd (subprocess): nvme version {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:39:51 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-b7236e54-f686-4306-a929-e75b7e4162b8 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] 'nvme version' failed. Not Retrying. {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 09:39:51 user nova-compute[75122]: DEBUG nova.network.neutron [None req-a7a3de79-bdf6-4340-9f56-a01fbf8e3fb5 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] [instance: 594aff52-4f70-48bc-9a7d-87b984e223b8] Successfully updated port: 8166d3f5-5c5b-493f-8194-3bfa42d0ff32 {{(pid=75122) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 09:39:51 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b7236e54-f686-4306-a929-e75b7e4162b8 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] nvme not present on system {{(pid=75122) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 09:39:51 user nova-compute[75122]: DEBUG nova.compute.manager [req-45eb5a5f-c310-4af4-a079-0a074831745f req-fabc9187-1c41-427f-9c82-2053d31ea649 service nova] [instance: 594aff52-4f70-48bc-9a7d-87b984e223b8] Received event network-changed-8166d3f5-5c5b-493f-8194-3bfa42d0ff32 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:39:51 user nova-compute[75122]: DEBUG nova.compute.manager [req-45eb5a5f-c310-4af4-a079-0a074831745f req-fabc9187-1c41-427f-9c82-2053d31ea649 service nova] [instance: 594aff52-4f70-48bc-9a7d-87b984e223b8] Refreshing instance network info cache due to event network-changed-8166d3f5-5c5b-493f-8194-3bfa42d0ff32. {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 09:39:51 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-45eb5a5f-c310-4af4-a079-0a074831745f req-fabc9187-1c41-427f-9c82-2053d31ea649 service nova] Acquiring lock "refresh_cache-594aff52-4f70-48bc-9a7d-87b984e223b8" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 09:39:51 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-45eb5a5f-c310-4af4-a079-0a074831745f req-fabc9187-1c41-427f-9c82-2053d31ea649 service nova] Acquired lock "refresh_cache-594aff52-4f70-48bc-9a7d-87b984e223b8" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 09:39:51 user nova-compute[75122]: DEBUG nova.network.neutron [req-45eb5a5f-c310-4af4-a079-0a074831745f req-fabc9187-1c41-427f-9c82-2053d31ea649 service nova] [instance: 594aff52-4f70-48bc-9a7d-87b984e223b8] Refreshing network info cache for port 8166d3f5-5c5b-493f-8194-3bfa42d0ff32 {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 09:39:51 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:39:51 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-a7a3de79-bdf6-4340-9f56-a01fbf8e3fb5 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Acquiring lock "refresh_cache-594aff52-4f70-48bc-9a7d-87b984e223b8" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 09:39:51 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 09:39:51 user nova-compute[75122]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 09:39:51 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[92c824df-c1bc-4d1b-9c2e-7b6c4a352e15]: (4, '') {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:39:51 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.lightos [None req-b7236e54-f686-4306-a929-e75b7e4162b8 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75122) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 09:39:51 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.lightos [None req-b7236e54-f686-4306-a929-e75b7e4162b8 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75122) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 09:39:51 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.lightos [None req-b7236e54-f686-4306-a929-e75b7e4162b8 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] LIGHTOS: no hostnqn found. {{(pid=75122) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 09:39:51 user nova-compute[75122]: DEBUG os_brick.utils [None req-b7236e54-f686-4306-a929-e75b7e4162b8 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:742fb64b3587', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 09:39:51 user nova-compute[75122]: DEBUG nova.virt.block_device [None req-b7236e54-f686-4306-a929-e75b7e4162b8 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] [instance: c2f45f49-0bca-4ae2-bc2a-eed293143489] Updating existing volume attachment record: 22685892-bfd8-40b4-b831-abfe96396915 {{(pid=75122) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 09:39:51 user nova-compute[75122]: DEBUG nova.network.neutron [req-45eb5a5f-c310-4af4-a079-0a074831745f req-fabc9187-1c41-427f-9c82-2053d31ea649 service nova] [instance: 594aff52-4f70-48bc-9a7d-87b984e223b8] Instance cache missing network info. {{(pid=75122) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 09:39:51 user nova-compute[75122]: DEBUG nova.network.neutron [req-45eb5a5f-c310-4af4-a079-0a074831745f req-fabc9187-1c41-427f-9c82-2053d31ea649 service nova] [instance: 594aff52-4f70-48bc-9a7d-87b984e223b8] Updating instance_info_cache with network_info: [] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:39:51 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-45eb5a5f-c310-4af4-a079-0a074831745f req-fabc9187-1c41-427f-9c82-2053d31ea649 service nova] Releasing lock "refresh_cache-594aff52-4f70-48bc-9a7d-87b984e223b8" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 09:39:51 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-a7a3de79-bdf6-4340-9f56-a01fbf8e3fb5 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Acquired lock "refresh_cache-594aff52-4f70-48bc-9a7d-87b984e223b8" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 09:39:51 user nova-compute[75122]: DEBUG nova.network.neutron [None req-a7a3de79-bdf6-4340-9f56-a01fbf8e3fb5 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] [instance: 594aff52-4f70-48bc-9a7d-87b984e223b8] Building network info cache for instance {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 09:39:51 user nova-compute[75122]: DEBUG nova.network.neutron [None req-a7a3de79-bdf6-4340-9f56-a01fbf8e3fb5 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] [instance: 594aff52-4f70-48bc-9a7d-87b984e223b8] Instance cache missing network info. {{(pid=75122) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 09:39:52 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:39:52 user nova-compute[75122]: DEBUG nova.network.neutron [None req-a7a3de79-bdf6-4340-9f56-a01fbf8e3fb5 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] [instance: 594aff52-4f70-48bc-9a7d-87b984e223b8] Updating instance_info_cache with network_info: [{"id": "8166d3f5-5c5b-493f-8194-3bfa42d0ff32", "address": "fa:16:3e:d7:4d:bf", "network": {"id": "cc80acf3-8a44-4d7e-aaa0-1214700564b3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1084984321-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f29cd64a8a674d73936b8a0c90bf2d34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8166d3f5-5c", "ovs_interfaceid": "8166d3f5-5c5b-493f-8194-3bfa42d0ff32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:39:52 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-a7a3de79-bdf6-4340-9f56-a01fbf8e3fb5 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Releasing lock "refresh_cache-594aff52-4f70-48bc-9a7d-87b984e223b8" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 09:39:52 user nova-compute[75122]: DEBUG nova.compute.manager [None req-a7a3de79-bdf6-4340-9f56-a01fbf8e3fb5 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] [instance: 594aff52-4f70-48bc-9a7d-87b984e223b8] Instance network_info: |[{"id": "8166d3f5-5c5b-493f-8194-3bfa42d0ff32", "address": "fa:16:3e:d7:4d:bf", "network": {"id": "cc80acf3-8a44-4d7e-aaa0-1214700564b3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1084984321-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f29cd64a8a674d73936b8a0c90bf2d34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8166d3f5-5c", "ovs_interfaceid": "8166d3f5-5c5b-493f-8194-3bfa42d0ff32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75122) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 09:39:52 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-a7a3de79-bdf6-4340-9f56-a01fbf8e3fb5 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] [instance: 594aff52-4f70-48bc-9a7d-87b984e223b8] Start _get_guest_xml network_info=[{"id": "8166d3f5-5c5b-493f-8194-3bfa42d0ff32", "address": "fa:16:3e:d7:4d:bf", "network": {"id": "cc80acf3-8a44-4d7e-aaa0-1214700564b3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1084984321-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f29cd64a8a674d73936b8a0c90bf2d34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8166d3f5-5c", "ovs_interfaceid": "8166d3f5-5c5b-493f-8194-3bfa42d0ff32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T09:26:31Z,direct_url=<?>,disk_format='qcow2',id=5e862cfe-47b8-4725-8292-65761ee6d0f5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9c57733cb41847c0b4ad31519c382e5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T09:26:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '5e862cfe-47b8-4725-8292-65761ee6d0f5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75122) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 09:39:52 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-a7a3de79-bdf6-4340-9f56-a01fbf8e3fb5 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 09:39:52 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-a7a3de79-bdf6-4340-9f56-a01fbf8e3fb5 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 09:39:52 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-a7a3de79-bdf6-4340-9f56-a01fbf8e3fb5 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75122) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 09:39:52 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-a7a3de79-bdf6-4340-9f56-a01fbf8e3fb5 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] CPU controller missing on host. {{(pid=75122) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 09:39:52 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-a7a3de79-bdf6-4340-9f56-a01fbf8e3fb5 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75122) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 09:39:52 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-a7a3de79-bdf6-4340-9f56-a01fbf8e3fb5 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] CPU controller found on host. {{(pid=75122) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 09:39:52 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-a7a3de79-bdf6-4340-9f56-a01fbf8e3fb5 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75122) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 09:39:52 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-a7a3de79-bdf6-4340-9f56-a01fbf8e3fb5 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T09:26:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T09:26:31Z,direct_url=<?>,disk_format='qcow2',id=5e862cfe-47b8-4725-8292-65761ee6d0f5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9c57733cb41847c0b4ad31519c382e5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T09:26:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 09:39:52 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-a7a3de79-bdf6-4340-9f56-a01fbf8e3fb5 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Flavor limits 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 09:39:52 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-a7a3de79-bdf6-4340-9f56-a01fbf8e3fb5 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Image limits 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 09:39:52 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-a7a3de79-bdf6-4340-9f56-a01fbf8e3fb5 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Flavor pref 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 09:39:52 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-a7a3de79-bdf6-4340-9f56-a01fbf8e3fb5 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Image pref 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 09:39:52 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-a7a3de79-bdf6-4340-9f56-a01fbf8e3fb5 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 09:39:52 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-a7a3de79-bdf6-4340-9f56-a01fbf8e3fb5 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 09:39:52 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-a7a3de79-bdf6-4340-9f56-a01fbf8e3fb5 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75122) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 09:39:52 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-a7a3de79-bdf6-4340-9f56-a01fbf8e3fb5 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Got 1 possible topologies {{(pid=75122) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 09:39:52 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-a7a3de79-bdf6-4340-9f56-a01fbf8e3fb5 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 09:39:52 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-a7a3de79-bdf6-4340-9f56-a01fbf8e3fb5 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 09:39:52 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-a7a3de79-bdf6-4340-9f56-a01fbf8e3fb5 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T09:39:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1369030815',display_name='tempest-AttachVolumeNegativeTest-server-1369030815',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1369030815',id=23,image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJV1hVBM+lOLbmTRKQZAbEHB2W5Xga/CKNfcUuqJXftk19w4SVS9+JWt9gT7w3ze2ebEVZJE6pozVLMwcn8V25ArAuCTS18/wcDFKR6poJHKgaXKagOVWmkM+lrjQy68Ag==',key_name='tempest-keypair-1521570724',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f29cd64a8a674d73936b8a0c90bf2d34',ramdisk_id='',reservation_id='r-5dx6y068',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-475232131',owner_user_name='tempest-AttachVolumeNegativeTest-475232131-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T09:39:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d52d39a644924944be943a3200bd5b33',uuid=594aff52-4f70-48bc-9a7d-87b984e223b8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8166d3f5-5c5b-493f-8194-3bfa42d0ff32", "address": "fa:16:3e:d7:4d:bf", "network": {"id": "cc80acf3-8a44-4d7e-aaa0-1214700564b3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1084984321-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f29cd64a8a674d73936b8a0c90bf2d34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8166d3f5-5c", "ovs_interfaceid": "8166d3f5-5c5b-493f-8194-3bfa42d0ff32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75122) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 09:39:52 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-a7a3de79-bdf6-4340-9f56-a01fbf8e3fb5 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Converting VIF {"id": "8166d3f5-5c5b-493f-8194-3bfa42d0ff32", "address": "fa:16:3e:d7:4d:bf", "network": {"id": "cc80acf3-8a44-4d7e-aaa0-1214700564b3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1084984321-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f29cd64a8a674d73936b8a0c90bf2d34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8166d3f5-5c", "ovs_interfaceid": "8166d3f5-5c5b-493f-8194-3bfa42d0ff32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 09:39:52 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-a7a3de79-bdf6-4340-9f56-a01fbf8e3fb5 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:4d:bf,bridge_name='br-int',has_traffic_filtering=True,id=8166d3f5-5c5b-493f-8194-3bfa42d0ff32,network=Network(cc80acf3-8a44-4d7e-aaa0-1214700564b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8166d3f5-5c') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 09:39:52 user nova-compute[75122]: DEBUG nova.objects.instance [None req-a7a3de79-bdf6-4340-9f56-a01fbf8e3fb5 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Lazy-loading 'pci_devices' on Instance uuid 594aff52-4f70-48bc-9a7d-87b984e223b8 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:39:52 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-a7a3de79-bdf6-4340-9f56-a01fbf8e3fb5 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] [instance: 594aff52-4f70-48bc-9a7d-87b984e223b8] End _get_guest_xml xml=<domain type="kvm">
Nov 15 09:39:52 user nova-compute[75122]:   <uuid>594aff52-4f70-48bc-9a7d-87b984e223b8</uuid>
Nov 15 09:39:52 user nova-compute[75122]:   <name>instance-00000017</name>
Nov 15 09:39:52 user nova-compute[75122]:   <memory>524288</memory>
Nov 15 09:39:52 user nova-compute[75122]:   <vcpu>1</vcpu>
Nov 15 09:39:52 user nova-compute[75122]:   <metadata>
Nov 15 09:39:52 user nova-compute[75122]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 09:39:52 user nova-compute[75122]:       <nova:package version="0.0.0"/>
Nov 15 09:39:52 user nova-compute[75122]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1369030815</nova:name>
Nov 15 09:39:52 user nova-compute[75122]:       <nova:creationTime>2023-11-15 09:39:52</nova:creationTime>
Nov 15 09:39:52 user nova-compute[75122]:       <nova:flavor name="m1.tiny">
Nov 15 09:39:52 user nova-compute[75122]:         <nova:memory>512</nova:memory>
Nov 15 09:39:52 user nova-compute[75122]:         <nova:disk>1</nova:disk>
Nov 15 09:39:52 user nova-compute[75122]:         <nova:swap>0</nova:swap>
Nov 15 09:39:52 user nova-compute[75122]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 09:39:52 user nova-compute[75122]:         <nova:vcpus>1</nova:vcpus>
Nov 15 09:39:52 user nova-compute[75122]:       </nova:flavor>
Nov 15 09:39:52 user nova-compute[75122]:       <nova:owner>
Nov 15 09:39:52 user nova-compute[75122]:         <nova:user uuid="d52d39a644924944be943a3200bd5b33">tempest-AttachVolumeNegativeTest-475232131-project-member</nova:user>
Nov 15 09:39:52 user nova-compute[75122]:         <nova:project uuid="f29cd64a8a674d73936b8a0c90bf2d34">tempest-AttachVolumeNegativeTest-475232131</nova:project>
Nov 15 09:39:52 user nova-compute[75122]:       </nova:owner>
Nov 15 09:39:52 user nova-compute[75122]:       <nova:root type="image" uuid="5e862cfe-47b8-4725-8292-65761ee6d0f5"/>
Nov 15 09:39:52 user nova-compute[75122]:       <nova:ports>
Nov 15 09:39:52 user nova-compute[75122]:         <nova:port uuid="8166d3f5-5c5b-493f-8194-3bfa42d0ff32">
Nov 15 09:39:52 user nova-compute[75122]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 15 09:39:52 user nova-compute[75122]:         </nova:port>
Nov 15 09:39:52 user nova-compute[75122]:       </nova:ports>
Nov 15 09:39:52 user nova-compute[75122]:     </nova:instance>
Nov 15 09:39:52 user nova-compute[75122]:   </metadata>
Nov 15 09:39:52 user nova-compute[75122]:   <sysinfo type="smbios">
Nov 15 09:39:52 user nova-compute[75122]:     <system>
Nov 15 09:39:52 user nova-compute[75122]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 09:39:52 user nova-compute[75122]:       <entry name="product">OpenStack Nova</entry>
Nov 15 09:39:52 user nova-compute[75122]:       <entry name="version">0.0.0</entry>
Nov 15 09:39:52 user nova-compute[75122]:       <entry name="serial">594aff52-4f70-48bc-9a7d-87b984e223b8</entry>
Nov 15 09:39:52 user nova-compute[75122]:       <entry name="uuid">594aff52-4f70-48bc-9a7d-87b984e223b8</entry>
Nov 15 09:39:52 user nova-compute[75122]:       <entry name="family">Virtual Machine</entry>
Nov 15 09:39:52 user nova-compute[75122]:     </system>
Nov 15 09:39:52 user nova-compute[75122]:   </sysinfo>
Nov 15 09:39:52 user nova-compute[75122]:   <os>
Nov 15 09:39:52 user nova-compute[75122]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 09:39:52 user nova-compute[75122]:     <boot dev="hd"/>
Nov 15 09:39:52 user nova-compute[75122]:     <smbios mode="sysinfo"/>
Nov 15 09:39:52 user nova-compute[75122]:   </os>
Nov 15 09:39:52 user nova-compute[75122]:   <features>
Nov 15 09:39:52 user nova-compute[75122]:     <acpi/>
Nov 15 09:39:52 user nova-compute[75122]:     <apic/>
Nov 15 09:39:52 user nova-compute[75122]:     <vmcoreinfo/>
Nov 15 09:39:52 user nova-compute[75122]:   </features>
Nov 15 09:39:52 user nova-compute[75122]:   <clock offset="utc">
Nov 15 09:39:52 user nova-compute[75122]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 09:39:52 user nova-compute[75122]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 09:39:52 user nova-compute[75122]:     <timer name="hpet" present="no"/>
Nov 15 09:39:52 user nova-compute[75122]:   </clock>
Nov 15 09:39:52 user nova-compute[75122]:   <cpu mode="custom" match="exact">
Nov 15 09:39:52 user nova-compute[75122]:     <model>Nehalem</model>
Nov 15 09:39:52 user nova-compute[75122]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 09:39:52 user nova-compute[75122]:   </cpu>
Nov 15 09:39:52 user nova-compute[75122]:   <devices>
Nov 15 09:39:52 user nova-compute[75122]:     <disk type="file" device="disk">
Nov 15 09:39:52 user nova-compute[75122]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 09:39:52 user nova-compute[75122]:       <source file="/opt/stack/data/nova/instances/594aff52-4f70-48bc-9a7d-87b984e223b8/disk"/>
Nov 15 09:39:52 user nova-compute[75122]:       <target dev="vda" bus="virtio"/>
Nov 15 09:39:52 user nova-compute[75122]:     </disk>
Nov 15 09:39:52 user nova-compute[75122]:     <interface type="ethernet">
Nov 15 09:39:52 user nova-compute[75122]:       <mac address="fa:16:3e:d7:4d:bf"/>
Nov 15 09:39:52 user nova-compute[75122]:       <model type="virtio"/>
Nov 15 09:39:52 user nova-compute[75122]:       <mtu size="1442"/>
Nov 15 09:39:52 user nova-compute[75122]:       <target dev="tap8166d3f5-5c"/>
Nov 15 09:39:52 user nova-compute[75122]:     </interface>
Nov 15 09:39:52 user nova-compute[75122]:     <serial type="pty">
Nov 15 09:39:52 user nova-compute[75122]:       <log file="/opt/stack/data/nova/instances/594aff52-4f70-48bc-9a7d-87b984e223b8/console.log" append="off"/>
Nov 15 09:39:52 user nova-compute[75122]:     </serial>
Nov 15 09:39:52 user nova-compute[75122]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 09:39:52 user nova-compute[75122]:     <video>
Nov 15 09:39:52 user nova-compute[75122]:       <model type="virtio"/>
Nov 15 09:39:52 user nova-compute[75122]:     </video>
Nov 15 09:39:52 user nova-compute[75122]:     <rng model="virtio">
Nov 15 09:39:52 user nova-compute[75122]:       <backend model="random">/dev/urandom</backend>
Nov 15 09:39:52 user nova-compute[75122]:     </rng>
Nov 15 09:39:52 user nova-compute[75122]:     <controller type="usb" index="0" model="none"/>
Nov 15 09:39:52 user nova-compute[75122]:     <memballoon model="virtio">
Nov 15 09:39:52 user nova-compute[75122]:       <stats period="10"/>
Nov 15 09:39:52 user nova-compute[75122]:     </memballoon>
Nov 15 09:39:52 user nova-compute[75122]:   </devices>
Nov 15 09:39:52 user nova-compute[75122]: </domain>
Nov 15 09:39:52 user nova-compute[75122]:  {{(pid=75122) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 09:39:52 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-a7a3de79-bdf6-4340-9f56-a01fbf8e3fb5 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T09:39:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1369030815',display_name='tempest-AttachVolumeNegativeTest-server-1369030815',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1369030815',id=23,image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJV1hVBM+lOLbmTRKQZAbEHB2W5Xga/CKNfcUuqJXftk19w4SVS9+JWt9gT7w3ze2ebEVZJE6pozVLMwcn8V25ArAuCTS18/wcDFKR6poJHKgaXKagOVWmkM+lrjQy68Ag==',key_name='tempest-keypair-1521570724',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f29cd64a8a674d73936b8a0c90bf2d34',ramdisk_id='',reservation_id='r-5dx6y068',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-475232131',owner_user_name='tempest-AttachVolumeNegativeTest-475232131-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T09:39:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d52d39a644924944be943a3200bd5b33',uuid=594aff52-4f70-48bc-9a7d-87b984e223b8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8166d3f5-5c5b-493f-8194-3bfa42d0ff32", "address": "fa:16:3e:d7:4d:bf", "network": {"id": "cc80acf3-8a44-4d7e-aaa0-1214700564b3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1084984321-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f29cd64a8a674d73936b8a0c90bf2d34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8166d3f5-5c", "ovs_interfaceid": "8166d3f5-5c5b-493f-8194-3bfa42d0ff32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 09:39:52 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-a7a3de79-bdf6-4340-9f56-a01fbf8e3fb5 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Converting VIF {"id": "8166d3f5-5c5b-493f-8194-3bfa42d0ff32", "address": "fa:16:3e:d7:4d:bf", "network": {"id": "cc80acf3-8a44-4d7e-aaa0-1214700564b3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1084984321-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f29cd64a8a674d73936b8a0c90bf2d34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8166d3f5-5c", "ovs_interfaceid": "8166d3f5-5c5b-493f-8194-3bfa42d0ff32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 09:39:52 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-a7a3de79-bdf6-4340-9f56-a01fbf8e3fb5 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:4d:bf,bridge_name='br-int',has_traffic_filtering=True,id=8166d3f5-5c5b-493f-8194-3bfa42d0ff32,network=Network(cc80acf3-8a44-4d7e-aaa0-1214700564b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8166d3f5-5c') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 09:39:52 user nova-compute[75122]: DEBUG os_vif [None req-a7a3de79-bdf6-4340-9f56-a01fbf8e3fb5 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:4d:bf,bridge_name='br-int',has_traffic_filtering=True,id=8166d3f5-5c5b-493f-8194-3bfa42d0ff32,network=Network(cc80acf3-8a44-4d7e-aaa0-1214700564b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8166d3f5-5c') {{(pid=75122) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 09:39:52 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:39:52 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:39:52 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 09:39:52 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:39:52 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '830867f7-f69f-59c0-8b2d-cc26343c997b', '_type': 'linux-noop'}}, row=False) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:39:52 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:39:52 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:39:52 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8166d3f5-5c, may_exist=True, interface_attrs={}) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:39:52 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8166d3f5-5c, col_values=(('qos', UUID('2f7582d7-b97c-4a89-a2dd-d521808e26ab')),), if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:39:52 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8166d3f5-5c, col_values=(('external_ids', {'iface-id': '8166d3f5-5c5b-493f-8194-3bfa42d0ff32', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d7:4d:bf', 'vm-uuid': '594aff52-4f70-48bc-9a7d-87b984e223b8'}),), if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:39:52 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:39:52 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:39:52 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:39:52 user nova-compute[75122]: INFO os_vif [None req-a7a3de79-bdf6-4340-9f56-a01fbf8e3fb5 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:4d:bf,bridge_name='br-int',has_traffic_filtering=True,id=8166d3f5-5c5b-493f-8194-3bfa42d0ff32,network=Network(cc80acf3-8a44-4d7e-aaa0-1214700564b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8166d3f5-5c')
Nov 15 09:39:52 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-a7a3de79-bdf6-4340-9f56-a01fbf8e3fb5 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] No BDM found with device name vda, not building metadata. {{(pid=75122) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 09:39:52 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-a7a3de79-bdf6-4340-9f56-a01fbf8e3fb5 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] No VIF found with MAC fa:16:3e:d7:4d:bf, not building metadata {{(pid=75122) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 09:39:53 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:39:53 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:39:53 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:39:53 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:39:53 user nova-compute[75122]: DEBUG nova.compute.manager [req-fe507236-7192-4f98-8bc4-cab4f6833138 req-f2d4ef64-738f-41a0-b8b8-0a0052d09936 service nova] [instance: 594aff52-4f70-48bc-9a7d-87b984e223b8] Received event network-vif-plugged-8166d3f5-5c5b-493f-8194-3bfa42d0ff32 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:39:53 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-fe507236-7192-4f98-8bc4-cab4f6833138 req-f2d4ef64-738f-41a0-b8b8-0a0052d09936 service nova] Acquiring lock "594aff52-4f70-48bc-9a7d-87b984e223b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:39:53 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-fe507236-7192-4f98-8bc4-cab4f6833138 req-f2d4ef64-738f-41a0-b8b8-0a0052d09936 service nova] Lock "594aff52-4f70-48bc-9a7d-87b984e223b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:39:53 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-fe507236-7192-4f98-8bc4-cab4f6833138 req-f2d4ef64-738f-41a0-b8b8-0a0052d09936 service nova] Lock "594aff52-4f70-48bc-9a7d-87b984e223b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:39:53 user nova-compute[75122]: DEBUG nova.compute.manager [req-fe507236-7192-4f98-8bc4-cab4f6833138 req-f2d4ef64-738f-41a0-b8b8-0a0052d09936 service nova] [instance: 594aff52-4f70-48bc-9a7d-87b984e223b8] No waiting events found dispatching network-vif-plugged-8166d3f5-5c5b-493f-8194-3bfa42d0ff32 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:39:53 user nova-compute[75122]: WARNING nova.compute.manager [req-fe507236-7192-4f98-8bc4-cab4f6833138 req-f2d4ef64-738f-41a0-b8b8-0a0052d09936 service nova] [instance: 594aff52-4f70-48bc-9a7d-87b984e223b8] Received unexpected event network-vif-plugged-8166d3f5-5c5b-493f-8194-3bfa42d0ff32 for instance with vm_state building and task_state spawning.
Nov 15 09:39:54 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:39:54 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:39:55 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-7cabcbdf-1c7a-4647-a8d4-0ecfe825f5ad tempest-VolumesNegativeTest-1736222970 tempest-VolumesNegativeTest-1736222970-project-member] Acquiring lock "ff1c5639-9d63-409a-bbd7-1de63f57b189" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:39:55 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-7cabcbdf-1c7a-4647-a8d4-0ecfe825f5ad tempest-VolumesNegativeTest-1736222970 tempest-VolumesNegativeTest-1736222970-project-member] Lock "ff1c5639-9d63-409a-bbd7-1de63f57b189" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.004s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:39:55 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-7cabcbdf-1c7a-4647-a8d4-0ecfe825f5ad tempest-VolumesNegativeTest-1736222970 tempest-VolumesNegativeTest-1736222970-project-member] Acquiring lock "ff1c5639-9d63-409a-bbd7-1de63f57b189-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:39:55 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-7cabcbdf-1c7a-4647-a8d4-0ecfe825f5ad tempest-VolumesNegativeTest-1736222970 tempest-VolumesNegativeTest-1736222970-project-member] Lock "ff1c5639-9d63-409a-bbd7-1de63f57b189-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:39:55 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-7cabcbdf-1c7a-4647-a8d4-0ecfe825f5ad tempest-VolumesNegativeTest-1736222970 tempest-VolumesNegativeTest-1736222970-project-member] Lock "ff1c5639-9d63-409a-bbd7-1de63f57b189-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:39:55 user nova-compute[75122]: INFO nova.compute.manager [None req-7cabcbdf-1c7a-4647-a8d4-0ecfe825f5ad tempest-VolumesNegativeTest-1736222970 tempest-VolumesNegativeTest-1736222970-project-member] [instance: ff1c5639-9d63-409a-bbd7-1de63f57b189] Terminating instance
Nov 15 09:39:55 user nova-compute[75122]: DEBUG nova.compute.manager [None req-7cabcbdf-1c7a-4647-a8d4-0ecfe825f5ad tempest-VolumesNegativeTest-1736222970 tempest-VolumesNegativeTest-1736222970-project-member] [instance: ff1c5639-9d63-409a-bbd7-1de63f57b189] Start destroying the instance on the hypervisor. {{(pid=75122) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 09:39:55 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:39:55 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:39:55 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:39:55 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:39:55 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:39:55 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-6b88000d-8c07-42d8-b781-19331773200e tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] Acquiring lock "e4d3e4f5-b48f-4fd4-9299-091469824217" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:39:55 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-6b88000d-8c07-42d8-b781-19331773200e tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] Lock "e4d3e4f5-b48f-4fd4-9299-091469824217" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:39:55 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-6b88000d-8c07-42d8-b781-19331773200e tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] Acquiring lock "e4d3e4f5-b48f-4fd4-9299-091469824217-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:39:55 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-6b88000d-8c07-42d8-b781-19331773200e tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] Lock "e4d3e4f5-b48f-4fd4-9299-091469824217-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:39:55 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-6b88000d-8c07-42d8-b781-19331773200e tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] Lock "e4d3e4f5-b48f-4fd4-9299-091469824217-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:39:55 user nova-compute[75122]: INFO nova.compute.manager [None req-6b88000d-8c07-42d8-b781-19331773200e tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] [instance: e4d3e4f5-b48f-4fd4-9299-091469824217] Terminating instance
Nov 15 09:39:55 user nova-compute[75122]: DEBUG nova.compute.manager [None req-6b88000d-8c07-42d8-b781-19331773200e tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] [instance: e4d3e4f5-b48f-4fd4-9299-091469824217] Start destroying the instance on the hypervisor. {{(pid=75122) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 09:39:55 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:39:55 user nova-compute[75122]: DEBUG nova.compute.manager [req-a4c3677d-b315-44e7-a119-80f8fb22db2b req-b64b18cd-4260-40e3-bce2-b9ace4890904 service nova] [instance: ff1c5639-9d63-409a-bbd7-1de63f57b189] Received event network-vif-unplugged-fb9bb294-6cbe-46c1-9214-229ff766f28e {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:39:55 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-a4c3677d-b315-44e7-a119-80f8fb22db2b req-b64b18cd-4260-40e3-bce2-b9ace4890904 service nova] Acquiring lock "ff1c5639-9d63-409a-bbd7-1de63f57b189-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:39:55 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-a4c3677d-b315-44e7-a119-80f8fb22db2b req-b64b18cd-4260-40e3-bce2-b9ace4890904 service nova] Lock "ff1c5639-9d63-409a-bbd7-1de63f57b189-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:39:55 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-a4c3677d-b315-44e7-a119-80f8fb22db2b req-b64b18cd-4260-40e3-bce2-b9ace4890904 service nova] Lock "ff1c5639-9d63-409a-bbd7-1de63f57b189-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:39:55 user nova-compute[75122]: DEBUG nova.compute.manager [req-a4c3677d-b315-44e7-a119-80f8fb22db2b req-b64b18cd-4260-40e3-bce2-b9ace4890904 service nova] [instance: ff1c5639-9d63-409a-bbd7-1de63f57b189] No waiting events found dispatching network-vif-unplugged-fb9bb294-6cbe-46c1-9214-229ff766f28e {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:39:55 user nova-compute[75122]: DEBUG nova.compute.manager [req-a4c3677d-b315-44e7-a119-80f8fb22db2b req-b64b18cd-4260-40e3-bce2-b9ace4890904 service nova] [instance: ff1c5639-9d63-409a-bbd7-1de63f57b189] Received event network-vif-unplugged-fb9bb294-6cbe-46c1-9214-229ff766f28e for instance with task_state deleting. {{(pid=75122) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 09:39:55 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:39:55 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:39:56 user nova-compute[75122]: DEBUG nova.compute.manager [req-a9673b3c-9bf7-4e47-8287-f9322ee73ff2 req-bfe2a2a3-a030-40ff-948c-9e8bc4f5a67e service nova] [instance: 594aff52-4f70-48bc-9a7d-87b984e223b8] Received event network-vif-plugged-8166d3f5-5c5b-493f-8194-3bfa42d0ff32 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:39:56 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-a9673b3c-9bf7-4e47-8287-f9322ee73ff2 req-bfe2a2a3-a030-40ff-948c-9e8bc4f5a67e service nova] Acquiring lock "594aff52-4f70-48bc-9a7d-87b984e223b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:39:56 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-a9673b3c-9bf7-4e47-8287-f9322ee73ff2 req-bfe2a2a3-a030-40ff-948c-9e8bc4f5a67e service nova] Lock "594aff52-4f70-48bc-9a7d-87b984e223b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:39:56 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-a9673b3c-9bf7-4e47-8287-f9322ee73ff2 req-bfe2a2a3-a030-40ff-948c-9e8bc4f5a67e service nova] Lock "594aff52-4f70-48bc-9a7d-87b984e223b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:39:56 user nova-compute[75122]: DEBUG nova.compute.manager [req-a9673b3c-9bf7-4e47-8287-f9322ee73ff2 req-bfe2a2a3-a030-40ff-948c-9e8bc4f5a67e service nova] [instance: 594aff52-4f70-48bc-9a7d-87b984e223b8] No waiting events found dispatching network-vif-plugged-8166d3f5-5c5b-493f-8194-3bfa42d0ff32 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:39:56 user nova-compute[75122]: WARNING nova.compute.manager [req-a9673b3c-9bf7-4e47-8287-f9322ee73ff2 req-bfe2a2a3-a030-40ff-948c-9e8bc4f5a67e service nova] [instance: 594aff52-4f70-48bc-9a7d-87b984e223b8] Received unexpected event network-vif-plugged-8166d3f5-5c5b-493f-8194-3bfa42d0ff32 for instance with vm_state building and task_state spawning.
Nov 15 09:39:56 user nova-compute[75122]: DEBUG nova.compute.manager [None req-a7a3de79-bdf6-4340-9f56-a01fbf8e3fb5 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] [instance: 594aff52-4f70-48bc-9a7d-87b984e223b8] Instance event wait completed in 0 seconds for  {{(pid=75122) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 09:39:56 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-a7a3de79-bdf6-4340-9f56-a01fbf8e3fb5 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] [instance: 594aff52-4f70-48bc-9a7d-87b984e223b8] Guest created on hypervisor {{(pid=75122) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 09:39:56 user nova-compute[75122]: INFO nova.virt.libvirt.driver [-] [instance: 594aff52-4f70-48bc-9a7d-87b984e223b8] Instance spawned successfully.
Nov 15 09:39:56 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-a7a3de79-bdf6-4340-9f56-a01fbf8e3fb5 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] [instance: 594aff52-4f70-48bc-9a7d-87b984e223b8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 09:39:56 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:39:56 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-a7a3de79-bdf6-4340-9f56-a01fbf8e3fb5 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] [instance: 594aff52-4f70-48bc-9a7d-87b984e223b8] Found default for hw_cdrom_bus of ide {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:39:56 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-a7a3de79-bdf6-4340-9f56-a01fbf8e3fb5 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] [instance: 594aff52-4f70-48bc-9a7d-87b984e223b8] Found default for hw_disk_bus of virtio {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:39:56 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-a7a3de79-bdf6-4340-9f56-a01fbf8e3fb5 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] [instance: 594aff52-4f70-48bc-9a7d-87b984e223b8] Found default for hw_input_bus of None {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:39:56 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-a7a3de79-bdf6-4340-9f56-a01fbf8e3fb5 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] [instance: 594aff52-4f70-48bc-9a7d-87b984e223b8] Found default for hw_pointer_model of None {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:39:56 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-a7a3de79-bdf6-4340-9f56-a01fbf8e3fb5 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] [instance: 594aff52-4f70-48bc-9a7d-87b984e223b8] Found default for hw_video_model of virtio {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:39:56 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-a7a3de79-bdf6-4340-9f56-a01fbf8e3fb5 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] [instance: 594aff52-4f70-48bc-9a7d-87b984e223b8] Found default for hw_vif_model of virtio {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:39:56 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:39:56 user nova-compute[75122]: INFO nova.compute.manager [None req-a7a3de79-bdf6-4340-9f56-a01fbf8e3fb5 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] [instance: 594aff52-4f70-48bc-9a7d-87b984e223b8] Took 6.90 seconds to spawn the instance on the hypervisor.
Nov 15 09:39:56 user nova-compute[75122]: DEBUG nova.compute.manager [None req-a7a3de79-bdf6-4340-9f56-a01fbf8e3fb5 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] [instance: 594aff52-4f70-48bc-9a7d-87b984e223b8] Checking state {{(pid=75122) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 09:39:56 user nova-compute[75122]: INFO nova.compute.manager [None req-a7a3de79-bdf6-4340-9f56-a01fbf8e3fb5 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] [instance: 594aff52-4f70-48bc-9a7d-87b984e223b8] Took 7.69 seconds to build instance.
Nov 15 09:39:56 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-a7a3de79-bdf6-4340-9f56-a01fbf8e3fb5 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Lock "594aff52-4f70-48bc-9a7d-87b984e223b8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.804s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:39:56 user nova-compute[75122]: INFO nova.virt.libvirt.driver [-] [instance: ff1c5639-9d63-409a-bbd7-1de63f57b189] Instance destroyed successfully.
Nov 15 09:39:56 user nova-compute[75122]: DEBUG nova.objects.instance [None req-7cabcbdf-1c7a-4647-a8d4-0ecfe825f5ad tempest-VolumesNegativeTest-1736222970 tempest-VolumesNegativeTest-1736222970-project-member] Lazy-loading 'resources' on Instance uuid ff1c5639-9d63-409a-bbd7-1de63f57b189 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:39:56 user nova-compute[75122]: INFO nova.virt.libvirt.driver [-] [instance: e4d3e4f5-b48f-4fd4-9299-091469824217] Instance destroyed successfully.
Nov 15 09:39:56 user nova-compute[75122]: DEBUG nova.objects.instance [None req-6b88000d-8c07-42d8-b781-19331773200e tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] Lazy-loading 'resources' on Instance uuid e4d3e4f5-b48f-4fd4-9299-091469824217 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:39:56 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-7cabcbdf-1c7a-4647-a8d4-0ecfe825f5ad tempest-VolumesNegativeTest-1736222970 tempest-VolumesNegativeTest-1736222970-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T09:38:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1967951168',display_name='tempest-VolumesNegativeTest-instance-1967951168',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1967951168',id=22,image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T09:38:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6a012486d55e4d64abb55a8681e53608',ramdisk_id='',reservation_id='r-v4523elx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-1736222970',owner_user_name='tempest-VolumesNegativeTest-1736222970-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T09:38:12Z,user_data=None,user_id='cb654b10f5564000833bdeb1dac7da8e',uuid=ff1c5639-9d63-409a-bbd7-1de63f57b189,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fb9bb294-6cbe-46c1-9214-229ff766f28e", "address": "fa:16:3e:d1:90:86", "network": {"id": "63c86f13-cbfa-4e48-af71-0b48ffa99834", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "9c57733cb41847c0b4ad31519c382e5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb9bb294-6c", "ovs_interfaceid": "fb9bb294-6cbe-46c1-9214-229ff766f28e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 09:39:56 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-7cabcbdf-1c7a-4647-a8d4-0ecfe825f5ad tempest-VolumesNegativeTest-1736222970 tempest-VolumesNegativeTest-1736222970-project-member] Converting VIF {"id": "fb9bb294-6cbe-46c1-9214-229ff766f28e", "address": "fa:16:3e:d1:90:86", "network": {"id": "63c86f13-cbfa-4e48-af71-0b48ffa99834", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.66", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "9c57733cb41847c0b4ad31519c382e5a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb9bb294-6c", "ovs_interfaceid": "fb9bb294-6cbe-46c1-9214-229ff766f28e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 09:39:56 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-7cabcbdf-1c7a-4647-a8d4-0ecfe825f5ad tempest-VolumesNegativeTest-1736222970 tempest-VolumesNegativeTest-1736222970-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:90:86,bridge_name='br-int',has_traffic_filtering=True,id=fb9bb294-6cbe-46c1-9214-229ff766f28e,network=Network(63c86f13-cbfa-4e48-af71-0b48ffa99834),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb9bb294-6c') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 09:39:56 user nova-compute[75122]: DEBUG os_vif [None req-7cabcbdf-1c7a-4647-a8d4-0ecfe825f5ad tempest-VolumesNegativeTest-1736222970 tempest-VolumesNegativeTest-1736222970-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:90:86,bridge_name='br-int',has_traffic_filtering=True,id=fb9bb294-6cbe-46c1-9214-229ff766f28e,network=Network(63c86f13-cbfa-4e48-af71-0b48ffa99834),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb9bb294-6c') {{(pid=75122) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 09:39:56 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-6b88000d-8c07-42d8-b781-19331773200e tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T09:38:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-803024308',display_name='tempest-VolumesAdminNegativeTest-server-803024308',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-803024308',id=21,image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T09:38:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f97007ed06a04d7ebbc6cd3543a23d96',ramdisk_id='',reservation_id='r-w7tso5dz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1303240267',owner_user_name='tempest-VolumesAdminNegativeTest-1303240267-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T09:38:08Z,user_data=None,user_id='bf43ec7daef3486cbcd5e5d2831e4615',uuid=e4d3e4f5-b48f-4fd4-9299-091469824217,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a3f00d6e-75c6-4c47-b4a4-366a791c3f24", "address": "fa:16:3e:da:d5:b8", "network": {"id": "cd65f44e-6f5f-40c7-87f0-de082fb2bda9", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-635927865-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f97007ed06a04d7ebbc6cd3543a23d96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3f00d6e-75", "ovs_interfaceid": "a3f00d6e-75c6-4c47-b4a4-366a791c3f24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 09:39:56 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-6b88000d-8c07-42d8-b781-19331773200e tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] Converting VIF {"id": "a3f00d6e-75c6-4c47-b4a4-366a791c3f24", "address": "fa:16:3e:da:d5:b8", "network": {"id": "cd65f44e-6f5f-40c7-87f0-de082fb2bda9", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-635927865-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f97007ed06a04d7ebbc6cd3543a23d96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3f00d6e-75", "ovs_interfaceid": "a3f00d6e-75c6-4c47-b4a4-366a791c3f24", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 09:39:56 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-6b88000d-8c07-42d8-b781-19331773200e tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:d5:b8,bridge_name='br-int',has_traffic_filtering=True,id=a3f00d6e-75c6-4c47-b4a4-366a791c3f24,network=Network(cd65f44e-6f5f-40c7-87f0-de082fb2bda9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3f00d6e-75') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 09:39:56 user nova-compute[75122]: DEBUG os_vif [None req-6b88000d-8c07-42d8-b781-19331773200e tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:d5:b8,bridge_name='br-int',has_traffic_filtering=True,id=a3f00d6e-75c6-4c47-b4a4-366a791c3f24,network=Network(cd65f44e-6f5f-40c7-87f0-de082fb2bda9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3f00d6e-75') {{(pid=75122) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 09:39:56 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:39:56 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfb9bb294-6c, bridge=br-int, if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:39:56 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:39:56 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:39:56 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:39:56 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:39:56 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa3f00d6e-75, bridge=br-int, if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:39:56 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:39:56 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:39:56 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0cf7ac34-35f8-4c20-a897-782ec2c1e86c) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:39:56 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:39:56 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:39:56 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:39:56 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a63d12dc-42ca-4a68-a666-367113c9d093) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:39:56 user nova-compute[75122]: INFO os_vif [None req-7cabcbdf-1c7a-4647-a8d4-0ecfe825f5ad tempest-VolumesNegativeTest-1736222970 tempest-VolumesNegativeTest-1736222970-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:90:86,bridge_name='br-int',has_traffic_filtering=True,id=fb9bb294-6cbe-46c1-9214-229ff766f28e,network=Network(63c86f13-cbfa-4e48-af71-0b48ffa99834),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb9bb294-6c')
Nov 15 09:39:56 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-7cabcbdf-1c7a-4647-a8d4-0ecfe825f5ad tempest-VolumesNegativeTest-1736222970 tempest-VolumesNegativeTest-1736222970-project-member] [instance: ff1c5639-9d63-409a-bbd7-1de63f57b189] Deleting instance files /opt/stack/data/nova/instances/ff1c5639-9d63-409a-bbd7-1de63f57b189_del
Nov 15 09:39:56 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-7cabcbdf-1c7a-4647-a8d4-0ecfe825f5ad tempest-VolumesNegativeTest-1736222970 tempest-VolumesNegativeTest-1736222970-project-member] [instance: ff1c5639-9d63-409a-bbd7-1de63f57b189] Deletion of /opt/stack/data/nova/instances/ff1c5639-9d63-409a-bbd7-1de63f57b189_del complete
Nov 15 09:39:56 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:39:56 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:39:56 user nova-compute[75122]: INFO os_vif [None req-6b88000d-8c07-42d8-b781-19331773200e tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:d5:b8,bridge_name='br-int',has_traffic_filtering=True,id=a3f00d6e-75c6-4c47-b4a4-366a791c3f24,network=Network(cd65f44e-6f5f-40c7-87f0-de082fb2bda9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3f00d6e-75')
Nov 15 09:39:56 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-6b88000d-8c07-42d8-b781-19331773200e tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] [instance: e4d3e4f5-b48f-4fd4-9299-091469824217] Deleting instance files /opt/stack/data/nova/instances/e4d3e4f5-b48f-4fd4-9299-091469824217_del
Nov 15 09:39:56 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-6b88000d-8c07-42d8-b781-19331773200e tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] [instance: e4d3e4f5-b48f-4fd4-9299-091469824217] Deletion of /opt/stack/data/nova/instances/e4d3e4f5-b48f-4fd4-9299-091469824217_del complete
Nov 15 09:39:56 user nova-compute[75122]: INFO nova.compute.manager [None req-7cabcbdf-1c7a-4647-a8d4-0ecfe825f5ad tempest-VolumesNegativeTest-1736222970 tempest-VolumesNegativeTest-1736222970-project-member] [instance: ff1c5639-9d63-409a-bbd7-1de63f57b189] Took 1.13 seconds to destroy the instance on the hypervisor.
Nov 15 09:39:56 user nova-compute[75122]: DEBUG oslo.service.loopingcall [None req-7cabcbdf-1c7a-4647-a8d4-0ecfe825f5ad tempest-VolumesNegativeTest-1736222970 tempest-VolumesNegativeTest-1736222970-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75122) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 09:39:56 user nova-compute[75122]: DEBUG nova.compute.manager [-] [instance: ff1c5639-9d63-409a-bbd7-1de63f57b189] Deallocating network for instance {{(pid=75122) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 09:39:56 user nova-compute[75122]: DEBUG nova.network.neutron [-] [instance: ff1c5639-9d63-409a-bbd7-1de63f57b189] deallocate_for_instance() {{(pid=75122) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 09:39:56 user nova-compute[75122]: INFO nova.compute.manager [None req-6b88000d-8c07-42d8-b781-19331773200e tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] [instance: e4d3e4f5-b48f-4fd4-9299-091469824217] Took 0.82 seconds to destroy the instance on the hypervisor.
Nov 15 09:39:56 user nova-compute[75122]: DEBUG oslo.service.loopingcall [None req-6b88000d-8c07-42d8-b781-19331773200e tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75122) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 09:39:56 user nova-compute[75122]: DEBUG nova.compute.manager [-] [instance: e4d3e4f5-b48f-4fd4-9299-091469824217] Deallocating network for instance {{(pid=75122) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 09:39:56 user nova-compute[75122]: DEBUG nova.network.neutron [-] [instance: e4d3e4f5-b48f-4fd4-9299-091469824217] deallocate_for_instance() {{(pid=75122) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 09:39:57 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b7236e54-f686-4306-a929-e75b7e4162b8 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] [instance: c2f45f49-0bca-4ae2-bc2a-eed293143489] Calling os-brick to attach iSCSI Volume {{(pid=75122) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 09:39:57 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7236e54-f686-4306-a929-e75b7e4162b8 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffa04060b80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:984b3190-31e5-432a-9602-cedead354720', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jCqyxEzX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 09:39:57 user nova-compute[75122]: WARNING os_brick.initiator.connectors.base [None req-b7236e54-f686-4306-a929-e75b7e4162b8 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 09:39:57 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-b7236e54-f686-4306-a929-e75b7e4162b8 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 09:39:57 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-b7236e54-f686-4306-a929-e75b7e4162b8 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 09:39:57 user nova-compute[75122]: WARNING os_brick.initiator.connectors.base [None req-b7236e54-f686-4306-a929-e75b7e4162b8 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 09:39:57 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-b7236e54-f686-4306-a929-e75b7e4162b8 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:984b3190-31e5-432a-9602-cedead354720" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 09:39:57 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-b7236e54-f686-4306-a929-e75b7e4162b8 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:984b3190-31e5-432a-9602-cedead354720" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 09:39:57 user nova-compute[75122]: INFO os_brick.initiator.connectors.iscsi [None req-b7236e54-f686-4306-a929-e75b7e4162b8 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 09:39:57 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:984b3190-31e5-432a-9602-cedead354720 -p 172.16.0.220:3260 {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:39:57 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:984b3190-31e5-432a-9602-cedead354720 -p 172.16.0.220:3260" returned: 21 in 0.029s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:39:57 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff366859-8159-4ad3-82ec-b3e42c4ee812]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:39:57 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7236e54-f686-4306-a929-e75b7e4162b8 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 09:39:57 user nova-compute[75122]:  {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:39:57 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:984b3190-31e5-432a-9602-cedead354720 -p 172.16.0.220:3260 --interface default --op new {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:39:57 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:984b3190-31e5-432a-9602-cedead354720 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:39:57 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6b516ff-56c3-4733-89cb-a31a7a52a122]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:984b3190-31e5-432a-9602-cedead354720] added\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:39:57 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7236e54-f686-4306-a929-e75b7e4162b8 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:984b3190-31e5-432a-9602-cedead354720] added
Nov 15 09:39:57 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:39:57 user nova-compute[75122]: DEBUG nova.network.neutron [-] [instance: e4d3e4f5-b48f-4fd4-9299-091469824217] Updating instance_info_cache with network_info: [] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:39:57 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:984b3190-31e5-432a-9602-cedead354720 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:39:57 user nova-compute[75122]: DEBUG nova.network.neutron [-] [instance: ff1c5639-9d63-409a-bbd7-1de63f57b189] Updating instance_info_cache with network_info: [] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:39:57 user nova-compute[75122]: INFO nova.compute.manager [-] [instance: e4d3e4f5-b48f-4fd4-9299-091469824217] Took 0.50 seconds to deallocate network for instance.
Nov 15 09:39:57 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:984b3190-31e5-432a-9602-cedead354720 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:39:57 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[efc4c84b-97a6-4b7c-ad2d-64f8e7a81b6d]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:39:57 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7236e54-f686-4306-a929-e75b7e4162b8 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:39:57 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:984b3190-31e5-432a-9602-cedead354720 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:39:57 user nova-compute[75122]: INFO nova.compute.manager [-] [instance: ff1c5639-9d63-409a-bbd7-1de63f57b189] Took 0.52 seconds to deallocate network for instance.
Nov 15 09:39:57 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:984b3190-31e5-432a-9602-cedead354720 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:39:57 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9060365-edfd-4c2a-b898-58d0a38743a0]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:39:57 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7236e54-f686-4306-a929-e75b7e4162b8 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:39:57 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:984b3190-31e5-432a-9602-cedead354720 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jCqyxEzX {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:39:57 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:984b3190-31e5-432a-9602-cedead354720 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jCqyxEzX" returned: 0 in 0.021s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:39:57 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[12dd4485-425b-46ac-bafb-86163225fc62]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:39:57 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7236e54-f686-4306-a929-e75b7e4162b8 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jCqyxEzX'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:39:57 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:984b3190-31e5-432a-9602-cedead354720 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:39:57 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-7cabcbdf-1c7a-4647-a8d4-0ecfe825f5ad tempest-VolumesNegativeTest-1736222970 tempest-VolumesNegativeTest-1736222970-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:39:57 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-7cabcbdf-1c7a-4647-a8d4-0ecfe825f5ad tempest-VolumesNegativeTest-1736222970 tempest-VolumesNegativeTest-1736222970-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:39:57 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:984b3190-31e5-432a-9602-cedead354720 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.029s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:39:57 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5a04432-728b-4aba-9a2f-b2475a4f236c]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:39:57 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7236e54-f686-4306-a929-e75b7e4162b8 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:39:57 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-6b88000d-8c07-42d8-b781-19331773200e tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:39:57 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:39:57 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:39:57 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[f44fe8a0-b0fc-465a-a949-9d67ad919027]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b366dd5-506b-4ee0-9e25-990a31acf3eb (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdf09a1b-a065-4b88-815d-ee54c1c68464 (non-flash)\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:39:57 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7236e54-f686-4306-a929-e75b7e4162b8 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b366dd5-506b-4ee0-9e25-990a31acf3eb (non-flash)
Nov 15 09:39:57 user nova-compute[75122]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdf09a1b-a065-4b88-815d-ee54c1c68464 (non-flash)
Nov 15 09:39:57 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 09:39:57 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7236e54-f686-4306-a929-e75b7e4162b8 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b366dd5-506b-4ee0-9e25-990a31acf3eb (non-flash)
Nov 15 09:39:57 user nova-compute[75122]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdf09a1b-a065-4b88-815d-ee54c1c68464 (non-flash)
Nov 15 09:39:57 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 09:39:57 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:984b3190-31e5-432a-9602-cedead354720 -p 172.16.0.220:3260 --login {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:39:57 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:984b3190-31e5-432a-9602-cedead354720 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:39:57 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[21a2c7bb-2c55-4b90-9238-899488009f4f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:984b3190-31e5-432a-9602-cedead354720, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:984b3190-31e5-432a-9602-cedead354720, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:39:57 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7236e54-f686-4306-a929-e75b7e4162b8 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:984b3190-31e5-432a-9602-cedead354720, portal: 172.16.0.220,3260]
Nov 15 09:39:57 user nova-compute[75122]: Login to [iface: default, target: iqn.2010-10.org.openstack:984b3190-31e5-432a-9602-cedead354720, portal: 172.16.0.220,3260] successful.
Nov 15 09:39:57 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:39:57 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:984b3190-31e5-432a-9602-cedead354720 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:39:57 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:984b3190-31e5-432a-9602-cedead354720 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:39:57 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6d35f17-f73c-41fa-9dd8-9dcd4708ae01]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:39:57 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7236e54-f686-4306-a929-e75b7e4162b8 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:39:57 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:39:57 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:39:57 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[a18db757-0d3b-461c-bb33-3c277573932e]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b366dd5-506b-4ee0-9e25-990a31acf3eb (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdf09a1b-a065-4b88-815d-ee54c1c68464 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:984b3190-31e5-432a-9602-cedead354720 (non-flash)\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:39:57 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7236e54-f686-4306-a929-e75b7e4162b8 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b366dd5-506b-4ee0-9e25-990a31acf3eb (non-flash)
Nov 15 09:39:57 user nova-compute[75122]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdf09a1b-a065-4b88-815d-ee54c1c68464 (non-flash)
Nov 15 09:39:57 user nova-compute[75122]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:984b3190-31e5-432a-9602-cedead354720 (non-flash)
Nov 15 09:39:57 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 09:39:57 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7236e54-f686-4306-a929-e75b7e4162b8 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b366dd5-506b-4ee0-9e25-990a31acf3eb (non-flash)
Nov 15 09:39:57 user nova-compute[75122]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdf09a1b-a065-4b88-815d-ee54c1c68464 (non-flash)
Nov 15 09:39:57 user nova-compute[75122]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:984b3190-31e5-432a-9602-cedead354720 (non-flash)
Nov 15 09:39:57 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 09:39:57 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-b7236e54-f686-4306-a929-e75b7e4162b8 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:984b3190-31e5-432a-9602-cedead354720" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.354s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 09:39:57 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7236e54-f686-4306-a929-e75b7e4162b8 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Connected to 172.16.0.220:3260 {{(pid=75122) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 09:39:57 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-b7236e54-f686-4306-a929-e75b7e4162b8 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] HCTL ('34', '-', '-', 0) found on session 30 with lun 0 {{(pid=75122) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 09:39:57 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-b7236e54-f686-4306-a929-e75b7e4162b8 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75122) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 09:39:57 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:39:57 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:39:57 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[94659f15-b0ac-436a-8724-f667f8e2d535]: (4, ('- - 0', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:39:57 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-b7236e54-f686-4306-a929-e75b7e4162b8 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Searching for a device in session 30 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75122) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 09:39:57 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7236e54-f686-4306-a929-e75b7e4162b8 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:984b3190-31e5-432a-9602-cedead354720', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jCqyxEzX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75122) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 09:39:57 user nova-compute[75122]: DEBUG nova.compute.provider_tree [None req-7cabcbdf-1c7a-4647-a8d4-0ecfe825f5ad tempest-VolumesNegativeTest-1736222970 tempest-VolumesNegativeTest-1736222970-project-member] Inventory has not changed in ProviderTree for provider: 69a3da65-47be-44c6-b67c-c692b58284ef {{(pid=75122) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 09:39:57 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-7cabcbdf-1c7a-4647-a8d4-0ecfe825f5ad tempest-VolumesNegativeTest-1736222970 tempest-VolumesNegativeTest-1736222970-project-member] Inventory has not changed for provider 69a3da65-47be-44c6-b67c-c692b58284ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 09:39:57 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-7cabcbdf-1c7a-4647-a8d4-0ecfe825f5ad tempest-VolumesNegativeTest-1736222970 tempest-VolumesNegativeTest-1736222970-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.431s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:39:57 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-6b88000d-8c07-42d8-b781-19331773200e tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.418s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:39:57 user nova-compute[75122]: INFO nova.scheduler.client.report [None req-7cabcbdf-1c7a-4647-a8d4-0ecfe825f5ad tempest-VolumesNegativeTest-1736222970 tempest-VolumesNegativeTest-1736222970-project-member] Deleted allocations for instance ff1c5639-9d63-409a-bbd7-1de63f57b189
Nov 15 09:39:57 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-7cabcbdf-1c7a-4647-a8d4-0ecfe825f5ad tempest-VolumesNegativeTest-1736222970 tempest-VolumesNegativeTest-1736222970-project-member] Lock "ff1c5639-9d63-409a-bbd7-1de63f57b189" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.337s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:39:57 user nova-compute[75122]: DEBUG nova.compute.manager [req-805d71e6-2ec8-48ac-8707-3193e47925e0 req-153e01df-3dd0-49de-9221-e288b78451b5 service nova] [instance: ff1c5639-9d63-409a-bbd7-1de63f57b189] Received event network-vif-plugged-fb9bb294-6cbe-46c1-9214-229ff766f28e {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:39:57 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-805d71e6-2ec8-48ac-8707-3193e47925e0 req-153e01df-3dd0-49de-9221-e288b78451b5 service nova] Acquiring lock "ff1c5639-9d63-409a-bbd7-1de63f57b189-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:39:57 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-805d71e6-2ec8-48ac-8707-3193e47925e0 req-153e01df-3dd0-49de-9221-e288b78451b5 service nova] Lock "ff1c5639-9d63-409a-bbd7-1de63f57b189-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:39:57 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-805d71e6-2ec8-48ac-8707-3193e47925e0 req-153e01df-3dd0-49de-9221-e288b78451b5 service nova] Lock "ff1c5639-9d63-409a-bbd7-1de63f57b189-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:39:57 user nova-compute[75122]: DEBUG nova.compute.manager [req-805d71e6-2ec8-48ac-8707-3193e47925e0 req-153e01df-3dd0-49de-9221-e288b78451b5 service nova] [instance: ff1c5639-9d63-409a-bbd7-1de63f57b189] No waiting events found dispatching network-vif-plugged-fb9bb294-6cbe-46c1-9214-229ff766f28e {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:39:57 user nova-compute[75122]: WARNING nova.compute.manager [req-805d71e6-2ec8-48ac-8707-3193e47925e0 req-153e01df-3dd0-49de-9221-e288b78451b5 service nova] [instance: ff1c5639-9d63-409a-bbd7-1de63f57b189] Received unexpected event network-vif-plugged-fb9bb294-6cbe-46c1-9214-229ff766f28e for instance with vm_state deleted and task_state None.
Nov 15 09:39:57 user nova-compute[75122]: DEBUG nova.compute.manager [req-805d71e6-2ec8-48ac-8707-3193e47925e0 req-153e01df-3dd0-49de-9221-e288b78451b5 service nova] [instance: e4d3e4f5-b48f-4fd4-9299-091469824217] Received event network-vif-unplugged-a3f00d6e-75c6-4c47-b4a4-366a791c3f24 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:39:57 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-805d71e6-2ec8-48ac-8707-3193e47925e0 req-153e01df-3dd0-49de-9221-e288b78451b5 service nova] Acquiring lock "e4d3e4f5-b48f-4fd4-9299-091469824217-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:39:57 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-805d71e6-2ec8-48ac-8707-3193e47925e0 req-153e01df-3dd0-49de-9221-e288b78451b5 service nova] Lock "e4d3e4f5-b48f-4fd4-9299-091469824217-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:39:57 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-805d71e6-2ec8-48ac-8707-3193e47925e0 req-153e01df-3dd0-49de-9221-e288b78451b5 service nova] Lock "e4d3e4f5-b48f-4fd4-9299-091469824217-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:39:57 user nova-compute[75122]: DEBUG nova.compute.manager [req-805d71e6-2ec8-48ac-8707-3193e47925e0 req-153e01df-3dd0-49de-9221-e288b78451b5 service nova] [instance: e4d3e4f5-b48f-4fd4-9299-091469824217] No waiting events found dispatching network-vif-unplugged-a3f00d6e-75c6-4c47-b4a4-366a791c3f24 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:39:57 user nova-compute[75122]: WARNING nova.compute.manager [req-805d71e6-2ec8-48ac-8707-3193e47925e0 req-153e01df-3dd0-49de-9221-e288b78451b5 service nova] [instance: e4d3e4f5-b48f-4fd4-9299-091469824217] Received unexpected event network-vif-unplugged-a3f00d6e-75c6-4c47-b4a4-366a791c3f24 for instance with vm_state deleted and task_state None.
Nov 15 09:39:57 user nova-compute[75122]: DEBUG nova.compute.manager [req-805d71e6-2ec8-48ac-8707-3193e47925e0 req-153e01df-3dd0-49de-9221-e288b78451b5 service nova] [instance: e4d3e4f5-b48f-4fd4-9299-091469824217] Received event network-vif-plugged-a3f00d6e-75c6-4c47-b4a4-366a791c3f24 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:39:57 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-805d71e6-2ec8-48ac-8707-3193e47925e0 req-153e01df-3dd0-49de-9221-e288b78451b5 service nova] Acquiring lock "e4d3e4f5-b48f-4fd4-9299-091469824217-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:39:57 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-805d71e6-2ec8-48ac-8707-3193e47925e0 req-153e01df-3dd0-49de-9221-e288b78451b5 service nova] Lock "e4d3e4f5-b48f-4fd4-9299-091469824217-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:39:57 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-805d71e6-2ec8-48ac-8707-3193e47925e0 req-153e01df-3dd0-49de-9221-e288b78451b5 service nova] Lock "e4d3e4f5-b48f-4fd4-9299-091469824217-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:39:57 user nova-compute[75122]: DEBUG nova.compute.manager [req-805d71e6-2ec8-48ac-8707-3193e47925e0 req-153e01df-3dd0-49de-9221-e288b78451b5 service nova] [instance: e4d3e4f5-b48f-4fd4-9299-091469824217] No waiting events found dispatching network-vif-plugged-a3f00d6e-75c6-4c47-b4a4-366a791c3f24 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:39:57 user nova-compute[75122]: WARNING nova.compute.manager [req-805d71e6-2ec8-48ac-8707-3193e47925e0 req-153e01df-3dd0-49de-9221-e288b78451b5 service nova] [instance: e4d3e4f5-b48f-4fd4-9299-091469824217] Received unexpected event network-vif-plugged-a3f00d6e-75c6-4c47-b4a4-366a791c3f24 for instance with vm_state deleted and task_state None.
Nov 15 09:39:57 user nova-compute[75122]: DEBUG nova.compute.manager [req-805d71e6-2ec8-48ac-8707-3193e47925e0 req-153e01df-3dd0-49de-9221-e288b78451b5 service nova] [instance: e4d3e4f5-b48f-4fd4-9299-091469824217] Received event network-vif-deleted-a3f00d6e-75c6-4c47-b4a4-366a791c3f24 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:39:57 user nova-compute[75122]: DEBUG nova.compute.provider_tree [None req-6b88000d-8c07-42d8-b781-19331773200e tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] Inventory has not changed in ProviderTree for provider: 69a3da65-47be-44c6-b67c-c692b58284ef {{(pid=75122) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 09:39:57 user nova-compute[75122]: INFO nova.compute.manager [None req-334fb888-d8d1-4075-b4bc-ba91ccac2f71 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] [instance: fd9d52bb-6248-48e6-a798-6dbdaaa68cbc] Rescuing
Nov 15 09:39:58 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-334fb888-d8d1-4075-b4bc-ba91ccac2f71 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Acquiring lock "refresh_cache-fd9d52bb-6248-48e6-a798-6dbdaaa68cbc" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 09:39:58 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-334fb888-d8d1-4075-b4bc-ba91ccac2f71 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Acquired lock "refresh_cache-fd9d52bb-6248-48e6-a798-6dbdaaa68cbc" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 09:39:58 user nova-compute[75122]: DEBUG nova.network.neutron [None req-334fb888-d8d1-4075-b4bc-ba91ccac2f71 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] [instance: fd9d52bb-6248-48e6-a798-6dbdaaa68cbc] Building network info cache for instance {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 09:39:58 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-6b88000d-8c07-42d8-b781-19331773200e tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] Inventory has not changed for provider 69a3da65-47be-44c6-b67c-c692b58284ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 09:39:58 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-6b88000d-8c07-42d8-b781-19331773200e tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.396s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:39:58 user nova-compute[75122]: DEBUG nova.compute.manager [req-6345e273-b0c1-4b35-b781-3ad64c2004df req-89e3ae59-8ee6-4c7f-bb82-b53ba64deebc service nova] [instance: ff1c5639-9d63-409a-bbd7-1de63f57b189] Received event network-vif-deleted-fb9bb294-6cbe-46c1-9214-229ff766f28e {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:39:58 user nova-compute[75122]: INFO nova.scheduler.client.report [None req-6b88000d-8c07-42d8-b781-19331773200e tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] Deleted allocations for instance e4d3e4f5-b48f-4fd4-9299-091469824217
Nov 15 09:39:58 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-6b88000d-8c07-42d8-b781-19331773200e tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] Lock "e4d3e4f5-b48f-4fd4-9299-091469824217" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.370s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:39:58 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-5c222371-0daf-4916-9b5c-561f576bfa33 tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] Acquiring lock "e1afe5d4-42c0-491c-b1c7-c8debf1d5da2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:39:58 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-5c222371-0daf-4916-9b5c-561f576bfa33 tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] Lock "e1afe5d4-42c0-491c-b1c7-c8debf1d5da2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:39:58 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-b7236e54-f686-4306-a929-e75b7e4162b8 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.391s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 09:39:58 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7236e54-f686-4306-a929-e75b7e4162b8 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] <== connect_volume: return (1393ms) {'type': 'block', 'scsi_wwn': '26563663035323337', 'path': '/dev/sdc'} {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 09:39:58 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b7236e54-f686-4306-a929-e75b7e4162b8 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] [instance: c2f45f49-0bca-4ae2-bc2a-eed293143489] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26563663035323337', 'path': '/dev/sdc'} {{(pid=75122) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 09:39:58 user nova-compute[75122]: DEBUG nova.objects.instance [None req-b7236e54-f686-4306-a929-e75b7e4162b8 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Lazy-loading 'flavor' on Instance uuid c2f45f49-0bca-4ae2-bc2a-eed293143489 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:39:58 user nova-compute[75122]: DEBUG nova.compute.manager [None req-5c222371-0daf-4916-9b5c-561f576bfa33 tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] [instance: e1afe5d4-42c0-491c-b1c7-c8debf1d5da2] Starting instance... {{(pid=75122) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 09:39:58 user nova-compute[75122]: DEBUG nova.network.neutron [None req-334fb888-d8d1-4075-b4bc-ba91ccac2f71 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] [instance: fd9d52bb-6248-48e6-a798-6dbdaaa68cbc] Updating instance_info_cache with network_info: [{"id": "f6892701-aba2-4c9a-88bd-996d00963301", "address": "fa:16:3e:a5:6f:a0", "network": {"id": "c2062f64-d925-42d2-9687-5d2511ef6697", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1134087048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eeff24cb28f5481fa3941ba399ce82ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6892701-ab", "ovs_interfaceid": "f6892701-aba2-4c9a-88bd-996d00963301", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:39:58 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-334fb888-d8d1-4075-b4bc-ba91ccac2f71 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Releasing lock "refresh_cache-fd9d52bb-6248-48e6-a798-6dbdaaa68cbc" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 09:39:58 user nova-compute[75122]: DEBUG nova.virt.libvirt.guest [None req-b7236e54-f686-4306-a929-e75b7e4162b8 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 09:39:58 user nova-compute[75122]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 09:39:58 user nova-compute[75122]:   <source dev="/dev/sdc"/>
Nov 15 09:39:58 user nova-compute[75122]:   <target dev="vdb" bus="virtio"/>
Nov 15 09:39:58 user nova-compute[75122]:   <serial>984b3190-31e5-432a-9602-cedead354720</serial>
Nov 15 09:39:58 user nova-compute[75122]: </disk>
Nov 15 09:39:58 user nova-compute[75122]:  {{(pid=75122) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 09:39:58 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-5c222371-0daf-4916-9b5c-561f576bfa33 tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:39:58 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-5c222371-0daf-4916-9b5c-561f576bfa33 tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:39:58 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-5c222371-0daf-4916-9b5c-561f576bfa33 tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75122) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 09:39:58 user nova-compute[75122]: INFO nova.compute.claims [None req-5c222371-0daf-4916-9b5c-561f576bfa33 tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] [instance: e1afe5d4-42c0-491c-b1c7-c8debf1d5da2] Claim successful on node user
Nov 15 09:39:58 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:39:58 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:39:58 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-b7236e54-f686-4306-a929-e75b7e4162b8 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] No BDM found with device name vda, not building metadata. {{(pid=75122) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 09:39:58 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-b7236e54-f686-4306-a929-e75b7e4162b8 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75122) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 09:39:58 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-b7236e54-f686-4306-a929-e75b7e4162b8 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] No VIF found with MAC fa:16:3e:92:99:9d, not building metadata {{(pid=75122) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 09:39:58 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:39:58 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:39:59 user nova-compute[75122]: DEBUG nova.compute.provider_tree [None req-5c222371-0daf-4916-9b5c-561f576bfa33 tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] Inventory has not changed in ProviderTree for provider: 69a3da65-47be-44c6-b67c-c692b58284ef {{(pid=75122) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 09:39:59 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-5c222371-0daf-4916-9b5c-561f576bfa33 tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] Inventory has not changed for provider 69a3da65-47be-44c6-b67c-c692b58284ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 09:39:59 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-5c222371-0daf-4916-9b5c-561f576bfa33 tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.564s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:39:59 user nova-compute[75122]: DEBUG nova.compute.manager [None req-5c222371-0daf-4916-9b5c-561f576bfa33 tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] [instance: e1afe5d4-42c0-491c-b1c7-c8debf1d5da2] Start building networks asynchronously for instance. {{(pid=75122) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 09:39:59 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-b7236e54-f686-4306-a929-e75b7e4162b8 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Lock "c2f45f49-0bca-4ae2-bc2a-eed293143489" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.722s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:39:59 user nova-compute[75122]: DEBUG nova.compute.manager [None req-5c222371-0daf-4916-9b5c-561f576bfa33 tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] [instance: e1afe5d4-42c0-491c-b1c7-c8debf1d5da2] Allocating IP information in the background. {{(pid=75122) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 09:39:59 user nova-compute[75122]: DEBUG nova.network.neutron [None req-5c222371-0daf-4916-9b5c-561f576bfa33 tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] [instance: e1afe5d4-42c0-491c-b1c7-c8debf1d5da2] allocate_for_instance() {{(pid=75122) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 09:39:59 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-5c222371-0daf-4916-9b5c-561f576bfa33 tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] [instance: e1afe5d4-42c0-491c-b1c7-c8debf1d5da2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 09:39:59 user nova-compute[75122]: DEBUG nova.compute.manager [None req-5c222371-0daf-4916-9b5c-561f576bfa33 tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] [instance: e1afe5d4-42c0-491c-b1c7-c8debf1d5da2] Start building block device mappings for instance. {{(pid=75122) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 09:39:59 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:39:59 user nova-compute[75122]: DEBUG nova.policy [None req-5c222371-0daf-4916-9b5c-561f576bfa33 tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '35c1bd52106641e081d67e05532fbec3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21d2b24ce1a3452fa6bba669f64ffaba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75122) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 09:39:59 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:39:59 user nova-compute[75122]: INFO nova.virt.block_device [None req-5c222371-0daf-4916-9b5c-561f576bfa33 tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] [instance: e1afe5d4-42c0-491c-b1c7-c8debf1d5da2] Booting with volume 395810b1-e3c3-4660-aaaf-b6d9e7cb5a88 at /dev/vda
Nov 15 09:39:59 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:39:59 user nova-compute[75122]: INFO nova.virt.libvirt.driver [-] [instance: fd9d52bb-6248-48e6-a798-6dbdaaa68cbc] Instance destroyed successfully.
Nov 15 09:39:59 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-334fb888-d8d1-4075-b4bc-ba91ccac2f71 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] [instance: fd9d52bb-6248-48e6-a798-6dbdaaa68cbc] Attempting rescue
Nov 15 09:39:59 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-334fb888-d8d1-4075-b4bc-ba91ccac2f71 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75122) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 15 09:39:59 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-334fb888-d8d1-4075-b4bc-ba91ccac2f71 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] [instance: fd9d52bb-6248-48e6-a798-6dbdaaa68cbc] Instance directory exists: not creating {{(pid=75122) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 15 09:39:59 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-334fb888-d8d1-4075-b4bc-ba91ccac2f71 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] [instance: fd9d52bb-6248-48e6-a798-6dbdaaa68cbc] Creating image(s)
Nov 15 09:39:59 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-334fb888-d8d1-4075-b4bc-ba91ccac2f71 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Acquiring lock "/opt/stack/data/nova/instances/fd9d52bb-6248-48e6-a798-6dbdaaa68cbc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:39:59 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-334fb888-d8d1-4075-b4bc-ba91ccac2f71 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Lock "/opt/stack/data/nova/instances/fd9d52bb-6248-48e6-a798-6dbdaaa68cbc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:39:59 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-334fb888-d8d1-4075-b4bc-ba91ccac2f71 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Lock "/opt/stack/data/nova/instances/fd9d52bb-6248-48e6-a798-6dbdaaa68cbc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:39:59 user nova-compute[75122]: DEBUG nova.objects.instance [None req-334fb888-d8d1-4075-b4bc-ba91ccac2f71 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Lazy-loading 'trusted_certs' on Instance uuid fd9d52bb-6248-48e6-a798-6dbdaaa68cbc {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:39:59 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-334fb888-d8d1-4075-b4bc-ba91ccac2f71 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Acquiring lock "95d6e29f74d5408f818e32f3bc29bc8270a4c665" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:39:59 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-334fb888-d8d1-4075-b4bc-ba91ccac2f71 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Lock "95d6e29f74d5408f818e32f3bc29bc8270a4c665" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:39:59 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-334fb888-d8d1-4075-b4bc-ba91ccac2f71 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:39:59 user nova-compute[75122]: DEBUG os_brick.utils [None req-5c222371-0daf-4916-9b5c-561f576bfa33 tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 09:39:59 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:39:59 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:39:59 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:39:59 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6d847cc-f82f-4066-91e7-291f589d3c64]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:742fb64b3587\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:39:59 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:39:59 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:39:59 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[68080554-861c-4617-98c3-a24e87761c67]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:39:59 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:39:59 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:39:59 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fcd7031-1973-4a29-8171-2503b9b1170c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:39:59 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[125f8f9c-de88-47af-82c4-17f4d4ace6f6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:39:59 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-5c222371-0daf-4916-9b5c-561f576bfa33 tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] Running cmd (subprocess): nvme version {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:39:59 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-5c222371-0daf-4916-9b5c-561f576bfa33 tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] 'nvme version' failed. Not Retrying. {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 09:39:59 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5c222371-0daf-4916-9b5c-561f576bfa33 tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] nvme not present on system {{(pid=75122) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 09:39:59 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:39:59 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 09:39:59 user nova-compute[75122]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 09:39:59 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d5aa2c7-e912-4333-8a78-c683885f3901]: (4, '') {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:39:59 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.lightos [None req-5c222371-0daf-4916-9b5c-561f576bfa33 tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75122) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 09:39:59 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.lightos [None req-5c222371-0daf-4916-9b5c-561f576bfa33 tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75122) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 09:39:59 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.lightos [None req-5c222371-0daf-4916-9b5c-561f576bfa33 tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] LIGHTOS: no hostnqn found. {{(pid=75122) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 09:39:59 user nova-compute[75122]: DEBUG os_brick.utils [None req-5c222371-0daf-4916-9b5c-561f576bfa33 tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:742fb64b3587', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 09:39:59 user nova-compute[75122]: DEBUG nova.virt.block_device [None req-5c222371-0daf-4916-9b5c-561f576bfa33 tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] [instance: e1afe5d4-42c0-491c-b1c7-c8debf1d5da2] Updating existing volume attachment record: 2ba0121d-1824-466a-b61c-33866b50d3e1 {{(pid=75122) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 09:39:59 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:39:59 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-334fb888-d8d1-4075-b4bc-ba91ccac2f71 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json" returned: 0 in 0.245s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:39:59 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-334fb888-d8d1-4075-b4bc-ba91ccac2f71 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665,backing_fmt=raw /opt/stack/data/nova/instances/fd9d52bb-6248-48e6-a798-6dbdaaa68cbc/disk.rescue {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:39:59 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-334fb888-d8d1-4075-b4bc-ba91ccac2f71 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665,backing_fmt=raw /opt/stack/data/nova/instances/fd9d52bb-6248-48e6-a798-6dbdaaa68cbc/disk.rescue" returned: 0 in 0.051s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:39:59 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-334fb888-d8d1-4075-b4bc-ba91ccac2f71 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Lock "95d6e29f74d5408f818e32f3bc29bc8270a4c665" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.303s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:39:59 user nova-compute[75122]: DEBUG nova.objects.instance [None req-334fb888-d8d1-4075-b4bc-ba91ccac2f71 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Lazy-loading 'migration_context' on Instance uuid fd9d52bb-6248-48e6-a798-6dbdaaa68cbc {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:39:59 user nova-compute[75122]: DEBUG nova.objects.base [None req-334fb888-d8d1-4075-b4bc-ba91ccac2f71 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Object Instance<fd9d52bb-6248-48e6-a798-6dbdaaa68cbc> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75122) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 09:39:59 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-334fb888-d8d1-4075-b4bc-ba91ccac2f71 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] [instance: fd9d52bb-6248-48e6-a798-6dbdaaa68cbc] Created local disks {{(pid=75122) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 09:39:59 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-334fb888-d8d1-4075-b4bc-ba91ccac2f71 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] [instance: fd9d52bb-6248-48e6-a798-6dbdaaa68cbc] Start _get_guest_xml network_info=[{"id": "f6892701-aba2-4c9a-88bd-996d00963301", "address": "fa:16:3e:a5:6f:a0", "network": {"id": "c2062f64-d925-42d2-9687-5d2511ef6697", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1134087048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1134087048-network", "vif_mac": "fa:16:3e:a5:6f:a0"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eeff24cb28f5481fa3941ba399ce82ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6892701-ab", "ovs_interfaceid": "f6892701-aba2-4c9a-88bd-996d00963301", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T09:26:31Z,direct_url=<?>,disk_format='qcow2',id=5e862cfe-47b8-4725-8292-65761ee6d0f5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9c57733cb41847c0b4ad31519c382e5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T09:26:33Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '5e862cfe-47b8-4725-8292-65761ee6d0f5', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75122) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 09:39:59 user nova-compute[75122]: DEBUG nova.objects.instance [None req-334fb888-d8d1-4075-b4bc-ba91ccac2f71 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Lazy-loading 'resources' on Instance uuid fd9d52bb-6248-48e6-a798-6dbdaaa68cbc {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:39:59 user nova-compute[75122]: DEBUG nova.objects.base [None req-334fb888-d8d1-4075-b4bc-ba91ccac2f71 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Object Instance<fd9d52bb-6248-48e6-a798-6dbdaaa68cbc> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75122) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 09:39:59 user nova-compute[75122]: DEBUG nova.objects.instance [None req-334fb888-d8d1-4075-b4bc-ba91ccac2f71 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Lazy-loading 'numa_topology' on Instance uuid fd9d52bb-6248-48e6-a798-6dbdaaa68cbc {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:39:59 user nova-compute[75122]: DEBUG nova.objects.base [None req-334fb888-d8d1-4075-b4bc-ba91ccac2f71 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Object Instance<fd9d52bb-6248-48e6-a798-6dbdaaa68cbc> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75122) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 09:39:59 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-334fb888-d8d1-4075-b4bc-ba91ccac2f71 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 09:39:59 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-334fb888-d8d1-4075-b4bc-ba91ccac2f71 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 09:39:59 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-334fb888-d8d1-4075-b4bc-ba91ccac2f71 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75122) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 09:39:59 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-334fb888-d8d1-4075-b4bc-ba91ccac2f71 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] CPU controller missing on host. {{(pid=75122) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 09:39:59 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-334fb888-d8d1-4075-b4bc-ba91ccac2f71 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75122) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 09:39:59 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-334fb888-d8d1-4075-b4bc-ba91ccac2f71 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] CPU controller found on host. {{(pid=75122) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 09:39:59 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-334fb888-d8d1-4075-b4bc-ba91ccac2f71 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75122) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 09:39:59 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-334fb888-d8d1-4075-b4bc-ba91ccac2f71 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T09:26:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T09:26:31Z,direct_url=<?>,disk_format='qcow2',id=5e862cfe-47b8-4725-8292-65761ee6d0f5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9c57733cb41847c0b4ad31519c382e5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T09:26:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 09:39:59 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-334fb888-d8d1-4075-b4bc-ba91ccac2f71 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Flavor limits 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 09:39:59 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-334fb888-d8d1-4075-b4bc-ba91ccac2f71 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Image limits 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 09:39:59 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-334fb888-d8d1-4075-b4bc-ba91ccac2f71 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Flavor pref 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 09:39:59 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-334fb888-d8d1-4075-b4bc-ba91ccac2f71 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Image pref 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 09:39:59 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-334fb888-d8d1-4075-b4bc-ba91ccac2f71 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 09:39:59 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-334fb888-d8d1-4075-b4bc-ba91ccac2f71 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 09:39:59 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-334fb888-d8d1-4075-b4bc-ba91ccac2f71 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75122) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 09:39:59 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-334fb888-d8d1-4075-b4bc-ba91ccac2f71 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Got 1 possible topologies {{(pid=75122) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 09:39:59 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-334fb888-d8d1-4075-b4bc-ba91ccac2f71 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 09:39:59 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-334fb888-d8d1-4075-b4bc-ba91ccac2f71 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 09:39:59 user nova-compute[75122]: DEBUG nova.objects.instance [None req-334fb888-d8d1-4075-b4bc-ba91ccac2f71 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Lazy-loading 'vcpu_model' on Instance uuid fd9d52bb-6248-48e6-a798-6dbdaaa68cbc {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:39:59 user nova-compute[75122]: DEBUG nova.objects.base [None req-334fb888-d8d1-4075-b4bc-ba91ccac2f71 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Object Instance<fd9d52bb-6248-48e6-a798-6dbdaaa68cbc> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75122) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 09:39:59 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-334fb888-d8d1-4075-b4bc-ba91ccac2f71 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T09:35:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1046243250',display_name='tempest-ServerRescueNegativeTestJSON-server-1046243250',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1046243250',id=16,image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T09:35:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='eeff24cb28f5481fa3941ba399ce82ff',ramdisk_id='',reservation_id='r-wmbthb7r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-59965354',owner_user_name='tempest-ServerRescueNegativeTestJSON-59965354-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T09:35:24Z,user_data=None,user_id='d05ef35b07ba45afb142f406d418d8d4',uuid=fd9d52bb-6248-48e6-a798-6dbdaaa68cbc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f6892701-aba2-4c9a-88bd-996d00963301", "address": "fa:16:3e:a5:6f:a0", "network": {"id": "c2062f64-d925-42d2-9687-5d2511ef6697", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1134087048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1134087048-network", "vif_mac": "fa:16:3e:a5:6f:a0"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eeff24cb28f5481fa3941ba399ce82ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6892701-ab", "ovs_interfaceid": "f6892701-aba2-4c9a-88bd-996d00963301", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75122) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 09:39:59 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-334fb888-d8d1-4075-b4bc-ba91ccac2f71 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Converting VIF {"id": "f6892701-aba2-4c9a-88bd-996d00963301", "address": "fa:16:3e:a5:6f:a0", "network": {"id": "c2062f64-d925-42d2-9687-5d2511ef6697", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1134087048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1134087048-network", "vif_mac": "fa:16:3e:a5:6f:a0"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eeff24cb28f5481fa3941ba399ce82ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6892701-ab", "ovs_interfaceid": "f6892701-aba2-4c9a-88bd-996d00963301", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 09:39:59 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-334fb888-d8d1-4075-b4bc-ba91ccac2f71 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a5:6f:a0,bridge_name='br-int',has_traffic_filtering=True,id=f6892701-aba2-4c9a-88bd-996d00963301,network=Network(c2062f64-d925-42d2-9687-5d2511ef6697),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6892701-ab') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 09:39:59 user nova-compute[75122]: DEBUG nova.objects.instance [None req-334fb888-d8d1-4075-b4bc-ba91ccac2f71 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Lazy-loading 'pci_devices' on Instance uuid fd9d52bb-6248-48e6-a798-6dbdaaa68cbc {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:39:59 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:39:59 user nova-compute[75122]: DEBUG nova.objects.base [None req-334fb888-d8d1-4075-b4bc-ba91ccac2f71 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Object Instance<fd9d52bb-6248-48e6-a798-6dbdaaa68cbc> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75122) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 09:39:59 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-334fb888-d8d1-4075-b4bc-ba91ccac2f71 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] [instance: fd9d52bb-6248-48e6-a798-6dbdaaa68cbc] End _get_guest_xml xml=<domain type="kvm">
Nov 15 09:39:59 user nova-compute[75122]:   <uuid>fd9d52bb-6248-48e6-a798-6dbdaaa68cbc</uuid>
Nov 15 09:39:59 user nova-compute[75122]:   <name>instance-00000010</name>
Nov 15 09:39:59 user nova-compute[75122]:   <memory>524288</memory>
Nov 15 09:39:59 user nova-compute[75122]:   <vcpu>1</vcpu>
Nov 15 09:39:59 user nova-compute[75122]:   <metadata>
Nov 15 09:39:59 user nova-compute[75122]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 09:39:59 user nova-compute[75122]:       <nova:package version="0.0.0"/>
Nov 15 09:39:59 user nova-compute[75122]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1046243250</nova:name>
Nov 15 09:39:59 user nova-compute[75122]:       <nova:creationTime>2023-11-15 09:39:59</nova:creationTime>
Nov 15 09:39:59 user nova-compute[75122]:       <nova:flavor name="m1.tiny">
Nov 15 09:39:59 user nova-compute[75122]:         <nova:memory>512</nova:memory>
Nov 15 09:39:59 user nova-compute[75122]:         <nova:disk>1</nova:disk>
Nov 15 09:39:59 user nova-compute[75122]:         <nova:swap>0</nova:swap>
Nov 15 09:39:59 user nova-compute[75122]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 09:39:59 user nova-compute[75122]:         <nova:vcpus>1</nova:vcpus>
Nov 15 09:39:59 user nova-compute[75122]:       </nova:flavor>
Nov 15 09:39:59 user nova-compute[75122]:       <nova:owner>
Nov 15 09:39:59 user nova-compute[75122]:         <nova:user uuid="d05ef35b07ba45afb142f406d418d8d4">tempest-ServerRescueNegativeTestJSON-59965354-project-member</nova:user>
Nov 15 09:39:59 user nova-compute[75122]:         <nova:project uuid="eeff24cb28f5481fa3941ba399ce82ff">tempest-ServerRescueNegativeTestJSON-59965354</nova:project>
Nov 15 09:39:59 user nova-compute[75122]:       </nova:owner>
Nov 15 09:39:59 user nova-compute[75122]:       <nova:root type="image" uuid="5e862cfe-47b8-4725-8292-65761ee6d0f5"/>
Nov 15 09:39:59 user nova-compute[75122]:       <nova:ports>
Nov 15 09:39:59 user nova-compute[75122]:         <nova:port uuid="f6892701-aba2-4c9a-88bd-996d00963301">
Nov 15 09:39:59 user nova-compute[75122]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 15 09:39:59 user nova-compute[75122]:         </nova:port>
Nov 15 09:39:59 user nova-compute[75122]:       </nova:ports>
Nov 15 09:39:59 user nova-compute[75122]:     </nova:instance>
Nov 15 09:39:59 user nova-compute[75122]:   </metadata>
Nov 15 09:39:59 user nova-compute[75122]:   <sysinfo type="smbios">
Nov 15 09:39:59 user nova-compute[75122]:     <system>
Nov 15 09:39:59 user nova-compute[75122]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 09:39:59 user nova-compute[75122]:       <entry name="product">OpenStack Nova</entry>
Nov 15 09:39:59 user nova-compute[75122]:       <entry name="version">0.0.0</entry>
Nov 15 09:39:59 user nova-compute[75122]:       <entry name="serial">fd9d52bb-6248-48e6-a798-6dbdaaa68cbc</entry>
Nov 15 09:39:59 user nova-compute[75122]:       <entry name="uuid">fd9d52bb-6248-48e6-a798-6dbdaaa68cbc</entry>
Nov 15 09:39:59 user nova-compute[75122]:       <entry name="family">Virtual Machine</entry>
Nov 15 09:39:59 user nova-compute[75122]:     </system>
Nov 15 09:39:59 user nova-compute[75122]:   </sysinfo>
Nov 15 09:39:59 user nova-compute[75122]:   <os>
Nov 15 09:39:59 user nova-compute[75122]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 09:39:59 user nova-compute[75122]:     <smbios mode="sysinfo"/>
Nov 15 09:39:59 user nova-compute[75122]:   </os>
Nov 15 09:39:59 user nova-compute[75122]:   <features>
Nov 15 09:39:59 user nova-compute[75122]:     <acpi/>
Nov 15 09:39:59 user nova-compute[75122]:     <apic/>
Nov 15 09:39:59 user nova-compute[75122]:     <vmcoreinfo/>
Nov 15 09:39:59 user nova-compute[75122]:   </features>
Nov 15 09:39:59 user nova-compute[75122]:   <clock offset="utc">
Nov 15 09:39:59 user nova-compute[75122]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 09:39:59 user nova-compute[75122]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 09:39:59 user nova-compute[75122]:     <timer name="hpet" present="no"/>
Nov 15 09:39:59 user nova-compute[75122]:   </clock>
Nov 15 09:39:59 user nova-compute[75122]:   <cpu mode="custom" match="exact">
Nov 15 09:39:59 user nova-compute[75122]:     <model>Nehalem</model>
Nov 15 09:39:59 user nova-compute[75122]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 09:39:59 user nova-compute[75122]:   </cpu>
Nov 15 09:39:59 user nova-compute[75122]:   <devices>
Nov 15 09:39:59 user nova-compute[75122]:     <disk type="file" device="disk">
Nov 15 09:39:59 user nova-compute[75122]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 09:39:59 user nova-compute[75122]:       <source file="/opt/stack/data/nova/instances/fd9d52bb-6248-48e6-a798-6dbdaaa68cbc/disk.rescue"/>
Nov 15 09:39:59 user nova-compute[75122]:       <target dev="vda" bus="virtio"/>
Nov 15 09:39:59 user nova-compute[75122]:     </disk>
Nov 15 09:39:59 user nova-compute[75122]:     <disk type="file" device="disk">
Nov 15 09:39:59 user nova-compute[75122]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 09:39:59 user nova-compute[75122]:       <source file="/opt/stack/data/nova/instances/fd9d52bb-6248-48e6-a798-6dbdaaa68cbc/disk"/>
Nov 15 09:39:59 user nova-compute[75122]:       <target dev="vdb" bus="virtio"/>
Nov 15 09:39:59 user nova-compute[75122]:     </disk>
Nov 15 09:39:59 user nova-compute[75122]:     <interface type="ethernet">
Nov 15 09:39:59 user nova-compute[75122]:       <mac address="fa:16:3e:a5:6f:a0"/>
Nov 15 09:39:59 user nova-compute[75122]:       <model type="virtio"/>
Nov 15 09:39:59 user nova-compute[75122]:       <mtu size="1442"/>
Nov 15 09:39:59 user nova-compute[75122]:       <target dev="tapf6892701-ab"/>
Nov 15 09:39:59 user nova-compute[75122]:     </interface>
Nov 15 09:39:59 user nova-compute[75122]:     <serial type="pty">
Nov 15 09:39:59 user nova-compute[75122]:       <log file="/opt/stack/data/nova/instances/fd9d52bb-6248-48e6-a798-6dbdaaa68cbc/console.log" append="off"/>
Nov 15 09:39:59 user nova-compute[75122]:     </serial>
Nov 15 09:39:59 user nova-compute[75122]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 09:39:59 user nova-compute[75122]:     <video>
Nov 15 09:39:59 user nova-compute[75122]:       <model type="virtio"/>
Nov 15 09:39:59 user nova-compute[75122]:     </video>
Nov 15 09:39:59 user nova-compute[75122]:     <rng model="virtio">
Nov 15 09:39:59 user nova-compute[75122]:       <backend model="random">/dev/urandom</backend>
Nov 15 09:39:59 user nova-compute[75122]:     </rng>
Nov 15 09:39:59 user nova-compute[75122]:     <controller type="usb" index="0" model="none"/>
Nov 15 09:39:59 user nova-compute[75122]:     <memballoon model="virtio">
Nov 15 09:39:59 user nova-compute[75122]:       <stats period="10"/>
Nov 15 09:39:59 user nova-compute[75122]:     </memballoon>
Nov 15 09:39:59 user nova-compute[75122]:   </devices>
Nov 15 09:39:59 user nova-compute[75122]: </domain>
Nov 15 09:39:59 user nova-compute[75122]:  {{(pid=75122) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 09:39:59 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:39:59 user nova-compute[75122]: INFO nova.virt.libvirt.driver [-] [instance: fd9d52bb-6248-48e6-a798-6dbdaaa68cbc] Instance destroyed successfully.
Nov 15 09:39:59 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-334fb888-d8d1-4075-b4bc-ba91ccac2f71 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] No BDM found with device name vda, not building metadata. {{(pid=75122) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 09:39:59 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-334fb888-d8d1-4075-b4bc-ba91ccac2f71 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75122) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 09:39:59 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-334fb888-d8d1-4075-b4bc-ba91ccac2f71 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] No VIF found with MAC fa:16:3e:a5:6f:a0, not building metadata {{(pid=75122) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 09:40:00 user nova-compute[75122]: DEBUG nova.compute.manager [req-79e00c2c-e165-4573-9b3e-b6910197178f req-cb39da39-7818-44af-b2d5-4641be6132bc service nova] [instance: fd9d52bb-6248-48e6-a798-6dbdaaa68cbc] Received event network-vif-unplugged-f6892701-aba2-4c9a-88bd-996d00963301 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:40:00 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-79e00c2c-e165-4573-9b3e-b6910197178f req-cb39da39-7818-44af-b2d5-4641be6132bc service nova] Acquiring lock "fd9d52bb-6248-48e6-a798-6dbdaaa68cbc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:40:00 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-79e00c2c-e165-4573-9b3e-b6910197178f req-cb39da39-7818-44af-b2d5-4641be6132bc service nova] Lock "fd9d52bb-6248-48e6-a798-6dbdaaa68cbc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:40:00 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-79e00c2c-e165-4573-9b3e-b6910197178f req-cb39da39-7818-44af-b2d5-4641be6132bc service nova] Lock "fd9d52bb-6248-48e6-a798-6dbdaaa68cbc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:40:00 user nova-compute[75122]: DEBUG nova.compute.manager [req-79e00c2c-e165-4573-9b3e-b6910197178f req-cb39da39-7818-44af-b2d5-4641be6132bc service nova] [instance: fd9d52bb-6248-48e6-a798-6dbdaaa68cbc] No waiting events found dispatching network-vif-unplugged-f6892701-aba2-4c9a-88bd-996d00963301 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:40:00 user nova-compute[75122]: WARNING nova.compute.manager [req-79e00c2c-e165-4573-9b3e-b6910197178f req-cb39da39-7818-44af-b2d5-4641be6132bc service nova] [instance: fd9d52bb-6248-48e6-a798-6dbdaaa68cbc] Received unexpected event network-vif-unplugged-f6892701-aba2-4c9a-88bd-996d00963301 for instance with vm_state active and task_state rescuing.
Nov 15 09:40:00 user nova-compute[75122]: DEBUG nova.compute.manager [req-79e00c2c-e165-4573-9b3e-b6910197178f req-cb39da39-7818-44af-b2d5-4641be6132bc service nova] [instance: fd9d52bb-6248-48e6-a798-6dbdaaa68cbc] Received event network-vif-plugged-f6892701-aba2-4c9a-88bd-996d00963301 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:40:00 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-79e00c2c-e165-4573-9b3e-b6910197178f req-cb39da39-7818-44af-b2d5-4641be6132bc service nova] Acquiring lock "fd9d52bb-6248-48e6-a798-6dbdaaa68cbc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:40:00 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-79e00c2c-e165-4573-9b3e-b6910197178f req-cb39da39-7818-44af-b2d5-4641be6132bc service nova] Lock "fd9d52bb-6248-48e6-a798-6dbdaaa68cbc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:40:00 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-79e00c2c-e165-4573-9b3e-b6910197178f req-cb39da39-7818-44af-b2d5-4641be6132bc service nova] Lock "fd9d52bb-6248-48e6-a798-6dbdaaa68cbc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:40:00 user nova-compute[75122]: DEBUG nova.compute.manager [req-79e00c2c-e165-4573-9b3e-b6910197178f req-cb39da39-7818-44af-b2d5-4641be6132bc service nova] [instance: fd9d52bb-6248-48e6-a798-6dbdaaa68cbc] No waiting events found dispatching network-vif-plugged-f6892701-aba2-4c9a-88bd-996d00963301 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:40:00 user nova-compute[75122]: WARNING nova.compute.manager [req-79e00c2c-e165-4573-9b3e-b6910197178f req-cb39da39-7818-44af-b2d5-4641be6132bc service nova] [instance: fd9d52bb-6248-48e6-a798-6dbdaaa68cbc] Received unexpected event network-vif-plugged-f6892701-aba2-4c9a-88bd-996d00963301 for instance with vm_state active and task_state rescuing.
Nov 15 09:40:00 user nova-compute[75122]: DEBUG nova.compute.manager [req-79e00c2c-e165-4573-9b3e-b6910197178f req-cb39da39-7818-44af-b2d5-4641be6132bc service nova] [instance: fd9d52bb-6248-48e6-a798-6dbdaaa68cbc] Received event network-vif-plugged-f6892701-aba2-4c9a-88bd-996d00963301 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:40:00 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-79e00c2c-e165-4573-9b3e-b6910197178f req-cb39da39-7818-44af-b2d5-4641be6132bc service nova] Acquiring lock "fd9d52bb-6248-48e6-a798-6dbdaaa68cbc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:40:00 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-79e00c2c-e165-4573-9b3e-b6910197178f req-cb39da39-7818-44af-b2d5-4641be6132bc service nova] Lock "fd9d52bb-6248-48e6-a798-6dbdaaa68cbc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:40:00 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-79e00c2c-e165-4573-9b3e-b6910197178f req-cb39da39-7818-44af-b2d5-4641be6132bc service nova] Lock "fd9d52bb-6248-48e6-a798-6dbdaaa68cbc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:40:00 user nova-compute[75122]: DEBUG nova.compute.manager [req-79e00c2c-e165-4573-9b3e-b6910197178f req-cb39da39-7818-44af-b2d5-4641be6132bc service nova] [instance: fd9d52bb-6248-48e6-a798-6dbdaaa68cbc] No waiting events found dispatching network-vif-plugged-f6892701-aba2-4c9a-88bd-996d00963301 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:40:00 user nova-compute[75122]: WARNING nova.compute.manager [req-79e00c2c-e165-4573-9b3e-b6910197178f req-cb39da39-7818-44af-b2d5-4641be6132bc service nova] [instance: fd9d52bb-6248-48e6-a798-6dbdaaa68cbc] Received unexpected event network-vif-plugged-f6892701-aba2-4c9a-88bd-996d00963301 for instance with vm_state active and task_state rescuing.
Nov 15 09:40:00 user nova-compute[75122]: DEBUG nova.compute.manager [req-79e00c2c-e165-4573-9b3e-b6910197178f req-cb39da39-7818-44af-b2d5-4641be6132bc service nova] [instance: fd9d52bb-6248-48e6-a798-6dbdaaa68cbc] Received event network-vif-plugged-f6892701-aba2-4c9a-88bd-996d00963301 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:40:00 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-79e00c2c-e165-4573-9b3e-b6910197178f req-cb39da39-7818-44af-b2d5-4641be6132bc service nova] Acquiring lock "fd9d52bb-6248-48e6-a798-6dbdaaa68cbc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:40:00 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-79e00c2c-e165-4573-9b3e-b6910197178f req-cb39da39-7818-44af-b2d5-4641be6132bc service nova] Lock "fd9d52bb-6248-48e6-a798-6dbdaaa68cbc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:40:00 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-79e00c2c-e165-4573-9b3e-b6910197178f req-cb39da39-7818-44af-b2d5-4641be6132bc service nova] Lock "fd9d52bb-6248-48e6-a798-6dbdaaa68cbc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:40:00 user nova-compute[75122]: DEBUG nova.compute.manager [req-79e00c2c-e165-4573-9b3e-b6910197178f req-cb39da39-7818-44af-b2d5-4641be6132bc service nova] [instance: fd9d52bb-6248-48e6-a798-6dbdaaa68cbc] No waiting events found dispatching network-vif-plugged-f6892701-aba2-4c9a-88bd-996d00963301 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:40:00 user nova-compute[75122]: WARNING nova.compute.manager [req-79e00c2c-e165-4573-9b3e-b6910197178f req-cb39da39-7818-44af-b2d5-4641be6132bc service nova] [instance: fd9d52bb-6248-48e6-a798-6dbdaaa68cbc] Received unexpected event network-vif-plugged-f6892701-aba2-4c9a-88bd-996d00963301 for instance with vm_state active and task_state rescuing.
Nov 15 09:40:00 user nova-compute[75122]: DEBUG nova.network.neutron [None req-5c222371-0daf-4916-9b5c-561f576bfa33 tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] [instance: e1afe5d4-42c0-491c-b1c7-c8debf1d5da2] Successfully created port: f2eacefa-263d-4e6f-af4e-3ab293748b4a {{(pid=75122) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 09:40:00 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:40:01 user nova-compute[75122]: DEBUG nova.network.neutron [None req-5c222371-0daf-4916-9b5c-561f576bfa33 tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] [instance: e1afe5d4-42c0-491c-b1c7-c8debf1d5da2] Successfully updated port: f2eacefa-263d-4e6f-af4e-3ab293748b4a {{(pid=75122) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 09:40:01 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-5c222371-0daf-4916-9b5c-561f576bfa33 tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] Acquiring lock "refresh_cache-e1afe5d4-42c0-491c-b1c7-c8debf1d5da2" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 09:40:01 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-5c222371-0daf-4916-9b5c-561f576bfa33 tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] Acquired lock "refresh_cache-e1afe5d4-42c0-491c-b1c7-c8debf1d5da2" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 09:40:01 user nova-compute[75122]: DEBUG nova.network.neutron [None req-5c222371-0daf-4916-9b5c-561f576bfa33 tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] [instance: e1afe5d4-42c0-491c-b1c7-c8debf1d5da2] Building network info cache for instance {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 09:40:01 user nova-compute[75122]: DEBUG nova.network.neutron [None req-5c222371-0daf-4916-9b5c-561f576bfa33 tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] [instance: e1afe5d4-42c0-491c-b1c7-c8debf1d5da2] Instance cache missing network info. {{(pid=75122) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 09:40:01 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-74c7dcc5-236a-40fa-a801-73b6300c43d1 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Acquiring lock "c2f45f49-0bca-4ae2-bc2a-eed293143489" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:40:01 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-74c7dcc5-236a-40fa-a801-73b6300c43d1 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Lock "c2f45f49-0bca-4ae2-bc2a-eed293143489" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:40:01 user nova-compute[75122]: INFO nova.compute.manager [None req-74c7dcc5-236a-40fa-a801-73b6300c43d1 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] [instance: c2f45f49-0bca-4ae2-bc2a-eed293143489] Detaching volume 984b3190-31e5-432a-9602-cedead354720
Nov 15 09:40:01 user nova-compute[75122]: INFO nova.virt.block_device [None req-74c7dcc5-236a-40fa-a801-73b6300c43d1 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] [instance: c2f45f49-0bca-4ae2-bc2a-eed293143489] Attempting to driver detach volume 984b3190-31e5-432a-9602-cedead354720 from mountpoint /dev/vdb
Nov 15 09:40:01 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-74c7dcc5-236a-40fa-a801-73b6300c43d1 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Attempting to detach device vdb from instance c2f45f49-0bca-4ae2-bc2a-eed293143489 from the persistent domain config. {{(pid=75122) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 09:40:01 user nova-compute[75122]: DEBUG nova.virt.libvirt.guest [None req-74c7dcc5-236a-40fa-a801-73b6300c43d1 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 09:40:01 user nova-compute[75122]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 09:40:01 user nova-compute[75122]:   <source dev="/dev/sdc"/>
Nov 15 09:40:01 user nova-compute[75122]:   <target dev="vdb" bus="virtio"/>
Nov 15 09:40:01 user nova-compute[75122]:   <serial>984b3190-31e5-432a-9602-cedead354720</serial>
Nov 15 09:40:01 user nova-compute[75122]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 09:40:01 user nova-compute[75122]: </disk>
Nov 15 09:40:01 user nova-compute[75122]:  {{(pid=75122) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 09:40:01 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:40:01 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-74c7dcc5-236a-40fa-a801-73b6300c43d1 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Successfully detached device vdb from instance c2f45f49-0bca-4ae2-bc2a-eed293143489 from the persistent domain config.
Nov 15 09:40:01 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-74c7dcc5-236a-40fa-a801-73b6300c43d1 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c2f45f49-0bca-4ae2-bc2a-eed293143489 from the live domain config. {{(pid=75122) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 09:40:01 user nova-compute[75122]: DEBUG nova.virt.libvirt.guest [None req-74c7dcc5-236a-40fa-a801-73b6300c43d1 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 09:40:01 user nova-compute[75122]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 09:40:01 user nova-compute[75122]:   <source dev="/dev/sdc"/>
Nov 15 09:40:01 user nova-compute[75122]:   <target dev="vdb" bus="virtio"/>
Nov 15 09:40:01 user nova-compute[75122]:   <serial>984b3190-31e5-432a-9602-cedead354720</serial>
Nov 15 09:40:01 user nova-compute[75122]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 09:40:01 user nova-compute[75122]: </disk>
Nov 15 09:40:01 user nova-compute[75122]:  {{(pid=75122) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 09:40:01 user nova-compute[75122]: DEBUG nova.network.neutron [None req-5c222371-0daf-4916-9b5c-561f576bfa33 tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] [instance: e1afe5d4-42c0-491c-b1c7-c8debf1d5da2] Updating instance_info_cache with network_info: [{"id": "f2eacefa-263d-4e6f-af4e-3ab293748b4a", "address": "fa:16:3e:f7:23:f8", "network": {"id": "0b825d42-d480-4526-a659-e1a5c5fbb53c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1640851308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21d2b24ce1a3452fa6bba669f64ffaba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2eacefa-26", "ovs_interfaceid": "f2eacefa-263d-4e6f-af4e-3ab293748b4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:40:01 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-5c222371-0daf-4916-9b5c-561f576bfa33 tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] Releasing lock "refresh_cache-e1afe5d4-42c0-491c-b1c7-c8debf1d5da2" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 09:40:01 user nova-compute[75122]: DEBUG nova.compute.manager [None req-5c222371-0daf-4916-9b5c-561f576bfa33 tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] [instance: e1afe5d4-42c0-491c-b1c7-c8debf1d5da2] Instance network_info: |[{"id": "f2eacefa-263d-4e6f-af4e-3ab293748b4a", "address": "fa:16:3e:f7:23:f8", "network": {"id": "0b825d42-d480-4526-a659-e1a5c5fbb53c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1640851308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21d2b24ce1a3452fa6bba669f64ffaba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2eacefa-26", "ovs_interfaceid": "f2eacefa-263d-4e6f-af4e-3ab293748b4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75122) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 09:40:01 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:40:01 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:40:01 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:40:01 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:40:02 user nova-compute[75122]: DEBUG nova.compute.manager [req-c7534ba5-af43-44e4-aca8-941e4fcc9650 req-068ef3f8-2836-4890-8c31-986063daaae0 service nova] [instance: fd9d52bb-6248-48e6-a798-6dbdaaa68cbc] Received event network-vif-unplugged-f6892701-aba2-4c9a-88bd-996d00963301 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:40:02 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-c7534ba5-af43-44e4-aca8-941e4fcc9650 req-068ef3f8-2836-4890-8c31-986063daaae0 service nova] Acquiring lock "fd9d52bb-6248-48e6-a798-6dbdaaa68cbc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:40:02 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-c7534ba5-af43-44e4-aca8-941e4fcc9650 req-068ef3f8-2836-4890-8c31-986063daaae0 service nova] Lock "fd9d52bb-6248-48e6-a798-6dbdaaa68cbc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:40:02 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-c7534ba5-af43-44e4-aca8-941e4fcc9650 req-068ef3f8-2836-4890-8c31-986063daaae0 service nova] Lock "fd9d52bb-6248-48e6-a798-6dbdaaa68cbc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:40:02 user nova-compute[75122]: DEBUG nova.compute.manager [req-c7534ba5-af43-44e4-aca8-941e4fcc9650 req-068ef3f8-2836-4890-8c31-986063daaae0 service nova] [instance: fd9d52bb-6248-48e6-a798-6dbdaaa68cbc] No waiting events found dispatching network-vif-unplugged-f6892701-aba2-4c9a-88bd-996d00963301 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:40:02 user nova-compute[75122]: WARNING nova.compute.manager [req-c7534ba5-af43-44e4-aca8-941e4fcc9650 req-068ef3f8-2836-4890-8c31-986063daaae0 service nova] [instance: fd9d52bb-6248-48e6-a798-6dbdaaa68cbc] Received unexpected event network-vif-unplugged-f6892701-aba2-4c9a-88bd-996d00963301 for instance with vm_state active and task_state rescuing.
Nov 15 09:40:02 user nova-compute[75122]: DEBUG nova.compute.manager [req-c7534ba5-af43-44e4-aca8-941e4fcc9650 req-068ef3f8-2836-4890-8c31-986063daaae0 service nova] [instance: fd9d52bb-6248-48e6-a798-6dbdaaa68cbc] Received event network-vif-plugged-f6892701-aba2-4c9a-88bd-996d00963301 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:40:02 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-c7534ba5-af43-44e4-aca8-941e4fcc9650 req-068ef3f8-2836-4890-8c31-986063daaae0 service nova] Acquiring lock "fd9d52bb-6248-48e6-a798-6dbdaaa68cbc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:40:02 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-c7534ba5-af43-44e4-aca8-941e4fcc9650 req-068ef3f8-2836-4890-8c31-986063daaae0 service nova] Lock "fd9d52bb-6248-48e6-a798-6dbdaaa68cbc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:40:02 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-c7534ba5-af43-44e4-aca8-941e4fcc9650 req-068ef3f8-2836-4890-8c31-986063daaae0 service nova] Lock "fd9d52bb-6248-48e6-a798-6dbdaaa68cbc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:40:02 user nova-compute[75122]: DEBUG nova.compute.manager [req-c7534ba5-af43-44e4-aca8-941e4fcc9650 req-068ef3f8-2836-4890-8c31-986063daaae0 service nova] [instance: fd9d52bb-6248-48e6-a798-6dbdaaa68cbc] No waiting events found dispatching network-vif-plugged-f6892701-aba2-4c9a-88bd-996d00963301 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:40:02 user nova-compute[75122]: WARNING nova.compute.manager [req-c7534ba5-af43-44e4-aca8-941e4fcc9650 req-068ef3f8-2836-4890-8c31-986063daaae0 service nova] [instance: fd9d52bb-6248-48e6-a798-6dbdaaa68cbc] Received unexpected event network-vif-plugged-f6892701-aba2-4c9a-88bd-996d00963301 for instance with vm_state active and task_state rescuing.
Nov 15 09:40:02 user nova-compute[75122]: DEBUG nova.compute.manager [req-c7534ba5-af43-44e4-aca8-941e4fcc9650 req-068ef3f8-2836-4890-8c31-986063daaae0 service nova] [instance: e1afe5d4-42c0-491c-b1c7-c8debf1d5da2] Received event network-changed-f2eacefa-263d-4e6f-af4e-3ab293748b4a {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:40:02 user nova-compute[75122]: DEBUG nova.compute.manager [req-c7534ba5-af43-44e4-aca8-941e4fcc9650 req-068ef3f8-2836-4890-8c31-986063daaae0 service nova] [instance: e1afe5d4-42c0-491c-b1c7-c8debf1d5da2] Refreshing instance network info cache due to event network-changed-f2eacefa-263d-4e6f-af4e-3ab293748b4a. {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 09:40:02 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-c7534ba5-af43-44e4-aca8-941e4fcc9650 req-068ef3f8-2836-4890-8c31-986063daaae0 service nova] Acquiring lock "refresh_cache-e1afe5d4-42c0-491c-b1c7-c8debf1d5da2" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 09:40:02 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-c7534ba5-af43-44e4-aca8-941e4fcc9650 req-068ef3f8-2836-4890-8c31-986063daaae0 service nova] Acquired lock "refresh_cache-e1afe5d4-42c0-491c-b1c7-c8debf1d5da2" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 09:40:02 user nova-compute[75122]: DEBUG nova.network.neutron [req-c7534ba5-af43-44e4-aca8-941e4fcc9650 req-068ef3f8-2836-4890-8c31-986063daaae0 service nova] [instance: e1afe5d4-42c0-491c-b1c7-c8debf1d5da2] Refreshing network info cache for port f2eacefa-263d-4e6f-af4e-3ab293748b4a {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 09:40:02 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-74c7dcc5-236a-40fa-a801-73b6300c43d1 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c2f45f49-0bca-4ae2-bc2a-eed293143489 {{(pid=75122) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 09:40:02 user nova-compute[75122]: DEBUG nova.network.neutron [req-c7534ba5-af43-44e4-aca8-941e4fcc9650 req-068ef3f8-2836-4890-8c31-986063daaae0 service nova] [instance: e1afe5d4-42c0-491c-b1c7-c8debf1d5da2] Updated VIF entry in instance network info cache for port f2eacefa-263d-4e6f-af4e-3ab293748b4a. {{(pid=75122) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 09:40:02 user nova-compute[75122]: DEBUG nova.network.neutron [req-c7534ba5-af43-44e4-aca8-941e4fcc9650 req-068ef3f8-2836-4890-8c31-986063daaae0 service nova] [instance: e1afe5d4-42c0-491c-b1c7-c8debf1d5da2] Updating instance_info_cache with network_info: [{"id": "f2eacefa-263d-4e6f-af4e-3ab293748b4a", "address": "fa:16:3e:f7:23:f8", "network": {"id": "0b825d42-d480-4526-a659-e1a5c5fbb53c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1640851308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21d2b24ce1a3452fa6bba669f64ffaba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2eacefa-26", "ovs_interfaceid": "f2eacefa-263d-4e6f-af4e-3ab293748b4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:40:02 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-c7534ba5-af43-44e4-aca8-941e4fcc9650 req-068ef3f8-2836-4890-8c31-986063daaae0 service nova] Releasing lock "refresh_cache-e1afe5d4-42c0-491c-b1c7-c8debf1d5da2" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 09:40:02 user nova-compute[75122]: DEBUG nova.compute.manager [req-c7534ba5-af43-44e4-aca8-941e4fcc9650 req-068ef3f8-2836-4890-8c31-986063daaae0 service nova] [instance: fd9d52bb-6248-48e6-a798-6dbdaaa68cbc] Received event network-vif-plugged-f6892701-aba2-4c9a-88bd-996d00963301 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:40:02 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-c7534ba5-af43-44e4-aca8-941e4fcc9650 req-068ef3f8-2836-4890-8c31-986063daaae0 service nova] Acquiring lock "fd9d52bb-6248-48e6-a798-6dbdaaa68cbc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:40:02 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-c7534ba5-af43-44e4-aca8-941e4fcc9650 req-068ef3f8-2836-4890-8c31-986063daaae0 service nova] Lock "fd9d52bb-6248-48e6-a798-6dbdaaa68cbc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:40:02 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-c7534ba5-af43-44e4-aca8-941e4fcc9650 req-068ef3f8-2836-4890-8c31-986063daaae0 service nova] Lock "fd9d52bb-6248-48e6-a798-6dbdaaa68cbc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:40:02 user nova-compute[75122]: DEBUG nova.compute.manager [req-c7534ba5-af43-44e4-aca8-941e4fcc9650 req-068ef3f8-2836-4890-8c31-986063daaae0 service nova] [instance: fd9d52bb-6248-48e6-a798-6dbdaaa68cbc] No waiting events found dispatching network-vif-plugged-f6892701-aba2-4c9a-88bd-996d00963301 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:40:02 user nova-compute[75122]: WARNING nova.compute.manager [req-c7534ba5-af43-44e4-aca8-941e4fcc9650 req-068ef3f8-2836-4890-8c31-986063daaae0 service nova] [instance: fd9d52bb-6248-48e6-a798-6dbdaaa68cbc] Received unexpected event network-vif-plugged-f6892701-aba2-4c9a-88bd-996d00963301 for instance with vm_state active and task_state rescuing.
Nov 15 09:40:02 user nova-compute[75122]: DEBUG nova.compute.manager [req-c7534ba5-af43-44e4-aca8-941e4fcc9650 req-068ef3f8-2836-4890-8c31-986063daaae0 service nova] [instance: fd9d52bb-6248-48e6-a798-6dbdaaa68cbc] Received event network-vif-plugged-f6892701-aba2-4c9a-88bd-996d00963301 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:40:02 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-c7534ba5-af43-44e4-aca8-941e4fcc9650 req-068ef3f8-2836-4890-8c31-986063daaae0 service nova] Acquiring lock "fd9d52bb-6248-48e6-a798-6dbdaaa68cbc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:40:02 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-c7534ba5-af43-44e4-aca8-941e4fcc9650 req-068ef3f8-2836-4890-8c31-986063daaae0 service nova] Lock "fd9d52bb-6248-48e6-a798-6dbdaaa68cbc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:40:02 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-c7534ba5-af43-44e4-aca8-941e4fcc9650 req-068ef3f8-2836-4890-8c31-986063daaae0 service nova] Lock "fd9d52bb-6248-48e6-a798-6dbdaaa68cbc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:40:02 user nova-compute[75122]: DEBUG nova.compute.manager [req-c7534ba5-af43-44e4-aca8-941e4fcc9650 req-068ef3f8-2836-4890-8c31-986063daaae0 service nova] [instance: fd9d52bb-6248-48e6-a798-6dbdaaa68cbc] No waiting events found dispatching network-vif-plugged-f6892701-aba2-4c9a-88bd-996d00963301 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:40:02 user nova-compute[75122]: WARNING nova.compute.manager [req-c7534ba5-af43-44e4-aca8-941e4fcc9650 req-068ef3f8-2836-4890-8c31-986063daaae0 service nova] [instance: fd9d52bb-6248-48e6-a798-6dbdaaa68cbc] Received unexpected event network-vif-plugged-f6892701-aba2-4c9a-88bd-996d00963301 for instance with vm_state active and task_state rescuing.
Nov 15 09:40:04 user nova-compute[75122]: DEBUG nova.compute.manager [None req-334fb888-d8d1-4075-b4bc-ba91ccac2f71 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] [instance: fd9d52bb-6248-48e6-a798-6dbdaaa68cbc] Checking state {{(pid=75122) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 09:40:05 user nova-compute[75122]: DEBUG nova.compute.manager [None req-5c222371-0daf-4916-9b5c-561f576bfa33 tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] [instance: e1afe5d4-42c0-491c-b1c7-c8debf1d5da2] Start spawning the instance on the hypervisor. {{(pid=75122) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 09:40:05 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-5c222371-0daf-4916-9b5c-561f576bfa33 tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] [instance: e1afe5d4-42c0-491c-b1c7-c8debf1d5da2] Creating instance directory {{(pid=75122) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 09:40:05 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-5c222371-0daf-4916-9b5c-561f576bfa33 tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] [instance: e1afe5d4-42c0-491c-b1c7-c8debf1d5da2] Creating image(s)
Nov 15 09:40:05 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-5c222371-0daf-4916-9b5c-561f576bfa33 tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] [instance: e1afe5d4-42c0-491c-b1c7-c8debf1d5da2] Did not create local disks {{(pid=75122) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 09:40:05 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-5c222371-0daf-4916-9b5c-561f576bfa33 tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] [instance: e1afe5d4-42c0-491c-b1c7-c8debf1d5da2] Ensure instance console log exists: /opt/stack/data/nova/instances/e1afe5d4-42c0-491c-b1c7-c8debf1d5da2/console.log {{(pid=75122) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 09:40:05 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-5c222371-0daf-4916-9b5c-561f576bfa33 tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:40:05 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-5c222371-0daf-4916-9b5c-561f576bfa33 tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:40:05 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-5c222371-0daf-4916-9b5c-561f576bfa33 tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:40:05 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-5c222371-0daf-4916-9b5c-561f576bfa33 tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] [instance: e1afe5d4-42c0-491c-b1c7-c8debf1d5da2] Start _get_guest_xml network_info=[{"id": "f2eacefa-263d-4e6f-af4e-3ab293748b4a", "address": "fa:16:3e:f7:23:f8", "network": {"id": "0b825d42-d480-4526-a659-e1a5c5fbb53c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1640851308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21d2b24ce1a3452fa6bba669f64ffaba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2eacefa-26", "ovs_interfaceid": "f2eacefa-263d-4e6f-af4e-3ab293748b4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:395810b1-e3c3-4660-aaaf-b6d9e7cb5a88', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cRPqjENp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e1afe5d4-42c0-491c-b1c7-c8debf1d5da2', 'attached_at': '', 'detached_at': '', 'volume_id': '395810b1-e3c3-4660-aaaf-b6d9e7cb5a88', 'serial': '395810b1-e3c3-4660-aaaf-b6d9e7cb5a88'}, 'guest_format': None, 'delete_on_termination': True, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vda', 'attachment_id': '2ba0121d-1824-466a-b61c-33866b50d3e1', 'volume_type': None} {{(pid=75122) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 09:40:05 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-5c222371-0daf-4916-9b5c-561f576bfa33 tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 09:40:05 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-5c222371-0daf-4916-9b5c-561f576bfa33 tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 09:40:05 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-5c222371-0daf-4916-9b5c-561f576bfa33 tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75122) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 09:40:05 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-5c222371-0daf-4916-9b5c-561f576bfa33 tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] CPU controller missing on host. {{(pid=75122) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 09:40:05 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-5c222371-0daf-4916-9b5c-561f576bfa33 tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75122) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 09:40:05 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-5c222371-0daf-4916-9b5c-561f576bfa33 tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] CPU controller found on host. {{(pid=75122) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 09:40:05 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-5c222371-0daf-4916-9b5c-561f576bfa33 tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75122) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 09:40:05 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-5c222371-0daf-4916-9b5c-561f576bfa33 tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T09:26:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 09:40:05 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-5c222371-0daf-4916-9b5c-561f576bfa33 tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] Flavor limits 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 09:40:05 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-5c222371-0daf-4916-9b5c-561f576bfa33 tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] Image limits 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 09:40:05 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-5c222371-0daf-4916-9b5c-561f576bfa33 tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] Flavor pref 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 09:40:05 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-5c222371-0daf-4916-9b5c-561f576bfa33 tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] Image pref 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 09:40:05 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-5c222371-0daf-4916-9b5c-561f576bfa33 tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 09:40:05 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-5c222371-0daf-4916-9b5c-561f576bfa33 tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 09:40:05 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-5c222371-0daf-4916-9b5c-561f576bfa33 tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75122) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 09:40:05 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-5c222371-0daf-4916-9b5c-561f576bfa33 tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] Got 1 possible topologies {{(pid=75122) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 09:40:05 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-5c222371-0daf-4916-9b5c-561f576bfa33 tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 09:40:05 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-5c222371-0daf-4916-9b5c-561f576bfa33 tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 09:40:05 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5c222371-0daf-4916-9b5c-561f576bfa33 tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] [instance: e1afe5d4-42c0-491c-b1c7-c8debf1d5da2] Calling os-brick to attach iSCSI Volume {{(pid=75122) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 09:40:05 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c222371-0daf-4916-9b5c-561f576bfa33 tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffa04060b80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:395810b1-e3c3-4660-aaaf-b6d9e7cb5a88', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cRPqjENp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 09:40:05 user nova-compute[75122]: WARNING os_brick.initiator.connectors.base [None req-5c222371-0daf-4916-9b5c-561f576bfa33 tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 09:40:05 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-5c222371-0daf-4916-9b5c-561f576bfa33 tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 09:40:05 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-5c222371-0daf-4916-9b5c-561f576bfa33 tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 09:40:05 user nova-compute[75122]: WARNING os_brick.initiator.connectors.base [None req-5c222371-0daf-4916-9b5c-561f576bfa33 tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 09:40:05 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-5c222371-0daf-4916-9b5c-561f576bfa33 tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:395810b1-e3c3-4660-aaaf-b6d9e7cb5a88" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 09:40:05 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-5c222371-0daf-4916-9b5c-561f576bfa33 tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:395810b1-e3c3-4660-aaaf-b6d9e7cb5a88" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 09:40:05 user nova-compute[75122]: INFO os_brick.initiator.connectors.iscsi [None req-5c222371-0daf-4916-9b5c-561f576bfa33 tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 09:40:05 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:395810b1-e3c3-4660-aaaf-b6d9e7cb5a88 -p 172.16.0.220:3260 {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:40:05 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:395810b1-e3c3-4660-aaaf-b6d9e7cb5a88 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:40:05 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[db5edd0f-af38-4053-8772-a3c27af8d419]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:40:05 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c222371-0daf-4916-9b5c-561f576bfa33 tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 09:40:05 user nova-compute[75122]:  {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:40:05 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:395810b1-e3c3-4660-aaaf-b6d9e7cb5a88 -p 172.16.0.220:3260 --interface default --op new {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:40:05 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:395810b1-e3c3-4660-aaaf-b6d9e7cb5a88 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:40:05 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8c09ba7-f140-428f-8ac0-595f102995eb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:395810b1-e3c3-4660-aaaf-b6d9e7cb5a88] added\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:40:05 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c222371-0daf-4916-9b5c-561f576bfa33 tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:395810b1-e3c3-4660-aaaf-b6d9e7cb5a88] added
Nov 15 09:40:05 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:40:05 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:395810b1-e3c3-4660-aaaf-b6d9e7cb5a88 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:40:05 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:395810b1-e3c3-4660-aaaf-b6d9e7cb5a88 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:40:05 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[69eaeff2-7538-4cc1-89b3-61525d14b72c]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:40:05 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c222371-0daf-4916-9b5c-561f576bfa33 tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:40:05 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:395810b1-e3c3-4660-aaaf-b6d9e7cb5a88 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:40:05 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:395810b1-e3c3-4660-aaaf-b6d9e7cb5a88 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:40:05 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[94694c9a-6743-41b0-98dd-75d423a6a230]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:40:05 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c222371-0daf-4916-9b5c-561f576bfa33 tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:40:05 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:395810b1-e3c3-4660-aaaf-b6d9e7cb5a88 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cRPqjENp {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:40:05 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:395810b1-e3c3-4660-aaaf-b6d9e7cb5a88 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cRPqjENp" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:40:05 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[63696955-31f6-4563-8eb3-407aadeedb20]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:40:05 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c222371-0daf-4916-9b5c-561f576bfa33 tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cRPqjENp'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:40:05 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:395810b1-e3c3-4660-aaaf-b6d9e7cb5a88 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:40:05 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:395810b1-e3c3-4660-aaaf-b6d9e7cb5a88 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:40:05 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[43d7f8c3-7be1-458c-984f-e8adf72c059d]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:40:05 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c222371-0daf-4916-9b5c-561f576bfa33 tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:40:05 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:40:05 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:40:05 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[373b7612-ab62-4bdc-b1f6-0d6ee811cdb1]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b366dd5-506b-4ee0-9e25-990a31acf3eb (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdf09a1b-a065-4b88-815d-ee54c1c68464 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:984b3190-31e5-432a-9602-cedead354720 (non-flash)\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:40:05 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c222371-0daf-4916-9b5c-561f576bfa33 tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b366dd5-506b-4ee0-9e25-990a31acf3eb (non-flash)
Nov 15 09:40:05 user nova-compute[75122]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdf09a1b-a065-4b88-815d-ee54c1c68464 (non-flash)
Nov 15 09:40:05 user nova-compute[75122]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:984b3190-31e5-432a-9602-cedead354720 (non-flash)
Nov 15 09:40:05 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 09:40:05 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c222371-0daf-4916-9b5c-561f576bfa33 tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b366dd5-506b-4ee0-9e25-990a31acf3eb (non-flash)
Nov 15 09:40:05 user nova-compute[75122]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdf09a1b-a065-4b88-815d-ee54c1c68464 (non-flash)
Nov 15 09:40:05 user nova-compute[75122]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:984b3190-31e5-432a-9602-cedead354720 (non-flash)
Nov 15 09:40:05 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 09:40:05 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:395810b1-e3c3-4660-aaaf-b6d9e7cb5a88 -p 172.16.0.220:3260 --login {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:40:05 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:395810b1-e3c3-4660-aaaf-b6d9e7cb5a88 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:40:05 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[52c1fec3-7ea5-4858-8b79-4eb8a4e4ec68]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:395810b1-e3c3-4660-aaaf-b6d9e7cb5a88, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:395810b1-e3c3-4660-aaaf-b6d9e7cb5a88, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:40:05 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c222371-0daf-4916-9b5c-561f576bfa33 tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:395810b1-e3c3-4660-aaaf-b6d9e7cb5a88, portal: 172.16.0.220,3260]
Nov 15 09:40:05 user nova-compute[75122]: Login to [iface: default, target: iqn.2010-10.org.openstack:395810b1-e3c3-4660-aaaf-b6d9e7cb5a88, portal: 172.16.0.220,3260] successful.
Nov 15 09:40:05 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:40:05 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:395810b1-e3c3-4660-aaaf-b6d9e7cb5a88 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:40:05 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:395810b1-e3c3-4660-aaaf-b6d9e7cb5a88 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:40:05 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[d04b1137-b6ed-44c7-8713-c62547613e62]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:40:05 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c222371-0daf-4916-9b5c-561f576bfa33 tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:40:05 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:40:05 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:40:05 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[a72684eb-9ba2-49ea-942f-a257bd3b6c42]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b366dd5-506b-4ee0-9e25-990a31acf3eb (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdf09a1b-a065-4b88-815d-ee54c1c68464 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:984b3190-31e5-432a-9602-cedead354720 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:395810b1-e3c3-4660-aaaf-b6d9e7cb5a88 (non-flash)\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:40:05 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c222371-0daf-4916-9b5c-561f576bfa33 tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b366dd5-506b-4ee0-9e25-990a31acf3eb (non-flash)
Nov 15 09:40:05 user nova-compute[75122]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdf09a1b-a065-4b88-815d-ee54c1c68464 (non-flash)
Nov 15 09:40:05 user nova-compute[75122]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:984b3190-31e5-432a-9602-cedead354720 (non-flash)
Nov 15 09:40:05 user nova-compute[75122]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:395810b1-e3c3-4660-aaaf-b6d9e7cb5a88 (non-flash)
Nov 15 09:40:05 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 09:40:05 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c222371-0daf-4916-9b5c-561f576bfa33 tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b366dd5-506b-4ee0-9e25-990a31acf3eb (non-flash)
Nov 15 09:40:05 user nova-compute[75122]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdf09a1b-a065-4b88-815d-ee54c1c68464 (non-flash)
Nov 15 09:40:05 user nova-compute[75122]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:984b3190-31e5-432a-9602-cedead354720 (non-flash)
Nov 15 09:40:05 user nova-compute[75122]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:395810b1-e3c3-4660-aaaf-b6d9e7cb5a88 (non-flash)
Nov 15 09:40:05 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 09:40:05 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-5c222371-0daf-4916-9b5c-561f576bfa33 tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:395810b1-e3c3-4660-aaaf-b6d9e7cb5a88" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.312s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 09:40:05 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c222371-0daf-4916-9b5c-561f576bfa33 tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] Connected to 172.16.0.220:3260 {{(pid=75122) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 09:40:05 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-5c222371-0daf-4916-9b5c-561f576bfa33 tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] HCTL ('36', '-', '-', 0) found on session 31 with lun 0 {{(pid=75122) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 09:40:05 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-5c222371-0daf-4916-9b5c-561f576bfa33 tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75122) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 09:40:05 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:40:05 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.015s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:40:05 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[685bbbdb-c97f-44c0-9752-0c05e2f7ad13]: (4, ('- - 0', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:40:05 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-5c222371-0daf-4916-9b5c-561f576bfa33 tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] Searching for a device in session 31 and hctl ['36', '*', '*', 0] yield: None {{(pid=75122) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 09:40:05 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:40:06 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:40:06 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-5c222371-0daf-4916-9b5c-561f576bfa33 tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] Searching for a device in session 31 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75122) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 09:40:06 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c222371-0daf-4916-9b5c-561f576bfa33 tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:395810b1-e3c3-4660-aaaf-b6d9e7cb5a88', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cRPqjENp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75122) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 09:40:06 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-5c222371-0daf-4916-9b5c-561f576bfa33 tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.342s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 09:40:06 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c222371-0daf-4916-9b5c-561f576bfa33 tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] <== connect_volume: return (1345ms) {'type': 'block', 'scsi_wwn': '23538613733363566', 'path': '/dev/sde'} {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 09:40:06 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5c222371-0daf-4916-9b5c-561f576bfa33 tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] [instance: e1afe5d4-42c0-491c-b1c7-c8debf1d5da2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23538613733363566', 'path': '/dev/sde'} {{(pid=75122) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 09:40:06 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-5c222371-0daf-4916-9b5c-561f576bfa33 tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T09:39:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1427271580',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1427271580',id=24,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKavn69DT/YiudqeLC0nG3DEUybkU33QtIjB7fX4OdJJmMo+mhmiPQjcJANuymlxpfxTBdycCs8+kgmwpZOBnByAe9gcjy/ud1YUrlRdkVYRnoGUJsx71JcToY7Fz/5kxA==',key_name='tempest-keypair-171606846',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='21d2b24ce1a3452fa6bba669f64ffaba',ramdisk_id='',reservation_id='r-j9e29adc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-380486035',owner_user_name='tempest-ServerActionsV293TestJSON-380486035-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T09:39:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='35c1bd52106641e081d67e05532fbec3',uuid=e1afe5d4-42c0-491c-b1c7-c8debf1d5da2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f2eacefa-263d-4e6f-af4e-3ab293748b4a", "address": "fa:16:3e:f7:23:f8", "network": {"id": "0b825d42-d480-4526-a659-e1a5c5fbb53c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1640851308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21d2b24ce1a3452fa6bba669f64ffaba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2eacefa-26", "ovs_interfaceid": "f2eacefa-263d-4e6f-af4e-3ab293748b4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75122) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 09:40:06 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-5c222371-0daf-4916-9b5c-561f576bfa33 tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] Converting VIF {"id": "f2eacefa-263d-4e6f-af4e-3ab293748b4a", "address": "fa:16:3e:f7:23:f8", "network": {"id": "0b825d42-d480-4526-a659-e1a5c5fbb53c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1640851308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21d2b24ce1a3452fa6bba669f64ffaba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2eacefa-26", "ovs_interfaceid": "f2eacefa-263d-4e6f-af4e-3ab293748b4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 09:40:06 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-5c222371-0daf-4916-9b5c-561f576bfa33 tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f7:23:f8,bridge_name='br-int',has_traffic_filtering=True,id=f2eacefa-263d-4e6f-af4e-3ab293748b4a,network=Network(0b825d42-d480-4526-a659-e1a5c5fbb53c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2eacefa-26') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 09:40:06 user nova-compute[75122]: DEBUG nova.objects.instance [None req-5c222371-0daf-4916-9b5c-561f576bfa33 tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] Lazy-loading 'pci_devices' on Instance uuid e1afe5d4-42c0-491c-b1c7-c8debf1d5da2 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:40:06 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-5c222371-0daf-4916-9b5c-561f576bfa33 tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] [instance: e1afe5d4-42c0-491c-b1c7-c8debf1d5da2] End _get_guest_xml xml=<domain type="kvm">
Nov 15 09:40:06 user nova-compute[75122]:   <uuid>e1afe5d4-42c0-491c-b1c7-c8debf1d5da2</uuid>
Nov 15 09:40:06 user nova-compute[75122]:   <name>instance-00000018</name>
Nov 15 09:40:06 user nova-compute[75122]:   <memory>524288</memory>
Nov 15 09:40:06 user nova-compute[75122]:   <vcpu>1</vcpu>
Nov 15 09:40:06 user nova-compute[75122]:   <metadata>
Nov 15 09:40:06 user nova-compute[75122]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 09:40:06 user nova-compute[75122]:       <nova:package version="0.0.0"/>
Nov 15 09:40:06 user nova-compute[75122]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1427271580</nova:name>
Nov 15 09:40:06 user nova-compute[75122]:       <nova:creationTime>2023-11-15 09:40:05</nova:creationTime>
Nov 15 09:40:06 user nova-compute[75122]:       <nova:flavor name="m1.tiny">
Nov 15 09:40:06 user nova-compute[75122]:         <nova:memory>512</nova:memory>
Nov 15 09:40:06 user nova-compute[75122]:         <nova:disk>1</nova:disk>
Nov 15 09:40:06 user nova-compute[75122]:         <nova:swap>0</nova:swap>
Nov 15 09:40:06 user nova-compute[75122]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 09:40:06 user nova-compute[75122]:         <nova:vcpus>1</nova:vcpus>
Nov 15 09:40:06 user nova-compute[75122]:       </nova:flavor>
Nov 15 09:40:06 user nova-compute[75122]:       <nova:owner>
Nov 15 09:40:06 user nova-compute[75122]:         <nova:user uuid="35c1bd52106641e081d67e05532fbec3">tempest-ServerActionsV293TestJSON-380486035-project-member</nova:user>
Nov 15 09:40:06 user nova-compute[75122]:         <nova:project uuid="21d2b24ce1a3452fa6bba669f64ffaba">tempest-ServerActionsV293TestJSON-380486035</nova:project>
Nov 15 09:40:06 user nova-compute[75122]:       </nova:owner>
Nov 15 09:40:06 user nova-compute[75122]:       <nova:ports>
Nov 15 09:40:06 user nova-compute[75122]:         <nova:port uuid="f2eacefa-263d-4e6f-af4e-3ab293748b4a">
Nov 15 09:40:06 user nova-compute[75122]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 15 09:40:06 user nova-compute[75122]:         </nova:port>
Nov 15 09:40:06 user nova-compute[75122]:       </nova:ports>
Nov 15 09:40:06 user nova-compute[75122]:     </nova:instance>
Nov 15 09:40:06 user nova-compute[75122]:   </metadata>
Nov 15 09:40:06 user nova-compute[75122]:   <sysinfo type="smbios">
Nov 15 09:40:06 user nova-compute[75122]:     <system>
Nov 15 09:40:06 user nova-compute[75122]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 09:40:06 user nova-compute[75122]:       <entry name="product">OpenStack Nova</entry>
Nov 15 09:40:06 user nova-compute[75122]:       <entry name="version">0.0.0</entry>
Nov 15 09:40:06 user nova-compute[75122]:       <entry name="serial">e1afe5d4-42c0-491c-b1c7-c8debf1d5da2</entry>
Nov 15 09:40:06 user nova-compute[75122]:       <entry name="uuid">e1afe5d4-42c0-491c-b1c7-c8debf1d5da2</entry>
Nov 15 09:40:06 user nova-compute[75122]:       <entry name="family">Virtual Machine</entry>
Nov 15 09:40:06 user nova-compute[75122]:     </system>
Nov 15 09:40:06 user nova-compute[75122]:   </sysinfo>
Nov 15 09:40:06 user nova-compute[75122]:   <os>
Nov 15 09:40:06 user nova-compute[75122]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 09:40:06 user nova-compute[75122]:     <boot dev="hd"/>
Nov 15 09:40:06 user nova-compute[75122]:     <smbios mode="sysinfo"/>
Nov 15 09:40:06 user nova-compute[75122]:   </os>
Nov 15 09:40:06 user nova-compute[75122]:   <features>
Nov 15 09:40:06 user nova-compute[75122]:     <acpi/>
Nov 15 09:40:06 user nova-compute[75122]:     <apic/>
Nov 15 09:40:06 user nova-compute[75122]:     <vmcoreinfo/>
Nov 15 09:40:06 user nova-compute[75122]:   </features>
Nov 15 09:40:06 user nova-compute[75122]:   <clock offset="utc">
Nov 15 09:40:06 user nova-compute[75122]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 09:40:06 user nova-compute[75122]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 09:40:06 user nova-compute[75122]:     <timer name="hpet" present="no"/>
Nov 15 09:40:06 user nova-compute[75122]:   </clock>
Nov 15 09:40:06 user nova-compute[75122]:   <cpu mode="custom" match="exact">
Nov 15 09:40:06 user nova-compute[75122]:     <model>Nehalem</model>
Nov 15 09:40:06 user nova-compute[75122]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 09:40:06 user nova-compute[75122]:   </cpu>
Nov 15 09:40:06 user nova-compute[75122]:   <devices>
Nov 15 09:40:06 user nova-compute[75122]:     <disk type="block" device="disk">
Nov 15 09:40:06 user nova-compute[75122]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 09:40:06 user nova-compute[75122]:       <source dev="/dev/sde"/>
Nov 15 09:40:06 user nova-compute[75122]:       <target dev="vda" bus="virtio"/>
Nov 15 09:40:06 user nova-compute[75122]:       <serial>395810b1-e3c3-4660-aaaf-b6d9e7cb5a88</serial>
Nov 15 09:40:06 user nova-compute[75122]:     </disk>
Nov 15 09:40:06 user nova-compute[75122]:     <interface type="ethernet">
Nov 15 09:40:06 user nova-compute[75122]:       <mac address="fa:16:3e:f7:23:f8"/>
Nov 15 09:40:06 user nova-compute[75122]:       <model type="virtio"/>
Nov 15 09:40:06 user nova-compute[75122]:       <mtu size="1442"/>
Nov 15 09:40:06 user nova-compute[75122]:       <target dev="tapf2eacefa-26"/>
Nov 15 09:40:06 user nova-compute[75122]:     </interface>
Nov 15 09:40:06 user nova-compute[75122]:     <serial type="pty">
Nov 15 09:40:06 user nova-compute[75122]:       <log file="/opt/stack/data/nova/instances/e1afe5d4-42c0-491c-b1c7-c8debf1d5da2/console.log" append="off"/>
Nov 15 09:40:06 user nova-compute[75122]:     </serial>
Nov 15 09:40:06 user nova-compute[75122]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 09:40:06 user nova-compute[75122]:     <video>
Nov 15 09:40:06 user nova-compute[75122]:       <model type="virtio"/>
Nov 15 09:40:06 user nova-compute[75122]:     </video>
Nov 15 09:40:06 user nova-compute[75122]:     <rng model="virtio">
Nov 15 09:40:06 user nova-compute[75122]:       <backend model="random">/dev/urandom</backend>
Nov 15 09:40:06 user nova-compute[75122]:     </rng>
Nov 15 09:40:06 user nova-compute[75122]:     <controller type="usb" index="0" model="none"/>
Nov 15 09:40:06 user nova-compute[75122]:     <memballoon model="virtio">
Nov 15 09:40:06 user nova-compute[75122]:       <stats period="10"/>
Nov 15 09:40:06 user nova-compute[75122]:     </memballoon>
Nov 15 09:40:06 user nova-compute[75122]:   </devices>
Nov 15 09:40:06 user nova-compute[75122]: </domain>
Nov 15 09:40:06 user nova-compute[75122]:  {{(pid=75122) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 09:40:06 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-5c222371-0daf-4916-9b5c-561f576bfa33 tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T09:39:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1427271580',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1427271580',id=24,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKavn69DT/YiudqeLC0nG3DEUybkU33QtIjB7fX4OdJJmMo+mhmiPQjcJANuymlxpfxTBdycCs8+kgmwpZOBnByAe9gcjy/ud1YUrlRdkVYRnoGUJsx71JcToY7Fz/5kxA==',key_name='tempest-keypair-171606846',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='21d2b24ce1a3452fa6bba669f64ffaba',ramdisk_id='',reservation_id='r-j9e29adc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-380486035',owner_user_name='tempest-ServerActionsV293TestJSON-380486035-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T09:39:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='35c1bd52106641e081d67e05532fbec3',uuid=e1afe5d4-42c0-491c-b1c7-c8debf1d5da2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f2eacefa-263d-4e6f-af4e-3ab293748b4a", "address": "fa:16:3e:f7:23:f8", "network": {"id": "0b825d42-d480-4526-a659-e1a5c5fbb53c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1640851308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21d2b24ce1a3452fa6bba669f64ffaba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2eacefa-26", "ovs_interfaceid": "f2eacefa-263d-4e6f-af4e-3ab293748b4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 09:40:06 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-5c222371-0daf-4916-9b5c-561f576bfa33 tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] Converting VIF {"id": "f2eacefa-263d-4e6f-af4e-3ab293748b4a", "address": "fa:16:3e:f7:23:f8", "network": {"id": "0b825d42-d480-4526-a659-e1a5c5fbb53c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1640851308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21d2b24ce1a3452fa6bba669f64ffaba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2eacefa-26", "ovs_interfaceid": "f2eacefa-263d-4e6f-af4e-3ab293748b4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 09:40:06 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-5c222371-0daf-4916-9b5c-561f576bfa33 tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f7:23:f8,bridge_name='br-int',has_traffic_filtering=True,id=f2eacefa-263d-4e6f-af4e-3ab293748b4a,network=Network(0b825d42-d480-4526-a659-e1a5c5fbb53c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2eacefa-26') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 09:40:06 user nova-compute[75122]: DEBUG os_vif [None req-5c222371-0daf-4916-9b5c-561f576bfa33 tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:23:f8,bridge_name='br-int',has_traffic_filtering=True,id=f2eacefa-263d-4e6f-af4e-3ab293748b4a,network=Network(0b825d42-d480-4526-a659-e1a5c5fbb53c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2eacefa-26') {{(pid=75122) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 09:40:06 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:40:06 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:40:06 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 09:40:06 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:40:06 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4e1e88e0-140e-588c-83b5-0c59dc509cb4', '_type': 'linux-noop'}}, row=False) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:40:06 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:40:06 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:40:06 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:40:06 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf2eacefa-26, may_exist=True, interface_attrs={}) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:40:06 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf2eacefa-26, col_values=(('qos', UUID('205d8d40-ff70-4593-b279-d652e2b5070e')),), if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:40:06 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf2eacefa-26, col_values=(('external_ids', {'iface-id': 'f2eacefa-263d-4e6f-af4e-3ab293748b4a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f7:23:f8', 'vm-uuid': 'e1afe5d4-42c0-491c-b1c7-c8debf1d5da2'}),), if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:40:06 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:40:06 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:40:06 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:40:06 user nova-compute[75122]: INFO os_vif [None req-5c222371-0daf-4916-9b5c-561f576bfa33 tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:23:f8,bridge_name='br-int',has_traffic_filtering=True,id=f2eacefa-263d-4e6f-af4e-3ab293748b4a,network=Network(0b825d42-d480-4526-a659-e1a5c5fbb53c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2eacefa-26')
Nov 15 09:40:06 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-5c222371-0daf-4916-9b5c-561f576bfa33 tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] No BDM found with device name vda, not building metadata. {{(pid=75122) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 09:40:06 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-5c222371-0daf-4916-9b5c-561f576bfa33 tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] No VIF found with MAC fa:16:3e:f7:23:f8, not building metadata {{(pid=75122) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 09:40:08 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:40:08 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:40:08 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:40:08 user nova-compute[75122]: DEBUG nova.compute.manager [req-b841cb94-ee05-4805-ae71-5633817b2af7 req-f281d87f-e3b9-45c4-a541-13f71b5f6b7a service nova] [instance: e1afe5d4-42c0-491c-b1c7-c8debf1d5da2] Received event network-vif-plugged-f2eacefa-263d-4e6f-af4e-3ab293748b4a {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:40:08 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-b841cb94-ee05-4805-ae71-5633817b2af7 req-f281d87f-e3b9-45c4-a541-13f71b5f6b7a service nova] Acquiring lock "e1afe5d4-42c0-491c-b1c7-c8debf1d5da2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:40:08 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-b841cb94-ee05-4805-ae71-5633817b2af7 req-f281d87f-e3b9-45c4-a541-13f71b5f6b7a service nova] Lock "e1afe5d4-42c0-491c-b1c7-c8debf1d5da2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:40:08 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-b841cb94-ee05-4805-ae71-5633817b2af7 req-f281d87f-e3b9-45c4-a541-13f71b5f6b7a service nova] Lock "e1afe5d4-42c0-491c-b1c7-c8debf1d5da2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:40:08 user nova-compute[75122]: DEBUG nova.compute.manager [req-b841cb94-ee05-4805-ae71-5633817b2af7 req-f281d87f-e3b9-45c4-a541-13f71b5f6b7a service nova] [instance: e1afe5d4-42c0-491c-b1c7-c8debf1d5da2] No waiting events found dispatching network-vif-plugged-f2eacefa-263d-4e6f-af4e-3ab293748b4a {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:40:08 user nova-compute[75122]: WARNING nova.compute.manager [req-b841cb94-ee05-4805-ae71-5633817b2af7 req-f281d87f-e3b9-45c4-a541-13f71b5f6b7a service nova] [instance: e1afe5d4-42c0-491c-b1c7-c8debf1d5da2] Received unexpected event network-vif-plugged-f2eacefa-263d-4e6f-af4e-3ab293748b4a for instance with vm_state building and task_state spawning.
Nov 15 09:40:08 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:40:08 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:40:10 user nova-compute[75122]: DEBUG nova.compute.manager [req-b302de9d-9389-4221-bf61-68b566b0a5a3 req-fc32ba3f-038c-40cc-a19b-ddcc1dde27ff service nova] [instance: e1afe5d4-42c0-491c-b1c7-c8debf1d5da2] Received event network-vif-plugged-f2eacefa-263d-4e6f-af4e-3ab293748b4a {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:40:10 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-b302de9d-9389-4221-bf61-68b566b0a5a3 req-fc32ba3f-038c-40cc-a19b-ddcc1dde27ff service nova] Acquiring lock "e1afe5d4-42c0-491c-b1c7-c8debf1d5da2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:40:10 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-b302de9d-9389-4221-bf61-68b566b0a5a3 req-fc32ba3f-038c-40cc-a19b-ddcc1dde27ff service nova] Lock "e1afe5d4-42c0-491c-b1c7-c8debf1d5da2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:40:10 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-b302de9d-9389-4221-bf61-68b566b0a5a3 req-fc32ba3f-038c-40cc-a19b-ddcc1dde27ff service nova] Lock "e1afe5d4-42c0-491c-b1c7-c8debf1d5da2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:40:10 user nova-compute[75122]: DEBUG nova.compute.manager [req-b302de9d-9389-4221-bf61-68b566b0a5a3 req-fc32ba3f-038c-40cc-a19b-ddcc1dde27ff service nova] [instance: e1afe5d4-42c0-491c-b1c7-c8debf1d5da2] No waiting events found dispatching network-vif-plugged-f2eacefa-263d-4e6f-af4e-3ab293748b4a {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:40:10 user nova-compute[75122]: WARNING nova.compute.manager [req-b302de9d-9389-4221-bf61-68b566b0a5a3 req-fc32ba3f-038c-40cc-a19b-ddcc1dde27ff service nova] [instance: e1afe5d4-42c0-491c-b1c7-c8debf1d5da2] Received unexpected event network-vif-plugged-f2eacefa-263d-4e6f-af4e-3ab293748b4a for instance with vm_state building and task_state spawning.
Nov 15 09:40:10 user nova-compute[75122]: DEBUG nova.compute.manager [None req-5c222371-0daf-4916-9b5c-561f576bfa33 tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] [instance: e1afe5d4-42c0-491c-b1c7-c8debf1d5da2] Instance event wait completed in 0 seconds for  {{(pid=75122) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 09:40:10 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-5c222371-0daf-4916-9b5c-561f576bfa33 tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] [instance: e1afe5d4-42c0-491c-b1c7-c8debf1d5da2] Guest created on hypervisor {{(pid=75122) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 09:40:10 user nova-compute[75122]: INFO nova.virt.libvirt.driver [-] [instance: e1afe5d4-42c0-491c-b1c7-c8debf1d5da2] Instance spawned successfully.
Nov 15 09:40:10 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-5c222371-0daf-4916-9b5c-561f576bfa33 tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] [instance: e1afe5d4-42c0-491c-b1c7-c8debf1d5da2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 09:40:10 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-5c222371-0daf-4916-9b5c-561f576bfa33 tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] [instance: e1afe5d4-42c0-491c-b1c7-c8debf1d5da2] Found default for hw_cdrom_bus of ide {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:40:10 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-5c222371-0daf-4916-9b5c-561f576bfa33 tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] [instance: e1afe5d4-42c0-491c-b1c7-c8debf1d5da2] Found default for hw_disk_bus of virtio {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:40:10 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-5c222371-0daf-4916-9b5c-561f576bfa33 tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] [instance: e1afe5d4-42c0-491c-b1c7-c8debf1d5da2] Found default for hw_input_bus of None {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:40:10 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-5c222371-0daf-4916-9b5c-561f576bfa33 tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] [instance: e1afe5d4-42c0-491c-b1c7-c8debf1d5da2] Found default for hw_pointer_model of None {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:40:10 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-5c222371-0daf-4916-9b5c-561f576bfa33 tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] [instance: e1afe5d4-42c0-491c-b1c7-c8debf1d5da2] Found default for hw_video_model of virtio {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:40:10 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-5c222371-0daf-4916-9b5c-561f576bfa33 tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] [instance: e1afe5d4-42c0-491c-b1c7-c8debf1d5da2] Found default for hw_vif_model of virtio {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:40:10 user nova-compute[75122]: INFO nova.compute.manager [None req-5c222371-0daf-4916-9b5c-561f576bfa33 tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] [instance: e1afe5d4-42c0-491c-b1c7-c8debf1d5da2] Took 5.73 seconds to spawn the instance on the hypervisor.
Nov 15 09:40:10 user nova-compute[75122]: DEBUG nova.compute.manager [None req-5c222371-0daf-4916-9b5c-561f576bfa33 tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] [instance: e1afe5d4-42c0-491c-b1c7-c8debf1d5da2] Checking state {{(pid=75122) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 09:40:10 user nova-compute[75122]: INFO nova.compute.manager [None req-5c222371-0daf-4916-9b5c-561f576bfa33 tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] [instance: e1afe5d4-42c0-491c-b1c7-c8debf1d5da2] Took 12.36 seconds to build instance.
Nov 15 09:40:10 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:40:10 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-5c222371-0daf-4916-9b5c-561f576bfa33 tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] Lock "e1afe5d4-42c0-491c-b1c7-c8debf1d5da2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.483s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:40:11 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:40:12 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-fcd08ae2-de0b-46cc-9455-3c7c3514e75b tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Acquiring lock "e815e0b5-e9c8-4ebb-aa85-b79b180595df" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:40:12 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-fcd08ae2-de0b-46cc-9455-3c7c3514e75b tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Lock "e815e0b5-e9c8-4ebb-aa85-b79b180595df" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:40:12 user nova-compute[75122]: DEBUG nova.compute.manager [None req-fcd08ae2-de0b-46cc-9455-3c7c3514e75b tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] [instance: e815e0b5-e9c8-4ebb-aa85-b79b180595df] Starting instance... {{(pid=75122) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 09:40:12 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-fcd08ae2-de0b-46cc-9455-3c7c3514e75b tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:40:12 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-fcd08ae2-de0b-46cc-9455-3c7c3514e75b tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:40:12 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-fcd08ae2-de0b-46cc-9455-3c7c3514e75b tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75122) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 09:40:12 user nova-compute[75122]: INFO nova.compute.claims [None req-fcd08ae2-de0b-46cc-9455-3c7c3514e75b tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] [instance: e815e0b5-e9c8-4ebb-aa85-b79b180595df] Claim successful on node user
Nov 15 09:40:12 user nova-compute[75122]: DEBUG nova.compute.provider_tree [None req-fcd08ae2-de0b-46cc-9455-3c7c3514e75b tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Inventory has not changed in ProviderTree for provider: 69a3da65-47be-44c6-b67c-c692b58284ef {{(pid=75122) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 09:40:12 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-fcd08ae2-de0b-46cc-9455-3c7c3514e75b tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Inventory has not changed for provider 69a3da65-47be-44c6-b67c-c692b58284ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 09:40:12 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-fcd08ae2-de0b-46cc-9455-3c7c3514e75b tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.450s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:40:12 user nova-compute[75122]: DEBUG nova.compute.manager [None req-fcd08ae2-de0b-46cc-9455-3c7c3514e75b tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] [instance: e815e0b5-e9c8-4ebb-aa85-b79b180595df] Start building networks asynchronously for instance. {{(pid=75122) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 09:40:13 user nova-compute[75122]: DEBUG nova.compute.manager [None req-fcd08ae2-de0b-46cc-9455-3c7c3514e75b tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] [instance: e815e0b5-e9c8-4ebb-aa85-b79b180595df] Allocating IP information in the background. {{(pid=75122) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 09:40:13 user nova-compute[75122]: DEBUG nova.network.neutron [None req-fcd08ae2-de0b-46cc-9455-3c7c3514e75b tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] [instance: e815e0b5-e9c8-4ebb-aa85-b79b180595df] allocate_for_instance() {{(pid=75122) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 09:40:13 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-fcd08ae2-de0b-46cc-9455-3c7c3514e75b tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] [instance: e815e0b5-e9c8-4ebb-aa85-b79b180595df] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 09:40:13 user nova-compute[75122]: DEBUG nova.compute.manager [None req-fcd08ae2-de0b-46cc-9455-3c7c3514e75b tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] [instance: e815e0b5-e9c8-4ebb-aa85-b79b180595df] Start building block device mappings for instance. {{(pid=75122) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 09:40:13 user nova-compute[75122]: DEBUG nova.compute.manager [None req-fcd08ae2-de0b-46cc-9455-3c7c3514e75b tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] [instance: e815e0b5-e9c8-4ebb-aa85-b79b180595df] Start spawning the instance on the hypervisor. {{(pid=75122) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 09:40:13 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-fcd08ae2-de0b-46cc-9455-3c7c3514e75b tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] [instance: e815e0b5-e9c8-4ebb-aa85-b79b180595df] Creating instance directory {{(pid=75122) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 09:40:13 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-fcd08ae2-de0b-46cc-9455-3c7c3514e75b tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] [instance: e815e0b5-e9c8-4ebb-aa85-b79b180595df] Creating image(s)
Nov 15 09:40:13 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-fcd08ae2-de0b-46cc-9455-3c7c3514e75b tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Acquiring lock "/opt/stack/data/nova/instances/e815e0b5-e9c8-4ebb-aa85-b79b180595df/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:40:13 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-fcd08ae2-de0b-46cc-9455-3c7c3514e75b tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Lock "/opt/stack/data/nova/instances/e815e0b5-e9c8-4ebb-aa85-b79b180595df/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:40:13 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-fcd08ae2-de0b-46cc-9455-3c7c3514e75b tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Lock "/opt/stack/data/nova/instances/e815e0b5-e9c8-4ebb-aa85-b79b180595df/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:40:13 user nova-compute[75122]: DEBUG nova.policy [None req-fcd08ae2-de0b-46cc-9455-3c7c3514e75b tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7e5545ae1ca743d4ada8e28d28fca540', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8ea42f6a3446e8a8edcf3dcb016b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75122) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 09:40:13 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-fcd08ae2-de0b-46cc-9455-3c7c3514e75b tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:40:13 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-fcd08ae2-de0b-46cc-9455-3c7c3514e75b tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json" returned: 0 in 0.196s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:40:13 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-fcd08ae2-de0b-46cc-9455-3c7c3514e75b tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Acquiring lock "95d6e29f74d5408f818e32f3bc29bc8270a4c665" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:40:13 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-fcd08ae2-de0b-46cc-9455-3c7c3514e75b tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Lock "95d6e29f74d5408f818e32f3bc29bc8270a4c665" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:40:13 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-fcd08ae2-de0b-46cc-9455-3c7c3514e75b tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:40:13 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-fcd08ae2-de0b-46cc-9455-3c7c3514e75b tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json" returned: 0 in 0.202s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:40:13 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-fcd08ae2-de0b-46cc-9455-3c7c3514e75b tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665,backing_fmt=raw /opt/stack/data/nova/instances/e815e0b5-e9c8-4ebb-aa85-b79b180595df/disk 1073741824 {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:40:13 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-fcd08ae2-de0b-46cc-9455-3c7c3514e75b tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665,backing_fmt=raw /opt/stack/data/nova/instances/e815e0b5-e9c8-4ebb-aa85-b79b180595df/disk 1073741824" returned: 0 in 0.067s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:40:13 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-fcd08ae2-de0b-46cc-9455-3c7c3514e75b tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Lock "95d6e29f74d5408f818e32f3bc29bc8270a4c665" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.284s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:40:13 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-fcd08ae2-de0b-46cc-9455-3c7c3514e75b tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:40:13 user nova-compute[75122]: DEBUG nova.network.neutron [None req-fcd08ae2-de0b-46cc-9455-3c7c3514e75b tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] [instance: e815e0b5-e9c8-4ebb-aa85-b79b180595df] Successfully created port: 2ec5e226-5264-46e3-980b-48ab765ecb54 {{(pid=75122) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 09:40:13 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-fcd08ae2-de0b-46cc-9455-3c7c3514e75b tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json" returned: 0 in 0.208s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:40:13 user nova-compute[75122]: DEBUG nova.virt.disk.api [None req-fcd08ae2-de0b-46cc-9455-3c7c3514e75b tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e815e0b5-e9c8-4ebb-aa85-b79b180595df/disk. size=1073741824 {{(pid=75122) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 09:40:13 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-fcd08ae2-de0b-46cc-9455-3c7c3514e75b tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e815e0b5-e9c8-4ebb-aa85-b79b180595df/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:40:14 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-fcd08ae2-de0b-46cc-9455-3c7c3514e75b tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e815e0b5-e9c8-4ebb-aa85-b79b180595df/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:40:14 user nova-compute[75122]: DEBUG nova.virt.disk.api [None req-fcd08ae2-de0b-46cc-9455-3c7c3514e75b tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Cannot resize image /opt/stack/data/nova/instances/e815e0b5-e9c8-4ebb-aa85-b79b180595df/disk to a smaller size. {{(pid=75122) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 09:40:14 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-fcd08ae2-de0b-46cc-9455-3c7c3514e75b tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] [instance: e815e0b5-e9c8-4ebb-aa85-b79b180595df] Created local disks {{(pid=75122) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 09:40:14 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-fcd08ae2-de0b-46cc-9455-3c7c3514e75b tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] [instance: e815e0b5-e9c8-4ebb-aa85-b79b180595df] Ensure instance console log exists: /opt/stack/data/nova/instances/e815e0b5-e9c8-4ebb-aa85-b79b180595df/console.log {{(pid=75122) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 09:40:14 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-fcd08ae2-de0b-46cc-9455-3c7c3514e75b tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:40:14 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-fcd08ae2-de0b-46cc-9455-3c7c3514e75b tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:40:14 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-fcd08ae2-de0b-46cc-9455-3c7c3514e75b tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:40:14 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:40:14 user nova-compute[75122]: DEBUG nova.network.neutron [None req-fcd08ae2-de0b-46cc-9455-3c7c3514e75b tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] [instance: e815e0b5-e9c8-4ebb-aa85-b79b180595df] Successfully updated port: 2ec5e226-5264-46e3-980b-48ab765ecb54 {{(pid=75122) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 09:40:14 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-fcd08ae2-de0b-46cc-9455-3c7c3514e75b tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Acquiring lock "refresh_cache-e815e0b5-e9c8-4ebb-aa85-b79b180595df" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 09:40:14 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-fcd08ae2-de0b-46cc-9455-3c7c3514e75b tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Acquired lock "refresh_cache-e815e0b5-e9c8-4ebb-aa85-b79b180595df" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 09:40:14 user nova-compute[75122]: DEBUG nova.network.neutron [None req-fcd08ae2-de0b-46cc-9455-3c7c3514e75b tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] [instance: e815e0b5-e9c8-4ebb-aa85-b79b180595df] Building network info cache for instance {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 09:40:14 user nova-compute[75122]: DEBUG nova.compute.manager [req-2c3cecd1-cd2d-4647-974e-ec28d215ef85 req-9cf93a8a-1c2b-40ae-9c62-a0e60e89de2b service nova] [instance: e815e0b5-e9c8-4ebb-aa85-b79b180595df] Received event network-changed-2ec5e226-5264-46e3-980b-48ab765ecb54 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:40:14 user nova-compute[75122]: DEBUG nova.compute.manager [req-2c3cecd1-cd2d-4647-974e-ec28d215ef85 req-9cf93a8a-1c2b-40ae-9c62-a0e60e89de2b service nova] [instance: e815e0b5-e9c8-4ebb-aa85-b79b180595df] Refreshing instance network info cache due to event network-changed-2ec5e226-5264-46e3-980b-48ab765ecb54. {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 09:40:14 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-2c3cecd1-cd2d-4647-974e-ec28d215ef85 req-9cf93a8a-1c2b-40ae-9c62-a0e60e89de2b service nova] Acquiring lock "refresh_cache-e815e0b5-e9c8-4ebb-aa85-b79b180595df" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 09:40:14 user nova-compute[75122]: DEBUG nova.network.neutron [None req-fcd08ae2-de0b-46cc-9455-3c7c3514e75b tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] [instance: e815e0b5-e9c8-4ebb-aa85-b79b180595df] Instance cache missing network info. {{(pid=75122) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 09:40:15 user nova-compute[75122]: DEBUG nova.network.neutron [None req-fcd08ae2-de0b-46cc-9455-3c7c3514e75b tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] [instance: e815e0b5-e9c8-4ebb-aa85-b79b180595df] Updating instance_info_cache with network_info: [{"id": "2ec5e226-5264-46e3-980b-48ab765ecb54", "address": "fa:16:3e:38:e8:08", "network": {"id": "cd74302c-bfd9-495b-887f-0de0d94f4ffc", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-692728798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac8ea42f6a3446e8a8edcf3dcb016b84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ec5e226-52", "ovs_interfaceid": "2ec5e226-5264-46e3-980b-48ab765ecb54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:40:15 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-fcd08ae2-de0b-46cc-9455-3c7c3514e75b tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Releasing lock "refresh_cache-e815e0b5-e9c8-4ebb-aa85-b79b180595df" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 09:40:15 user nova-compute[75122]: DEBUG nova.compute.manager [None req-fcd08ae2-de0b-46cc-9455-3c7c3514e75b tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] [instance: e815e0b5-e9c8-4ebb-aa85-b79b180595df] Instance network_info: |[{"id": "2ec5e226-5264-46e3-980b-48ab765ecb54", "address": "fa:16:3e:38:e8:08", "network": {"id": "cd74302c-bfd9-495b-887f-0de0d94f4ffc", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-692728798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac8ea42f6a3446e8a8edcf3dcb016b84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ec5e226-52", "ovs_interfaceid": "2ec5e226-5264-46e3-980b-48ab765ecb54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75122) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 09:40:15 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-2c3cecd1-cd2d-4647-974e-ec28d215ef85 req-9cf93a8a-1c2b-40ae-9c62-a0e60e89de2b service nova] Acquired lock "refresh_cache-e815e0b5-e9c8-4ebb-aa85-b79b180595df" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 09:40:15 user nova-compute[75122]: DEBUG nova.network.neutron [req-2c3cecd1-cd2d-4647-974e-ec28d215ef85 req-9cf93a8a-1c2b-40ae-9c62-a0e60e89de2b service nova] [instance: e815e0b5-e9c8-4ebb-aa85-b79b180595df] Refreshing network info cache for port 2ec5e226-5264-46e3-980b-48ab765ecb54 {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 09:40:15 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-fcd08ae2-de0b-46cc-9455-3c7c3514e75b tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] [instance: e815e0b5-e9c8-4ebb-aa85-b79b180595df] Start _get_guest_xml network_info=[{"id": "2ec5e226-5264-46e3-980b-48ab765ecb54", "address": "fa:16:3e:38:e8:08", "network": {"id": "cd74302c-bfd9-495b-887f-0de0d94f4ffc", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-692728798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac8ea42f6a3446e8a8edcf3dcb016b84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ec5e226-52", "ovs_interfaceid": "2ec5e226-5264-46e3-980b-48ab765ecb54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T09:26:31Z,direct_url=<?>,disk_format='qcow2',id=5e862cfe-47b8-4725-8292-65761ee6d0f5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9c57733cb41847c0b4ad31519c382e5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T09:26:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '5e862cfe-47b8-4725-8292-65761ee6d0f5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75122) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 09:40:15 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-fcd08ae2-de0b-46cc-9455-3c7c3514e75b tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 09:40:15 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-fcd08ae2-de0b-46cc-9455-3c7c3514e75b tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 09:40:15 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-fcd08ae2-de0b-46cc-9455-3c7c3514e75b tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75122) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 09:40:15 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-fcd08ae2-de0b-46cc-9455-3c7c3514e75b tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] CPU controller missing on host. {{(pid=75122) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 09:40:15 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-fcd08ae2-de0b-46cc-9455-3c7c3514e75b tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75122) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 09:40:15 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-fcd08ae2-de0b-46cc-9455-3c7c3514e75b tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] CPU controller found on host. {{(pid=75122) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 09:40:15 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-fcd08ae2-de0b-46cc-9455-3c7c3514e75b tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75122) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 09:40:15 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-fcd08ae2-de0b-46cc-9455-3c7c3514e75b tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T09:26:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T09:26:31Z,direct_url=<?>,disk_format='qcow2',id=5e862cfe-47b8-4725-8292-65761ee6d0f5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9c57733cb41847c0b4ad31519c382e5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T09:26:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 09:40:15 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-fcd08ae2-de0b-46cc-9455-3c7c3514e75b tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Flavor limits 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 09:40:15 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-fcd08ae2-de0b-46cc-9455-3c7c3514e75b tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Image limits 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 09:40:15 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-fcd08ae2-de0b-46cc-9455-3c7c3514e75b tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Flavor pref 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 09:40:15 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-fcd08ae2-de0b-46cc-9455-3c7c3514e75b tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Image pref 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 09:40:15 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-fcd08ae2-de0b-46cc-9455-3c7c3514e75b tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 09:40:15 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-fcd08ae2-de0b-46cc-9455-3c7c3514e75b tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 09:40:15 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-fcd08ae2-de0b-46cc-9455-3c7c3514e75b tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75122) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 09:40:15 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-fcd08ae2-de0b-46cc-9455-3c7c3514e75b tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Got 1 possible topologies {{(pid=75122) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 09:40:15 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-fcd08ae2-de0b-46cc-9455-3c7c3514e75b tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 09:40:15 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-fcd08ae2-de0b-46cc-9455-3c7c3514e75b tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 09:40:15 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-fcd08ae2-de0b-46cc-9455-3c7c3514e75b tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T09:40:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1796816628',display_name='tempest-VolumesSnapshotTestJSON-instance-1796816628',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1796816628',id=25,image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPZVXvYXAy37AlUx2l8+OvR87U0uWeZ7IVch8c1tm509pBcdcHWHvbWlDP+7xy/ZOU+Q7P/i82UvbN0uBDLqc9Qf8f6qHO22W5bjtplvBFauPsGqRoPcA7bzwPuDzOiIuQ==',key_name='tempest-keypair-303809446',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ac8ea42f6a3446e8a8edcf3dcb016b84',ramdisk_id='',reservation_id='r-bh829twx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1852829755',owner_user_name='tempest-VolumesSnapshotTestJSON-1852829755-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T09:40:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7e5545ae1ca743d4ada8e28d28fca540',uuid=e815e0b5-e9c8-4ebb-aa85-b79b180595df,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2ec5e226-5264-46e3-980b-48ab765ecb54", "address": "fa:16:3e:38:e8:08", "network": {"id": "cd74302c-bfd9-495b-887f-0de0d94f4ffc", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-692728798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac8ea42f6a3446e8a8edcf3dcb016b84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ec5e226-52", "ovs_interfaceid": "2ec5e226-5264-46e3-980b-48ab765ecb54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75122) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 09:40:15 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-fcd08ae2-de0b-46cc-9455-3c7c3514e75b tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Converting VIF {"id": "2ec5e226-5264-46e3-980b-48ab765ecb54", "address": "fa:16:3e:38:e8:08", "network": {"id": "cd74302c-bfd9-495b-887f-0de0d94f4ffc", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-692728798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac8ea42f6a3446e8a8edcf3dcb016b84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ec5e226-52", "ovs_interfaceid": "2ec5e226-5264-46e3-980b-48ab765ecb54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 09:40:15 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-fcd08ae2-de0b-46cc-9455-3c7c3514e75b tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:e8:08,bridge_name='br-int',has_traffic_filtering=True,id=2ec5e226-5264-46e3-980b-48ab765ecb54,network=Network(cd74302c-bfd9-495b-887f-0de0d94f4ffc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ec5e226-52') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 09:40:15 user nova-compute[75122]: DEBUG nova.objects.instance [None req-fcd08ae2-de0b-46cc-9455-3c7c3514e75b tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Lazy-loading 'pci_devices' on Instance uuid e815e0b5-e9c8-4ebb-aa85-b79b180595df {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:40:15 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-fcd08ae2-de0b-46cc-9455-3c7c3514e75b tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] [instance: e815e0b5-e9c8-4ebb-aa85-b79b180595df] End _get_guest_xml xml=<domain type="kvm">
Nov 15 09:40:15 user nova-compute[75122]:   <uuid>e815e0b5-e9c8-4ebb-aa85-b79b180595df</uuid>
Nov 15 09:40:15 user nova-compute[75122]:   <name>instance-00000019</name>
Nov 15 09:40:15 user nova-compute[75122]:   <memory>524288</memory>
Nov 15 09:40:15 user nova-compute[75122]:   <vcpu>1</vcpu>
Nov 15 09:40:15 user nova-compute[75122]:   <metadata>
Nov 15 09:40:15 user nova-compute[75122]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 09:40:15 user nova-compute[75122]:       <nova:package version="0.0.0"/>
Nov 15 09:40:15 user nova-compute[75122]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1796816628</nova:name>
Nov 15 09:40:15 user nova-compute[75122]:       <nova:creationTime>2023-11-15 09:40:15</nova:creationTime>
Nov 15 09:40:15 user nova-compute[75122]:       <nova:flavor name="m1.tiny">
Nov 15 09:40:15 user nova-compute[75122]:         <nova:memory>512</nova:memory>
Nov 15 09:40:15 user nova-compute[75122]:         <nova:disk>1</nova:disk>
Nov 15 09:40:15 user nova-compute[75122]:         <nova:swap>0</nova:swap>
Nov 15 09:40:15 user nova-compute[75122]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 09:40:15 user nova-compute[75122]:         <nova:vcpus>1</nova:vcpus>
Nov 15 09:40:15 user nova-compute[75122]:       </nova:flavor>
Nov 15 09:40:15 user nova-compute[75122]:       <nova:owner>
Nov 15 09:40:15 user nova-compute[75122]:         <nova:user uuid="7e5545ae1ca743d4ada8e28d28fca540">tempest-VolumesSnapshotTestJSON-1852829755-project-member</nova:user>
Nov 15 09:40:15 user nova-compute[75122]:         <nova:project uuid="ac8ea42f6a3446e8a8edcf3dcb016b84">tempest-VolumesSnapshotTestJSON-1852829755</nova:project>
Nov 15 09:40:15 user nova-compute[75122]:       </nova:owner>
Nov 15 09:40:15 user nova-compute[75122]:       <nova:root type="image" uuid="5e862cfe-47b8-4725-8292-65761ee6d0f5"/>
Nov 15 09:40:15 user nova-compute[75122]:       <nova:ports>
Nov 15 09:40:15 user nova-compute[75122]:         <nova:port uuid="2ec5e226-5264-46e3-980b-48ab765ecb54">
Nov 15 09:40:15 user nova-compute[75122]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 15 09:40:15 user nova-compute[75122]:         </nova:port>
Nov 15 09:40:15 user nova-compute[75122]:       </nova:ports>
Nov 15 09:40:15 user nova-compute[75122]:     </nova:instance>
Nov 15 09:40:15 user nova-compute[75122]:   </metadata>
Nov 15 09:40:15 user nova-compute[75122]:   <sysinfo type="smbios">
Nov 15 09:40:15 user nova-compute[75122]:     <system>
Nov 15 09:40:15 user nova-compute[75122]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 09:40:15 user nova-compute[75122]:       <entry name="product">OpenStack Nova</entry>
Nov 15 09:40:15 user nova-compute[75122]:       <entry name="version">0.0.0</entry>
Nov 15 09:40:15 user nova-compute[75122]:       <entry name="serial">e815e0b5-e9c8-4ebb-aa85-b79b180595df</entry>
Nov 15 09:40:15 user nova-compute[75122]:       <entry name="uuid">e815e0b5-e9c8-4ebb-aa85-b79b180595df</entry>
Nov 15 09:40:15 user nova-compute[75122]:       <entry name="family">Virtual Machine</entry>
Nov 15 09:40:15 user nova-compute[75122]:     </system>
Nov 15 09:40:15 user nova-compute[75122]:   </sysinfo>
Nov 15 09:40:15 user nova-compute[75122]:   <os>
Nov 15 09:40:15 user nova-compute[75122]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 09:40:15 user nova-compute[75122]:     <boot dev="hd"/>
Nov 15 09:40:15 user nova-compute[75122]:     <smbios mode="sysinfo"/>
Nov 15 09:40:15 user nova-compute[75122]:   </os>
Nov 15 09:40:15 user nova-compute[75122]:   <features>
Nov 15 09:40:15 user nova-compute[75122]:     <acpi/>
Nov 15 09:40:15 user nova-compute[75122]:     <apic/>
Nov 15 09:40:15 user nova-compute[75122]:     <vmcoreinfo/>
Nov 15 09:40:15 user nova-compute[75122]:   </features>
Nov 15 09:40:15 user nova-compute[75122]:   <clock offset="utc">
Nov 15 09:40:15 user nova-compute[75122]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 09:40:15 user nova-compute[75122]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 09:40:15 user nova-compute[75122]:     <timer name="hpet" present="no"/>
Nov 15 09:40:15 user nova-compute[75122]:   </clock>
Nov 15 09:40:15 user nova-compute[75122]:   <cpu mode="custom" match="exact">
Nov 15 09:40:15 user nova-compute[75122]:     <model>Nehalem</model>
Nov 15 09:40:15 user nova-compute[75122]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 09:40:15 user nova-compute[75122]:   </cpu>
Nov 15 09:40:15 user nova-compute[75122]:   <devices>
Nov 15 09:40:15 user nova-compute[75122]:     <disk type="file" device="disk">
Nov 15 09:40:15 user nova-compute[75122]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 09:40:15 user nova-compute[75122]:       <source file="/opt/stack/data/nova/instances/e815e0b5-e9c8-4ebb-aa85-b79b180595df/disk"/>
Nov 15 09:40:15 user nova-compute[75122]:       <target dev="vda" bus="virtio"/>
Nov 15 09:40:15 user nova-compute[75122]:     </disk>
Nov 15 09:40:15 user nova-compute[75122]:     <interface type="ethernet">
Nov 15 09:40:15 user nova-compute[75122]:       <mac address="fa:16:3e:38:e8:08"/>
Nov 15 09:40:15 user nova-compute[75122]:       <model type="virtio"/>
Nov 15 09:40:15 user nova-compute[75122]:       <mtu size="1442"/>
Nov 15 09:40:15 user nova-compute[75122]:       <target dev="tap2ec5e226-52"/>
Nov 15 09:40:15 user nova-compute[75122]:     </interface>
Nov 15 09:40:15 user nova-compute[75122]:     <serial type="pty">
Nov 15 09:40:15 user nova-compute[75122]:       <log file="/opt/stack/data/nova/instances/e815e0b5-e9c8-4ebb-aa85-b79b180595df/console.log" append="off"/>
Nov 15 09:40:15 user nova-compute[75122]:     </serial>
Nov 15 09:40:15 user nova-compute[75122]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 09:40:15 user nova-compute[75122]:     <video>
Nov 15 09:40:15 user nova-compute[75122]:       <model type="virtio"/>
Nov 15 09:40:15 user nova-compute[75122]:     </video>
Nov 15 09:40:15 user nova-compute[75122]:     <rng model="virtio">
Nov 15 09:40:15 user nova-compute[75122]:       <backend model="random">/dev/urandom</backend>
Nov 15 09:40:15 user nova-compute[75122]:     </rng>
Nov 15 09:40:15 user nova-compute[75122]:     <controller type="usb" index="0" model="none"/>
Nov 15 09:40:15 user nova-compute[75122]:     <memballoon model="virtio">
Nov 15 09:40:15 user nova-compute[75122]:       <stats period="10"/>
Nov 15 09:40:15 user nova-compute[75122]:     </memballoon>
Nov 15 09:40:15 user nova-compute[75122]:   </devices>
Nov 15 09:40:15 user nova-compute[75122]: </domain>
Nov 15 09:40:15 user nova-compute[75122]:  {{(pid=75122) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 09:40:15 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-fcd08ae2-de0b-46cc-9455-3c7c3514e75b tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T09:40:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1796816628',display_name='tempest-VolumesSnapshotTestJSON-instance-1796816628',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1796816628',id=25,image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPZVXvYXAy37AlUx2l8+OvR87U0uWeZ7IVch8c1tm509pBcdcHWHvbWlDP+7xy/ZOU+Q7P/i82UvbN0uBDLqc9Qf8f6qHO22W5bjtplvBFauPsGqRoPcA7bzwPuDzOiIuQ==',key_name='tempest-keypair-303809446',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ac8ea42f6a3446e8a8edcf3dcb016b84',ramdisk_id='',reservation_id='r-bh829twx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1852829755',owner_user_name='tempest-VolumesSnapshotTestJSON-1852829755-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T09:40:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7e5545ae1ca743d4ada8e28d28fca540',uuid=e815e0b5-e9c8-4ebb-aa85-b79b180595df,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2ec5e226-5264-46e3-980b-48ab765ecb54", "address": "fa:16:3e:38:e8:08", "network": {"id": "cd74302c-bfd9-495b-887f-0de0d94f4ffc", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-692728798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac8ea42f6a3446e8a8edcf3dcb016b84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ec5e226-52", "ovs_interfaceid": "2ec5e226-5264-46e3-980b-48ab765ecb54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 09:40:15 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-fcd08ae2-de0b-46cc-9455-3c7c3514e75b tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Converting VIF {"id": "2ec5e226-5264-46e3-980b-48ab765ecb54", "address": "fa:16:3e:38:e8:08", "network": {"id": "cd74302c-bfd9-495b-887f-0de0d94f4ffc", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-692728798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac8ea42f6a3446e8a8edcf3dcb016b84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ec5e226-52", "ovs_interfaceid": "2ec5e226-5264-46e3-980b-48ab765ecb54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 09:40:15 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-fcd08ae2-de0b-46cc-9455-3c7c3514e75b tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:38:e8:08,bridge_name='br-int',has_traffic_filtering=True,id=2ec5e226-5264-46e3-980b-48ab765ecb54,network=Network(cd74302c-bfd9-495b-887f-0de0d94f4ffc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ec5e226-52') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 09:40:15 user nova-compute[75122]: DEBUG os_vif [None req-fcd08ae2-de0b-46cc-9455-3c7c3514e75b tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:e8:08,bridge_name='br-int',has_traffic_filtering=True,id=2ec5e226-5264-46e3-980b-48ab765ecb54,network=Network(cd74302c-bfd9-495b-887f-0de0d94f4ffc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ec5e226-52') {{(pid=75122) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 09:40:15 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:40:15 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:40:15 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 09:40:15 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:40:15 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cbc91246-30dd-5f2e-bfb3-6a5c5dbba0c6', '_type': 'linux-noop'}}, row=False) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:40:15 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:40:15 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:40:15 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:40:15 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2ec5e226-52, may_exist=True, interface_attrs={}) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:40:15 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2ec5e226-52, col_values=(('qos', UUID('1c8e31e2-825a-4e4b-a134-08dc03046867')),), if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:40:15 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2ec5e226-52, col_values=(('external_ids', {'iface-id': '2ec5e226-5264-46e3-980b-48ab765ecb54', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:38:e8:08', 'vm-uuid': 'e815e0b5-e9c8-4ebb-aa85-b79b180595df'}),), if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:40:15 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:40:15 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:40:15 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:40:15 user nova-compute[75122]: INFO os_vif [None req-fcd08ae2-de0b-46cc-9455-3c7c3514e75b tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:38:e8:08,bridge_name='br-int',has_traffic_filtering=True,id=2ec5e226-5264-46e3-980b-48ab765ecb54,network=Network(cd74302c-bfd9-495b-887f-0de0d94f4ffc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ec5e226-52')
Nov 15 09:40:15 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:40:15 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75122) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 09:40:15 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-fcd08ae2-de0b-46cc-9455-3c7c3514e75b tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] No BDM found with device name vda, not building metadata. {{(pid=75122) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 09:40:15 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-fcd08ae2-de0b-46cc-9455-3c7c3514e75b tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] No VIF found with MAC fa:16:3e:38:e8:08, not building metadata {{(pid=75122) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 09:40:15 user nova-compute[75122]: DEBUG nova.network.neutron [req-2c3cecd1-cd2d-4647-974e-ec28d215ef85 req-9cf93a8a-1c2b-40ae-9c62-a0e60e89de2b service nova] [instance: e815e0b5-e9c8-4ebb-aa85-b79b180595df] Updated VIF entry in instance network info cache for port 2ec5e226-5264-46e3-980b-48ab765ecb54. {{(pid=75122) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 09:40:15 user nova-compute[75122]: DEBUG nova.network.neutron [req-2c3cecd1-cd2d-4647-974e-ec28d215ef85 req-9cf93a8a-1c2b-40ae-9c62-a0e60e89de2b service nova] [instance: e815e0b5-e9c8-4ebb-aa85-b79b180595df] Updating instance_info_cache with network_info: [{"id": "2ec5e226-5264-46e3-980b-48ab765ecb54", "address": "fa:16:3e:38:e8:08", "network": {"id": "cd74302c-bfd9-495b-887f-0de0d94f4ffc", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-692728798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac8ea42f6a3446e8a8edcf3dcb016b84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ec5e226-52", "ovs_interfaceid": "2ec5e226-5264-46e3-980b-48ab765ecb54", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:40:15 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-2c3cecd1-cd2d-4647-974e-ec28d215ef85 req-9cf93a8a-1c2b-40ae-9c62-a0e60e89de2b service nova] Releasing lock "refresh_cache-e815e0b5-e9c8-4ebb-aa85-b79b180595df" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 09:40:15 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:40:16 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:40:16 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Starting heal instance info cache {{(pid=75122) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 09:40:16 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Didn't find any instances for network info cache update. {{(pid=75122) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 15 09:40:16 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:40:16 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:40:16 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:40:16 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:40:16 user nova-compute[75122]: DEBUG nova.compute.manager [req-cc675f9c-ab4a-4caa-9193-31801ba482f0 req-9059616b-f12e-44b4-9846-488c65c2f77a service nova] [instance: e815e0b5-e9c8-4ebb-aa85-b79b180595df] Received event network-vif-plugged-2ec5e226-5264-46e3-980b-48ab765ecb54 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:40:16 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-cc675f9c-ab4a-4caa-9193-31801ba482f0 req-9059616b-f12e-44b4-9846-488c65c2f77a service nova] Acquiring lock "e815e0b5-e9c8-4ebb-aa85-b79b180595df-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:40:16 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-cc675f9c-ab4a-4caa-9193-31801ba482f0 req-9059616b-f12e-44b4-9846-488c65c2f77a service nova] Lock "e815e0b5-e9c8-4ebb-aa85-b79b180595df-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:40:16 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-cc675f9c-ab4a-4caa-9193-31801ba482f0 req-9059616b-f12e-44b4-9846-488c65c2f77a service nova] Lock "e815e0b5-e9c8-4ebb-aa85-b79b180595df-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:40:16 user nova-compute[75122]: DEBUG nova.compute.manager [req-cc675f9c-ab4a-4caa-9193-31801ba482f0 req-9059616b-f12e-44b4-9846-488c65c2f77a service nova] [instance: e815e0b5-e9c8-4ebb-aa85-b79b180595df] No waiting events found dispatching network-vif-plugged-2ec5e226-5264-46e3-980b-48ab765ecb54 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:40:16 user nova-compute[75122]: WARNING nova.compute.manager [req-cc675f9c-ab4a-4caa-9193-31801ba482f0 req-9059616b-f12e-44b4-9846-488c65c2f77a service nova] [instance: e815e0b5-e9c8-4ebb-aa85-b79b180595df] Received unexpected event network-vif-plugged-2ec5e226-5264-46e3-980b-48ab765ecb54 for instance with vm_state building and task_state spawning.
Nov 15 09:40:17 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:40:17 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:40:18 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:40:18 user nova-compute[75122]: DEBUG nova.compute.manager [None req-fcd08ae2-de0b-46cc-9455-3c7c3514e75b tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] [instance: e815e0b5-e9c8-4ebb-aa85-b79b180595df] Instance event wait completed in 0 seconds for  {{(pid=75122) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 09:40:18 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-fcd08ae2-de0b-46cc-9455-3c7c3514e75b tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] [instance: e815e0b5-e9c8-4ebb-aa85-b79b180595df] Guest created on hypervisor {{(pid=75122) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 09:40:18 user nova-compute[75122]: INFO nova.virt.libvirt.driver [-] [instance: e815e0b5-e9c8-4ebb-aa85-b79b180595df] Instance spawned successfully.
Nov 15 09:40:18 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-fcd08ae2-de0b-46cc-9455-3c7c3514e75b tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] [instance: e815e0b5-e9c8-4ebb-aa85-b79b180595df] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 09:40:18 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-fcd08ae2-de0b-46cc-9455-3c7c3514e75b tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] [instance: e815e0b5-e9c8-4ebb-aa85-b79b180595df] Found default for hw_cdrom_bus of ide {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:40:18 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-fcd08ae2-de0b-46cc-9455-3c7c3514e75b tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] [instance: e815e0b5-e9c8-4ebb-aa85-b79b180595df] Found default for hw_disk_bus of virtio {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:40:18 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-fcd08ae2-de0b-46cc-9455-3c7c3514e75b tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] [instance: e815e0b5-e9c8-4ebb-aa85-b79b180595df] Found default for hw_input_bus of None {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:40:18 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-fcd08ae2-de0b-46cc-9455-3c7c3514e75b tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] [instance: e815e0b5-e9c8-4ebb-aa85-b79b180595df] Found default for hw_pointer_model of None {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:40:18 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-fcd08ae2-de0b-46cc-9455-3c7c3514e75b tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] [instance: e815e0b5-e9c8-4ebb-aa85-b79b180595df] Found default for hw_video_model of virtio {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:40:18 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-fcd08ae2-de0b-46cc-9455-3c7c3514e75b tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] [instance: e815e0b5-e9c8-4ebb-aa85-b79b180595df] Found default for hw_vif_model of virtio {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:40:18 user nova-compute[75122]: INFO nova.compute.manager [None req-fcd08ae2-de0b-46cc-9455-3c7c3514e75b tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] [instance: e815e0b5-e9c8-4ebb-aa85-b79b180595df] Took 5.60 seconds to spawn the instance on the hypervisor.
Nov 15 09:40:18 user nova-compute[75122]: DEBUG nova.compute.manager [None req-fcd08ae2-de0b-46cc-9455-3c7c3514e75b tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] [instance: e815e0b5-e9c8-4ebb-aa85-b79b180595df] Checking state {{(pid=75122) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 09:40:18 user nova-compute[75122]: DEBUG nova.compute.manager [req-d3013789-d98b-4681-bd83-8293e6400131 req-90d01b4d-9d65-4877-9b8a-ed97d00c7fbf service nova] [instance: e815e0b5-e9c8-4ebb-aa85-b79b180595df] Received event network-vif-plugged-2ec5e226-5264-46e3-980b-48ab765ecb54 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:40:18 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-d3013789-d98b-4681-bd83-8293e6400131 req-90d01b4d-9d65-4877-9b8a-ed97d00c7fbf service nova] Acquiring lock "e815e0b5-e9c8-4ebb-aa85-b79b180595df-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:40:18 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-d3013789-d98b-4681-bd83-8293e6400131 req-90d01b4d-9d65-4877-9b8a-ed97d00c7fbf service nova] Lock "e815e0b5-e9c8-4ebb-aa85-b79b180595df-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:40:18 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-d3013789-d98b-4681-bd83-8293e6400131 req-90d01b4d-9d65-4877-9b8a-ed97d00c7fbf service nova] Lock "e815e0b5-e9c8-4ebb-aa85-b79b180595df-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:40:18 user nova-compute[75122]: DEBUG nova.compute.manager [req-d3013789-d98b-4681-bd83-8293e6400131 req-90d01b4d-9d65-4877-9b8a-ed97d00c7fbf service nova] [instance: e815e0b5-e9c8-4ebb-aa85-b79b180595df] No waiting events found dispatching network-vif-plugged-2ec5e226-5264-46e3-980b-48ab765ecb54 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:40:18 user nova-compute[75122]: WARNING nova.compute.manager [req-d3013789-d98b-4681-bd83-8293e6400131 req-90d01b4d-9d65-4877-9b8a-ed97d00c7fbf service nova] [instance: e815e0b5-e9c8-4ebb-aa85-b79b180595df] Received unexpected event network-vif-plugged-2ec5e226-5264-46e3-980b-48ab765ecb54 for instance with vm_state building and task_state spawning.
Nov 15 09:40:18 user nova-compute[75122]: INFO nova.compute.manager [None req-fcd08ae2-de0b-46cc-9455-3c7c3514e75b tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] [instance: e815e0b5-e9c8-4ebb-aa85-b79b180595df] Took 6.41 seconds to build instance.
Nov 15 09:40:18 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-fcd08ae2-de0b-46cc-9455-3c7c3514e75b tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Lock "e815e0b5-e9c8-4ebb-aa85-b79b180595df" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.503s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:40:19 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:40:19 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:40:20 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:40:20 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:40:20 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:40:20 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:40:20 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:40:20 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75122) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 09:40:20 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2f45f49-0bca-4ae2-bc2a-eed293143489/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:40:20 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2f45f49-0bca-4ae2-bc2a-eed293143489/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:40:20 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2f45f49-0bca-4ae2-bc2a-eed293143489/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:40:20 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2f45f49-0bca-4ae2-bc2a-eed293143489/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:40:20 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/594aff52-4f70-48bc-9a7d-87b984e223b8/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:40:20 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:40:20 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/594aff52-4f70-48bc-9a7d-87b984e223b8/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:40:20 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/594aff52-4f70-48bc-9a7d-87b984e223b8/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:40:21 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/594aff52-4f70-48bc-9a7d-87b984e223b8/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:40:21 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd9d52bb-6248-48e6-a798-6dbdaaa68cbc/disk.rescue --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:40:21 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd9d52bb-6248-48e6-a798-6dbdaaa68cbc/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:40:21 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd9d52bb-6248-48e6-a798-6dbdaaa68cbc/disk.rescue --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:40:21 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd9d52bb-6248-48e6-a798-6dbdaaa68cbc/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:40:21 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd9d52bb-6248-48e6-a798-6dbdaaa68cbc/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:40:21 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd9d52bb-6248-48e6-a798-6dbdaaa68cbc/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:40:21 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd9d52bb-6248-48e6-a798-6dbdaaa68cbc/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:40:21 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd9d52bb-6248-48e6-a798-6dbdaaa68cbc/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:40:21 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75122) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 09:40:21 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5a4d58-ba1e-473d-a32a-06fae1c84efc/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:40:22 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5a4d58-ba1e-473d-a32a-06fae1c84efc/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:40:22 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5a4d58-ba1e-473d-a32a-06fae1c84efc/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:40:22 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5a4d58-ba1e-473d-a32a-06fae1c84efc/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:40:22 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75122) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 09:40:22 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5a4d58-ba1e-473d-a32a-06fae1c84efc/disk.rescue --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:40:22 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-74c7dcc5-236a-40fa-a801-73b6300c43d1 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance c2f45f49-0bca-4ae2-bc2a-eed293143489 is timed out.
Nov 15 09:40:22 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-74c7dcc5-236a-40fa-a801-73b6300c43d1 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Successfully detached device vdb from instance c2f45f49-0bca-4ae2-bc2a-eed293143489 from the live domain config.
Nov 15 09:40:22 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-74c7dcc5-236a-40fa-a801-73b6300c43d1 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] [instance: c2f45f49-0bca-4ae2-bc2a-eed293143489] calling os-brick to detach iSCSI Volume {{(pid=75122) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 09:40:22 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-74c7dcc5-236a-40fa-a801-73b6300c43d1 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffa04060b80>, {'target_iqn': 'iqn.2010-10.org.openstack:984b3190-31e5-432a-9602-cedead354720', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jCqyxEzX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 09:40:22 user nova-compute[75122]: WARNING os_brick.initiator.connectors.base [None req-74c7dcc5-236a-40fa-a801-73b6300c43d1 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 09:40:22 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-74c7dcc5-236a-40fa-a801-73b6300c43d1 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 09:40:22 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-74c7dcc5-236a-40fa-a801-73b6300c43d1 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 09:40:22 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:40:22 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:40:22 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[bce2d280-e6ca-4f42-a6c2-5e2ae0a97a2f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:395810b1-e3c3-4660-aaaf-b6d9e7cb5a88\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0b366dd5-506b-4ee0-9e25-990a31acf3eb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:984b3190-31e5-432a-9602-cedead354720\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fdf09a1b-a065-4b88-815d-ee54c1c68464\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:40:22 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-74c7dcc5-236a-40fa-a801-73b6300c43d1 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 09:40:22 user nova-compute[75122]: No targets found.
Nov 15 09:40:22 user nova-compute[75122]: iSNS:
Nov 15 09:40:22 user nova-compute[75122]: No targets found.
Nov 15 09:40:22 user nova-compute[75122]: STATIC:
Nov 15 09:40:22 user nova-compute[75122]: Target: iqn.2010-10.org.openstack:395810b1-e3c3-4660-aaaf-b6d9e7cb5a88
Nov 15 09:40:22 user nova-compute[75122]:         Portal: 172.16.0.220:3260,-1
Nov 15 09:40:22 user nova-compute[75122]:                 Iface Name: default
Nov 15 09:40:22 user nova-compute[75122]: Target: iqn.2010-10.org.openstack:0b366dd5-506b-4ee0-9e25-990a31acf3eb
Nov 15 09:40:22 user nova-compute[75122]:         Portal: 172.16.0.220:3260,-1
Nov 15 09:40:22 user nova-compute[75122]:                 Iface Name: default
Nov 15 09:40:22 user nova-compute[75122]: Target: iqn.2010-10.org.openstack:984b3190-31e5-432a-9602-cedead354720
Nov 15 09:40:22 user nova-compute[75122]:         Portal: 172.16.0.220:3260,-1
Nov 15 09:40:22 user nova-compute[75122]:                 Iface Name: default
Nov 15 09:40:22 user nova-compute[75122]: Target: iqn.2010-10.org.openstack:fdf09a1b-a065-4b88-815d-ee54c1c68464
Nov 15 09:40:22 user nova-compute[75122]:         Portal: 172.16.0.220:3260,-1
Nov 15 09:40:22 user nova-compute[75122]:                 Iface Name: default
Nov 15 09:40:22 user nova-compute[75122]: FIRMWARE:
Nov 15 09:40:22 user nova-compute[75122]: No targets found.
Nov 15 09:40:22 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 09:40:22 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-74c7dcc5-236a-40fa-a801-73b6300c43d1 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 09:40:22 user nova-compute[75122]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 09:40:22 user nova-compute[75122]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75122) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 09:40:22 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-74c7dcc5-236a-40fa-a801-73b6300c43d1 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:984b3190-31e5-432a-9602-cedead354720', 0)] {{(pid=75122) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 09:40:22 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:40:22 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:40:22 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[be031cdb-5fbc-43d0-9730-58d30660ecd8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0b366dd5-506b-4ee0-9e25-990a31acf3eb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:395810b1-e3c3-4660-aaaf-b6d9e7cb5a88\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:984b3190-31e5-432a-9602-cedead354720\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fdf09a1b-a065-4b88-815d-ee54c1c68464\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:40:22 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:40:22 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:40:22 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6827f75-9503-4dd7-b3e9-245f0a3d61d4]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b366dd5-506b-4ee0-9e25-990a31acf3eb (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdf09a1b-a065-4b88-815d-ee54c1c68464 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:984b3190-31e5-432a-9602-cedead354720 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:395810b1-e3c3-4660-aaaf-b6d9e7cb5a88 (non-flash)\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:40:22 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-74c7dcc5-236a-40fa-a801-73b6300c43d1 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b366dd5-506b-4ee0-9e25-990a31acf3eb (non-flash)
Nov 15 09:40:22 user nova-compute[75122]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdf09a1b-a065-4b88-815d-ee54c1c68464 (non-flash)
Nov 15 09:40:22 user nova-compute[75122]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:984b3190-31e5-432a-9602-cedead354720 (non-flash)
Nov 15 09:40:22 user nova-compute[75122]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:395810b1-e3c3-4660-aaaf-b6d9e7cb5a88 (non-flash)
Nov 15 09:40:22 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 09:40:22 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-74c7dcc5-236a-40fa-a801-73b6300c43d1 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b366dd5-506b-4ee0-9e25-990a31acf3eb (non-flash)
Nov 15 09:40:22 user nova-compute[75122]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdf09a1b-a065-4b88-815d-ee54c1c68464 (non-flash)
Nov 15 09:40:22 user nova-compute[75122]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:984b3190-31e5-432a-9602-cedead354720 (non-flash)
Nov 15 09:40:22 user nova-compute[75122]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:395810b1-e3c3-4660-aaaf-b6d9e7cb5a88 (non-flash)
Nov 15 09:40:22 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 09:40:22 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-74c7dcc5-236a-40fa-a801-73b6300c43d1 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff9e45e9bd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:984b3190-31e5-432a-9602-cedead354720'): ({'sdc'}, set())}) {{(pid=75122) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 09:40:22 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-74c7dcc5-236a-40fa-a801-73b6300c43d1 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Removing single pathed devices sdc {{(pid=75122) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 09:40:22 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:40:22 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:40:22 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[30b842c9-e480-4f1e-8478-a4008359e84e]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:40:22 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:40:22 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5a4d58-ba1e-473d-a32a-06fae1c84efc/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:40:22 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5a4d58-ba1e-473d-a32a-06fae1c84efc/disk.rescue --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:40:22 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:40:22 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[259cf261-1a58-4b45-afd6-b20778131626]: (4, ('ok\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:40:22 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-74c7dcc5-236a-40fa-a801-73b6300c43d1 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Flushing IO for device /dev/sdc {{(pid=75122) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 09:40:22 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:40:22 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:40:22 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bd7b24e-ffe7-472e-b575-2c0589487397]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:40:22 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-74c7dcc5-236a-40fa-a801-73b6300c43d1 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75122) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 09:40:22 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:40:22 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.043s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:40:22 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7389ee7-cdc7-4633-a36e-660af02f0b53]: (4, ('1', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:40:22 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-74c7dcc5-236a-40fa-a801-73b6300c43d1 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75122) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 09:40:22 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-74c7dcc5-236a-40fa-a801-73b6300c43d1 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] SCSI volumes sdc have been removed. {{(pid=75122) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 09:40:22 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-74c7dcc5-236a-40fa-a801-73b6300c43d1 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:984b3190-31e5-432a-9602-cedead354720')] {{(pid=75122) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 09:40:22 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:984b3190-31e5-432a-9602-cedead354720 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:40:22 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:984b3190-31e5-432a-9602-cedead354720 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.108s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:40:22 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b60d94f-8f14-4992-824e-ee7aafb15cf0]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:40:22 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-74c7dcc5-236a-40fa-a801-73b6300c43d1 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:40:22 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:984b3190-31e5-432a-9602-cedead354720 -p 172.16.0.220:3260 --logout {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:40:22 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5a4d58-ba1e-473d-a32a-06fae1c84efc/disk.rescue --force-share --output=json" returned: 0 in 0.225s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:40:22 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df913b3e-218d-4ae6-b7b3-70f64fdd3896/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:40:22 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:984b3190-31e5-432a-9602-cedead354720 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:40:22 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[587cd080-82c7-4708-bf26-31b52ff99cd9]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:984b3190-31e5-432a-9602-cedead354720, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:984b3190-31e5-432a-9602-cedead354720, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:40:22 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-74c7dcc5-236a-40fa-a801-73b6300c43d1 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:984b3190-31e5-432a-9602-cedead354720, portal: 172.16.0.220,3260]
Nov 15 09:40:22 user nova-compute[75122]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:984b3190-31e5-432a-9602-cedead354720, portal: 172.16.0.220,3260] successful.
Nov 15 09:40:22 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:40:22 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:984b3190-31e5-432a-9602-cedead354720 -p 172.16.0.220:3260 --op delete {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:40:22 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:984b3190-31e5-432a-9602-cedead354720 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:40:22 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[a28806b6-75df-440e-853d-5a0394f291a6]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:40:22 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-74c7dcc5-236a-40fa-a801-73b6300c43d1 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:40:22 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-74c7dcc5-236a-40fa-a801-73b6300c43d1 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.459s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 09:40:22 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-74c7dcc5-236a-40fa-a801-73b6300c43d1 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] <== disconnect_volume: return (461ms) None {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 09:40:22 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-74c7dcc5-236a-40fa-a801-73b6300c43d1 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] [instance: c2f45f49-0bca-4ae2-bc2a-eed293143489] Disconnected iSCSI Volume {{(pid=75122) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 09:40:22 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df913b3e-218d-4ae6-b7b3-70f64fdd3896/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:40:22 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df913b3e-218d-4ae6-b7b3-70f64fdd3896/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:40:23 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df913b3e-218d-4ae6-b7b3-70f64fdd3896/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:40:23 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75122) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 09:40:23 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e19f9e1-69c6-4590-85d2-e90cbdbb3d80/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:40:23 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e19f9e1-69c6-4590-85d2-e90cbdbb3d80/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:40:23 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e19f9e1-69c6-4590-85d2-e90cbdbb3d80/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:40:23 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e19f9e1-69c6-4590-85d2-e90cbdbb3d80/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:40:23 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/131142fd-e8ec-42d1-a518-aa21c7bb7cb1/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:40:23 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/131142fd-e8ec-42d1-a518-aa21c7bb7cb1/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:40:23 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/131142fd-e8ec-42d1-a518-aa21c7bb7cb1/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:40:23 user nova-compute[75122]: DEBUG nova.objects.instance [None req-74c7dcc5-236a-40fa-a801-73b6300c43d1 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Lazy-loading 'flavor' on Instance uuid c2f45f49-0bca-4ae2-bc2a-eed293143489 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:40:23 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-74c7dcc5-236a-40fa-a801-73b6300c43d1 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Lock "c2f45f49-0bca-4ae2-bc2a-eed293143489" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.415s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:40:23 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/131142fd-e8ec-42d1-a518-aa21c7bb7cb1/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:40:23 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e815e0b5-e9c8-4ebb-aa85-b79b180595df/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:40:24 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e815e0b5-e9c8-4ebb-aa85-b79b180595df/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:40:24 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e815e0b5-e9c8-4ebb-aa85-b79b180595df/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:40:24 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e815e0b5-e9c8-4ebb-aa85-b79b180595df/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:40:24 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00270cc2-4f5b-4f64-8f88-31f21e3b3950/disk.rescue --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:40:24 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00270cc2-4f5b-4f64-8f88-31f21e3b3950/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:40:24 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00270cc2-4f5b-4f64-8f88-31f21e3b3950/disk.rescue --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:40:24 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00270cc2-4f5b-4f64-8f88-31f21e3b3950/disk.rescue --force-share --output=json" returned: 0 in 0.324s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:40:24 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00270cc2-4f5b-4f64-8f88-31f21e3b3950/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:40:25 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00270cc2-4f5b-4f64-8f88-31f21e3b3950/disk --force-share --output=json" returned: 0 in 0.341s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:40:25 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00270cc2-4f5b-4f64-8f88-31f21e3b3950/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:40:25 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:40:25 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00270cc2-4f5b-4f64-8f88-31f21e3b3950/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:40:25 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 09:40:25 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 09:40:25 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Hypervisor/Node resource view: name=user free_ram=7518MB free_disk=25.29979705810547GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75122) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 09:40:25 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:40:25 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:40:25 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance 131142fd-e8ec-42d1-a518-aa21c7bb7cb1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:40:25 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance 5b5a4d58-ba1e-473d-a32a-06fae1c84efc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:40:25 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance 1e19f9e1-69c6-4590-85d2-e90cbdbb3d80 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:40:25 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance fd9d52bb-6248-48e6-a798-6dbdaaa68cbc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:40:25 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance 00270cc2-4f5b-4f64-8f88-31f21e3b3950 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:40:25 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance df913b3e-218d-4ae6-b7b3-70f64fdd3896 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:40:25 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance c2f45f49-0bca-4ae2-bc2a-eed293143489 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:40:25 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance 594aff52-4f70-48bc-9a7d-87b984e223b8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:40:25 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance e1afe5d4-42c0-491c-b1c7-c8debf1d5da2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:40:25 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance e815e0b5-e9c8-4ebb-aa85-b79b180595df actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:40:25 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75122) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 09:40:25 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75122) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 09:40:25 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:40:26 user nova-compute[75122]: DEBUG nova.compute.provider_tree [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Inventory has not changed in ProviderTree for provider: 69a3da65-47be-44c6-b67c-c692b58284ef {{(pid=75122) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 09:40:26 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Inventory has not changed for provider 69a3da65-47be-44c6-b67c-c692b58284ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 09:40:26 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Compute_service record updated for user:user {{(pid=75122) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 09:40:26 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.449s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:40:30 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:40:30 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:40:30 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:40:35 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:40:35 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:40:40 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:40:40 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:40:41 user nova-compute[75122]: INFO nova.compute.manager [None req-5cb3653b-5998-4662-befa-c0a1b70e516a tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] [instance: 5b5a4d58-ba1e-473d-a32a-06fae1c84efc] Unrescuing
Nov 15 09:40:41 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-5cb3653b-5998-4662-befa-c0a1b70e516a tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] Acquiring lock "refresh_cache-5b5a4d58-ba1e-473d-a32a-06fae1c84efc" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 09:40:41 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-5cb3653b-5998-4662-befa-c0a1b70e516a tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] Acquired lock "refresh_cache-5b5a4d58-ba1e-473d-a32a-06fae1c84efc" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 09:40:41 user nova-compute[75122]: DEBUG nova.network.neutron [None req-5cb3653b-5998-4662-befa-c0a1b70e516a tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] [instance: 5b5a4d58-ba1e-473d-a32a-06fae1c84efc] Building network info cache for instance {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 09:40:41 user nova-compute[75122]: DEBUG nova.network.neutron [None req-5cb3653b-5998-4662-befa-c0a1b70e516a tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] [instance: 5b5a4d58-ba1e-473d-a32a-06fae1c84efc] Updating instance_info_cache with network_info: [{"id": "b245a5c2-e523-4d4e-a343-f5b2352337ab", "address": "fa:16:3e:cd:ac:71", "network": {"id": "53e8c131-26be-4b3f-beca-dd48fe06ffbe", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-888345656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6aed61f0071f44ac901b94cd9a4a909d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb245a5c2-e5", "ovs_interfaceid": "b245a5c2-e523-4d4e-a343-f5b2352337ab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:40:41 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-5cb3653b-5998-4662-befa-c0a1b70e516a tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] Releasing lock "refresh_cache-5b5a4d58-ba1e-473d-a32a-06fae1c84efc" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 09:40:41 user nova-compute[75122]: DEBUG nova.objects.instance [None req-5cb3653b-5998-4662-befa-c0a1b70e516a tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] Lazy-loading 'flavor' on Instance uuid 5b5a4d58-ba1e-473d-a32a-06fae1c84efc {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:40:42 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:40:42 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:40:42 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:40:42 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:40:42 user nova-compute[75122]: DEBUG nova.compute.manager [req-e6193737-1985-49c7-b567-34e6a406def8 req-65702a0d-30c6-4eee-ad2e-13bb1491db58 service nova] [instance: 5b5a4d58-ba1e-473d-a32a-06fae1c84efc] Received event network-vif-unplugged-b245a5c2-e523-4d4e-a343-f5b2352337ab {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:40:42 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-e6193737-1985-49c7-b567-34e6a406def8 req-65702a0d-30c6-4eee-ad2e-13bb1491db58 service nova] Acquiring lock "5b5a4d58-ba1e-473d-a32a-06fae1c84efc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:40:42 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-e6193737-1985-49c7-b567-34e6a406def8 req-65702a0d-30c6-4eee-ad2e-13bb1491db58 service nova] Lock "5b5a4d58-ba1e-473d-a32a-06fae1c84efc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:40:42 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-e6193737-1985-49c7-b567-34e6a406def8 req-65702a0d-30c6-4eee-ad2e-13bb1491db58 service nova] Lock "5b5a4d58-ba1e-473d-a32a-06fae1c84efc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:40:42 user nova-compute[75122]: DEBUG nova.compute.manager [req-e6193737-1985-49c7-b567-34e6a406def8 req-65702a0d-30c6-4eee-ad2e-13bb1491db58 service nova] [instance: 5b5a4d58-ba1e-473d-a32a-06fae1c84efc] No waiting events found dispatching network-vif-unplugged-b245a5c2-e523-4d4e-a343-f5b2352337ab {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:40:42 user nova-compute[75122]: WARNING nova.compute.manager [req-e6193737-1985-49c7-b567-34e6a406def8 req-65702a0d-30c6-4eee-ad2e-13bb1491db58 service nova] [instance: 5b5a4d58-ba1e-473d-a32a-06fae1c84efc] Received unexpected event network-vif-unplugged-b245a5c2-e523-4d4e-a343-f5b2352337ab for instance with vm_state rescued and task_state unrescuing.
Nov 15 09:40:42 user nova-compute[75122]: DEBUG nova.compute.manager [req-d04890d2-e36d-4fdd-9cb2-a99cca65546c req-a4a409e9-a429-4bc3-b515-413b3e5f7142 service nova] [instance: 5b5a4d58-ba1e-473d-a32a-06fae1c84efc] Received event network-changed-b245a5c2-e523-4d4e-a343-f5b2352337ab {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:40:42 user nova-compute[75122]: DEBUG nova.compute.manager [req-d04890d2-e36d-4fdd-9cb2-a99cca65546c req-a4a409e9-a429-4bc3-b515-413b3e5f7142 service nova] [instance: 5b5a4d58-ba1e-473d-a32a-06fae1c84efc] Refreshing instance network info cache due to event network-changed-b245a5c2-e523-4d4e-a343-f5b2352337ab. {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 09:40:42 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-d04890d2-e36d-4fdd-9cb2-a99cca65546c req-a4a409e9-a429-4bc3-b515-413b3e5f7142 service nova] Acquiring lock "refresh_cache-5b5a4d58-ba1e-473d-a32a-06fae1c84efc" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 09:40:42 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-d04890d2-e36d-4fdd-9cb2-a99cca65546c req-a4a409e9-a429-4bc3-b515-413b3e5f7142 service nova] Acquired lock "refresh_cache-5b5a4d58-ba1e-473d-a32a-06fae1c84efc" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 09:40:42 user nova-compute[75122]: DEBUG nova.network.neutron [req-d04890d2-e36d-4fdd-9cb2-a99cca65546c req-a4a409e9-a429-4bc3-b515-413b3e5f7142 service nova] [instance: 5b5a4d58-ba1e-473d-a32a-06fae1c84efc] Refreshing network info cache for port b245a5c2-e523-4d4e-a343-f5b2352337ab {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 09:40:42 user nova-compute[75122]: INFO nova.virt.libvirt.driver [-] [instance: 5b5a4d58-ba1e-473d-a32a-06fae1c84efc] Instance destroyed successfully.
Nov 15 09:40:42 user nova-compute[75122]: DEBUG nova.network.neutron [req-d04890d2-e36d-4fdd-9cb2-a99cca65546c req-a4a409e9-a429-4bc3-b515-413b3e5f7142 service nova] [instance: 5b5a4d58-ba1e-473d-a32a-06fae1c84efc] Updated VIF entry in instance network info cache for port b245a5c2-e523-4d4e-a343-f5b2352337ab. {{(pid=75122) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 09:40:42 user nova-compute[75122]: DEBUG nova.network.neutron [req-d04890d2-e36d-4fdd-9cb2-a99cca65546c req-a4a409e9-a429-4bc3-b515-413b3e5f7142 service nova] [instance: 5b5a4d58-ba1e-473d-a32a-06fae1c84efc] Updating instance_info_cache with network_info: [{"id": "b245a5c2-e523-4d4e-a343-f5b2352337ab", "address": "fa:16:3e:cd:ac:71", "network": {"id": "53e8c131-26be-4b3f-beca-dd48fe06ffbe", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-888345656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6aed61f0071f44ac901b94cd9a4a909d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb245a5c2-e5", "ovs_interfaceid": "b245a5c2-e523-4d4e-a343-f5b2352337ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:40:42 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-d04890d2-e36d-4fdd-9cb2-a99cca65546c req-a4a409e9-a429-4bc3-b515-413b3e5f7142 service nova] Releasing lock "refresh_cache-5b5a4d58-ba1e-473d-a32a-06fae1c84efc" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 09:40:44 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:40:44 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:40:44 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:40:44 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:40:44 user nova-compute[75122]: DEBUG nova.compute.manager [req-34f3c40e-9319-4307-aeeb-179fd17dd9f8 req-37c51391-4ac4-4fb5-8b62-4532c1ea4b51 service nova] [instance: 5b5a4d58-ba1e-473d-a32a-06fae1c84efc] Received event network-vif-plugged-b245a5c2-e523-4d4e-a343-f5b2352337ab {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:40:44 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-34f3c40e-9319-4307-aeeb-179fd17dd9f8 req-37c51391-4ac4-4fb5-8b62-4532c1ea4b51 service nova] Acquiring lock "5b5a4d58-ba1e-473d-a32a-06fae1c84efc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:40:44 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-34f3c40e-9319-4307-aeeb-179fd17dd9f8 req-37c51391-4ac4-4fb5-8b62-4532c1ea4b51 service nova] Lock "5b5a4d58-ba1e-473d-a32a-06fae1c84efc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:40:44 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-34f3c40e-9319-4307-aeeb-179fd17dd9f8 req-37c51391-4ac4-4fb5-8b62-4532c1ea4b51 service nova] Lock "5b5a4d58-ba1e-473d-a32a-06fae1c84efc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:40:44 user nova-compute[75122]: DEBUG nova.compute.manager [req-34f3c40e-9319-4307-aeeb-179fd17dd9f8 req-37c51391-4ac4-4fb5-8b62-4532c1ea4b51 service nova] [instance: 5b5a4d58-ba1e-473d-a32a-06fae1c84efc] No waiting events found dispatching network-vif-plugged-b245a5c2-e523-4d4e-a343-f5b2352337ab {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:40:44 user nova-compute[75122]: WARNING nova.compute.manager [req-34f3c40e-9319-4307-aeeb-179fd17dd9f8 req-37c51391-4ac4-4fb5-8b62-4532c1ea4b51 service nova] [instance: 5b5a4d58-ba1e-473d-a32a-06fae1c84efc] Received unexpected event network-vif-plugged-b245a5c2-e523-4d4e-a343-f5b2352337ab for instance with vm_state rescued and task_state unrescuing.
Nov 15 09:40:44 user nova-compute[75122]: DEBUG nova.compute.manager [req-34f3c40e-9319-4307-aeeb-179fd17dd9f8 req-37c51391-4ac4-4fb5-8b62-4532c1ea4b51 service nova] [instance: 5b5a4d58-ba1e-473d-a32a-06fae1c84efc] Received event network-vif-plugged-b245a5c2-e523-4d4e-a343-f5b2352337ab {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:40:44 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-34f3c40e-9319-4307-aeeb-179fd17dd9f8 req-37c51391-4ac4-4fb5-8b62-4532c1ea4b51 service nova] Acquiring lock "5b5a4d58-ba1e-473d-a32a-06fae1c84efc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:40:44 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-34f3c40e-9319-4307-aeeb-179fd17dd9f8 req-37c51391-4ac4-4fb5-8b62-4532c1ea4b51 service nova] Lock "5b5a4d58-ba1e-473d-a32a-06fae1c84efc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:40:44 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-34f3c40e-9319-4307-aeeb-179fd17dd9f8 req-37c51391-4ac4-4fb5-8b62-4532c1ea4b51 service nova] Lock "5b5a4d58-ba1e-473d-a32a-06fae1c84efc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:40:44 user nova-compute[75122]: DEBUG nova.compute.manager [req-34f3c40e-9319-4307-aeeb-179fd17dd9f8 req-37c51391-4ac4-4fb5-8b62-4532c1ea4b51 service nova] [instance: 5b5a4d58-ba1e-473d-a32a-06fae1c84efc] No waiting events found dispatching network-vif-plugged-b245a5c2-e523-4d4e-a343-f5b2352337ab {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:40:44 user nova-compute[75122]: WARNING nova.compute.manager [req-34f3c40e-9319-4307-aeeb-179fd17dd9f8 req-37c51391-4ac4-4fb5-8b62-4532c1ea4b51 service nova] [instance: 5b5a4d58-ba1e-473d-a32a-06fae1c84efc] Received unexpected event network-vif-plugged-b245a5c2-e523-4d4e-a343-f5b2352337ab for instance with vm_state rescued and task_state unrescuing.
Nov 15 09:40:44 user nova-compute[75122]: DEBUG nova.compute.manager [req-21a0b857-7d9a-4493-bebc-8cbf5fe574ea req-bd1205ea-c674-4292-bf46-9be07b05d32e service nova] [instance: 5b5a4d58-ba1e-473d-a32a-06fae1c84efc] Received event network-changed-b245a5c2-e523-4d4e-a343-f5b2352337ab {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:40:44 user nova-compute[75122]: DEBUG nova.compute.manager [req-21a0b857-7d9a-4493-bebc-8cbf5fe574ea req-bd1205ea-c674-4292-bf46-9be07b05d32e service nova] [instance: 5b5a4d58-ba1e-473d-a32a-06fae1c84efc] Refreshing instance network info cache due to event network-changed-b245a5c2-e523-4d4e-a343-f5b2352337ab. {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 09:40:44 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-21a0b857-7d9a-4493-bebc-8cbf5fe574ea req-bd1205ea-c674-4292-bf46-9be07b05d32e service nova] Acquiring lock "refresh_cache-5b5a4d58-ba1e-473d-a32a-06fae1c84efc" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 09:40:44 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-21a0b857-7d9a-4493-bebc-8cbf5fe574ea req-bd1205ea-c674-4292-bf46-9be07b05d32e service nova] Acquired lock "refresh_cache-5b5a4d58-ba1e-473d-a32a-06fae1c84efc" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 09:40:44 user nova-compute[75122]: DEBUG nova.network.neutron [req-21a0b857-7d9a-4493-bebc-8cbf5fe574ea req-bd1205ea-c674-4292-bf46-9be07b05d32e service nova] [instance: 5b5a4d58-ba1e-473d-a32a-06fae1c84efc] Refreshing network info cache for port b245a5c2-e523-4d4e-a343-f5b2352337ab {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 09:40:44 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:40:44 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:40:44 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:40:44 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:40:44 user nova-compute[75122]: DEBUG nova.network.neutron [req-21a0b857-7d9a-4493-bebc-8cbf5fe574ea req-bd1205ea-c674-4292-bf46-9be07b05d32e service nova] [instance: 5b5a4d58-ba1e-473d-a32a-06fae1c84efc] Updated VIF entry in instance network info cache for port b245a5c2-e523-4d4e-a343-f5b2352337ab. {{(pid=75122) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 09:40:44 user nova-compute[75122]: DEBUG nova.network.neutron [req-21a0b857-7d9a-4493-bebc-8cbf5fe574ea req-bd1205ea-c674-4292-bf46-9be07b05d32e service nova] [instance: 5b5a4d58-ba1e-473d-a32a-06fae1c84efc] Updating instance_info_cache with network_info: [{"id": "b245a5c2-e523-4d4e-a343-f5b2352337ab", "address": "fa:16:3e:cd:ac:71", "network": {"id": "53e8c131-26be-4b3f-beca-dd48fe06ffbe", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-888345656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6aed61f0071f44ac901b94cd9a4a909d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb245a5c2-e5", "ovs_interfaceid": "b245a5c2-e523-4d4e-a343-f5b2352337ab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:40:44 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-21a0b857-7d9a-4493-bebc-8cbf5fe574ea req-bd1205ea-c674-4292-bf46-9be07b05d32e service nova] Releasing lock "refresh_cache-5b5a4d58-ba1e-473d-a32a-06fae1c84efc" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 09:40:45 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:40:45 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:40:46 user nova-compute[75122]: DEBUG nova.compute.manager [None req-5cb3653b-5998-4662-befa-c0a1b70e516a tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] [instance: 5b5a4d58-ba1e-473d-a32a-06fae1c84efc] Checking state {{(pid=75122) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 09:40:46 user nova-compute[75122]: DEBUG nova.compute.manager [req-28cb3471-3d66-418f-9b97-515ca794b74f req-14b87b5f-2a37-4045-9cbc-5ed400a3e468 service nova] [instance: 5b5a4d58-ba1e-473d-a32a-06fae1c84efc] Received event network-vif-plugged-b245a5c2-e523-4d4e-a343-f5b2352337ab {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:40:46 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-28cb3471-3d66-418f-9b97-515ca794b74f req-14b87b5f-2a37-4045-9cbc-5ed400a3e468 service nova] Acquiring lock "5b5a4d58-ba1e-473d-a32a-06fae1c84efc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:40:46 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-28cb3471-3d66-418f-9b97-515ca794b74f req-14b87b5f-2a37-4045-9cbc-5ed400a3e468 service nova] Lock "5b5a4d58-ba1e-473d-a32a-06fae1c84efc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:40:46 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-28cb3471-3d66-418f-9b97-515ca794b74f req-14b87b5f-2a37-4045-9cbc-5ed400a3e468 service nova] Lock "5b5a4d58-ba1e-473d-a32a-06fae1c84efc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:40:46 user nova-compute[75122]: DEBUG nova.compute.manager [req-28cb3471-3d66-418f-9b97-515ca794b74f req-14b87b5f-2a37-4045-9cbc-5ed400a3e468 service nova] [instance: 5b5a4d58-ba1e-473d-a32a-06fae1c84efc] No waiting events found dispatching network-vif-plugged-b245a5c2-e523-4d4e-a343-f5b2352337ab {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:40:46 user nova-compute[75122]: WARNING nova.compute.manager [req-28cb3471-3d66-418f-9b97-515ca794b74f req-14b87b5f-2a37-4045-9cbc-5ed400a3e468 service nova] [instance: 5b5a4d58-ba1e-473d-a32a-06fae1c84efc] Received unexpected event network-vif-plugged-b245a5c2-e523-4d4e-a343-f5b2352337ab for instance with vm_state active and task_state None.
Nov 15 09:40:48 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-f7ac0aac-8993-4550-a892-65feffa50baa tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] Acquiring lock "1e19f9e1-69c6-4590-85d2-e90cbdbb3d80" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:40:48 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-f7ac0aac-8993-4550-a892-65feffa50baa tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] Lock "1e19f9e1-69c6-4590-85d2-e90cbdbb3d80" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:40:48 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-f7ac0aac-8993-4550-a892-65feffa50baa tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] Acquiring lock "1e19f9e1-69c6-4590-85d2-e90cbdbb3d80-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:40:48 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-f7ac0aac-8993-4550-a892-65feffa50baa tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] Lock "1e19f9e1-69c6-4590-85d2-e90cbdbb3d80-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:40:48 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-f7ac0aac-8993-4550-a892-65feffa50baa tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] Lock "1e19f9e1-69c6-4590-85d2-e90cbdbb3d80-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:40:48 user nova-compute[75122]: INFO nova.compute.manager [None req-f7ac0aac-8993-4550-a892-65feffa50baa tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] [instance: 1e19f9e1-69c6-4590-85d2-e90cbdbb3d80] Terminating instance
Nov 15 09:40:48 user nova-compute[75122]: DEBUG nova.compute.manager [None req-f7ac0aac-8993-4550-a892-65feffa50baa tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] [instance: 1e19f9e1-69c6-4590-85d2-e90cbdbb3d80] Start destroying the instance on the hypervisor. {{(pid=75122) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 09:40:48 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:40:48 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:40:48 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:40:48 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:40:49 user nova-compute[75122]: DEBUG nova.compute.manager [req-c4b3a161-7dab-4865-95f4-86e899756401 req-6d854482-ecd3-483d-b944-955042bf453c service nova] [instance: 1e19f9e1-69c6-4590-85d2-e90cbdbb3d80] Received event network-vif-unplugged-a9170e2e-32f0-422c-becf-e1b2792b9b75 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:40:49 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-c4b3a161-7dab-4865-95f4-86e899756401 req-6d854482-ecd3-483d-b944-955042bf453c service nova] Acquiring lock "1e19f9e1-69c6-4590-85d2-e90cbdbb3d80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:40:49 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-c4b3a161-7dab-4865-95f4-86e899756401 req-6d854482-ecd3-483d-b944-955042bf453c service nova] Lock "1e19f9e1-69c6-4590-85d2-e90cbdbb3d80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:40:49 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-c4b3a161-7dab-4865-95f4-86e899756401 req-6d854482-ecd3-483d-b944-955042bf453c service nova] Lock "1e19f9e1-69c6-4590-85d2-e90cbdbb3d80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:40:49 user nova-compute[75122]: DEBUG nova.compute.manager [req-c4b3a161-7dab-4865-95f4-86e899756401 req-6d854482-ecd3-483d-b944-955042bf453c service nova] [instance: 1e19f9e1-69c6-4590-85d2-e90cbdbb3d80] No waiting events found dispatching network-vif-unplugged-a9170e2e-32f0-422c-becf-e1b2792b9b75 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:40:49 user nova-compute[75122]: DEBUG nova.compute.manager [req-c4b3a161-7dab-4865-95f4-86e899756401 req-6d854482-ecd3-483d-b944-955042bf453c service nova] [instance: 1e19f9e1-69c6-4590-85d2-e90cbdbb3d80] Received event network-vif-unplugged-a9170e2e-32f0-422c-becf-e1b2792b9b75 for instance with task_state deleting. {{(pid=75122) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 09:40:49 user nova-compute[75122]: INFO nova.virt.libvirt.driver [-] [instance: 1e19f9e1-69c6-4590-85d2-e90cbdbb3d80] Instance destroyed successfully.
Nov 15 09:40:49 user nova-compute[75122]: DEBUG nova.objects.instance [None req-f7ac0aac-8993-4550-a892-65feffa50baa tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] Lazy-loading 'resources' on Instance uuid 1e19f9e1-69c6-4590-85d2-e90cbdbb3d80 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:40:49 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-f7ac0aac-8993-4550-a892-65feffa50baa tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T09:35:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-412056593',display_name='tempest-VolumesAdminNegativeTest-server-412056593',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-412056593',id=15,image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKXjs5SOTPmIKBg6xFMXSmve6Sj7bQfvi4DYYYoZDNJ3nDlAQAAbzlKIYDRthtIg9zVZfMzY3rnkwZSA5aSTQbGZOfl4WkEYweWbf7Lrl7GcUYmAJWbXBhi7A/WSBCcerg==',key_name='tempest-keypair-1745833748',keypairs=<?>,launch_index=0,launched_at=2023-11-15T09:35:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f97007ed06a04d7ebbc6cd3543a23d96',ramdisk_id='',reservation_id='r-t050bzxw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1303240267',owner_user_name='tempest-VolumesAdminNegativeTest-1303240267-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T09:35:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bf43ec7daef3486cbcd5e5d2831e4615',uuid=1e19f9e1-69c6-4590-85d2-e90cbdbb3d80,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a9170e2e-32f0-422c-becf-e1b2792b9b75", "address": "fa:16:3e:4c:61:a8", "network": {"id": "cd65f44e-6f5f-40c7-87f0-de082fb2bda9", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-635927865-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f97007ed06a04d7ebbc6cd3543a23d96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9170e2e-32", "ovs_interfaceid": "a9170e2e-32f0-422c-becf-e1b2792b9b75", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 09:40:49 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-f7ac0aac-8993-4550-a892-65feffa50baa tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] Converting VIF {"id": "a9170e2e-32f0-422c-becf-e1b2792b9b75", "address": "fa:16:3e:4c:61:a8", "network": {"id": "cd65f44e-6f5f-40c7-87f0-de082fb2bda9", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-635927865-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f97007ed06a04d7ebbc6cd3543a23d96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9170e2e-32", "ovs_interfaceid": "a9170e2e-32f0-422c-becf-e1b2792b9b75", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 09:40:49 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-f7ac0aac-8993-4550-a892-65feffa50baa tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4c:61:a8,bridge_name='br-int',has_traffic_filtering=True,id=a9170e2e-32f0-422c-becf-e1b2792b9b75,network=Network(cd65f44e-6f5f-40c7-87f0-de082fb2bda9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9170e2e-32') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 09:40:49 user nova-compute[75122]: DEBUG os_vif [None req-f7ac0aac-8993-4550-a892-65feffa50baa tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4c:61:a8,bridge_name='br-int',has_traffic_filtering=True,id=a9170e2e-32f0-422c-becf-e1b2792b9b75,network=Network(cd65f44e-6f5f-40c7-87f0-de082fb2bda9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9170e2e-32') {{(pid=75122) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 09:40:49 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:40:49 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa9170e2e-32, bridge=br-int, if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:40:49 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:40:49 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:40:49 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:40:49 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4c6ca4c5-4adf-43ca-8f04-b733b26eddf7) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:40:49 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:40:49 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:40:49 user nova-compute[75122]: INFO os_vif [None req-f7ac0aac-8993-4550-a892-65feffa50baa tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4c:61:a8,bridge_name='br-int',has_traffic_filtering=True,id=a9170e2e-32f0-422c-becf-e1b2792b9b75,network=Network(cd65f44e-6f5f-40c7-87f0-de082fb2bda9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9170e2e-32')
Nov 15 09:40:49 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-f7ac0aac-8993-4550-a892-65feffa50baa tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] [instance: 1e19f9e1-69c6-4590-85d2-e90cbdbb3d80] Deleting instance files /opt/stack/data/nova/instances/1e19f9e1-69c6-4590-85d2-e90cbdbb3d80_del
Nov 15 09:40:49 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-f7ac0aac-8993-4550-a892-65feffa50baa tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] [instance: 1e19f9e1-69c6-4590-85d2-e90cbdbb3d80] Deletion of /opt/stack/data/nova/instances/1e19f9e1-69c6-4590-85d2-e90cbdbb3d80_del complete
Nov 15 09:40:49 user nova-compute[75122]: INFO nova.compute.manager [None req-f7ac0aac-8993-4550-a892-65feffa50baa tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] [instance: 1e19f9e1-69c6-4590-85d2-e90cbdbb3d80] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 15 09:40:49 user nova-compute[75122]: DEBUG oslo.service.loopingcall [None req-f7ac0aac-8993-4550-a892-65feffa50baa tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75122) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 09:40:49 user nova-compute[75122]: DEBUG nova.compute.manager [-] [instance: 1e19f9e1-69c6-4590-85d2-e90cbdbb3d80] Deallocating network for instance {{(pid=75122) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 09:40:49 user nova-compute[75122]: DEBUG nova.network.neutron [-] [instance: 1e19f9e1-69c6-4590-85d2-e90cbdbb3d80] deallocate_for_instance() {{(pid=75122) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 09:40:50 user nova-compute[75122]: DEBUG nova.network.neutron [-] [instance: 1e19f9e1-69c6-4590-85d2-e90cbdbb3d80] Updating instance_info_cache with network_info: [] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:40:50 user nova-compute[75122]: INFO nova.compute.manager [-] [instance: 1e19f9e1-69c6-4590-85d2-e90cbdbb3d80] Took 0.78 seconds to deallocate network for instance.
Nov 15 09:40:50 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-f7ac0aac-8993-4550-a892-65feffa50baa tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:40:50 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-f7ac0aac-8993-4550-a892-65feffa50baa tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:40:50 user nova-compute[75122]: DEBUG nova.compute.provider_tree [None req-f7ac0aac-8993-4550-a892-65feffa50baa tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] Inventory has not changed in ProviderTree for provider: 69a3da65-47be-44c6-b67c-c692b58284ef {{(pid=75122) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 09:40:50 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-f7ac0aac-8993-4550-a892-65feffa50baa tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] Inventory has not changed for provider 69a3da65-47be-44c6-b67c-c692b58284ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 09:40:50 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-f7ac0aac-8993-4550-a892-65feffa50baa tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.308s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:40:50 user nova-compute[75122]: INFO nova.scheduler.client.report [None req-f7ac0aac-8993-4550-a892-65feffa50baa tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] Deleted allocations for instance 1e19f9e1-69c6-4590-85d2-e90cbdbb3d80
Nov 15 09:40:50 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:40:50 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-f7ac0aac-8993-4550-a892-65feffa50baa tempest-VolumesAdminNegativeTest-1303240267 tempest-VolumesAdminNegativeTest-1303240267-project-member] Lock "1e19f9e1-69c6-4590-85d2-e90cbdbb3d80" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.174s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:40:51 user nova-compute[75122]: DEBUG nova.compute.manager [req-edb8a5b1-523c-4a12-89a0-026f619e3d72 req-f000ea3d-3994-481f-880d-ba91e7e6db6a service nova] [instance: 1e19f9e1-69c6-4590-85d2-e90cbdbb3d80] Received event network-vif-plugged-a9170e2e-32f0-422c-becf-e1b2792b9b75 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:40:51 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-edb8a5b1-523c-4a12-89a0-026f619e3d72 req-f000ea3d-3994-481f-880d-ba91e7e6db6a service nova] Acquiring lock "1e19f9e1-69c6-4590-85d2-e90cbdbb3d80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:40:51 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-edb8a5b1-523c-4a12-89a0-026f619e3d72 req-f000ea3d-3994-481f-880d-ba91e7e6db6a service nova] Lock "1e19f9e1-69c6-4590-85d2-e90cbdbb3d80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:40:51 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-edb8a5b1-523c-4a12-89a0-026f619e3d72 req-f000ea3d-3994-481f-880d-ba91e7e6db6a service nova] Lock "1e19f9e1-69c6-4590-85d2-e90cbdbb3d80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:40:51 user nova-compute[75122]: DEBUG nova.compute.manager [req-edb8a5b1-523c-4a12-89a0-026f619e3d72 req-f000ea3d-3994-481f-880d-ba91e7e6db6a service nova] [instance: 1e19f9e1-69c6-4590-85d2-e90cbdbb3d80] No waiting events found dispatching network-vif-plugged-a9170e2e-32f0-422c-becf-e1b2792b9b75 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:40:51 user nova-compute[75122]: WARNING nova.compute.manager [req-edb8a5b1-523c-4a12-89a0-026f619e3d72 req-f000ea3d-3994-481f-880d-ba91e7e6db6a service nova] [instance: 1e19f9e1-69c6-4590-85d2-e90cbdbb3d80] Received unexpected event network-vif-plugged-a9170e2e-32f0-422c-becf-e1b2792b9b75 for instance with vm_state deleted and task_state None.
Nov 15 09:40:51 user nova-compute[75122]: DEBUG nova.compute.manager [req-edb8a5b1-523c-4a12-89a0-026f619e3d72 req-f000ea3d-3994-481f-880d-ba91e7e6db6a service nova] [instance: 1e19f9e1-69c6-4590-85d2-e90cbdbb3d80] Received event network-vif-deleted-a9170e2e-32f0-422c-becf-e1b2792b9b75 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:40:54 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:40:54 user nova-compute[75122]: DEBUG nova.compute.manager [None req-a3744556-0865-4f99-8d20-731ed57c3bc7 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] [instance: c2f45f49-0bca-4ae2-bc2a-eed293143489] Checking state {{(pid=75122) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 09:40:55 user nova-compute[75122]: INFO nova.compute.manager [None req-a3744556-0865-4f99-8d20-731ed57c3bc7 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] [instance: c2f45f49-0bca-4ae2-bc2a-eed293143489] instance snapshotting
Nov 15 09:40:55 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-a3744556-0865-4f99-8d20-731ed57c3bc7 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] [instance: c2f45f49-0bca-4ae2-bc2a-eed293143489] Beginning live snapshot process
Nov 15 09:40:55 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:40:55 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-a3744556-0865-4f99-8d20-731ed57c3bc7 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2f45f49-0bca-4ae2-bc2a-eed293143489/disk --force-share --output=json -f qcow2 {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:40:55 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-a3744556-0865-4f99-8d20-731ed57c3bc7 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2f45f49-0bca-4ae2-bc2a-eed293143489/disk --force-share --output=json -f qcow2" returned: 0 in 0.182s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:40:55 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-a3744556-0865-4f99-8d20-731ed57c3bc7 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2f45f49-0bca-4ae2-bc2a-eed293143489/disk --force-share --output=json -f qcow2 {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:40:55 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-a3744556-0865-4f99-8d20-731ed57c3bc7 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2f45f49-0bca-4ae2-bc2a-eed293143489/disk --force-share --output=json -f qcow2" returned: 0 in 0.178s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:40:55 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-a3744556-0865-4f99-8d20-731ed57c3bc7 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:40:55 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-a3744556-0865-4f99-8d20-731ed57c3bc7 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json" returned: 0 in 0.187s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:40:55 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-a3744556-0865-4f99-8d20-731ed57c3bc7 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpaurj_u82/b0be801380974d85b9888be5319483bd.delta 1073741824 {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:40:55 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-a3744556-0865-4f99-8d20-731ed57c3bc7 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpaurj_u82/b0be801380974d85b9888be5319483bd.delta 1073741824" returned: 0 in 0.058s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:40:55 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-a3744556-0865-4f99-8d20-731ed57c3bc7 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] [instance: c2f45f49-0bca-4ae2-bc2a-eed293143489] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 15 09:40:56 user nova-compute[75122]: DEBUG nova.virt.libvirt.guest [None req-a3744556-0865-4f99-8d20-731ed57c3bc7 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=75122) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 09:40:57 user nova-compute[75122]: DEBUG nova.virt.libvirt.guest [None req-a3744556-0865-4f99-8d20-731ed57c3bc7 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] COPY block job progress, current cursor: 23592960 final cursor: 75563008 {{(pid=75122) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 09:40:57 user nova-compute[75122]: DEBUG nova.virt.libvirt.guest [None req-a3744556-0865-4f99-8d20-731ed57c3bc7 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=75122) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 09:40:57 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-a3744556-0865-4f99-8d20-731ed57c3bc7 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] [instance: c2f45f49-0bca-4ae2-bc2a-eed293143489] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 15 09:40:57 user nova-compute[75122]: DEBUG nova.privsep.utils [None req-a3744556-0865-4f99-8d20-731ed57c3bc7 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75122) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 09:40:57 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-a3744556-0865-4f99-8d20-731ed57c3bc7 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpaurj_u82/b0be801380974d85b9888be5319483bd.delta /opt/stack/data/nova/instances/snapshots/tmpaurj_u82/b0be801380974d85b9888be5319483bd {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:40:58 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-a3744556-0865-4f99-8d20-731ed57c3bc7 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpaurj_u82/b0be801380974d85b9888be5319483bd.delta /opt/stack/data/nova/instances/snapshots/tmpaurj_u82/b0be801380974d85b9888be5319483bd" returned: 0 in 0.846s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:40:58 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-a3744556-0865-4f99-8d20-731ed57c3bc7 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] [instance: c2f45f49-0bca-4ae2-bc2a-eed293143489] Snapshot extracted, beginning image upload
Nov 15 09:40:59 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:40:59 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:41:00 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:41:01 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-a3744556-0865-4f99-8d20-731ed57c3bc7 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] [instance: c2f45f49-0bca-4ae2-bc2a-eed293143489] Snapshot image upload complete
Nov 15 09:41:01 user nova-compute[75122]: INFO nova.compute.manager [None req-a3744556-0865-4f99-8d20-731ed57c3bc7 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] [instance: c2f45f49-0bca-4ae2-bc2a-eed293143489] Took 6.30 seconds to snapshot the instance on the hypervisor.
Nov 15 09:41:02 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:41:04 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-fa7aa7ec-1614-4bc0-add5-9012ea6c0d35 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Acquiring lock "6f6177c5-3048-4a78-b34a-e595d26d69d0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:41:04 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-fa7aa7ec-1614-4bc0-add5-9012ea6c0d35 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Lock "6f6177c5-3048-4a78-b34a-e595d26d69d0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:41:04 user nova-compute[75122]: DEBUG nova.compute.manager [None req-fa7aa7ec-1614-4bc0-add5-9012ea6c0d35 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] [instance: 6f6177c5-3048-4a78-b34a-e595d26d69d0] Starting instance... {{(pid=75122) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 09:41:04 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-fa7aa7ec-1614-4bc0-add5-9012ea6c0d35 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:41:04 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-fa7aa7ec-1614-4bc0-add5-9012ea6c0d35 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:41:04 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-fa7aa7ec-1614-4bc0-add5-9012ea6c0d35 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75122) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 09:41:04 user nova-compute[75122]: INFO nova.compute.claims [None req-fa7aa7ec-1614-4bc0-add5-9012ea6c0d35 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] [instance: 6f6177c5-3048-4a78-b34a-e595d26d69d0] Claim successful on node user
Nov 15 09:41:04 user nova-compute[75122]: DEBUG nova.compute.provider_tree [None req-fa7aa7ec-1614-4bc0-add5-9012ea6c0d35 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Inventory has not changed in ProviderTree for provider: 69a3da65-47be-44c6-b67c-c692b58284ef {{(pid=75122) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 09:41:04 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-fa7aa7ec-1614-4bc0-add5-9012ea6c0d35 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Inventory has not changed for provider 69a3da65-47be-44c6-b67c-c692b58284ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 09:41:04 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:41:04 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-fa7aa7ec-1614-4bc0-add5-9012ea6c0d35 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.506s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:41:04 user nova-compute[75122]: DEBUG nova.compute.manager [None req-fa7aa7ec-1614-4bc0-add5-9012ea6c0d35 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] [instance: 6f6177c5-3048-4a78-b34a-e595d26d69d0] Start building networks asynchronously for instance. {{(pid=75122) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 09:41:04 user nova-compute[75122]: DEBUG nova.compute.manager [None req-fa7aa7ec-1614-4bc0-add5-9012ea6c0d35 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] [instance: 6f6177c5-3048-4a78-b34a-e595d26d69d0] Allocating IP information in the background. {{(pid=75122) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 09:41:04 user nova-compute[75122]: DEBUG nova.network.neutron [None req-fa7aa7ec-1614-4bc0-add5-9012ea6c0d35 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] [instance: 6f6177c5-3048-4a78-b34a-e595d26d69d0] allocate_for_instance() {{(pid=75122) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 09:41:04 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-fa7aa7ec-1614-4bc0-add5-9012ea6c0d35 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] [instance: 6f6177c5-3048-4a78-b34a-e595d26d69d0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 09:41:04 user nova-compute[75122]: DEBUG nova.compute.manager [None req-fa7aa7ec-1614-4bc0-add5-9012ea6c0d35 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] [instance: 6f6177c5-3048-4a78-b34a-e595d26d69d0] Start building block device mappings for instance. {{(pid=75122) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 09:41:04 user nova-compute[75122]: DEBUG nova.policy [None req-fa7aa7ec-1614-4bc0-add5-9012ea6c0d35 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '15a69b87dd164c74af2fed014a3c5f37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdc0f52b1c744b91b4f1a4ecd07e07c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75122) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 09:41:04 user nova-compute[75122]: DEBUG nova.compute.manager [None req-fa7aa7ec-1614-4bc0-add5-9012ea6c0d35 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] [instance: 6f6177c5-3048-4a78-b34a-e595d26d69d0] Start spawning the instance on the hypervisor. {{(pid=75122) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 09:41:04 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-fa7aa7ec-1614-4bc0-add5-9012ea6c0d35 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] [instance: 6f6177c5-3048-4a78-b34a-e595d26d69d0] Creating instance directory {{(pid=75122) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 09:41:04 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-fa7aa7ec-1614-4bc0-add5-9012ea6c0d35 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] [instance: 6f6177c5-3048-4a78-b34a-e595d26d69d0] Creating image(s)
Nov 15 09:41:04 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-fa7aa7ec-1614-4bc0-add5-9012ea6c0d35 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Acquiring lock "/opt/stack/data/nova/instances/6f6177c5-3048-4a78-b34a-e595d26d69d0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:41:04 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-fa7aa7ec-1614-4bc0-add5-9012ea6c0d35 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Lock "/opt/stack/data/nova/instances/6f6177c5-3048-4a78-b34a-e595d26d69d0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:41:04 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-fa7aa7ec-1614-4bc0-add5-9012ea6c0d35 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Lock "/opt/stack/data/nova/instances/6f6177c5-3048-4a78-b34a-e595d26d69d0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:41:04 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-fa7aa7ec-1614-4bc0-add5-9012ea6c0d35 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Acquiring lock "ddd182cf2629c3be359fb82f9ee75c26505567bb" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:41:04 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-fa7aa7ec-1614-4bc0-add5-9012ea6c0d35 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Lock "ddd182cf2629c3be359fb82f9ee75c26505567bb" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:41:06 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-fa7aa7ec-1614-4bc0-add5-9012ea6c0d35 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ddd182cf2629c3be359fb82f9ee75c26505567bb.part --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:41:06 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:41:06 user nova-compute[75122]: DEBUG nova.network.neutron [None req-fa7aa7ec-1614-4bc0-add5-9012ea6c0d35 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] [instance: 6f6177c5-3048-4a78-b34a-e595d26d69d0] Successfully created port: 8f77c03f-9bb8-441c-97a9-19bb14a14d89 {{(pid=75122) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 09:41:06 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-fa7aa7ec-1614-4bc0-add5-9012ea6c0d35 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ddd182cf2629c3be359fb82f9ee75c26505567bb.part --force-share --output=json" returned: 0 in 0.177s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:41:06 user nova-compute[75122]: DEBUG nova.virt.images [None req-fa7aa7ec-1614-4bc0-add5-9012ea6c0d35 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] 5874135a-1a9c-4554-adbd-8a21eca8d6ff was qcow2, converting to raw {{(pid=75122) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 15 09:41:06 user nova-compute[75122]: DEBUG nova.privsep.utils [None req-fa7aa7ec-1614-4bc0-add5-9012ea6c0d35 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75122) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 09:41:06 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-fa7aa7ec-1614-4bc0-add5-9012ea6c0d35 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ddd182cf2629c3be359fb82f9ee75c26505567bb.part /opt/stack/data/nova/instances/_base/ddd182cf2629c3be359fb82f9ee75c26505567bb.converted {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:41:06 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:41:07 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-fa7aa7ec-1614-4bc0-add5-9012ea6c0d35 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ddd182cf2629c3be359fb82f9ee75c26505567bb.part /opt/stack/data/nova/instances/_base/ddd182cf2629c3be359fb82f9ee75c26505567bb.converted" returned: 0 in 0.554s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:41:07 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-fa7aa7ec-1614-4bc0-add5-9012ea6c0d35 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ddd182cf2629c3be359fb82f9ee75c26505567bb.converted --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:41:07 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-fa7aa7ec-1614-4bc0-add5-9012ea6c0d35 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ddd182cf2629c3be359fb82f9ee75c26505567bb.converted --force-share --output=json" returned: 0 in 0.199s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:41:07 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-fa7aa7ec-1614-4bc0-add5-9012ea6c0d35 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Lock "ddd182cf2629c3be359fb82f9ee75c26505567bb" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.425s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:41:07 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-fa7aa7ec-1614-4bc0-add5-9012ea6c0d35 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ddd182cf2629c3be359fb82f9ee75c26505567bb --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:41:07 user nova-compute[75122]: DEBUG nova.network.neutron [None req-fa7aa7ec-1614-4bc0-add5-9012ea6c0d35 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] [instance: 6f6177c5-3048-4a78-b34a-e595d26d69d0] Successfully updated port: 8f77c03f-9bb8-441c-97a9-19bb14a14d89 {{(pid=75122) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 09:41:07 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-fa7aa7ec-1614-4bc0-add5-9012ea6c0d35 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ddd182cf2629c3be359fb82f9ee75c26505567bb --force-share --output=json" returned: 0 in 0.204s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:41:07 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-fa7aa7ec-1614-4bc0-add5-9012ea6c0d35 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Acquiring lock "ddd182cf2629c3be359fb82f9ee75c26505567bb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:41:07 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-fa7aa7ec-1614-4bc0-add5-9012ea6c0d35 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Lock "ddd182cf2629c3be359fb82f9ee75c26505567bb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:41:07 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-fa7aa7ec-1614-4bc0-add5-9012ea6c0d35 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ddd182cf2629c3be359fb82f9ee75c26505567bb --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:41:07 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-fa7aa7ec-1614-4bc0-add5-9012ea6c0d35 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Acquiring lock "refresh_cache-6f6177c5-3048-4a78-b34a-e595d26d69d0" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 09:41:07 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-fa7aa7ec-1614-4bc0-add5-9012ea6c0d35 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Acquired lock "refresh_cache-6f6177c5-3048-4a78-b34a-e595d26d69d0" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 09:41:07 user nova-compute[75122]: DEBUG nova.network.neutron [None req-fa7aa7ec-1614-4bc0-add5-9012ea6c0d35 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] [instance: 6f6177c5-3048-4a78-b34a-e595d26d69d0] Building network info cache for instance {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 09:41:07 user nova-compute[75122]: DEBUG nova.compute.manager [req-00f47bb8-ade3-4ac3-88d5-f08d3b096d15 req-e381394c-083e-4c01-947a-9a1a4942cbf5 service nova] [instance: 6f6177c5-3048-4a78-b34a-e595d26d69d0] Received event network-changed-8f77c03f-9bb8-441c-97a9-19bb14a14d89 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:41:07 user nova-compute[75122]: DEBUG nova.compute.manager [req-00f47bb8-ade3-4ac3-88d5-f08d3b096d15 req-e381394c-083e-4c01-947a-9a1a4942cbf5 service nova] [instance: 6f6177c5-3048-4a78-b34a-e595d26d69d0] Refreshing instance network info cache due to event network-changed-8f77c03f-9bb8-441c-97a9-19bb14a14d89. {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 09:41:07 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-00f47bb8-ade3-4ac3-88d5-f08d3b096d15 req-e381394c-083e-4c01-947a-9a1a4942cbf5 service nova] Acquiring lock "refresh_cache-6f6177c5-3048-4a78-b34a-e595d26d69d0" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 09:41:07 user nova-compute[75122]: DEBUG nova.network.neutron [None req-fa7aa7ec-1614-4bc0-add5-9012ea6c0d35 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] [instance: 6f6177c5-3048-4a78-b34a-e595d26d69d0] Instance cache missing network info. {{(pid=75122) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 09:41:07 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-fa7aa7ec-1614-4bc0-add5-9012ea6c0d35 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ddd182cf2629c3be359fb82f9ee75c26505567bb --force-share --output=json" returned: 0 in 0.182s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:41:07 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-fa7aa7ec-1614-4bc0-add5-9012ea6c0d35 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ddd182cf2629c3be359fb82f9ee75c26505567bb,backing_fmt=raw /opt/stack/data/nova/instances/6f6177c5-3048-4a78-b34a-e595d26d69d0/disk 1073741824 {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:41:07 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-fa7aa7ec-1614-4bc0-add5-9012ea6c0d35 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ddd182cf2629c3be359fb82f9ee75c26505567bb,backing_fmt=raw /opt/stack/data/nova/instances/6f6177c5-3048-4a78-b34a-e595d26d69d0/disk 1073741824" returned: 0 in 0.057s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:41:07 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-fa7aa7ec-1614-4bc0-add5-9012ea6c0d35 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Lock "ddd182cf2629c3be359fb82f9ee75c26505567bb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.243s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:41:07 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-fa7aa7ec-1614-4bc0-add5-9012ea6c0d35 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ddd182cf2629c3be359fb82f9ee75c26505567bb --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:41:08 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-fa7aa7ec-1614-4bc0-add5-9012ea6c0d35 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ddd182cf2629c3be359fb82f9ee75c26505567bb --force-share --output=json" returned: 0 in 0.225s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:41:08 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-fa7aa7ec-1614-4bc0-add5-9012ea6c0d35 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] [instance: 6f6177c5-3048-4a78-b34a-e595d26d69d0] Created local disks {{(pid=75122) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 09:41:08 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-fa7aa7ec-1614-4bc0-add5-9012ea6c0d35 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] [instance: 6f6177c5-3048-4a78-b34a-e595d26d69d0] Ensure instance console log exists: /opt/stack/data/nova/instances/6f6177c5-3048-4a78-b34a-e595d26d69d0/console.log {{(pid=75122) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 09:41:08 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-fa7aa7ec-1614-4bc0-add5-9012ea6c0d35 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:41:08 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-fa7aa7ec-1614-4bc0-add5-9012ea6c0d35 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:41:08 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-fa7aa7ec-1614-4bc0-add5-9012ea6c0d35 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:41:08 user nova-compute[75122]: DEBUG nova.network.neutron [None req-fa7aa7ec-1614-4bc0-add5-9012ea6c0d35 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] [instance: 6f6177c5-3048-4a78-b34a-e595d26d69d0] Updating instance_info_cache with network_info: [{"id": "8f77c03f-9bb8-441c-97a9-19bb14a14d89", "address": "fa:16:3e:18:aa:27", "network": {"id": "387b4fc3-39ad-40c3-bcd7-7526b09e30b7", "bridge": "br-int", "label": "tempest-TestStampPattern-1501769990-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bdc0f52b1c744b91b4f1a4ecd07e07c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f77c03f-9b", "ovs_interfaceid": "8f77c03f-9bb8-441c-97a9-19bb14a14d89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:41:08 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-fa7aa7ec-1614-4bc0-add5-9012ea6c0d35 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Releasing lock "refresh_cache-6f6177c5-3048-4a78-b34a-e595d26d69d0" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 09:41:08 user nova-compute[75122]: DEBUG nova.compute.manager [None req-fa7aa7ec-1614-4bc0-add5-9012ea6c0d35 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] [instance: 6f6177c5-3048-4a78-b34a-e595d26d69d0] Instance network_info: |[{"id": "8f77c03f-9bb8-441c-97a9-19bb14a14d89", "address": "fa:16:3e:18:aa:27", "network": {"id": "387b4fc3-39ad-40c3-bcd7-7526b09e30b7", "bridge": "br-int", "label": "tempest-TestStampPattern-1501769990-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bdc0f52b1c744b91b4f1a4ecd07e07c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f77c03f-9b", "ovs_interfaceid": "8f77c03f-9bb8-441c-97a9-19bb14a14d89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75122) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 09:41:08 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-00f47bb8-ade3-4ac3-88d5-f08d3b096d15 req-e381394c-083e-4c01-947a-9a1a4942cbf5 service nova] Acquired lock "refresh_cache-6f6177c5-3048-4a78-b34a-e595d26d69d0" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 09:41:08 user nova-compute[75122]: DEBUG nova.network.neutron [req-00f47bb8-ade3-4ac3-88d5-f08d3b096d15 req-e381394c-083e-4c01-947a-9a1a4942cbf5 service nova] [instance: 6f6177c5-3048-4a78-b34a-e595d26d69d0] Refreshing network info cache for port 8f77c03f-9bb8-441c-97a9-19bb14a14d89 {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 09:41:08 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-fa7aa7ec-1614-4bc0-add5-9012ea6c0d35 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] [instance: 6f6177c5-3048-4a78-b34a-e595d26d69d0] Start _get_guest_xml network_info=[{"id": "8f77c03f-9bb8-441c-97a9-19bb14a14d89", "address": "fa:16:3e:18:aa:27", "network": {"id": "387b4fc3-39ad-40c3-bcd7-7526b09e30b7", "bridge": "br-int", "label": "tempest-TestStampPattern-1501769990-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bdc0f52b1c744b91b4f1a4ecd07e07c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f77c03f-9b", "ovs_interfaceid": "8f77c03f-9bb8-441c-97a9-19bb14a14d89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='df124546ccb5efe4c2cb6ca80c399e76',container_format='bare',created_at=2023-11-15T09:40:55Z,direct_url=<?>,disk_format='qcow2',id=5874135a-1a9c-4554-adbd-8a21eca8d6ff,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1471797545',owner='bdc0f52b1c744b91b4f1a4ecd07e07c1',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-15T09:41:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '5874135a-1a9c-4554-adbd-8a21eca8d6ff'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75122) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 09:41:08 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-fa7aa7ec-1614-4bc0-add5-9012ea6c0d35 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 09:41:08 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-fa7aa7ec-1614-4bc0-add5-9012ea6c0d35 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 09:41:08 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-fa7aa7ec-1614-4bc0-add5-9012ea6c0d35 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75122) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 09:41:08 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-fa7aa7ec-1614-4bc0-add5-9012ea6c0d35 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] CPU controller missing on host. {{(pid=75122) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 09:41:08 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-fa7aa7ec-1614-4bc0-add5-9012ea6c0d35 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75122) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 09:41:08 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-fa7aa7ec-1614-4bc0-add5-9012ea6c0d35 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] CPU controller found on host. {{(pid=75122) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 09:41:08 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-fa7aa7ec-1614-4bc0-add5-9012ea6c0d35 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75122) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 09:41:08 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-fa7aa7ec-1614-4bc0-add5-9012ea6c0d35 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T09:26:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='df124546ccb5efe4c2cb6ca80c399e76',container_format='bare',created_at=2023-11-15T09:40:55Z,direct_url=<?>,disk_format='qcow2',id=5874135a-1a9c-4554-adbd-8a21eca8d6ff,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1471797545',owner='bdc0f52b1c744b91b4f1a4ecd07e07c1',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-15T09:41:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 09:41:08 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-fa7aa7ec-1614-4bc0-add5-9012ea6c0d35 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Flavor limits 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 09:41:08 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-fa7aa7ec-1614-4bc0-add5-9012ea6c0d35 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Image limits 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 09:41:08 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-fa7aa7ec-1614-4bc0-add5-9012ea6c0d35 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Flavor pref 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 09:41:08 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-fa7aa7ec-1614-4bc0-add5-9012ea6c0d35 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Image pref 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 09:41:08 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-fa7aa7ec-1614-4bc0-add5-9012ea6c0d35 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 09:41:08 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-fa7aa7ec-1614-4bc0-add5-9012ea6c0d35 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 09:41:08 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-fa7aa7ec-1614-4bc0-add5-9012ea6c0d35 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75122) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 09:41:08 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-fa7aa7ec-1614-4bc0-add5-9012ea6c0d35 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Got 1 possible topologies {{(pid=75122) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 09:41:08 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-fa7aa7ec-1614-4bc0-add5-9012ea6c0d35 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 09:41:08 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-fa7aa7ec-1614-4bc0-add5-9012ea6c0d35 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 09:41:08 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-fa7aa7ec-1614-4bc0-add5-9012ea6c0d35 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T09:41:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-293567681',display_name='tempest-TestStampPattern-server-293567681',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-293567681',id=26,image_ref='5874135a-1a9c-4554-adbd-8a21eca8d6ff',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLTuyc1m0Na8NQ5VH/Tfx2UBRmDQ41qC6ACQUu2KLBVZhr2oW2YpfUnFSSho5blcWwWbXMeGc1bLerwgE7lxS0HgCpcrAeG55ew3eBiC1wjNqqSI1GsVKLlgwinFMYycdQ==',key_name='tempest-TestStampPattern-625128858',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bdc0f52b1c744b91b4f1a4ecd07e07c1',ramdisk_id='',reservation_id='r-cdt58emf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='c2f45f49-0bca-4ae2-bc2a-eed293143489',image_min_disk='1',image_min_ram='0',image_owner_id='bdc0f52b1c744b91b4f1a4ecd07e07c1',image_owner_project_name='tempest-TestStampPattern-1896212913',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1896212913-project-member',image_user_id='15a69b87dd164c74af2fed014a3c5f37',network_allocated='True',owner_project_name='tempest-TestStampPattern-1896212913',owner_user_name='tempest-TestStampPattern-1896212913-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T09:41:05Z,user_data=None,user_id='15a69b87dd164c74af2fed014a3c5f37',uuid=6f6177c5-3048-4a78-b34a-e595d26d69d0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8f77c03f-9bb8-441c-97a9-19bb14a14d89", "address": "fa:16:3e:18:aa:27", "network": {"id": "387b4fc3-39ad-40c3-bcd7-7526b09e30b7", "bridge": "br-int", "label": "tempest-TestStampPattern-1501769990-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bdc0f52b1c744b91b4f1a4ecd07e07c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f77c03f-9b", "ovs_interfaceid": "8f77c03f-9bb8-441c-97a9-19bb14a14d89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75122) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 09:41:08 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-fa7aa7ec-1614-4bc0-add5-9012ea6c0d35 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Converting VIF {"id": "8f77c03f-9bb8-441c-97a9-19bb14a14d89", "address": "fa:16:3e:18:aa:27", "network": {"id": "387b4fc3-39ad-40c3-bcd7-7526b09e30b7", "bridge": "br-int", "label": "tempest-TestStampPattern-1501769990-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bdc0f52b1c744b91b4f1a4ecd07e07c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f77c03f-9b", "ovs_interfaceid": "8f77c03f-9bb8-441c-97a9-19bb14a14d89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 09:41:08 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-fa7aa7ec-1614-4bc0-add5-9012ea6c0d35 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:aa:27,bridge_name='br-int',has_traffic_filtering=True,id=8f77c03f-9bb8-441c-97a9-19bb14a14d89,network=Network(387b4fc3-39ad-40c3-bcd7-7526b09e30b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f77c03f-9b') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 09:41:08 user nova-compute[75122]: DEBUG nova.objects.instance [None req-fa7aa7ec-1614-4bc0-add5-9012ea6c0d35 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Lazy-loading 'pci_devices' on Instance uuid 6f6177c5-3048-4a78-b34a-e595d26d69d0 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:41:08 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-fa7aa7ec-1614-4bc0-add5-9012ea6c0d35 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] [instance: 6f6177c5-3048-4a78-b34a-e595d26d69d0] End _get_guest_xml xml=<domain type="kvm">
Nov 15 09:41:08 user nova-compute[75122]:   <uuid>6f6177c5-3048-4a78-b34a-e595d26d69d0</uuid>
Nov 15 09:41:08 user nova-compute[75122]:   <name>instance-0000001a</name>
Nov 15 09:41:08 user nova-compute[75122]:   <memory>524288</memory>
Nov 15 09:41:08 user nova-compute[75122]:   <vcpu>1</vcpu>
Nov 15 09:41:08 user nova-compute[75122]:   <metadata>
Nov 15 09:41:08 user nova-compute[75122]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 09:41:08 user nova-compute[75122]:       <nova:package version="0.0.0"/>
Nov 15 09:41:08 user nova-compute[75122]:       <nova:name>tempest-TestStampPattern-server-293567681</nova:name>
Nov 15 09:41:08 user nova-compute[75122]:       <nova:creationTime>2023-11-15 09:41:08</nova:creationTime>
Nov 15 09:41:08 user nova-compute[75122]:       <nova:flavor name="m1.tiny">
Nov 15 09:41:08 user nova-compute[75122]:         <nova:memory>512</nova:memory>
Nov 15 09:41:08 user nova-compute[75122]:         <nova:disk>1</nova:disk>
Nov 15 09:41:08 user nova-compute[75122]:         <nova:swap>0</nova:swap>
Nov 15 09:41:08 user nova-compute[75122]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 09:41:08 user nova-compute[75122]:         <nova:vcpus>1</nova:vcpus>
Nov 15 09:41:08 user nova-compute[75122]:       </nova:flavor>
Nov 15 09:41:08 user nova-compute[75122]:       <nova:owner>
Nov 15 09:41:08 user nova-compute[75122]:         <nova:user uuid="15a69b87dd164c74af2fed014a3c5f37">tempest-TestStampPattern-1896212913-project-member</nova:user>
Nov 15 09:41:08 user nova-compute[75122]:         <nova:project uuid="bdc0f52b1c744b91b4f1a4ecd07e07c1">tempest-TestStampPattern-1896212913</nova:project>
Nov 15 09:41:08 user nova-compute[75122]:       </nova:owner>
Nov 15 09:41:08 user nova-compute[75122]:       <nova:root type="image" uuid="5874135a-1a9c-4554-adbd-8a21eca8d6ff"/>
Nov 15 09:41:08 user nova-compute[75122]:       <nova:ports>
Nov 15 09:41:08 user nova-compute[75122]:         <nova:port uuid="8f77c03f-9bb8-441c-97a9-19bb14a14d89">
Nov 15 09:41:08 user nova-compute[75122]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 15 09:41:08 user nova-compute[75122]:         </nova:port>
Nov 15 09:41:08 user nova-compute[75122]:       </nova:ports>
Nov 15 09:41:08 user nova-compute[75122]:     </nova:instance>
Nov 15 09:41:08 user nova-compute[75122]:   </metadata>
Nov 15 09:41:08 user nova-compute[75122]:   <sysinfo type="smbios">
Nov 15 09:41:08 user nova-compute[75122]:     <system>
Nov 15 09:41:08 user nova-compute[75122]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 09:41:08 user nova-compute[75122]:       <entry name="product">OpenStack Nova</entry>
Nov 15 09:41:08 user nova-compute[75122]:       <entry name="version">0.0.0</entry>
Nov 15 09:41:08 user nova-compute[75122]:       <entry name="serial">6f6177c5-3048-4a78-b34a-e595d26d69d0</entry>
Nov 15 09:41:08 user nova-compute[75122]:       <entry name="uuid">6f6177c5-3048-4a78-b34a-e595d26d69d0</entry>
Nov 15 09:41:08 user nova-compute[75122]:       <entry name="family">Virtual Machine</entry>
Nov 15 09:41:08 user nova-compute[75122]:     </system>
Nov 15 09:41:08 user nova-compute[75122]:   </sysinfo>
Nov 15 09:41:08 user nova-compute[75122]:   <os>
Nov 15 09:41:08 user nova-compute[75122]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 09:41:08 user nova-compute[75122]:     <boot dev="hd"/>
Nov 15 09:41:08 user nova-compute[75122]:     <smbios mode="sysinfo"/>
Nov 15 09:41:08 user nova-compute[75122]:   </os>
Nov 15 09:41:08 user nova-compute[75122]:   <features>
Nov 15 09:41:08 user nova-compute[75122]:     <acpi/>
Nov 15 09:41:08 user nova-compute[75122]:     <apic/>
Nov 15 09:41:08 user nova-compute[75122]:     <vmcoreinfo/>
Nov 15 09:41:08 user nova-compute[75122]:   </features>
Nov 15 09:41:08 user nova-compute[75122]:   <clock offset="utc">
Nov 15 09:41:08 user nova-compute[75122]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 09:41:08 user nova-compute[75122]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 09:41:08 user nova-compute[75122]:     <timer name="hpet" present="no"/>
Nov 15 09:41:08 user nova-compute[75122]:   </clock>
Nov 15 09:41:08 user nova-compute[75122]:   <cpu mode="custom" match="exact">
Nov 15 09:41:08 user nova-compute[75122]:     <model>Nehalem</model>
Nov 15 09:41:08 user nova-compute[75122]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 09:41:08 user nova-compute[75122]:   </cpu>
Nov 15 09:41:08 user nova-compute[75122]:   <devices>
Nov 15 09:41:08 user nova-compute[75122]:     <disk type="file" device="disk">
Nov 15 09:41:08 user nova-compute[75122]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 09:41:08 user nova-compute[75122]:       <source file="/opt/stack/data/nova/instances/6f6177c5-3048-4a78-b34a-e595d26d69d0/disk"/>
Nov 15 09:41:08 user nova-compute[75122]:       <target dev="vda" bus="virtio"/>
Nov 15 09:41:08 user nova-compute[75122]:     </disk>
Nov 15 09:41:08 user nova-compute[75122]:     <interface type="ethernet">
Nov 15 09:41:08 user nova-compute[75122]:       <mac address="fa:16:3e:18:aa:27"/>
Nov 15 09:41:08 user nova-compute[75122]:       <model type="virtio"/>
Nov 15 09:41:08 user nova-compute[75122]:       <mtu size="1442"/>
Nov 15 09:41:08 user nova-compute[75122]:       <target dev="tap8f77c03f-9b"/>
Nov 15 09:41:08 user nova-compute[75122]:     </interface>
Nov 15 09:41:08 user nova-compute[75122]:     <serial type="pty">
Nov 15 09:41:08 user nova-compute[75122]:       <log file="/opt/stack/data/nova/instances/6f6177c5-3048-4a78-b34a-e595d26d69d0/console.log" append="off"/>
Nov 15 09:41:08 user nova-compute[75122]:     </serial>
Nov 15 09:41:08 user nova-compute[75122]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 09:41:08 user nova-compute[75122]:     <video>
Nov 15 09:41:08 user nova-compute[75122]:       <model type="virtio"/>
Nov 15 09:41:08 user nova-compute[75122]:     </video>
Nov 15 09:41:08 user nova-compute[75122]:     <rng model="virtio">
Nov 15 09:41:08 user nova-compute[75122]:       <backend model="random">/dev/urandom</backend>
Nov 15 09:41:08 user nova-compute[75122]:     </rng>
Nov 15 09:41:08 user nova-compute[75122]:     <controller type="usb" index="0" model="none"/>
Nov 15 09:41:08 user nova-compute[75122]:     <memballoon model="virtio">
Nov 15 09:41:08 user nova-compute[75122]:       <stats period="10"/>
Nov 15 09:41:08 user nova-compute[75122]:     </memballoon>
Nov 15 09:41:08 user nova-compute[75122]:   </devices>
Nov 15 09:41:08 user nova-compute[75122]: </domain>
Nov 15 09:41:08 user nova-compute[75122]:  {{(pid=75122) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 09:41:08 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-fa7aa7ec-1614-4bc0-add5-9012ea6c0d35 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T09:41:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-293567681',display_name='tempest-TestStampPattern-server-293567681',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-293567681',id=26,image_ref='5874135a-1a9c-4554-adbd-8a21eca8d6ff',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLTuyc1m0Na8NQ5VH/Tfx2UBRmDQ41qC6ACQUu2KLBVZhr2oW2YpfUnFSSho5blcWwWbXMeGc1bLerwgE7lxS0HgCpcrAeG55ew3eBiC1wjNqqSI1GsVKLlgwinFMYycdQ==',key_name='tempest-TestStampPattern-625128858',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bdc0f52b1c744b91b4f1a4ecd07e07c1',ramdisk_id='',reservation_id='r-cdt58emf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='c2f45f49-0bca-4ae2-bc2a-eed293143489',image_min_disk='1',image_min_ram='0',image_owner_id='bdc0f52b1c744b91b4f1a4ecd07e07c1',image_owner_project_name='tempest-TestStampPattern-1896212913',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1896212913-project-member',image_user_id='15a69b87dd164c74af2fed014a3c5f37',network_allocated='True',owner_project_name='tempest-TestStampPattern-1896212913',owner_user_name='tempest-TestStampPattern-1896212913-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T09:41:05Z,user_data=None,user_id='15a69b87dd164c74af2fed014a3c5f37',uuid=6f6177c5-3048-4a78-b34a-e595d26d69d0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8f77c03f-9bb8-441c-97a9-19bb14a14d89", "address": "fa:16:3e:18:aa:27", "network": {"id": "387b4fc3-39ad-40c3-bcd7-7526b09e30b7", "bridge": "br-int", "label": "tempest-TestStampPattern-1501769990-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bdc0f52b1c744b91b4f1a4ecd07e07c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f77c03f-9b", "ovs_interfaceid": "8f77c03f-9bb8-441c-97a9-19bb14a14d89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 09:41:08 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-fa7aa7ec-1614-4bc0-add5-9012ea6c0d35 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Converting VIF {"id": "8f77c03f-9bb8-441c-97a9-19bb14a14d89", "address": "fa:16:3e:18:aa:27", "network": {"id": "387b4fc3-39ad-40c3-bcd7-7526b09e30b7", "bridge": "br-int", "label": "tempest-TestStampPattern-1501769990-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bdc0f52b1c744b91b4f1a4ecd07e07c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f77c03f-9b", "ovs_interfaceid": "8f77c03f-9bb8-441c-97a9-19bb14a14d89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 09:41:08 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-fa7aa7ec-1614-4bc0-add5-9012ea6c0d35 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:aa:27,bridge_name='br-int',has_traffic_filtering=True,id=8f77c03f-9bb8-441c-97a9-19bb14a14d89,network=Network(387b4fc3-39ad-40c3-bcd7-7526b09e30b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f77c03f-9b') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 09:41:08 user nova-compute[75122]: DEBUG os_vif [None req-fa7aa7ec-1614-4bc0-add5-9012ea6c0d35 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:aa:27,bridge_name='br-int',has_traffic_filtering=True,id=8f77c03f-9bb8-441c-97a9-19bb14a14d89,network=Network(387b4fc3-39ad-40c3-bcd7-7526b09e30b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f77c03f-9b') {{(pid=75122) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 09:41:08 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:41:08 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:41:08 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 09:41:08 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:41:08 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ac3a47c7-b101-5750-8b2c-019e10882c97', '_type': 'linux-noop'}}, row=False) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:41:08 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:41:08 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:41:08 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:41:08 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8f77c03f-9b, may_exist=True, interface_attrs={}) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:41:08 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8f77c03f-9b, col_values=(('qos', UUID('ff7ce761-5815-4ede-9f49-5f195ebda381')),), if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:41:08 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8f77c03f-9b, col_values=(('external_ids', {'iface-id': '8f77c03f-9bb8-441c-97a9-19bb14a14d89', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:18:aa:27', 'vm-uuid': '6f6177c5-3048-4a78-b34a-e595d26d69d0'}),), if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:41:08 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:41:08 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:41:08 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:41:08 user nova-compute[75122]: INFO os_vif [None req-fa7aa7ec-1614-4bc0-add5-9012ea6c0d35 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:aa:27,bridge_name='br-int',has_traffic_filtering=True,id=8f77c03f-9bb8-441c-97a9-19bb14a14d89,network=Network(387b4fc3-39ad-40c3-bcd7-7526b09e30b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f77c03f-9b')
Nov 15 09:41:08 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-fa7aa7ec-1614-4bc0-add5-9012ea6c0d35 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] No BDM found with device name vda, not building metadata. {{(pid=75122) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 09:41:08 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-fa7aa7ec-1614-4bc0-add5-9012ea6c0d35 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] No VIF found with MAC fa:16:3e:18:aa:27, not building metadata {{(pid=75122) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 09:41:09 user nova-compute[75122]: DEBUG nova.network.neutron [req-00f47bb8-ade3-4ac3-88d5-f08d3b096d15 req-e381394c-083e-4c01-947a-9a1a4942cbf5 service nova] [instance: 6f6177c5-3048-4a78-b34a-e595d26d69d0] Updated VIF entry in instance network info cache for port 8f77c03f-9bb8-441c-97a9-19bb14a14d89. {{(pid=75122) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 09:41:09 user nova-compute[75122]: DEBUG nova.network.neutron [req-00f47bb8-ade3-4ac3-88d5-f08d3b096d15 req-e381394c-083e-4c01-947a-9a1a4942cbf5 service nova] [instance: 6f6177c5-3048-4a78-b34a-e595d26d69d0] Updating instance_info_cache with network_info: [{"id": "8f77c03f-9bb8-441c-97a9-19bb14a14d89", "address": "fa:16:3e:18:aa:27", "network": {"id": "387b4fc3-39ad-40c3-bcd7-7526b09e30b7", "bridge": "br-int", "label": "tempest-TestStampPattern-1501769990-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bdc0f52b1c744b91b4f1a4ecd07e07c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f77c03f-9b", "ovs_interfaceid": "8f77c03f-9bb8-441c-97a9-19bb14a14d89", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:41:09 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-00f47bb8-ade3-4ac3-88d5-f08d3b096d15 req-e381394c-083e-4c01-947a-9a1a4942cbf5 service nova] Releasing lock "refresh_cache-6f6177c5-3048-4a78-b34a-e595d26d69d0" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 09:41:09 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:41:10 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:41:10 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:41:10 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:41:10 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:41:10 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:41:11 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:41:12 user nova-compute[75122]: DEBUG nova.compute.manager [None req-fa7aa7ec-1614-4bc0-add5-9012ea6c0d35 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] [instance: 6f6177c5-3048-4a78-b34a-e595d26d69d0] Instance event wait completed in 0 seconds for  {{(pid=75122) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 09:41:12 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-fa7aa7ec-1614-4bc0-add5-9012ea6c0d35 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] [instance: 6f6177c5-3048-4a78-b34a-e595d26d69d0] Guest created on hypervisor {{(pid=75122) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 09:41:12 user nova-compute[75122]: INFO nova.virt.libvirt.driver [-] [instance: 6f6177c5-3048-4a78-b34a-e595d26d69d0] Instance spawned successfully.
Nov 15 09:41:12 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-fa7aa7ec-1614-4bc0-add5-9012ea6c0d35 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] [instance: 6f6177c5-3048-4a78-b34a-e595d26d69d0] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 09:41:12 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-fa7aa7ec-1614-4bc0-add5-9012ea6c0d35 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] [instance: 6f6177c5-3048-4a78-b34a-e595d26d69d0] Found default for hw_input_bus of None {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:41:12 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-fa7aa7ec-1614-4bc0-add5-9012ea6c0d35 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] [instance: 6f6177c5-3048-4a78-b34a-e595d26d69d0] Found default for hw_pointer_model of None {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:41:12 user nova-compute[75122]: INFO nova.compute.manager [None req-fa7aa7ec-1614-4bc0-add5-9012ea6c0d35 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] [instance: 6f6177c5-3048-4a78-b34a-e595d26d69d0] Took 7.60 seconds to spawn the instance on the hypervisor.
Nov 15 09:41:12 user nova-compute[75122]: DEBUG nova.compute.manager [None req-fa7aa7ec-1614-4bc0-add5-9012ea6c0d35 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] [instance: 6f6177c5-3048-4a78-b34a-e595d26d69d0] Checking state {{(pid=75122) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 09:41:12 user nova-compute[75122]: INFO nova.compute.manager [None req-fa7aa7ec-1614-4bc0-add5-9012ea6c0d35 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] [instance: 6f6177c5-3048-4a78-b34a-e595d26d69d0] Took 8.51 seconds to build instance.
Nov 15 09:41:12 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-fa7aa7ec-1614-4bc0-add5-9012ea6c0d35 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Lock "6f6177c5-3048-4a78-b34a-e595d26d69d0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.605s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:41:12 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-faca803d-7a82-47f7-bae1-e20ce4eb16d2 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] Acquiring lock "52c066f3-dea1-4aa3-9da4-da9397b9fff1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:41:12 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-faca803d-7a82-47f7-bae1-e20ce4eb16d2 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] Lock "52c066f3-dea1-4aa3-9da4-da9397b9fff1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:41:12 user nova-compute[75122]: DEBUG nova.compute.manager [None req-faca803d-7a82-47f7-bae1-e20ce4eb16d2 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] [instance: 52c066f3-dea1-4aa3-9da4-da9397b9fff1] Starting instance... {{(pid=75122) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 09:41:12 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-faca803d-7a82-47f7-bae1-e20ce4eb16d2 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:41:12 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-faca803d-7a82-47f7-bae1-e20ce4eb16d2 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:41:12 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-faca803d-7a82-47f7-bae1-e20ce4eb16d2 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75122) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 09:41:12 user nova-compute[75122]: INFO nova.compute.claims [None req-faca803d-7a82-47f7-bae1-e20ce4eb16d2 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] [instance: 52c066f3-dea1-4aa3-9da4-da9397b9fff1] Claim successful on node user
Nov 15 09:41:13 user nova-compute[75122]: DEBUG nova.compute.provider_tree [None req-faca803d-7a82-47f7-bae1-e20ce4eb16d2 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] Inventory has not changed in ProviderTree for provider: 69a3da65-47be-44c6-b67c-c692b58284ef {{(pid=75122) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 09:41:13 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-faca803d-7a82-47f7-bae1-e20ce4eb16d2 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] Inventory has not changed for provider 69a3da65-47be-44c6-b67c-c692b58284ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 09:41:13 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-faca803d-7a82-47f7-bae1-e20ce4eb16d2 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.427s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:41:13 user nova-compute[75122]: DEBUG nova.compute.manager [None req-faca803d-7a82-47f7-bae1-e20ce4eb16d2 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] [instance: 52c066f3-dea1-4aa3-9da4-da9397b9fff1] Start building networks asynchronously for instance. {{(pid=75122) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 09:41:13 user nova-compute[75122]: DEBUG nova.compute.manager [None req-faca803d-7a82-47f7-bae1-e20ce4eb16d2 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] [instance: 52c066f3-dea1-4aa3-9da4-da9397b9fff1] Allocating IP information in the background. {{(pid=75122) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 09:41:13 user nova-compute[75122]: DEBUG nova.network.neutron [None req-faca803d-7a82-47f7-bae1-e20ce4eb16d2 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] [instance: 52c066f3-dea1-4aa3-9da4-da9397b9fff1] allocate_for_instance() {{(pid=75122) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 09:41:13 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-faca803d-7a82-47f7-bae1-e20ce4eb16d2 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] [instance: 52c066f3-dea1-4aa3-9da4-da9397b9fff1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 09:41:13 user nova-compute[75122]: DEBUG nova.compute.manager [None req-faca803d-7a82-47f7-bae1-e20ce4eb16d2 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] [instance: 52c066f3-dea1-4aa3-9da4-da9397b9fff1] Start building block device mappings for instance. {{(pid=75122) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 09:41:13 user nova-compute[75122]: DEBUG nova.policy [None req-faca803d-7a82-47f7-bae1-e20ce4eb16d2 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8956b45f936640e392df01f3262db471', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1030239722241f5ae167b813b4fee15', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75122) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 09:41:13 user nova-compute[75122]: DEBUG nova.compute.manager [None req-faca803d-7a82-47f7-bae1-e20ce4eb16d2 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] [instance: 52c066f3-dea1-4aa3-9da4-da9397b9fff1] Start spawning the instance on the hypervisor. {{(pid=75122) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 09:41:13 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-faca803d-7a82-47f7-bae1-e20ce4eb16d2 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] [instance: 52c066f3-dea1-4aa3-9da4-da9397b9fff1] Creating instance directory {{(pid=75122) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 09:41:13 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-faca803d-7a82-47f7-bae1-e20ce4eb16d2 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] [instance: 52c066f3-dea1-4aa3-9da4-da9397b9fff1] Creating image(s)
Nov 15 09:41:13 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-faca803d-7a82-47f7-bae1-e20ce4eb16d2 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] Acquiring lock "/opt/stack/data/nova/instances/52c066f3-dea1-4aa3-9da4-da9397b9fff1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:41:13 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-faca803d-7a82-47f7-bae1-e20ce4eb16d2 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] Lock "/opt/stack/data/nova/instances/52c066f3-dea1-4aa3-9da4-da9397b9fff1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:41:13 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-faca803d-7a82-47f7-bae1-e20ce4eb16d2 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] Lock "/opt/stack/data/nova/instances/52c066f3-dea1-4aa3-9da4-da9397b9fff1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:41:13 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-faca803d-7a82-47f7-bae1-e20ce4eb16d2 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:41:13 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:41:13 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-faca803d-7a82-47f7-bae1-e20ce4eb16d2 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json" returned: 0 in 0.177s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:41:13 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-faca803d-7a82-47f7-bae1-e20ce4eb16d2 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] Acquiring lock "95d6e29f74d5408f818e32f3bc29bc8270a4c665" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:41:13 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-faca803d-7a82-47f7-bae1-e20ce4eb16d2 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] Lock "95d6e29f74d5408f818e32f3bc29bc8270a4c665" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:41:13 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-faca803d-7a82-47f7-bae1-e20ce4eb16d2 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:41:13 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-faca803d-7a82-47f7-bae1-e20ce4eb16d2 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json" returned: 0 in 0.176s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:41:13 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-faca803d-7a82-47f7-bae1-e20ce4eb16d2 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665,backing_fmt=raw /opt/stack/data/nova/instances/52c066f3-dea1-4aa3-9da4-da9397b9fff1/disk 1073741824 {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:41:14 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-faca803d-7a82-47f7-bae1-e20ce4eb16d2 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665,backing_fmt=raw /opt/stack/data/nova/instances/52c066f3-dea1-4aa3-9da4-da9397b9fff1/disk 1073741824" returned: 0 in 0.048s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:41:14 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-faca803d-7a82-47f7-bae1-e20ce4eb16d2 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] Lock "95d6e29f74d5408f818e32f3bc29bc8270a4c665" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.230s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:41:14 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-faca803d-7a82-47f7-bae1-e20ce4eb16d2 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:41:14 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-faca803d-7a82-47f7-bae1-e20ce4eb16d2 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json" returned: 0 in 0.204s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:41:14 user nova-compute[75122]: DEBUG nova.virt.disk.api [None req-faca803d-7a82-47f7-bae1-e20ce4eb16d2 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] Checking if we can resize image /opt/stack/data/nova/instances/52c066f3-dea1-4aa3-9da4-da9397b9fff1/disk. size=1073741824 {{(pid=75122) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 09:41:14 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-faca803d-7a82-47f7-bae1-e20ce4eb16d2 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52c066f3-dea1-4aa3-9da4-da9397b9fff1/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:41:14 user nova-compute[75122]: DEBUG nova.network.neutron [None req-faca803d-7a82-47f7-bae1-e20ce4eb16d2 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] [instance: 52c066f3-dea1-4aa3-9da4-da9397b9fff1] Successfully created port: 57222fd9-53d9-4344-b5c7-1b77cb36fd65 {{(pid=75122) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 09:41:14 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-faca803d-7a82-47f7-bae1-e20ce4eb16d2 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52c066f3-dea1-4aa3-9da4-da9397b9fff1/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:41:14 user nova-compute[75122]: DEBUG nova.virt.disk.api [None req-faca803d-7a82-47f7-bae1-e20ce4eb16d2 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] Cannot resize image /opt/stack/data/nova/instances/52c066f3-dea1-4aa3-9da4-da9397b9fff1/disk to a smaller size. {{(pid=75122) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 09:41:14 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-faca803d-7a82-47f7-bae1-e20ce4eb16d2 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] [instance: 52c066f3-dea1-4aa3-9da4-da9397b9fff1] Created local disks {{(pid=75122) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 09:41:14 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-faca803d-7a82-47f7-bae1-e20ce4eb16d2 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] [instance: 52c066f3-dea1-4aa3-9da4-da9397b9fff1] Ensure instance console log exists: /opt/stack/data/nova/instances/52c066f3-dea1-4aa3-9da4-da9397b9fff1/console.log {{(pid=75122) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 09:41:14 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-faca803d-7a82-47f7-bae1-e20ce4eb16d2 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:41:14 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-faca803d-7a82-47f7-bae1-e20ce4eb16d2 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:41:14 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-faca803d-7a82-47f7-bae1-e20ce4eb16d2 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:41:14 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0d082253-166e-4d56-b59f-c192650191fe tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] Acquiring lock "5b5a4d58-ba1e-473d-a32a-06fae1c84efc" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:41:14 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0d082253-166e-4d56-b59f-c192650191fe tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] Lock "5b5a4d58-ba1e-473d-a32a-06fae1c84efc" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:41:14 user nova-compute[75122]: INFO nova.compute.manager [None req-0d082253-166e-4d56-b59f-c192650191fe tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] [instance: 5b5a4d58-ba1e-473d-a32a-06fae1c84efc] Detaching volume 0b366dd5-506b-4ee0-9e25-990a31acf3eb
Nov 15 09:41:14 user nova-compute[75122]: INFO nova.virt.block_device [None req-0d082253-166e-4d56-b59f-c192650191fe tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] [instance: 5b5a4d58-ba1e-473d-a32a-06fae1c84efc] Attempting to driver detach volume 0b366dd5-506b-4ee0-9e25-990a31acf3eb from mountpoint /dev/vdb
Nov 15 09:41:14 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-0d082253-166e-4d56-b59f-c192650191fe tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] Attempting to detach device vdb from instance 5b5a4d58-ba1e-473d-a32a-06fae1c84efc from the persistent domain config. {{(pid=75122) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 09:41:14 user nova-compute[75122]: DEBUG nova.virt.libvirt.guest [None req-0d082253-166e-4d56-b59f-c192650191fe tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 09:41:14 user nova-compute[75122]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 09:41:14 user nova-compute[75122]:   <source dev="/dev/sdd"/>
Nov 15 09:41:14 user nova-compute[75122]:   <target dev="vdb" bus="virtio"/>
Nov 15 09:41:14 user nova-compute[75122]:   <serial>0b366dd5-506b-4ee0-9e25-990a31acf3eb</serial>
Nov 15 09:41:14 user nova-compute[75122]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 09:41:14 user nova-compute[75122]: </disk>
Nov 15 09:41:14 user nova-compute[75122]:  {{(pid=75122) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 09:41:14 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-0d082253-166e-4d56-b59f-c192650191fe tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] Successfully detached device vdb from instance 5b5a4d58-ba1e-473d-a32a-06fae1c84efc from the persistent domain config.
Nov 15 09:41:14 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-0d082253-166e-4d56-b59f-c192650191fe tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5b5a4d58-ba1e-473d-a32a-06fae1c84efc from the live domain config. {{(pid=75122) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 09:41:14 user nova-compute[75122]: DEBUG nova.virt.libvirt.guest [None req-0d082253-166e-4d56-b59f-c192650191fe tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 09:41:14 user nova-compute[75122]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 09:41:14 user nova-compute[75122]:   <source dev="/dev/sdd"/>
Nov 15 09:41:14 user nova-compute[75122]:   <target dev="vdb" bus="virtio"/>
Nov 15 09:41:14 user nova-compute[75122]:   <serial>0b366dd5-506b-4ee0-9e25-990a31acf3eb</serial>
Nov 15 09:41:14 user nova-compute[75122]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 09:41:14 user nova-compute[75122]: </disk>
Nov 15 09:41:14 user nova-compute[75122]:  {{(pid=75122) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 09:41:15 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-0d082253-166e-4d56-b59f-c192650191fe tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5b5a4d58-ba1e-473d-a32a-06fae1c84efc {{(pid=75122) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 09:41:15 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:41:15 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75122) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 09:41:15 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:41:15 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Cleaning up deleted instances {{(pid=75122) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 15 09:41:15 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] There are 0 instances to clean {{(pid=75122) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 15 09:41:15 user nova-compute[75122]: DEBUG nova.network.neutron [None req-faca803d-7a82-47f7-bae1-e20ce4eb16d2 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] [instance: 52c066f3-dea1-4aa3-9da4-da9397b9fff1] Successfully updated port: 57222fd9-53d9-4344-b5c7-1b77cb36fd65 {{(pid=75122) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 09:41:15 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-faca803d-7a82-47f7-bae1-e20ce4eb16d2 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] Acquiring lock "refresh_cache-52c066f3-dea1-4aa3-9da4-da9397b9fff1" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 09:41:15 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-faca803d-7a82-47f7-bae1-e20ce4eb16d2 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] Acquired lock "refresh_cache-52c066f3-dea1-4aa3-9da4-da9397b9fff1" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 09:41:15 user nova-compute[75122]: DEBUG nova.network.neutron [None req-faca803d-7a82-47f7-bae1-e20ce4eb16d2 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] [instance: 52c066f3-dea1-4aa3-9da4-da9397b9fff1] Building network info cache for instance {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 09:41:15 user nova-compute[75122]: DEBUG nova.compute.manager [req-917107c5-d54f-4d22-a8c8-7f6ffe62b2cc req-4d59181f-611d-445a-b078-1dbee4933972 service nova] [instance: 52c066f3-dea1-4aa3-9da4-da9397b9fff1] Received event network-changed-57222fd9-53d9-4344-b5c7-1b77cb36fd65 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:41:15 user nova-compute[75122]: DEBUG nova.compute.manager [req-917107c5-d54f-4d22-a8c8-7f6ffe62b2cc req-4d59181f-611d-445a-b078-1dbee4933972 service nova] [instance: 52c066f3-dea1-4aa3-9da4-da9397b9fff1] Refreshing instance network info cache due to event network-changed-57222fd9-53d9-4344-b5c7-1b77cb36fd65. {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 09:41:15 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-917107c5-d54f-4d22-a8c8-7f6ffe62b2cc req-4d59181f-611d-445a-b078-1dbee4933972 service nova] Acquiring lock "refresh_cache-52c066f3-dea1-4aa3-9da4-da9397b9fff1" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 09:41:15 user nova-compute[75122]: DEBUG nova.network.neutron [None req-faca803d-7a82-47f7-bae1-e20ce4eb16d2 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] [instance: 52c066f3-dea1-4aa3-9da4-da9397b9fff1] Instance cache missing network info. {{(pid=75122) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 09:41:15 user nova-compute[75122]: DEBUG nova.compute.manager [req-0a34df5f-1242-4c53-b57b-bc02df86b43d req-e6003895-51cb-406f-bfc5-95725a429a34 service nova] [instance: 6f6177c5-3048-4a78-b34a-e595d26d69d0] Received event network-vif-plugged-8f77c03f-9bb8-441c-97a9-19bb14a14d89 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:41:15 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-0a34df5f-1242-4c53-b57b-bc02df86b43d req-e6003895-51cb-406f-bfc5-95725a429a34 service nova] Acquiring lock "6f6177c5-3048-4a78-b34a-e595d26d69d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:41:15 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-0a34df5f-1242-4c53-b57b-bc02df86b43d req-e6003895-51cb-406f-bfc5-95725a429a34 service nova] Lock "6f6177c5-3048-4a78-b34a-e595d26d69d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:41:15 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-0a34df5f-1242-4c53-b57b-bc02df86b43d req-e6003895-51cb-406f-bfc5-95725a429a34 service nova] Lock "6f6177c5-3048-4a78-b34a-e595d26d69d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:41:15 user nova-compute[75122]: DEBUG nova.compute.manager [req-0a34df5f-1242-4c53-b57b-bc02df86b43d req-e6003895-51cb-406f-bfc5-95725a429a34 service nova] [instance: 6f6177c5-3048-4a78-b34a-e595d26d69d0] No waiting events found dispatching network-vif-plugged-8f77c03f-9bb8-441c-97a9-19bb14a14d89 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:41:15 user nova-compute[75122]: WARNING nova.compute.manager [req-0a34df5f-1242-4c53-b57b-bc02df86b43d req-e6003895-51cb-406f-bfc5-95725a429a34 service nova] [instance: 6f6177c5-3048-4a78-b34a-e595d26d69d0] Received unexpected event network-vif-plugged-8f77c03f-9bb8-441c-97a9-19bb14a14d89 for instance with vm_state active and task_state None.
Nov 15 09:41:15 user nova-compute[75122]: DEBUG nova.network.neutron [None req-faca803d-7a82-47f7-bae1-e20ce4eb16d2 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] [instance: 52c066f3-dea1-4aa3-9da4-da9397b9fff1] Updating instance_info_cache with network_info: [{"id": "57222fd9-53d9-4344-b5c7-1b77cb36fd65", "address": "fa:16:3e:dd:19:1b", "network": {"id": "8510a5b3-69c9-4fd8-9f2c-c83a255474b5", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-535784436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1030239722241f5ae167b813b4fee15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57222fd9-53", "ovs_interfaceid": "57222fd9-53d9-4344-b5c7-1b77cb36fd65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:41:15 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-faca803d-7a82-47f7-bae1-e20ce4eb16d2 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] Releasing lock "refresh_cache-52c066f3-dea1-4aa3-9da4-da9397b9fff1" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 09:41:15 user nova-compute[75122]: DEBUG nova.compute.manager [None req-faca803d-7a82-47f7-bae1-e20ce4eb16d2 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] [instance: 52c066f3-dea1-4aa3-9da4-da9397b9fff1] Instance network_info: |[{"id": "57222fd9-53d9-4344-b5c7-1b77cb36fd65", "address": "fa:16:3e:dd:19:1b", "network": {"id": "8510a5b3-69c9-4fd8-9f2c-c83a255474b5", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-535784436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1030239722241f5ae167b813b4fee15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57222fd9-53", "ovs_interfaceid": "57222fd9-53d9-4344-b5c7-1b77cb36fd65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75122) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 09:41:15 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-917107c5-d54f-4d22-a8c8-7f6ffe62b2cc req-4d59181f-611d-445a-b078-1dbee4933972 service nova] Acquired lock "refresh_cache-52c066f3-dea1-4aa3-9da4-da9397b9fff1" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 09:41:15 user nova-compute[75122]: DEBUG nova.network.neutron [req-917107c5-d54f-4d22-a8c8-7f6ffe62b2cc req-4d59181f-611d-445a-b078-1dbee4933972 service nova] [instance: 52c066f3-dea1-4aa3-9da4-da9397b9fff1] Refreshing network info cache for port 57222fd9-53d9-4344-b5c7-1b77cb36fd65 {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 09:41:15 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-faca803d-7a82-47f7-bae1-e20ce4eb16d2 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] [instance: 52c066f3-dea1-4aa3-9da4-da9397b9fff1] Start _get_guest_xml network_info=[{"id": "57222fd9-53d9-4344-b5c7-1b77cb36fd65", "address": "fa:16:3e:dd:19:1b", "network": {"id": "8510a5b3-69c9-4fd8-9f2c-c83a255474b5", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-535784436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1030239722241f5ae167b813b4fee15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57222fd9-53", "ovs_interfaceid": "57222fd9-53d9-4344-b5c7-1b77cb36fd65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T09:26:31Z,direct_url=<?>,disk_format='qcow2',id=5e862cfe-47b8-4725-8292-65761ee6d0f5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9c57733cb41847c0b4ad31519c382e5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T09:26:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '5e862cfe-47b8-4725-8292-65761ee6d0f5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75122) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 09:41:15 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-faca803d-7a82-47f7-bae1-e20ce4eb16d2 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 09:41:15 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-faca803d-7a82-47f7-bae1-e20ce4eb16d2 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 09:41:15 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-faca803d-7a82-47f7-bae1-e20ce4eb16d2 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75122) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 09:41:15 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-faca803d-7a82-47f7-bae1-e20ce4eb16d2 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] CPU controller missing on host. {{(pid=75122) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 09:41:15 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-faca803d-7a82-47f7-bae1-e20ce4eb16d2 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75122) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 09:41:15 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-faca803d-7a82-47f7-bae1-e20ce4eb16d2 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] CPU controller found on host. {{(pid=75122) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 09:41:15 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-faca803d-7a82-47f7-bae1-e20ce4eb16d2 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75122) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 09:41:15 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-faca803d-7a82-47f7-bae1-e20ce4eb16d2 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T09:26:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T09:26:31Z,direct_url=<?>,disk_format='qcow2',id=5e862cfe-47b8-4725-8292-65761ee6d0f5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9c57733cb41847c0b4ad31519c382e5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T09:26:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 09:41:15 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-faca803d-7a82-47f7-bae1-e20ce4eb16d2 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] Flavor limits 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 09:41:15 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-faca803d-7a82-47f7-bae1-e20ce4eb16d2 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] Image limits 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 09:41:15 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-faca803d-7a82-47f7-bae1-e20ce4eb16d2 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] Flavor pref 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 09:41:15 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-faca803d-7a82-47f7-bae1-e20ce4eb16d2 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] Image pref 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 09:41:15 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-faca803d-7a82-47f7-bae1-e20ce4eb16d2 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 09:41:15 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-faca803d-7a82-47f7-bae1-e20ce4eb16d2 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 09:41:15 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-faca803d-7a82-47f7-bae1-e20ce4eb16d2 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75122) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 09:41:15 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-faca803d-7a82-47f7-bae1-e20ce4eb16d2 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] Got 1 possible topologies {{(pid=75122) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 09:41:15 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-faca803d-7a82-47f7-bae1-e20ce4eb16d2 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 09:41:15 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-faca803d-7a82-47f7-bae1-e20ce4eb16d2 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 09:41:15 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-faca803d-7a82-47f7-bae1-e20ce4eb16d2 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T09:41:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1892172195',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1892172195',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1892172',id=27,image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPBUmT4sfkb1U+xbzFDHPS8xcVlJkOW5a4VHDucj2MH8kxD6Q4mYTszYeqlAJhLAbR/5hg60tDsQXwx7fLY5RewUgKp3CazqqDpmWsMwkuOk36oG+Yyotz+HvmkhgkebKw==',key_name='tempest-keypair-1437934740',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f1030239722241f5ae167b813b4fee15',ramdisk_id='',reservation_id='r-2dp92q16',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1710486673',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T09:41:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8956b45f936640e392df01f3262db471',uuid=52c066f3-dea1-4aa3-9da4-da9397b9fff1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "57222fd9-53d9-4344-b5c7-1b77cb36fd65", "address": "fa:16:3e:dd:19:1b", "network": {"id": "8510a5b3-69c9-4fd8-9f2c-c83a255474b5", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-535784436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1030239722241f5ae167b813b4fee15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57222fd9-53", "ovs_interfaceid": "57222fd9-53d9-4344-b5c7-1b77cb36fd65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75122) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 09:41:15 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-faca803d-7a82-47f7-bae1-e20ce4eb16d2 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] Converting VIF {"id": "57222fd9-53d9-4344-b5c7-1b77cb36fd65", "address": "fa:16:3e:dd:19:1b", "network": {"id": "8510a5b3-69c9-4fd8-9f2c-c83a255474b5", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-535784436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1030239722241f5ae167b813b4fee15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57222fd9-53", "ovs_interfaceid": "57222fd9-53d9-4344-b5c7-1b77cb36fd65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 09:41:15 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-faca803d-7a82-47f7-bae1-e20ce4eb16d2 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:19:1b,bridge_name='br-int',has_traffic_filtering=True,id=57222fd9-53d9-4344-b5c7-1b77cb36fd65,network=Network(8510a5b3-69c9-4fd8-9f2c-c83a255474b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57222fd9-53') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 09:41:15 user nova-compute[75122]: DEBUG nova.objects.instance [None req-faca803d-7a82-47f7-bae1-e20ce4eb16d2 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] Lazy-loading 'pci_devices' on Instance uuid 52c066f3-dea1-4aa3-9da4-da9397b9fff1 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:41:15 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-faca803d-7a82-47f7-bae1-e20ce4eb16d2 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] [instance: 52c066f3-dea1-4aa3-9da4-da9397b9fff1] End _get_guest_xml xml=<domain type="kvm">
Nov 15 09:41:15 user nova-compute[75122]:   <uuid>52c066f3-dea1-4aa3-9da4-da9397b9fff1</uuid>
Nov 15 09:41:15 user nova-compute[75122]:   <name>instance-0000001b</name>
Nov 15 09:41:15 user nova-compute[75122]:   <memory>524288</memory>
Nov 15 09:41:15 user nova-compute[75122]:   <vcpu>1</vcpu>
Nov 15 09:41:15 user nova-compute[75122]:   <metadata>
Nov 15 09:41:15 user nova-compute[75122]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 09:41:15 user nova-compute[75122]:       <nova:package version="0.0.0"/>
Nov 15 09:41:15 user nova-compute[75122]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-1892172195</nova:name>
Nov 15 09:41:15 user nova-compute[75122]:       <nova:creationTime>2023-11-15 09:41:15</nova:creationTime>
Nov 15 09:41:15 user nova-compute[75122]:       <nova:flavor name="m1.tiny">
Nov 15 09:41:15 user nova-compute[75122]:         <nova:memory>512</nova:memory>
Nov 15 09:41:15 user nova-compute[75122]:         <nova:disk>1</nova:disk>
Nov 15 09:41:15 user nova-compute[75122]:         <nova:swap>0</nova:swap>
Nov 15 09:41:15 user nova-compute[75122]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 09:41:15 user nova-compute[75122]:         <nova:vcpus>1</nova:vcpus>
Nov 15 09:41:15 user nova-compute[75122]:       </nova:flavor>
Nov 15 09:41:15 user nova-compute[75122]:       <nova:owner>
Nov 15 09:41:15 user nova-compute[75122]:         <nova:user uuid="8956b45f936640e392df01f3262db471">tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member</nova:user>
Nov 15 09:41:15 user nova-compute[75122]:         <nova:project uuid="f1030239722241f5ae167b813b4fee15">tempest-TestServerVolumeAttachScenarioOldVersion-1710486673</nova:project>
Nov 15 09:41:15 user nova-compute[75122]:       </nova:owner>
Nov 15 09:41:15 user nova-compute[75122]:       <nova:root type="image" uuid="5e862cfe-47b8-4725-8292-65761ee6d0f5"/>
Nov 15 09:41:15 user nova-compute[75122]:       <nova:ports>
Nov 15 09:41:15 user nova-compute[75122]:         <nova:port uuid="57222fd9-53d9-4344-b5c7-1b77cb36fd65">
Nov 15 09:41:15 user nova-compute[75122]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 15 09:41:15 user nova-compute[75122]:         </nova:port>
Nov 15 09:41:15 user nova-compute[75122]:       </nova:ports>
Nov 15 09:41:15 user nova-compute[75122]:     </nova:instance>
Nov 15 09:41:15 user nova-compute[75122]:   </metadata>
Nov 15 09:41:15 user nova-compute[75122]:   <sysinfo type="smbios">
Nov 15 09:41:15 user nova-compute[75122]:     <system>
Nov 15 09:41:15 user nova-compute[75122]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 09:41:15 user nova-compute[75122]:       <entry name="product">OpenStack Nova</entry>
Nov 15 09:41:15 user nova-compute[75122]:       <entry name="version">0.0.0</entry>
Nov 15 09:41:15 user nova-compute[75122]:       <entry name="serial">52c066f3-dea1-4aa3-9da4-da9397b9fff1</entry>
Nov 15 09:41:15 user nova-compute[75122]:       <entry name="uuid">52c066f3-dea1-4aa3-9da4-da9397b9fff1</entry>
Nov 15 09:41:15 user nova-compute[75122]:       <entry name="family">Virtual Machine</entry>
Nov 15 09:41:15 user nova-compute[75122]:     </system>
Nov 15 09:41:15 user nova-compute[75122]:   </sysinfo>
Nov 15 09:41:15 user nova-compute[75122]:   <os>
Nov 15 09:41:15 user nova-compute[75122]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 09:41:15 user nova-compute[75122]:     <boot dev="hd"/>
Nov 15 09:41:15 user nova-compute[75122]:     <smbios mode="sysinfo"/>
Nov 15 09:41:15 user nova-compute[75122]:   </os>
Nov 15 09:41:15 user nova-compute[75122]:   <features>
Nov 15 09:41:15 user nova-compute[75122]:     <acpi/>
Nov 15 09:41:15 user nova-compute[75122]:     <apic/>
Nov 15 09:41:15 user nova-compute[75122]:     <vmcoreinfo/>
Nov 15 09:41:15 user nova-compute[75122]:   </features>
Nov 15 09:41:15 user nova-compute[75122]:   <clock offset="utc">
Nov 15 09:41:15 user nova-compute[75122]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 09:41:15 user nova-compute[75122]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 09:41:15 user nova-compute[75122]:     <timer name="hpet" present="no"/>
Nov 15 09:41:15 user nova-compute[75122]:   </clock>
Nov 15 09:41:15 user nova-compute[75122]:   <cpu mode="custom" match="exact">
Nov 15 09:41:15 user nova-compute[75122]:     <model>Nehalem</model>
Nov 15 09:41:15 user nova-compute[75122]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 09:41:15 user nova-compute[75122]:   </cpu>
Nov 15 09:41:15 user nova-compute[75122]:   <devices>
Nov 15 09:41:15 user nova-compute[75122]:     <disk type="file" device="disk">
Nov 15 09:41:15 user nova-compute[75122]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 09:41:15 user nova-compute[75122]:       <source file="/opt/stack/data/nova/instances/52c066f3-dea1-4aa3-9da4-da9397b9fff1/disk"/>
Nov 15 09:41:15 user nova-compute[75122]:       <target dev="vda" bus="virtio"/>
Nov 15 09:41:15 user nova-compute[75122]:     </disk>
Nov 15 09:41:15 user nova-compute[75122]:     <interface type="ethernet">
Nov 15 09:41:15 user nova-compute[75122]:       <mac address="fa:16:3e:dd:19:1b"/>
Nov 15 09:41:15 user nova-compute[75122]:       <model type="virtio"/>
Nov 15 09:41:15 user nova-compute[75122]:       <mtu size="1442"/>
Nov 15 09:41:15 user nova-compute[75122]:       <target dev="tap57222fd9-53"/>
Nov 15 09:41:15 user nova-compute[75122]:     </interface>
Nov 15 09:41:15 user nova-compute[75122]:     <serial type="pty">
Nov 15 09:41:15 user nova-compute[75122]:       <log file="/opt/stack/data/nova/instances/52c066f3-dea1-4aa3-9da4-da9397b9fff1/console.log" append="off"/>
Nov 15 09:41:15 user nova-compute[75122]:     </serial>
Nov 15 09:41:15 user nova-compute[75122]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 09:41:15 user nova-compute[75122]:     <video>
Nov 15 09:41:15 user nova-compute[75122]:       <model type="virtio"/>
Nov 15 09:41:15 user nova-compute[75122]:     </video>
Nov 15 09:41:15 user nova-compute[75122]:     <rng model="virtio">
Nov 15 09:41:15 user nova-compute[75122]:       <backend model="random">/dev/urandom</backend>
Nov 15 09:41:15 user nova-compute[75122]:     </rng>
Nov 15 09:41:15 user nova-compute[75122]:     <controller type="usb" index="0" model="none"/>
Nov 15 09:41:15 user nova-compute[75122]:     <memballoon model="virtio">
Nov 15 09:41:15 user nova-compute[75122]:       <stats period="10"/>
Nov 15 09:41:15 user nova-compute[75122]:     </memballoon>
Nov 15 09:41:15 user nova-compute[75122]:   </devices>
Nov 15 09:41:15 user nova-compute[75122]: </domain>
Nov 15 09:41:15 user nova-compute[75122]:  {{(pid=75122) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 09:41:15 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-faca803d-7a82-47f7-bae1-e20ce4eb16d2 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T09:41:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1892172195',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1892172195',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1892172',id=27,image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPBUmT4sfkb1U+xbzFDHPS8xcVlJkOW5a4VHDucj2MH8kxD6Q4mYTszYeqlAJhLAbR/5hg60tDsQXwx7fLY5RewUgKp3CazqqDpmWsMwkuOk36oG+Yyotz+HvmkhgkebKw==',key_name='tempest-keypair-1437934740',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f1030239722241f5ae167b813b4fee15',ramdisk_id='',reservation_id='r-2dp92q16',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1710486673',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T09:41:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8956b45f936640e392df01f3262db471',uuid=52c066f3-dea1-4aa3-9da4-da9397b9fff1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "57222fd9-53d9-4344-b5c7-1b77cb36fd65", "address": "fa:16:3e:dd:19:1b", "network": {"id": "8510a5b3-69c9-4fd8-9f2c-c83a255474b5", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-535784436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1030239722241f5ae167b813b4fee15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57222fd9-53", "ovs_interfaceid": "57222fd9-53d9-4344-b5c7-1b77cb36fd65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 09:41:15 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-faca803d-7a82-47f7-bae1-e20ce4eb16d2 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] Converting VIF {"id": "57222fd9-53d9-4344-b5c7-1b77cb36fd65", "address": "fa:16:3e:dd:19:1b", "network": {"id": "8510a5b3-69c9-4fd8-9f2c-c83a255474b5", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-535784436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1030239722241f5ae167b813b4fee15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57222fd9-53", "ovs_interfaceid": "57222fd9-53d9-4344-b5c7-1b77cb36fd65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 09:41:15 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-faca803d-7a82-47f7-bae1-e20ce4eb16d2 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:19:1b,bridge_name='br-int',has_traffic_filtering=True,id=57222fd9-53d9-4344-b5c7-1b77cb36fd65,network=Network(8510a5b3-69c9-4fd8-9f2c-c83a255474b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57222fd9-53') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 09:41:15 user nova-compute[75122]: DEBUG os_vif [None req-faca803d-7a82-47f7-bae1-e20ce4eb16d2 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:19:1b,bridge_name='br-int',has_traffic_filtering=True,id=57222fd9-53d9-4344-b5c7-1b77cb36fd65,network=Network(8510a5b3-69c9-4fd8-9f2c-c83a255474b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57222fd9-53') {{(pid=75122) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 09:41:15 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:41:15 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:41:15 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 09:41:15 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:41:15 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a4bfb1ef-5d90-5202-90bf-5499f89699c8', '_type': 'linux-noop'}}, row=False) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:41:15 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:41:15 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:41:15 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:41:15 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap57222fd9-53, may_exist=True, interface_attrs={}) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:41:15 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap57222fd9-53, col_values=(('qos', UUID('2c41a8f4-21ee-40db-b93e-86b3a4253028')),), if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:41:15 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap57222fd9-53, col_values=(('external_ids', {'iface-id': '57222fd9-53d9-4344-b5c7-1b77cb36fd65', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:dd:19:1b', 'vm-uuid': '52c066f3-dea1-4aa3-9da4-da9397b9fff1'}),), if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:41:15 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:41:15 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:41:15 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:41:15 user nova-compute[75122]: INFO os_vif [None req-faca803d-7a82-47f7-bae1-e20ce4eb16d2 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:19:1b,bridge_name='br-int',has_traffic_filtering=True,id=57222fd9-53d9-4344-b5c7-1b77cb36fd65,network=Network(8510a5b3-69c9-4fd8-9f2c-c83a255474b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57222fd9-53')
Nov 15 09:41:15 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-faca803d-7a82-47f7-bae1-e20ce4eb16d2 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] No BDM found with device name vda, not building metadata. {{(pid=75122) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 09:41:15 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-faca803d-7a82-47f7-bae1-e20ce4eb16d2 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] No VIF found with MAC fa:16:3e:dd:19:1b, not building metadata {{(pid=75122) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 09:41:15 user nova-compute[75122]: DEBUG nova.network.neutron [req-917107c5-d54f-4d22-a8c8-7f6ffe62b2cc req-4d59181f-611d-445a-b078-1dbee4933972 service nova] [instance: 52c066f3-dea1-4aa3-9da4-da9397b9fff1] Updated VIF entry in instance network info cache for port 57222fd9-53d9-4344-b5c7-1b77cb36fd65. {{(pid=75122) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 09:41:15 user nova-compute[75122]: DEBUG nova.network.neutron [req-917107c5-d54f-4d22-a8c8-7f6ffe62b2cc req-4d59181f-611d-445a-b078-1dbee4933972 service nova] [instance: 52c066f3-dea1-4aa3-9da4-da9397b9fff1] Updating instance_info_cache with network_info: [{"id": "57222fd9-53d9-4344-b5c7-1b77cb36fd65", "address": "fa:16:3e:dd:19:1b", "network": {"id": "8510a5b3-69c9-4fd8-9f2c-c83a255474b5", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-535784436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1030239722241f5ae167b813b4fee15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57222fd9-53", "ovs_interfaceid": "57222fd9-53d9-4344-b5c7-1b77cb36fd65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:41:15 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-917107c5-d54f-4d22-a8c8-7f6ffe62b2cc req-4d59181f-611d-445a-b078-1dbee4933972 service nova] Releasing lock "refresh_cache-52c066f3-dea1-4aa3-9da4-da9397b9fff1" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 09:41:16 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:41:16 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:41:17 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:41:17 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:41:17 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:41:17 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:41:17 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:41:17 user nova-compute[75122]: DEBUG nova.compute.manager [req-9bc13fb2-38a0-4616-8f42-ce8477ea3560 req-ba101898-8c56-4976-b1bf-1479a508338f service nova] [instance: 6f6177c5-3048-4a78-b34a-e595d26d69d0] Received event network-vif-plugged-8f77c03f-9bb8-441c-97a9-19bb14a14d89 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:41:17 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-9bc13fb2-38a0-4616-8f42-ce8477ea3560 req-ba101898-8c56-4976-b1bf-1479a508338f service nova] Acquiring lock "6f6177c5-3048-4a78-b34a-e595d26d69d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:41:17 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-9bc13fb2-38a0-4616-8f42-ce8477ea3560 req-ba101898-8c56-4976-b1bf-1479a508338f service nova] Lock "6f6177c5-3048-4a78-b34a-e595d26d69d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:41:17 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-9bc13fb2-38a0-4616-8f42-ce8477ea3560 req-ba101898-8c56-4976-b1bf-1479a508338f service nova] Lock "6f6177c5-3048-4a78-b34a-e595d26d69d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:41:17 user nova-compute[75122]: DEBUG nova.compute.manager [req-9bc13fb2-38a0-4616-8f42-ce8477ea3560 req-ba101898-8c56-4976-b1bf-1479a508338f service nova] [instance: 6f6177c5-3048-4a78-b34a-e595d26d69d0] No waiting events found dispatching network-vif-plugged-8f77c03f-9bb8-441c-97a9-19bb14a14d89 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:41:17 user nova-compute[75122]: WARNING nova.compute.manager [req-9bc13fb2-38a0-4616-8f42-ce8477ea3560 req-ba101898-8c56-4976-b1bf-1479a508338f service nova] [instance: 6f6177c5-3048-4a78-b34a-e595d26d69d0] Received unexpected event network-vif-plugged-8f77c03f-9bb8-441c-97a9-19bb14a14d89 for instance with vm_state active and task_state None.
Nov 15 09:41:17 user nova-compute[75122]: DEBUG nova.compute.manager [req-9bc13fb2-38a0-4616-8f42-ce8477ea3560 req-ba101898-8c56-4976-b1bf-1479a508338f service nova] [instance: 52c066f3-dea1-4aa3-9da4-da9397b9fff1] Received event network-vif-plugged-57222fd9-53d9-4344-b5c7-1b77cb36fd65 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:41:17 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-9bc13fb2-38a0-4616-8f42-ce8477ea3560 req-ba101898-8c56-4976-b1bf-1479a508338f service nova] Acquiring lock "52c066f3-dea1-4aa3-9da4-da9397b9fff1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:41:17 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-9bc13fb2-38a0-4616-8f42-ce8477ea3560 req-ba101898-8c56-4976-b1bf-1479a508338f service nova] Lock "52c066f3-dea1-4aa3-9da4-da9397b9fff1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:41:17 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-9bc13fb2-38a0-4616-8f42-ce8477ea3560 req-ba101898-8c56-4976-b1bf-1479a508338f service nova] Lock "52c066f3-dea1-4aa3-9da4-da9397b9fff1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:41:17 user nova-compute[75122]: DEBUG nova.compute.manager [req-9bc13fb2-38a0-4616-8f42-ce8477ea3560 req-ba101898-8c56-4976-b1bf-1479a508338f service nova] [instance: 52c066f3-dea1-4aa3-9da4-da9397b9fff1] No waiting events found dispatching network-vif-plugged-57222fd9-53d9-4344-b5c7-1b77cb36fd65 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:41:17 user nova-compute[75122]: WARNING nova.compute.manager [req-9bc13fb2-38a0-4616-8f42-ce8477ea3560 req-ba101898-8c56-4976-b1bf-1479a508338f service nova] [instance: 52c066f3-dea1-4aa3-9da4-da9397b9fff1] Received unexpected event network-vif-plugged-57222fd9-53d9-4344-b5c7-1b77cb36fd65 for instance with vm_state building and task_state spawning.
Nov 15 09:41:17 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:41:17 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:41:17 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:41:18 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:41:18 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Starting heal instance info cache {{(pid=75122) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 09:41:18 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Rebuilding the list of instances to heal {{(pid=75122) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 09:41:18 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] [instance: 52c066f3-dea1-4aa3-9da4-da9397b9fff1] Skipping network cache update for instance because it is Building. {{(pid=75122) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 15 09:41:18 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "refresh_cache-131142fd-e8ec-42d1-a518-aa21c7bb7cb1" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 09:41:18 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquired lock "refresh_cache-131142fd-e8ec-42d1-a518-aa21c7bb7cb1" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 09:41:18 user nova-compute[75122]: DEBUG nova.network.neutron [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] [instance: 131142fd-e8ec-42d1-a518-aa21c7bb7cb1] Forcefully refreshing network info cache for instance {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 09:41:18 user nova-compute[75122]: DEBUG nova.objects.instance [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lazy-loading 'info_cache' on Instance uuid 131142fd-e8ec-42d1-a518-aa21c7bb7cb1 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:41:18 user nova-compute[75122]: DEBUG nova.network.neutron [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] [instance: 131142fd-e8ec-42d1-a518-aa21c7bb7cb1] Updating instance_info_cache with network_info: [{"id": "f8302d0d-f140-479c-96da-b21516385381", "address": "fa:16:3e:06:1e:34", "network": {"id": "6e846655-a6f8-4339-a239-65d2f94c8b74", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1923452032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b8e67f8a66a4930be3fb65c397cbeb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8302d0d-f1", "ovs_interfaceid": "f8302d0d-f140-479c-96da-b21516385381", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:41:18 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Releasing lock "refresh_cache-131142fd-e8ec-42d1-a518-aa21c7bb7cb1" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 09:41:18 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] [instance: 131142fd-e8ec-42d1-a518-aa21c7bb7cb1] Updated the network info_cache for instance {{(pid=75122) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 09:41:18 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:41:18 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:41:19 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:41:19 user nova-compute[75122]: DEBUG nova.compute.manager [None req-faca803d-7a82-47f7-bae1-e20ce4eb16d2 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] [instance: 52c066f3-dea1-4aa3-9da4-da9397b9fff1] Instance event wait completed in 0 seconds for  {{(pid=75122) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 09:41:19 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-faca803d-7a82-47f7-bae1-e20ce4eb16d2 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] [instance: 52c066f3-dea1-4aa3-9da4-da9397b9fff1] Guest created on hypervisor {{(pid=75122) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 09:41:19 user nova-compute[75122]: INFO nova.virt.libvirt.driver [-] [instance: 52c066f3-dea1-4aa3-9da4-da9397b9fff1] Instance spawned successfully.
Nov 15 09:41:19 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-faca803d-7a82-47f7-bae1-e20ce4eb16d2 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] [instance: 52c066f3-dea1-4aa3-9da4-da9397b9fff1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 09:41:19 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-faca803d-7a82-47f7-bae1-e20ce4eb16d2 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] [instance: 52c066f3-dea1-4aa3-9da4-da9397b9fff1] Found default for hw_cdrom_bus of ide {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:41:19 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-faca803d-7a82-47f7-bae1-e20ce4eb16d2 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] [instance: 52c066f3-dea1-4aa3-9da4-da9397b9fff1] Found default for hw_disk_bus of virtio {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:41:19 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-faca803d-7a82-47f7-bae1-e20ce4eb16d2 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] [instance: 52c066f3-dea1-4aa3-9da4-da9397b9fff1] Found default for hw_input_bus of None {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:41:19 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-faca803d-7a82-47f7-bae1-e20ce4eb16d2 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] [instance: 52c066f3-dea1-4aa3-9da4-da9397b9fff1] Found default for hw_pointer_model of None {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:41:19 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-faca803d-7a82-47f7-bae1-e20ce4eb16d2 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] [instance: 52c066f3-dea1-4aa3-9da4-da9397b9fff1] Found default for hw_video_model of virtio {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:41:19 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-faca803d-7a82-47f7-bae1-e20ce4eb16d2 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] [instance: 52c066f3-dea1-4aa3-9da4-da9397b9fff1] Found default for hw_vif_model of virtio {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:41:19 user nova-compute[75122]: INFO nova.compute.manager [None req-faca803d-7a82-47f7-bae1-e20ce4eb16d2 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] [instance: 52c066f3-dea1-4aa3-9da4-da9397b9fff1] Took 5.78 seconds to spawn the instance on the hypervisor.
Nov 15 09:41:19 user nova-compute[75122]: DEBUG nova.compute.manager [None req-faca803d-7a82-47f7-bae1-e20ce4eb16d2 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] [instance: 52c066f3-dea1-4aa3-9da4-da9397b9fff1] Checking state {{(pid=75122) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 09:41:19 user nova-compute[75122]: DEBUG nova.compute.manager [req-e4957dc3-227e-4b77-a7d8-3ac4fdebf280 req-c73e2d12-1799-4daa-8416-ab3d9aedde91 service nova] [instance: 52c066f3-dea1-4aa3-9da4-da9397b9fff1] Received event network-vif-plugged-57222fd9-53d9-4344-b5c7-1b77cb36fd65 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:41:19 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-e4957dc3-227e-4b77-a7d8-3ac4fdebf280 req-c73e2d12-1799-4daa-8416-ab3d9aedde91 service nova] Acquiring lock "52c066f3-dea1-4aa3-9da4-da9397b9fff1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:41:19 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-e4957dc3-227e-4b77-a7d8-3ac4fdebf280 req-c73e2d12-1799-4daa-8416-ab3d9aedde91 service nova] Lock "52c066f3-dea1-4aa3-9da4-da9397b9fff1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:41:19 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-e4957dc3-227e-4b77-a7d8-3ac4fdebf280 req-c73e2d12-1799-4daa-8416-ab3d9aedde91 service nova] Lock "52c066f3-dea1-4aa3-9da4-da9397b9fff1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:41:19 user nova-compute[75122]: DEBUG nova.compute.manager [req-e4957dc3-227e-4b77-a7d8-3ac4fdebf280 req-c73e2d12-1799-4daa-8416-ab3d9aedde91 service nova] [instance: 52c066f3-dea1-4aa3-9da4-da9397b9fff1] No waiting events found dispatching network-vif-plugged-57222fd9-53d9-4344-b5c7-1b77cb36fd65 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:41:19 user nova-compute[75122]: WARNING nova.compute.manager [req-e4957dc3-227e-4b77-a7d8-3ac4fdebf280 req-c73e2d12-1799-4daa-8416-ab3d9aedde91 service nova] [instance: 52c066f3-dea1-4aa3-9da4-da9397b9fff1] Received unexpected event network-vif-plugged-57222fd9-53d9-4344-b5c7-1b77cb36fd65 for instance with vm_state building and task_state spawning.
Nov 15 09:41:19 user nova-compute[75122]: INFO nova.compute.manager [None req-faca803d-7a82-47f7-bae1-e20ce4eb16d2 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] [instance: 52c066f3-dea1-4aa3-9da4-da9397b9fff1] Took 6.54 seconds to build instance.
Nov 15 09:41:19 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-faca803d-7a82-47f7-bae1-e20ce4eb16d2 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] Lock "52c066f3-dea1-4aa3-9da4-da9397b9fff1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.643s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:41:20 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:41:21 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:41:21 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:41:21 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:41:21 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:41:21 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:41:21 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75122) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 09:41:21 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f6177c5-3048-4a78-b34a-e595d26d69d0/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:41:21 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f6177c5-3048-4a78-b34a-e595d26d69d0/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:41:21 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f6177c5-3048-4a78-b34a-e595d26d69d0/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:41:21 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f6177c5-3048-4a78-b34a-e595d26d69d0/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:41:21 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2f45f49-0bca-4ae2-bc2a-eed293143489/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:41:22 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2f45f49-0bca-4ae2-bc2a-eed293143489/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:41:22 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2f45f49-0bca-4ae2-bc2a-eed293143489/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:41:22 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2f45f49-0bca-4ae2-bc2a-eed293143489/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:41:22 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/594aff52-4f70-48bc-9a7d-87b984e223b8/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:41:22 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/594aff52-4f70-48bc-9a7d-87b984e223b8/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:41:22 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/594aff52-4f70-48bc-9a7d-87b984e223b8/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:41:22 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/594aff52-4f70-48bc-9a7d-87b984e223b8/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:41:22 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd9d52bb-6248-48e6-a798-6dbdaaa68cbc/disk.rescue --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:41:22 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd9d52bb-6248-48e6-a798-6dbdaaa68cbc/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:41:22 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd9d52bb-6248-48e6-a798-6dbdaaa68cbc/disk.rescue --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:41:22 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd9d52bb-6248-48e6-a798-6dbdaaa68cbc/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:41:22 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd9d52bb-6248-48e6-a798-6dbdaaa68cbc/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:41:23 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd9d52bb-6248-48e6-a798-6dbdaaa68cbc/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:41:23 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd9d52bb-6248-48e6-a798-6dbdaaa68cbc/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:41:23 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd9d52bb-6248-48e6-a798-6dbdaaa68cbc/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:41:23 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75122) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 09:41:23 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5a4d58-ba1e-473d-a32a-06fae1c84efc/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:41:23 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5a4d58-ba1e-473d-a32a-06fae1c84efc/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:41:23 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5a4d58-ba1e-473d-a32a-06fae1c84efc/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:41:23 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b5a4d58-ba1e-473d-a32a-06fae1c84efc/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:41:23 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df913b3e-218d-4ae6-b7b3-70f64fdd3896/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:41:23 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df913b3e-218d-4ae6-b7b3-70f64fdd3896/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:41:23 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df913b3e-218d-4ae6-b7b3-70f64fdd3896/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:41:24 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df913b3e-218d-4ae6-b7b3-70f64fdd3896/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:41:24 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75122) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 09:41:24 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52c066f3-dea1-4aa3-9da4-da9397b9fff1/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:41:24 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52c066f3-dea1-4aa3-9da4-da9397b9fff1/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:41:24 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52c066f3-dea1-4aa3-9da4-da9397b9fff1/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:41:24 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52c066f3-dea1-4aa3-9da4-da9397b9fff1/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:41:24 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/131142fd-e8ec-42d1-a518-aa21c7bb7cb1/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:41:24 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/131142fd-e8ec-42d1-a518-aa21c7bb7cb1/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:41:24 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/131142fd-e8ec-42d1-a518-aa21c7bb7cb1/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:41:24 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/131142fd-e8ec-42d1-a518-aa21c7bb7cb1/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:41:24 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e815e0b5-e9c8-4ebb-aa85-b79b180595df/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:41:25 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e815e0b5-e9c8-4ebb-aa85-b79b180595df/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:41:25 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e815e0b5-e9c8-4ebb-aa85-b79b180595df/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:41:25 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e815e0b5-e9c8-4ebb-aa85-b79b180595df/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:41:25 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00270cc2-4f5b-4f64-8f88-31f21e3b3950/disk.rescue --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:41:25 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00270cc2-4f5b-4f64-8f88-31f21e3b3950/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:41:25 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00270cc2-4f5b-4f64-8f88-31f21e3b3950/disk.rescue --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:41:25 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:41:25 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00270cc2-4f5b-4f64-8f88-31f21e3b3950/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:41:25 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00270cc2-4f5b-4f64-8f88-31f21e3b3950/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:41:25 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00270cc2-4f5b-4f64-8f88-31f21e3b3950/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:41:25 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00270cc2-4f5b-4f64-8f88-31f21e3b3950/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:41:26 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00270cc2-4f5b-4f64-8f88-31f21e3b3950/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:41:26 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:41:26 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 09:41:26 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 09:41:26 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Hypervisor/Node resource view: name=user free_ram=7351MB free_disk=25.14373779296875GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75122) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 09:41:26 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:41:26 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:41:26 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance 131142fd-e8ec-42d1-a518-aa21c7bb7cb1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:41:26 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance 5b5a4d58-ba1e-473d-a32a-06fae1c84efc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:41:26 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance fd9d52bb-6248-48e6-a798-6dbdaaa68cbc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:41:26 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance 00270cc2-4f5b-4f64-8f88-31f21e3b3950 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:41:26 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance df913b3e-218d-4ae6-b7b3-70f64fdd3896 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:41:26 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance c2f45f49-0bca-4ae2-bc2a-eed293143489 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:41:26 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance 594aff52-4f70-48bc-9a7d-87b984e223b8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:41:26 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance e1afe5d4-42c0-491c-b1c7-c8debf1d5da2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:41:26 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance e815e0b5-e9c8-4ebb-aa85-b79b180595df actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:41:26 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance 6f6177c5-3048-4a78-b34a-e595d26d69d0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:41:26 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance 52c066f3-dea1-4aa3-9da4-da9397b9fff1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:41:26 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75122) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 09:41:26 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75122) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 09:41:26 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Refreshing inventories for resource provider 69a3da65-47be-44c6-b67c-c692b58284ef {{(pid=75122) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 15 09:41:26 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Updating ProviderTree inventory for provider 69a3da65-47be-44c6-b67c-c692b58284ef from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 15 09:41:26 user nova-compute[75122]: DEBUG nova.compute.provider_tree [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Updating inventory in ProviderTree for provider 69a3da65-47be-44c6-b67c-c692b58284ef with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 15 09:41:26 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Refreshing aggregate associations for resource provider 69a3da65-47be-44c6-b67c-c692b58284ef, aggregates: None {{(pid=75122) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 15 09:41:26 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Refreshing trait associations for resource provider 69a3da65-47be-44c6-b67c-c692b58284ef, traits: COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_RESCUE_BFV,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE,COMPUTE_NODE,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_ACCELERATORS,HW_CPU_X86_MMX {{(pid=75122) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 15 09:41:27 user nova-compute[75122]: DEBUG nova.compute.provider_tree [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Inventory has not changed in ProviderTree for provider: 69a3da65-47be-44c6-b67c-c692b58284ef {{(pid=75122) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 09:41:27 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Inventory has not changed for provider 69a3da65-47be-44c6-b67c-c692b58284ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 09:41:27 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Compute_service record updated for user:user {{(pid=75122) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 09:41:27 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.723s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:41:27 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:41:27 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75122) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 15 09:41:27 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:41:30 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:41:31 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:41:32 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:41:35 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-0d082253-166e-4d56-b59f-c192650191fe tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 5b5a4d58-ba1e-473d-a32a-06fae1c84efc is timed out.
Nov 15 09:41:35 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-0d082253-166e-4d56-b59f-c192650191fe tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] Successfully detached device vdb from instance 5b5a4d58-ba1e-473d-a32a-06fae1c84efc from the live domain config.
Nov 15 09:41:35 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d082253-166e-4d56-b59f-c192650191fe tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] [instance: 5b5a4d58-ba1e-473d-a32a-06fae1c84efc] calling os-brick to detach iSCSI Volume {{(pid=75122) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 09:41:35 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d082253-166e-4d56-b59f-c192650191fe tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffa04060b80>, {'target_iqn': 'iqn.2010-10.org.openstack:0b366dd5-506b-4ee0-9e25-990a31acf3eb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pgnaQueR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 09:41:35 user nova-compute[75122]: WARNING os_brick.initiator.connectors.base [None req-0d082253-166e-4d56-b59f-c192650191fe tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 09:41:35 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-0d082253-166e-4d56-b59f-c192650191fe tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 09:41:35 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-0d082253-166e-4d56-b59f-c192650191fe tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 09:41:35 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:41:35 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:41:35 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[e604d267-653f-4a57-b58f-a96f79b68d07]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:395810b1-e3c3-4660-aaaf-b6d9e7cb5a88\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0b366dd5-506b-4ee0-9e25-990a31acf3eb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fdf09a1b-a065-4b88-815d-ee54c1c68464\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:41:35 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d082253-166e-4d56-b59f-c192650191fe tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 09:41:35 user nova-compute[75122]: No targets found.
Nov 15 09:41:35 user nova-compute[75122]: iSNS:
Nov 15 09:41:35 user nova-compute[75122]: No targets found.
Nov 15 09:41:35 user nova-compute[75122]: STATIC:
Nov 15 09:41:35 user nova-compute[75122]: Target: iqn.2010-10.org.openstack:395810b1-e3c3-4660-aaaf-b6d9e7cb5a88
Nov 15 09:41:35 user nova-compute[75122]:         Portal: 172.16.0.220:3260,-1
Nov 15 09:41:35 user nova-compute[75122]:                 Iface Name: default
Nov 15 09:41:35 user nova-compute[75122]: Target: iqn.2010-10.org.openstack:0b366dd5-506b-4ee0-9e25-990a31acf3eb
Nov 15 09:41:35 user nova-compute[75122]:         Portal: 172.16.0.220:3260,-1
Nov 15 09:41:35 user nova-compute[75122]:                 Iface Name: default
Nov 15 09:41:35 user nova-compute[75122]: Target: iqn.2010-10.org.openstack:fdf09a1b-a065-4b88-815d-ee54c1c68464
Nov 15 09:41:35 user nova-compute[75122]:         Portal: 172.16.0.220:3260,-1
Nov 15 09:41:35 user nova-compute[75122]:                 Iface Name: default
Nov 15 09:41:35 user nova-compute[75122]: FIRMWARE:
Nov 15 09:41:35 user nova-compute[75122]: No targets found.
Nov 15 09:41:35 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 09:41:35 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d082253-166e-4d56-b59f-c192650191fe tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 09:41:35 user nova-compute[75122]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 09:41:35 user nova-compute[75122]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75122) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 09:41:35 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d082253-166e-4d56-b59f-c192650191fe tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0b366dd5-506b-4ee0-9e25-990a31acf3eb', 0)] {{(pid=75122) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 09:41:35 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:41:35 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:41:35 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6facea0-279e-4e48-a7cf-dc31167b5794]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0b366dd5-506b-4ee0-9e25-990a31acf3eb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:395810b1-e3c3-4660-aaaf-b6d9e7cb5a88\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fdf09a1b-a065-4b88-815d-ee54c1c68464\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:41:35 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:41:35 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:41:35 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[1879cabf-0a4c-44f8-aade-cf3fecdd8c4f]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b366dd5-506b-4ee0-9e25-990a31acf3eb (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdf09a1b-a065-4b88-815d-ee54c1c68464 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:395810b1-e3c3-4660-aaaf-b6d9e7cb5a88 (non-flash)\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:41:35 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d082253-166e-4d56-b59f-c192650191fe tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b366dd5-506b-4ee0-9e25-990a31acf3eb (non-flash)
Nov 15 09:41:35 user nova-compute[75122]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdf09a1b-a065-4b88-815d-ee54c1c68464 (non-flash)
Nov 15 09:41:35 user nova-compute[75122]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:395810b1-e3c3-4660-aaaf-b6d9e7cb5a88 (non-flash)
Nov 15 09:41:35 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 09:41:35 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d082253-166e-4d56-b59f-c192650191fe tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b366dd5-506b-4ee0-9e25-990a31acf3eb (non-flash)
Nov 15 09:41:35 user nova-compute[75122]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdf09a1b-a065-4b88-815d-ee54c1c68464 (non-flash)
Nov 15 09:41:35 user nova-compute[75122]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:395810b1-e3c3-4660-aaaf-b6d9e7cb5a88 (non-flash)
Nov 15 09:41:35 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 09:41:35 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d082253-166e-4d56-b59f-c192650191fe tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff9fc25e290>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0b366dd5-506b-4ee0-9e25-990a31acf3eb'): ({'sdd'}, set())}) {{(pid=75122) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 09:41:35 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-0d082253-166e-4d56-b59f-c192650191fe tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] Removing single pathed devices sdd {{(pid=75122) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 09:41:35 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:41:35 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:41:35 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[4292f0d9-2aa3-4a98-8545-139dafb1f2bf]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:41:35 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:41:35 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:41:35 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[68bc2e41-a9cb-44c2-8bbe-7b7b5afa4799]: (4, ('ok\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:41:35 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-0d082253-166e-4d56-b59f-c192650191fe tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] Flushing IO for device /dev/sdd {{(pid=75122) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 09:41:35 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:41:35 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:41:35 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[26fe44a3-f163-4731-bd26-0486ca0d3739]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:41:35 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-0d082253-166e-4d56-b59f-c192650191fe tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75122) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 09:41:35 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:41:35 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.046s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:41:35 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f7028d2-a786-406e-8ce7-8fd5126826c5]: (4, ('1', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:41:35 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-0d082253-166e-4d56-b59f-c192650191fe tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75122) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 09:41:35 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-0d082253-166e-4d56-b59f-c192650191fe tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] SCSI volumes sdd have been removed. {{(pid=75122) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 09:41:35 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d082253-166e-4d56-b59f-c192650191fe tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0b366dd5-506b-4ee0-9e25-990a31acf3eb')] {{(pid=75122) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 09:41:35 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b366dd5-506b-4ee0-9e25-990a31acf3eb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:41:35 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b366dd5-506b-4ee0-9e25-990a31acf3eb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:41:35 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[3424310b-0aa0-4103-b526-0cff849f532b]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:41:35 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d082253-166e-4d56-b59f-c192650191fe tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:41:35 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b366dd5-506b-4ee0-9e25-990a31acf3eb -p 172.16.0.220:3260 --logout {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:41:35 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b366dd5-506b-4ee0-9e25-990a31acf3eb -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:41:35 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[33221cd5-d312-411f-add1-ac733ab92e26]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:0b366dd5-506b-4ee0-9e25-990a31acf3eb, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:0b366dd5-506b-4ee0-9e25-990a31acf3eb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:41:35 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d082253-166e-4d56-b59f-c192650191fe tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:0b366dd5-506b-4ee0-9e25-990a31acf3eb, portal: 172.16.0.220,3260]
Nov 15 09:41:35 user nova-compute[75122]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:0b366dd5-506b-4ee0-9e25-990a31acf3eb, portal: 172.16.0.220,3260] successful.
Nov 15 09:41:35 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:41:35 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b366dd5-506b-4ee0-9e25-990a31acf3eb -p 172.16.0.220:3260 --op delete {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:41:35 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b366dd5-506b-4ee0-9e25-990a31acf3eb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:41:35 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[223ed0b4-c76f-44c0-8450-edda469fa78b]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:41:35 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d082253-166e-4d56-b59f-c192650191fe tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:41:35 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-0d082253-166e-4d56-b59f-c192650191fe tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.291s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 09:41:35 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d082253-166e-4d56-b59f-c192650191fe tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] <== disconnect_volume: return (292ms) None {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 09:41:35 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d082253-166e-4d56-b59f-c192650191fe tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] [instance: 5b5a4d58-ba1e-473d-a32a-06fae1c84efc] Disconnected iSCSI Volume {{(pid=75122) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 09:41:35 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:41:36 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:41:36 user nova-compute[75122]: DEBUG nova.objects.instance [None req-0d082253-166e-4d56-b59f-c192650191fe tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] Lazy-loading 'flavor' on Instance uuid 5b5a4d58-ba1e-473d-a32a-06fae1c84efc {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:41:36 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0d082253-166e-4d56-b59f-c192650191fe tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] Lock "5b5a4d58-ba1e-473d-a32a-06fae1c84efc" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.654s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:41:37 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-d1d12aac-ad02-4056-8659-8d679a4d22d8 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Acquiring lock "cc485c6c-5a9a-4c94-b966-68dd9e336e56" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:41:37 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-d1d12aac-ad02-4056-8659-8d679a4d22d8 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Lock "cc485c6c-5a9a-4c94-b966-68dd9e336e56" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:41:37 user nova-compute[75122]: DEBUG nova.compute.manager [None req-d1d12aac-ad02-4056-8659-8d679a4d22d8 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] [instance: cc485c6c-5a9a-4c94-b966-68dd9e336e56] Starting instance... {{(pid=75122) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 09:41:37 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-d1d12aac-ad02-4056-8659-8d679a4d22d8 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:41:37 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-d1d12aac-ad02-4056-8659-8d679a4d22d8 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:41:37 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-d1d12aac-ad02-4056-8659-8d679a4d22d8 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75122) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 09:41:37 user nova-compute[75122]: INFO nova.compute.claims [None req-d1d12aac-ad02-4056-8659-8d679a4d22d8 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] [instance: cc485c6c-5a9a-4c94-b966-68dd9e336e56] Claim successful on node user
Nov 15 09:41:37 user nova-compute[75122]: DEBUG nova.compute.provider_tree [None req-d1d12aac-ad02-4056-8659-8d679a4d22d8 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Inventory has not changed in ProviderTree for provider: 69a3da65-47be-44c6-b67c-c692b58284ef {{(pid=75122) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 09:41:37 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-d1d12aac-ad02-4056-8659-8d679a4d22d8 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Inventory has not changed for provider 69a3da65-47be-44c6-b67c-c692b58284ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 09:41:37 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-d1d12aac-ad02-4056-8659-8d679a4d22d8 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.408s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:41:37 user nova-compute[75122]: DEBUG nova.compute.manager [None req-d1d12aac-ad02-4056-8659-8d679a4d22d8 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] [instance: cc485c6c-5a9a-4c94-b966-68dd9e336e56] Start building networks asynchronously for instance. {{(pid=75122) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 09:41:37 user nova-compute[75122]: DEBUG nova.compute.manager [None req-d1d12aac-ad02-4056-8659-8d679a4d22d8 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] [instance: cc485c6c-5a9a-4c94-b966-68dd9e336e56] Allocating IP information in the background. {{(pid=75122) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 09:41:37 user nova-compute[75122]: DEBUG nova.network.neutron [None req-d1d12aac-ad02-4056-8659-8d679a4d22d8 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] [instance: cc485c6c-5a9a-4c94-b966-68dd9e336e56] allocate_for_instance() {{(pid=75122) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 09:41:37 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-d1d12aac-ad02-4056-8659-8d679a4d22d8 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] [instance: cc485c6c-5a9a-4c94-b966-68dd9e336e56] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 09:41:37 user nova-compute[75122]: DEBUG nova.compute.manager [None req-d1d12aac-ad02-4056-8659-8d679a4d22d8 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] [instance: cc485c6c-5a9a-4c94-b966-68dd9e336e56] Start building block device mappings for instance. {{(pid=75122) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 09:41:37 user nova-compute[75122]: DEBUG nova.policy [None req-d1d12aac-ad02-4056-8659-8d679a4d22d8 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '91f1469b2c7c45d6ac27f2b64fd5cefe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b8e67f8a66a4930be3fb65c397cbeb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75122) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 09:41:37 user nova-compute[75122]: INFO nova.virt.block_device [None req-d1d12aac-ad02-4056-8659-8d679a4d22d8 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] [instance: cc485c6c-5a9a-4c94-b966-68dd9e336e56] Booting with volume 5aa0e3ae-4004-414c-b0c9-8c089c420c17 at /dev/vda
Nov 15 09:41:37 user nova-compute[75122]: DEBUG os_brick.utils [None req-d1d12aac-ad02-4056-8659-8d679a4d22d8 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 09:41:37 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:41:37 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:41:37 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[36705855-dbbf-45e4-b324-ea7bed6e4718]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:742fb64b3587\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:41:37 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:41:37 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:41:37 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a0b00d9-2edd-46a1-9912-2bdde9376a18]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:41:37 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:41:37 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:41:37 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b82d3af-055d-4915-88af-ce845b701ff6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:41:37 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cb3ee52-0c1f-4268-a7b2-6a32e2cb241c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:41:37 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-d1d12aac-ad02-4056-8659-8d679a4d22d8 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Running cmd (subprocess): nvme version {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:41:37 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-d1d12aac-ad02-4056-8659-8d679a4d22d8 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] 'nvme version' failed. Not Retrying. {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 09:41:37 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d1d12aac-ad02-4056-8659-8d679a4d22d8 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] nvme not present on system {{(pid=75122) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 09:41:37 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:41:37 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 09:41:37 user nova-compute[75122]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 09:41:37 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[11c65179-b942-46b9-8356-15c5be92b956]: (4, '') {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:41:37 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.lightos [None req-d1d12aac-ad02-4056-8659-8d679a4d22d8 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75122) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 09:41:37 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.lightos [None req-d1d12aac-ad02-4056-8659-8d679a4d22d8 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75122) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 09:41:37 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.lightos [None req-d1d12aac-ad02-4056-8659-8d679a4d22d8 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] LIGHTOS: no hostnqn found. {{(pid=75122) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 09:41:37 user nova-compute[75122]: DEBUG os_brick.utils [None req-d1d12aac-ad02-4056-8659-8d679a4d22d8 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:742fb64b3587', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 09:41:37 user nova-compute[75122]: DEBUG nova.virt.block_device [None req-d1d12aac-ad02-4056-8659-8d679a4d22d8 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] [instance: cc485c6c-5a9a-4c94-b966-68dd9e336e56] Updating existing volume attachment record: 355da4ec-40d0-4b0a-b6ee-26740bea8c51 {{(pid=75122) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 09:41:38 user nova-compute[75122]: DEBUG nova.network.neutron [None req-d1d12aac-ad02-4056-8659-8d679a4d22d8 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] [instance: cc485c6c-5a9a-4c94-b966-68dd9e336e56] Successfully created port: d3b26bb1-8ddd-4467-af3e-74e39d54390e {{(pid=75122) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 09:41:39 user nova-compute[75122]: DEBUG nova.network.neutron [None req-d1d12aac-ad02-4056-8659-8d679a4d22d8 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] [instance: cc485c6c-5a9a-4c94-b966-68dd9e336e56] Successfully updated port: d3b26bb1-8ddd-4467-af3e-74e39d54390e {{(pid=75122) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 09:41:39 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-d1d12aac-ad02-4056-8659-8d679a4d22d8 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Acquiring lock "refresh_cache-cc485c6c-5a9a-4c94-b966-68dd9e336e56" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 09:41:39 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-d1d12aac-ad02-4056-8659-8d679a4d22d8 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Acquired lock "refresh_cache-cc485c6c-5a9a-4c94-b966-68dd9e336e56" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 09:41:39 user nova-compute[75122]: DEBUG nova.network.neutron [None req-d1d12aac-ad02-4056-8659-8d679a4d22d8 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] [instance: cc485c6c-5a9a-4c94-b966-68dd9e336e56] Building network info cache for instance {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 09:41:39 user nova-compute[75122]: DEBUG nova.compute.manager [req-111e8b58-915f-4d3f-ae23-5c9eeef86b1e req-20efb64a-7c00-4a71-bc9d-15cde119965d service nova] [instance: cc485c6c-5a9a-4c94-b966-68dd9e336e56] Received event network-changed-d3b26bb1-8ddd-4467-af3e-74e39d54390e {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:41:39 user nova-compute[75122]: DEBUG nova.compute.manager [req-111e8b58-915f-4d3f-ae23-5c9eeef86b1e req-20efb64a-7c00-4a71-bc9d-15cde119965d service nova] [instance: cc485c6c-5a9a-4c94-b966-68dd9e336e56] Refreshing instance network info cache due to event network-changed-d3b26bb1-8ddd-4467-af3e-74e39d54390e. {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 09:41:39 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-111e8b58-915f-4d3f-ae23-5c9eeef86b1e req-20efb64a-7c00-4a71-bc9d-15cde119965d service nova] Acquiring lock "refresh_cache-cc485c6c-5a9a-4c94-b966-68dd9e336e56" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 09:41:39 user nova-compute[75122]: DEBUG nova.network.neutron [None req-d1d12aac-ad02-4056-8659-8d679a4d22d8 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] [instance: cc485c6c-5a9a-4c94-b966-68dd9e336e56] Instance cache missing network info. {{(pid=75122) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 09:41:39 user nova-compute[75122]: DEBUG nova.compute.manager [req-fda05ebf-613f-4a33-b7a8-a4652c6b0629 req-775c23b7-7f06-4669-b106-f874f050fa84 service nova] [instance: 594aff52-4f70-48bc-9a7d-87b984e223b8] Received event network-changed-8166d3f5-5c5b-493f-8194-3bfa42d0ff32 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:41:39 user nova-compute[75122]: DEBUG nova.compute.manager [req-fda05ebf-613f-4a33-b7a8-a4652c6b0629 req-775c23b7-7f06-4669-b106-f874f050fa84 service nova] [instance: 594aff52-4f70-48bc-9a7d-87b984e223b8] Refreshing instance network info cache due to event network-changed-8166d3f5-5c5b-493f-8194-3bfa42d0ff32. {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 09:41:39 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-fda05ebf-613f-4a33-b7a8-a4652c6b0629 req-775c23b7-7f06-4669-b106-f874f050fa84 service nova] Acquiring lock "refresh_cache-594aff52-4f70-48bc-9a7d-87b984e223b8" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 09:41:39 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-fda05ebf-613f-4a33-b7a8-a4652c6b0629 req-775c23b7-7f06-4669-b106-f874f050fa84 service nova] Acquired lock "refresh_cache-594aff52-4f70-48bc-9a7d-87b984e223b8" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 09:41:39 user nova-compute[75122]: DEBUG nova.network.neutron [req-fda05ebf-613f-4a33-b7a8-a4652c6b0629 req-775c23b7-7f06-4669-b106-f874f050fa84 service nova] [instance: 594aff52-4f70-48bc-9a7d-87b984e223b8] Refreshing network info cache for port 8166d3f5-5c5b-493f-8194-3bfa42d0ff32 {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 09:41:39 user nova-compute[75122]: DEBUG nova.network.neutron [None req-d1d12aac-ad02-4056-8659-8d679a4d22d8 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] [instance: cc485c6c-5a9a-4c94-b966-68dd9e336e56] Updating instance_info_cache with network_info: [{"id": "d3b26bb1-8ddd-4467-af3e-74e39d54390e", "address": "fa:16:3e:8c:a9:0b", "network": {"id": "6e846655-a6f8-4339-a239-65d2f94c8b74", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1923452032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b8e67f8a66a4930be3fb65c397cbeb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3b26bb1-8d", "ovs_interfaceid": "d3b26bb1-8ddd-4467-af3e-74e39d54390e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:41:39 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-d1d12aac-ad02-4056-8659-8d679a4d22d8 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Releasing lock "refresh_cache-cc485c6c-5a9a-4c94-b966-68dd9e336e56" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 09:41:39 user nova-compute[75122]: DEBUG nova.compute.manager [None req-d1d12aac-ad02-4056-8659-8d679a4d22d8 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] [instance: cc485c6c-5a9a-4c94-b966-68dd9e336e56] Instance network_info: |[{"id": "d3b26bb1-8ddd-4467-af3e-74e39d54390e", "address": "fa:16:3e:8c:a9:0b", "network": {"id": "6e846655-a6f8-4339-a239-65d2f94c8b74", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1923452032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b8e67f8a66a4930be3fb65c397cbeb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3b26bb1-8d", "ovs_interfaceid": "d3b26bb1-8ddd-4467-af3e-74e39d54390e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75122) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 09:41:39 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-111e8b58-915f-4d3f-ae23-5c9eeef86b1e req-20efb64a-7c00-4a71-bc9d-15cde119965d service nova] Acquired lock "refresh_cache-cc485c6c-5a9a-4c94-b966-68dd9e336e56" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 09:41:39 user nova-compute[75122]: DEBUG nova.network.neutron [req-111e8b58-915f-4d3f-ae23-5c9eeef86b1e req-20efb64a-7c00-4a71-bc9d-15cde119965d service nova] [instance: cc485c6c-5a9a-4c94-b966-68dd9e336e56] Refreshing network info cache for port d3b26bb1-8ddd-4467-af3e-74e39d54390e {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 09:41:40 user nova-compute[75122]: DEBUG nova.network.neutron [req-fda05ebf-613f-4a33-b7a8-a4652c6b0629 req-775c23b7-7f06-4669-b106-f874f050fa84 service nova] [instance: 594aff52-4f70-48bc-9a7d-87b984e223b8] Updated VIF entry in instance network info cache for port 8166d3f5-5c5b-493f-8194-3bfa42d0ff32. {{(pid=75122) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 09:41:40 user nova-compute[75122]: DEBUG nova.network.neutron [req-fda05ebf-613f-4a33-b7a8-a4652c6b0629 req-775c23b7-7f06-4669-b106-f874f050fa84 service nova] [instance: 594aff52-4f70-48bc-9a7d-87b984e223b8] Updating instance_info_cache with network_info: [{"id": "8166d3f5-5c5b-493f-8194-3bfa42d0ff32", "address": "fa:16:3e:d7:4d:bf", "network": {"id": "cc80acf3-8a44-4d7e-aaa0-1214700564b3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1084984321-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f29cd64a8a674d73936b8a0c90bf2d34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8166d3f5-5c", "ovs_interfaceid": "8166d3f5-5c5b-493f-8194-3bfa42d0ff32", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:41:40 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-fda05ebf-613f-4a33-b7a8-a4652c6b0629 req-775c23b7-7f06-4669-b106-f874f050fa84 service nova] Releasing lock "refresh_cache-594aff52-4f70-48bc-9a7d-87b984e223b8" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 09:41:40 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-8600cc72-2760-4b3f-95b6-99838f4c06f6 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Acquiring lock "594aff52-4f70-48bc-9a7d-87b984e223b8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:41:40 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-8600cc72-2760-4b3f-95b6-99838f4c06f6 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Lock "594aff52-4f70-48bc-9a7d-87b984e223b8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:41:40 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-8600cc72-2760-4b3f-95b6-99838f4c06f6 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Acquiring lock "594aff52-4f70-48bc-9a7d-87b984e223b8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:41:40 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-8600cc72-2760-4b3f-95b6-99838f4c06f6 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Lock "594aff52-4f70-48bc-9a7d-87b984e223b8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:41:40 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-8600cc72-2760-4b3f-95b6-99838f4c06f6 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Lock "594aff52-4f70-48bc-9a7d-87b984e223b8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:41:40 user nova-compute[75122]: INFO nova.compute.manager [None req-8600cc72-2760-4b3f-95b6-99838f4c06f6 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] [instance: 594aff52-4f70-48bc-9a7d-87b984e223b8] Terminating instance
Nov 15 09:41:40 user nova-compute[75122]: DEBUG nova.compute.manager [None req-8600cc72-2760-4b3f-95b6-99838f4c06f6 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] [instance: 594aff52-4f70-48bc-9a7d-87b984e223b8] Start destroying the instance on the hypervisor. {{(pid=75122) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 09:41:40 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:41:40 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:41:40 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:41:40 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:41:40 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:41:40 user nova-compute[75122]: INFO nova.virt.libvirt.driver [-] [instance: 594aff52-4f70-48bc-9a7d-87b984e223b8] Instance destroyed successfully.
Nov 15 09:41:40 user nova-compute[75122]: DEBUG nova.objects.instance [None req-8600cc72-2760-4b3f-95b6-99838f4c06f6 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Lazy-loading 'resources' on Instance uuid 594aff52-4f70-48bc-9a7d-87b984e223b8 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:41:40 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-8600cc72-2760-4b3f-95b6-99838f4c06f6 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T09:39:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1369030815',display_name='tempest-AttachVolumeNegativeTest-server-1369030815',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1369030815',id=23,image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJV1hVBM+lOLbmTRKQZAbEHB2W5Xga/CKNfcUuqJXftk19w4SVS9+JWt9gT7w3ze2ebEVZJE6pozVLMwcn8V25ArAuCTS18/wcDFKR6poJHKgaXKagOVWmkM+lrjQy68Ag==',key_name='tempest-keypair-1521570724',keypairs=<?>,launch_index=0,launched_at=2023-11-15T09:39:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f29cd64a8a674d73936b8a0c90bf2d34',ramdisk_id='',reservation_id='r-5dx6y068',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-475232131',owner_user_name='tempest-AttachVolumeNegativeTest-475232131-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T09:39:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d52d39a644924944be943a3200bd5b33',uuid=594aff52-4f70-48bc-9a7d-87b984e223b8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8166d3f5-5c5b-493f-8194-3bfa42d0ff32", "address": "fa:16:3e:d7:4d:bf", "network": {"id": "cc80acf3-8a44-4d7e-aaa0-1214700564b3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1084984321-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f29cd64a8a674d73936b8a0c90bf2d34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8166d3f5-5c", "ovs_interfaceid": "8166d3f5-5c5b-493f-8194-3bfa42d0ff32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 09:41:40 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-8600cc72-2760-4b3f-95b6-99838f4c06f6 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Converting VIF {"id": "8166d3f5-5c5b-493f-8194-3bfa42d0ff32", "address": "fa:16:3e:d7:4d:bf", "network": {"id": "cc80acf3-8a44-4d7e-aaa0-1214700564b3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1084984321-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f29cd64a8a674d73936b8a0c90bf2d34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8166d3f5-5c", "ovs_interfaceid": "8166d3f5-5c5b-493f-8194-3bfa42d0ff32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 09:41:40 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-8600cc72-2760-4b3f-95b6-99838f4c06f6 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d7:4d:bf,bridge_name='br-int',has_traffic_filtering=True,id=8166d3f5-5c5b-493f-8194-3bfa42d0ff32,network=Network(cc80acf3-8a44-4d7e-aaa0-1214700564b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8166d3f5-5c') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 09:41:40 user nova-compute[75122]: DEBUG os_vif [None req-8600cc72-2760-4b3f-95b6-99838f4c06f6 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:4d:bf,bridge_name='br-int',has_traffic_filtering=True,id=8166d3f5-5c5b-493f-8194-3bfa42d0ff32,network=Network(cc80acf3-8a44-4d7e-aaa0-1214700564b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8166d3f5-5c') {{(pid=75122) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 09:41:40 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:41:40 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8166d3f5-5c, bridge=br-int, if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:41:40 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:41:40 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:41:40 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:41:40 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2f7582d7-b97c-4a89-a2dd-d521808e26ab) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:41:40 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:41:40 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:41:40 user nova-compute[75122]: INFO os_vif [None req-8600cc72-2760-4b3f-95b6-99838f4c06f6 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d7:4d:bf,bridge_name='br-int',has_traffic_filtering=True,id=8166d3f5-5c5b-493f-8194-3bfa42d0ff32,network=Network(cc80acf3-8a44-4d7e-aaa0-1214700564b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8166d3f5-5c')
Nov 15 09:41:40 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-8600cc72-2760-4b3f-95b6-99838f4c06f6 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] [instance: 594aff52-4f70-48bc-9a7d-87b984e223b8] Deleting instance files /opt/stack/data/nova/instances/594aff52-4f70-48bc-9a7d-87b984e223b8_del
Nov 15 09:41:40 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-8600cc72-2760-4b3f-95b6-99838f4c06f6 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] [instance: 594aff52-4f70-48bc-9a7d-87b984e223b8] Deletion of /opt/stack/data/nova/instances/594aff52-4f70-48bc-9a7d-87b984e223b8_del complete
Nov 15 09:41:40 user nova-compute[75122]: INFO nova.compute.manager [None req-8600cc72-2760-4b3f-95b6-99838f4c06f6 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] [instance: 594aff52-4f70-48bc-9a7d-87b984e223b8] Took 0.67 seconds to destroy the instance on the hypervisor.
Nov 15 09:41:40 user nova-compute[75122]: DEBUG oslo.service.loopingcall [None req-8600cc72-2760-4b3f-95b6-99838f4c06f6 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75122) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 09:41:40 user nova-compute[75122]: DEBUG nova.compute.manager [-] [instance: 594aff52-4f70-48bc-9a7d-87b984e223b8] Deallocating network for instance {{(pid=75122) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 09:41:40 user nova-compute[75122]: DEBUG nova.network.neutron [-] [instance: 594aff52-4f70-48bc-9a7d-87b984e223b8] deallocate_for_instance() {{(pid=75122) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 09:41:41 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:41:41 user nova-compute[75122]: DEBUG nova.network.neutron [req-111e8b58-915f-4d3f-ae23-5c9eeef86b1e req-20efb64a-7c00-4a71-bc9d-15cde119965d service nova] [instance: cc485c6c-5a9a-4c94-b966-68dd9e336e56] Updated VIF entry in instance network info cache for port d3b26bb1-8ddd-4467-af3e-74e39d54390e. {{(pid=75122) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 09:41:41 user nova-compute[75122]: DEBUG nova.network.neutron [req-111e8b58-915f-4d3f-ae23-5c9eeef86b1e req-20efb64a-7c00-4a71-bc9d-15cde119965d service nova] [instance: cc485c6c-5a9a-4c94-b966-68dd9e336e56] Updating instance_info_cache with network_info: [{"id": "d3b26bb1-8ddd-4467-af3e-74e39d54390e", "address": "fa:16:3e:8c:a9:0b", "network": {"id": "6e846655-a6f8-4339-a239-65d2f94c8b74", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1923452032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b8e67f8a66a4930be3fb65c397cbeb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3b26bb1-8d", "ovs_interfaceid": "d3b26bb1-8ddd-4467-af3e-74e39d54390e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:41:41 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-111e8b58-915f-4d3f-ae23-5c9eeef86b1e req-20efb64a-7c00-4a71-bc9d-15cde119965d service nova] Releasing lock "refresh_cache-cc485c6c-5a9a-4c94-b966-68dd9e336e56" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 09:41:41 user nova-compute[75122]: DEBUG nova.network.neutron [-] [instance: 594aff52-4f70-48bc-9a7d-87b984e223b8] Updating instance_info_cache with network_info: [] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:41:41 user nova-compute[75122]: INFO nova.compute.manager [-] [instance: 594aff52-4f70-48bc-9a7d-87b984e223b8] Took 0.68 seconds to deallocate network for instance.
Nov 15 09:41:41 user nova-compute[75122]: DEBUG nova.compute.manager [req-7120ccc5-4c2d-4199-abe0-cd4c4012f499 req-23e511ad-f158-4dd1-9a6f-423f744f98d5 service nova] [instance: 594aff52-4f70-48bc-9a7d-87b984e223b8] Received event network-vif-deleted-8166d3f5-5c5b-493f-8194-3bfa42d0ff32 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:41:41 user nova-compute[75122]: INFO nova.compute.manager [req-7120ccc5-4c2d-4199-abe0-cd4c4012f499 req-23e511ad-f158-4dd1-9a6f-423f744f98d5 service nova] [instance: 594aff52-4f70-48bc-9a7d-87b984e223b8] Neutron deleted interface 8166d3f5-5c5b-493f-8194-3bfa42d0ff32; detaching it from the instance and deleting it from the info cache
Nov 15 09:41:41 user nova-compute[75122]: DEBUG nova.network.neutron [req-7120ccc5-4c2d-4199-abe0-cd4c4012f499 req-23e511ad-f158-4dd1-9a6f-423f744f98d5 service nova] [instance: 594aff52-4f70-48bc-9a7d-87b984e223b8] Updating instance_info_cache with network_info: [] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:41:41 user nova-compute[75122]: DEBUG nova.compute.manager [req-c5786a90-04ea-4015-8fa6-71347c39ff4f req-ad52c0fa-c288-4a37-b64f-bb8c539be842 service nova] [instance: 594aff52-4f70-48bc-9a7d-87b984e223b8] Received event network-vif-unplugged-8166d3f5-5c5b-493f-8194-3bfa42d0ff32 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:41:41 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-c5786a90-04ea-4015-8fa6-71347c39ff4f req-ad52c0fa-c288-4a37-b64f-bb8c539be842 service nova] Acquiring lock "594aff52-4f70-48bc-9a7d-87b984e223b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:41:41 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-c5786a90-04ea-4015-8fa6-71347c39ff4f req-ad52c0fa-c288-4a37-b64f-bb8c539be842 service nova] Lock "594aff52-4f70-48bc-9a7d-87b984e223b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:41:41 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-c5786a90-04ea-4015-8fa6-71347c39ff4f req-ad52c0fa-c288-4a37-b64f-bb8c539be842 service nova] Lock "594aff52-4f70-48bc-9a7d-87b984e223b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:41:41 user nova-compute[75122]: DEBUG nova.compute.manager [req-c5786a90-04ea-4015-8fa6-71347c39ff4f req-ad52c0fa-c288-4a37-b64f-bb8c539be842 service nova] [instance: 594aff52-4f70-48bc-9a7d-87b984e223b8] No waiting events found dispatching network-vif-unplugged-8166d3f5-5c5b-493f-8194-3bfa42d0ff32 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:41:41 user nova-compute[75122]: DEBUG nova.compute.manager [req-c5786a90-04ea-4015-8fa6-71347c39ff4f req-ad52c0fa-c288-4a37-b64f-bb8c539be842 service nova] [instance: 594aff52-4f70-48bc-9a7d-87b984e223b8] Received event network-vif-unplugged-8166d3f5-5c5b-493f-8194-3bfa42d0ff32 for instance with task_state deleting. {{(pid=75122) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 09:41:41 user nova-compute[75122]: DEBUG nova.compute.manager [req-c5786a90-04ea-4015-8fa6-71347c39ff4f req-ad52c0fa-c288-4a37-b64f-bb8c539be842 service nova] [instance: 594aff52-4f70-48bc-9a7d-87b984e223b8] Received event network-vif-plugged-8166d3f5-5c5b-493f-8194-3bfa42d0ff32 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:41:41 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-c5786a90-04ea-4015-8fa6-71347c39ff4f req-ad52c0fa-c288-4a37-b64f-bb8c539be842 service nova] Acquiring lock "594aff52-4f70-48bc-9a7d-87b984e223b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:41:41 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-c5786a90-04ea-4015-8fa6-71347c39ff4f req-ad52c0fa-c288-4a37-b64f-bb8c539be842 service nova] Lock "594aff52-4f70-48bc-9a7d-87b984e223b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:41:41 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-c5786a90-04ea-4015-8fa6-71347c39ff4f req-ad52c0fa-c288-4a37-b64f-bb8c539be842 service nova] Lock "594aff52-4f70-48bc-9a7d-87b984e223b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:41:41 user nova-compute[75122]: DEBUG nova.compute.manager [req-c5786a90-04ea-4015-8fa6-71347c39ff4f req-ad52c0fa-c288-4a37-b64f-bb8c539be842 service nova] [instance: 594aff52-4f70-48bc-9a7d-87b984e223b8] No waiting events found dispatching network-vif-plugged-8166d3f5-5c5b-493f-8194-3bfa42d0ff32 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:41:41 user nova-compute[75122]: WARNING nova.compute.manager [req-c5786a90-04ea-4015-8fa6-71347c39ff4f req-ad52c0fa-c288-4a37-b64f-bb8c539be842 service nova] [instance: 594aff52-4f70-48bc-9a7d-87b984e223b8] Received unexpected event network-vif-plugged-8166d3f5-5c5b-493f-8194-3bfa42d0ff32 for instance with vm_state active and task_state deleting.
Nov 15 09:41:41 user nova-compute[75122]: DEBUG nova.compute.manager [req-7120ccc5-4c2d-4199-abe0-cd4c4012f499 req-23e511ad-f158-4dd1-9a6f-423f744f98d5 service nova] [instance: 594aff52-4f70-48bc-9a7d-87b984e223b8] Detach interface failed, port_id=8166d3f5-5c5b-493f-8194-3bfa42d0ff32, reason: Instance 594aff52-4f70-48bc-9a7d-87b984e223b8 could not be found. {{(pid=75122) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 09:41:41 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-8600cc72-2760-4b3f-95b6-99838f4c06f6 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:41:41 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-8600cc72-2760-4b3f-95b6-99838f4c06f6 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:41:42 user nova-compute[75122]: DEBUG nova.compute.provider_tree [None req-8600cc72-2760-4b3f-95b6-99838f4c06f6 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Inventory has not changed in ProviderTree for provider: 69a3da65-47be-44c6-b67c-c692b58284ef {{(pid=75122) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 09:41:42 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-8600cc72-2760-4b3f-95b6-99838f4c06f6 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Inventory has not changed for provider 69a3da65-47be-44c6-b67c-c692b58284ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 09:41:42 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-8600cc72-2760-4b3f-95b6-99838f4c06f6 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.387s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:41:42 user nova-compute[75122]: INFO nova.scheduler.client.report [None req-8600cc72-2760-4b3f-95b6-99838f4c06f6 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Deleted allocations for instance 594aff52-4f70-48bc-9a7d-87b984e223b8
Nov 15 09:41:42 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-8600cc72-2760-4b3f-95b6-99838f4c06f6 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Lock "594aff52-4f70-48bc-9a7d-87b984e223b8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.971s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:41:42 user nova-compute[75122]: DEBUG nova.compute.manager [None req-d1d12aac-ad02-4056-8659-8d679a4d22d8 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] [instance: cc485c6c-5a9a-4c94-b966-68dd9e336e56] Start spawning the instance on the hypervisor. {{(pid=75122) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 09:41:42 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-d1d12aac-ad02-4056-8659-8d679a4d22d8 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] [instance: cc485c6c-5a9a-4c94-b966-68dd9e336e56] Creating instance directory {{(pid=75122) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 09:41:42 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-d1d12aac-ad02-4056-8659-8d679a4d22d8 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] [instance: cc485c6c-5a9a-4c94-b966-68dd9e336e56] Creating image(s)
Nov 15 09:41:42 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-d1d12aac-ad02-4056-8659-8d679a4d22d8 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] [instance: cc485c6c-5a9a-4c94-b966-68dd9e336e56] Did not create local disks {{(pid=75122) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 09:41:42 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-d1d12aac-ad02-4056-8659-8d679a4d22d8 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] [instance: cc485c6c-5a9a-4c94-b966-68dd9e336e56] Ensure instance console log exists: /opt/stack/data/nova/instances/cc485c6c-5a9a-4c94-b966-68dd9e336e56/console.log {{(pid=75122) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 09:41:42 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-d1d12aac-ad02-4056-8659-8d679a4d22d8 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:41:42 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-d1d12aac-ad02-4056-8659-8d679a4d22d8 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:41:42 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-d1d12aac-ad02-4056-8659-8d679a4d22d8 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:41:42 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-d1d12aac-ad02-4056-8659-8d679a4d22d8 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] [instance: cc485c6c-5a9a-4c94-b966-68dd9e336e56] Start _get_guest_xml network_info=[{"id": "d3b26bb1-8ddd-4467-af3e-74e39d54390e", "address": "fa:16:3e:8c:a9:0b", "network": {"id": "6e846655-a6f8-4339-a239-65d2f94c8b74", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1923452032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b8e67f8a66a4930be3fb65c397cbeb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3b26bb1-8d", "ovs_interfaceid": "d3b26bb1-8ddd-4467-af3e-74e39d54390e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DdRJNhXT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'cc485c6c-5a9a-4c94-b966-68dd9e336e56', 'attached_at': '', 'detached_at': '', 'volume_id': '5aa0e3ae-4004-414c-b0c9-8c089c420c17', 'serial': '5aa0e3ae-4004-414c-b0c9-8c089c420c17'}, 'guest_format': None, 'delete_on_termination': True, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vda', 'attachment_id': '355da4ec-40d0-4b0a-b6ee-26740bea8c51', 'volume_type': None} {{(pid=75122) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 09:41:42 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-d1d12aac-ad02-4056-8659-8d679a4d22d8 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 09:41:42 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-d1d12aac-ad02-4056-8659-8d679a4d22d8 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 09:41:42 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-d1d12aac-ad02-4056-8659-8d679a4d22d8 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75122) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 09:41:42 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-d1d12aac-ad02-4056-8659-8d679a4d22d8 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] CPU controller missing on host. {{(pid=75122) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 09:41:42 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-d1d12aac-ad02-4056-8659-8d679a4d22d8 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75122) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 09:41:42 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-d1d12aac-ad02-4056-8659-8d679a4d22d8 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] CPU controller found on host. {{(pid=75122) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 09:41:42 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-d1d12aac-ad02-4056-8659-8d679a4d22d8 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75122) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 09:41:42 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-d1d12aac-ad02-4056-8659-8d679a4d22d8 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T09:26:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 09:41:42 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-d1d12aac-ad02-4056-8659-8d679a4d22d8 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Flavor limits 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 09:41:42 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-d1d12aac-ad02-4056-8659-8d679a4d22d8 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Image limits 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 09:41:42 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-d1d12aac-ad02-4056-8659-8d679a4d22d8 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Flavor pref 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 09:41:42 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-d1d12aac-ad02-4056-8659-8d679a4d22d8 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Image pref 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 09:41:42 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-d1d12aac-ad02-4056-8659-8d679a4d22d8 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 09:41:42 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-d1d12aac-ad02-4056-8659-8d679a4d22d8 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 09:41:42 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-d1d12aac-ad02-4056-8659-8d679a4d22d8 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75122) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 09:41:42 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-d1d12aac-ad02-4056-8659-8d679a4d22d8 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Got 1 possible topologies {{(pid=75122) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 09:41:42 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-d1d12aac-ad02-4056-8659-8d679a4d22d8 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 09:41:42 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-d1d12aac-ad02-4056-8659-8d679a4d22d8 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 09:41:42 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d1d12aac-ad02-4056-8659-8d679a4d22d8 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] [instance: cc485c6c-5a9a-4c94-b966-68dd9e336e56] Calling os-brick to attach iSCSI Volume {{(pid=75122) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 09:41:42 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1d12aac-ad02-4056-8659-8d679a4d22d8 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffa04060b80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DdRJNhXT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 09:41:42 user nova-compute[75122]: WARNING os_brick.initiator.connectors.base [None req-d1d12aac-ad02-4056-8659-8d679a4d22d8 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 09:41:42 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-d1d12aac-ad02-4056-8659-8d679a4d22d8 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 09:41:42 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-d1d12aac-ad02-4056-8659-8d679a4d22d8 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 09:41:42 user nova-compute[75122]: WARNING os_brick.initiator.connectors.base [None req-d1d12aac-ad02-4056-8659-8d679a4d22d8 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 09:41:42 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-d1d12aac-ad02-4056-8659-8d679a4d22d8 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 09:41:42 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-d1d12aac-ad02-4056-8659-8d679a4d22d8 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 09:41:42 user nova-compute[75122]: INFO os_brick.initiator.connectors.iscsi [None req-d1d12aac-ad02-4056-8659-8d679a4d22d8 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 09:41:42 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17 -p 172.16.0.220:3260 {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:41:42 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:41:42 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[55fb74e9-1c05-4523-8320-bc7908a7b806]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:41:42 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1d12aac-ad02-4056-8659-8d679a4d22d8 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 09:41:42 user nova-compute[75122]:  {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:41:42 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17 -p 172.16.0.220:3260 --interface default --op new {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:41:42 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:41:42 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8b43dd1-99cb-4189-8fa9-e6a212712e48]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17] added\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:41:42 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1d12aac-ad02-4056-8659-8d679a4d22d8 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17] added
Nov 15 09:41:42 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:41:42 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:41:42 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:41:42 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffbcedee-4830-48b7-b1c4-3a8b011b2682]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:41:42 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1d12aac-ad02-4056-8659-8d679a4d22d8 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:41:42 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:41:43 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:41:43 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd7f0bc8-4810-4a8e-a82c-8c38b2622f51]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:41:43 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1d12aac-ad02-4056-8659-8d679a4d22d8 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:41:43 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DdRJNhXT {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:41:43 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DdRJNhXT" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:41:43 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[620ede69-50a3-45af-a97c-81d26e037c61]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:41:43 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1d12aac-ad02-4056-8659-8d679a4d22d8 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DdRJNhXT'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:41:43 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:41:43 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:41:43 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ba692c0-66a5-4e01-8d26-83fd040081dc]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:41:43 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1d12aac-ad02-4056-8659-8d679a4d22d8 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:41:43 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:41:43 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:41:43 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f69bbf0-c89f-4368-9815-e764660fe451]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdf09a1b-a065-4b88-815d-ee54c1c68464 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:395810b1-e3c3-4660-aaaf-b6d9e7cb5a88 (non-flash)\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:41:43 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1d12aac-ad02-4056-8659-8d679a4d22d8 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdf09a1b-a065-4b88-815d-ee54c1c68464 (non-flash)
Nov 15 09:41:43 user nova-compute[75122]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:395810b1-e3c3-4660-aaaf-b6d9e7cb5a88 (non-flash)
Nov 15 09:41:43 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 09:41:43 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1d12aac-ad02-4056-8659-8d679a4d22d8 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdf09a1b-a065-4b88-815d-ee54c1c68464 (non-flash)
Nov 15 09:41:43 user nova-compute[75122]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:395810b1-e3c3-4660-aaaf-b6d9e7cb5a88 (non-flash)
Nov 15 09:41:43 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 09:41:43 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17 -p 172.16.0.220:3260 --login {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:41:43 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:41:43 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[793d4810-c750-4413-861a-7d63bdd59566]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:41:43 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1d12aac-ad02-4056-8659-8d679a4d22d8 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17, portal: 172.16.0.220,3260]
Nov 15 09:41:43 user nova-compute[75122]: Login to [iface: default, target: iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17, portal: 172.16.0.220,3260] successful.
Nov 15 09:41:43 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:41:43 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:41:43 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:41:43 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[8231b632-36f8-48c5-bc4a-9dce331869d1]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:41:43 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1d12aac-ad02-4056-8659-8d679a4d22d8 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:41:43 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:41:43 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:41:43 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[bee06843-b46d-442e-9d1d-98fd22087228]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdf09a1b-a065-4b88-815d-ee54c1c68464 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:395810b1-e3c3-4660-aaaf-b6d9e7cb5a88 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17 (non-flash)\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:41:43 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1d12aac-ad02-4056-8659-8d679a4d22d8 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdf09a1b-a065-4b88-815d-ee54c1c68464 (non-flash)
Nov 15 09:41:43 user nova-compute[75122]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:395810b1-e3c3-4660-aaaf-b6d9e7cb5a88 (non-flash)
Nov 15 09:41:43 user nova-compute[75122]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17 (non-flash)
Nov 15 09:41:43 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 09:41:43 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1d12aac-ad02-4056-8659-8d679a4d22d8 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdf09a1b-a065-4b88-815d-ee54c1c68464 (non-flash)
Nov 15 09:41:43 user nova-compute[75122]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:395810b1-e3c3-4660-aaaf-b6d9e7cb5a88 (non-flash)
Nov 15 09:41:43 user nova-compute[75122]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17 (non-flash)
Nov 15 09:41:43 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 09:41:43 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-d1d12aac-ad02-4056-8659-8d679a4d22d8 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.279s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 09:41:43 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1d12aac-ad02-4056-8659-8d679a4d22d8 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Connected to 172.16.0.220:3260 {{(pid=75122) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 09:41:43 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-d1d12aac-ad02-4056-8659-8d679a4d22d8 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] HCTL ('34', '-', '-', 0) found on session 32 with lun 0 {{(pid=75122) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 09:41:43 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-d1d12aac-ad02-4056-8659-8d679a4d22d8 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75122) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 09:41:43 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:41:43 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:41:43 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[cde10ae1-f157-4ad3-a740-13ee4bab05a6]: (4, ('- - 0', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:41:43 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-d1d12aac-ad02-4056-8659-8d679a4d22d8 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Searching for a device in session 32 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75122) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 09:41:43 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1d12aac-ad02-4056-8659-8d679a4d22d8 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DdRJNhXT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75122) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 09:41:43 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:41:44 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-d1d12aac-ad02-4056-8659-8d679a4d22d8 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.447s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 09:41:44 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1d12aac-ad02-4056-8659-8d679a4d22d8 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] <== connect_volume: return (1449ms) {'type': 'block', 'scsi_wwn': '23666363463366637', 'path': '/dev/sdc'} {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 09:41:44 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d1d12aac-ad02-4056-8659-8d679a4d22d8 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] [instance: cc485c6c-5a9a-4c94-b966-68dd9e336e56] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23666363463366637', 'path': '/dev/sdc'} {{(pid=75122) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 09:41:44 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-d1d12aac-ad02-4056-8659-8d679a4d22d8 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T09:41:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-876462161',display_name='tempest-ServerActionsTestOtherA-server-876462161',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-876462161',id=28,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOjee/3FY3+bQUxkeNPW0HfKU2TS7/WwlSdJA5dC2LRbPtr2GAllBrZqAcx+1wIVC2pqAFLTFeo/KsxadKKcxACsVLYL8LB97mDl41CXm0aq5TWX4fm1S5aOkZSs0D2eNA==',key_name='tempest-keypair-686734186',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8b8e67f8a66a4930be3fb65c397cbeb2',ramdisk_id='',reservation_id='r-50r2vzfz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1521412552',owner_user_name='tempest-ServerActionsTestOtherA-1521412552-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T09:41:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='91f1469b2c7c45d6ac27f2b64fd5cefe',uuid=cc485c6c-5a9a-4c94-b966-68dd9e336e56,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d3b26bb1-8ddd-4467-af3e-74e39d54390e", "address": "fa:16:3e:8c:a9:0b", "network": {"id": "6e846655-a6f8-4339-a239-65d2f94c8b74", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1923452032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b8e67f8a66a4930be3fb65c397cbeb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3b26bb1-8d", "ovs_interfaceid": "d3b26bb1-8ddd-4467-af3e-74e39d54390e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75122) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 09:41:44 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-d1d12aac-ad02-4056-8659-8d679a4d22d8 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Converting VIF {"id": "d3b26bb1-8ddd-4467-af3e-74e39d54390e", "address": "fa:16:3e:8c:a9:0b", "network": {"id": "6e846655-a6f8-4339-a239-65d2f94c8b74", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1923452032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b8e67f8a66a4930be3fb65c397cbeb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3b26bb1-8d", "ovs_interfaceid": "d3b26bb1-8ddd-4467-af3e-74e39d54390e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 09:41:44 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-d1d12aac-ad02-4056-8659-8d679a4d22d8 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:a9:0b,bridge_name='br-int',has_traffic_filtering=True,id=d3b26bb1-8ddd-4467-af3e-74e39d54390e,network=Network(6e846655-a6f8-4339-a239-65d2f94c8b74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3b26bb1-8d') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 09:41:44 user nova-compute[75122]: DEBUG nova.objects.instance [None req-d1d12aac-ad02-4056-8659-8d679a4d22d8 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Lazy-loading 'pci_devices' on Instance uuid cc485c6c-5a9a-4c94-b966-68dd9e336e56 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:41:44 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-d1d12aac-ad02-4056-8659-8d679a4d22d8 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] [instance: cc485c6c-5a9a-4c94-b966-68dd9e336e56] End _get_guest_xml xml=<domain type="kvm">
Nov 15 09:41:44 user nova-compute[75122]:   <uuid>cc485c6c-5a9a-4c94-b966-68dd9e336e56</uuid>
Nov 15 09:41:44 user nova-compute[75122]:   <name>instance-0000001c</name>
Nov 15 09:41:44 user nova-compute[75122]:   <memory>524288</memory>
Nov 15 09:41:44 user nova-compute[75122]:   <vcpu>1</vcpu>
Nov 15 09:41:44 user nova-compute[75122]:   <metadata>
Nov 15 09:41:44 user nova-compute[75122]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 09:41:44 user nova-compute[75122]:       <nova:package version="0.0.0"/>
Nov 15 09:41:44 user nova-compute[75122]:       <nova:name>tempest-ServerActionsTestOtherA-server-876462161</nova:name>
Nov 15 09:41:44 user nova-compute[75122]:       <nova:creationTime>2023-11-15 09:41:42</nova:creationTime>
Nov 15 09:41:44 user nova-compute[75122]:       <nova:flavor name="m1.tiny">
Nov 15 09:41:44 user nova-compute[75122]:         <nova:memory>512</nova:memory>
Nov 15 09:41:44 user nova-compute[75122]:         <nova:disk>1</nova:disk>
Nov 15 09:41:44 user nova-compute[75122]:         <nova:swap>0</nova:swap>
Nov 15 09:41:44 user nova-compute[75122]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 09:41:44 user nova-compute[75122]:         <nova:vcpus>1</nova:vcpus>
Nov 15 09:41:44 user nova-compute[75122]:       </nova:flavor>
Nov 15 09:41:44 user nova-compute[75122]:       <nova:owner>
Nov 15 09:41:44 user nova-compute[75122]:         <nova:user uuid="91f1469b2c7c45d6ac27f2b64fd5cefe">tempest-ServerActionsTestOtherA-1521412552-project-member</nova:user>
Nov 15 09:41:44 user nova-compute[75122]:         <nova:project uuid="8b8e67f8a66a4930be3fb65c397cbeb2">tempest-ServerActionsTestOtherA-1521412552</nova:project>
Nov 15 09:41:44 user nova-compute[75122]:       </nova:owner>
Nov 15 09:41:44 user nova-compute[75122]:       <nova:ports>
Nov 15 09:41:44 user nova-compute[75122]:         <nova:port uuid="d3b26bb1-8ddd-4467-af3e-74e39d54390e">
Nov 15 09:41:44 user nova-compute[75122]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 15 09:41:44 user nova-compute[75122]:         </nova:port>
Nov 15 09:41:44 user nova-compute[75122]:       </nova:ports>
Nov 15 09:41:44 user nova-compute[75122]:     </nova:instance>
Nov 15 09:41:44 user nova-compute[75122]:   </metadata>
Nov 15 09:41:44 user nova-compute[75122]:   <sysinfo type="smbios">
Nov 15 09:41:44 user nova-compute[75122]:     <system>
Nov 15 09:41:44 user nova-compute[75122]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 09:41:44 user nova-compute[75122]:       <entry name="product">OpenStack Nova</entry>
Nov 15 09:41:44 user nova-compute[75122]:       <entry name="version">0.0.0</entry>
Nov 15 09:41:44 user nova-compute[75122]:       <entry name="serial">cc485c6c-5a9a-4c94-b966-68dd9e336e56</entry>
Nov 15 09:41:44 user nova-compute[75122]:       <entry name="uuid">cc485c6c-5a9a-4c94-b966-68dd9e336e56</entry>
Nov 15 09:41:44 user nova-compute[75122]:       <entry name="family">Virtual Machine</entry>
Nov 15 09:41:44 user nova-compute[75122]:     </system>
Nov 15 09:41:44 user nova-compute[75122]:   </sysinfo>
Nov 15 09:41:44 user nova-compute[75122]:   <os>
Nov 15 09:41:44 user nova-compute[75122]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 09:41:44 user nova-compute[75122]:     <boot dev="hd"/>
Nov 15 09:41:44 user nova-compute[75122]:     <smbios mode="sysinfo"/>
Nov 15 09:41:44 user nova-compute[75122]:   </os>
Nov 15 09:41:44 user nova-compute[75122]:   <features>
Nov 15 09:41:44 user nova-compute[75122]:     <acpi/>
Nov 15 09:41:44 user nova-compute[75122]:     <apic/>
Nov 15 09:41:44 user nova-compute[75122]:     <vmcoreinfo/>
Nov 15 09:41:44 user nova-compute[75122]:   </features>
Nov 15 09:41:44 user nova-compute[75122]:   <clock offset="utc">
Nov 15 09:41:44 user nova-compute[75122]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 09:41:44 user nova-compute[75122]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 09:41:44 user nova-compute[75122]:     <timer name="hpet" present="no"/>
Nov 15 09:41:44 user nova-compute[75122]:   </clock>
Nov 15 09:41:44 user nova-compute[75122]:   <cpu mode="custom" match="exact">
Nov 15 09:41:44 user nova-compute[75122]:     <model>Nehalem</model>
Nov 15 09:41:44 user nova-compute[75122]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 09:41:44 user nova-compute[75122]:   </cpu>
Nov 15 09:41:44 user nova-compute[75122]:   <devices>
Nov 15 09:41:44 user nova-compute[75122]:     <disk type="block" device="disk">
Nov 15 09:41:44 user nova-compute[75122]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 09:41:44 user nova-compute[75122]:       <source dev="/dev/sdc"/>
Nov 15 09:41:44 user nova-compute[75122]:       <target dev="vda" bus="virtio"/>
Nov 15 09:41:44 user nova-compute[75122]:       <serial>5aa0e3ae-4004-414c-b0c9-8c089c420c17</serial>
Nov 15 09:41:44 user nova-compute[75122]:     </disk>
Nov 15 09:41:44 user nova-compute[75122]:     <interface type="ethernet">
Nov 15 09:41:44 user nova-compute[75122]:       <mac address="fa:16:3e:8c:a9:0b"/>
Nov 15 09:41:44 user nova-compute[75122]:       <model type="virtio"/>
Nov 15 09:41:44 user nova-compute[75122]:       <mtu size="1442"/>
Nov 15 09:41:44 user nova-compute[75122]:       <target dev="tapd3b26bb1-8d"/>
Nov 15 09:41:44 user nova-compute[75122]:     </interface>
Nov 15 09:41:44 user nova-compute[75122]:     <serial type="pty">
Nov 15 09:41:44 user nova-compute[75122]:       <log file="/opt/stack/data/nova/instances/cc485c6c-5a9a-4c94-b966-68dd9e336e56/console.log" append="off"/>
Nov 15 09:41:44 user nova-compute[75122]:     </serial>
Nov 15 09:41:44 user nova-compute[75122]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 09:41:44 user nova-compute[75122]:     <video>
Nov 15 09:41:44 user nova-compute[75122]:       <model type="virtio"/>
Nov 15 09:41:44 user nova-compute[75122]:     </video>
Nov 15 09:41:44 user nova-compute[75122]:     <rng model="virtio">
Nov 15 09:41:44 user nova-compute[75122]:       <backend model="random">/dev/urandom</backend>
Nov 15 09:41:44 user nova-compute[75122]:     </rng>
Nov 15 09:41:44 user nova-compute[75122]:     <controller type="usb" index="0" model="none"/>
Nov 15 09:41:44 user nova-compute[75122]:     <memballoon model="virtio">
Nov 15 09:41:44 user nova-compute[75122]:       <stats period="10"/>
Nov 15 09:41:44 user nova-compute[75122]:     </memballoon>
Nov 15 09:41:44 user nova-compute[75122]:   </devices>
Nov 15 09:41:44 user nova-compute[75122]: </domain>
Nov 15 09:41:44 user nova-compute[75122]:  {{(pid=75122) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 09:41:44 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-d1d12aac-ad02-4056-8659-8d679a4d22d8 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T09:41:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-876462161',display_name='tempest-ServerActionsTestOtherA-server-876462161',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-876462161',id=28,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOjee/3FY3+bQUxkeNPW0HfKU2TS7/WwlSdJA5dC2LRbPtr2GAllBrZqAcx+1wIVC2pqAFLTFeo/KsxadKKcxACsVLYL8LB97mDl41CXm0aq5TWX4fm1S5aOkZSs0D2eNA==',key_name='tempest-keypair-686734186',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8b8e67f8a66a4930be3fb65c397cbeb2',ramdisk_id='',reservation_id='r-50r2vzfz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1521412552',owner_user_name='tempest-ServerActionsTestOtherA-1521412552-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T09:41:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='91f1469b2c7c45d6ac27f2b64fd5cefe',uuid=cc485c6c-5a9a-4c94-b966-68dd9e336e56,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d3b26bb1-8ddd-4467-af3e-74e39d54390e", "address": "fa:16:3e:8c:a9:0b", "network": {"id": "6e846655-a6f8-4339-a239-65d2f94c8b74", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1923452032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b8e67f8a66a4930be3fb65c397cbeb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3b26bb1-8d", "ovs_interfaceid": "d3b26bb1-8ddd-4467-af3e-74e39d54390e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 09:41:44 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-d1d12aac-ad02-4056-8659-8d679a4d22d8 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Converting VIF {"id": "d3b26bb1-8ddd-4467-af3e-74e39d54390e", "address": "fa:16:3e:8c:a9:0b", "network": {"id": "6e846655-a6f8-4339-a239-65d2f94c8b74", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1923452032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b8e67f8a66a4930be3fb65c397cbeb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3b26bb1-8d", "ovs_interfaceid": "d3b26bb1-8ddd-4467-af3e-74e39d54390e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 09:41:44 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-d1d12aac-ad02-4056-8659-8d679a4d22d8 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:a9:0b,bridge_name='br-int',has_traffic_filtering=True,id=d3b26bb1-8ddd-4467-af3e-74e39d54390e,network=Network(6e846655-a6f8-4339-a239-65d2f94c8b74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3b26bb1-8d') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 09:41:44 user nova-compute[75122]: DEBUG os_vif [None req-d1d12aac-ad02-4056-8659-8d679a4d22d8 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:a9:0b,bridge_name='br-int',has_traffic_filtering=True,id=d3b26bb1-8ddd-4467-af3e-74e39d54390e,network=Network(6e846655-a6f8-4339-a239-65d2f94c8b74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3b26bb1-8d') {{(pid=75122) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 09:41:44 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:41:44 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:41:44 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 09:41:44 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:41:44 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd1890972-0a31-50b4-bd14-e1765aeb2d3c', '_type': 'linux-noop'}}, row=False) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:41:44 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:41:44 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:41:44 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:41:44 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd3b26bb1-8d, may_exist=True, interface_attrs={}) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:41:44 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd3b26bb1-8d, col_values=(('qos', UUID('22a4650a-8efe-4542-a81a-7af157a09071')),), if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:41:44 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd3b26bb1-8d, col_values=(('external_ids', {'iface-id': 'd3b26bb1-8ddd-4467-af3e-74e39d54390e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8c:a9:0b', 'vm-uuid': 'cc485c6c-5a9a-4c94-b966-68dd9e336e56'}),), if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:41:44 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:41:44 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:41:44 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:41:44 user nova-compute[75122]: INFO os_vif [None req-d1d12aac-ad02-4056-8659-8d679a4d22d8 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:a9:0b,bridge_name='br-int',has_traffic_filtering=True,id=d3b26bb1-8ddd-4467-af3e-74e39d54390e,network=Network(6e846655-a6f8-4339-a239-65d2f94c8b74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3b26bb1-8d')
Nov 15 09:41:44 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-d1d12aac-ad02-4056-8659-8d679a4d22d8 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] No BDM found with device name vda, not building metadata. {{(pid=75122) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 09:41:44 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-d1d12aac-ad02-4056-8659-8d679a4d22d8 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] No VIF found with MAC fa:16:3e:8c:a9:0b, not building metadata {{(pid=75122) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 09:41:45 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:41:45 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:41:45 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:41:45 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:41:45 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:41:46 user nova-compute[75122]: DEBUG nova.compute.manager [req-e0e91607-f612-467f-bdd8-bc101b3ddde6 req-e5751fe8-7f94-4a45-b204-e82934eb8fde service nova] [instance: cc485c6c-5a9a-4c94-b966-68dd9e336e56] Received event network-vif-plugged-d3b26bb1-8ddd-4467-af3e-74e39d54390e {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:41:46 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-e0e91607-f612-467f-bdd8-bc101b3ddde6 req-e5751fe8-7f94-4a45-b204-e82934eb8fde service nova] Acquiring lock "cc485c6c-5a9a-4c94-b966-68dd9e336e56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:41:46 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-e0e91607-f612-467f-bdd8-bc101b3ddde6 req-e5751fe8-7f94-4a45-b204-e82934eb8fde service nova] Lock "cc485c6c-5a9a-4c94-b966-68dd9e336e56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:41:46 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-e0e91607-f612-467f-bdd8-bc101b3ddde6 req-e5751fe8-7f94-4a45-b204-e82934eb8fde service nova] Lock "cc485c6c-5a9a-4c94-b966-68dd9e336e56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:41:46 user nova-compute[75122]: DEBUG nova.compute.manager [req-e0e91607-f612-467f-bdd8-bc101b3ddde6 req-e5751fe8-7f94-4a45-b204-e82934eb8fde service nova] [instance: cc485c6c-5a9a-4c94-b966-68dd9e336e56] No waiting events found dispatching network-vif-plugged-d3b26bb1-8ddd-4467-af3e-74e39d54390e {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:41:46 user nova-compute[75122]: WARNING nova.compute.manager [req-e0e91607-f612-467f-bdd8-bc101b3ddde6 req-e5751fe8-7f94-4a45-b204-e82934eb8fde service nova] [instance: cc485c6c-5a9a-4c94-b966-68dd9e336e56] Received unexpected event network-vif-plugged-d3b26bb1-8ddd-4467-af3e-74e39d54390e for instance with vm_state building and task_state spawning.
Nov 15 09:41:46 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:41:46 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:41:47 user nova-compute[75122]: DEBUG nova.compute.manager [None req-d1d12aac-ad02-4056-8659-8d679a4d22d8 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] [instance: cc485c6c-5a9a-4c94-b966-68dd9e336e56] Instance event wait completed in 0 seconds for  {{(pid=75122) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 09:41:47 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-d1d12aac-ad02-4056-8659-8d679a4d22d8 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] [instance: cc485c6c-5a9a-4c94-b966-68dd9e336e56] Guest created on hypervisor {{(pid=75122) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 09:41:47 user nova-compute[75122]: INFO nova.virt.libvirt.driver [-] [instance: cc485c6c-5a9a-4c94-b966-68dd9e336e56] Instance spawned successfully.
Nov 15 09:41:47 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-d1d12aac-ad02-4056-8659-8d679a4d22d8 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] [instance: cc485c6c-5a9a-4c94-b966-68dd9e336e56] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 09:41:47 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-d1d12aac-ad02-4056-8659-8d679a4d22d8 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] [instance: cc485c6c-5a9a-4c94-b966-68dd9e336e56] Found default for hw_cdrom_bus of ide {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:41:47 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-d1d12aac-ad02-4056-8659-8d679a4d22d8 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] [instance: cc485c6c-5a9a-4c94-b966-68dd9e336e56] Found default for hw_disk_bus of virtio {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:41:47 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-d1d12aac-ad02-4056-8659-8d679a4d22d8 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] [instance: cc485c6c-5a9a-4c94-b966-68dd9e336e56] Found default for hw_input_bus of None {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:41:47 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-d1d12aac-ad02-4056-8659-8d679a4d22d8 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] [instance: cc485c6c-5a9a-4c94-b966-68dd9e336e56] Found default for hw_pointer_model of None {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:41:47 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-d1d12aac-ad02-4056-8659-8d679a4d22d8 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] [instance: cc485c6c-5a9a-4c94-b966-68dd9e336e56] Found default for hw_video_model of virtio {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:41:47 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-d1d12aac-ad02-4056-8659-8d679a4d22d8 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] [instance: cc485c6c-5a9a-4c94-b966-68dd9e336e56] Found default for hw_vif_model of virtio {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:41:47 user nova-compute[75122]: INFO nova.compute.manager [None req-d1d12aac-ad02-4056-8659-8d679a4d22d8 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] [instance: cc485c6c-5a9a-4c94-b966-68dd9e336e56] Took 5.11 seconds to spawn the instance on the hypervisor.
Nov 15 09:41:47 user nova-compute[75122]: DEBUG nova.compute.manager [None req-d1d12aac-ad02-4056-8659-8d679a4d22d8 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] [instance: cc485c6c-5a9a-4c94-b966-68dd9e336e56] Checking state {{(pid=75122) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 09:41:48 user nova-compute[75122]: INFO nova.compute.manager [None req-d1d12aac-ad02-4056-8659-8d679a4d22d8 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] [instance: cc485c6c-5a9a-4c94-b966-68dd9e336e56] Took 10.85 seconds to build instance.
Nov 15 09:41:48 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-d1d12aac-ad02-4056-8659-8d679a4d22d8 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Lock "cc485c6c-5a9a-4c94-b966-68dd9e336e56" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.951s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:41:48 user nova-compute[75122]: DEBUG nova.compute.manager [req-29882ceb-1547-4b74-8025-30b8192183f2 req-ae4130ae-1d98-4050-89f9-6837781d1ae8 service nova] [instance: cc485c6c-5a9a-4c94-b966-68dd9e336e56] Received event network-vif-plugged-d3b26bb1-8ddd-4467-af3e-74e39d54390e {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:41:48 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-29882ceb-1547-4b74-8025-30b8192183f2 req-ae4130ae-1d98-4050-89f9-6837781d1ae8 service nova] Acquiring lock "cc485c6c-5a9a-4c94-b966-68dd9e336e56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:41:48 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-29882ceb-1547-4b74-8025-30b8192183f2 req-ae4130ae-1d98-4050-89f9-6837781d1ae8 service nova] Lock "cc485c6c-5a9a-4c94-b966-68dd9e336e56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:41:48 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-29882ceb-1547-4b74-8025-30b8192183f2 req-ae4130ae-1d98-4050-89f9-6837781d1ae8 service nova] Lock "cc485c6c-5a9a-4c94-b966-68dd9e336e56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:41:48 user nova-compute[75122]: DEBUG nova.compute.manager [req-29882ceb-1547-4b74-8025-30b8192183f2 req-ae4130ae-1d98-4050-89f9-6837781d1ae8 service nova] [instance: cc485c6c-5a9a-4c94-b966-68dd9e336e56] No waiting events found dispatching network-vif-plugged-d3b26bb1-8ddd-4467-af3e-74e39d54390e {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:41:48 user nova-compute[75122]: WARNING nova.compute.manager [req-29882ceb-1547-4b74-8025-30b8192183f2 req-ae4130ae-1d98-4050-89f9-6837781d1ae8 service nova] [instance: cc485c6c-5a9a-4c94-b966-68dd9e336e56] Received unexpected event network-vif-plugged-d3b26bb1-8ddd-4467-af3e-74e39d54390e for instance with vm_state active and task_state None.
Nov 15 09:41:48 user nova-compute[75122]: INFO nova.compute.manager [None req-e121a256-0c8f-40f2-ba9f-f7f0adc6b6fd tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] [instance: fd9d52bb-6248-48e6-a798-6dbdaaa68cbc] Unrescuing
Nov 15 09:41:48 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-e121a256-0c8f-40f2-ba9f-f7f0adc6b6fd tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Acquiring lock "refresh_cache-fd9d52bb-6248-48e6-a798-6dbdaaa68cbc" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 09:41:48 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-e121a256-0c8f-40f2-ba9f-f7f0adc6b6fd tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Acquired lock "refresh_cache-fd9d52bb-6248-48e6-a798-6dbdaaa68cbc" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 09:41:48 user nova-compute[75122]: DEBUG nova.network.neutron [None req-e121a256-0c8f-40f2-ba9f-f7f0adc6b6fd tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] [instance: fd9d52bb-6248-48e6-a798-6dbdaaa68cbc] Building network info cache for instance {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 09:41:49 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:41:49 user nova-compute[75122]: DEBUG nova.network.neutron [None req-e121a256-0c8f-40f2-ba9f-f7f0adc6b6fd tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] [instance: fd9d52bb-6248-48e6-a798-6dbdaaa68cbc] Updating instance_info_cache with network_info: [{"id": "f6892701-aba2-4c9a-88bd-996d00963301", "address": "fa:16:3e:a5:6f:a0", "network": {"id": "c2062f64-d925-42d2-9687-5d2511ef6697", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1134087048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eeff24cb28f5481fa3941ba399ce82ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6892701-ab", "ovs_interfaceid": "f6892701-aba2-4c9a-88bd-996d00963301", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:41:49 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-e121a256-0c8f-40f2-ba9f-f7f0adc6b6fd tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Releasing lock "refresh_cache-fd9d52bb-6248-48e6-a798-6dbdaaa68cbc" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 09:41:49 user nova-compute[75122]: DEBUG nova.objects.instance [None req-e121a256-0c8f-40f2-ba9f-f7f0adc6b6fd tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Lazy-loading 'flavor' on Instance uuid fd9d52bb-6248-48e6-a798-6dbdaaa68cbc {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:41:49 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:41:49 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:41:50 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:41:50 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:41:50 user nova-compute[75122]: DEBUG nova.compute.manager [req-857ff92b-8ae6-48dc-8ed2-3f712f5a71a8 req-0a58348f-afe9-405b-8b8e-aefc26491047 service nova] [instance: fd9d52bb-6248-48e6-a798-6dbdaaa68cbc] Received event network-vif-unplugged-f6892701-aba2-4c9a-88bd-996d00963301 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:41:50 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-857ff92b-8ae6-48dc-8ed2-3f712f5a71a8 req-0a58348f-afe9-405b-8b8e-aefc26491047 service nova] Acquiring lock "fd9d52bb-6248-48e6-a798-6dbdaaa68cbc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:41:50 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-857ff92b-8ae6-48dc-8ed2-3f712f5a71a8 req-0a58348f-afe9-405b-8b8e-aefc26491047 service nova] Lock "fd9d52bb-6248-48e6-a798-6dbdaaa68cbc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:41:50 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-857ff92b-8ae6-48dc-8ed2-3f712f5a71a8 req-0a58348f-afe9-405b-8b8e-aefc26491047 service nova] Lock "fd9d52bb-6248-48e6-a798-6dbdaaa68cbc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:41:50 user nova-compute[75122]: DEBUG nova.compute.manager [req-857ff92b-8ae6-48dc-8ed2-3f712f5a71a8 req-0a58348f-afe9-405b-8b8e-aefc26491047 service nova] [instance: fd9d52bb-6248-48e6-a798-6dbdaaa68cbc] No waiting events found dispatching network-vif-unplugged-f6892701-aba2-4c9a-88bd-996d00963301 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:41:50 user nova-compute[75122]: WARNING nova.compute.manager [req-857ff92b-8ae6-48dc-8ed2-3f712f5a71a8 req-0a58348f-afe9-405b-8b8e-aefc26491047 service nova] [instance: fd9d52bb-6248-48e6-a798-6dbdaaa68cbc] Received unexpected event network-vif-unplugged-f6892701-aba2-4c9a-88bd-996d00963301 for instance with vm_state rescued and task_state unrescuing.
Nov 15 09:41:50 user nova-compute[75122]: DEBUG nova.compute.manager [req-3811b3f4-c051-45ed-aec0-060b4595098a req-9d440fcd-f033-41a7-afc0-1b6c8b6814ce service nova] [instance: e1afe5d4-42c0-491c-b1c7-c8debf1d5da2] Received event network-changed-f2eacefa-263d-4e6f-af4e-3ab293748b4a {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:41:50 user nova-compute[75122]: DEBUG nova.compute.manager [req-3811b3f4-c051-45ed-aec0-060b4595098a req-9d440fcd-f033-41a7-afc0-1b6c8b6814ce service nova] [instance: e1afe5d4-42c0-491c-b1c7-c8debf1d5da2] Refreshing instance network info cache due to event network-changed-f2eacefa-263d-4e6f-af4e-3ab293748b4a. {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 09:41:50 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-3811b3f4-c051-45ed-aec0-060b4595098a req-9d440fcd-f033-41a7-afc0-1b6c8b6814ce service nova] Acquiring lock "refresh_cache-e1afe5d4-42c0-491c-b1c7-c8debf1d5da2" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 09:41:50 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-3811b3f4-c051-45ed-aec0-060b4595098a req-9d440fcd-f033-41a7-afc0-1b6c8b6814ce service nova] Acquired lock "refresh_cache-e1afe5d4-42c0-491c-b1c7-c8debf1d5da2" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 09:41:50 user nova-compute[75122]: DEBUG nova.network.neutron [req-3811b3f4-c051-45ed-aec0-060b4595098a req-9d440fcd-f033-41a7-afc0-1b6c8b6814ce service nova] [instance: e1afe5d4-42c0-491c-b1c7-c8debf1d5da2] Refreshing network info cache for port f2eacefa-263d-4e6f-af4e-3ab293748b4a {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 09:41:50 user nova-compute[75122]: INFO nova.virt.libvirt.driver [-] [instance: fd9d52bb-6248-48e6-a798-6dbdaaa68cbc] Instance destroyed successfully.
Nov 15 09:41:50 user nova-compute[75122]: DEBUG nova.network.neutron [req-3811b3f4-c051-45ed-aec0-060b4595098a req-9d440fcd-f033-41a7-afc0-1b6c8b6814ce service nova] [instance: e1afe5d4-42c0-491c-b1c7-c8debf1d5da2] Updated VIF entry in instance network info cache for port f2eacefa-263d-4e6f-af4e-3ab293748b4a. {{(pid=75122) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 09:41:50 user nova-compute[75122]: DEBUG nova.network.neutron [req-3811b3f4-c051-45ed-aec0-060b4595098a req-9d440fcd-f033-41a7-afc0-1b6c8b6814ce service nova] [instance: e1afe5d4-42c0-491c-b1c7-c8debf1d5da2] Updating instance_info_cache with network_info: [{"id": "f2eacefa-263d-4e6f-af4e-3ab293748b4a", "address": "fa:16:3e:f7:23:f8", "network": {"id": "0b825d42-d480-4526-a659-e1a5c5fbb53c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1640851308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21d2b24ce1a3452fa6bba669f64ffaba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2eacefa-26", "ovs_interfaceid": "f2eacefa-263d-4e6f-af4e-3ab293748b4a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:41:50 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-3811b3f4-c051-45ed-aec0-060b4595098a req-9d440fcd-f033-41a7-afc0-1b6c8b6814ce service nova] Releasing lock "refresh_cache-e1afe5d4-42c0-491c-b1c7-c8debf1d5da2" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 09:41:50 user nova-compute[75122]: INFO nova.compute.manager [None req-8f0430ef-9426-44db-87f1-e7cd78a5967d tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] [instance: e1afe5d4-42c0-491c-b1c7-c8debf1d5da2] Rebuilding instance
Nov 15 09:41:51 user nova-compute[75122]: DEBUG nova.compute.manager [None req-8f0430ef-9426-44db-87f1-e7cd78a5967d tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] [instance: e1afe5d4-42c0-491c-b1c7-c8debf1d5da2] Checking state {{(pid=75122) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 09:41:51 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:41:51 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:41:51 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:41:51 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:41:51 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:41:51 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:41:51 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:41:52 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:41:52 user nova-compute[75122]: DEBUG nova.compute.manager [req-a1e78a6e-c9bd-41a6-ac00-e0f1b19f326b req-d5cd8d9b-a9b4-4a3f-bab9-c160db9eca1c service nova] [instance: fd9d52bb-6248-48e6-a798-6dbdaaa68cbc] Received event network-vif-plugged-f6892701-aba2-4c9a-88bd-996d00963301 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:41:52 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-a1e78a6e-c9bd-41a6-ac00-e0f1b19f326b req-d5cd8d9b-a9b4-4a3f-bab9-c160db9eca1c service nova] Acquiring lock "fd9d52bb-6248-48e6-a798-6dbdaaa68cbc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:41:52 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-a1e78a6e-c9bd-41a6-ac00-e0f1b19f326b req-d5cd8d9b-a9b4-4a3f-bab9-c160db9eca1c service nova] Lock "fd9d52bb-6248-48e6-a798-6dbdaaa68cbc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:41:52 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-a1e78a6e-c9bd-41a6-ac00-e0f1b19f326b req-d5cd8d9b-a9b4-4a3f-bab9-c160db9eca1c service nova] Lock "fd9d52bb-6248-48e6-a798-6dbdaaa68cbc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:41:52 user nova-compute[75122]: DEBUG nova.compute.manager [req-a1e78a6e-c9bd-41a6-ac00-e0f1b19f326b req-d5cd8d9b-a9b4-4a3f-bab9-c160db9eca1c service nova] [instance: fd9d52bb-6248-48e6-a798-6dbdaaa68cbc] No waiting events found dispatching network-vif-plugged-f6892701-aba2-4c9a-88bd-996d00963301 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:41:52 user nova-compute[75122]: WARNING nova.compute.manager [req-a1e78a6e-c9bd-41a6-ac00-e0f1b19f326b req-d5cd8d9b-a9b4-4a3f-bab9-c160db9eca1c service nova] [instance: fd9d52bb-6248-48e6-a798-6dbdaaa68cbc] Received unexpected event network-vif-plugged-f6892701-aba2-4c9a-88bd-996d00963301 for instance with vm_state rescued and task_state unrescuing.
Nov 15 09:41:52 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:41:52 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:41:52 user nova-compute[75122]: DEBUG nova.compute.manager [req-fc2c64a9-5539-4065-acd9-4c8ad1ec9b23 req-578ed97c-4c7a-4c67-8fff-3e9371c1d9a4 service nova] [instance: e1afe5d4-42c0-491c-b1c7-c8debf1d5da2] Received event network-vif-unplugged-f2eacefa-263d-4e6f-af4e-3ab293748b4a {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:41:52 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-fc2c64a9-5539-4065-acd9-4c8ad1ec9b23 req-578ed97c-4c7a-4c67-8fff-3e9371c1d9a4 service nova] Acquiring lock "e1afe5d4-42c0-491c-b1c7-c8debf1d5da2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:41:52 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-fc2c64a9-5539-4065-acd9-4c8ad1ec9b23 req-578ed97c-4c7a-4c67-8fff-3e9371c1d9a4 service nova] Lock "e1afe5d4-42c0-491c-b1c7-c8debf1d5da2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:41:52 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-fc2c64a9-5539-4065-acd9-4c8ad1ec9b23 req-578ed97c-4c7a-4c67-8fff-3e9371c1d9a4 service nova] Lock "e1afe5d4-42c0-491c-b1c7-c8debf1d5da2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:41:52 user nova-compute[75122]: DEBUG nova.compute.manager [req-fc2c64a9-5539-4065-acd9-4c8ad1ec9b23 req-578ed97c-4c7a-4c67-8fff-3e9371c1d9a4 service nova] [instance: e1afe5d4-42c0-491c-b1c7-c8debf1d5da2] No waiting events found dispatching network-vif-unplugged-f2eacefa-263d-4e6f-af4e-3ab293748b4a {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:41:52 user nova-compute[75122]: WARNING nova.compute.manager [req-fc2c64a9-5539-4065-acd9-4c8ad1ec9b23 req-578ed97c-4c7a-4c67-8fff-3e9371c1d9a4 service nova] [instance: e1afe5d4-42c0-491c-b1c7-c8debf1d5da2] Received unexpected event network-vif-unplugged-f2eacefa-263d-4e6f-af4e-3ab293748b4a for instance with vm_state active and task_state rebuilding.
Nov 15 09:41:52 user nova-compute[75122]: DEBUG nova.compute.manager [req-fc2c64a9-5539-4065-acd9-4c8ad1ec9b23 req-578ed97c-4c7a-4c67-8fff-3e9371c1d9a4 service nova] [instance: e1afe5d4-42c0-491c-b1c7-c8debf1d5da2] Received event network-vif-plugged-f2eacefa-263d-4e6f-af4e-3ab293748b4a {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:41:52 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-fc2c64a9-5539-4065-acd9-4c8ad1ec9b23 req-578ed97c-4c7a-4c67-8fff-3e9371c1d9a4 service nova] Acquiring lock "e1afe5d4-42c0-491c-b1c7-c8debf1d5da2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:41:52 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-fc2c64a9-5539-4065-acd9-4c8ad1ec9b23 req-578ed97c-4c7a-4c67-8fff-3e9371c1d9a4 service nova] Lock "e1afe5d4-42c0-491c-b1c7-c8debf1d5da2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:41:52 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-fc2c64a9-5539-4065-acd9-4c8ad1ec9b23 req-578ed97c-4c7a-4c67-8fff-3e9371c1d9a4 service nova] Lock "e1afe5d4-42c0-491c-b1c7-c8debf1d5da2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:41:52 user nova-compute[75122]: DEBUG nova.compute.manager [req-fc2c64a9-5539-4065-acd9-4c8ad1ec9b23 req-578ed97c-4c7a-4c67-8fff-3e9371c1d9a4 service nova] [instance: e1afe5d4-42c0-491c-b1c7-c8debf1d5da2] No waiting events found dispatching network-vif-plugged-f2eacefa-263d-4e6f-af4e-3ab293748b4a {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:41:52 user nova-compute[75122]: WARNING nova.compute.manager [req-fc2c64a9-5539-4065-acd9-4c8ad1ec9b23 req-578ed97c-4c7a-4c67-8fff-3e9371c1d9a4 service nova] [instance: e1afe5d4-42c0-491c-b1c7-c8debf1d5da2] Received unexpected event network-vif-plugged-f2eacefa-263d-4e6f-af4e-3ab293748b4a for instance with vm_state active and task_state rebuilding.
Nov 15 09:41:52 user nova-compute[75122]: INFO nova.virt.libvirt.driver [-] [instance: e1afe5d4-42c0-491c-b1c7-c8debf1d5da2] Instance destroyed successfully.
Nov 15 09:41:52 user nova-compute[75122]: INFO nova.virt.libvirt.driver [-] [instance: e1afe5d4-42c0-491c-b1c7-c8debf1d5da2] Instance destroyed successfully.
Nov 15 09:41:52 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-8f0430ef-9426-44db-87f1-e7cd78a5967d tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T09:39:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-859857655',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1427271580',id=24,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKavn69DT/YiudqeLC0nG3DEUybkU33QtIjB7fX4OdJJmMo+mhmiPQjcJANuymlxpfxTBdycCs8+kgmwpZOBnByAe9gcjy/ud1YUrlRdkVYRnoGUJsx71JcToY7Fz/5kxA==',key_name='tempest-keypair-171606846',keypairs=<?>,launch_index=0,launched_at=2023-11-15T09:40:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='21d2b24ce1a3452fa6bba669f64ffaba',ramdisk_id='',reservation_id='r-j9e29adc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-380486035',owner_user_name='tempest-ServerActionsV293TestJSON-380486035-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T09:41:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='35c1bd52106641e081d67e05532fbec3',uuid=e1afe5d4-42c0-491c-b1c7-c8debf1d5da2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f2eacefa-263d-4e6f-af4e-3ab293748b4a", "address": "fa:16:3e:f7:23:f8", "network": {"id": "0b825d42-d480-4526-a659-e1a5c5fbb53c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1640851308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21d2b24ce1a3452fa6bba669f64ffaba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2eacefa-26", "ovs_interfaceid": "f2eacefa-263d-4e6f-af4e-3ab293748b4a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 09:41:52 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-8f0430ef-9426-44db-87f1-e7cd78a5967d tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] Converting VIF {"id": "f2eacefa-263d-4e6f-af4e-3ab293748b4a", "address": "fa:16:3e:f7:23:f8", "network": {"id": "0b825d42-d480-4526-a659-e1a5c5fbb53c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1640851308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21d2b24ce1a3452fa6bba669f64ffaba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2eacefa-26", "ovs_interfaceid": "f2eacefa-263d-4e6f-af4e-3ab293748b4a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 09:41:52 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-8f0430ef-9426-44db-87f1-e7cd78a5967d tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f7:23:f8,bridge_name='br-int',has_traffic_filtering=True,id=f2eacefa-263d-4e6f-af4e-3ab293748b4a,network=Network(0b825d42-d480-4526-a659-e1a5c5fbb53c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2eacefa-26') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 09:41:52 user nova-compute[75122]: DEBUG os_vif [None req-8f0430ef-9426-44db-87f1-e7cd78a5967d tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f7:23:f8,bridge_name='br-int',has_traffic_filtering=True,id=f2eacefa-263d-4e6f-af4e-3ab293748b4a,network=Network(0b825d42-d480-4526-a659-e1a5c5fbb53c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2eacefa-26') {{(pid=75122) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 09:41:52 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:41:52 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf2eacefa-26, bridge=br-int, if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:41:52 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:41:52 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:41:52 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:41:52 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=205d8d40-ff70-4593-b279-d652e2b5070e) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:41:52 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:41:52 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:41:52 user nova-compute[75122]: INFO os_vif [None req-8f0430ef-9426-44db-87f1-e7cd78a5967d tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f7:23:f8,bridge_name='br-int',has_traffic_filtering=True,id=f2eacefa-263d-4e6f-af4e-3ab293748b4a,network=Network(0b825d42-d480-4526-a659-e1a5c5fbb53c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2eacefa-26')
Nov 15 09:41:52 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8f0430ef-9426-44db-87f1-e7cd78a5967d tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] [instance: e1afe5d4-42c0-491c-b1c7-c8debf1d5da2] calling os-brick to detach iSCSI Volume {{(pid=75122) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 09:41:52 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f0430ef-9426-44db-87f1-e7cd78a5967d tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffa04060b80>, {'target_iqn': 'iqn.2010-10.org.openstack:395810b1-e3c3-4660-aaaf-b6d9e7cb5a88', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cRPqjENp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 09:41:52 user nova-compute[75122]: WARNING os_brick.initiator.connectors.base [None req-8f0430ef-9426-44db-87f1-e7cd78a5967d tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 15 09:41:52 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-8f0430ef-9426-44db-87f1-e7cd78a5967d tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 09:41:52 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-8f0430ef-9426-44db-87f1-e7cd78a5967d tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 09:41:52 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:41:52 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:41:52 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[cca643cf-6cc4-4bb4-b785-72eaf24cf334]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:395810b1-e3c3-4660-aaaf-b6d9e7cb5a88\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fdf09a1b-a065-4b88-815d-ee54c1c68464\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:41:52 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f0430ef-9426-44db-87f1-e7cd78a5967d tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 09:41:52 user nova-compute[75122]: No targets found.
Nov 15 09:41:52 user nova-compute[75122]: iSNS:
Nov 15 09:41:52 user nova-compute[75122]: No targets found.
Nov 15 09:41:52 user nova-compute[75122]: STATIC:
Nov 15 09:41:52 user nova-compute[75122]: Target: iqn.2010-10.org.openstack:395810b1-e3c3-4660-aaaf-b6d9e7cb5a88
Nov 15 09:41:52 user nova-compute[75122]:         Portal: 172.16.0.220:3260,-1
Nov 15 09:41:52 user nova-compute[75122]:                 Iface Name: default
Nov 15 09:41:52 user nova-compute[75122]: Target: iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17
Nov 15 09:41:52 user nova-compute[75122]:         Portal: 172.16.0.220:3260,-1
Nov 15 09:41:52 user nova-compute[75122]:                 Iface Name: default
Nov 15 09:41:52 user nova-compute[75122]: Target: iqn.2010-10.org.openstack:fdf09a1b-a065-4b88-815d-ee54c1c68464
Nov 15 09:41:52 user nova-compute[75122]:         Portal: 172.16.0.220:3260,-1
Nov 15 09:41:52 user nova-compute[75122]:                 Iface Name: default
Nov 15 09:41:52 user nova-compute[75122]: FIRMWARE:
Nov 15 09:41:52 user nova-compute[75122]: No targets found.
Nov 15 09:41:52 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 09:41:52 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f0430ef-9426-44db-87f1-e7cd78a5967d tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 09:41:52 user nova-compute[75122]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 09:41:52 user nova-compute[75122]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75122) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 09:41:52 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f0430ef-9426-44db-87f1-e7cd78a5967d tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:395810b1-e3c3-4660-aaaf-b6d9e7cb5a88', 0)] {{(pid=75122) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 09:41:52 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:41:52 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:41:52 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[263093ae-73c5-461f-9973-530a350e844b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:395810b1-e3c3-4660-aaaf-b6d9e7cb5a88\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fdf09a1b-a065-4b88-815d-ee54c1c68464\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:41:52 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:41:52 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:41:52 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c3504c1-007a-4adc-af7c-0cbcb93db6d3]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdf09a1b-a065-4b88-815d-ee54c1c68464 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:395810b1-e3c3-4660-aaaf-b6d9e7cb5a88 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17 (non-flash)\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:41:52 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f0430ef-9426-44db-87f1-e7cd78a5967d tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdf09a1b-a065-4b88-815d-ee54c1c68464 (non-flash)
Nov 15 09:41:52 user nova-compute[75122]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:395810b1-e3c3-4660-aaaf-b6d9e7cb5a88 (non-flash)
Nov 15 09:41:52 user nova-compute[75122]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17 (non-flash)
Nov 15 09:41:52 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 09:41:52 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f0430ef-9426-44db-87f1-e7cd78a5967d tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdf09a1b-a065-4b88-815d-ee54c1c68464 (non-flash)
Nov 15 09:41:52 user nova-compute[75122]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:395810b1-e3c3-4660-aaaf-b6d9e7cb5a88 (non-flash)
Nov 15 09:41:52 user nova-compute[75122]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17 (non-flash)
Nov 15 09:41:52 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 09:41:52 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f0430ef-9426-44db-87f1-e7cd78a5967d tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff9e43336d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:395810b1-e3c3-4660-aaaf-b6d9e7cb5a88'): ({'sde'}, set())}) {{(pid=75122) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 09:41:52 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-8f0430ef-9426-44db-87f1-e7cd78a5967d tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] Removing single pathed devices sde {{(pid=75122) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 09:41:52 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:41:52 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:41:52 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aa254e4-129d-4c8a-94c1-3c30270beaa7]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:41:52 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:41:52 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.025s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:41:52 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[9856e2ac-9da9-447f-a2fa-83161324eda2]: (4, ('ok\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:41:52 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-8f0430ef-9426-44db-87f1-e7cd78a5967d tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] Flushing IO for device /dev/sde {{(pid=75122) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 09:41:52 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:41:52 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.019s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:41:52 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8134555-b2e8-4e18-9d9d-b524f58b8cc2]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:41:52 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-8f0430ef-9426-44db-87f1-e7cd78a5967d tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75122) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 09:41:52 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:41:52 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.049s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:41:52 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b833e22-7776-4f53-95a7-71ea0a410e35]: (4, ('1', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:41:52 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-8f0430ef-9426-44db-87f1-e7cd78a5967d tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75122) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 09:41:52 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-8f0430ef-9426-44db-87f1-e7cd78a5967d tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] SCSI volumes sde have been removed. {{(pid=75122) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 09:41:52 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f0430ef-9426-44db-87f1-e7cd78a5967d tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:395810b1-e3c3-4660-aaaf-b6d9e7cb5a88')] {{(pid=75122) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 09:41:52 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:395810b1-e3c3-4660-aaaf-b6d9e7cb5a88 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:41:52 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:395810b1-e3c3-4660-aaaf-b6d9e7cb5a88 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:41:52 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a4ab96c-a3f1-4bc9-aaf4-e48540f04c0a]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:41:52 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f0430ef-9426-44db-87f1-e7cd78a5967d tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:41:52 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:395810b1-e3c3-4660-aaaf-b6d9e7cb5a88 -p 172.16.0.220:3260 --logout {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:41:53 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:395810b1-e3c3-4660-aaaf-b6d9e7cb5a88 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:41:53 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b2581cb-0556-426a-a4a8-4a31b6be41c6]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:395810b1-e3c3-4660-aaaf-b6d9e7cb5a88, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:395810b1-e3c3-4660-aaaf-b6d9e7cb5a88, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:41:53 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f0430ef-9426-44db-87f1-e7cd78a5967d tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:395810b1-e3c3-4660-aaaf-b6d9e7cb5a88, portal: 172.16.0.220,3260]
Nov 15 09:41:53 user nova-compute[75122]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:395810b1-e3c3-4660-aaaf-b6d9e7cb5a88, portal: 172.16.0.220,3260] successful.
Nov 15 09:41:53 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:41:53 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:395810b1-e3c3-4660-aaaf-b6d9e7cb5a88 -p 172.16.0.220:3260 --op delete {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:41:53 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:395810b1-e3c3-4660-aaaf-b6d9e7cb5a88 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:41:53 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[33527bc9-31e1-441f-86a6-085abbc5fdd7]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:41:53 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f0430ef-9426-44db-87f1-e7cd78a5967d tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:41:53 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-8f0430ef-9426-44db-87f1-e7cd78a5967d tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.338s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 09:41:53 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f0430ef-9426-44db-87f1-e7cd78a5967d tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] <== disconnect_volume: return (340ms) None {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 09:41:53 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8f0430ef-9426-44db-87f1-e7cd78a5967d tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] [instance: e1afe5d4-42c0-491c-b1c7-c8debf1d5da2] Disconnected iSCSI Volume {{(pid=75122) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 09:41:53 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-8f0430ef-9426-44db-87f1-e7cd78a5967d tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] [instance: e1afe5d4-42c0-491c-b1c7-c8debf1d5da2] Deleting instance files /opt/stack/data/nova/instances/e1afe5d4-42c0-491c-b1c7-c8debf1d5da2_del
Nov 15 09:41:53 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-8f0430ef-9426-44db-87f1-e7cd78a5967d tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] [instance: e1afe5d4-42c0-491c-b1c7-c8debf1d5da2] Deletion of /opt/stack/data/nova/instances/e1afe5d4-42c0-491c-b1c7-c8debf1d5da2_del complete
Nov 15 09:41:53 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-8f0430ef-9426-44db-87f1-e7cd78a5967d tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] [instance: e1afe5d4-42c0-491c-b1c7-c8debf1d5da2] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance e1afe5d4-42c0-491c-b1c7-c8debf1d5da2 could not be found.
Nov 15 09:41:53 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8f0430ef-9426-44db-87f1-e7cd78a5967d tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] [instance: e1afe5d4-42c0-491c-b1c7-c8debf1d5da2] calling os-brick to detach iSCSI Volume {{(pid=75122) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 09:41:53 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f0430ef-9426-44db-87f1-e7cd78a5967d tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffa04060b80>, {'target_iqn': 'iqn.2010-10.org.openstack:395810b1-e3c3-4660-aaaf-b6d9e7cb5a88', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cRPqjENp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 09:41:53 user nova-compute[75122]: WARNING os_brick.initiator.connectors.base [None req-8f0430ef-9426-44db-87f1-e7cd78a5967d tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 15 09:41:53 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-8f0430ef-9426-44db-87f1-e7cd78a5967d tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 09:41:53 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-8f0430ef-9426-44db-87f1-e7cd78a5967d tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 09:41:53 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:41:53 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:41:53 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[d51f5ac6-25b0-4bfe-9759-17d54c11ef93]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fdf09a1b-a065-4b88-815d-ee54c1c68464\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:41:53 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f0430ef-9426-44db-87f1-e7cd78a5967d tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 09:41:53 user nova-compute[75122]: No targets found.
Nov 15 09:41:53 user nova-compute[75122]: iSNS:
Nov 15 09:41:53 user nova-compute[75122]: No targets found.
Nov 15 09:41:53 user nova-compute[75122]: STATIC:
Nov 15 09:41:53 user nova-compute[75122]: Target: iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17
Nov 15 09:41:53 user nova-compute[75122]:         Portal: 172.16.0.220:3260,-1
Nov 15 09:41:53 user nova-compute[75122]:                 Iface Name: default
Nov 15 09:41:53 user nova-compute[75122]: Target: iqn.2010-10.org.openstack:fdf09a1b-a065-4b88-815d-ee54c1c68464
Nov 15 09:41:53 user nova-compute[75122]:         Portal: 172.16.0.220:3260,-1
Nov 15 09:41:53 user nova-compute[75122]:                 Iface Name: default
Nov 15 09:41:53 user nova-compute[75122]: FIRMWARE:
Nov 15 09:41:53 user nova-compute[75122]: No targets found.
Nov 15 09:41:53 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 09:41:53 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f0430ef-9426-44db-87f1-e7cd78a5967d tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 09:41:53 user nova-compute[75122]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 09:41:53 user nova-compute[75122]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75122) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 09:41:53 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f0430ef-9426-44db-87f1-e7cd78a5967d tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:395810b1-e3c3-4660-aaaf-b6d9e7cb5a88', 0)] {{(pid=75122) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 09:41:53 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:41:53 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:41:53 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[de3e76b7-5370-4689-b5d2-932e751d8c79]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fdf09a1b-a065-4b88-815d-ee54c1c68464\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:41:53 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:41:53 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:41:53 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5de5192-cd72-4ab2-a835-d3d8e940b45a]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdf09a1b-a065-4b88-815d-ee54c1c68464 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17 (non-flash)\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:41:53 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f0430ef-9426-44db-87f1-e7cd78a5967d tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdf09a1b-a065-4b88-815d-ee54c1c68464 (non-flash)
Nov 15 09:41:53 user nova-compute[75122]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17 (non-flash)
Nov 15 09:41:53 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 09:41:53 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f0430ef-9426-44db-87f1-e7cd78a5967d tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdf09a1b-a065-4b88-815d-ee54c1c68464 (non-flash)
Nov 15 09:41:53 user nova-compute[75122]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17 (non-flash)
Nov 15 09:41:53 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 09:41:53 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f0430ef-9426-44db-87f1-e7cd78a5967d tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff9e45a1480>, {}) {{(pid=75122) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 09:41:53 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f0430ef-9426-44db-87f1-e7cd78a5967d tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] Disconnecting from: [] {{(pid=75122) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 09:41:53 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-8f0430ef-9426-44db-87f1-e7cd78a5967d tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.080s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 09:41:53 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f0430ef-9426-44db-87f1-e7cd78a5967d tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] <== disconnect_volume: return (82ms) None {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 09:41:53 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8f0430ef-9426-44db-87f1-e7cd78a5967d tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] [instance: e1afe5d4-42c0-491c-b1c7-c8debf1d5da2] Disconnected iSCSI Volume {{(pid=75122) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 09:41:54 user nova-compute[75122]: DEBUG nova.compute.manager [req-f151daa0-ee77-4ee6-8b69-fb07793e96a6 req-bab8003b-6bf9-449f-af45-a7733c003d7e service nova] [instance: fd9d52bb-6248-48e6-a798-6dbdaaa68cbc] Received event network-vif-plugged-f6892701-aba2-4c9a-88bd-996d00963301 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:41:54 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-f151daa0-ee77-4ee6-8b69-fb07793e96a6 req-bab8003b-6bf9-449f-af45-a7733c003d7e service nova] Acquiring lock "fd9d52bb-6248-48e6-a798-6dbdaaa68cbc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:41:54 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-f151daa0-ee77-4ee6-8b69-fb07793e96a6 req-bab8003b-6bf9-449f-af45-a7733c003d7e service nova] Lock "fd9d52bb-6248-48e6-a798-6dbdaaa68cbc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:41:54 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-f151daa0-ee77-4ee6-8b69-fb07793e96a6 req-bab8003b-6bf9-449f-af45-a7733c003d7e service nova] Lock "fd9d52bb-6248-48e6-a798-6dbdaaa68cbc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:41:54 user nova-compute[75122]: DEBUG nova.compute.manager [req-f151daa0-ee77-4ee6-8b69-fb07793e96a6 req-bab8003b-6bf9-449f-af45-a7733c003d7e service nova] [instance: fd9d52bb-6248-48e6-a798-6dbdaaa68cbc] No waiting events found dispatching network-vif-plugged-f6892701-aba2-4c9a-88bd-996d00963301 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:41:54 user nova-compute[75122]: WARNING nova.compute.manager [req-f151daa0-ee77-4ee6-8b69-fb07793e96a6 req-bab8003b-6bf9-449f-af45-a7733c003d7e service nova] [instance: fd9d52bb-6248-48e6-a798-6dbdaaa68cbc] Received unexpected event network-vif-plugged-f6892701-aba2-4c9a-88bd-996d00963301 for instance with vm_state rescued and task_state unrescuing.
Nov 15 09:41:54 user nova-compute[75122]: DEBUG nova.compute.manager [req-f151daa0-ee77-4ee6-8b69-fb07793e96a6 req-bab8003b-6bf9-449f-af45-a7733c003d7e service nova] [instance: fd9d52bb-6248-48e6-a798-6dbdaaa68cbc] Received event network-vif-plugged-f6892701-aba2-4c9a-88bd-996d00963301 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:41:54 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-f151daa0-ee77-4ee6-8b69-fb07793e96a6 req-bab8003b-6bf9-449f-af45-a7733c003d7e service nova] Acquiring lock "fd9d52bb-6248-48e6-a798-6dbdaaa68cbc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:41:54 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-f151daa0-ee77-4ee6-8b69-fb07793e96a6 req-bab8003b-6bf9-449f-af45-a7733c003d7e service nova] Lock "fd9d52bb-6248-48e6-a798-6dbdaaa68cbc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:41:54 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-f151daa0-ee77-4ee6-8b69-fb07793e96a6 req-bab8003b-6bf9-449f-af45-a7733c003d7e service nova] Lock "fd9d52bb-6248-48e6-a798-6dbdaaa68cbc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:41:54 user nova-compute[75122]: DEBUG nova.compute.manager [req-f151daa0-ee77-4ee6-8b69-fb07793e96a6 req-bab8003b-6bf9-449f-af45-a7733c003d7e service nova] [instance: fd9d52bb-6248-48e6-a798-6dbdaaa68cbc] No waiting events found dispatching network-vif-plugged-f6892701-aba2-4c9a-88bd-996d00963301 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:41:54 user nova-compute[75122]: WARNING nova.compute.manager [req-f151daa0-ee77-4ee6-8b69-fb07793e96a6 req-bab8003b-6bf9-449f-af45-a7733c003d7e service nova] [instance: fd9d52bb-6248-48e6-a798-6dbdaaa68cbc] Received unexpected event network-vif-plugged-f6892701-aba2-4c9a-88bd-996d00963301 for instance with vm_state rescued and task_state unrescuing.
Nov 15 09:41:54 user nova-compute[75122]: DEBUG nova.compute.manager [None req-8f0430ef-9426-44db-87f1-e7cd78a5967d tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] [instance: e1afe5d4-42c0-491c-b1c7-c8debf1d5da2] Preparing to wait for external event volume-reimaged-395810b1-e3c3-4660-aaaf-b6d9e7cb5a88 {{(pid=75122) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Nov 15 09:41:54 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-8f0430ef-9426-44db-87f1-e7cd78a5967d tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] Acquiring lock "e1afe5d4-42c0-491c-b1c7-c8debf1d5da2-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:41:54 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-8f0430ef-9426-44db-87f1-e7cd78a5967d tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] Lock "e1afe5d4-42c0-491c-b1c7-c8debf1d5da2-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:41:54 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-8f0430ef-9426-44db-87f1-e7cd78a5967d tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] Lock "e1afe5d4-42c0-491c-b1c7-c8debf1d5da2-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:41:54 user nova-compute[75122]: DEBUG nova.compute.manager [None req-e121a256-0c8f-40f2-ba9f-f7f0adc6b6fd tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] [instance: fd9d52bb-6248-48e6-a798-6dbdaaa68cbc] Checking state {{(pid=75122) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 09:41:56 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:41:57 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:42:01 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:42:02 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:42:03 user nova-compute[75122]: DEBUG nova.compute.manager [req-e19c17e9-57b1-4ec7-aa3b-312c97e05120 req-38e4d6c8-d1c9-4b46-ad2c-96f4e124d56e service nova] [instance: e815e0b5-e9c8-4ebb-aa85-b79b180595df] Received event network-changed-2ec5e226-5264-46e3-980b-48ab765ecb54 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:42:03 user nova-compute[75122]: DEBUG nova.compute.manager [req-e19c17e9-57b1-4ec7-aa3b-312c97e05120 req-38e4d6c8-d1c9-4b46-ad2c-96f4e124d56e service nova] [instance: e815e0b5-e9c8-4ebb-aa85-b79b180595df] Refreshing instance network info cache due to event network-changed-2ec5e226-5264-46e3-980b-48ab765ecb54. {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 09:42:03 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-e19c17e9-57b1-4ec7-aa3b-312c97e05120 req-38e4d6c8-d1c9-4b46-ad2c-96f4e124d56e service nova] Acquiring lock "refresh_cache-e815e0b5-e9c8-4ebb-aa85-b79b180595df" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 09:42:03 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-e19c17e9-57b1-4ec7-aa3b-312c97e05120 req-38e4d6c8-d1c9-4b46-ad2c-96f4e124d56e service nova] Acquired lock "refresh_cache-e815e0b5-e9c8-4ebb-aa85-b79b180595df" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 09:42:03 user nova-compute[75122]: DEBUG nova.network.neutron [req-e19c17e9-57b1-4ec7-aa3b-312c97e05120 req-38e4d6c8-d1c9-4b46-ad2c-96f4e124d56e service nova] [instance: e815e0b5-e9c8-4ebb-aa85-b79b180595df] Refreshing network info cache for port 2ec5e226-5264-46e3-980b-48ab765ecb54 {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 09:42:04 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0556c008-9552-4e2d-be7b-7d1a23255181 tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Acquiring lock "e815e0b5-e9c8-4ebb-aa85-b79b180595df" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:42:04 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0556c008-9552-4e2d-be7b-7d1a23255181 tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Lock "e815e0b5-e9c8-4ebb-aa85-b79b180595df" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:42:04 user nova-compute[75122]: DEBUG nova.objects.instance [None req-0556c008-9552-4e2d-be7b-7d1a23255181 tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Lazy-loading 'flavor' on Instance uuid e815e0b5-e9c8-4ebb-aa85-b79b180595df {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:42:04 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-0556c008-9552-4e2d-be7b-7d1a23255181 tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] [instance: e815e0b5-e9c8-4ebb-aa85-b79b180595df] Ignoring supplied device name: /dev/vdb
Nov 15 09:42:04 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0556c008-9552-4e2d-be7b-7d1a23255181 tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Lock "e815e0b5-e9c8-4ebb-aa85-b79b180595df" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:42:04 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0556c008-9552-4e2d-be7b-7d1a23255181 tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Acquiring lock "e815e0b5-e9c8-4ebb-aa85-b79b180595df" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:42:04 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0556c008-9552-4e2d-be7b-7d1a23255181 tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Lock "e815e0b5-e9c8-4ebb-aa85-b79b180595df" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:42:04 user nova-compute[75122]: INFO nova.compute.manager [None req-0556c008-9552-4e2d-be7b-7d1a23255181 tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] [instance: e815e0b5-e9c8-4ebb-aa85-b79b180595df] Attaching volume 10bad99b-3c27-4b44-bd2f-444e0c0581cb to /dev/vdb
Nov 15 09:42:04 user nova-compute[75122]: DEBUG os_brick.utils [None req-0556c008-9552-4e2d-be7b-7d1a23255181 tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 09:42:04 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:42:04 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:42:04 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[b430d59d-74bf-47e0-b954-ef44422b0876]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:742fb64b3587\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:42:04 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:42:04 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:42:04 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd70a55a-0ba6-4f60-8e18-44bc9b2713e1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:42:04 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:42:04 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:42:04 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9849444-7d4b-4978-89a6-386f8b7aedf3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:42:04 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ed793c9-ef59-4ed2-8088-0a7781ae2432]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:42:04 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0556c008-9552-4e2d-be7b-7d1a23255181 tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Running cmd (subprocess): nvme version {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:42:04 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0556c008-9552-4e2d-be7b-7d1a23255181 tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] 'nvme version' failed. Not Retrying. {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 09:42:04 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0556c008-9552-4e2d-be7b-7d1a23255181 tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] nvme not present on system {{(pid=75122) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 09:42:04 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:42:04 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 09:42:04 user nova-compute[75122]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 09:42:04 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2f86d44-1733-4401-8367-5253e1c19fd1]: (4, '') {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:42:04 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.lightos [None req-0556c008-9552-4e2d-be7b-7d1a23255181 tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75122) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 09:42:04 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.lightos [None req-0556c008-9552-4e2d-be7b-7d1a23255181 tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75122) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 09:42:04 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.lightos [None req-0556c008-9552-4e2d-be7b-7d1a23255181 tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] LIGHTOS: no hostnqn found. {{(pid=75122) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 09:42:04 user nova-compute[75122]: DEBUG os_brick.utils [None req-0556c008-9552-4e2d-be7b-7d1a23255181 tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] <== get_connector_properties: return (153ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:742fb64b3587', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 09:42:04 user nova-compute[75122]: DEBUG nova.virt.block_device [None req-0556c008-9552-4e2d-be7b-7d1a23255181 tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] [instance: e815e0b5-e9c8-4ebb-aa85-b79b180595df] Updating existing volume attachment record: 9d50f438-c541-4e39-b542-8268fb34c414 {{(pid=75122) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 09:42:04 user nova-compute[75122]: DEBUG nova.network.neutron [req-e19c17e9-57b1-4ec7-aa3b-312c97e05120 req-38e4d6c8-d1c9-4b46-ad2c-96f4e124d56e service nova] [instance: e815e0b5-e9c8-4ebb-aa85-b79b180595df] Updated VIF entry in instance network info cache for port 2ec5e226-5264-46e3-980b-48ab765ecb54. {{(pid=75122) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 09:42:04 user nova-compute[75122]: DEBUG nova.network.neutron [req-e19c17e9-57b1-4ec7-aa3b-312c97e05120 req-38e4d6c8-d1c9-4b46-ad2c-96f4e124d56e service nova] [instance: e815e0b5-e9c8-4ebb-aa85-b79b180595df] Updating instance_info_cache with network_info: [{"id": "2ec5e226-5264-46e3-980b-48ab765ecb54", "address": "fa:16:3e:38:e8:08", "network": {"id": "cd74302c-bfd9-495b-887f-0de0d94f4ffc", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-692728798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac8ea42f6a3446e8a8edcf3dcb016b84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ec5e226-52", "ovs_interfaceid": "2ec5e226-5264-46e3-980b-48ab765ecb54", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:42:04 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-e19c17e9-57b1-4ec7-aa3b-312c97e05120 req-38e4d6c8-d1c9-4b46-ad2c-96f4e124d56e service nova] Releasing lock "refresh_cache-e815e0b5-e9c8-4ebb-aa85-b79b180595df" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 09:42:05 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-5861f993-e4d6-440d-9233-aa6b6303a22d tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] Acquiring lock "5b5a4d58-ba1e-473d-a32a-06fae1c84efc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:42:05 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-5861f993-e4d6-440d-9233-aa6b6303a22d tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] Lock "5b5a4d58-ba1e-473d-a32a-06fae1c84efc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.004s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:42:05 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-5861f993-e4d6-440d-9233-aa6b6303a22d tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] Acquiring lock "5b5a4d58-ba1e-473d-a32a-06fae1c84efc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:42:05 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-5861f993-e4d6-440d-9233-aa6b6303a22d tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] Lock "5b5a4d58-ba1e-473d-a32a-06fae1c84efc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:42:05 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-5861f993-e4d6-440d-9233-aa6b6303a22d tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] Lock "5b5a4d58-ba1e-473d-a32a-06fae1c84efc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:42:05 user nova-compute[75122]: INFO nova.compute.manager [None req-5861f993-e4d6-440d-9233-aa6b6303a22d tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] [instance: 5b5a4d58-ba1e-473d-a32a-06fae1c84efc] Terminating instance
Nov 15 09:42:05 user nova-compute[75122]: DEBUG nova.compute.manager [None req-5861f993-e4d6-440d-9233-aa6b6303a22d tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] [instance: 5b5a4d58-ba1e-473d-a32a-06fae1c84efc] Start destroying the instance on the hypervisor. {{(pid=75122) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 09:42:05 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:42:05 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:42:05 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:42:05 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:42:05 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:42:06 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:42:06 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:42:06 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:42:06 user nova-compute[75122]: INFO nova.virt.libvirt.driver [-] [instance: 5b5a4d58-ba1e-473d-a32a-06fae1c84efc] Instance destroyed successfully.
Nov 15 09:42:06 user nova-compute[75122]: DEBUG nova.objects.instance [None req-5861f993-e4d6-440d-9233-aa6b6303a22d tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] Lazy-loading 'resources' on Instance uuid 5b5a4d58-ba1e-473d-a32a-06fae1c84efc {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:42:06 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-5861f993-e4d6-440d-9233-aa6b6303a22d tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T09:34:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-180143653',display_name='tempest-ServerStableDeviceRescueTest-server-180143653',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-180143653',id=14,image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKac38UUwHVGlBpF/6pXojX0cRWwmcLLAWsTVnSZWVmiaULTNSXXsfMP/wFHtldyqrM46US3c5PHqGscE2t9cqcjfXRdmnAO58flpaqENX0njs5rEgrRIIKZ8U9R5OYa5Q==',key_name='tempest-keypair-537753446',keypairs=<?>,launch_index=0,launched_at=2023-11-15T09:38:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6aed61f0071f44ac901b94cd9a4a909d',ramdisk_id='',reservation_id='r-v0tsii3q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-813673110',owner_user_name='tempest-ServerStableDeviceRescueTest-813673110-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T09:40:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2940f4a7d03a4c9b97a832c436ae4b76',uuid=5b5a4d58-ba1e-473d-a32a-06fae1c84efc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b245a5c2-e523-4d4e-a343-f5b2352337ab", "address": "fa:16:3e:cd:ac:71", "network": {"id": "53e8c131-26be-4b3f-beca-dd48fe06ffbe", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-888345656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6aed61f0071f44ac901b94cd9a4a909d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb245a5c2-e5", "ovs_interfaceid": "b245a5c2-e523-4d4e-a343-f5b2352337ab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 09:42:06 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-5861f993-e4d6-440d-9233-aa6b6303a22d tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] Converting VIF {"id": "b245a5c2-e523-4d4e-a343-f5b2352337ab", "address": "fa:16:3e:cd:ac:71", "network": {"id": "53e8c131-26be-4b3f-beca-dd48fe06ffbe", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-888345656-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6aed61f0071f44ac901b94cd9a4a909d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb245a5c2-e5", "ovs_interfaceid": "b245a5c2-e523-4d4e-a343-f5b2352337ab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 09:42:06 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-5861f993-e4d6-440d-9233-aa6b6303a22d tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cd:ac:71,bridge_name='br-int',has_traffic_filtering=True,id=b245a5c2-e523-4d4e-a343-f5b2352337ab,network=Network(53e8c131-26be-4b3f-beca-dd48fe06ffbe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb245a5c2-e5') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 09:42:06 user nova-compute[75122]: DEBUG os_vif [None req-5861f993-e4d6-440d-9233-aa6b6303a22d tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cd:ac:71,bridge_name='br-int',has_traffic_filtering=True,id=b245a5c2-e523-4d4e-a343-f5b2352337ab,network=Network(53e8c131-26be-4b3f-beca-dd48fe06ffbe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb245a5c2-e5') {{(pid=75122) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 09:42:06 user nova-compute[75122]: DEBUG nova.compute.manager [req-c4242dc2-cc32-4e4b-b95c-30001cb8a05b req-50977009-0995-466f-b11b-ed5bd57b8548 service nova] [instance: 5b5a4d58-ba1e-473d-a32a-06fae1c84efc] Received event network-vif-unplugged-b245a5c2-e523-4d4e-a343-f5b2352337ab {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:42:06 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-c4242dc2-cc32-4e4b-b95c-30001cb8a05b req-50977009-0995-466f-b11b-ed5bd57b8548 service nova] Acquiring lock "5b5a4d58-ba1e-473d-a32a-06fae1c84efc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:42:06 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-c4242dc2-cc32-4e4b-b95c-30001cb8a05b req-50977009-0995-466f-b11b-ed5bd57b8548 service nova] Lock "5b5a4d58-ba1e-473d-a32a-06fae1c84efc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.005s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:42:06 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-c4242dc2-cc32-4e4b-b95c-30001cb8a05b req-50977009-0995-466f-b11b-ed5bd57b8548 service nova] Lock "5b5a4d58-ba1e-473d-a32a-06fae1c84efc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:42:06 user nova-compute[75122]: DEBUG nova.compute.manager [req-c4242dc2-cc32-4e4b-b95c-30001cb8a05b req-50977009-0995-466f-b11b-ed5bd57b8548 service nova] [instance: 5b5a4d58-ba1e-473d-a32a-06fae1c84efc] No waiting events found dispatching network-vif-unplugged-b245a5c2-e523-4d4e-a343-f5b2352337ab {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:42:06 user nova-compute[75122]: DEBUG nova.compute.manager [req-c4242dc2-cc32-4e4b-b95c-30001cb8a05b req-50977009-0995-466f-b11b-ed5bd57b8548 service nova] [instance: 5b5a4d58-ba1e-473d-a32a-06fae1c84efc] Received event network-vif-unplugged-b245a5c2-e523-4d4e-a343-f5b2352337ab for instance with task_state deleting. {{(pid=75122) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 09:42:06 user nova-compute[75122]: DEBUG nova.compute.manager [req-c4242dc2-cc32-4e4b-b95c-30001cb8a05b req-50977009-0995-466f-b11b-ed5bd57b8548 service nova] [instance: 5b5a4d58-ba1e-473d-a32a-06fae1c84efc] Received event network-vif-plugged-b245a5c2-e523-4d4e-a343-f5b2352337ab {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:42:06 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-c4242dc2-cc32-4e4b-b95c-30001cb8a05b req-50977009-0995-466f-b11b-ed5bd57b8548 service nova] Acquiring lock "5b5a4d58-ba1e-473d-a32a-06fae1c84efc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:42:06 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-c4242dc2-cc32-4e4b-b95c-30001cb8a05b req-50977009-0995-466f-b11b-ed5bd57b8548 service nova] Lock "5b5a4d58-ba1e-473d-a32a-06fae1c84efc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:42:06 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-c4242dc2-cc32-4e4b-b95c-30001cb8a05b req-50977009-0995-466f-b11b-ed5bd57b8548 service nova] Lock "5b5a4d58-ba1e-473d-a32a-06fae1c84efc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:42:06 user nova-compute[75122]: DEBUG nova.compute.manager [req-c4242dc2-cc32-4e4b-b95c-30001cb8a05b req-50977009-0995-466f-b11b-ed5bd57b8548 service nova] [instance: 5b5a4d58-ba1e-473d-a32a-06fae1c84efc] No waiting events found dispatching network-vif-plugged-b245a5c2-e523-4d4e-a343-f5b2352337ab {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:42:06 user nova-compute[75122]: WARNING nova.compute.manager [req-c4242dc2-cc32-4e4b-b95c-30001cb8a05b req-50977009-0995-466f-b11b-ed5bd57b8548 service nova] [instance: 5b5a4d58-ba1e-473d-a32a-06fae1c84efc] Received unexpected event network-vif-plugged-b245a5c2-e523-4d4e-a343-f5b2352337ab for instance with vm_state active and task_state deleting.
Nov 15 09:42:06 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:42:06 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb245a5c2-e5, bridge=br-int, if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:42:06 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:42:06 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:42:06 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:42:06 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c9443ec0-0c08-4aeb-ab78-d99fd14ab163) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:42:06 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:42:06 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:42:06 user nova-compute[75122]: INFO os_vif [None req-5861f993-e4d6-440d-9233-aa6b6303a22d tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cd:ac:71,bridge_name='br-int',has_traffic_filtering=True,id=b245a5c2-e523-4d4e-a343-f5b2352337ab,network=Network(53e8c131-26be-4b3f-beca-dd48fe06ffbe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb245a5c2-e5')
Nov 15 09:42:06 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-5861f993-e4d6-440d-9233-aa6b6303a22d tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] [instance: 5b5a4d58-ba1e-473d-a32a-06fae1c84efc] Deleting instance files /opt/stack/data/nova/instances/5b5a4d58-ba1e-473d-a32a-06fae1c84efc_del
Nov 15 09:42:06 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-5861f993-e4d6-440d-9233-aa6b6303a22d tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] [instance: 5b5a4d58-ba1e-473d-a32a-06fae1c84efc] Deletion of /opt/stack/data/nova/instances/5b5a4d58-ba1e-473d-a32a-06fae1c84efc_del complete
Nov 15 09:42:06 user nova-compute[75122]: INFO nova.compute.manager [None req-5861f993-e4d6-440d-9233-aa6b6303a22d tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] [instance: 5b5a4d58-ba1e-473d-a32a-06fae1c84efc] Took 1.08 seconds to destroy the instance on the hypervisor.
Nov 15 09:42:06 user nova-compute[75122]: DEBUG oslo.service.loopingcall [None req-5861f993-e4d6-440d-9233-aa6b6303a22d tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75122) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 09:42:06 user nova-compute[75122]: DEBUG nova.compute.manager [-] [instance: 5b5a4d58-ba1e-473d-a32a-06fae1c84efc] Deallocating network for instance {{(pid=75122) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 09:42:06 user nova-compute[75122]: DEBUG nova.network.neutron [-] [instance: 5b5a4d58-ba1e-473d-a32a-06fae1c84efc] deallocate_for_instance() {{(pid=75122) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 09:42:07 user nova-compute[75122]: DEBUG nova.network.neutron [-] [instance: 5b5a4d58-ba1e-473d-a32a-06fae1c84efc] Updating instance_info_cache with network_info: [] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:42:07 user nova-compute[75122]: INFO nova.compute.manager [-] [instance: 5b5a4d58-ba1e-473d-a32a-06fae1c84efc] Took 0.83 seconds to deallocate network for instance.
Nov 15 09:42:07 user nova-compute[75122]: DEBUG nova.compute.manager [req-5ce79a7d-6b33-428f-b79d-2ec79a799c93 req-24b6d78b-af32-42d4-95c7-65068d372f73 service nova] [instance: 5b5a4d58-ba1e-473d-a32a-06fae1c84efc] Received event network-vif-deleted-b245a5c2-e523-4d4e-a343-f5b2352337ab {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:42:07 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-5861f993-e4d6-440d-9233-aa6b6303a22d tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:42:07 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-5861f993-e4d6-440d-9233-aa6b6303a22d tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:42:07 user nova-compute[75122]: DEBUG nova.compute.provider_tree [None req-5861f993-e4d6-440d-9233-aa6b6303a22d tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] Inventory has not changed in ProviderTree for provider: 69a3da65-47be-44c6-b67c-c692b58284ef {{(pid=75122) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 09:42:08 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-5861f993-e4d6-440d-9233-aa6b6303a22d tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] Inventory has not changed for provider 69a3da65-47be-44c6-b67c-c692b58284ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 09:42:08 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-5861f993-e4d6-440d-9233-aa6b6303a22d tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.777s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:42:08 user nova-compute[75122]: INFO nova.scheduler.client.report [None req-5861f993-e4d6-440d-9233-aa6b6303a22d tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] Deleted allocations for instance 5b5a4d58-ba1e-473d-a32a-06fae1c84efc
Nov 15 09:42:08 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-5861f993-e4d6-440d-9233-aa6b6303a22d tempest-ServerStableDeviceRescueTest-813673110 tempest-ServerStableDeviceRescueTest-813673110-project-member] Lock "5b5a4d58-ba1e-473d-a32a-06fae1c84efc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.907s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:42:11 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:42:11 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:42:13 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0556c008-9552-4e2d-be7b-7d1a23255181 tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] [instance: e815e0b5-e9c8-4ebb-aa85-b79b180595df] Calling os-brick to attach iSCSI Volume {{(pid=75122) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 09:42:13 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-0556c008-9552-4e2d-be7b-7d1a23255181 tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffa04060b80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:10bad99b-3c27-4b44-bd2f-444e0c0581cb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XOflmCDG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 09:42:13 user nova-compute[75122]: WARNING os_brick.initiator.connectors.base [None req-0556c008-9552-4e2d-be7b-7d1a23255181 tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 09:42:13 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-0556c008-9552-4e2d-be7b-7d1a23255181 tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 09:42:13 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-0556c008-9552-4e2d-be7b-7d1a23255181 tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 09:42:13 user nova-compute[75122]: WARNING os_brick.initiator.connectors.base [None req-0556c008-9552-4e2d-be7b-7d1a23255181 tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 09:42:13 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-0556c008-9552-4e2d-be7b-7d1a23255181 tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:10bad99b-3c27-4b44-bd2f-444e0c0581cb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 09:42:13 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-0556c008-9552-4e2d-be7b-7d1a23255181 tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:10bad99b-3c27-4b44-bd2f-444e0c0581cb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 09:42:13 user nova-compute[75122]: INFO os_brick.initiator.connectors.iscsi [None req-0556c008-9552-4e2d-be7b-7d1a23255181 tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 09:42:13 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10bad99b-3c27-4b44-bd2f-444e0c0581cb -p 172.16.0.220:3260 {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:42:13 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10bad99b-3c27-4b44-bd2f-444e0c0581cb -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:42:13 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[1711652a-5401-4910-9d68-ff306c536db9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:42:13 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-0556c008-9552-4e2d-be7b-7d1a23255181 tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 09:42:13 user nova-compute[75122]:  {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:42:13 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10bad99b-3c27-4b44-bd2f-444e0c0581cb -p 172.16.0.220:3260 --interface default --op new {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:42:13 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10bad99b-3c27-4b44-bd2f-444e0c0581cb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:42:13 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[424a95fb-72a8-4233-808c-17490b86a425]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:10bad99b-3c27-4b44-bd2f-444e0c0581cb] added\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:42:13 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-0556c008-9552-4e2d-be7b-7d1a23255181 tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:10bad99b-3c27-4b44-bd2f-444e0c0581cb] added
Nov 15 09:42:13 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:42:13 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10bad99b-3c27-4b44-bd2f-444e0c0581cb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:42:13 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10bad99b-3c27-4b44-bd2f-444e0c0581cb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:42:13 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8367bb1-318b-4aa9-8832-28c88fa06431]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:42:13 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-0556c008-9552-4e2d-be7b-7d1a23255181 tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:42:13 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10bad99b-3c27-4b44-bd2f-444e0c0581cb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:42:13 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10bad99b-3c27-4b44-bd2f-444e0c0581cb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:42:13 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e8c373d-9988-40e5-8cc5-b290092c4194]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:42:13 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-0556c008-9552-4e2d-be7b-7d1a23255181 tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:42:13 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10bad99b-3c27-4b44-bd2f-444e0c0581cb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XOflmCDG {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:42:13 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10bad99b-3c27-4b44-bd2f-444e0c0581cb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XOflmCDG" returned: 0 in 0.024s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:42:13 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[538ad6ff-d82c-443d-9cda-d44403a06aba]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:42:13 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-0556c008-9552-4e2d-be7b-7d1a23255181 tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XOflmCDG'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:42:13 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10bad99b-3c27-4b44-bd2f-444e0c0581cb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:42:13 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10bad99b-3c27-4b44-bd2f-444e0c0581cb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:42:13 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1f930a5-7bda-4e84-9ab0-89084d5375b4]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:42:13 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-0556c008-9552-4e2d-be7b-7d1a23255181 tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:42:13 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:42:13 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:42:13 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[88794961-7917-4590-8c3e-0abdf169d9cb]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdf09a1b-a065-4b88-815d-ee54c1c68464 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17 (non-flash)\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:42:13 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-0556c008-9552-4e2d-be7b-7d1a23255181 tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdf09a1b-a065-4b88-815d-ee54c1c68464 (non-flash)
Nov 15 09:42:13 user nova-compute[75122]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17 (non-flash)
Nov 15 09:42:13 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 09:42:13 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-0556c008-9552-4e2d-be7b-7d1a23255181 tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdf09a1b-a065-4b88-815d-ee54c1c68464 (non-flash)
Nov 15 09:42:13 user nova-compute[75122]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17 (non-flash)
Nov 15 09:42:13 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 09:42:13 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10bad99b-3c27-4b44-bd2f-444e0c0581cb -p 172.16.0.220:3260 --login {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:42:14 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10bad99b-3c27-4b44-bd2f-444e0c0581cb -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:42:14 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[c64e5ecf-0a5c-49f3-9eba-560012a9bf3c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:10bad99b-3c27-4b44-bd2f-444e0c0581cb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:10bad99b-3c27-4b44-bd2f-444e0c0581cb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:42:14 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-0556c008-9552-4e2d-be7b-7d1a23255181 tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:10bad99b-3c27-4b44-bd2f-444e0c0581cb, portal: 172.16.0.220,3260]
Nov 15 09:42:14 user nova-compute[75122]: Login to [iface: default, target: iqn.2010-10.org.openstack:10bad99b-3c27-4b44-bd2f-444e0c0581cb, portal: 172.16.0.220,3260] successful.
Nov 15 09:42:14 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:42:14 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10bad99b-3c27-4b44-bd2f-444e0c0581cb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:42:14 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10bad99b-3c27-4b44-bd2f-444e0c0581cb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:42:14 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[adc79bfc-4483-4f92-8ca2-b9c9af1d1b06]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:42:14 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-0556c008-9552-4e2d-be7b-7d1a23255181 tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:42:14 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:42:14 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:42:14 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf2b5122-fe36-4213-ab65-518d69b2c29a]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdf09a1b-a065-4b88-815d-ee54c1c68464 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10bad99b-3c27-4b44-bd2f-444e0c0581cb (non-flash)\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:42:14 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-0556c008-9552-4e2d-be7b-7d1a23255181 tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdf09a1b-a065-4b88-815d-ee54c1c68464 (non-flash)
Nov 15 09:42:14 user nova-compute[75122]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17 (non-flash)
Nov 15 09:42:14 user nova-compute[75122]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10bad99b-3c27-4b44-bd2f-444e0c0581cb (non-flash)
Nov 15 09:42:14 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 09:42:14 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-0556c008-9552-4e2d-be7b-7d1a23255181 tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdf09a1b-a065-4b88-815d-ee54c1c68464 (non-flash)
Nov 15 09:42:14 user nova-compute[75122]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17 (non-flash)
Nov 15 09:42:14 user nova-compute[75122]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10bad99b-3c27-4b44-bd2f-444e0c0581cb (non-flash)
Nov 15 09:42:14 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 09:42:14 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-0556c008-9552-4e2d-be7b-7d1a23255181 tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:10bad99b-3c27-4b44-bd2f-444e0c0581cb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.293s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 09:42:14 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-0556c008-9552-4e2d-be7b-7d1a23255181 tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Connected to 172.16.0.220:3260 {{(pid=75122) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 09:42:14 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-0556c008-9552-4e2d-be7b-7d1a23255181 tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] HCTL ('35', '-', '-', 0) found on session 34 with lun 0 {{(pid=75122) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 09:42:14 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-0556c008-9552-4e2d-be7b-7d1a23255181 tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75122) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 09:42:14 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:42:14 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:42:14 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[768f48ac-9a24-4737-8484-da5e75a84c3e]: (4, ('- - 0', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:42:14 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-0556c008-9552-4e2d-be7b-7d1a23255181 tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Searching for a device in session 34 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75122) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 09:42:14 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-0556c008-9552-4e2d-be7b-7d1a23255181 tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:10bad99b-3c27-4b44-bd2f-444e0c0581cb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XOflmCDG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75122) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 09:42:14 user nova-compute[75122]: DEBUG nova.compute.manager [req-8f0430ef-9426-44db-87f1-e7cd78a5967d req-95d6caa0-6c32-49b3-89de-ac805b9d55dc service nova] [instance: e1afe5d4-42c0-491c-b1c7-c8debf1d5da2] Received event volume-reimaged-395810b1-e3c3-4660-aaaf-b6d9e7cb5a88 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:42:14 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-8f0430ef-9426-44db-87f1-e7cd78a5967d req-95d6caa0-6c32-49b3-89de-ac805b9d55dc service nova] Acquiring lock "e1afe5d4-42c0-491c-b1c7-c8debf1d5da2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:42:14 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-8f0430ef-9426-44db-87f1-e7cd78a5967d req-95d6caa0-6c32-49b3-89de-ac805b9d55dc service nova] Lock "e1afe5d4-42c0-491c-b1c7-c8debf1d5da2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:42:14 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-8f0430ef-9426-44db-87f1-e7cd78a5967d req-95d6caa0-6c32-49b3-89de-ac805b9d55dc service nova] Lock "e1afe5d4-42c0-491c-b1c7-c8debf1d5da2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:42:14 user nova-compute[75122]: DEBUG nova.compute.manager [req-8f0430ef-9426-44db-87f1-e7cd78a5967d req-95d6caa0-6c32-49b3-89de-ac805b9d55dc service nova] [instance: e1afe5d4-42c0-491c-b1c7-c8debf1d5da2] Processing event volume-reimaged-395810b1-e3c3-4660-aaaf-b6d9e7cb5a88 {{(pid=75122) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10872}}
Nov 15 09:42:14 user nova-compute[75122]: DEBUG nova.compute.manager [None req-8f0430ef-9426-44db-87f1-e7cd78a5967d tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] [instance: e1afe5d4-42c0-491c-b1c7-c8debf1d5da2] Instance event wait completed in 20 seconds for volume-reimaged {{(pid=75122) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 09:42:14 user nova-compute[75122]: INFO nova.virt.block_device [None req-8f0430ef-9426-44db-87f1-e7cd78a5967d tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] [instance: e1afe5d4-42c0-491c-b1c7-c8debf1d5da2] Booting with volume 395810b1-e3c3-4660-aaaf-b6d9e7cb5a88 at /dev/vda
Nov 15 09:42:14 user nova-compute[75122]: DEBUG os_brick.utils [None req-8f0430ef-9426-44db-87f1-e7cd78a5967d tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 09:42:14 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:42:14 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:42:14 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[49a129ac-e4a8-476d-9e50-4187b2384f3d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:742fb64b3587\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:42:14 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:42:14 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:42:14 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7308cd2-b4ac-46e0-8e15-12b71cb8706a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:42:14 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:42:14 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:42:14 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[06a98326-29f7-456e-af6e-bbe8bca1d9c6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:42:14 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb2f5a0d-9aa7-4fba-82e8-b1687b11e2da]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:42:14 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-8f0430ef-9426-44db-87f1-e7cd78a5967d tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] Running cmd (subprocess): nvme version {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:42:14 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-8f0430ef-9426-44db-87f1-e7cd78a5967d tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] 'nvme version' failed. Not Retrying. {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 09:42:14 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8f0430ef-9426-44db-87f1-e7cd78a5967d tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] nvme not present on system {{(pid=75122) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 09:42:14 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:42:14 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 09:42:14 user nova-compute[75122]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 09:42:14 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dbbcd7f-5bf4-420e-8c0d-42a799ced3a3]: (4, '') {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:42:14 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.lightos [None req-8f0430ef-9426-44db-87f1-e7cd78a5967d tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75122) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 09:42:14 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.lightos [None req-8f0430ef-9426-44db-87f1-e7cd78a5967d tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75122) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 09:42:14 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.lightos [None req-8f0430ef-9426-44db-87f1-e7cd78a5967d tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] LIGHTOS: no hostnqn found. {{(pid=75122) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 09:42:14 user nova-compute[75122]: DEBUG os_brick.utils [None req-8f0430ef-9426-44db-87f1-e7cd78a5967d tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:742fb64b3587', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 09:42:14 user nova-compute[75122]: DEBUG nova.virt.block_device [None req-8f0430ef-9426-44db-87f1-e7cd78a5967d tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] [instance: e1afe5d4-42c0-491c-b1c7-c8debf1d5da2] Updating existing volume attachment record: 5c107689-9528-4088-975d-1084dc264f07 {{(pid=75122) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 09:42:15 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-0556c008-9552-4e2d-be7b-7d1a23255181 tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.327s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 09:42:15 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-0556c008-9552-4e2d-be7b-7d1a23255181 tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] <== connect_volume: return (1329ms) {'type': 'block', 'scsi_wwn': '23736613332636464', 'path': '/dev/sdd'} {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 09:42:15 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0556c008-9552-4e2d-be7b-7d1a23255181 tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] [instance: e815e0b5-e9c8-4ebb-aa85-b79b180595df] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23736613332636464', 'path': '/dev/sdd'} {{(pid=75122) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 09:42:15 user nova-compute[75122]: DEBUG nova.objects.instance [None req-0556c008-9552-4e2d-be7b-7d1a23255181 tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Lazy-loading 'flavor' on Instance uuid e815e0b5-e9c8-4ebb-aa85-b79b180595df {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:42:15 user nova-compute[75122]: DEBUG nova.virt.libvirt.guest [None req-0556c008-9552-4e2d-be7b-7d1a23255181 tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 09:42:15 user nova-compute[75122]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 09:42:15 user nova-compute[75122]:   <source dev="/dev/sdd"/>
Nov 15 09:42:15 user nova-compute[75122]:   <target dev="vdb" bus="virtio"/>
Nov 15 09:42:15 user nova-compute[75122]:   <serial>10bad99b-3c27-4b44-bd2f-444e0c0581cb</serial>
Nov 15 09:42:15 user nova-compute[75122]: </disk>
Nov 15 09:42:15 user nova-compute[75122]:  {{(pid=75122) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 09:42:15 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-0556c008-9552-4e2d-be7b-7d1a23255181 tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] No BDM found with device name vda, not building metadata. {{(pid=75122) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 09:42:15 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-0556c008-9552-4e2d-be7b-7d1a23255181 tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75122) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 09:42:15 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-0556c008-9552-4e2d-be7b-7d1a23255181 tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] No VIF found with MAC fa:16:3e:38:e8:08, not building metadata {{(pid=75122) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 09:42:15 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0556c008-9552-4e2d-be7b-7d1a23255181 tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Lock "e815e0b5-e9c8-4ebb-aa85-b79b180595df" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.186s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:42:16 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:42:16 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:42:17 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:42:17 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75122) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 09:42:18 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:42:18 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:42:19 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:42:19 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:42:20 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:42:20 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Starting heal instance info cache {{(pid=75122) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 09:42:20 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "refresh_cache-fd9d52bb-6248-48e6-a798-6dbdaaa68cbc" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 09:42:20 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquired lock "refresh_cache-fd9d52bb-6248-48e6-a798-6dbdaaa68cbc" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 09:42:20 user nova-compute[75122]: DEBUG nova.network.neutron [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] [instance: fd9d52bb-6248-48e6-a798-6dbdaaa68cbc] Forcefully refreshing network info cache for instance {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 09:42:20 user nova-compute[75122]: DEBUG nova.network.neutron [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] [instance: fd9d52bb-6248-48e6-a798-6dbdaaa68cbc] Updating instance_info_cache with network_info: [{"id": "f6892701-aba2-4c9a-88bd-996d00963301", "address": "fa:16:3e:a5:6f:a0", "network": {"id": "c2062f64-d925-42d2-9687-5d2511ef6697", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1134087048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eeff24cb28f5481fa3941ba399ce82ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6892701-ab", "ovs_interfaceid": "f6892701-aba2-4c9a-88bd-996d00963301", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:42:20 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Releasing lock "refresh_cache-fd9d52bb-6248-48e6-a798-6dbdaaa68cbc" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 09:42:20 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] [instance: fd9d52bb-6248-48e6-a798-6dbdaaa68cbc] Updated the network info_cache for instance {{(pid=75122) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 09:42:20 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:42:21 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:42:21 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:42:22 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:42:22 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:42:22 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:42:22 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:42:22 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75122) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 09:42:22 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f6177c5-3048-4a78-b34a-e595d26d69d0/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:42:22 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f6177c5-3048-4a78-b34a-e595d26d69d0/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:42:22 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f6177c5-3048-4a78-b34a-e595d26d69d0/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:42:22 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f6177c5-3048-4a78-b34a-e595d26d69d0/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:42:22 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2f45f49-0bca-4ae2-bc2a-eed293143489/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:42:22 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2f45f49-0bca-4ae2-bc2a-eed293143489/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:42:22 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2f45f49-0bca-4ae2-bc2a-eed293143489/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:42:23 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2f45f49-0bca-4ae2-bc2a-eed293143489/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:42:23 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75122) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 09:42:23 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd9d52bb-6248-48e6-a798-6dbdaaa68cbc/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:42:23 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd9d52bb-6248-48e6-a798-6dbdaaa68cbc/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:42:23 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd9d52bb-6248-48e6-a798-6dbdaaa68cbc/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:42:23 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd9d52bb-6248-48e6-a798-6dbdaaa68cbc/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:42:23 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df913b3e-218d-4ae6-b7b3-70f64fdd3896/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:42:23 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df913b3e-218d-4ae6-b7b3-70f64fdd3896/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:42:23 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df913b3e-218d-4ae6-b7b3-70f64fdd3896/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:42:23 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df913b3e-218d-4ae6-b7b3-70f64fdd3896/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:42:23 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75122) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 09:42:23 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52c066f3-dea1-4aa3-9da4-da9397b9fff1/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:42:24 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-8f0430ef-9426-44db-87f1-e7cd78a5967d tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] [instance: e1afe5d4-42c0-491c-b1c7-c8debf1d5da2] Creating instance directory {{(pid=75122) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 09:42:24 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-8f0430ef-9426-44db-87f1-e7cd78a5967d tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] [instance: e1afe5d4-42c0-491c-b1c7-c8debf1d5da2] Creating image(s)
Nov 15 09:42:24 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-8f0430ef-9426-44db-87f1-e7cd78a5967d tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] [instance: e1afe5d4-42c0-491c-b1c7-c8debf1d5da2] Did not create local disks {{(pid=75122) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 09:42:24 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-8f0430ef-9426-44db-87f1-e7cd78a5967d tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] [instance: e1afe5d4-42c0-491c-b1c7-c8debf1d5da2] Ensure instance console log exists: /opt/stack/data/nova/instances/e1afe5d4-42c0-491c-b1c7-c8debf1d5da2/console.log {{(pid=75122) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 09:42:24 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-8f0430ef-9426-44db-87f1-e7cd78a5967d tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:42:24 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-8f0430ef-9426-44db-87f1-e7cd78a5967d tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:42:24 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-8f0430ef-9426-44db-87f1-e7cd78a5967d tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:42:24 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-8f0430ef-9426-44db-87f1-e7cd78a5967d tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] [instance: e1afe5d4-42c0-491c-b1c7-c8debf1d5da2] Start _get_guest_xml network_info=[{"id": "f2eacefa-263d-4e6f-af4e-3ab293748b4a", "address": "fa:16:3e:f7:23:f8", "network": {"id": "0b825d42-d480-4526-a659-e1a5c5fbb53c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1640851308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21d2b24ce1a3452fa6bba669f64ffaba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2eacefa-26", "ovs_interfaceid": "f2eacefa-263d-4e6f-af4e-3ab293748b4a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T09:26:31Z,direct_url=<?>,disk_format='qcow2',id=5e862cfe-47b8-4725-8292-65761ee6d0f5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9c57733cb41847c0b4ad31519c382e5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T09:26:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:395810b1-e3c3-4660-aaaf-b6d9e7cb5a88', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cRPqjENp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e1afe5d4-42c0-491c-b1c7-c8debf1d5da2', 'attached_at': '', 'detached_at': '', 'volume_id': '395810b1-e3c3-4660-aaaf-b6d9e7cb5a88', 'serial': '395810b1-e3c3-4660-aaaf-b6d9e7cb5a88'}, 'guest_format': None, 'delete_on_termination': True, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vda', 'attachment_id': '5c107689-9528-4088-975d-1084dc264f07', 'volume_type': None} {{(pid=75122) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 09:42:24 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52c066f3-dea1-4aa3-9da4-da9397b9fff1/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:42:24 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52c066f3-dea1-4aa3-9da4-da9397b9fff1/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:42:24 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-8f0430ef-9426-44db-87f1-e7cd78a5967d tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 15 09:42:24 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-8f0430ef-9426-44db-87f1-e7cd78a5967d tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 15 09:42:24 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-8f0430ef-9426-44db-87f1-e7cd78a5967d tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75122) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 09:42:24 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-8f0430ef-9426-44db-87f1-e7cd78a5967d tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] CPU controller missing on host. {{(pid=75122) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 09:42:24 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-8f0430ef-9426-44db-87f1-e7cd78a5967d tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75122) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 09:42:24 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-8f0430ef-9426-44db-87f1-e7cd78a5967d tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] CPU controller found on host. {{(pid=75122) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 09:42:24 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-8f0430ef-9426-44db-87f1-e7cd78a5967d tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75122) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 09:42:24 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-8f0430ef-9426-44db-87f1-e7cd78a5967d tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T09:26:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T09:26:31Z,direct_url=<?>,disk_format='qcow2',id=5e862cfe-47b8-4725-8292-65761ee6d0f5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9c57733cb41847c0b4ad31519c382e5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T09:26:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 09:42:24 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-8f0430ef-9426-44db-87f1-e7cd78a5967d tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] Flavor limits 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 09:42:24 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-8f0430ef-9426-44db-87f1-e7cd78a5967d tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] Image limits 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 09:42:24 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-8f0430ef-9426-44db-87f1-e7cd78a5967d tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] Flavor pref 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 09:42:24 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-8f0430ef-9426-44db-87f1-e7cd78a5967d tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] Image pref 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 09:42:24 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-8f0430ef-9426-44db-87f1-e7cd78a5967d tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 09:42:24 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-8f0430ef-9426-44db-87f1-e7cd78a5967d tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 09:42:24 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-8f0430ef-9426-44db-87f1-e7cd78a5967d tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75122) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 09:42:24 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-8f0430ef-9426-44db-87f1-e7cd78a5967d tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] Got 1 possible topologies {{(pid=75122) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 09:42:24 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-8f0430ef-9426-44db-87f1-e7cd78a5967d tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 09:42:24 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-8f0430ef-9426-44db-87f1-e7cd78a5967d tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 09:42:24 user nova-compute[75122]: DEBUG nova.objects.instance [None req-8f0430ef-9426-44db-87f1-e7cd78a5967d tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] Lazy-loading 'vcpu_model' on Instance uuid e1afe5d4-42c0-491c-b1c7-c8debf1d5da2 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:42:24 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8f0430ef-9426-44db-87f1-e7cd78a5967d tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] [instance: e1afe5d4-42c0-491c-b1c7-c8debf1d5da2] Calling os-brick to attach iSCSI Volume {{(pid=75122) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 09:42:24 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f0430ef-9426-44db-87f1-e7cd78a5967d tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffa04060b80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:395810b1-e3c3-4660-aaaf-b6d9e7cb5a88', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cRPqjENp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 09:42:24 user nova-compute[75122]: WARNING os_brick.initiator.connectors.base [None req-8f0430ef-9426-44db-87f1-e7cd78a5967d tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 15 09:42:24 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-8f0430ef-9426-44db-87f1-e7cd78a5967d tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 09:42:24 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-8f0430ef-9426-44db-87f1-e7cd78a5967d tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 09:42:24 user nova-compute[75122]: WARNING os_brick.initiator.connectors.base [None req-8f0430ef-9426-44db-87f1-e7cd78a5967d tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 15 09:42:24 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-8f0430ef-9426-44db-87f1-e7cd78a5967d tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:395810b1-e3c3-4660-aaaf-b6d9e7cb5a88" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 09:42:24 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-8f0430ef-9426-44db-87f1-e7cd78a5967d tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:395810b1-e3c3-4660-aaaf-b6d9e7cb5a88" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 09:42:24 user nova-compute[75122]: INFO os_brick.initiator.connectors.iscsi [None req-8f0430ef-9426-44db-87f1-e7cd78a5967d tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 09:42:24 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:395810b1-e3c3-4660-aaaf-b6d9e7cb5a88 -p 172.16.0.220:3260 {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:42:24 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:395810b1-e3c3-4660-aaaf-b6d9e7cb5a88 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:42:24 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[77153aff-e082-4c44-b8a1-09c806312a90]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:42:24 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f0430ef-9426-44db-87f1-e7cd78a5967d tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 09:42:24 user nova-compute[75122]:  {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:42:24 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:395810b1-e3c3-4660-aaaf-b6d9e7cb5a88 -p 172.16.0.220:3260 --interface default --op new {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:42:24 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:395810b1-e3c3-4660-aaaf-b6d9e7cb5a88 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:42:24 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1306ae3-a5c0-4bfd-a78d-b783deec869c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:395810b1-e3c3-4660-aaaf-b6d9e7cb5a88] added\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:42:24 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f0430ef-9426-44db-87f1-e7cd78a5967d tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:395810b1-e3c3-4660-aaaf-b6d9e7cb5a88] added
Nov 15 09:42:24 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:42:24 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:395810b1-e3c3-4660-aaaf-b6d9e7cb5a88 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:42:24 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:395810b1-e3c3-4660-aaaf-b6d9e7cb5a88 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:42:24 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[35ff50b0-9ce8-441c-9365-2fcf9b3c7b76]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:42:24 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f0430ef-9426-44db-87f1-e7cd78a5967d tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:42:24 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:395810b1-e3c3-4660-aaaf-b6d9e7cb5a88 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:42:24 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52c066f3-dea1-4aa3-9da4-da9397b9fff1/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:42:24 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/131142fd-e8ec-42d1-a518-aa21c7bb7cb1/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:42:24 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:395810b1-e3c3-4660-aaaf-b6d9e7cb5a88 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:42:24 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[b686c4cc-5ba9-4c74-91c3-398cf86456f7]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:42:24 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f0430ef-9426-44db-87f1-e7cd78a5967d tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:42:24 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:395810b1-e3c3-4660-aaaf-b6d9e7cb5a88 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cRPqjENp {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:42:24 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:395810b1-e3c3-4660-aaaf-b6d9e7cb5a88 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cRPqjENp" returned: 0 in 0.017s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:42:24 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[4312d678-e261-4922-b6e1-10f9b84631a4]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:42:24 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f0430ef-9426-44db-87f1-e7cd78a5967d tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cRPqjENp'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:42:24 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:395810b1-e3c3-4660-aaaf-b6d9e7cb5a88 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:42:24 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:395810b1-e3c3-4660-aaaf-b6d9e7cb5a88 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:42:24 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[da296444-4727-4c4f-90ec-5eceb502ad2b]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:42:24 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f0430ef-9426-44db-87f1-e7cd78a5967d tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:42:24 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:42:24 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:42:24 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[b266c1bf-5cf2-4e73-96c0-ca3d43de9c2c]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdf09a1b-a065-4b88-815d-ee54c1c68464 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10bad99b-3c27-4b44-bd2f-444e0c0581cb (non-flash)\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:42:24 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f0430ef-9426-44db-87f1-e7cd78a5967d tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdf09a1b-a065-4b88-815d-ee54c1c68464 (non-flash)
Nov 15 09:42:24 user nova-compute[75122]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17 (non-flash)
Nov 15 09:42:24 user nova-compute[75122]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10bad99b-3c27-4b44-bd2f-444e0c0581cb (non-flash)
Nov 15 09:42:24 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 09:42:24 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f0430ef-9426-44db-87f1-e7cd78a5967d tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdf09a1b-a065-4b88-815d-ee54c1c68464 (non-flash)
Nov 15 09:42:24 user nova-compute[75122]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17 (non-flash)
Nov 15 09:42:24 user nova-compute[75122]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10bad99b-3c27-4b44-bd2f-444e0c0581cb (non-flash)
Nov 15 09:42:24 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 09:42:24 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:395810b1-e3c3-4660-aaaf-b6d9e7cb5a88 -p 172.16.0.220:3260 --login {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:42:24 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:395810b1-e3c3-4660-aaaf-b6d9e7cb5a88 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:42:24 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[471d950d-f573-4f65-b4f2-827fa9d9767d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:395810b1-e3c3-4660-aaaf-b6d9e7cb5a88, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:395810b1-e3c3-4660-aaaf-b6d9e7cb5a88, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:42:24 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f0430ef-9426-44db-87f1-e7cd78a5967d tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:395810b1-e3c3-4660-aaaf-b6d9e7cb5a88, portal: 172.16.0.220,3260]
Nov 15 09:42:24 user nova-compute[75122]: Login to [iface: default, target: iqn.2010-10.org.openstack:395810b1-e3c3-4660-aaaf-b6d9e7cb5a88, portal: 172.16.0.220,3260] successful.
Nov 15 09:42:24 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:42:24 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:395810b1-e3c3-4660-aaaf-b6d9e7cb5a88 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:42:24 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/131142fd-e8ec-42d1-a518-aa21c7bb7cb1/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:42:24 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/131142fd-e8ec-42d1-a518-aa21c7bb7cb1/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:42:24 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:395810b1-e3c3-4660-aaaf-b6d9e7cb5a88 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:42:24 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[366093d6-3308-46f0-9199-b75ba93d6d5d]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:42:24 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f0430ef-9426-44db-87f1-e7cd78a5967d tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:42:24 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:42:24 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:42:24 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[87af5387-53a5-4073-b996-1e0ca9584aee]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdf09a1b-a065-4b88-815d-ee54c1c68464 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10bad99b-3c27-4b44-bd2f-444e0c0581cb (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:395810b1-e3c3-4660-aaaf-b6d9e7cb5a88 (non-flash)\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:42:24 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f0430ef-9426-44db-87f1-e7cd78a5967d tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdf09a1b-a065-4b88-815d-ee54c1c68464 (non-flash)
Nov 15 09:42:24 user nova-compute[75122]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17 (non-flash)
Nov 15 09:42:24 user nova-compute[75122]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10bad99b-3c27-4b44-bd2f-444e0c0581cb (non-flash)
Nov 15 09:42:24 user nova-compute[75122]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:395810b1-e3c3-4660-aaaf-b6d9e7cb5a88 (non-flash)
Nov 15 09:42:24 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 09:42:24 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f0430ef-9426-44db-87f1-e7cd78a5967d tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdf09a1b-a065-4b88-815d-ee54c1c68464 (non-flash)
Nov 15 09:42:24 user nova-compute[75122]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17 (non-flash)
Nov 15 09:42:24 user nova-compute[75122]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10bad99b-3c27-4b44-bd2f-444e0c0581cb (non-flash)
Nov 15 09:42:24 user nova-compute[75122]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:395810b1-e3c3-4660-aaaf-b6d9e7cb5a88 (non-flash)
Nov 15 09:42:24 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 09:42:24 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-8f0430ef-9426-44db-87f1-e7cd78a5967d tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:395810b1-e3c3-4660-aaaf-b6d9e7cb5a88" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.315s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 09:42:24 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f0430ef-9426-44db-87f1-e7cd78a5967d tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] Connected to 172.16.0.220:3260 {{(pid=75122) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 09:42:24 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-8f0430ef-9426-44db-87f1-e7cd78a5967d tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] HCTL ('36', '-', '-', 0) found on session 35 with lun 0 {{(pid=75122) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 09:42:24 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-8f0430ef-9426-44db-87f1-e7cd78a5967d tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75122) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 09:42:24 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:42:24 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.015s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:42:24 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[a804e639-2689-4db0-bb6b-96dd1524c94e]: (4, ('- - 0', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:42:24 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-8f0430ef-9426-44db-87f1-e7cd78a5967d tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] Searching for a device in session 35 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75122) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 09:42:24 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f0430ef-9426-44db-87f1-e7cd78a5967d tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:395810b1-e3c3-4660-aaaf-b6d9e7cb5a88', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cRPqjENp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75122) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 09:42:24 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/131142fd-e8ec-42d1-a518-aa21c7bb7cb1/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:42:24 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e815e0b5-e9c8-4ebb-aa85-b79b180595df/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:42:24 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e815e0b5-e9c8-4ebb-aa85-b79b180595df/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:42:24 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e815e0b5-e9c8-4ebb-aa85-b79b180595df/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:42:25 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e815e0b5-e9c8-4ebb-aa85-b79b180595df/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:42:25 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75122) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 09:42:25 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00270cc2-4f5b-4f64-8f88-31f21e3b3950/disk.rescue --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:42:25 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00270cc2-4f5b-4f64-8f88-31f21e3b3950/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:42:25 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00270cc2-4f5b-4f64-8f88-31f21e3b3950/disk.rescue --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:42:25 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00270cc2-4f5b-4f64-8f88-31f21e3b3950/disk.rescue --force-share --output=json" returned: 0 in 0.193s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:42:25 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00270cc2-4f5b-4f64-8f88-31f21e3b3950/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:42:25 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-8f0430ef-9426-44db-87f1-e7cd78a5967d tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.357s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 09:42:25 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f0430ef-9426-44db-87f1-e7cd78a5967d tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] <== connect_volume: return (1360ms) {'type': 'block', 'scsi_wwn': '23538613733363566', 'path': '/dev/sde'} {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 09:42:25 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8f0430ef-9426-44db-87f1-e7cd78a5967d tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] [instance: e1afe5d4-42c0-491c-b1c7-c8debf1d5da2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23538613733363566', 'path': '/dev/sde'} {{(pid=75122) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 09:42:25 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00270cc2-4f5b-4f64-8f88-31f21e3b3950/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:42:25 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00270cc2-4f5b-4f64-8f88-31f21e3b3950/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:42:25 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-8f0430ef-9426-44db-87f1-e7cd78a5967d tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-15T09:39:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-859857655',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1427271580',id=24,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKavn69DT/YiudqeLC0nG3DEUybkU33QtIjB7fX4OdJJmMo+mhmiPQjcJANuymlxpfxTBdycCs8+kgmwpZOBnByAe9gcjy/ud1YUrlRdkVYRnoGUJsx71JcToY7Fz/5kxA==',key_name='tempest-keypair-171606846',keypairs=<?>,launch_index=0,launched_at=2023-11-15T09:40:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='21d2b24ce1a3452fa6bba669f64ffaba',ramdisk_id='',reservation_id='r-j9e29adc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-380486035',owner_user_name='tempest-ServerActionsV293TestJSON-380486035-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T09:42:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='35c1bd52106641e081d67e05532fbec3',uuid=e1afe5d4-42c0-491c-b1c7-c8debf1d5da2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f2eacefa-263d-4e6f-af4e-3ab293748b4a", "address": "fa:16:3e:f7:23:f8", "network": {"id": "0b825d42-d480-4526-a659-e1a5c5fbb53c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1640851308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21d2b24ce1a3452fa6bba669f64ffaba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2eacefa-26", "ovs_interfaceid": "f2eacefa-263d-4e6f-af4e-3ab293748b4a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75122) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 09:42:25 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-8f0430ef-9426-44db-87f1-e7cd78a5967d tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] Converting VIF {"id": "f2eacefa-263d-4e6f-af4e-3ab293748b4a", "address": "fa:16:3e:f7:23:f8", "network": {"id": "0b825d42-d480-4526-a659-e1a5c5fbb53c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1640851308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21d2b24ce1a3452fa6bba669f64ffaba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2eacefa-26", "ovs_interfaceid": "f2eacefa-263d-4e6f-af4e-3ab293748b4a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 09:42:25 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-8f0430ef-9426-44db-87f1-e7cd78a5967d tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f7:23:f8,bridge_name='br-int',has_traffic_filtering=True,id=f2eacefa-263d-4e6f-af4e-3ab293748b4a,network=Network(0b825d42-d480-4526-a659-e1a5c5fbb53c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2eacefa-26') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 09:42:25 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-8f0430ef-9426-44db-87f1-e7cd78a5967d tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] [instance: e1afe5d4-42c0-491c-b1c7-c8debf1d5da2] End _get_guest_xml xml=<domain type="kvm">
Nov 15 09:42:25 user nova-compute[75122]:   <uuid>e1afe5d4-42c0-491c-b1c7-c8debf1d5da2</uuid>
Nov 15 09:42:25 user nova-compute[75122]:   <name>instance-00000018</name>
Nov 15 09:42:25 user nova-compute[75122]:   <memory>524288</memory>
Nov 15 09:42:25 user nova-compute[75122]:   <vcpu>1</vcpu>
Nov 15 09:42:25 user nova-compute[75122]:   <metadata>
Nov 15 09:42:25 user nova-compute[75122]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 09:42:25 user nova-compute[75122]:       <nova:package version="0.0.0"/>
Nov 15 09:42:25 user nova-compute[75122]:       <nova:name>tempest-ServerActionsV293TestJSON-server-859857655</nova:name>
Nov 15 09:42:25 user nova-compute[75122]:       <nova:creationTime>2023-11-15 09:42:24</nova:creationTime>
Nov 15 09:42:25 user nova-compute[75122]:       <nova:flavor name="m1.tiny">
Nov 15 09:42:25 user nova-compute[75122]:         <nova:memory>512</nova:memory>
Nov 15 09:42:25 user nova-compute[75122]:         <nova:disk>1</nova:disk>
Nov 15 09:42:25 user nova-compute[75122]:         <nova:swap>0</nova:swap>
Nov 15 09:42:25 user nova-compute[75122]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 09:42:25 user nova-compute[75122]:         <nova:vcpus>1</nova:vcpus>
Nov 15 09:42:25 user nova-compute[75122]:       </nova:flavor>
Nov 15 09:42:25 user nova-compute[75122]:       <nova:owner>
Nov 15 09:42:25 user nova-compute[75122]:         <nova:user uuid="35c1bd52106641e081d67e05532fbec3">tempest-ServerActionsV293TestJSON-380486035-project-member</nova:user>
Nov 15 09:42:25 user nova-compute[75122]:         <nova:project uuid="21d2b24ce1a3452fa6bba669f64ffaba">tempest-ServerActionsV293TestJSON-380486035</nova:project>
Nov 15 09:42:25 user nova-compute[75122]:       </nova:owner>
Nov 15 09:42:25 user nova-compute[75122]:       <nova:ports>
Nov 15 09:42:25 user nova-compute[75122]:         <nova:port uuid="f2eacefa-263d-4e6f-af4e-3ab293748b4a">
Nov 15 09:42:25 user nova-compute[75122]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 15 09:42:25 user nova-compute[75122]:         </nova:port>
Nov 15 09:42:25 user nova-compute[75122]:       </nova:ports>
Nov 15 09:42:25 user nova-compute[75122]:     </nova:instance>
Nov 15 09:42:25 user nova-compute[75122]:   </metadata>
Nov 15 09:42:25 user nova-compute[75122]:   <sysinfo type="smbios">
Nov 15 09:42:25 user nova-compute[75122]:     <system>
Nov 15 09:42:25 user nova-compute[75122]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 09:42:25 user nova-compute[75122]:       <entry name="product">OpenStack Nova</entry>
Nov 15 09:42:25 user nova-compute[75122]:       <entry name="version">0.0.0</entry>
Nov 15 09:42:25 user nova-compute[75122]:       <entry name="serial">e1afe5d4-42c0-491c-b1c7-c8debf1d5da2</entry>
Nov 15 09:42:25 user nova-compute[75122]:       <entry name="uuid">e1afe5d4-42c0-491c-b1c7-c8debf1d5da2</entry>
Nov 15 09:42:25 user nova-compute[75122]:       <entry name="family">Virtual Machine</entry>
Nov 15 09:42:25 user nova-compute[75122]:     </system>
Nov 15 09:42:25 user nova-compute[75122]:   </sysinfo>
Nov 15 09:42:25 user nova-compute[75122]:   <os>
Nov 15 09:42:25 user nova-compute[75122]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 09:42:25 user nova-compute[75122]:     <boot dev="hd"/>
Nov 15 09:42:25 user nova-compute[75122]:     <smbios mode="sysinfo"/>
Nov 15 09:42:25 user nova-compute[75122]:   </os>
Nov 15 09:42:25 user nova-compute[75122]:   <features>
Nov 15 09:42:25 user nova-compute[75122]:     <acpi/>
Nov 15 09:42:25 user nova-compute[75122]:     <apic/>
Nov 15 09:42:25 user nova-compute[75122]:     <vmcoreinfo/>
Nov 15 09:42:25 user nova-compute[75122]:   </features>
Nov 15 09:42:25 user nova-compute[75122]:   <clock offset="utc">
Nov 15 09:42:25 user nova-compute[75122]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 09:42:25 user nova-compute[75122]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 09:42:25 user nova-compute[75122]:     <timer name="hpet" present="no"/>
Nov 15 09:42:25 user nova-compute[75122]:   </clock>
Nov 15 09:42:25 user nova-compute[75122]:   <cpu mode="custom" match="exact">
Nov 15 09:42:25 user nova-compute[75122]:     <model>Nehalem</model>
Nov 15 09:42:25 user nova-compute[75122]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 09:42:25 user nova-compute[75122]:   </cpu>
Nov 15 09:42:25 user nova-compute[75122]:   <devices>
Nov 15 09:42:25 user nova-compute[75122]:     <disk type="block" device="disk">
Nov 15 09:42:25 user nova-compute[75122]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 09:42:25 user nova-compute[75122]:       <source dev="/dev/sde"/>
Nov 15 09:42:25 user nova-compute[75122]:       <target dev="vda" bus="virtio"/>
Nov 15 09:42:25 user nova-compute[75122]:       <serial>395810b1-e3c3-4660-aaaf-b6d9e7cb5a88</serial>
Nov 15 09:42:25 user nova-compute[75122]:     </disk>
Nov 15 09:42:25 user nova-compute[75122]:     <interface type="ethernet">
Nov 15 09:42:25 user nova-compute[75122]:       <mac address="fa:16:3e:f7:23:f8"/>
Nov 15 09:42:25 user nova-compute[75122]:       <model type="virtio"/>
Nov 15 09:42:25 user nova-compute[75122]:       <mtu size="1442"/>
Nov 15 09:42:25 user nova-compute[75122]:       <target dev="tapf2eacefa-26"/>
Nov 15 09:42:25 user nova-compute[75122]:     </interface>
Nov 15 09:42:25 user nova-compute[75122]:     <serial type="pty">
Nov 15 09:42:25 user nova-compute[75122]:       <log file="/opt/stack/data/nova/instances/e1afe5d4-42c0-491c-b1c7-c8debf1d5da2/console.log" append="off"/>
Nov 15 09:42:25 user nova-compute[75122]:     </serial>
Nov 15 09:42:25 user nova-compute[75122]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 09:42:25 user nova-compute[75122]:     <video>
Nov 15 09:42:25 user nova-compute[75122]:       <model type="virtio"/>
Nov 15 09:42:25 user nova-compute[75122]:     </video>
Nov 15 09:42:25 user nova-compute[75122]:     <rng model="virtio">
Nov 15 09:42:25 user nova-compute[75122]:       <backend model="random">/dev/urandom</backend>
Nov 15 09:42:25 user nova-compute[75122]:     </rng>
Nov 15 09:42:25 user nova-compute[75122]:     <controller type="usb" index="0" model="none"/>
Nov 15 09:42:25 user nova-compute[75122]:     <memballoon model="virtio">
Nov 15 09:42:25 user nova-compute[75122]:       <stats period="10"/>
Nov 15 09:42:25 user nova-compute[75122]:     </memballoon>
Nov 15 09:42:25 user nova-compute[75122]:   </devices>
Nov 15 09:42:25 user nova-compute[75122]: </domain>
Nov 15 09:42:25 user nova-compute[75122]:  {{(pid=75122) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 09:42:25 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-8f0430ef-9426-44db-87f1-e7cd78a5967d tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-15T09:39:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-859857655',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1427271580',id=24,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKavn69DT/YiudqeLC0nG3DEUybkU33QtIjB7fX4OdJJmMo+mhmiPQjcJANuymlxpfxTBdycCs8+kgmwpZOBnByAe9gcjy/ud1YUrlRdkVYRnoGUJsx71JcToY7Fz/5kxA==',key_name='tempest-keypair-171606846',keypairs=<?>,launch_index=0,launched_at=2023-11-15T09:40:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='21d2b24ce1a3452fa6bba669f64ffaba',ramdisk_id='',reservation_id='r-j9e29adc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-380486035',owner_user_name='tempest-ServerActionsV293TestJSON-380486035-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T09:42:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='35c1bd52106641e081d67e05532fbec3',uuid=e1afe5d4-42c0-491c-b1c7-c8debf1d5da2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f2eacefa-263d-4e6f-af4e-3ab293748b4a", "address": "fa:16:3e:f7:23:f8", "network": {"id": "0b825d42-d480-4526-a659-e1a5c5fbb53c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1640851308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21d2b24ce1a3452fa6bba669f64ffaba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2eacefa-26", "ovs_interfaceid": "f2eacefa-263d-4e6f-af4e-3ab293748b4a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 09:42:25 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-8f0430ef-9426-44db-87f1-e7cd78a5967d tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] Converting VIF {"id": "f2eacefa-263d-4e6f-af4e-3ab293748b4a", "address": "fa:16:3e:f7:23:f8", "network": {"id": "0b825d42-d480-4526-a659-e1a5c5fbb53c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1640851308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21d2b24ce1a3452fa6bba669f64ffaba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2eacefa-26", "ovs_interfaceid": "f2eacefa-263d-4e6f-af4e-3ab293748b4a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 09:42:25 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-8f0430ef-9426-44db-87f1-e7cd78a5967d tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f7:23:f8,bridge_name='br-int',has_traffic_filtering=True,id=f2eacefa-263d-4e6f-af4e-3ab293748b4a,network=Network(0b825d42-d480-4526-a659-e1a5c5fbb53c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2eacefa-26') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 09:42:25 user nova-compute[75122]: DEBUG os_vif [None req-8f0430ef-9426-44db-87f1-e7cd78a5967d tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f7:23:f8,bridge_name='br-int',has_traffic_filtering=True,id=f2eacefa-263d-4e6f-af4e-3ab293748b4a,network=Network(0b825d42-d480-4526-a659-e1a5c5fbb53c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2eacefa-26') {{(pid=75122) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 09:42:25 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:42:25 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:42:25 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 09:42:25 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:42:25 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4e1e88e0-140e-588c-83b5-0c59dc509cb4', '_type': 'linux-noop'}}, row=False) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:42:25 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:42:25 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:42:25 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:42:25 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf2eacefa-26, may_exist=True, interface_attrs={}) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:42:25 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf2eacefa-26, col_values=(('qos', UUID('21512433-05eb-4716-81b5-78bde30cb06d')),), if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:42:25 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf2eacefa-26, col_values=(('external_ids', {'iface-id': 'f2eacefa-263d-4e6f-af4e-3ab293748b4a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f7:23:f8', 'vm-uuid': 'e1afe5d4-42c0-491c-b1c7-c8debf1d5da2'}),), if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:42:25 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:42:25 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:42:25 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:42:25 user nova-compute[75122]: INFO os_vif [None req-8f0430ef-9426-44db-87f1-e7cd78a5967d tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f7:23:f8,bridge_name='br-int',has_traffic_filtering=True,id=f2eacefa-263d-4e6f-af4e-3ab293748b4a,network=Network(0b825d42-d480-4526-a659-e1a5c5fbb53c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2eacefa-26')
Nov 15 09:42:25 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-8f0430ef-9426-44db-87f1-e7cd78a5967d tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] No BDM found with device name vda, not building metadata. {{(pid=75122) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 09:42:25 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-8f0430ef-9426-44db-87f1-e7cd78a5967d tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] No VIF found with MAC fa:16:3e:f7:23:f8, not building metadata {{(pid=75122) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 09:42:25 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00270cc2-4f5b-4f64-8f88-31f21e3b3950/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:42:26 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:42:26 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 09:42:26 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 09:42:26 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Hypervisor/Node resource view: name=user free_ram=7515MB free_disk=25.255115509033203GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75122) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 09:42:26 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:42:26 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:42:26 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance 131142fd-e8ec-42d1-a518-aa21c7bb7cb1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:42:26 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance fd9d52bb-6248-48e6-a798-6dbdaaa68cbc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:42:26 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance 00270cc2-4f5b-4f64-8f88-31f21e3b3950 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:42:26 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance df913b3e-218d-4ae6-b7b3-70f64fdd3896 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:42:26 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance c2f45f49-0bca-4ae2-bc2a-eed293143489 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:42:26 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance e1afe5d4-42c0-491c-b1c7-c8debf1d5da2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:42:26 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance e815e0b5-e9c8-4ebb-aa85-b79b180595df actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:42:26 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance 6f6177c5-3048-4a78-b34a-e595d26d69d0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:42:26 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance 52c066f3-dea1-4aa3-9da4-da9397b9fff1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:42:26 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance cc485c6c-5a9a-4c94-b966-68dd9e336e56 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:42:26 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75122) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 09:42:26 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75122) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 09:42:26 user nova-compute[75122]: DEBUG nova.compute.provider_tree [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Inventory has not changed in ProviderTree for provider: 69a3da65-47be-44c6-b67c-c692b58284ef {{(pid=75122) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 09:42:26 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Inventory has not changed for provider 69a3da65-47be-44c6-b67c-c692b58284ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 09:42:26 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Compute_service record updated for user:user {{(pid=75122) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 09:42:26 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.637s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:42:27 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:42:27 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:42:27 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:42:27 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:42:27 user nova-compute[75122]: DEBUG nova.compute.manager [req-dcc1cd41-5e12-4e75-8043-9c06f21e946e req-7df62eab-7de3-4a1a-9cb6-f219f96fc231 service nova] [instance: e1afe5d4-42c0-491c-b1c7-c8debf1d5da2] Received event network-vif-plugged-f2eacefa-263d-4e6f-af4e-3ab293748b4a {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:42:27 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-dcc1cd41-5e12-4e75-8043-9c06f21e946e req-7df62eab-7de3-4a1a-9cb6-f219f96fc231 service nova] Acquiring lock "e1afe5d4-42c0-491c-b1c7-c8debf1d5da2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:42:27 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-dcc1cd41-5e12-4e75-8043-9c06f21e946e req-7df62eab-7de3-4a1a-9cb6-f219f96fc231 service nova] Lock "e1afe5d4-42c0-491c-b1c7-c8debf1d5da2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:42:27 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-dcc1cd41-5e12-4e75-8043-9c06f21e946e req-7df62eab-7de3-4a1a-9cb6-f219f96fc231 service nova] Lock "e1afe5d4-42c0-491c-b1c7-c8debf1d5da2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:42:27 user nova-compute[75122]: DEBUG nova.compute.manager [req-dcc1cd41-5e12-4e75-8043-9c06f21e946e req-7df62eab-7de3-4a1a-9cb6-f219f96fc231 service nova] [instance: e1afe5d4-42c0-491c-b1c7-c8debf1d5da2] No waiting events found dispatching network-vif-plugged-f2eacefa-263d-4e6f-af4e-3ab293748b4a {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:42:27 user nova-compute[75122]: WARNING nova.compute.manager [req-dcc1cd41-5e12-4e75-8043-9c06f21e946e req-7df62eab-7de3-4a1a-9cb6-f219f96fc231 service nova] [instance: e1afe5d4-42c0-491c-b1c7-c8debf1d5da2] Received unexpected event network-vif-plugged-f2eacefa-263d-4e6f-af4e-3ab293748b4a for instance with vm_state active and task_state rebuild_spawning.
Nov 15 09:42:27 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:42:27 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:42:27 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:42:27 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:42:28 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:42:29 user nova-compute[75122]: DEBUG nova.compute.manager [None req-8f0430ef-9426-44db-87f1-e7cd78a5967d tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] [instance: e1afe5d4-42c0-491c-b1c7-c8debf1d5da2] Instance event wait completed in 0 seconds for  {{(pid=75122) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 09:42:29 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-8f0430ef-9426-44db-87f1-e7cd78a5967d tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] [instance: e1afe5d4-42c0-491c-b1c7-c8debf1d5da2] Guest created on hypervisor {{(pid=75122) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 09:42:29 user nova-compute[75122]: INFO nova.virt.libvirt.driver [-] [instance: e1afe5d4-42c0-491c-b1c7-c8debf1d5da2] Instance spawned successfully.
Nov 15 09:42:29 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-8f0430ef-9426-44db-87f1-e7cd78a5967d tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] [instance: e1afe5d4-42c0-491c-b1c7-c8debf1d5da2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 09:42:29 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-8f0430ef-9426-44db-87f1-e7cd78a5967d tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] [instance: e1afe5d4-42c0-491c-b1c7-c8debf1d5da2] Found default for hw_cdrom_bus of ide {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:42:29 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-8f0430ef-9426-44db-87f1-e7cd78a5967d tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] [instance: e1afe5d4-42c0-491c-b1c7-c8debf1d5da2] Found default for hw_disk_bus of virtio {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:42:29 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-8f0430ef-9426-44db-87f1-e7cd78a5967d tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] [instance: e1afe5d4-42c0-491c-b1c7-c8debf1d5da2] Found default for hw_input_bus of None {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:42:29 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-8f0430ef-9426-44db-87f1-e7cd78a5967d tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] [instance: e1afe5d4-42c0-491c-b1c7-c8debf1d5da2] Found default for hw_pointer_model of None {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:42:29 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-8f0430ef-9426-44db-87f1-e7cd78a5967d tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] [instance: e1afe5d4-42c0-491c-b1c7-c8debf1d5da2] Found default for hw_video_model of virtio {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:42:29 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-8f0430ef-9426-44db-87f1-e7cd78a5967d tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] [instance: e1afe5d4-42c0-491c-b1c7-c8debf1d5da2] Found default for hw_vif_model of virtio {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:42:29 user nova-compute[75122]: DEBUG nova.compute.manager [req-a8bc3b2a-0223-47ec-b3df-b1aa4ed98568 req-2846112f-4732-4e97-8ca9-21fdb7cb9e84 service nova] [instance: e1afe5d4-42c0-491c-b1c7-c8debf1d5da2] Received event network-vif-plugged-f2eacefa-263d-4e6f-af4e-3ab293748b4a {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:42:29 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-a8bc3b2a-0223-47ec-b3df-b1aa4ed98568 req-2846112f-4732-4e97-8ca9-21fdb7cb9e84 service nova] Acquiring lock "e1afe5d4-42c0-491c-b1c7-c8debf1d5da2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:42:29 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-a8bc3b2a-0223-47ec-b3df-b1aa4ed98568 req-2846112f-4732-4e97-8ca9-21fdb7cb9e84 service nova] Lock "e1afe5d4-42c0-491c-b1c7-c8debf1d5da2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:42:29 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-a8bc3b2a-0223-47ec-b3df-b1aa4ed98568 req-2846112f-4732-4e97-8ca9-21fdb7cb9e84 service nova] Lock "e1afe5d4-42c0-491c-b1c7-c8debf1d5da2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:42:29 user nova-compute[75122]: DEBUG nova.compute.manager [req-a8bc3b2a-0223-47ec-b3df-b1aa4ed98568 req-2846112f-4732-4e97-8ca9-21fdb7cb9e84 service nova] [instance: e1afe5d4-42c0-491c-b1c7-c8debf1d5da2] No waiting events found dispatching network-vif-plugged-f2eacefa-263d-4e6f-af4e-3ab293748b4a {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:42:29 user nova-compute[75122]: WARNING nova.compute.manager [req-a8bc3b2a-0223-47ec-b3df-b1aa4ed98568 req-2846112f-4732-4e97-8ca9-21fdb7cb9e84 service nova] [instance: e1afe5d4-42c0-491c-b1c7-c8debf1d5da2] Received unexpected event network-vif-plugged-f2eacefa-263d-4e6f-af4e-3ab293748b4a for instance with vm_state active and task_state rebuild_spawning.
Nov 15 09:42:29 user nova-compute[75122]: DEBUG nova.compute.manager [None req-8f0430ef-9426-44db-87f1-e7cd78a5967d tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] [instance: e1afe5d4-42c0-491c-b1c7-c8debf1d5da2] Checking state {{(pid=75122) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 09:42:29 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-8f0430ef-9426-44db-87f1-e7cd78a5967d tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:42:29 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-8f0430ef-9426-44db-87f1-e7cd78a5967d tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:42:29 user nova-compute[75122]: DEBUG nova.objects.instance [None req-8f0430ef-9426-44db-87f1-e7cd78a5967d tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] [instance: e1afe5d4-42c0-491c-b1c7-c8debf1d5da2] Trying to apply a migration context that does not seem to be set for this instance {{(pid=75122) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 15 09:42:29 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-8f0430ef-9426-44db-87f1-e7cd78a5967d tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.097s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:42:30 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:42:31 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:42:31 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-d0050006-d67b-483e-8dc1-e2466e986235 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Acquiring lock "df913b3e-218d-4ae6-b7b3-70f64fdd3896" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:42:31 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-d0050006-d67b-483e-8dc1-e2466e986235 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Lock "df913b3e-218d-4ae6-b7b3-70f64fdd3896" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:42:31 user nova-compute[75122]: INFO nova.compute.manager [None req-d0050006-d67b-483e-8dc1-e2466e986235 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] [instance: df913b3e-218d-4ae6-b7b3-70f64fdd3896] Detaching volume fdf09a1b-a065-4b88-815d-ee54c1c68464
Nov 15 09:42:31 user nova-compute[75122]: INFO nova.virt.block_device [None req-d0050006-d67b-483e-8dc1-e2466e986235 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] [instance: df913b3e-218d-4ae6-b7b3-70f64fdd3896] Attempting to driver detach volume fdf09a1b-a065-4b88-815d-ee54c1c68464 from mountpoint /dev/vdb
Nov 15 09:42:31 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-58d6edc5-534c-47f7-ba4b-d228224a3044 tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Acquiring lock "e815e0b5-e9c8-4ebb-aa85-b79b180595df" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:42:31 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-58d6edc5-534c-47f7-ba4b-d228224a3044 tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Lock "e815e0b5-e9c8-4ebb-aa85-b79b180595df" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:42:31 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-d0050006-d67b-483e-8dc1-e2466e986235 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Attempting to detach device vdb from instance df913b3e-218d-4ae6-b7b3-70f64fdd3896 from the persistent domain config. {{(pid=75122) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 09:42:31 user nova-compute[75122]: DEBUG nova.virt.libvirt.guest [None req-d0050006-d67b-483e-8dc1-e2466e986235 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 09:42:31 user nova-compute[75122]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 09:42:31 user nova-compute[75122]:   <source dev="/dev/sdb"/>
Nov 15 09:42:31 user nova-compute[75122]:   <target dev="vdb" bus="virtio"/>
Nov 15 09:42:31 user nova-compute[75122]:   <serial>fdf09a1b-a065-4b88-815d-ee54c1c68464</serial>
Nov 15 09:42:31 user nova-compute[75122]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 09:42:31 user nova-compute[75122]: </disk>
Nov 15 09:42:31 user nova-compute[75122]:  {{(pid=75122) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 09:42:31 user nova-compute[75122]: INFO nova.compute.manager [None req-58d6edc5-534c-47f7-ba4b-d228224a3044 tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] [instance: e815e0b5-e9c8-4ebb-aa85-b79b180595df] Detaching volume 10bad99b-3c27-4b44-bd2f-444e0c0581cb
Nov 15 09:42:31 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-d0050006-d67b-483e-8dc1-e2466e986235 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Successfully detached device vdb from instance df913b3e-218d-4ae6-b7b3-70f64fdd3896 from the persistent domain config.
Nov 15 09:42:31 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-d0050006-d67b-483e-8dc1-e2466e986235 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance df913b3e-218d-4ae6-b7b3-70f64fdd3896 from the live domain config. {{(pid=75122) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 09:42:31 user nova-compute[75122]: DEBUG nova.virt.libvirt.guest [None req-d0050006-d67b-483e-8dc1-e2466e986235 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 09:42:31 user nova-compute[75122]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 09:42:31 user nova-compute[75122]:   <source dev="/dev/sdb"/>
Nov 15 09:42:31 user nova-compute[75122]:   <target dev="vdb" bus="virtio"/>
Nov 15 09:42:31 user nova-compute[75122]:   <serial>fdf09a1b-a065-4b88-815d-ee54c1c68464</serial>
Nov 15 09:42:31 user nova-compute[75122]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 09:42:31 user nova-compute[75122]: </disk>
Nov 15 09:42:31 user nova-compute[75122]:  {{(pid=75122) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 09:42:31 user nova-compute[75122]: INFO nova.virt.block_device [None req-58d6edc5-534c-47f7-ba4b-d228224a3044 tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] [instance: e815e0b5-e9c8-4ebb-aa85-b79b180595df] Attempting to driver detach volume 10bad99b-3c27-4b44-bd2f-444e0c0581cb from mountpoint /dev/vdb
Nov 15 09:42:31 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-58d6edc5-534c-47f7-ba4b-d228224a3044 tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Attempting to detach device vdb from instance e815e0b5-e9c8-4ebb-aa85-b79b180595df from the persistent domain config. {{(pid=75122) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 09:42:31 user nova-compute[75122]: DEBUG nova.virt.libvirt.guest [None req-58d6edc5-534c-47f7-ba4b-d228224a3044 tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 09:42:31 user nova-compute[75122]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 09:42:31 user nova-compute[75122]:   <source dev="/dev/sdd"/>
Nov 15 09:42:31 user nova-compute[75122]:   <target dev="vdb" bus="virtio"/>
Nov 15 09:42:31 user nova-compute[75122]:   <serial>10bad99b-3c27-4b44-bd2f-444e0c0581cb</serial>
Nov 15 09:42:31 user nova-compute[75122]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 09:42:31 user nova-compute[75122]: </disk>
Nov 15 09:42:31 user nova-compute[75122]:  {{(pid=75122) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 09:42:31 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-46d63c66-3e11-447e-8609-918155940255 tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Acquiring lock "e815e0b5-e9c8-4ebb-aa85-b79b180595df" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:42:31 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-58d6edc5-534c-47f7-ba4b-d228224a3044 tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Successfully detached device vdb from instance e815e0b5-e9c8-4ebb-aa85-b79b180595df from the persistent domain config.
Nov 15 09:42:31 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-58d6edc5-534c-47f7-ba4b-d228224a3044 tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e815e0b5-e9c8-4ebb-aa85-b79b180595df from the live domain config. {{(pid=75122) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 09:42:31 user nova-compute[75122]: DEBUG nova.virt.libvirt.guest [None req-58d6edc5-534c-47f7-ba4b-d228224a3044 tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 09:42:31 user nova-compute[75122]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 09:42:31 user nova-compute[75122]:   <source dev="/dev/sdd"/>
Nov 15 09:42:31 user nova-compute[75122]:   <target dev="vdb" bus="virtio"/>
Nov 15 09:42:31 user nova-compute[75122]:   <serial>10bad99b-3c27-4b44-bd2f-444e0c0581cb</serial>
Nov 15 09:42:31 user nova-compute[75122]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 09:42:31 user nova-compute[75122]: </disk>
Nov 15 09:42:31 user nova-compute[75122]:  {{(pid=75122) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 09:42:32 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-d0050006-d67b-483e-8dc1-e2466e986235 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance df913b3e-218d-4ae6-b7b3-70f64fdd3896 {{(pid=75122) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 09:42:32 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-58d6edc5-534c-47f7-ba4b-d228224a3044 tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e815e0b5-e9c8-4ebb-aa85-b79b180595df {{(pid=75122) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 09:42:35 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:42:36 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:42:40 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:42:45 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:42:45 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:42:45 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=75122) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 09:42:45 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75122) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 09:42:45 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:42:45 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75122) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 09:42:46 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:42:50 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:42:51 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:42:52 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-d0050006-d67b-483e-8dc1-e2466e986235 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance df913b3e-218d-4ae6-b7b3-70f64fdd3896 is timed out.
Nov 15 09:42:52 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-d0050006-d67b-483e-8dc1-e2466e986235 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Successfully detached device vdb from instance df913b3e-218d-4ae6-b7b3-70f64fdd3896 from the live domain config.
Nov 15 09:42:52 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d0050006-d67b-483e-8dc1-e2466e986235 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] [instance: df913b3e-218d-4ae6-b7b3-70f64fdd3896] calling os-brick to detach iSCSI Volume {{(pid=75122) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 09:42:52 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0050006-d67b-483e-8dc1-e2466e986235 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffa04060b80>, {'target_iqn': 'iqn.2010-10.org.openstack:fdf09a1b-a065-4b88-815d-ee54c1c68464', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QfwYZitq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 09:42:52 user nova-compute[75122]: WARNING os_brick.initiator.connectors.base [None req-d0050006-d67b-483e-8dc1-e2466e986235 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 09:42:52 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-d0050006-d67b-483e-8dc1-e2466e986235 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 09:42:52 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-d0050006-d67b-483e-8dc1-e2466e986235 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 09:42:52 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:42:52 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:42:52 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[36b78c8f-ae45-4f32-a1aa-7fb12e7a85f8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:395810b1-e3c3-4660-aaaf-b6d9e7cb5a88\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fdf09a1b-a065-4b88-815d-ee54c1c68464\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:10bad99b-3c27-4b44-bd2f-444e0c0581cb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:42:52 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0050006-d67b-483e-8dc1-e2466e986235 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 09:42:52 user nova-compute[75122]: No targets found.
Nov 15 09:42:52 user nova-compute[75122]: iSNS:
Nov 15 09:42:52 user nova-compute[75122]: No targets found.
Nov 15 09:42:52 user nova-compute[75122]: STATIC:
Nov 15 09:42:52 user nova-compute[75122]: Target: iqn.2010-10.org.openstack:395810b1-e3c3-4660-aaaf-b6d9e7cb5a88
Nov 15 09:42:52 user nova-compute[75122]:         Portal: 172.16.0.220:3260,-1
Nov 15 09:42:52 user nova-compute[75122]:                 Iface Name: default
Nov 15 09:42:52 user nova-compute[75122]: Target: iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17
Nov 15 09:42:52 user nova-compute[75122]:         Portal: 172.16.0.220:3260,-1
Nov 15 09:42:52 user nova-compute[75122]:                 Iface Name: default
Nov 15 09:42:52 user nova-compute[75122]: Target: iqn.2010-10.org.openstack:fdf09a1b-a065-4b88-815d-ee54c1c68464
Nov 15 09:42:52 user nova-compute[75122]:         Portal: 172.16.0.220:3260,-1
Nov 15 09:42:52 user nova-compute[75122]:                 Iface Name: default
Nov 15 09:42:52 user nova-compute[75122]: Target: iqn.2010-10.org.openstack:10bad99b-3c27-4b44-bd2f-444e0c0581cb
Nov 15 09:42:52 user nova-compute[75122]:         Portal: 172.16.0.220:3260,-1
Nov 15 09:42:52 user nova-compute[75122]:                 Iface Name: default
Nov 15 09:42:52 user nova-compute[75122]: FIRMWARE:
Nov 15 09:42:52 user nova-compute[75122]: No targets found.
Nov 15 09:42:52 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 09:42:52 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0050006-d67b-483e-8dc1-e2466e986235 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 09:42:52 user nova-compute[75122]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 09:42:52 user nova-compute[75122]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75122) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 09:42:52 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0050006-d67b-483e-8dc1-e2466e986235 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fdf09a1b-a065-4b88-815d-ee54c1c68464', 0)] {{(pid=75122) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 09:42:52 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:42:52 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:42:52 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca32c986-8049-4b21-969b-cbeca9ab0291]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:10bad99b-3c27-4b44-bd2f-444e0c0581cb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:395810b1-e3c3-4660-aaaf-b6d9e7cb5a88\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fdf09a1b-a065-4b88-815d-ee54c1c68464\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:42:52 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:42:52 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:42:52 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0ff9ec2-927e-4e23-ac2e-f1181c3b764f]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdf09a1b-a065-4b88-815d-ee54c1c68464 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10bad99b-3c27-4b44-bd2f-444e0c0581cb (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:395810b1-e3c3-4660-aaaf-b6d9e7cb5a88 (non-flash)\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:42:52 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0050006-d67b-483e-8dc1-e2466e986235 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdf09a1b-a065-4b88-815d-ee54c1c68464 (non-flash)
Nov 15 09:42:52 user nova-compute[75122]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17 (non-flash)
Nov 15 09:42:52 user nova-compute[75122]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10bad99b-3c27-4b44-bd2f-444e0c0581cb (non-flash)
Nov 15 09:42:52 user nova-compute[75122]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:395810b1-e3c3-4660-aaaf-b6d9e7cb5a88 (non-flash)
Nov 15 09:42:52 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 09:42:52 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0050006-d67b-483e-8dc1-e2466e986235 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdf09a1b-a065-4b88-815d-ee54c1c68464 (non-flash)
Nov 15 09:42:52 user nova-compute[75122]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17 (non-flash)
Nov 15 09:42:52 user nova-compute[75122]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10bad99b-3c27-4b44-bd2f-444e0c0581cb (non-flash)
Nov 15 09:42:52 user nova-compute[75122]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:395810b1-e3c3-4660-aaaf-b6d9e7cb5a88 (non-flash)
Nov 15 09:42:52 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 09:42:52 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0050006-d67b-483e-8dc1-e2466e986235 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ffa089cb1c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fdf09a1b-a065-4b88-815d-ee54c1c68464'): ({'sdb'}, set())}) {{(pid=75122) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 09:42:52 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-d0050006-d67b-483e-8dc1-e2466e986235 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Removing single pathed devices sdb {{(pid=75122) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 09:42:52 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:42:52 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:42:52 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1075c56-e013-4b4b-9830-14abdd957053]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:42:52 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:42:52 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:42:52 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[223452f5-3985-4eb2-98fe-da2a8e8972ba]: (4, ('ok\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:42:52 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-d0050006-d67b-483e-8dc1-e2466e986235 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Flushing IO for device /dev/sdb {{(pid=75122) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 09:42:52 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:42:52 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:42:52 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[36754c9d-5ae5-4fe4-be44-1330b2a06a81]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:42:52 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-d0050006-d67b-483e-8dc1-e2466e986235 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75122) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 09:42:52 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:42:52 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:42:52 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[59b700c5-9997-4fe8-8fc9-b6df52be23a9]: (4, ('1', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:42:52 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-d0050006-d67b-483e-8dc1-e2466e986235 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75122) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 09:42:52 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-d0050006-d67b-483e-8dc1-e2466e986235 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] SCSI volumes sdb have been removed. {{(pid=75122) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 09:42:52 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0050006-d67b-483e-8dc1-e2466e986235 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fdf09a1b-a065-4b88-815d-ee54c1c68464')] {{(pid=75122) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 09:42:52 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fdf09a1b-a065-4b88-815d-ee54c1c68464 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:42:52 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fdf09a1b-a065-4b88-815d-ee54c1c68464 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:42:52 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[2418ce4f-3e07-41ce-b994-f42ef92b0148]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:42:52 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0050006-d67b-483e-8dc1-e2466e986235 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:42:52 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fdf09a1b-a065-4b88-815d-ee54c1c68464 -p 172.16.0.220:3260 --logout {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:42:52 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fdf09a1b-a065-4b88-815d-ee54c1c68464 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:42:52 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[c43e6acd-0a10-4066-8e99-a8933ba2f55b]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:fdf09a1b-a065-4b88-815d-ee54c1c68464, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:fdf09a1b-a065-4b88-815d-ee54c1c68464, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:42:52 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0050006-d67b-483e-8dc1-e2466e986235 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:fdf09a1b-a065-4b88-815d-ee54c1c68464, portal: 172.16.0.220,3260]
Nov 15 09:42:52 user nova-compute[75122]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:fdf09a1b-a065-4b88-815d-ee54c1c68464, portal: 172.16.0.220,3260] successful.
Nov 15 09:42:52 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:42:52 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fdf09a1b-a065-4b88-815d-ee54c1c68464 -p 172.16.0.220:3260 --op delete {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:42:52 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fdf09a1b-a065-4b88-815d-ee54c1c68464 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:42:52 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[30ba5c8c-5b63-4c01-9796-b38ed13486d3]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:42:52 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0050006-d67b-483e-8dc1-e2466e986235 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:42:52 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-d0050006-d67b-483e-8dc1-e2466e986235 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.283s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 09:42:52 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0050006-d67b-483e-8dc1-e2466e986235 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] <== disconnect_volume: return (284ms) None {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 09:42:52 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d0050006-d67b-483e-8dc1-e2466e986235 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] [instance: df913b3e-218d-4ae6-b7b3-70f64fdd3896] Disconnected iSCSI Volume {{(pid=75122) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 09:42:52 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-58d6edc5-534c-47f7-ba4b-d228224a3044 tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance e815e0b5-e9c8-4ebb-aa85-b79b180595df is timed out.
Nov 15 09:42:52 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-58d6edc5-534c-47f7-ba4b-d228224a3044 tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Successfully detached device vdb from instance e815e0b5-e9c8-4ebb-aa85-b79b180595df from the live domain config.
Nov 15 09:42:52 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-58d6edc5-534c-47f7-ba4b-d228224a3044 tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] [instance: e815e0b5-e9c8-4ebb-aa85-b79b180595df] calling os-brick to detach iSCSI Volume {{(pid=75122) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 09:42:52 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-58d6edc5-534c-47f7-ba4b-d228224a3044 tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffa04060b80>, {'target_iqn': 'iqn.2010-10.org.openstack:10bad99b-3c27-4b44-bd2f-444e0c0581cb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XOflmCDG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 09:42:52 user nova-compute[75122]: WARNING os_brick.initiator.connectors.base [None req-58d6edc5-534c-47f7-ba4b-d228224a3044 tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 09:42:52 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-58d6edc5-534c-47f7-ba4b-d228224a3044 tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 09:42:52 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-58d6edc5-534c-47f7-ba4b-d228224a3044 tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 09:42:52 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:42:52 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:42:52 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[56ad22df-a168-4620-ab66-74f95cf3cb0d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:395810b1-e3c3-4660-aaaf-b6d9e7cb5a88\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:10bad99b-3c27-4b44-bd2f-444e0c0581cb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:42:52 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-58d6edc5-534c-47f7-ba4b-d228224a3044 tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 09:42:52 user nova-compute[75122]: No targets found.
Nov 15 09:42:52 user nova-compute[75122]: iSNS:
Nov 15 09:42:52 user nova-compute[75122]: No targets found.
Nov 15 09:42:52 user nova-compute[75122]: STATIC:
Nov 15 09:42:52 user nova-compute[75122]: Target: iqn.2010-10.org.openstack:395810b1-e3c3-4660-aaaf-b6d9e7cb5a88
Nov 15 09:42:52 user nova-compute[75122]:         Portal: 172.16.0.220:3260,-1
Nov 15 09:42:52 user nova-compute[75122]:                 Iface Name: default
Nov 15 09:42:52 user nova-compute[75122]: Target: iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17
Nov 15 09:42:52 user nova-compute[75122]:         Portal: 172.16.0.220:3260,-1
Nov 15 09:42:52 user nova-compute[75122]:                 Iface Name: default
Nov 15 09:42:52 user nova-compute[75122]: Target: iqn.2010-10.org.openstack:10bad99b-3c27-4b44-bd2f-444e0c0581cb
Nov 15 09:42:52 user nova-compute[75122]:         Portal: 172.16.0.220:3260,-1
Nov 15 09:42:52 user nova-compute[75122]:                 Iface Name: default
Nov 15 09:42:52 user nova-compute[75122]: FIRMWARE:
Nov 15 09:42:52 user nova-compute[75122]: No targets found.
Nov 15 09:42:52 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 09:42:52 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-58d6edc5-534c-47f7-ba4b-d228224a3044 tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 09:42:52 user nova-compute[75122]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 09:42:52 user nova-compute[75122]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75122) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 09:42:52 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-58d6edc5-534c-47f7-ba4b-d228224a3044 tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:10bad99b-3c27-4b44-bd2f-444e0c0581cb', 0)] {{(pid=75122) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 09:42:52 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:42:52 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:42:52 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[94a16979-47d4-4c9d-bf59-7da069326301]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:10bad99b-3c27-4b44-bd2f-444e0c0581cb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:395810b1-e3c3-4660-aaaf-b6d9e7cb5a88\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:42:52 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:42:52 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:42:52 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3b3d713-5c32-4ce7-80e3-934d318ae291]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10bad99b-3c27-4b44-bd2f-444e0c0581cb (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:395810b1-e3c3-4660-aaaf-b6d9e7cb5a88 (non-flash)\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:42:52 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-58d6edc5-534c-47f7-ba4b-d228224a3044 tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17 (non-flash)
Nov 15 09:42:52 user nova-compute[75122]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10bad99b-3c27-4b44-bd2f-444e0c0581cb (non-flash)
Nov 15 09:42:52 user nova-compute[75122]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:395810b1-e3c3-4660-aaaf-b6d9e7cb5a88 (non-flash)
Nov 15 09:42:52 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 09:42:52 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-58d6edc5-534c-47f7-ba4b-d228224a3044 tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17 (non-flash)
Nov 15 09:42:52 user nova-compute[75122]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10bad99b-3c27-4b44-bd2f-444e0c0581cb (non-flash)
Nov 15 09:42:52 user nova-compute[75122]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:395810b1-e3c3-4660-aaaf-b6d9e7cb5a88 (non-flash)
Nov 15 09:42:52 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 09:42:52 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-58d6edc5-534c-47f7-ba4b-d228224a3044 tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff9fc1f9900>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:10bad99b-3c27-4b44-bd2f-444e0c0581cb'): ({'sdd'}, set())}) {{(pid=75122) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 09:42:52 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-58d6edc5-534c-47f7-ba4b-d228224a3044 tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Removing single pathed devices sdd {{(pid=75122) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 09:42:52 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:42:52 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:42:52 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2bd3f5c-b05d-4eec-b0ed-5eec6bd621a3]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:42:52 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:42:52 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.017s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:42:52 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[d502c234-a5b5-48d3-9f6b-cb0819735536]: (4, ('ok\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:42:52 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-58d6edc5-534c-47f7-ba4b-d228224a3044 tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Flushing IO for device /dev/sdd {{(pid=75122) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 09:42:52 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:42:52 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:42:52 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5b470ad-4066-4dd5-85ad-9ce6999cbdf3]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:42:52 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-58d6edc5-534c-47f7-ba4b-d228224a3044 tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75122) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 09:42:52 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:42:52 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.036s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:42:52 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd7ddd70-7b7c-4556-9bbd-e41d62da6bda]: (4, ('1', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:42:52 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-58d6edc5-534c-47f7-ba4b-d228224a3044 tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75122) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 09:42:52 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-58d6edc5-534c-47f7-ba4b-d228224a3044 tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] SCSI volumes sdd have been removed. {{(pid=75122) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 09:42:52 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-58d6edc5-534c-47f7-ba4b-d228224a3044 tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:10bad99b-3c27-4b44-bd2f-444e0c0581cb')] {{(pid=75122) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 09:42:52 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10bad99b-3c27-4b44-bd2f-444e0c0581cb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:42:52 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10bad99b-3c27-4b44-bd2f-444e0c0581cb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:42:52 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa631828-9c29-46c8-86a1-7de9a764eeaf]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:42:52 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-58d6edc5-534c-47f7-ba4b-d228224a3044 tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:42:52 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10bad99b-3c27-4b44-bd2f-444e0c0581cb -p 172.16.0.220:3260 --logout {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:42:52 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10bad99b-3c27-4b44-bd2f-444e0c0581cb -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:42:52 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8dc7e58-b755-484f-b9b1-92a551fc23b5]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:10bad99b-3c27-4b44-bd2f-444e0c0581cb, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:10bad99b-3c27-4b44-bd2f-444e0c0581cb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:42:52 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-58d6edc5-534c-47f7-ba4b-d228224a3044 tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:10bad99b-3c27-4b44-bd2f-444e0c0581cb, portal: 172.16.0.220,3260]
Nov 15 09:42:52 user nova-compute[75122]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:10bad99b-3c27-4b44-bd2f-444e0c0581cb, portal: 172.16.0.220,3260] successful.
Nov 15 09:42:52 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:42:52 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10bad99b-3c27-4b44-bd2f-444e0c0581cb -p 172.16.0.220:3260 --op delete {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:42:52 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10bad99b-3c27-4b44-bd2f-444e0c0581cb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:42:52 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3cbc547-5912-489c-991d-684c7070dc51]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:42:52 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-58d6edc5-534c-47f7-ba4b-d228224a3044 tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:42:52 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-58d6edc5-534c-47f7-ba4b-d228224a3044 tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.289s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 09:42:52 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-58d6edc5-534c-47f7-ba4b-d228224a3044 tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] <== disconnect_volume: return (291ms) None {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 09:42:52 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-58d6edc5-534c-47f7-ba4b-d228224a3044 tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] [instance: e815e0b5-e9c8-4ebb-aa85-b79b180595df] Disconnected iSCSI Volume {{(pid=75122) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 09:42:53 user nova-compute[75122]: DEBUG nova.objects.instance [None req-d0050006-d67b-483e-8dc1-e2466e986235 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Lazy-loading 'flavor' on Instance uuid df913b3e-218d-4ae6-b7b3-70f64fdd3896 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:42:53 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-d0050006-d67b-483e-8dc1-e2466e986235 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Lock "df913b3e-218d-4ae6-b7b3-70f64fdd3896" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.980s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:42:53 user nova-compute[75122]: DEBUG nova.objects.instance [None req-58d6edc5-534c-47f7-ba4b-d228224a3044 tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Lazy-loading 'flavor' on Instance uuid e815e0b5-e9c8-4ebb-aa85-b79b180595df {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:42:53 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-58d6edc5-534c-47f7-ba4b-d228224a3044 tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Lock "e815e0b5-e9c8-4ebb-aa85-b79b180595df" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.961s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:42:53 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-46d63c66-3e11-447e-8609-918155940255 tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Lock "e815e0b5-e9c8-4ebb-aa85-b79b180595df" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.843s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:42:53 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-46d63c66-3e11-447e-8609-918155940255 tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Acquiring lock "e815e0b5-e9c8-4ebb-aa85-b79b180595df-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:42:53 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-46d63c66-3e11-447e-8609-918155940255 tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Lock "e815e0b5-e9c8-4ebb-aa85-b79b180595df-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:42:53 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-46d63c66-3e11-447e-8609-918155940255 tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Lock "e815e0b5-e9c8-4ebb-aa85-b79b180595df-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:42:53 user nova-compute[75122]: INFO nova.compute.manager [None req-46d63c66-3e11-447e-8609-918155940255 tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] [instance: e815e0b5-e9c8-4ebb-aa85-b79b180595df] Terminating instance
Nov 15 09:42:53 user nova-compute[75122]: DEBUG nova.compute.manager [None req-46d63c66-3e11-447e-8609-918155940255 tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] [instance: e815e0b5-e9c8-4ebb-aa85-b79b180595df] Start destroying the instance on the hypervisor. {{(pid=75122) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 09:42:53 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:42:53 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:42:53 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:42:53 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:42:53 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:42:53 user nova-compute[75122]: DEBUG nova.compute.manager [req-bb5ef60f-72ce-4d2c-96f5-8fe93a82ee91 req-1278b618-a929-424f-b557-6a344e73bf57 service nova] [instance: e815e0b5-e9c8-4ebb-aa85-b79b180595df] Received event network-vif-unplugged-2ec5e226-5264-46e3-980b-48ab765ecb54 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:42:53 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-bb5ef60f-72ce-4d2c-96f5-8fe93a82ee91 req-1278b618-a929-424f-b557-6a344e73bf57 service nova] Acquiring lock "e815e0b5-e9c8-4ebb-aa85-b79b180595df-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:42:53 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-bb5ef60f-72ce-4d2c-96f5-8fe93a82ee91 req-1278b618-a929-424f-b557-6a344e73bf57 service nova] Lock "e815e0b5-e9c8-4ebb-aa85-b79b180595df-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:42:53 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-bb5ef60f-72ce-4d2c-96f5-8fe93a82ee91 req-1278b618-a929-424f-b557-6a344e73bf57 service nova] Lock "e815e0b5-e9c8-4ebb-aa85-b79b180595df-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:42:53 user nova-compute[75122]: DEBUG nova.compute.manager [req-bb5ef60f-72ce-4d2c-96f5-8fe93a82ee91 req-1278b618-a929-424f-b557-6a344e73bf57 service nova] [instance: e815e0b5-e9c8-4ebb-aa85-b79b180595df] No waiting events found dispatching network-vif-unplugged-2ec5e226-5264-46e3-980b-48ab765ecb54 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:42:53 user nova-compute[75122]: DEBUG nova.compute.manager [req-bb5ef60f-72ce-4d2c-96f5-8fe93a82ee91 req-1278b618-a929-424f-b557-6a344e73bf57 service nova] [instance: e815e0b5-e9c8-4ebb-aa85-b79b180595df] Received event network-vif-unplugged-2ec5e226-5264-46e3-980b-48ab765ecb54 for instance with task_state deleting. {{(pid=75122) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 09:42:54 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:42:54 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:42:54 user nova-compute[75122]: INFO nova.virt.libvirt.driver [-] [instance: e815e0b5-e9c8-4ebb-aa85-b79b180595df] Instance destroyed successfully.
Nov 15 09:42:54 user nova-compute[75122]: DEBUG nova.objects.instance [None req-46d63c66-3e11-447e-8609-918155940255 tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Lazy-loading 'resources' on Instance uuid e815e0b5-e9c8-4ebb-aa85-b79b180595df {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:42:54 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-46d63c66-3e11-447e-8609-918155940255 tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T09:40:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1796816628',display_name='tempest-VolumesSnapshotTestJSON-instance-1796816628',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1796816628',id=25,image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPZVXvYXAy37AlUx2l8+OvR87U0uWeZ7IVch8c1tm509pBcdcHWHvbWlDP+7xy/ZOU+Q7P/i82UvbN0uBDLqc9Qf8f6qHO22W5bjtplvBFauPsGqRoPcA7bzwPuDzOiIuQ==',key_name='tempest-keypair-303809446',keypairs=<?>,launch_index=0,launched_at=2023-11-15T09:40:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ac8ea42f6a3446e8a8edcf3dcb016b84',ramdisk_id='',reservation_id='r-bh829twx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1852829755',owner_user_name='tempest-VolumesSnapshotTestJSON-1852829755-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T09:40:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7e5545ae1ca743d4ada8e28d28fca540',uuid=e815e0b5-e9c8-4ebb-aa85-b79b180595df,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2ec5e226-5264-46e3-980b-48ab765ecb54", "address": "fa:16:3e:38:e8:08", "network": {"id": "cd74302c-bfd9-495b-887f-0de0d94f4ffc", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-692728798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac8ea42f6a3446e8a8edcf3dcb016b84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ec5e226-52", "ovs_interfaceid": "2ec5e226-5264-46e3-980b-48ab765ecb54", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 09:42:54 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-46d63c66-3e11-447e-8609-918155940255 tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Converting VIF {"id": "2ec5e226-5264-46e3-980b-48ab765ecb54", "address": "fa:16:3e:38:e8:08", "network": {"id": "cd74302c-bfd9-495b-887f-0de0d94f4ffc", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-692728798-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.97", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ac8ea42f6a3446e8a8edcf3dcb016b84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ec5e226-52", "ovs_interfaceid": "2ec5e226-5264-46e3-980b-48ab765ecb54", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 09:42:54 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-46d63c66-3e11-447e-8609-918155940255 tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:38:e8:08,bridge_name='br-int',has_traffic_filtering=True,id=2ec5e226-5264-46e3-980b-48ab765ecb54,network=Network(cd74302c-bfd9-495b-887f-0de0d94f4ffc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ec5e226-52') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 09:42:54 user nova-compute[75122]: DEBUG os_vif [None req-46d63c66-3e11-447e-8609-918155940255 tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:38:e8:08,bridge_name='br-int',has_traffic_filtering=True,id=2ec5e226-5264-46e3-980b-48ab765ecb54,network=Network(cd74302c-bfd9-495b-887f-0de0d94f4ffc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ec5e226-52') {{(pid=75122) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 09:42:54 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:42:54 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2ec5e226-52, bridge=br-int, if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:42:54 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:42:54 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:42:54 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:42:54 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1c8e31e2-825a-4e4b-a134-08dc03046867) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:42:54 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:42:54 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:42:54 user nova-compute[75122]: INFO os_vif [None req-46d63c66-3e11-447e-8609-918155940255 tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:38:e8:08,bridge_name='br-int',has_traffic_filtering=True,id=2ec5e226-5264-46e3-980b-48ab765ecb54,network=Network(cd74302c-bfd9-495b-887f-0de0d94f4ffc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ec5e226-52')
Nov 15 09:42:54 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-46d63c66-3e11-447e-8609-918155940255 tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] [instance: e815e0b5-e9c8-4ebb-aa85-b79b180595df] calling os-brick to detach iSCSI Volume {{(pid=75122) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 09:42:54 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-46d63c66-3e11-447e-8609-918155940255 tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffa04060b80>, {'target_iqn': 'iqn.2010-10.org.openstack:10bad99b-3c27-4b44-bd2f-444e0c0581cb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XOflmCDG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 09:42:54 user nova-compute[75122]: WARNING os_brick.initiator.connectors.base [None req-46d63c66-3e11-447e-8609-918155940255 tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 09:42:54 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-46d63c66-3e11-447e-8609-918155940255 tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 09:42:54 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-46d63c66-3e11-447e-8609-918155940255 tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 09:42:54 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:42:54 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:42:54 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5877499-adf0-4231-8dad-7c057074118b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:395810b1-e3c3-4660-aaaf-b6d9e7cb5a88\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:42:54 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-46d63c66-3e11-447e-8609-918155940255 tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 09:42:54 user nova-compute[75122]: No targets found.
Nov 15 09:42:54 user nova-compute[75122]: iSNS:
Nov 15 09:42:54 user nova-compute[75122]: No targets found.
Nov 15 09:42:54 user nova-compute[75122]: STATIC:
Nov 15 09:42:54 user nova-compute[75122]: Target: iqn.2010-10.org.openstack:395810b1-e3c3-4660-aaaf-b6d9e7cb5a88
Nov 15 09:42:54 user nova-compute[75122]:         Portal: 172.16.0.220:3260,-1
Nov 15 09:42:54 user nova-compute[75122]:                 Iface Name: default
Nov 15 09:42:54 user nova-compute[75122]: Target: iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17
Nov 15 09:42:54 user nova-compute[75122]:         Portal: 172.16.0.220:3260,-1
Nov 15 09:42:54 user nova-compute[75122]:                 Iface Name: default
Nov 15 09:42:54 user nova-compute[75122]: FIRMWARE:
Nov 15 09:42:54 user nova-compute[75122]: No targets found.
Nov 15 09:42:54 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 09:42:54 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-46d63c66-3e11-447e-8609-918155940255 tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 09:42:54 user nova-compute[75122]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 09:42:54 user nova-compute[75122]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75122) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 09:42:54 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-46d63c66-3e11-447e-8609-918155940255 tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:10bad99b-3c27-4b44-bd2f-444e0c0581cb', 0)] {{(pid=75122) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 09:42:54 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:42:54 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:42:54 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3512b35-7136-47b7-860a-be498a44e425]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:395810b1-e3c3-4660-aaaf-b6d9e7cb5a88\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:42:54 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:42:54 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:42:54 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[daa88fbe-840d-4519-b9d9-dcd52d7b43ee]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:395810b1-e3c3-4660-aaaf-b6d9e7cb5a88 (non-flash)\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:42:54 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-46d63c66-3e11-447e-8609-918155940255 tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17 (non-flash)
Nov 15 09:42:54 user nova-compute[75122]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:395810b1-e3c3-4660-aaaf-b6d9e7cb5a88 (non-flash)
Nov 15 09:42:54 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 09:42:54 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-46d63c66-3e11-447e-8609-918155940255 tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17 (non-flash)
Nov 15 09:42:54 user nova-compute[75122]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:395810b1-e3c3-4660-aaaf-b6d9e7cb5a88 (non-flash)
Nov 15 09:42:54 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 09:42:54 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-46d63c66-3e11-447e-8609-918155940255 tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ffa04496cb0>, {}) {{(pid=75122) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 09:42:54 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-46d63c66-3e11-447e-8609-918155940255 tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Disconnecting from: [] {{(pid=75122) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 09:42:54 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-46d63c66-3e11-447e-8609-918155940255 tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.064s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 09:42:54 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-46d63c66-3e11-447e-8609-918155940255 tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] <== disconnect_volume: return (66ms) None {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 09:42:54 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-46d63c66-3e11-447e-8609-918155940255 tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] [instance: e815e0b5-e9c8-4ebb-aa85-b79b180595df] Disconnected iSCSI Volume {{(pid=75122) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 09:42:54 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-46d63c66-3e11-447e-8609-918155940255 tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] [instance: e815e0b5-e9c8-4ebb-aa85-b79b180595df] Deleting instance files /opt/stack/data/nova/instances/e815e0b5-e9c8-4ebb-aa85-b79b180595df_del
Nov 15 09:42:54 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-46d63c66-3e11-447e-8609-918155940255 tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] [instance: e815e0b5-e9c8-4ebb-aa85-b79b180595df] Deletion of /opt/stack/data/nova/instances/e815e0b5-e9c8-4ebb-aa85-b79b180595df_del complete
Nov 15 09:42:54 user nova-compute[75122]: INFO nova.compute.manager [None req-46d63c66-3e11-447e-8609-918155940255 tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] [instance: e815e0b5-e9c8-4ebb-aa85-b79b180595df] Took 0.90 seconds to destroy the instance on the hypervisor.
Nov 15 09:42:54 user nova-compute[75122]: DEBUG oslo.service.loopingcall [None req-46d63c66-3e11-447e-8609-918155940255 tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75122) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 09:42:54 user nova-compute[75122]: DEBUG nova.compute.manager [-] [instance: e815e0b5-e9c8-4ebb-aa85-b79b180595df] Deallocating network for instance {{(pid=75122) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 09:42:54 user nova-compute[75122]: DEBUG nova.network.neutron [-] [instance: e815e0b5-e9c8-4ebb-aa85-b79b180595df] deallocate_for_instance() {{(pid=75122) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 09:42:55 user nova-compute[75122]: DEBUG nova.network.neutron [-] [instance: e815e0b5-e9c8-4ebb-aa85-b79b180595df] Updating instance_info_cache with network_info: [] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:42:55 user nova-compute[75122]: INFO nova.compute.manager [-] [instance: e815e0b5-e9c8-4ebb-aa85-b79b180595df] Took 0.78 seconds to deallocate network for instance.
Nov 15 09:42:55 user nova-compute[75122]: WARNING nova.volume.cinder [None req-46d63c66-3e11-447e-8609-918155940255 tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Attachment 9d50f438-c541-4e39-b542-8268fb34c414 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 9d50f438-c541-4e39-b542-8268fb34c414. (HTTP 404) (Request-ID: req-7e97353b-9250-4b63-9c19-118408717fec)
Nov 15 09:42:55 user nova-compute[75122]: INFO nova.compute.manager [None req-46d63c66-3e11-447e-8609-918155940255 tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] [instance: e815e0b5-e9c8-4ebb-aa85-b79b180595df] Took 0.02 seconds to detach 1 volumes for instance.
Nov 15 09:42:55 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-46d63c66-3e11-447e-8609-918155940255 tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:42:55 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-46d63c66-3e11-447e-8609-918155940255 tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:42:55 user nova-compute[75122]: DEBUG nova.compute.manager [req-3eae7333-110c-4f68-8f2c-fc1d9b6c4cf0 req-a6852c95-d9c7-4d8f-90a3-124d7cbcacd6 service nova] [instance: 6f6177c5-3048-4a78-b34a-e595d26d69d0] Received event network-changed-8f77c03f-9bb8-441c-97a9-19bb14a14d89 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:42:55 user nova-compute[75122]: DEBUG nova.compute.manager [req-3eae7333-110c-4f68-8f2c-fc1d9b6c4cf0 req-a6852c95-d9c7-4d8f-90a3-124d7cbcacd6 service nova] [instance: 6f6177c5-3048-4a78-b34a-e595d26d69d0] Refreshing instance network info cache due to event network-changed-8f77c03f-9bb8-441c-97a9-19bb14a14d89. {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 09:42:55 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-3eae7333-110c-4f68-8f2c-fc1d9b6c4cf0 req-a6852c95-d9c7-4d8f-90a3-124d7cbcacd6 service nova] Acquiring lock "refresh_cache-6f6177c5-3048-4a78-b34a-e595d26d69d0" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 09:42:55 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-3eae7333-110c-4f68-8f2c-fc1d9b6c4cf0 req-a6852c95-d9c7-4d8f-90a3-124d7cbcacd6 service nova] Acquired lock "refresh_cache-6f6177c5-3048-4a78-b34a-e595d26d69d0" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 09:42:55 user nova-compute[75122]: DEBUG nova.network.neutron [req-3eae7333-110c-4f68-8f2c-fc1d9b6c4cf0 req-a6852c95-d9c7-4d8f-90a3-124d7cbcacd6 service nova] [instance: 6f6177c5-3048-4a78-b34a-e595d26d69d0] Refreshing network info cache for port 8f77c03f-9bb8-441c-97a9-19bb14a14d89 {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 09:42:55 user nova-compute[75122]: DEBUG nova.compute.provider_tree [None req-46d63c66-3e11-447e-8609-918155940255 tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Inventory has not changed in ProviderTree for provider: 69a3da65-47be-44c6-b67c-c692b58284ef {{(pid=75122) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 09:42:55 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-46d63c66-3e11-447e-8609-918155940255 tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Inventory has not changed for provider 69a3da65-47be-44c6-b67c-c692b58284ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 09:42:55 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-46d63c66-3e11-447e-8609-918155940255 tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.308s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:42:55 user nova-compute[75122]: INFO nova.scheduler.client.report [None req-46d63c66-3e11-447e-8609-918155940255 tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Deleted allocations for instance e815e0b5-e9c8-4ebb-aa85-b79b180595df
Nov 15 09:42:55 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-46d63c66-3e11-447e-8609-918155940255 tempest-VolumesSnapshotTestJSON-1852829755 tempest-VolumesSnapshotTestJSON-1852829755-project-member] Lock "e815e0b5-e9c8-4ebb-aa85-b79b180595df" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.290s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:42:55 user nova-compute[75122]: DEBUG nova.compute.manager [req-86e22dab-d6ae-4c60-a73d-2d9fde00b371 req-c01e45c8-66c5-4190-bb0e-5ddd60511c18 service nova] [instance: e815e0b5-e9c8-4ebb-aa85-b79b180595df] Received event network-vif-plugged-2ec5e226-5264-46e3-980b-48ab765ecb54 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:42:55 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-86e22dab-d6ae-4c60-a73d-2d9fde00b371 req-c01e45c8-66c5-4190-bb0e-5ddd60511c18 service nova] Acquiring lock "e815e0b5-e9c8-4ebb-aa85-b79b180595df-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:42:55 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-86e22dab-d6ae-4c60-a73d-2d9fde00b371 req-c01e45c8-66c5-4190-bb0e-5ddd60511c18 service nova] Lock "e815e0b5-e9c8-4ebb-aa85-b79b180595df-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:42:55 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-86e22dab-d6ae-4c60-a73d-2d9fde00b371 req-c01e45c8-66c5-4190-bb0e-5ddd60511c18 service nova] Lock "e815e0b5-e9c8-4ebb-aa85-b79b180595df-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:42:55 user nova-compute[75122]: DEBUG nova.compute.manager [req-86e22dab-d6ae-4c60-a73d-2d9fde00b371 req-c01e45c8-66c5-4190-bb0e-5ddd60511c18 service nova] [instance: e815e0b5-e9c8-4ebb-aa85-b79b180595df] No waiting events found dispatching network-vif-plugged-2ec5e226-5264-46e3-980b-48ab765ecb54 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:42:55 user nova-compute[75122]: WARNING nova.compute.manager [req-86e22dab-d6ae-4c60-a73d-2d9fde00b371 req-c01e45c8-66c5-4190-bb0e-5ddd60511c18 service nova] [instance: e815e0b5-e9c8-4ebb-aa85-b79b180595df] Received unexpected event network-vif-plugged-2ec5e226-5264-46e3-980b-48ab765ecb54 for instance with vm_state deleted and task_state None.
Nov 15 09:42:56 user nova-compute[75122]: DEBUG nova.compute.manager [req-86e22dab-d6ae-4c60-a73d-2d9fde00b371 req-c01e45c8-66c5-4190-bb0e-5ddd60511c18 service nova] [instance: e815e0b5-e9c8-4ebb-aa85-b79b180595df] Received event network-vif-deleted-2ec5e226-5264-46e3-980b-48ab765ecb54 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:42:56 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:42:56 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-fad438ac-dfe5-41db-8efa-2e21b88fa3b2 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Acquiring lock "6f6177c5-3048-4a78-b34a-e595d26d69d0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:42:56 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-fad438ac-dfe5-41db-8efa-2e21b88fa3b2 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Lock "6f6177c5-3048-4a78-b34a-e595d26d69d0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.011s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:42:56 user nova-compute[75122]: DEBUG nova.network.neutron [req-3eae7333-110c-4f68-8f2c-fc1d9b6c4cf0 req-a6852c95-d9c7-4d8f-90a3-124d7cbcacd6 service nova] [instance: 6f6177c5-3048-4a78-b34a-e595d26d69d0] Updated VIF entry in instance network info cache for port 8f77c03f-9bb8-441c-97a9-19bb14a14d89. {{(pid=75122) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 09:42:56 user nova-compute[75122]: DEBUG nova.network.neutron [req-3eae7333-110c-4f68-8f2c-fc1d9b6c4cf0 req-a6852c95-d9c7-4d8f-90a3-124d7cbcacd6 service nova] [instance: 6f6177c5-3048-4a78-b34a-e595d26d69d0] Updating instance_info_cache with network_info: [{"id": "8f77c03f-9bb8-441c-97a9-19bb14a14d89", "address": "fa:16:3e:18:aa:27", "network": {"id": "387b4fc3-39ad-40c3-bcd7-7526b09e30b7", "bridge": "br-int", "label": "tempest-TestStampPattern-1501769990-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.48", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bdc0f52b1c744b91b4f1a4ecd07e07c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f77c03f-9b", "ovs_interfaceid": "8f77c03f-9bb8-441c-97a9-19bb14a14d89", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:42:56 user nova-compute[75122]: DEBUG nova.objects.instance [None req-fad438ac-dfe5-41db-8efa-2e21b88fa3b2 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Lazy-loading 'flavor' on Instance uuid 6f6177c5-3048-4a78-b34a-e595d26d69d0 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:42:56 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-3eae7333-110c-4f68-8f2c-fc1d9b6c4cf0 req-a6852c95-d9c7-4d8f-90a3-124d7cbcacd6 service nova] Releasing lock "refresh_cache-6f6177c5-3048-4a78-b34a-e595d26d69d0" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 09:42:56 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-fad438ac-dfe5-41db-8efa-2e21b88fa3b2 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Lock "6f6177c5-3048-4a78-b34a-e595d26d69d0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.235s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:42:56 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-fad438ac-dfe5-41db-8efa-2e21b88fa3b2 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Acquiring lock "6f6177c5-3048-4a78-b34a-e595d26d69d0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:42:56 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-fad438ac-dfe5-41db-8efa-2e21b88fa3b2 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Lock "6f6177c5-3048-4a78-b34a-e595d26d69d0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:42:56 user nova-compute[75122]: INFO nova.compute.manager [None req-fad438ac-dfe5-41db-8efa-2e21b88fa3b2 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] [instance: 6f6177c5-3048-4a78-b34a-e595d26d69d0] Attaching volume fd818868-d5e9-440a-88a0-16ff267004be to /dev/vdb
Nov 15 09:42:56 user nova-compute[75122]: DEBUG os_brick.utils [None req-fad438ac-dfe5-41db-8efa-2e21b88fa3b2 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 09:42:56 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:42:56 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:42:56 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[78b65ead-c20c-4fb3-a0aa-42eaa74d5a80]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:742fb64b3587\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:42:56 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:42:56 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:42:56 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae3b5a98-c7e6-4595-acaa-fdc4b74863d0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:42:56 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:42:56 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:42:56 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d959ed0-2ef7-4072-a86e-cc4d210679c5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:42:56 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[dee38a8c-0ad7-414a-94f7-737d75862d0c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:42:56 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-fad438ac-dfe5-41db-8efa-2e21b88fa3b2 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Running cmd (subprocess): nvme version {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:42:56 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-fad438ac-dfe5-41db-8efa-2e21b88fa3b2 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] 'nvme version' failed. Not Retrying. {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 09:42:56 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fad438ac-dfe5-41db-8efa-2e21b88fa3b2 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] nvme not present on system {{(pid=75122) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 09:42:56 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:42:56 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 09:42:56 user nova-compute[75122]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 09:42:56 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6285b86-d25b-4ca2-8383-0c0f99ba7c55]: (4, '') {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:42:56 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.lightos [None req-fad438ac-dfe5-41db-8efa-2e21b88fa3b2 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75122) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 09:42:56 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.lightos [None req-fad438ac-dfe5-41db-8efa-2e21b88fa3b2 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75122) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 09:42:56 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.lightos [None req-fad438ac-dfe5-41db-8efa-2e21b88fa3b2 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] LIGHTOS: no hostnqn found. {{(pid=75122) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 09:42:56 user nova-compute[75122]: DEBUG os_brick.utils [None req-fad438ac-dfe5-41db-8efa-2e21b88fa3b2 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:742fb64b3587', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 09:42:56 user nova-compute[75122]: DEBUG nova.virt.block_device [None req-fad438ac-dfe5-41db-8efa-2e21b88fa3b2 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] [instance: 6f6177c5-3048-4a78-b34a-e595d26d69d0] Updating existing volume attachment record: 902173bb-a625-42cd-b38e-8ee1f6feee27 {{(pid=75122) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 09:42:59 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:43:00 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:43:01 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:43:01 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fad438ac-dfe5-41db-8efa-2e21b88fa3b2 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] [instance: 6f6177c5-3048-4a78-b34a-e595d26d69d0] Calling os-brick to attach iSCSI Volume {{(pid=75122) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 09:43:01 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-fad438ac-dfe5-41db-8efa-2e21b88fa3b2 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffa04060b80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fd818868-d5e9-440a-88a0-16ff267004be', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yZeKCqWo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 09:43:01 user nova-compute[75122]: WARNING os_brick.initiator.connectors.base [None req-fad438ac-dfe5-41db-8efa-2e21b88fa3b2 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 09:43:01 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-fad438ac-dfe5-41db-8efa-2e21b88fa3b2 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 09:43:01 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-fad438ac-dfe5-41db-8efa-2e21b88fa3b2 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 09:43:01 user nova-compute[75122]: WARNING os_brick.initiator.connectors.base [None req-fad438ac-dfe5-41db-8efa-2e21b88fa3b2 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 09:43:01 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-fad438ac-dfe5-41db-8efa-2e21b88fa3b2 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fd818868-d5e9-440a-88a0-16ff267004be" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 09:43:01 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-fad438ac-dfe5-41db-8efa-2e21b88fa3b2 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fd818868-d5e9-440a-88a0-16ff267004be" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 09:43:01 user nova-compute[75122]: INFO os_brick.initiator.connectors.iscsi [None req-fad438ac-dfe5-41db-8efa-2e21b88fa3b2 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 09:43:01 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd818868-d5e9-440a-88a0-16ff267004be -p 172.16.0.220:3260 {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:43:01 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd818868-d5e9-440a-88a0-16ff267004be -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:43:01 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dbf8a48-5f2d-4ac3-9d42-398af5885e28]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:43:01 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-fad438ac-dfe5-41db-8efa-2e21b88fa3b2 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 09:43:01 user nova-compute[75122]:  {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:43:01 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd818868-d5e9-440a-88a0-16ff267004be -p 172.16.0.220:3260 --interface default --op new {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:43:01 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd818868-d5e9-440a-88a0-16ff267004be -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:43:01 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[6562942e-70b4-4150-b992-08566df38e33]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fd818868-d5e9-440a-88a0-16ff267004be] added\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:43:01 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-fad438ac-dfe5-41db-8efa-2e21b88fa3b2 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fd818868-d5e9-440a-88a0-16ff267004be] added
Nov 15 09:43:01 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:43:01 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd818868-d5e9-440a-88a0-16ff267004be -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:43:01 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd818868-d5e9-440a-88a0-16ff267004be -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.060s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:43:01 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[5080a1b0-75c3-4df6-ab61-ad1e52895620]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:43:01 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-fad438ac-dfe5-41db-8efa-2e21b88fa3b2 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:43:01 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd818868-d5e9-440a-88a0-16ff267004be -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:43:01 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd818868-d5e9-440a-88a0-16ff267004be -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.100s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:43:01 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[64aff34e-2f86-439b-a7e9-c1a15236f9b7]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:43:01 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-fad438ac-dfe5-41db-8efa-2e21b88fa3b2 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:43:01 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd818868-d5e9-440a-88a0-16ff267004be -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yZeKCqWo {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:43:01 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd818868-d5e9-440a-88a0-16ff267004be -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yZeKCqWo" returned: 0 in 0.027s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:43:01 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[c33f3ce1-938f-45f2-b49a-1c0485ed226e]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:43:01 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-fad438ac-dfe5-41db-8efa-2e21b88fa3b2 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yZeKCqWo'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:43:01 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd818868-d5e9-440a-88a0-16ff267004be -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:43:01 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd818868-d5e9-440a-88a0-16ff267004be -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.031s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:43:01 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb6071dd-f8a0-4a60-aec8-d7e8c4d133ff]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:43:01 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-fad438ac-dfe5-41db-8efa-2e21b88fa3b2 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:43:01 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:43:01 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.048s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:43:01 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[412a6ab4-c450-4794-901d-1bff036732d9]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:395810b1-e3c3-4660-aaaf-b6d9e7cb5a88 (non-flash)\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:43:01 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-fad438ac-dfe5-41db-8efa-2e21b88fa3b2 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17 (non-flash)
Nov 15 09:43:01 user nova-compute[75122]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:395810b1-e3c3-4660-aaaf-b6d9e7cb5a88 (non-flash)
Nov 15 09:43:01 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 09:43:01 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-fad438ac-dfe5-41db-8efa-2e21b88fa3b2 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17 (non-flash)
Nov 15 09:43:01 user nova-compute[75122]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:395810b1-e3c3-4660-aaaf-b6d9e7cb5a88 (non-flash)
Nov 15 09:43:01 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 09:43:01 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd818868-d5e9-440a-88a0-16ff267004be -p 172.16.0.220:3260 --login {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:43:01 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd818868-d5e9-440a-88a0-16ff267004be -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:43:01 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4b55eba-cf02-407c-9d44-21dff14402ca]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fd818868-d5e9-440a-88a0-16ff267004be, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fd818868-d5e9-440a-88a0-16ff267004be, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:43:01 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-fad438ac-dfe5-41db-8efa-2e21b88fa3b2 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fd818868-d5e9-440a-88a0-16ff267004be, portal: 172.16.0.220,3260]
Nov 15 09:43:01 user nova-compute[75122]: Login to [iface: default, target: iqn.2010-10.org.openstack:fd818868-d5e9-440a-88a0-16ff267004be, portal: 172.16.0.220,3260] successful.
Nov 15 09:43:01 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:43:01 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd818868-d5e9-440a-88a0-16ff267004be -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:43:01 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd818868-d5e9-440a-88a0-16ff267004be -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:43:01 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[1225e4b2-3e77-4534-ba27-a7a52af58daf]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:43:01 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-fad438ac-dfe5-41db-8efa-2e21b88fa3b2 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:43:01 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:43:01 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:43:01 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[2872486b-244d-464a-8257-9a58c26784bf]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:395810b1-e3c3-4660-aaaf-b6d9e7cb5a88 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd818868-d5e9-440a-88a0-16ff267004be (non-flash)\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:43:01 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-fad438ac-dfe5-41db-8efa-2e21b88fa3b2 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17 (non-flash)
Nov 15 09:43:01 user nova-compute[75122]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:395810b1-e3c3-4660-aaaf-b6d9e7cb5a88 (non-flash)
Nov 15 09:43:01 user nova-compute[75122]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd818868-d5e9-440a-88a0-16ff267004be (non-flash)
Nov 15 09:43:01 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 09:43:01 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-fad438ac-dfe5-41db-8efa-2e21b88fa3b2 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17 (non-flash)
Nov 15 09:43:01 user nova-compute[75122]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:395810b1-e3c3-4660-aaaf-b6d9e7cb5a88 (non-flash)
Nov 15 09:43:01 user nova-compute[75122]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd818868-d5e9-440a-88a0-16ff267004be (non-flash)
Nov 15 09:43:01 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 09:43:01 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-fad438ac-dfe5-41db-8efa-2e21b88fa3b2 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fd818868-d5e9-440a-88a0-16ff267004be" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.455s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 09:43:01 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-fad438ac-dfe5-41db-8efa-2e21b88fa3b2 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Connected to 172.16.0.220:3260 {{(pid=75122) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 09:43:01 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-fad438ac-dfe5-41db-8efa-2e21b88fa3b2 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] HCTL ('33', '-', '-', 0) found on session 36 with lun 0 {{(pid=75122) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 09:43:01 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-fad438ac-dfe5-41db-8efa-2e21b88fa3b2 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75122) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 09:43:01 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:43:01 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:43:01 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e808e6e-6958-4c51-a3de-81299966db34]: (4, ('- - 0', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:43:01 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-fad438ac-dfe5-41db-8efa-2e21b88fa3b2 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Searching for a device in session 36 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75122) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 09:43:01 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-fad438ac-dfe5-41db-8efa-2e21b88fa3b2 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:fd818868-d5e9-440a-88a0-16ff267004be', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yZeKCqWo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75122) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 09:43:02 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-fad438ac-dfe5-41db-8efa-2e21b88fa3b2 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.489s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 09:43:02 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-fad438ac-dfe5-41db-8efa-2e21b88fa3b2 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] <== connect_volume: return (1491ms) {'type': 'block', 'scsi_wwn': '23534343530383965', 'path': '/dev/sdb'} {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 09:43:02 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fad438ac-dfe5-41db-8efa-2e21b88fa3b2 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] [instance: 6f6177c5-3048-4a78-b34a-e595d26d69d0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23534343530383965', 'path': '/dev/sdb'} {{(pid=75122) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 09:43:02 user nova-compute[75122]: DEBUG nova.objects.instance [None req-fad438ac-dfe5-41db-8efa-2e21b88fa3b2 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Lazy-loading 'flavor' on Instance uuid 6f6177c5-3048-4a78-b34a-e595d26d69d0 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:43:02 user nova-compute[75122]: DEBUG nova.virt.libvirt.guest [None req-fad438ac-dfe5-41db-8efa-2e21b88fa3b2 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 09:43:02 user nova-compute[75122]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 09:43:02 user nova-compute[75122]:   <source dev="/dev/sdb"/>
Nov 15 09:43:02 user nova-compute[75122]:   <target dev="vdb" bus="virtio"/>
Nov 15 09:43:02 user nova-compute[75122]:   <serial>fd818868-d5e9-440a-88a0-16ff267004be</serial>
Nov 15 09:43:02 user nova-compute[75122]: </disk>
Nov 15 09:43:02 user nova-compute[75122]:  {{(pid=75122) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 09:43:03 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-fad438ac-dfe5-41db-8efa-2e21b88fa3b2 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] No BDM found with device name vda, not building metadata. {{(pid=75122) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 09:43:03 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-fad438ac-dfe5-41db-8efa-2e21b88fa3b2 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75122) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 09:43:03 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-fad438ac-dfe5-41db-8efa-2e21b88fa3b2 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] No VIF found with MAC fa:16:3e:18:aa:27, not building metadata {{(pid=75122) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 09:43:03 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-fad438ac-dfe5-41db-8efa-2e21b88fa3b2 tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Lock "6f6177c5-3048-4a78-b34a-e595d26d69d0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.885s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:43:04 user nova-compute[75122]: DEBUG nova.compute.manager [req-37b6df6d-cf6f-43f0-96fb-9ae48f71ab84 req-1480f0d5-f7de-4cf7-a508-87b199906502 service nova] [instance: 52c066f3-dea1-4aa3-9da4-da9397b9fff1] Received event network-changed-57222fd9-53d9-4344-b5c7-1b77cb36fd65 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:43:04 user nova-compute[75122]: DEBUG nova.compute.manager [req-37b6df6d-cf6f-43f0-96fb-9ae48f71ab84 req-1480f0d5-f7de-4cf7-a508-87b199906502 service nova] [instance: 52c066f3-dea1-4aa3-9da4-da9397b9fff1] Refreshing instance network info cache due to event network-changed-57222fd9-53d9-4344-b5c7-1b77cb36fd65. {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 09:43:04 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-37b6df6d-cf6f-43f0-96fb-9ae48f71ab84 req-1480f0d5-f7de-4cf7-a508-87b199906502 service nova] Acquiring lock "refresh_cache-52c066f3-dea1-4aa3-9da4-da9397b9fff1" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 09:43:04 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-37b6df6d-cf6f-43f0-96fb-9ae48f71ab84 req-1480f0d5-f7de-4cf7-a508-87b199906502 service nova] Acquired lock "refresh_cache-52c066f3-dea1-4aa3-9da4-da9397b9fff1" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 09:43:04 user nova-compute[75122]: DEBUG nova.network.neutron [req-37b6df6d-cf6f-43f0-96fb-9ae48f71ab84 req-1480f0d5-f7de-4cf7-a508-87b199906502 service nova] [instance: 52c066f3-dea1-4aa3-9da4-da9397b9fff1] Refreshing network info cache for port 57222fd9-53d9-4344-b5c7-1b77cb36fd65 {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 09:43:04 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:43:04 user nova-compute[75122]: DEBUG nova.network.neutron [req-37b6df6d-cf6f-43f0-96fb-9ae48f71ab84 req-1480f0d5-f7de-4cf7-a508-87b199906502 service nova] [instance: 52c066f3-dea1-4aa3-9da4-da9397b9fff1] Updated VIF entry in instance network info cache for port 57222fd9-53d9-4344-b5c7-1b77cb36fd65. {{(pid=75122) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 09:43:04 user nova-compute[75122]: DEBUG nova.network.neutron [req-37b6df6d-cf6f-43f0-96fb-9ae48f71ab84 req-1480f0d5-f7de-4cf7-a508-87b199906502 service nova] [instance: 52c066f3-dea1-4aa3-9da4-da9397b9fff1] Updating instance_info_cache with network_info: [{"id": "57222fd9-53d9-4344-b5c7-1b77cb36fd65", "address": "fa:16:3e:dd:19:1b", "network": {"id": "8510a5b3-69c9-4fd8-9f2c-c83a255474b5", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-535784436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1030239722241f5ae167b813b4fee15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57222fd9-53", "ovs_interfaceid": "57222fd9-53d9-4344-b5c7-1b77cb36fd65", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:43:04 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-37b6df6d-cf6f-43f0-96fb-9ae48f71ab84 req-1480f0d5-f7de-4cf7-a508-87b199906502 service nova] Releasing lock "refresh_cache-52c066f3-dea1-4aa3-9da4-da9397b9fff1" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 09:43:05 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-6cf10367-1548-45bb-bbfd-4ac2819d38bb tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Acquiring lock "6f6177c5-3048-4a78-b34a-e595d26d69d0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:43:05 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-6cf10367-1548-45bb-bbfd-4ac2819d38bb tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Lock "6f6177c5-3048-4a78-b34a-e595d26d69d0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:43:05 user nova-compute[75122]: INFO nova.compute.manager [None req-6cf10367-1548-45bb-bbfd-4ac2819d38bb tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] [instance: 6f6177c5-3048-4a78-b34a-e595d26d69d0] Detaching volume fd818868-d5e9-440a-88a0-16ff267004be
Nov 15 09:43:05 user nova-compute[75122]: INFO nova.virt.block_device [None req-6cf10367-1548-45bb-bbfd-4ac2819d38bb tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] [instance: 6f6177c5-3048-4a78-b34a-e595d26d69d0] Attempting to driver detach volume fd818868-d5e9-440a-88a0-16ff267004be from mountpoint /dev/vdb
Nov 15 09:43:05 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-6cf10367-1548-45bb-bbfd-4ac2819d38bb tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Attempting to detach device vdb from instance 6f6177c5-3048-4a78-b34a-e595d26d69d0 from the persistent domain config. {{(pid=75122) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 09:43:05 user nova-compute[75122]: DEBUG nova.virt.libvirt.guest [None req-6cf10367-1548-45bb-bbfd-4ac2819d38bb tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 09:43:05 user nova-compute[75122]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 09:43:05 user nova-compute[75122]:   <source dev="/dev/sdb"/>
Nov 15 09:43:05 user nova-compute[75122]:   <target dev="vdb" bus="virtio"/>
Nov 15 09:43:05 user nova-compute[75122]:   <serial>fd818868-d5e9-440a-88a0-16ff267004be</serial>
Nov 15 09:43:05 user nova-compute[75122]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 09:43:05 user nova-compute[75122]: </disk>
Nov 15 09:43:05 user nova-compute[75122]:  {{(pid=75122) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 09:43:05 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-6cf10367-1548-45bb-bbfd-4ac2819d38bb tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Successfully detached device vdb from instance 6f6177c5-3048-4a78-b34a-e595d26d69d0 from the persistent domain config.
Nov 15 09:43:05 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-6cf10367-1548-45bb-bbfd-4ac2819d38bb tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 6f6177c5-3048-4a78-b34a-e595d26d69d0 from the live domain config. {{(pid=75122) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 09:43:05 user nova-compute[75122]: DEBUG nova.virt.libvirt.guest [None req-6cf10367-1548-45bb-bbfd-4ac2819d38bb tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 09:43:05 user nova-compute[75122]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 09:43:05 user nova-compute[75122]:   <source dev="/dev/sdb"/>
Nov 15 09:43:05 user nova-compute[75122]:   <target dev="vdb" bus="virtio"/>
Nov 15 09:43:05 user nova-compute[75122]:   <serial>fd818868-d5e9-440a-88a0-16ff267004be</serial>
Nov 15 09:43:05 user nova-compute[75122]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 09:43:05 user nova-compute[75122]: </disk>
Nov 15 09:43:05 user nova-compute[75122]:  {{(pid=75122) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 09:43:06 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:43:06 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:43:06 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-6cf10367-1548-45bb-bbfd-4ac2819d38bb tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 6f6177c5-3048-4a78-b34a-e595d26d69d0 {{(pid=75122) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 09:43:06 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-b6cd7076-6b3f-4e5a-af5c-f820e94e5c70 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] Acquiring lock "52c066f3-dea1-4aa3-9da4-da9397b9fff1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:43:06 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-b6cd7076-6b3f-4e5a-af5c-f820e94e5c70 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] Lock "52c066f3-dea1-4aa3-9da4-da9397b9fff1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:43:06 user nova-compute[75122]: DEBUG nova.objects.instance [None req-b6cd7076-6b3f-4e5a-af5c-f820e94e5c70 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] Lazy-loading 'flavor' on Instance uuid 52c066f3-dea1-4aa3-9da4-da9397b9fff1 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:43:06 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-b6cd7076-6b3f-4e5a-af5c-f820e94e5c70 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] Lock "52c066f3-dea1-4aa3-9da4-da9397b9fff1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:43:06 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-b6cd7076-6b3f-4e5a-af5c-f820e94e5c70 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] Acquiring lock "52c066f3-dea1-4aa3-9da4-da9397b9fff1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:43:06 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-b6cd7076-6b3f-4e5a-af5c-f820e94e5c70 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] Lock "52c066f3-dea1-4aa3-9da4-da9397b9fff1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:43:06 user nova-compute[75122]: INFO nova.compute.manager [None req-b6cd7076-6b3f-4e5a-af5c-f820e94e5c70 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] [instance: 52c066f3-dea1-4aa3-9da4-da9397b9fff1] Attaching volume 284cc694-dd22-4f9e-8f3b-787e222f8da5 to /dev/vdb
Nov 15 09:43:06 user nova-compute[75122]: DEBUG os_brick.utils [None req-b6cd7076-6b3f-4e5a-af5c-f820e94e5c70 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 09:43:06 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:43:06 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:43:06 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[9922cb48-f4be-4183-b94a-f503a3daa903]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:742fb64b3587\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:43:06 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:43:06 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:43:06 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[def66461-e494-4d71-98cb-c4d7668a9dac]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:43:06 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:43:06 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:43:06 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b694c80-dccc-4e6c-b5f5-de2c4e53a5cc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:43:06 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c61d570-e73c-411c-8c92-be4ac1b094ef]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:43:06 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-b6cd7076-6b3f-4e5a-af5c-f820e94e5c70 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] Running cmd (subprocess): nvme version {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:43:06 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-b6cd7076-6b3f-4e5a-af5c-f820e94e5c70 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] 'nvme version' failed. Not Retrying. {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 09:43:06 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b6cd7076-6b3f-4e5a-af5c-f820e94e5c70 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] nvme not present on system {{(pid=75122) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 09:43:06 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:43:06 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 09:43:06 user nova-compute[75122]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 09:43:06 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ef0c9fa-9f6a-4fc8-994e-df0a1fa5aec2]: (4, '') {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:43:06 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.lightos [None req-b6cd7076-6b3f-4e5a-af5c-f820e94e5c70 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75122) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 09:43:06 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.lightos [None req-b6cd7076-6b3f-4e5a-af5c-f820e94e5c70 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75122) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 09:43:06 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.lightos [None req-b6cd7076-6b3f-4e5a-af5c-f820e94e5c70 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] LIGHTOS: no hostnqn found. {{(pid=75122) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 09:43:06 user nova-compute[75122]: DEBUG os_brick.utils [None req-b6cd7076-6b3f-4e5a-af5c-f820e94e5c70 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] <== get_connector_properties: return (109ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:742fb64b3587', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 09:43:06 user nova-compute[75122]: DEBUG nova.virt.block_device [None req-b6cd7076-6b3f-4e5a-af5c-f820e94e5c70 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] [instance: 52c066f3-dea1-4aa3-9da4-da9397b9fff1] Updating existing volume attachment record: 77b988b2-0ba0-4b09-8764-f6dc85bfd589 {{(pid=75122) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 09:43:07 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:43:09 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:43:09 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:43:11 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:43:11 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b6cd7076-6b3f-4e5a-af5c-f820e94e5c70 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] [instance: 52c066f3-dea1-4aa3-9da4-da9397b9fff1] Calling os-brick to attach iSCSI Volume {{(pid=75122) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 09:43:11 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6cd7076-6b3f-4e5a-af5c-f820e94e5c70 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffa04060b80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:284cc694-dd22-4f9e-8f3b-787e222f8da5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xWYXjrqO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 09:43:11 user nova-compute[75122]: WARNING os_brick.initiator.connectors.base [None req-b6cd7076-6b3f-4e5a-af5c-f820e94e5c70 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 09:43:11 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-b6cd7076-6b3f-4e5a-af5c-f820e94e5c70 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 09:43:11 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-b6cd7076-6b3f-4e5a-af5c-f820e94e5c70 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 09:43:11 user nova-compute[75122]: WARNING os_brick.initiator.connectors.base [None req-b6cd7076-6b3f-4e5a-af5c-f820e94e5c70 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 09:43:11 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-b6cd7076-6b3f-4e5a-af5c-f820e94e5c70 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:284cc694-dd22-4f9e-8f3b-787e222f8da5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 09:43:11 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-b6cd7076-6b3f-4e5a-af5c-f820e94e5c70 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:284cc694-dd22-4f9e-8f3b-787e222f8da5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 09:43:11 user nova-compute[75122]: INFO os_brick.initiator.connectors.iscsi [None req-b6cd7076-6b3f-4e5a-af5c-f820e94e5c70 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 09:43:11 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:284cc694-dd22-4f9e-8f3b-787e222f8da5 -p 172.16.0.220:3260 {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:43:11 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:284cc694-dd22-4f9e-8f3b-787e222f8da5 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:43:11 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[396063ae-0dc8-4e44-8d0e-2e20fad35536]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:43:11 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6cd7076-6b3f-4e5a-af5c-f820e94e5c70 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 09:43:11 user nova-compute[75122]:  {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:43:11 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:284cc694-dd22-4f9e-8f3b-787e222f8da5 -p 172.16.0.220:3260 --interface default --op new {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:43:11 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:284cc694-dd22-4f9e-8f3b-787e222f8da5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:43:11 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[c84a006c-b182-4ec4-942f-d7e235ba6893]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:284cc694-dd22-4f9e-8f3b-787e222f8da5] added\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:43:11 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6cd7076-6b3f-4e5a-af5c-f820e94e5c70 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:284cc694-dd22-4f9e-8f3b-787e222f8da5] added
Nov 15 09:43:11 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:43:11 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:284cc694-dd22-4f9e-8f3b-787e222f8da5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:43:11 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:284cc694-dd22-4f9e-8f3b-787e222f8da5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:43:11 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[cce0138b-7add-445f-af06-5693779e9108]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:43:11 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6cd7076-6b3f-4e5a-af5c-f820e94e5c70 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:43:11 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:284cc694-dd22-4f9e-8f3b-787e222f8da5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:43:11 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:284cc694-dd22-4f9e-8f3b-787e222f8da5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:43:11 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4fcda56-5779-4ea6-99a6-e15168a6d2a7]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:43:11 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6cd7076-6b3f-4e5a-af5c-f820e94e5c70 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:43:11 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:284cc694-dd22-4f9e-8f3b-787e222f8da5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xWYXjrqO {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:43:11 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:284cc694-dd22-4f9e-8f3b-787e222f8da5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xWYXjrqO" returned: 0 in 0.019s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:43:11 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c867b7b-d549-4007-bcea-cb7b7639fe9a]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:43:11 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6cd7076-6b3f-4e5a-af5c-f820e94e5c70 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xWYXjrqO'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:43:11 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:284cc694-dd22-4f9e-8f3b-787e222f8da5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:43:11 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:284cc694-dd22-4f9e-8f3b-787e222f8da5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:43:11 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecd362e2-937a-4286-9b87-6976c5cbe07d]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:43:11 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6cd7076-6b3f-4e5a-af5c-f820e94e5c70 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:43:11 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:43:11 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:43:11 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[49cf0f5a-c7e9-4262-87a3-2d10ebe253d1]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:395810b1-e3c3-4660-aaaf-b6d9e7cb5a88 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd818868-d5e9-440a-88a0-16ff267004be (non-flash)\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:43:11 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6cd7076-6b3f-4e5a-af5c-f820e94e5c70 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17 (non-flash)
Nov 15 09:43:11 user nova-compute[75122]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:395810b1-e3c3-4660-aaaf-b6d9e7cb5a88 (non-flash)
Nov 15 09:43:11 user nova-compute[75122]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd818868-d5e9-440a-88a0-16ff267004be (non-flash)
Nov 15 09:43:11 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 09:43:11 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6cd7076-6b3f-4e5a-af5c-f820e94e5c70 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17 (non-flash)
Nov 15 09:43:11 user nova-compute[75122]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:395810b1-e3c3-4660-aaaf-b6d9e7cb5a88 (non-flash)
Nov 15 09:43:11 user nova-compute[75122]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd818868-d5e9-440a-88a0-16ff267004be (non-flash)
Nov 15 09:43:11 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 09:43:11 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:284cc694-dd22-4f9e-8f3b-787e222f8da5 -p 172.16.0.220:3260 --login {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:43:11 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:284cc694-dd22-4f9e-8f3b-787e222f8da5 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:43:11 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[847295d1-6abb-4bcd-8443-364e1170047e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:284cc694-dd22-4f9e-8f3b-787e222f8da5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:284cc694-dd22-4f9e-8f3b-787e222f8da5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:43:11 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6cd7076-6b3f-4e5a-af5c-f820e94e5c70 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:284cc694-dd22-4f9e-8f3b-787e222f8da5, portal: 172.16.0.220,3260]
Nov 15 09:43:11 user nova-compute[75122]: Login to [iface: default, target: iqn.2010-10.org.openstack:284cc694-dd22-4f9e-8f3b-787e222f8da5, portal: 172.16.0.220,3260] successful.
Nov 15 09:43:11 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:43:11 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:284cc694-dd22-4f9e-8f3b-787e222f8da5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:43:11 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:284cc694-dd22-4f9e-8f3b-787e222f8da5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:43:11 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[31205fdd-7c43-4064-a1ba-47fffac3e4fb]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:43:11 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6cd7076-6b3f-4e5a-af5c-f820e94e5c70 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:43:11 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:43:11 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:43:11 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[b370c1ea-2253-4219-9a46-f11d14526c74]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:395810b1-e3c3-4660-aaaf-b6d9e7cb5a88 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd818868-d5e9-440a-88a0-16ff267004be (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:284cc694-dd22-4f9e-8f3b-787e222f8da5 (non-flash)\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:43:11 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6cd7076-6b3f-4e5a-af5c-f820e94e5c70 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17 (non-flash)
Nov 15 09:43:11 user nova-compute[75122]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:395810b1-e3c3-4660-aaaf-b6d9e7cb5a88 (non-flash)
Nov 15 09:43:11 user nova-compute[75122]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd818868-d5e9-440a-88a0-16ff267004be (non-flash)
Nov 15 09:43:11 user nova-compute[75122]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:284cc694-dd22-4f9e-8f3b-787e222f8da5 (non-flash)
Nov 15 09:43:11 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 09:43:11 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6cd7076-6b3f-4e5a-af5c-f820e94e5c70 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17 (non-flash)
Nov 15 09:43:11 user nova-compute[75122]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:395810b1-e3c3-4660-aaaf-b6d9e7cb5a88 (non-flash)
Nov 15 09:43:11 user nova-compute[75122]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd818868-d5e9-440a-88a0-16ff267004be (non-flash)
Nov 15 09:43:11 user nova-compute[75122]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:284cc694-dd22-4f9e-8f3b-787e222f8da5 (non-flash)
Nov 15 09:43:11 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 09:43:11 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-b6cd7076-6b3f-4e5a-af5c-f820e94e5c70 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:284cc694-dd22-4f9e-8f3b-787e222f8da5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.292s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 09:43:11 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6cd7076-6b3f-4e5a-af5c-f820e94e5c70 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] Connected to 172.16.0.220:3260 {{(pid=75122) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 09:43:11 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-b6cd7076-6b3f-4e5a-af5c-f820e94e5c70 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] HCTL ('35', '-', '-', 0) found on session 37 with lun 0 {{(pid=75122) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 09:43:11 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-b6cd7076-6b3f-4e5a-af5c-f820e94e5c70 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75122) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 09:43:11 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:43:11 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:43:11 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d621b3d-8261-42da-ae56-3324c4731bb4]: (4, ('- - 0', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:43:11 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-b6cd7076-6b3f-4e5a-af5c-f820e94e5c70 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] Searching for a device in session 37 and hctl ['35', '*', '*', 0] yield: None {{(pid=75122) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 09:43:12 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-034aea7a-8468-489f-8b6e-1fa35ec29b53 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Acquiring lock "bc80e3fb-b5a3-4685-8ec5-12f8c385b833" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:43:12 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-034aea7a-8468-489f-8b6e-1fa35ec29b53 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Lock "bc80e3fb-b5a3-4685-8ec5-12f8c385b833" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:43:12 user nova-compute[75122]: DEBUG nova.compute.manager [None req-034aea7a-8468-489f-8b6e-1fa35ec29b53 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] [instance: bc80e3fb-b5a3-4685-8ec5-12f8c385b833] Starting instance... {{(pid=75122) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 09:43:12 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-034aea7a-8468-489f-8b6e-1fa35ec29b53 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:43:12 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-034aea7a-8468-489f-8b6e-1fa35ec29b53 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:43:12 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-034aea7a-8468-489f-8b6e-1fa35ec29b53 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75122) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 09:43:12 user nova-compute[75122]: INFO nova.compute.claims [None req-034aea7a-8468-489f-8b6e-1fa35ec29b53 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] [instance: bc80e3fb-b5a3-4685-8ec5-12f8c385b833] Claim successful on node user
Nov 15 09:43:12 user nova-compute[75122]: DEBUG nova.compute.provider_tree [None req-034aea7a-8468-489f-8b6e-1fa35ec29b53 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Inventory has not changed in ProviderTree for provider: 69a3da65-47be-44c6-b67c-c692b58284ef {{(pid=75122) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 09:43:12 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-034aea7a-8468-489f-8b6e-1fa35ec29b53 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Inventory has not changed for provider 69a3da65-47be-44c6-b67c-c692b58284ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 09:43:12 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-034aea7a-8468-489f-8b6e-1fa35ec29b53 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.448s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:43:12 user nova-compute[75122]: DEBUG nova.compute.manager [None req-034aea7a-8468-489f-8b6e-1fa35ec29b53 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] [instance: bc80e3fb-b5a3-4685-8ec5-12f8c385b833] Start building networks asynchronously for instance. {{(pid=75122) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 09:43:12 user nova-compute[75122]: DEBUG nova.compute.manager [None req-034aea7a-8468-489f-8b6e-1fa35ec29b53 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] [instance: bc80e3fb-b5a3-4685-8ec5-12f8c385b833] Allocating IP information in the background. {{(pid=75122) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 09:43:12 user nova-compute[75122]: DEBUG nova.network.neutron [None req-034aea7a-8468-489f-8b6e-1fa35ec29b53 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] [instance: bc80e3fb-b5a3-4685-8ec5-12f8c385b833] allocate_for_instance() {{(pid=75122) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 09:43:12 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-034aea7a-8468-489f-8b6e-1fa35ec29b53 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] [instance: bc80e3fb-b5a3-4685-8ec5-12f8c385b833] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 09:43:12 user nova-compute[75122]: DEBUG nova.compute.manager [None req-034aea7a-8468-489f-8b6e-1fa35ec29b53 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] [instance: bc80e3fb-b5a3-4685-8ec5-12f8c385b833] Start building block device mappings for instance. {{(pid=75122) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 09:43:12 user nova-compute[75122]: DEBUG nova.policy [None req-034aea7a-8468-489f-8b6e-1fa35ec29b53 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ad06186836ed40a49a05ef7cc9afd1bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '535c751b9e76421c9262e48fbab3fb6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75122) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 09:43:12 user nova-compute[75122]: DEBUG nova.compute.manager [None req-034aea7a-8468-489f-8b6e-1fa35ec29b53 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] [instance: bc80e3fb-b5a3-4685-8ec5-12f8c385b833] Start spawning the instance on the hypervisor. {{(pid=75122) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 09:43:12 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-034aea7a-8468-489f-8b6e-1fa35ec29b53 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] [instance: bc80e3fb-b5a3-4685-8ec5-12f8c385b833] Creating instance directory {{(pid=75122) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 09:43:12 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-034aea7a-8468-489f-8b6e-1fa35ec29b53 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] [instance: bc80e3fb-b5a3-4685-8ec5-12f8c385b833] Creating image(s)
Nov 15 09:43:12 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-034aea7a-8468-489f-8b6e-1fa35ec29b53 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Acquiring lock "/opt/stack/data/nova/instances/bc80e3fb-b5a3-4685-8ec5-12f8c385b833/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:43:12 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-034aea7a-8468-489f-8b6e-1fa35ec29b53 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Lock "/opt/stack/data/nova/instances/bc80e3fb-b5a3-4685-8ec5-12f8c385b833/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:43:12 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-034aea7a-8468-489f-8b6e-1fa35ec29b53 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Lock "/opt/stack/data/nova/instances/bc80e3fb-b5a3-4685-8ec5-12f8c385b833/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:43:12 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-b6cd7076-6b3f-4e5a-af5c-f820e94e5c70 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] Searching for a device in session 37 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75122) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 09:43:12 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6cd7076-6b3f-4e5a-af5c-f820e94e5c70 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:284cc694-dd22-4f9e-8f3b-787e222f8da5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xWYXjrqO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75122) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 09:43:12 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-b6cd7076-6b3f-4e5a-af5c-f820e94e5c70 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.333s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 09:43:12 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6cd7076-6b3f-4e5a-af5c-f820e94e5c70 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] <== connect_volume: return (1335ms) {'type': 'block', 'scsi_wwn': '23461323936613863', 'path': '/dev/sdd'} {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 09:43:12 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b6cd7076-6b3f-4e5a-af5c-f820e94e5c70 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] [instance: 52c066f3-dea1-4aa3-9da4-da9397b9fff1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23461323936613863', 'path': '/dev/sdd'} {{(pid=75122) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 09:43:12 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-034aea7a-8468-489f-8b6e-1fa35ec29b53 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:43:12 user nova-compute[75122]: DEBUG nova.objects.instance [None req-b6cd7076-6b3f-4e5a-af5c-f820e94e5c70 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] Lazy-loading 'flavor' on Instance uuid 52c066f3-dea1-4aa3-9da4-da9397b9fff1 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:43:13 user nova-compute[75122]: DEBUG nova.virt.libvirt.guest [None req-b6cd7076-6b3f-4e5a-af5c-f820e94e5c70 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 09:43:13 user nova-compute[75122]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 09:43:13 user nova-compute[75122]:   <source dev="/dev/sdd"/>
Nov 15 09:43:13 user nova-compute[75122]:   <target dev="vdb" bus="virtio"/>
Nov 15 09:43:13 user nova-compute[75122]:   <serial>284cc694-dd22-4f9e-8f3b-787e222f8da5</serial>
Nov 15 09:43:13 user nova-compute[75122]: </disk>
Nov 15 09:43:13 user nova-compute[75122]:  {{(pid=75122) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 09:43:13 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-034aea7a-8468-489f-8b6e-1fa35ec29b53 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json" returned: 0 in 0.180s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:43:13 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-034aea7a-8468-489f-8b6e-1fa35ec29b53 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Acquiring lock "95d6e29f74d5408f818e32f3bc29bc8270a4c665" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:43:13 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-034aea7a-8468-489f-8b6e-1fa35ec29b53 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Lock "95d6e29f74d5408f818e32f3bc29bc8270a4c665" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:43:13 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-034aea7a-8468-489f-8b6e-1fa35ec29b53 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:43:13 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-034aea7a-8468-489f-8b6e-1fa35ec29b53 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json" returned: 0 in 0.168s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:43:13 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-034aea7a-8468-489f-8b6e-1fa35ec29b53 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665,backing_fmt=raw /opt/stack/data/nova/instances/bc80e3fb-b5a3-4685-8ec5-12f8c385b833/disk 1073741824 {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:43:13 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-034aea7a-8468-489f-8b6e-1fa35ec29b53 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665,backing_fmt=raw /opt/stack/data/nova/instances/bc80e3fb-b5a3-4685-8ec5-12f8c385b833/disk 1073741824" returned: 0 in 0.051s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:43:13 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-034aea7a-8468-489f-8b6e-1fa35ec29b53 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Lock "95d6e29f74d5408f818e32f3bc29bc8270a4c665" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.225s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:43:13 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-034aea7a-8468-489f-8b6e-1fa35ec29b53 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:43:13 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-b6cd7076-6b3f-4e5a-af5c-f820e94e5c70 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] No BDM found with device name vda, not building metadata. {{(pid=75122) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 09:43:13 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-b6cd7076-6b3f-4e5a-af5c-f820e94e5c70 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75122) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 09:43:13 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-b6cd7076-6b3f-4e5a-af5c-f820e94e5c70 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] No VIF found with MAC fa:16:3e:dd:19:1b, not building metadata {{(pid=75122) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 09:43:13 user nova-compute[75122]: DEBUG nova.network.neutron [None req-034aea7a-8468-489f-8b6e-1fa35ec29b53 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] [instance: bc80e3fb-b5a3-4685-8ec5-12f8c385b833] Successfully created port: a4776ec9-b51c-45f4-8e4c-8cbc3d9e8a59 {{(pid=75122) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 09:43:13 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-034aea7a-8468-489f-8b6e-1fa35ec29b53 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json" returned: 0 in 0.182s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:43:13 user nova-compute[75122]: DEBUG nova.virt.disk.api [None req-034aea7a-8468-489f-8b6e-1fa35ec29b53 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bc80e3fb-b5a3-4685-8ec5-12f8c385b833/disk. size=1073741824 {{(pid=75122) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 09:43:13 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-034aea7a-8468-489f-8b6e-1fa35ec29b53 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc80e3fb-b5a3-4685-8ec5-12f8c385b833/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:43:13 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-b6cd7076-6b3f-4e5a-af5c-f820e94e5c70 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] Lock "52c066f3-dea1-4aa3-9da4-da9397b9fff1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.168s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:43:13 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-034aea7a-8468-489f-8b6e-1fa35ec29b53 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc80e3fb-b5a3-4685-8ec5-12f8c385b833/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:43:13 user nova-compute[75122]: DEBUG nova.virt.disk.api [None req-034aea7a-8468-489f-8b6e-1fa35ec29b53 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Cannot resize image /opt/stack/data/nova/instances/bc80e3fb-b5a3-4685-8ec5-12f8c385b833/disk to a smaller size. {{(pid=75122) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 09:43:13 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-034aea7a-8468-489f-8b6e-1fa35ec29b53 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] [instance: bc80e3fb-b5a3-4685-8ec5-12f8c385b833] Created local disks {{(pid=75122) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 09:43:13 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-034aea7a-8468-489f-8b6e-1fa35ec29b53 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] [instance: bc80e3fb-b5a3-4685-8ec5-12f8c385b833] Ensure instance console log exists: /opt/stack/data/nova/instances/bc80e3fb-b5a3-4685-8ec5-12f8c385b833/console.log {{(pid=75122) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 09:43:13 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-034aea7a-8468-489f-8b6e-1fa35ec29b53 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:43:13 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-034aea7a-8468-489f-8b6e-1fa35ec29b53 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:43:13 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-034aea7a-8468-489f-8b6e-1fa35ec29b53 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:43:14 user nova-compute[75122]: DEBUG nova.network.neutron [None req-034aea7a-8468-489f-8b6e-1fa35ec29b53 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] [instance: bc80e3fb-b5a3-4685-8ec5-12f8c385b833] Successfully updated port: a4776ec9-b51c-45f4-8e4c-8cbc3d9e8a59 {{(pid=75122) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 09:43:14 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-034aea7a-8468-489f-8b6e-1fa35ec29b53 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Acquiring lock "refresh_cache-bc80e3fb-b5a3-4685-8ec5-12f8c385b833" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 09:43:14 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-034aea7a-8468-489f-8b6e-1fa35ec29b53 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Acquired lock "refresh_cache-bc80e3fb-b5a3-4685-8ec5-12f8c385b833" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 09:43:14 user nova-compute[75122]: DEBUG nova.network.neutron [None req-034aea7a-8468-489f-8b6e-1fa35ec29b53 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] [instance: bc80e3fb-b5a3-4685-8ec5-12f8c385b833] Building network info cache for instance {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 09:43:14 user nova-compute[75122]: DEBUG nova.compute.manager [req-ed11d77c-1083-4ac7-8ebb-f5d304b980e3 req-24e16369-6862-4af6-a3f2-62f249d7ecc6 service nova] [instance: bc80e3fb-b5a3-4685-8ec5-12f8c385b833] Received event network-changed-a4776ec9-b51c-45f4-8e4c-8cbc3d9e8a59 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:43:14 user nova-compute[75122]: DEBUG nova.compute.manager [req-ed11d77c-1083-4ac7-8ebb-f5d304b980e3 req-24e16369-6862-4af6-a3f2-62f249d7ecc6 service nova] [instance: bc80e3fb-b5a3-4685-8ec5-12f8c385b833] Refreshing instance network info cache due to event network-changed-a4776ec9-b51c-45f4-8e4c-8cbc3d9e8a59. {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 09:43:14 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-ed11d77c-1083-4ac7-8ebb-f5d304b980e3 req-24e16369-6862-4af6-a3f2-62f249d7ecc6 service nova] Acquiring lock "refresh_cache-bc80e3fb-b5a3-4685-8ec5-12f8c385b833" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 09:43:14 user nova-compute[75122]: DEBUG nova.network.neutron [None req-034aea7a-8468-489f-8b6e-1fa35ec29b53 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] [instance: bc80e3fb-b5a3-4685-8ec5-12f8c385b833] Instance cache missing network info. {{(pid=75122) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 09:43:14 user nova-compute[75122]: DEBUG nova.network.neutron [None req-034aea7a-8468-489f-8b6e-1fa35ec29b53 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] [instance: bc80e3fb-b5a3-4685-8ec5-12f8c385b833] Updating instance_info_cache with network_info: [{"id": "a4776ec9-b51c-45f4-8e4c-8cbc3d9e8a59", "address": "fa:16:3e:8c:f1:36", "network": {"id": "7ab99c1b-e670-416e-b5fe-e1337db6b28d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-487518933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "535c751b9e76421c9262e48fbab3fb6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4776ec9-b5", "ovs_interfaceid": "a4776ec9-b51c-45f4-8e4c-8cbc3d9e8a59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:43:14 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-034aea7a-8468-489f-8b6e-1fa35ec29b53 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Releasing lock "refresh_cache-bc80e3fb-b5a3-4685-8ec5-12f8c385b833" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 09:43:14 user nova-compute[75122]: DEBUG nova.compute.manager [None req-034aea7a-8468-489f-8b6e-1fa35ec29b53 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] [instance: bc80e3fb-b5a3-4685-8ec5-12f8c385b833] Instance network_info: |[{"id": "a4776ec9-b51c-45f4-8e4c-8cbc3d9e8a59", "address": "fa:16:3e:8c:f1:36", "network": {"id": "7ab99c1b-e670-416e-b5fe-e1337db6b28d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-487518933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "535c751b9e76421c9262e48fbab3fb6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4776ec9-b5", "ovs_interfaceid": "a4776ec9-b51c-45f4-8e4c-8cbc3d9e8a59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75122) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 09:43:14 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-ed11d77c-1083-4ac7-8ebb-f5d304b980e3 req-24e16369-6862-4af6-a3f2-62f249d7ecc6 service nova] Acquired lock "refresh_cache-bc80e3fb-b5a3-4685-8ec5-12f8c385b833" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 09:43:14 user nova-compute[75122]: DEBUG nova.network.neutron [req-ed11d77c-1083-4ac7-8ebb-f5d304b980e3 req-24e16369-6862-4af6-a3f2-62f249d7ecc6 service nova] [instance: bc80e3fb-b5a3-4685-8ec5-12f8c385b833] Refreshing network info cache for port a4776ec9-b51c-45f4-8e4c-8cbc3d9e8a59 {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 09:43:14 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-034aea7a-8468-489f-8b6e-1fa35ec29b53 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] [instance: bc80e3fb-b5a3-4685-8ec5-12f8c385b833] Start _get_guest_xml network_info=[{"id": "a4776ec9-b51c-45f4-8e4c-8cbc3d9e8a59", "address": "fa:16:3e:8c:f1:36", "network": {"id": "7ab99c1b-e670-416e-b5fe-e1337db6b28d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-487518933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "535c751b9e76421c9262e48fbab3fb6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4776ec9-b5", "ovs_interfaceid": "a4776ec9-b51c-45f4-8e4c-8cbc3d9e8a59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T09:26:31Z,direct_url=<?>,disk_format='qcow2',id=5e862cfe-47b8-4725-8292-65761ee6d0f5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9c57733cb41847c0b4ad31519c382e5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T09:26:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '5e862cfe-47b8-4725-8292-65761ee6d0f5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75122) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 09:43:14 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-034aea7a-8468-489f-8b6e-1fa35ec29b53 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 09:43:14 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-034aea7a-8468-489f-8b6e-1fa35ec29b53 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 09:43:14 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-034aea7a-8468-489f-8b6e-1fa35ec29b53 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75122) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 09:43:14 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-034aea7a-8468-489f-8b6e-1fa35ec29b53 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] CPU controller missing on host. {{(pid=75122) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 09:43:14 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-034aea7a-8468-489f-8b6e-1fa35ec29b53 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75122) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 09:43:14 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-034aea7a-8468-489f-8b6e-1fa35ec29b53 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] CPU controller found on host. {{(pid=75122) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 09:43:14 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-034aea7a-8468-489f-8b6e-1fa35ec29b53 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75122) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 09:43:14 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-034aea7a-8468-489f-8b6e-1fa35ec29b53 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T09:26:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T09:26:31Z,direct_url=<?>,disk_format='qcow2',id=5e862cfe-47b8-4725-8292-65761ee6d0f5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9c57733cb41847c0b4ad31519c382e5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T09:26:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 09:43:14 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-034aea7a-8468-489f-8b6e-1fa35ec29b53 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Flavor limits 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 09:43:14 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-034aea7a-8468-489f-8b6e-1fa35ec29b53 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Image limits 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 09:43:14 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-034aea7a-8468-489f-8b6e-1fa35ec29b53 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Flavor pref 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 09:43:14 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-034aea7a-8468-489f-8b6e-1fa35ec29b53 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Image pref 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 09:43:14 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-034aea7a-8468-489f-8b6e-1fa35ec29b53 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 09:43:14 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-034aea7a-8468-489f-8b6e-1fa35ec29b53 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 09:43:14 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-034aea7a-8468-489f-8b6e-1fa35ec29b53 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75122) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 09:43:14 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-034aea7a-8468-489f-8b6e-1fa35ec29b53 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Got 1 possible topologies {{(pid=75122) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 09:43:14 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-034aea7a-8468-489f-8b6e-1fa35ec29b53 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 09:43:14 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-034aea7a-8468-489f-8b6e-1fa35ec29b53 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 09:43:14 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-034aea7a-8468-489f-8b6e-1fa35ec29b53 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T09:43:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-163449221',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-163449221',id=29,image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJfEuPLuVH5xqWrSMchZ/D472KVFUB0l6HnFeBNP5ISHr0hl+yReqPqomRDnTEO/skiLFiaQqOkcDJWvEVPbCsE6HHOsaS7zMjbvhh02/xzV3QyLU+3VyYUKh9zh6YINxw==',key_name='tempest-keypair-785756428',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='535c751b9e76421c9262e48fbab3fb6f',ramdisk_id='',reservation_id='r-s195psec',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1659813957',owner_user_name='tempest-AttachVolumeShelveTestJSON-1659813957-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T09:43:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad06186836ed40a49a05ef7cc9afd1bc',uuid=bc80e3fb-b5a3-4685-8ec5-12f8c385b833,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a4776ec9-b51c-45f4-8e4c-8cbc3d9e8a59", "address": "fa:16:3e:8c:f1:36", "network": {"id": "7ab99c1b-e670-416e-b5fe-e1337db6b28d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-487518933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "535c751b9e76421c9262e48fbab3fb6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4776ec9-b5", "ovs_interfaceid": "a4776ec9-b51c-45f4-8e4c-8cbc3d9e8a59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75122) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 09:43:14 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-034aea7a-8468-489f-8b6e-1fa35ec29b53 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Converting VIF {"id": "a4776ec9-b51c-45f4-8e4c-8cbc3d9e8a59", "address": "fa:16:3e:8c:f1:36", "network": {"id": "7ab99c1b-e670-416e-b5fe-e1337db6b28d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-487518933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "535c751b9e76421c9262e48fbab3fb6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4776ec9-b5", "ovs_interfaceid": "a4776ec9-b51c-45f4-8e4c-8cbc3d9e8a59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 09:43:14 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-034aea7a-8468-489f-8b6e-1fa35ec29b53 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:f1:36,bridge_name='br-int',has_traffic_filtering=True,id=a4776ec9-b51c-45f4-8e4c-8cbc3d9e8a59,network=Network(7ab99c1b-e670-416e-b5fe-e1337db6b28d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4776ec9-b5') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 09:43:14 user nova-compute[75122]: DEBUG nova.objects.instance [None req-034aea7a-8468-489f-8b6e-1fa35ec29b53 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Lazy-loading 'pci_devices' on Instance uuid bc80e3fb-b5a3-4685-8ec5-12f8c385b833 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:43:14 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:43:14 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-034aea7a-8468-489f-8b6e-1fa35ec29b53 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] [instance: bc80e3fb-b5a3-4685-8ec5-12f8c385b833] End _get_guest_xml xml=<domain type="kvm">
Nov 15 09:43:14 user nova-compute[75122]:   <uuid>bc80e3fb-b5a3-4685-8ec5-12f8c385b833</uuid>
Nov 15 09:43:14 user nova-compute[75122]:   <name>instance-0000001d</name>
Nov 15 09:43:14 user nova-compute[75122]:   <memory>524288</memory>
Nov 15 09:43:14 user nova-compute[75122]:   <vcpu>1</vcpu>
Nov 15 09:43:14 user nova-compute[75122]:   <metadata>
Nov 15 09:43:14 user nova-compute[75122]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 09:43:14 user nova-compute[75122]:       <nova:package version="0.0.0"/>
Nov 15 09:43:14 user nova-compute[75122]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-163449221</nova:name>
Nov 15 09:43:14 user nova-compute[75122]:       <nova:creationTime>2023-11-15 09:43:14</nova:creationTime>
Nov 15 09:43:14 user nova-compute[75122]:       <nova:flavor name="m1.tiny">
Nov 15 09:43:14 user nova-compute[75122]:         <nova:memory>512</nova:memory>
Nov 15 09:43:14 user nova-compute[75122]:         <nova:disk>1</nova:disk>
Nov 15 09:43:14 user nova-compute[75122]:         <nova:swap>0</nova:swap>
Nov 15 09:43:14 user nova-compute[75122]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 09:43:14 user nova-compute[75122]:         <nova:vcpus>1</nova:vcpus>
Nov 15 09:43:14 user nova-compute[75122]:       </nova:flavor>
Nov 15 09:43:14 user nova-compute[75122]:       <nova:owner>
Nov 15 09:43:14 user nova-compute[75122]:         <nova:user uuid="ad06186836ed40a49a05ef7cc9afd1bc">tempest-AttachVolumeShelveTestJSON-1659813957-project-member</nova:user>
Nov 15 09:43:14 user nova-compute[75122]:         <nova:project uuid="535c751b9e76421c9262e48fbab3fb6f">tempest-AttachVolumeShelveTestJSON-1659813957</nova:project>
Nov 15 09:43:14 user nova-compute[75122]:       </nova:owner>
Nov 15 09:43:14 user nova-compute[75122]:       <nova:root type="image" uuid="5e862cfe-47b8-4725-8292-65761ee6d0f5"/>
Nov 15 09:43:14 user nova-compute[75122]:       <nova:ports>
Nov 15 09:43:14 user nova-compute[75122]:         <nova:port uuid="a4776ec9-b51c-45f4-8e4c-8cbc3d9e8a59">
Nov 15 09:43:14 user nova-compute[75122]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 15 09:43:14 user nova-compute[75122]:         </nova:port>
Nov 15 09:43:14 user nova-compute[75122]:       </nova:ports>
Nov 15 09:43:14 user nova-compute[75122]:     </nova:instance>
Nov 15 09:43:14 user nova-compute[75122]:   </metadata>
Nov 15 09:43:14 user nova-compute[75122]:   <sysinfo type="smbios">
Nov 15 09:43:14 user nova-compute[75122]:     <system>
Nov 15 09:43:14 user nova-compute[75122]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 09:43:14 user nova-compute[75122]:       <entry name="product">OpenStack Nova</entry>
Nov 15 09:43:14 user nova-compute[75122]:       <entry name="version">0.0.0</entry>
Nov 15 09:43:14 user nova-compute[75122]:       <entry name="serial">bc80e3fb-b5a3-4685-8ec5-12f8c385b833</entry>
Nov 15 09:43:14 user nova-compute[75122]:       <entry name="uuid">bc80e3fb-b5a3-4685-8ec5-12f8c385b833</entry>
Nov 15 09:43:14 user nova-compute[75122]:       <entry name="family">Virtual Machine</entry>
Nov 15 09:43:14 user nova-compute[75122]:     </system>
Nov 15 09:43:14 user nova-compute[75122]:   </sysinfo>
Nov 15 09:43:14 user nova-compute[75122]:   <os>
Nov 15 09:43:14 user nova-compute[75122]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 09:43:14 user nova-compute[75122]:     <boot dev="hd"/>
Nov 15 09:43:14 user nova-compute[75122]:     <smbios mode="sysinfo"/>
Nov 15 09:43:14 user nova-compute[75122]:   </os>
Nov 15 09:43:14 user nova-compute[75122]:   <features>
Nov 15 09:43:14 user nova-compute[75122]:     <acpi/>
Nov 15 09:43:14 user nova-compute[75122]:     <apic/>
Nov 15 09:43:14 user nova-compute[75122]:     <vmcoreinfo/>
Nov 15 09:43:14 user nova-compute[75122]:   </features>
Nov 15 09:43:14 user nova-compute[75122]:   <clock offset="utc">
Nov 15 09:43:14 user nova-compute[75122]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 09:43:14 user nova-compute[75122]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 09:43:14 user nova-compute[75122]:     <timer name="hpet" present="no"/>
Nov 15 09:43:14 user nova-compute[75122]:   </clock>
Nov 15 09:43:14 user nova-compute[75122]:   <cpu mode="custom" match="exact">
Nov 15 09:43:14 user nova-compute[75122]:     <model>Nehalem</model>
Nov 15 09:43:14 user nova-compute[75122]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 09:43:14 user nova-compute[75122]:   </cpu>
Nov 15 09:43:14 user nova-compute[75122]:   <devices>
Nov 15 09:43:14 user nova-compute[75122]:     <disk type="file" device="disk">
Nov 15 09:43:14 user nova-compute[75122]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 09:43:14 user nova-compute[75122]:       <source file="/opt/stack/data/nova/instances/bc80e3fb-b5a3-4685-8ec5-12f8c385b833/disk"/>
Nov 15 09:43:14 user nova-compute[75122]:       <target dev="vda" bus="virtio"/>
Nov 15 09:43:14 user nova-compute[75122]:     </disk>
Nov 15 09:43:14 user nova-compute[75122]:     <interface type="ethernet">
Nov 15 09:43:14 user nova-compute[75122]:       <mac address="fa:16:3e:8c:f1:36"/>
Nov 15 09:43:14 user nova-compute[75122]:       <model type="virtio"/>
Nov 15 09:43:14 user nova-compute[75122]:       <mtu size="1442"/>
Nov 15 09:43:14 user nova-compute[75122]:       <target dev="tapa4776ec9-b5"/>
Nov 15 09:43:14 user nova-compute[75122]:     </interface>
Nov 15 09:43:14 user nova-compute[75122]:     <serial type="pty">
Nov 15 09:43:14 user nova-compute[75122]:       <log file="/opt/stack/data/nova/instances/bc80e3fb-b5a3-4685-8ec5-12f8c385b833/console.log" append="off"/>
Nov 15 09:43:14 user nova-compute[75122]:     </serial>
Nov 15 09:43:14 user nova-compute[75122]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 09:43:14 user nova-compute[75122]:     <video>
Nov 15 09:43:14 user nova-compute[75122]:       <model type="virtio"/>
Nov 15 09:43:14 user nova-compute[75122]:     </video>
Nov 15 09:43:14 user nova-compute[75122]:     <rng model="virtio">
Nov 15 09:43:14 user nova-compute[75122]:       <backend model="random">/dev/urandom</backend>
Nov 15 09:43:14 user nova-compute[75122]:     </rng>
Nov 15 09:43:14 user nova-compute[75122]:     <controller type="usb" index="0" model="none"/>
Nov 15 09:43:14 user nova-compute[75122]:     <memballoon model="virtio">
Nov 15 09:43:14 user nova-compute[75122]:       <stats period="10"/>
Nov 15 09:43:14 user nova-compute[75122]:     </memballoon>
Nov 15 09:43:14 user nova-compute[75122]:   </devices>
Nov 15 09:43:14 user nova-compute[75122]: </domain>
Nov 15 09:43:14 user nova-compute[75122]:  {{(pid=75122) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 09:43:14 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-034aea7a-8468-489f-8b6e-1fa35ec29b53 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T09:43:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-163449221',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-163449221',id=29,image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJfEuPLuVH5xqWrSMchZ/D472KVFUB0l6HnFeBNP5ISHr0hl+yReqPqomRDnTEO/skiLFiaQqOkcDJWvEVPbCsE6HHOsaS7zMjbvhh02/xzV3QyLU+3VyYUKh9zh6YINxw==',key_name='tempest-keypair-785756428',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='535c751b9e76421c9262e48fbab3fb6f',ramdisk_id='',reservation_id='r-s195psec',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1659813957',owner_user_name='tempest-AttachVolumeShelveTestJSON-1659813957-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T09:43:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad06186836ed40a49a05ef7cc9afd1bc',uuid=bc80e3fb-b5a3-4685-8ec5-12f8c385b833,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a4776ec9-b51c-45f4-8e4c-8cbc3d9e8a59", "address": "fa:16:3e:8c:f1:36", "network": {"id": "7ab99c1b-e670-416e-b5fe-e1337db6b28d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-487518933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "535c751b9e76421c9262e48fbab3fb6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4776ec9-b5", "ovs_interfaceid": "a4776ec9-b51c-45f4-8e4c-8cbc3d9e8a59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 09:43:14 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-034aea7a-8468-489f-8b6e-1fa35ec29b53 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Converting VIF {"id": "a4776ec9-b51c-45f4-8e4c-8cbc3d9e8a59", "address": "fa:16:3e:8c:f1:36", "network": {"id": "7ab99c1b-e670-416e-b5fe-e1337db6b28d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-487518933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "535c751b9e76421c9262e48fbab3fb6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4776ec9-b5", "ovs_interfaceid": "a4776ec9-b51c-45f4-8e4c-8cbc3d9e8a59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 09:43:14 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-034aea7a-8468-489f-8b6e-1fa35ec29b53 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:f1:36,bridge_name='br-int',has_traffic_filtering=True,id=a4776ec9-b51c-45f4-8e4c-8cbc3d9e8a59,network=Network(7ab99c1b-e670-416e-b5fe-e1337db6b28d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4776ec9-b5') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 09:43:14 user nova-compute[75122]: DEBUG os_vif [None req-034aea7a-8468-489f-8b6e-1fa35ec29b53 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:f1:36,bridge_name='br-int',has_traffic_filtering=True,id=a4776ec9-b51c-45f4-8e4c-8cbc3d9e8a59,network=Network(7ab99c1b-e670-416e-b5fe-e1337db6b28d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4776ec9-b5') {{(pid=75122) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 09:43:14 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:43:14 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:43:14 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 09:43:14 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:43:14 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8560e877-fdd6-5ae9-82ec-68f448ef54ff', '_type': 'linux-noop'}}, row=False) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:43:14 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:43:14 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:43:14 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:43:14 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa4776ec9-b5, may_exist=True, interface_attrs={}) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:43:14 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa4776ec9-b5, col_values=(('qos', UUID('18b7d54d-8f65-4c1a-9fbe-5401d20593c4')),), if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:43:14 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa4776ec9-b5, col_values=(('external_ids', {'iface-id': 'a4776ec9-b51c-45f4-8e4c-8cbc3d9e8a59', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8c:f1:36', 'vm-uuid': 'bc80e3fb-b5a3-4685-8ec5-12f8c385b833'}),), if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:43:14 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:43:14 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:43:14 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:43:14 user nova-compute[75122]: INFO os_vif [None req-034aea7a-8468-489f-8b6e-1fa35ec29b53 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:f1:36,bridge_name='br-int',has_traffic_filtering=True,id=a4776ec9-b51c-45f4-8e4c-8cbc3d9e8a59,network=Network(7ab99c1b-e670-416e-b5fe-e1337db6b28d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4776ec9-b5')
Nov 15 09:43:14 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-034aea7a-8468-489f-8b6e-1fa35ec29b53 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] No BDM found with device name vda, not building metadata. {{(pid=75122) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 09:43:14 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-034aea7a-8468-489f-8b6e-1fa35ec29b53 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] No VIF found with MAC fa:16:3e:8c:f1:36, not building metadata {{(pid=75122) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 09:43:14 user nova-compute[75122]: DEBUG nova.network.neutron [req-ed11d77c-1083-4ac7-8ebb-f5d304b980e3 req-24e16369-6862-4af6-a3f2-62f249d7ecc6 service nova] [instance: bc80e3fb-b5a3-4685-8ec5-12f8c385b833] Updated VIF entry in instance network info cache for port a4776ec9-b51c-45f4-8e4c-8cbc3d9e8a59. {{(pid=75122) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 09:43:14 user nova-compute[75122]: DEBUG nova.network.neutron [req-ed11d77c-1083-4ac7-8ebb-f5d304b980e3 req-24e16369-6862-4af6-a3f2-62f249d7ecc6 service nova] [instance: bc80e3fb-b5a3-4685-8ec5-12f8c385b833] Updating instance_info_cache with network_info: [{"id": "a4776ec9-b51c-45f4-8e4c-8cbc3d9e8a59", "address": "fa:16:3e:8c:f1:36", "network": {"id": "7ab99c1b-e670-416e-b5fe-e1337db6b28d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-487518933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "535c751b9e76421c9262e48fbab3fb6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4776ec9-b5", "ovs_interfaceid": "a4776ec9-b51c-45f4-8e4c-8cbc3d9e8a59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:43:14 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-ed11d77c-1083-4ac7-8ebb-f5d304b980e3 req-24e16369-6862-4af6-a3f2-62f249d7ecc6 service nova] Releasing lock "refresh_cache-bc80e3fb-b5a3-4685-8ec5-12f8c385b833" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 09:43:15 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-c8d8c3d8-a887-4baa-b633-4cd9fb1afabf tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] Acquiring lock "52c066f3-dea1-4aa3-9da4-da9397b9fff1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:43:15 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-c8d8c3d8-a887-4baa-b633-4cd9fb1afabf tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] Lock "52c066f3-dea1-4aa3-9da4-da9397b9fff1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:43:15 user nova-compute[75122]: INFO nova.compute.manager [None req-c8d8c3d8-a887-4baa-b633-4cd9fb1afabf tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] [instance: 52c066f3-dea1-4aa3-9da4-da9397b9fff1] Detaching volume 284cc694-dd22-4f9e-8f3b-787e222f8da5
Nov 15 09:43:15 user nova-compute[75122]: INFO nova.virt.block_device [None req-c8d8c3d8-a887-4baa-b633-4cd9fb1afabf tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] [instance: 52c066f3-dea1-4aa3-9da4-da9397b9fff1] Attempting to driver detach volume 284cc694-dd22-4f9e-8f3b-787e222f8da5 from mountpoint /dev/vdb
Nov 15 09:43:15 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-c8d8c3d8-a887-4baa-b633-4cd9fb1afabf tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] Attempting to detach device vdb from instance 52c066f3-dea1-4aa3-9da4-da9397b9fff1 from the persistent domain config. {{(pid=75122) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 09:43:15 user nova-compute[75122]: DEBUG nova.virt.libvirt.guest [None req-c8d8c3d8-a887-4baa-b633-4cd9fb1afabf tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 09:43:15 user nova-compute[75122]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 09:43:15 user nova-compute[75122]:   <source dev="/dev/sdd"/>
Nov 15 09:43:15 user nova-compute[75122]:   <target dev="vdb" bus="virtio"/>
Nov 15 09:43:15 user nova-compute[75122]:   <serial>284cc694-dd22-4f9e-8f3b-787e222f8da5</serial>
Nov 15 09:43:15 user nova-compute[75122]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 09:43:15 user nova-compute[75122]: </disk>
Nov 15 09:43:15 user nova-compute[75122]:  {{(pid=75122) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 09:43:15 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-c8d8c3d8-a887-4baa-b633-4cd9fb1afabf tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] Successfully detached device vdb from instance 52c066f3-dea1-4aa3-9da4-da9397b9fff1 from the persistent domain config.
Nov 15 09:43:15 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-c8d8c3d8-a887-4baa-b633-4cd9fb1afabf tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 52c066f3-dea1-4aa3-9da4-da9397b9fff1 from the live domain config. {{(pid=75122) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 09:43:15 user nova-compute[75122]: DEBUG nova.virt.libvirt.guest [None req-c8d8c3d8-a887-4baa-b633-4cd9fb1afabf tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 09:43:15 user nova-compute[75122]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 09:43:15 user nova-compute[75122]:   <source dev="/dev/sdd"/>
Nov 15 09:43:15 user nova-compute[75122]:   <target dev="vdb" bus="virtio"/>
Nov 15 09:43:15 user nova-compute[75122]:   <serial>284cc694-dd22-4f9e-8f3b-787e222f8da5</serial>
Nov 15 09:43:15 user nova-compute[75122]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 09:43:15 user nova-compute[75122]: </disk>
Nov 15 09:43:15 user nova-compute[75122]:  {{(pid=75122) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 09:43:15 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:43:15 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:43:15 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:43:16 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-c8d8c3d8-a887-4baa-b633-4cd9fb1afabf tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 52c066f3-dea1-4aa3-9da4-da9397b9fff1 {{(pid=75122) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 09:43:16 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:43:16 user nova-compute[75122]: DEBUG nova.compute.manager [req-afe49ebe-3fb9-4375-8265-8fc813038870 req-284f138f-82d2-4a70-bf89-ac12f7daf89a service nova] [instance: bc80e3fb-b5a3-4685-8ec5-12f8c385b833] Received event network-vif-plugged-a4776ec9-b51c-45f4-8e4c-8cbc3d9e8a59 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:43:16 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-afe49ebe-3fb9-4375-8265-8fc813038870 req-284f138f-82d2-4a70-bf89-ac12f7daf89a service nova] Acquiring lock "bc80e3fb-b5a3-4685-8ec5-12f8c385b833-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:43:16 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-afe49ebe-3fb9-4375-8265-8fc813038870 req-284f138f-82d2-4a70-bf89-ac12f7daf89a service nova] Lock "bc80e3fb-b5a3-4685-8ec5-12f8c385b833-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:43:16 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-afe49ebe-3fb9-4375-8265-8fc813038870 req-284f138f-82d2-4a70-bf89-ac12f7daf89a service nova] Lock "bc80e3fb-b5a3-4685-8ec5-12f8c385b833-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:43:16 user nova-compute[75122]: DEBUG nova.compute.manager [req-afe49ebe-3fb9-4375-8265-8fc813038870 req-284f138f-82d2-4a70-bf89-ac12f7daf89a service nova] [instance: bc80e3fb-b5a3-4685-8ec5-12f8c385b833] No waiting events found dispatching network-vif-plugged-a4776ec9-b51c-45f4-8e4c-8cbc3d9e8a59 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:43:16 user nova-compute[75122]: WARNING nova.compute.manager [req-afe49ebe-3fb9-4375-8265-8fc813038870 req-284f138f-82d2-4a70-bf89-ac12f7daf89a service nova] [instance: bc80e3fb-b5a3-4685-8ec5-12f8c385b833] Received unexpected event network-vif-plugged-a4776ec9-b51c-45f4-8e4c-8cbc3d9e8a59 for instance with vm_state building and task_state spawning.
Nov 15 09:43:16 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:43:16 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:43:16 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:43:16 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:43:18 user nova-compute[75122]: DEBUG nova.compute.manager [req-bfcc753f-d92a-48cd-8283-1a92e121cb72 req-95f75b2e-1c16-47c0-9888-529ab48682cc service nova] [instance: bc80e3fb-b5a3-4685-8ec5-12f8c385b833] Received event network-vif-plugged-a4776ec9-b51c-45f4-8e4c-8cbc3d9e8a59 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:43:18 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-bfcc753f-d92a-48cd-8283-1a92e121cb72 req-95f75b2e-1c16-47c0-9888-529ab48682cc service nova] Acquiring lock "bc80e3fb-b5a3-4685-8ec5-12f8c385b833-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:43:18 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-bfcc753f-d92a-48cd-8283-1a92e121cb72 req-95f75b2e-1c16-47c0-9888-529ab48682cc service nova] Lock "bc80e3fb-b5a3-4685-8ec5-12f8c385b833-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:43:18 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-bfcc753f-d92a-48cd-8283-1a92e121cb72 req-95f75b2e-1c16-47c0-9888-529ab48682cc service nova] Lock "bc80e3fb-b5a3-4685-8ec5-12f8c385b833-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:43:18 user nova-compute[75122]: DEBUG nova.compute.manager [req-bfcc753f-d92a-48cd-8283-1a92e121cb72 req-95f75b2e-1c16-47c0-9888-529ab48682cc service nova] [instance: bc80e3fb-b5a3-4685-8ec5-12f8c385b833] No waiting events found dispatching network-vif-plugged-a4776ec9-b51c-45f4-8e4c-8cbc3d9e8a59 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:43:18 user nova-compute[75122]: WARNING nova.compute.manager [req-bfcc753f-d92a-48cd-8283-1a92e121cb72 req-95f75b2e-1c16-47c0-9888-529ab48682cc service nova] [instance: bc80e3fb-b5a3-4685-8ec5-12f8c385b833] Received unexpected event network-vif-plugged-a4776ec9-b51c-45f4-8e4c-8cbc3d9e8a59 for instance with vm_state building and task_state spawning.
Nov 15 09:43:18 user nova-compute[75122]: DEBUG nova.compute.manager [None req-034aea7a-8468-489f-8b6e-1fa35ec29b53 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] [instance: bc80e3fb-b5a3-4685-8ec5-12f8c385b833] Instance event wait completed in 0 seconds for  {{(pid=75122) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 09:43:18 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-034aea7a-8468-489f-8b6e-1fa35ec29b53 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] [instance: bc80e3fb-b5a3-4685-8ec5-12f8c385b833] Guest created on hypervisor {{(pid=75122) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 09:43:18 user nova-compute[75122]: INFO nova.virt.libvirt.driver [-] [instance: bc80e3fb-b5a3-4685-8ec5-12f8c385b833] Instance spawned successfully.
Nov 15 09:43:18 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-034aea7a-8468-489f-8b6e-1fa35ec29b53 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] [instance: bc80e3fb-b5a3-4685-8ec5-12f8c385b833] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 09:43:18 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-034aea7a-8468-489f-8b6e-1fa35ec29b53 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] [instance: bc80e3fb-b5a3-4685-8ec5-12f8c385b833] Found default for hw_cdrom_bus of ide {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:43:18 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-034aea7a-8468-489f-8b6e-1fa35ec29b53 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] [instance: bc80e3fb-b5a3-4685-8ec5-12f8c385b833] Found default for hw_disk_bus of virtio {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:43:18 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-034aea7a-8468-489f-8b6e-1fa35ec29b53 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] [instance: bc80e3fb-b5a3-4685-8ec5-12f8c385b833] Found default for hw_input_bus of None {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:43:18 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-034aea7a-8468-489f-8b6e-1fa35ec29b53 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] [instance: bc80e3fb-b5a3-4685-8ec5-12f8c385b833] Found default for hw_pointer_model of None {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:43:18 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-034aea7a-8468-489f-8b6e-1fa35ec29b53 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] [instance: bc80e3fb-b5a3-4685-8ec5-12f8c385b833] Found default for hw_video_model of virtio {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:43:18 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-034aea7a-8468-489f-8b6e-1fa35ec29b53 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] [instance: bc80e3fb-b5a3-4685-8ec5-12f8c385b833] Found default for hw_vif_model of virtio {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:43:18 user nova-compute[75122]: INFO nova.compute.manager [None req-034aea7a-8468-489f-8b6e-1fa35ec29b53 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] [instance: bc80e3fb-b5a3-4685-8ec5-12f8c385b833] Took 5.60 seconds to spawn the instance on the hypervisor.
Nov 15 09:43:18 user nova-compute[75122]: DEBUG nova.compute.manager [None req-034aea7a-8468-489f-8b6e-1fa35ec29b53 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] [instance: bc80e3fb-b5a3-4685-8ec5-12f8c385b833] Checking state {{(pid=75122) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 09:43:18 user nova-compute[75122]: INFO nova.compute.manager [None req-034aea7a-8468-489f-8b6e-1fa35ec29b53 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] [instance: bc80e3fb-b5a3-4685-8ec5-12f8c385b833] Took 6.38 seconds to build instance.
Nov 15 09:43:18 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-034aea7a-8468-489f-8b6e-1fa35ec29b53 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Lock "bc80e3fb-b5a3-4685-8ec5-12f8c385b833" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.481s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:43:19 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:43:19 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:43:19 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75122) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 09:43:19 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:43:20 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:43:20 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:43:20 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:43:21 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:43:21 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:43:21 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Starting heal instance info cache {{(pid=75122) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 09:43:21 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "refresh_cache-00270cc2-4f5b-4f64-8f88-31f21e3b3950" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 09:43:21 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquired lock "refresh_cache-00270cc2-4f5b-4f64-8f88-31f21e3b3950" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 09:43:21 user nova-compute[75122]: DEBUG nova.network.neutron [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] [instance: 00270cc2-4f5b-4f64-8f88-31f21e3b3950] Forcefully refreshing network info cache for instance {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 09:43:21 user nova-compute[75122]: DEBUG nova.network.neutron [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] [instance: 00270cc2-4f5b-4f64-8f88-31f21e3b3950] Updating instance_info_cache with network_info: [{"id": "bb6552dc-ebef-427a-beea-b41083f05e70", "address": "fa:16:3e:44:9c:f9", "network": {"id": "c2062f64-d925-42d2-9687-5d2511ef6697", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1134087048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eeff24cb28f5481fa3941ba399ce82ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb6552dc-eb", "ovs_interfaceid": "bb6552dc-ebef-427a-beea-b41083f05e70", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:43:21 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Releasing lock "refresh_cache-00270cc2-4f5b-4f64-8f88-31f21e3b3950" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 09:43:21 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] [instance: 00270cc2-4f5b-4f64-8f88-31f21e3b3950] Updated the network info_cache for instance {{(pid=75122) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 09:43:22 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-7f13dc29-4207-41d2-bbbe-01a6e530a1ea tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Acquiring lock "df913b3e-218d-4ae6-b7b3-70f64fdd3896" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:43:22 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-7f13dc29-4207-41d2-bbbe-01a6e530a1ea tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Lock "df913b3e-218d-4ae6-b7b3-70f64fdd3896" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:43:22 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-7f13dc29-4207-41d2-bbbe-01a6e530a1ea tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Acquiring lock "df913b3e-218d-4ae6-b7b3-70f64fdd3896-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:43:22 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-7f13dc29-4207-41d2-bbbe-01a6e530a1ea tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Lock "df913b3e-218d-4ae6-b7b3-70f64fdd3896-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:43:22 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-7f13dc29-4207-41d2-bbbe-01a6e530a1ea tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Lock "df913b3e-218d-4ae6-b7b3-70f64fdd3896-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:43:22 user nova-compute[75122]: INFO nova.compute.manager [None req-7f13dc29-4207-41d2-bbbe-01a6e530a1ea tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] [instance: df913b3e-218d-4ae6-b7b3-70f64fdd3896] Terminating instance
Nov 15 09:43:22 user nova-compute[75122]: DEBUG nova.compute.manager [None req-7f13dc29-4207-41d2-bbbe-01a6e530a1ea tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] [instance: df913b3e-218d-4ae6-b7b3-70f64fdd3896] Start destroying the instance on the hypervisor. {{(pid=75122) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 09:43:22 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:43:22 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:43:22 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:43:22 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:43:22 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:43:22 user nova-compute[75122]: DEBUG nova.compute.manager [req-4ea49367-bfb6-4c5d-a450-7d2cf85be598 req-8d9728cf-a25d-43df-91a0-3f19c9855656 service nova] [instance: df913b3e-218d-4ae6-b7b3-70f64fdd3896] Received event network-vif-unplugged-1a900796-9d0d-43a8-8ccd-21307e17f875 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:43:22 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-4ea49367-bfb6-4c5d-a450-7d2cf85be598 req-8d9728cf-a25d-43df-91a0-3f19c9855656 service nova] Acquiring lock "df913b3e-218d-4ae6-b7b3-70f64fdd3896-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:43:22 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-4ea49367-bfb6-4c5d-a450-7d2cf85be598 req-8d9728cf-a25d-43df-91a0-3f19c9855656 service nova] Lock "df913b3e-218d-4ae6-b7b3-70f64fdd3896-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:43:22 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-4ea49367-bfb6-4c5d-a450-7d2cf85be598 req-8d9728cf-a25d-43df-91a0-3f19c9855656 service nova] Lock "df913b3e-218d-4ae6-b7b3-70f64fdd3896-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:43:22 user nova-compute[75122]: DEBUG nova.compute.manager [req-4ea49367-bfb6-4c5d-a450-7d2cf85be598 req-8d9728cf-a25d-43df-91a0-3f19c9855656 service nova] [instance: df913b3e-218d-4ae6-b7b3-70f64fdd3896] No waiting events found dispatching network-vif-unplugged-1a900796-9d0d-43a8-8ccd-21307e17f875 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:43:22 user nova-compute[75122]: DEBUG nova.compute.manager [req-4ea49367-bfb6-4c5d-a450-7d2cf85be598 req-8d9728cf-a25d-43df-91a0-3f19c9855656 service nova] [instance: df913b3e-218d-4ae6-b7b3-70f64fdd3896] Received event network-vif-unplugged-1a900796-9d0d-43a8-8ccd-21307e17f875 for instance with task_state deleting. {{(pid=75122) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 09:43:22 user nova-compute[75122]: INFO nova.virt.libvirt.driver [-] [instance: df913b3e-218d-4ae6-b7b3-70f64fdd3896] Instance destroyed successfully.
Nov 15 09:43:22 user nova-compute[75122]: DEBUG nova.objects.instance [None req-7f13dc29-4207-41d2-bbbe-01a6e530a1ea tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Lazy-loading 'resources' on Instance uuid df913b3e-218d-4ae6-b7b3-70f64fdd3896 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:43:23 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-7f13dc29-4207-41d2-bbbe-01a6e530a1ea tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T09:37:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1839546565',display_name='tempest-AttachVolumeNegativeTest-server-1839546565',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1839546565',id=19,image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAElWj3x5xtshAY2VAWdnuBmoQjsm3lrwT9SyzEHcMAu/Y7+WZUQjuYaN/GPFaf4V6uT8GArSNheaFBNuhiZRVhd/T9NIo/d+O9kv0GY3FAf3m/it2t9MbWrCboHuAE1XQ==',key_name='tempest-keypair-191892403',keypairs=<?>,launch_index=0,launched_at=2023-11-15T09:37:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f29cd64a8a674d73936b8a0c90bf2d34',ramdisk_id='',reservation_id='r-hea6qvh1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-475232131',owner_user_name='tempest-AttachVolumeNegativeTest-475232131-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T09:37:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d52d39a644924944be943a3200bd5b33',uuid=df913b3e-218d-4ae6-b7b3-70f64fdd3896,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1a900796-9d0d-43a8-8ccd-21307e17f875", "address": "fa:16:3e:1b:53:31", "network": {"id": "cc80acf3-8a44-4d7e-aaa0-1214700564b3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1084984321-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f29cd64a8a674d73936b8a0c90bf2d34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a900796-9d", "ovs_interfaceid": "1a900796-9d0d-43a8-8ccd-21307e17f875", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 09:43:23 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-7f13dc29-4207-41d2-bbbe-01a6e530a1ea tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Converting VIF {"id": "1a900796-9d0d-43a8-8ccd-21307e17f875", "address": "fa:16:3e:1b:53:31", "network": {"id": "cc80acf3-8a44-4d7e-aaa0-1214700564b3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1084984321-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f29cd64a8a674d73936b8a0c90bf2d34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1a900796-9d", "ovs_interfaceid": "1a900796-9d0d-43a8-8ccd-21307e17f875", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 09:43:23 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-7f13dc29-4207-41d2-bbbe-01a6e530a1ea tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1b:53:31,bridge_name='br-int',has_traffic_filtering=True,id=1a900796-9d0d-43a8-8ccd-21307e17f875,network=Network(cc80acf3-8a44-4d7e-aaa0-1214700564b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a900796-9d') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 09:43:23 user nova-compute[75122]: DEBUG os_vif [None req-7f13dc29-4207-41d2-bbbe-01a6e530a1ea tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1b:53:31,bridge_name='br-int',has_traffic_filtering=True,id=1a900796-9d0d-43a8-8ccd-21307e17f875,network=Network(cc80acf3-8a44-4d7e-aaa0-1214700564b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a900796-9d') {{(pid=75122) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 09:43:23 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:43:23 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1a900796-9d, bridge=br-int, if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:43:23 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:43:23 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:43:23 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:43:23 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c2073906-06c4-4e59-833a-1c9ba9ac6291) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:43:23 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:43:23 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:43:23 user nova-compute[75122]: INFO os_vif [None req-7f13dc29-4207-41d2-bbbe-01a6e530a1ea tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1b:53:31,bridge_name='br-int',has_traffic_filtering=True,id=1a900796-9d0d-43a8-8ccd-21307e17f875,network=Network(cc80acf3-8a44-4d7e-aaa0-1214700564b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1a900796-9d')
Nov 15 09:43:23 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-7f13dc29-4207-41d2-bbbe-01a6e530a1ea tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] [instance: df913b3e-218d-4ae6-b7b3-70f64fdd3896] Deleting instance files /opt/stack/data/nova/instances/df913b3e-218d-4ae6-b7b3-70f64fdd3896_del
Nov 15 09:43:23 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-7f13dc29-4207-41d2-bbbe-01a6e530a1ea tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] [instance: df913b3e-218d-4ae6-b7b3-70f64fdd3896] Deletion of /opt/stack/data/nova/instances/df913b3e-218d-4ae6-b7b3-70f64fdd3896_del complete
Nov 15 09:43:23 user nova-compute[75122]: INFO nova.compute.manager [None req-7f13dc29-4207-41d2-bbbe-01a6e530a1ea tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] [instance: df913b3e-218d-4ae6-b7b3-70f64fdd3896] Took 1.02 seconds to destroy the instance on the hypervisor.
Nov 15 09:43:23 user nova-compute[75122]: DEBUG oslo.service.loopingcall [None req-7f13dc29-4207-41d2-bbbe-01a6e530a1ea tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75122) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 09:43:23 user nova-compute[75122]: DEBUG nova.compute.manager [-] [instance: df913b3e-218d-4ae6-b7b3-70f64fdd3896] Deallocating network for instance {{(pid=75122) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 09:43:23 user nova-compute[75122]: DEBUG nova.network.neutron [-] [instance: df913b3e-218d-4ae6-b7b3-70f64fdd3896] deallocate_for_instance() {{(pid=75122) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 09:43:23 user nova-compute[75122]: DEBUG nova.network.neutron [-] [instance: df913b3e-218d-4ae6-b7b3-70f64fdd3896] Updating instance_info_cache with network_info: [] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:43:23 user nova-compute[75122]: INFO nova.compute.manager [-] [instance: df913b3e-218d-4ae6-b7b3-70f64fdd3896] Took 0.76 seconds to deallocate network for instance.
Nov 15 09:43:23 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-7f13dc29-4207-41d2-bbbe-01a6e530a1ea tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:43:23 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-7f13dc29-4207-41d2-bbbe-01a6e530a1ea tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:43:23 user nova-compute[75122]: DEBUG nova.compute.manager [req-ad53aab1-921d-412d-b5b3-ee40ed2aae5a req-9a350b90-b538-4e9d-8498-6e7f3467f206 service nova] [instance: df913b3e-218d-4ae6-b7b3-70f64fdd3896] Received event network-vif-deleted-1a900796-9d0d-43a8-8ccd-21307e17f875 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:43:24 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:43:24 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:43:24 user nova-compute[75122]: DEBUG nova.compute.provider_tree [None req-7f13dc29-4207-41d2-bbbe-01a6e530a1ea tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Inventory has not changed in ProviderTree for provider: 69a3da65-47be-44c6-b67c-c692b58284ef {{(pid=75122) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 09:43:24 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-7f13dc29-4207-41d2-bbbe-01a6e530a1ea tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Inventory has not changed for provider 69a3da65-47be-44c6-b67c-c692b58284ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 09:43:24 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-7f13dc29-4207-41d2-bbbe-01a6e530a1ea tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.406s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:43:24 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.146s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:43:24 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:43:24 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75122) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 09:43:24 user nova-compute[75122]: INFO nova.scheduler.client.report [None req-7f13dc29-4207-41d2-bbbe-01a6e530a1ea tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Deleted allocations for instance df913b3e-218d-4ae6-b7b3-70f64fdd3896
Nov 15 09:43:24 user nova-compute[75122]: DEBUG nova.compute.manager [req-aa66bef9-5333-4fca-88c9-59b5e7f375d9 req-0b9d01de-f01f-4f16-a84b-ec794888d34a service nova] [instance: df913b3e-218d-4ae6-b7b3-70f64fdd3896] Received event network-vif-plugged-1a900796-9d0d-43a8-8ccd-21307e17f875 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:43:24 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-aa66bef9-5333-4fca-88c9-59b5e7f375d9 req-0b9d01de-f01f-4f16-a84b-ec794888d34a service nova] Acquiring lock "df913b3e-218d-4ae6-b7b3-70f64fdd3896-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:43:24 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-aa66bef9-5333-4fca-88c9-59b5e7f375d9 req-0b9d01de-f01f-4f16-a84b-ec794888d34a service nova] Lock "df913b3e-218d-4ae6-b7b3-70f64fdd3896-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:43:24 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-aa66bef9-5333-4fca-88c9-59b5e7f375d9 req-0b9d01de-f01f-4f16-a84b-ec794888d34a service nova] Lock "df913b3e-218d-4ae6-b7b3-70f64fdd3896-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:43:24 user nova-compute[75122]: DEBUG nova.compute.manager [req-aa66bef9-5333-4fca-88c9-59b5e7f375d9 req-0b9d01de-f01f-4f16-a84b-ec794888d34a service nova] [instance: df913b3e-218d-4ae6-b7b3-70f64fdd3896] No waiting events found dispatching network-vif-plugged-1a900796-9d0d-43a8-8ccd-21307e17f875 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:43:24 user nova-compute[75122]: WARNING nova.compute.manager [req-aa66bef9-5333-4fca-88c9-59b5e7f375d9 req-0b9d01de-f01f-4f16-a84b-ec794888d34a service nova] [instance: df913b3e-218d-4ae6-b7b3-70f64fdd3896] Received unexpected event network-vif-plugged-1a900796-9d0d-43a8-8ccd-21307e17f875 for instance with vm_state deleted and task_state None.
Nov 15 09:43:24 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-7f13dc29-4207-41d2-bbbe-01a6e530a1ea tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Lock "df913b3e-218d-4ae6-b7b3-70f64fdd3896" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.401s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:43:24 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f6177c5-3048-4a78-b34a-e595d26d69d0/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:43:24 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f6177c5-3048-4a78-b34a-e595d26d69d0/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:43:24 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f6177c5-3048-4a78-b34a-e595d26d69d0/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:43:24 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f6177c5-3048-4a78-b34a-e595d26d69d0/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:43:24 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2f45f49-0bca-4ae2-bc2a-eed293143489/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:43:25 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2f45f49-0bca-4ae2-bc2a-eed293143489/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:43:25 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2f45f49-0bca-4ae2-bc2a-eed293143489/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:43:25 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2f45f49-0bca-4ae2-bc2a-eed293143489/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:43:25 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75122) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 09:43:25 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc80e3fb-b5a3-4685-8ec5-12f8c385b833/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:43:25 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc80e3fb-b5a3-4685-8ec5-12f8c385b833/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:43:25 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc80e3fb-b5a3-4685-8ec5-12f8c385b833/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:43:25 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc80e3fb-b5a3-4685-8ec5-12f8c385b833/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:43:25 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd9d52bb-6248-48e6-a798-6dbdaaa68cbc/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:43:25 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd9d52bb-6248-48e6-a798-6dbdaaa68cbc/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:43:25 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd9d52bb-6248-48e6-a798-6dbdaaa68cbc/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:43:26 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd9d52bb-6248-48e6-a798-6dbdaaa68cbc/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:43:26 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75122) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 09:43:26 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52c066f3-dea1-4aa3-9da4-da9397b9fff1/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:43:26 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:43:26 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-6cf10367-1548-45bb-bbfd-4ac2819d38bb tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 6f6177c5-3048-4a78-b34a-e595d26d69d0 is timed out.
Nov 15 09:43:26 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-6cf10367-1548-45bb-bbfd-4ac2819d38bb tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Successfully detached device vdb from instance 6f6177c5-3048-4a78-b34a-e595d26d69d0 from the live domain config.
Nov 15 09:43:26 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6cf10367-1548-45bb-bbfd-4ac2819d38bb tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] [instance: 6f6177c5-3048-4a78-b34a-e595d26d69d0] calling os-brick to detach iSCSI Volume {{(pid=75122) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 09:43:26 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cf10367-1548-45bb-bbfd-4ac2819d38bb tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffa04060b80>, {'target_iqn': 'iqn.2010-10.org.openstack:fd818868-d5e9-440a-88a0-16ff267004be', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yZeKCqWo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 09:43:26 user nova-compute[75122]: WARNING os_brick.initiator.connectors.base [None req-6cf10367-1548-45bb-bbfd-4ac2819d38bb tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 09:43:26 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-6cf10367-1548-45bb-bbfd-4ac2819d38bb tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 09:43:26 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-6cf10367-1548-45bb-bbfd-4ac2819d38bb tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 09:43:26 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:43:26 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:43:26 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[f418eb03-ad94-442f-89a6-03a8b6bb3dbc]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:284cc694-dd22-4f9e-8f3b-787e222f8da5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:395810b1-e3c3-4660-aaaf-b6d9e7cb5a88\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fd818868-d5e9-440a-88a0-16ff267004be\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:43:26 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cf10367-1548-45bb-bbfd-4ac2819d38bb tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 09:43:26 user nova-compute[75122]: No targets found.
Nov 15 09:43:26 user nova-compute[75122]: iSNS:
Nov 15 09:43:26 user nova-compute[75122]: No targets found.
Nov 15 09:43:26 user nova-compute[75122]: STATIC:
Nov 15 09:43:26 user nova-compute[75122]: Target: iqn.2010-10.org.openstack:284cc694-dd22-4f9e-8f3b-787e222f8da5
Nov 15 09:43:26 user nova-compute[75122]:         Portal: 172.16.0.220:3260,-1
Nov 15 09:43:26 user nova-compute[75122]:                 Iface Name: default
Nov 15 09:43:26 user nova-compute[75122]: Target: iqn.2010-10.org.openstack:395810b1-e3c3-4660-aaaf-b6d9e7cb5a88
Nov 15 09:43:26 user nova-compute[75122]:         Portal: 172.16.0.220:3260,-1
Nov 15 09:43:26 user nova-compute[75122]:                 Iface Name: default
Nov 15 09:43:26 user nova-compute[75122]: Target: iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17
Nov 15 09:43:26 user nova-compute[75122]:         Portal: 172.16.0.220:3260,-1
Nov 15 09:43:26 user nova-compute[75122]:                 Iface Name: default
Nov 15 09:43:26 user nova-compute[75122]: Target: iqn.2010-10.org.openstack:fd818868-d5e9-440a-88a0-16ff267004be
Nov 15 09:43:26 user nova-compute[75122]:         Portal: 172.16.0.220:3260,-1
Nov 15 09:43:26 user nova-compute[75122]:                 Iface Name: default
Nov 15 09:43:26 user nova-compute[75122]: FIRMWARE:
Nov 15 09:43:26 user nova-compute[75122]: No targets found.
Nov 15 09:43:26 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 09:43:26 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cf10367-1548-45bb-bbfd-4ac2819d38bb tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 09:43:26 user nova-compute[75122]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 09:43:26 user nova-compute[75122]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75122) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 09:43:26 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cf10367-1548-45bb-bbfd-4ac2819d38bb tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fd818868-d5e9-440a-88a0-16ff267004be', 0)] {{(pid=75122) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 09:43:26 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:43:26 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52c066f3-dea1-4aa3-9da4-da9397b9fff1/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:43:26 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52c066f3-dea1-4aa3-9da4-da9397b9fff1/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:43:26 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:43:26 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ace79b2-a684-4fbf-bbba-27ad4c6e704d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:284cc694-dd22-4f9e-8f3b-787e222f8da5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:395810b1-e3c3-4660-aaaf-b6d9e7cb5a88\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fd818868-d5e9-440a-88a0-16ff267004be\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:43:26 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:43:26 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:43:26 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee3bca57-f4bb-4278-8769-28b19bb9734d]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:395810b1-e3c3-4660-aaaf-b6d9e7cb5a88 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd818868-d5e9-440a-88a0-16ff267004be (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:284cc694-dd22-4f9e-8f3b-787e222f8da5 (non-flash)\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:43:26 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cf10367-1548-45bb-bbfd-4ac2819d38bb tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17 (non-flash)
Nov 15 09:43:26 user nova-compute[75122]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:395810b1-e3c3-4660-aaaf-b6d9e7cb5a88 (non-flash)
Nov 15 09:43:26 user nova-compute[75122]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd818868-d5e9-440a-88a0-16ff267004be (non-flash)
Nov 15 09:43:26 user nova-compute[75122]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:284cc694-dd22-4f9e-8f3b-787e222f8da5 (non-flash)
Nov 15 09:43:26 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 09:43:26 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cf10367-1548-45bb-bbfd-4ac2819d38bb tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17 (non-flash)
Nov 15 09:43:26 user nova-compute[75122]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:395810b1-e3c3-4660-aaaf-b6d9e7cb5a88 (non-flash)
Nov 15 09:43:26 user nova-compute[75122]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fd818868-d5e9-440a-88a0-16ff267004be (non-flash)
Nov 15 09:43:26 user nova-compute[75122]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:284cc694-dd22-4f9e-8f3b-787e222f8da5 (non-flash)
Nov 15 09:43:26 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 09:43:26 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cf10367-1548-45bb-bbfd-4ac2819d38bb tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ffa04411510>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fd818868-d5e9-440a-88a0-16ff267004be'): ({'sdb'}, set())}) {{(pid=75122) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 09:43:26 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-6cf10367-1548-45bb-bbfd-4ac2819d38bb tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Removing single pathed devices sdb {{(pid=75122) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 09:43:26 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:43:26 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:43:26 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[31e6b01a-c9e5-48db-a127-34171b5222e6]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:43:26 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:43:26 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:43:26 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[10922ea2-f51f-4423-a764-357e88fb0c31]: (4, ('ok\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:43:26 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-6cf10367-1548-45bb-bbfd-4ac2819d38bb tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Flushing IO for device /dev/sdb {{(pid=75122) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 09:43:26 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:43:26 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:43:26 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b9672ef-3d21-4679-ae8b-e32a20bbbd37]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:43:26 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-6cf10367-1548-45bb-bbfd-4ac2819d38bb tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75122) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 09:43:26 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:43:26 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:43:26 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9be79c3-8504-4006-8bf8-9148b98c5f02]: (4, ('1', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:43:26 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-6cf10367-1548-45bb-bbfd-4ac2819d38bb tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75122) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 09:43:26 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-6cf10367-1548-45bb-bbfd-4ac2819d38bb tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] SCSI volumes sdb have been removed. {{(pid=75122) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 09:43:26 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cf10367-1548-45bb-bbfd-4ac2819d38bb tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fd818868-d5e9-440a-88a0-16ff267004be')] {{(pid=75122) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 09:43:26 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd818868-d5e9-440a-88a0-16ff267004be -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:43:26 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/52c066f3-dea1-4aa3-9da4-da9397b9fff1/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:43:26 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/131142fd-e8ec-42d1-a518-aa21c7bb7cb1/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:43:26 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd818868-d5e9-440a-88a0-16ff267004be -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:43:26 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd6ba1cd-d964-4361-a363-92d4895aa0b6]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:43:26 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cf10367-1548-45bb-bbfd-4ac2819d38bb tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:43:26 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd818868-d5e9-440a-88a0-16ff267004be -p 172.16.0.220:3260 --logout {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:43:26 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd818868-d5e9-440a-88a0-16ff267004be -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:43:26 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa40a274-7cbc-437f-bea0-8190406f9c98]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:fd818868-d5e9-440a-88a0-16ff267004be, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:fd818868-d5e9-440a-88a0-16ff267004be, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:43:26 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cf10367-1548-45bb-bbfd-4ac2819d38bb tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:fd818868-d5e9-440a-88a0-16ff267004be, portal: 172.16.0.220,3260]
Nov 15 09:43:26 user nova-compute[75122]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:fd818868-d5e9-440a-88a0-16ff267004be, portal: 172.16.0.220,3260] successful.
Nov 15 09:43:26 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:43:26 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fd818868-d5e9-440a-88a0-16ff267004be -p 172.16.0.220:3260 --op delete {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:43:26 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fd818868-d5e9-440a-88a0-16ff267004be -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:43:26 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[882e4a57-0e2c-4440-888d-066b7ab83c2a]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:43:26 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cf10367-1548-45bb-bbfd-4ac2819d38bb tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:43:26 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-6cf10367-1548-45bb-bbfd-4ac2819d38bb tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.377s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 09:43:26 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cf10367-1548-45bb-bbfd-4ac2819d38bb tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] <== disconnect_volume: return (379ms) None {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 09:43:26 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6cf10367-1548-45bb-bbfd-4ac2819d38bb tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] [instance: 6f6177c5-3048-4a78-b34a-e595d26d69d0] Disconnected iSCSI Volume {{(pid=75122) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 09:43:26 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/131142fd-e8ec-42d1-a518-aa21c7bb7cb1/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:43:26 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/131142fd-e8ec-42d1-a518-aa21c7bb7cb1/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:43:26 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/131142fd-e8ec-42d1-a518-aa21c7bb7cb1/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:43:26 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00270cc2-4f5b-4f64-8f88-31f21e3b3950/disk.rescue --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:43:27 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00270cc2-4f5b-4f64-8f88-31f21e3b3950/disk.rescue --force-share --output=json" returned: 0 in 0.201s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:43:27 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00270cc2-4f5b-4f64-8f88-31f21e3b3950/disk.rescue --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:43:27 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00270cc2-4f5b-4f64-8f88-31f21e3b3950/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:43:27 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00270cc2-4f5b-4f64-8f88-31f21e3b3950/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:43:27 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00270cc2-4f5b-4f64-8f88-31f21e3b3950/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:43:27 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00270cc2-4f5b-4f64-8f88-31f21e3b3950/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:43:27 user nova-compute[75122]: DEBUG nova.objects.instance [None req-6cf10367-1548-45bb-bbfd-4ac2819d38bb tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Lazy-loading 'flavor' on Instance uuid 6f6177c5-3048-4a78-b34a-e595d26d69d0 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:43:27 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00270cc2-4f5b-4f64-8f88-31f21e3b3950/disk --force-share --output=json" returned: 0 in 0.282s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:43:27 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-6cf10367-1548-45bb-bbfd-4ac2819d38bb tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Lock "6f6177c5-3048-4a78-b34a-e595d26d69d0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.160s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:43:28 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:43:28 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 09:43:28 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 09:43:28 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Hypervisor/Node resource view: name=user free_ram=7760MB free_disk=25.29739761352539GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75122) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 09:43:28 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:43:28 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:43:28 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance 131142fd-e8ec-42d1-a518-aa21c7bb7cb1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:43:28 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance fd9d52bb-6248-48e6-a798-6dbdaaa68cbc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:43:28 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance 00270cc2-4f5b-4f64-8f88-31f21e3b3950 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:43:28 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance c2f45f49-0bca-4ae2-bc2a-eed293143489 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:43:28 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance e1afe5d4-42c0-491c-b1c7-c8debf1d5da2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:43:28 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance 6f6177c5-3048-4a78-b34a-e595d26d69d0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:43:28 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance 52c066f3-dea1-4aa3-9da4-da9397b9fff1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:43:28 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance cc485c6c-5a9a-4c94-b966-68dd9e336e56 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:43:28 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance bc80e3fb-b5a3-4685-8ec5-12f8c385b833 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:43:28 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75122) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 09:43:28 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75122) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 09:43:28 user nova-compute[75122]: DEBUG nova.compute.manager [req-7cb1bd2d-95af-4a83-882e-3370e49fa83f req-7c07ca9d-3161-495f-926f-5d9cfbab0c1e service nova] [instance: 131142fd-e8ec-42d1-a518-aa21c7bb7cb1] Received event network-changed-f8302d0d-f140-479c-96da-b21516385381 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:43:28 user nova-compute[75122]: DEBUG nova.compute.manager [req-7cb1bd2d-95af-4a83-882e-3370e49fa83f req-7c07ca9d-3161-495f-926f-5d9cfbab0c1e service nova] [instance: 131142fd-e8ec-42d1-a518-aa21c7bb7cb1] Refreshing instance network info cache due to event network-changed-f8302d0d-f140-479c-96da-b21516385381. {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 09:43:28 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-7cb1bd2d-95af-4a83-882e-3370e49fa83f req-7c07ca9d-3161-495f-926f-5d9cfbab0c1e service nova] Acquiring lock "refresh_cache-131142fd-e8ec-42d1-a518-aa21c7bb7cb1" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 09:43:28 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-7cb1bd2d-95af-4a83-882e-3370e49fa83f req-7c07ca9d-3161-495f-926f-5d9cfbab0c1e service nova] Acquired lock "refresh_cache-131142fd-e8ec-42d1-a518-aa21c7bb7cb1" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 09:43:28 user nova-compute[75122]: DEBUG nova.network.neutron [req-7cb1bd2d-95af-4a83-882e-3370e49fa83f req-7c07ca9d-3161-495f-926f-5d9cfbab0c1e service nova] [instance: 131142fd-e8ec-42d1-a518-aa21c7bb7cb1] Refreshing network info cache for port f8302d0d-f140-479c-96da-b21516385381 {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 09:43:28 user nova-compute[75122]: DEBUG nova.compute.provider_tree [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Inventory has not changed in ProviderTree for provider: 69a3da65-47be-44c6-b67c-c692b58284ef {{(pid=75122) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 09:43:28 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Inventory has not changed for provider 69a3da65-47be-44c6-b67c-c692b58284ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 09:43:28 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Compute_service record updated for user:user {{(pid=75122) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 09:43:28 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.526s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:43:29 user nova-compute[75122]: DEBUG nova.network.neutron [req-7cb1bd2d-95af-4a83-882e-3370e49fa83f req-7c07ca9d-3161-495f-926f-5d9cfbab0c1e service nova] [instance: 131142fd-e8ec-42d1-a518-aa21c7bb7cb1] Updated VIF entry in instance network info cache for port f8302d0d-f140-479c-96da-b21516385381. {{(pid=75122) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 09:43:29 user nova-compute[75122]: DEBUG nova.network.neutron [req-7cb1bd2d-95af-4a83-882e-3370e49fa83f req-7c07ca9d-3161-495f-926f-5d9cfbab0c1e service nova] [instance: 131142fd-e8ec-42d1-a518-aa21c7bb7cb1] Updating instance_info_cache with network_info: [{"id": "f8302d0d-f140-479c-96da-b21516385381", "address": "fa:16:3e:06:1e:34", "network": {"id": "6e846655-a6f8-4339-a239-65d2f94c8b74", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1923452032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b8e67f8a66a4930be3fb65c397cbeb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8302d0d-f1", "ovs_interfaceid": "f8302d0d-f140-479c-96da-b21516385381", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:43:29 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-7cb1bd2d-95af-4a83-882e-3370e49fa83f req-7c07ca9d-3161-495f-926f-5d9cfbab0c1e service nova] Releasing lock "refresh_cache-131142fd-e8ec-42d1-a518-aa21c7bb7cb1" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 09:43:30 user nova-compute[75122]: DEBUG nova.compute.manager [None req-3b843efe-1db5-44f5-b55a-25e62bddc2f5 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] [instance: cc485c6c-5a9a-4c94-b966-68dd9e336e56] Stashing vm_state: active {{(pid=75122) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 15 09:43:30 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-3b843efe-1db5-44f5-b55a-25e62bddc2f5 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:43:30 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-3b843efe-1db5-44f5-b55a-25e62bddc2f5 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:43:30 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-3b843efe-1db5-44f5-b55a-25e62bddc2f5 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75122) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 09:43:30 user nova-compute[75122]: INFO nova.compute.claims [None req-3b843efe-1db5-44f5-b55a-25e62bddc2f5 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] [instance: cc485c6c-5a9a-4c94-b966-68dd9e336e56] Claim successful on node user
Nov 15 09:43:30 user nova-compute[75122]: INFO nova.compute.resource_tracker [None req-3b843efe-1db5-44f5-b55a-25e62bddc2f5 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] [instance: cc485c6c-5a9a-4c94-b966-68dd9e336e56] Updating resource usage from migration 1c6b84e0-2ff9-44f1-bd0a-20e98d2f2ac0
Nov 15 09:43:30 user nova-compute[75122]: DEBUG nova.compute.manager [req-dc240d2f-7061-4d0d-a477-bc2a6b61dfb4 req-c20b7241-f4bf-42e7-a8b3-fce5e180e675 service nova] [instance: cc485c6c-5a9a-4c94-b966-68dd9e336e56] Received event network-changed-d3b26bb1-8ddd-4467-af3e-74e39d54390e {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:43:30 user nova-compute[75122]: DEBUG nova.compute.manager [req-dc240d2f-7061-4d0d-a477-bc2a6b61dfb4 req-c20b7241-f4bf-42e7-a8b3-fce5e180e675 service nova] [instance: cc485c6c-5a9a-4c94-b966-68dd9e336e56] Refreshing instance network info cache due to event network-changed-d3b26bb1-8ddd-4467-af3e-74e39d54390e. {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 09:43:30 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-dc240d2f-7061-4d0d-a477-bc2a6b61dfb4 req-c20b7241-f4bf-42e7-a8b3-fce5e180e675 service nova] Acquiring lock "refresh_cache-cc485c6c-5a9a-4c94-b966-68dd9e336e56" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 09:43:30 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-dc240d2f-7061-4d0d-a477-bc2a6b61dfb4 req-c20b7241-f4bf-42e7-a8b3-fce5e180e675 service nova] Acquired lock "refresh_cache-cc485c6c-5a9a-4c94-b966-68dd9e336e56" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 09:43:30 user nova-compute[75122]: DEBUG nova.network.neutron [req-dc240d2f-7061-4d0d-a477-bc2a6b61dfb4 req-c20b7241-f4bf-42e7-a8b3-fce5e180e675 service nova] [instance: cc485c6c-5a9a-4c94-b966-68dd9e336e56] Refreshing network info cache for port d3b26bb1-8ddd-4467-af3e-74e39d54390e {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 09:43:30 user nova-compute[75122]: DEBUG nova.compute.provider_tree [None req-3b843efe-1db5-44f5-b55a-25e62bddc2f5 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Inventory has not changed in ProviderTree for provider: 69a3da65-47be-44c6-b67c-c692b58284ef {{(pid=75122) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 09:43:30 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-3b843efe-1db5-44f5-b55a-25e62bddc2f5 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Inventory has not changed for provider 69a3da65-47be-44c6-b67c-c692b58284ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 09:43:31 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-3b843efe-1db5-44f5-b55a-25e62bddc2f5 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.481s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:43:31 user nova-compute[75122]: INFO nova.compute.manager [None req-3b843efe-1db5-44f5-b55a-25e62bddc2f5 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] [instance: cc485c6c-5a9a-4c94-b966-68dd9e336e56] Migrating
Nov 15 09:43:31 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-3b843efe-1db5-44f5-b55a-25e62bddc2f5 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Acquiring lock "refresh_cache-cc485c6c-5a9a-4c94-b966-68dd9e336e56" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 09:43:31 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:43:31 user nova-compute[75122]: DEBUG nova.network.neutron [req-dc240d2f-7061-4d0d-a477-bc2a6b61dfb4 req-c20b7241-f4bf-42e7-a8b3-fce5e180e675 service nova] [instance: cc485c6c-5a9a-4c94-b966-68dd9e336e56] Updated VIF entry in instance network info cache for port d3b26bb1-8ddd-4467-af3e-74e39d54390e. {{(pid=75122) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 09:43:31 user nova-compute[75122]: DEBUG nova.network.neutron [req-dc240d2f-7061-4d0d-a477-bc2a6b61dfb4 req-c20b7241-f4bf-42e7-a8b3-fce5e180e675 service nova] [instance: cc485c6c-5a9a-4c94-b966-68dd9e336e56] Updating instance_info_cache with network_info: [{"id": "d3b26bb1-8ddd-4467-af3e-74e39d54390e", "address": "fa:16:3e:8c:a9:0b", "network": {"id": "6e846655-a6f8-4339-a239-65d2f94c8b74", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1923452032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b8e67f8a66a4930be3fb65c397cbeb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3b26bb1-8d", "ovs_interfaceid": "d3b26bb1-8ddd-4467-af3e-74e39d54390e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:43:31 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-dc240d2f-7061-4d0d-a477-bc2a6b61dfb4 req-c20b7241-f4bf-42e7-a8b3-fce5e180e675 service nova] Releasing lock "refresh_cache-cc485c6c-5a9a-4c94-b966-68dd9e336e56" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 09:43:31 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-3b843efe-1db5-44f5-b55a-25e62bddc2f5 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Acquired lock "refresh_cache-cc485c6c-5a9a-4c94-b966-68dd9e336e56" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 09:43:31 user nova-compute[75122]: DEBUG nova.network.neutron [None req-3b843efe-1db5-44f5-b55a-25e62bddc2f5 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] [instance: cc485c6c-5a9a-4c94-b966-68dd9e336e56] Building network info cache for instance {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 09:43:31 user nova-compute[75122]: DEBUG nova.network.neutron [None req-3b843efe-1db5-44f5-b55a-25e62bddc2f5 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] [instance: cc485c6c-5a9a-4c94-b966-68dd9e336e56] Updating instance_info_cache with network_info: [{"id": "d3b26bb1-8ddd-4467-af3e-74e39d54390e", "address": "fa:16:3e:8c:a9:0b", "network": {"id": "6e846655-a6f8-4339-a239-65d2f94c8b74", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1923452032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b8e67f8a66a4930be3fb65c397cbeb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3b26bb1-8d", "ovs_interfaceid": "d3b26bb1-8ddd-4467-af3e-74e39d54390e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:43:31 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-3b843efe-1db5-44f5-b55a-25e62bddc2f5 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Releasing lock "refresh_cache-cc485c6c-5a9a-4c94-b966-68dd9e336e56" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 09:43:32 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-3b843efe-1db5-44f5-b55a-25e62bddc2f5 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] [instance: cc485c6c-5a9a-4c94-b966-68dd9e336e56] Starting migrate_disk_and_power_off {{(pid=75122) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Nov 15 09:43:32 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:43:32 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:43:32 user nova-compute[75122]: DEBUG nova.compute.manager [req-cad6695a-0f6c-4e56-88a8-fabc5a87d1df req-089646e1-51bb-4a8b-a2ef-a8ee15cbf8e2 service nova] [instance: cc485c6c-5a9a-4c94-b966-68dd9e336e56] Received event network-vif-unplugged-d3b26bb1-8ddd-4467-af3e-74e39d54390e {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:43:32 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-cad6695a-0f6c-4e56-88a8-fabc5a87d1df req-089646e1-51bb-4a8b-a2ef-a8ee15cbf8e2 service nova] Acquiring lock "cc485c6c-5a9a-4c94-b966-68dd9e336e56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:43:32 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-cad6695a-0f6c-4e56-88a8-fabc5a87d1df req-089646e1-51bb-4a8b-a2ef-a8ee15cbf8e2 service nova] Lock "cc485c6c-5a9a-4c94-b966-68dd9e336e56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:43:32 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-cad6695a-0f6c-4e56-88a8-fabc5a87d1df req-089646e1-51bb-4a8b-a2ef-a8ee15cbf8e2 service nova] Lock "cc485c6c-5a9a-4c94-b966-68dd9e336e56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:43:32 user nova-compute[75122]: DEBUG nova.compute.manager [req-cad6695a-0f6c-4e56-88a8-fabc5a87d1df req-089646e1-51bb-4a8b-a2ef-a8ee15cbf8e2 service nova] [instance: cc485c6c-5a9a-4c94-b966-68dd9e336e56] No waiting events found dispatching network-vif-unplugged-d3b26bb1-8ddd-4467-af3e-74e39d54390e {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:43:32 user nova-compute[75122]: WARNING nova.compute.manager [req-cad6695a-0f6c-4e56-88a8-fabc5a87d1df req-089646e1-51bb-4a8b-a2ef-a8ee15cbf8e2 service nova] [instance: cc485c6c-5a9a-4c94-b966-68dd9e336e56] Received unexpected event network-vif-unplugged-d3b26bb1-8ddd-4467-af3e-74e39d54390e for instance with vm_state active and task_state resize_migrating.
Nov 15 09:43:32 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:43:32 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:43:32 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:43:32 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:43:32 user nova-compute[75122]: INFO nova.virt.libvirt.driver [-] [instance: cc485c6c-5a9a-4c94-b966-68dd9e336e56] Instance destroyed successfully.
Nov 15 09:43:32 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-3b843efe-1db5-44f5-b55a-25e62bddc2f5 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T09:41:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-876462161',display_name='tempest-ServerActionsTestOtherA-server-876462161',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-876462161',id=28,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOjee/3FY3+bQUxkeNPW0HfKU2TS7/WwlSdJA5dC2LRbPtr2GAllBrZqAcx+1wIVC2pqAFLTFeo/KsxadKKcxACsVLYL8LB97mDl41CXm0aq5TWX4fm1S5aOkZSs0D2eNA==',key_name='tempest-keypair-686734186',keypairs=<?>,launch_index=0,launched_at=2023-11-15T09:41:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='8b8e67f8a66a4930be3fb65c397cbeb2',ramdisk_id='',reservation_id='r-50r2vzfz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1521412552',owner_user_name='tempest-ServerActionsTestOtherA-1521412552-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T09:43:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='91f1469b2c7c45d6ac27f2b64fd5cefe',uuid=cc485c6c-5a9a-4c94-b966-68dd9e336e56,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d3b26bb1-8ddd-4467-af3e-74e39d54390e", "address": "fa:16:3e:8c:a9:0b", "network": {"id": "6e846655-a6f8-4339-a239-65d2f94c8b74", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1923452032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1923452032-network", "vif_mac": "fa:16:3e:8c:a9:0b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b8e67f8a66a4930be3fb65c397cbeb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3b26bb1-8d", "ovs_interfaceid": "d3b26bb1-8ddd-4467-af3e-74e39d54390e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 09:43:32 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-3b843efe-1db5-44f5-b55a-25e62bddc2f5 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Converting VIF {"id": "d3b26bb1-8ddd-4467-af3e-74e39d54390e", "address": "fa:16:3e:8c:a9:0b", "network": {"id": "6e846655-a6f8-4339-a239-65d2f94c8b74", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1923452032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1923452032-network", "vif_mac": "fa:16:3e:8c:a9:0b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b8e67f8a66a4930be3fb65c397cbeb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3b26bb1-8d", "ovs_interfaceid": "d3b26bb1-8ddd-4467-af3e-74e39d54390e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 09:43:32 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-3b843efe-1db5-44f5-b55a-25e62bddc2f5 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8c:a9:0b,bridge_name='br-int',has_traffic_filtering=True,id=d3b26bb1-8ddd-4467-af3e-74e39d54390e,network=Network(6e846655-a6f8-4339-a239-65d2f94c8b74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3b26bb1-8d') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 09:43:32 user nova-compute[75122]: DEBUG os_vif [None req-3b843efe-1db5-44f5-b55a-25e62bddc2f5 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8c:a9:0b,bridge_name='br-int',has_traffic_filtering=True,id=d3b26bb1-8ddd-4467-af3e-74e39d54390e,network=Network(6e846655-a6f8-4339-a239-65d2f94c8b74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3b26bb1-8d') {{(pid=75122) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 09:43:32 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:43:32 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd3b26bb1-8d, bridge=br-int, if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:43:32 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:43:32 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:43:32 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:43:32 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=22a4650a-8efe-4542-a81a-7af157a09071) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:43:32 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:43:32 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:43:32 user nova-compute[75122]: INFO os_vif [None req-3b843efe-1db5-44f5-b55a-25e62bddc2f5 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8c:a9:0b,bridge_name='br-int',has_traffic_filtering=True,id=d3b26bb1-8ddd-4467-af3e-74e39d54390e,network=Network(6e846655-a6f8-4339-a239-65d2f94c8b74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3b26bb1-8d')
Nov 15 09:43:32 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b843efe-1db5-44f5-b55a-25e62bddc2f5 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] [instance: cc485c6c-5a9a-4c94-b966-68dd9e336e56] calling os-brick to detach iSCSI Volume {{(pid=75122) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 09:43:32 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b843efe-1db5-44f5-b55a-25e62bddc2f5 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffa04060b80>, {'target_iqn': 'iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DdRJNhXT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 09:43:32 user nova-compute[75122]: WARNING os_brick.initiator.connectors.base [None req-3b843efe-1db5-44f5-b55a-25e62bddc2f5 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 09:43:32 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-3b843efe-1db5-44f5-b55a-25e62bddc2f5 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 09:43:32 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-3b843efe-1db5-44f5-b55a-25e62bddc2f5 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 09:43:32 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:43:32 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:43:32 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fd94624-8f24-4c31-be41-e6242ef5bd29]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:284cc694-dd22-4f9e-8f3b-787e222f8da5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:395810b1-e3c3-4660-aaaf-b6d9e7cb5a88\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:43:32 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b843efe-1db5-44f5-b55a-25e62bddc2f5 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 09:43:32 user nova-compute[75122]: No targets found.
Nov 15 09:43:32 user nova-compute[75122]: iSNS:
Nov 15 09:43:32 user nova-compute[75122]: No targets found.
Nov 15 09:43:32 user nova-compute[75122]: STATIC:
Nov 15 09:43:32 user nova-compute[75122]: Target: iqn.2010-10.org.openstack:284cc694-dd22-4f9e-8f3b-787e222f8da5
Nov 15 09:43:32 user nova-compute[75122]:         Portal: 172.16.0.220:3260,-1
Nov 15 09:43:32 user nova-compute[75122]:                 Iface Name: default
Nov 15 09:43:32 user nova-compute[75122]: Target: iqn.2010-10.org.openstack:395810b1-e3c3-4660-aaaf-b6d9e7cb5a88
Nov 15 09:43:32 user nova-compute[75122]:         Portal: 172.16.0.220:3260,-1
Nov 15 09:43:32 user nova-compute[75122]:                 Iface Name: default
Nov 15 09:43:32 user nova-compute[75122]: Target: iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17
Nov 15 09:43:32 user nova-compute[75122]:         Portal: 172.16.0.220:3260,-1
Nov 15 09:43:32 user nova-compute[75122]:                 Iface Name: default
Nov 15 09:43:32 user nova-compute[75122]: FIRMWARE:
Nov 15 09:43:32 user nova-compute[75122]: No targets found.
Nov 15 09:43:32 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 09:43:32 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b843efe-1db5-44f5-b55a-25e62bddc2f5 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 09:43:32 user nova-compute[75122]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 09:43:32 user nova-compute[75122]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75122) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 09:43:32 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b843efe-1db5-44f5-b55a-25e62bddc2f5 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17', 0)] {{(pid=75122) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 09:43:32 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:43:32 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:43:32 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[957fc086-31ce-4af7-88cf-7167d6c7bbc3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:284cc694-dd22-4f9e-8f3b-787e222f8da5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:395810b1-e3c3-4660-aaaf-b6d9e7cb5a88\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:43:32 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:43:33 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:43:33 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[91b2845d-56e6-43e5-9d2d-f0d11896d905]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:395810b1-e3c3-4660-aaaf-b6d9e7cb5a88 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:284cc694-dd22-4f9e-8f3b-787e222f8da5 (non-flash)\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:43:33 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b843efe-1db5-44f5-b55a-25e62bddc2f5 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17 (non-flash)
Nov 15 09:43:33 user nova-compute[75122]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:395810b1-e3c3-4660-aaaf-b6d9e7cb5a88 (non-flash)
Nov 15 09:43:33 user nova-compute[75122]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:284cc694-dd22-4f9e-8f3b-787e222f8da5 (non-flash)
Nov 15 09:43:33 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 09:43:33 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b843efe-1db5-44f5-b55a-25e62bddc2f5 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17 (non-flash)
Nov 15 09:43:33 user nova-compute[75122]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:395810b1-e3c3-4660-aaaf-b6d9e7cb5a88 (non-flash)
Nov 15 09:43:33 user nova-compute[75122]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:284cc694-dd22-4f9e-8f3b-787e222f8da5 (non-flash)
Nov 15 09:43:33 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 09:43:33 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b843efe-1db5-44f5-b55a-25e62bddc2f5 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff9e438fbe0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17'): ({'sdc'}, set())}) {{(pid=75122) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 09:43:33 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-3b843efe-1db5-44f5-b55a-25e62bddc2f5 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Removing single pathed devices sdc {{(pid=75122) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 09:43:33 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:43:33 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.037s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:43:33 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7f5478d-3e76-471d-9ba9-5f4cfea16242]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:43:33 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:43:33 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:43:33 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[87fb6d60-b667-43c4-884b-ab91373efa06]: (4, ('ok\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:43:33 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-3b843efe-1db5-44f5-b55a-25e62bddc2f5 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Flushing IO for device /dev/sdc {{(pid=75122) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 09:43:33 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:43:33 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:43:33 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f22dedb-231d-4f5e-a0a4-d48ee444340e]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:43:33 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-3b843efe-1db5-44f5-b55a-25e62bddc2f5 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75122) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 09:43:33 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:43:33 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.063s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:43:33 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8be4d1f-71b2-4e94-b421-c0be16ac12b8]: (4, ('1', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:43:33 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-3b843efe-1db5-44f5-b55a-25e62bddc2f5 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75122) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 09:43:33 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-3b843efe-1db5-44f5-b55a-25e62bddc2f5 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] SCSI volumes sdc have been removed. {{(pid=75122) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 09:43:33 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b843efe-1db5-44f5-b55a-25e62bddc2f5 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17')] {{(pid=75122) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 09:43:33 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:43:33 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:43:33 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a69e70e-6e9b-4c00-aba8-608becf9d77e]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:43:33 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b843efe-1db5-44f5-b55a-25e62bddc2f5 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:43:33 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17 -p 172.16.0.220:3260 --logout {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:43:33 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:43:33 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[36889559-89f4-4047-a498-3f2088feeda9]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:43:33 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b843efe-1db5-44f5-b55a-25e62bddc2f5 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17, portal: 172.16.0.220,3260]
Nov 15 09:43:33 user nova-compute[75122]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17, portal: 172.16.0.220,3260] successful.
Nov 15 09:43:33 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:43:33 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17 -p 172.16.0.220:3260 --op delete {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:43:33 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:43:33 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ff43551-6f39-4745-8c90-45ce1d0176fd]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:43:33 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b843efe-1db5-44f5-b55a-25e62bddc2f5 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:43:33 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-3b843efe-1db5-44f5-b55a-25e62bddc2f5 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.458s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 09:43:33 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b843efe-1db5-44f5-b55a-25e62bddc2f5 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] <== disconnect_volume: return (460ms) None {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 09:43:33 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b843efe-1db5-44f5-b55a-25e62bddc2f5 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] [instance: cc485c6c-5a9a-4c94-b966-68dd9e336e56] Disconnected iSCSI Volume {{(pid=75122) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 09:43:33 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-3b843efe-1db5-44f5-b55a-25e62bddc2f5 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75122) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 09:43:33 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:43:34 user nova-compute[75122]: DEBUG nova.compute.manager [req-19e9a706-6443-4e12-add6-be30fcff34aa req-1498f13d-350e-428a-88d2-0173dd5f249c service nova] [instance: cc485c6c-5a9a-4c94-b966-68dd9e336e56] Received event network-vif-plugged-d3b26bb1-8ddd-4467-af3e-74e39d54390e {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:43:34 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-19e9a706-6443-4e12-add6-be30fcff34aa req-1498f13d-350e-428a-88d2-0173dd5f249c service nova] Acquiring lock "cc485c6c-5a9a-4c94-b966-68dd9e336e56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:43:34 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-19e9a706-6443-4e12-add6-be30fcff34aa req-1498f13d-350e-428a-88d2-0173dd5f249c service nova] Lock "cc485c6c-5a9a-4c94-b966-68dd9e336e56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:43:34 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-19e9a706-6443-4e12-add6-be30fcff34aa req-1498f13d-350e-428a-88d2-0173dd5f249c service nova] Lock "cc485c6c-5a9a-4c94-b966-68dd9e336e56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:43:34 user nova-compute[75122]: DEBUG nova.compute.manager [req-19e9a706-6443-4e12-add6-be30fcff34aa req-1498f13d-350e-428a-88d2-0173dd5f249c service nova] [instance: cc485c6c-5a9a-4c94-b966-68dd9e336e56] No waiting events found dispatching network-vif-plugged-d3b26bb1-8ddd-4467-af3e-74e39d54390e {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:43:34 user nova-compute[75122]: WARNING nova.compute.manager [req-19e9a706-6443-4e12-add6-be30fcff34aa req-1498f13d-350e-428a-88d2-0173dd5f249c service nova] [instance: cc485c6c-5a9a-4c94-b966-68dd9e336e56] Received unexpected event network-vif-plugged-d3b26bb1-8ddd-4467-af3e-74e39d54390e for instance with vm_state active and task_state resize_migrating.
Nov 15 09:43:35 user nova-compute[75122]: DEBUG nova.network.neutron [None req-3b843efe-1db5-44f5-b55a-25e62bddc2f5 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] [instance: cc485c6c-5a9a-4c94-b966-68dd9e336e56] Port d3b26bb1-8ddd-4467-af3e-74e39d54390e binding to destination host user is already ACTIVE {{(pid=75122) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 15 09:43:35 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-3b843efe-1db5-44f5-b55a-25e62bddc2f5 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Acquiring lock "cc485c6c-5a9a-4c94-b966-68dd9e336e56-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:43:35 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-3b843efe-1db5-44f5-b55a-25e62bddc2f5 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Lock "cc485c6c-5a9a-4c94-b966-68dd9e336e56-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.002s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:43:35 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-3b843efe-1db5-44f5-b55a-25e62bddc2f5 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Lock "cc485c6c-5a9a-4c94-b966-68dd9e336e56-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:43:35 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-3b843efe-1db5-44f5-b55a-25e62bddc2f5 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Acquiring lock "refresh_cache-cc485c6c-5a9a-4c94-b966-68dd9e336e56" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 09:43:35 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-3b843efe-1db5-44f5-b55a-25e62bddc2f5 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Acquired lock "refresh_cache-cc485c6c-5a9a-4c94-b966-68dd9e336e56" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 09:43:35 user nova-compute[75122]: DEBUG nova.network.neutron [None req-3b843efe-1db5-44f5-b55a-25e62bddc2f5 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] [instance: cc485c6c-5a9a-4c94-b966-68dd9e336e56] Building network info cache for instance {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 09:43:35 user nova-compute[75122]: DEBUG nova.network.neutron [None req-3b843efe-1db5-44f5-b55a-25e62bddc2f5 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] [instance: cc485c6c-5a9a-4c94-b966-68dd9e336e56] Updating instance_info_cache with network_info: [{"id": "d3b26bb1-8ddd-4467-af3e-74e39d54390e", "address": "fa:16:3e:8c:a9:0b", "network": {"id": "6e846655-a6f8-4339-a239-65d2f94c8b74", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1923452032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b8e67f8a66a4930be3fb65c397cbeb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3b26bb1-8d", "ovs_interfaceid": "d3b26bb1-8ddd-4467-af3e-74e39d54390e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:43:35 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-3b843efe-1db5-44f5-b55a-25e62bddc2f5 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Releasing lock "refresh_cache-cc485c6c-5a9a-4c94-b966-68dd9e336e56" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 09:43:35 user nova-compute[75122]: DEBUG os_brick.utils [None req-3b843efe-1db5-44f5-b55a-25e62bddc2f5 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 09:43:35 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:43:35 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:43:35 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[778e432a-a4ba-4f7f-923e-e22195eb5cc9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:742fb64b3587\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:43:35 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:43:35 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:43:35 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[38cd2166-b8b9-405c-9591-aff1ed577faf]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:43:35 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:43:35 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:43:35 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[77baf228-9ad7-4b61-87f0-b1b443a6eebe]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:43:35 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[a62b2982-22b2-40fa-a98d-e757e2af5638]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:43:35 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-3b843efe-1db5-44f5-b55a-25e62bddc2f5 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Running cmd (subprocess): nvme version {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:43:35 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-3b843efe-1db5-44f5-b55a-25e62bddc2f5 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] 'nvme version' failed. Not Retrying. {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 09:43:35 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3b843efe-1db5-44f5-b55a-25e62bddc2f5 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] nvme not present on system {{(pid=75122) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 09:43:35 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:43:35 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 09:43:35 user nova-compute[75122]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 09:43:35 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf2da6d0-ad13-423b-af7e-49959f8a5404]: (4, '') {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:43:35 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.lightos [None req-3b843efe-1db5-44f5-b55a-25e62bddc2f5 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75122) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 09:43:35 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.lightos [None req-3b843efe-1db5-44f5-b55a-25e62bddc2f5 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75122) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 09:43:35 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.lightos [None req-3b843efe-1db5-44f5-b55a-25e62bddc2f5 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] LIGHTOS: no hostnqn found. {{(pid=75122) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 09:43:35 user nova-compute[75122]: DEBUG os_brick.utils [None req-3b843efe-1db5-44f5-b55a-25e62bddc2f5 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:742fb64b3587', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 09:43:36 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-c8d8c3d8-a887-4baa-b633-4cd9fb1afabf tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 52c066f3-dea1-4aa3-9da4-da9397b9fff1 is timed out.
Nov 15 09:43:36 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-c8d8c3d8-a887-4baa-b633-4cd9fb1afabf tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] Successfully detached device vdb from instance 52c066f3-dea1-4aa3-9da4-da9397b9fff1 from the live domain config.
Nov 15 09:43:36 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c8d8c3d8-a887-4baa-b633-4cd9fb1afabf tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] [instance: 52c066f3-dea1-4aa3-9da4-da9397b9fff1] calling os-brick to detach iSCSI Volume {{(pid=75122) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 09:43:36 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8d8c3d8-a887-4baa-b633-4cd9fb1afabf tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffa04060b80>, {'target_iqn': 'iqn.2010-10.org.openstack:284cc694-dd22-4f9e-8f3b-787e222f8da5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xWYXjrqO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 09:43:36 user nova-compute[75122]: WARNING os_brick.initiator.connectors.base [None req-c8d8c3d8-a887-4baa-b633-4cd9fb1afabf tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 09:43:36 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-c8d8c3d8-a887-4baa-b633-4cd9fb1afabf tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 09:43:36 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-c8d8c3d8-a887-4baa-b633-4cd9fb1afabf tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 09:43:36 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:43:36 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:43:36 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:43:36 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1b14675-052e-4f95-89e7-12a324f671dc]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:284cc694-dd22-4f9e-8f3b-787e222f8da5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:395810b1-e3c3-4660-aaaf-b6d9e7cb5a88\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:43:36 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8d8c3d8-a887-4baa-b633-4cd9fb1afabf tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 09:43:36 user nova-compute[75122]: No targets found.
Nov 15 09:43:36 user nova-compute[75122]: iSNS:
Nov 15 09:43:36 user nova-compute[75122]: No targets found.
Nov 15 09:43:36 user nova-compute[75122]: STATIC:
Nov 15 09:43:36 user nova-compute[75122]: Target: iqn.2010-10.org.openstack:284cc694-dd22-4f9e-8f3b-787e222f8da5
Nov 15 09:43:36 user nova-compute[75122]:         Portal: 172.16.0.220:3260,-1
Nov 15 09:43:36 user nova-compute[75122]:                 Iface Name: default
Nov 15 09:43:36 user nova-compute[75122]: Target: iqn.2010-10.org.openstack:395810b1-e3c3-4660-aaaf-b6d9e7cb5a88
Nov 15 09:43:36 user nova-compute[75122]:         Portal: 172.16.0.220:3260,-1
Nov 15 09:43:36 user nova-compute[75122]:                 Iface Name: default
Nov 15 09:43:36 user nova-compute[75122]: FIRMWARE:
Nov 15 09:43:36 user nova-compute[75122]: No targets found.
Nov 15 09:43:36 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 09:43:36 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8d8c3d8-a887-4baa-b633-4cd9fb1afabf tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 09:43:36 user nova-compute[75122]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 09:43:36 user nova-compute[75122]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75122) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 09:43:36 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8d8c3d8-a887-4baa-b633-4cd9fb1afabf tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:284cc694-dd22-4f9e-8f3b-787e222f8da5', 0)] {{(pid=75122) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 09:43:36 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:43:36 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:43:36 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[3660b098-1259-4783-af2c-b63b3cbd9296]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:284cc694-dd22-4f9e-8f3b-787e222f8da5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:395810b1-e3c3-4660-aaaf-b6d9e7cb5a88\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:43:36 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:43:36 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:43:36 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2001c45-d0d0-4805-abda-78dfcc96303c]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:395810b1-e3c3-4660-aaaf-b6d9e7cb5a88 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:284cc694-dd22-4f9e-8f3b-787e222f8da5 (non-flash)\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:43:36 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8d8c3d8-a887-4baa-b633-4cd9fb1afabf tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:395810b1-e3c3-4660-aaaf-b6d9e7cb5a88 (non-flash)
Nov 15 09:43:36 user nova-compute[75122]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:284cc694-dd22-4f9e-8f3b-787e222f8da5 (non-flash)
Nov 15 09:43:36 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 09:43:36 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8d8c3d8-a887-4baa-b633-4cd9fb1afabf tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:395810b1-e3c3-4660-aaaf-b6d9e7cb5a88 (non-flash)
Nov 15 09:43:36 user nova-compute[75122]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:284cc694-dd22-4f9e-8f3b-787e222f8da5 (non-flash)
Nov 15 09:43:36 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 09:43:36 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8d8c3d8-a887-4baa-b633-4cd9fb1afabf tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ffa0413cb80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:284cc694-dd22-4f9e-8f3b-787e222f8da5'): ({'sdd'}, set())}) {{(pid=75122) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 09:43:36 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-c8d8c3d8-a887-4baa-b633-4cd9fb1afabf tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] Removing single pathed devices sdd {{(pid=75122) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 09:43:36 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:43:36 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:43:36 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[d70fb7ee-311e-4412-a4d9-f8bb3419be69]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:43:36 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:43:36 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:43:36 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1ba4062-f214-4655-8940-4d008bb44a21]: (4, ('ok\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:43:36 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-c8d8c3d8-a887-4baa-b633-4cd9fb1afabf tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] Flushing IO for device /dev/sdd {{(pid=75122) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 09:43:36 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:43:36 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:43:36 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bc5626e-f885-499d-95db-3999a90f23f1]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:43:36 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-c8d8c3d8-a887-4baa-b633-4cd9fb1afabf tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75122) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 09:43:36 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:43:36 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.032s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:43:36 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[64e89538-f812-4e24-969a-c4d78c0c2d0a]: (4, ('1', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:43:36 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-c8d8c3d8-a887-4baa-b633-4cd9fb1afabf tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75122) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 09:43:36 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-c8d8c3d8-a887-4baa-b633-4cd9fb1afabf tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] SCSI volumes sdd have been removed. {{(pid=75122) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 09:43:36 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8d8c3d8-a887-4baa-b633-4cd9fb1afabf tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:284cc694-dd22-4f9e-8f3b-787e222f8da5')] {{(pid=75122) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 09:43:36 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:284cc694-dd22-4f9e-8f3b-787e222f8da5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:43:36 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:284cc694-dd22-4f9e-8f3b-787e222f8da5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:43:36 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[d003d7db-390e-46d3-919f-8a153279c066]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:43:36 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8d8c3d8-a887-4baa-b633-4cd9fb1afabf tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:43:36 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:284cc694-dd22-4f9e-8f3b-787e222f8da5 -p 172.16.0.220:3260 --logout {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:43:36 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:284cc694-dd22-4f9e-8f3b-787e222f8da5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:43:36 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e0c011a-0b62-4c7e-9878-b48a596fd827]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:284cc694-dd22-4f9e-8f3b-787e222f8da5, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:284cc694-dd22-4f9e-8f3b-787e222f8da5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:43:36 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8d8c3d8-a887-4baa-b633-4cd9fb1afabf tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:284cc694-dd22-4f9e-8f3b-787e222f8da5, portal: 172.16.0.220,3260]
Nov 15 09:43:36 user nova-compute[75122]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:284cc694-dd22-4f9e-8f3b-787e222f8da5, portal: 172.16.0.220,3260] successful.
Nov 15 09:43:36 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:43:36 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:284cc694-dd22-4f9e-8f3b-787e222f8da5 -p 172.16.0.220:3260 --op delete {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:43:36 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:284cc694-dd22-4f9e-8f3b-787e222f8da5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:43:36 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c934270-8b34-4113-941a-58d4e5b9533e]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:43:36 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8d8c3d8-a887-4baa-b633-4cd9fb1afabf tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:43:36 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-c8d8c3d8-a887-4baa-b633-4cd9fb1afabf tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.274s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 09:43:36 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8d8c3d8-a887-4baa-b633-4cd9fb1afabf tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] <== disconnect_volume: return (275ms) None {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 09:43:36 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c8d8c3d8-a887-4baa-b633-4cd9fb1afabf tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] [instance: 52c066f3-dea1-4aa3-9da4-da9397b9fff1] Disconnected iSCSI Volume {{(pid=75122) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 09:43:37 user nova-compute[75122]: DEBUG nova.objects.instance [None req-c8d8c3d8-a887-4baa-b633-4cd9fb1afabf tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] Lazy-loading 'flavor' on Instance uuid 52c066f3-dea1-4aa3-9da4-da9397b9fff1 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:43:37 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-c8d8c3d8-a887-4baa-b633-4cd9fb1afabf tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] Lock "52c066f3-dea1-4aa3-9da4-da9397b9fff1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.579s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:43:37 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:43:41 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:43:42 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-b834f9f6-d5e3-427d-bbdb-de267e70bdac tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] Acquiring lock "e1afe5d4-42c0-491c-b1c7-c8debf1d5da2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:43:42 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-b834f9f6-d5e3-427d-bbdb-de267e70bdac tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] Lock "e1afe5d4-42c0-491c-b1c7-c8debf1d5da2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:43:42 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-b834f9f6-d5e3-427d-bbdb-de267e70bdac tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] Acquiring lock "e1afe5d4-42c0-491c-b1c7-c8debf1d5da2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:43:42 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-b834f9f6-d5e3-427d-bbdb-de267e70bdac tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] Lock "e1afe5d4-42c0-491c-b1c7-c8debf1d5da2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:43:42 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-b834f9f6-d5e3-427d-bbdb-de267e70bdac tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] Lock "e1afe5d4-42c0-491c-b1c7-c8debf1d5da2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:43:42 user nova-compute[75122]: INFO nova.compute.manager [None req-b834f9f6-d5e3-427d-bbdb-de267e70bdac tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] [instance: e1afe5d4-42c0-491c-b1c7-c8debf1d5da2] Terminating instance
Nov 15 09:43:42 user nova-compute[75122]: DEBUG nova.compute.manager [None req-b834f9f6-d5e3-427d-bbdb-de267e70bdac tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] [instance: e1afe5d4-42c0-491c-b1c7-c8debf1d5da2] Start destroying the instance on the hypervisor. {{(pid=75122) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 09:43:42 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:43:42 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:43:42 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:43:42 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:43:42 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:43:42 user nova-compute[75122]: DEBUG nova.compute.manager [req-b6b8239e-1b99-492f-8dea-c9cc56aa57a8 req-3f02c916-83ad-40fc-a5d2-7de338f2c13a service nova] [instance: e1afe5d4-42c0-491c-b1c7-c8debf1d5da2] Received event network-vif-unplugged-f2eacefa-263d-4e6f-af4e-3ab293748b4a {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:43:42 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-b6b8239e-1b99-492f-8dea-c9cc56aa57a8 req-3f02c916-83ad-40fc-a5d2-7de338f2c13a service nova] Acquiring lock "e1afe5d4-42c0-491c-b1c7-c8debf1d5da2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:43:42 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-b6b8239e-1b99-492f-8dea-c9cc56aa57a8 req-3f02c916-83ad-40fc-a5d2-7de338f2c13a service nova] Lock "e1afe5d4-42c0-491c-b1c7-c8debf1d5da2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:43:42 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-b6b8239e-1b99-492f-8dea-c9cc56aa57a8 req-3f02c916-83ad-40fc-a5d2-7de338f2c13a service nova] Lock "e1afe5d4-42c0-491c-b1c7-c8debf1d5da2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:43:42 user nova-compute[75122]: DEBUG nova.compute.manager [req-b6b8239e-1b99-492f-8dea-c9cc56aa57a8 req-3f02c916-83ad-40fc-a5d2-7de338f2c13a service nova] [instance: e1afe5d4-42c0-491c-b1c7-c8debf1d5da2] No waiting events found dispatching network-vif-unplugged-f2eacefa-263d-4e6f-af4e-3ab293748b4a {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:43:42 user nova-compute[75122]: DEBUG nova.compute.manager [req-b6b8239e-1b99-492f-8dea-c9cc56aa57a8 req-3f02c916-83ad-40fc-a5d2-7de338f2c13a service nova] [instance: e1afe5d4-42c0-491c-b1c7-c8debf1d5da2] Received event network-vif-unplugged-f2eacefa-263d-4e6f-af4e-3ab293748b4a for instance with task_state deleting. {{(pid=75122) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 09:43:43 user nova-compute[75122]: INFO nova.virt.libvirt.driver [-] [instance: e1afe5d4-42c0-491c-b1c7-c8debf1d5da2] Instance destroyed successfully.
Nov 15 09:43:43 user nova-compute[75122]: DEBUG nova.objects.instance [None req-b834f9f6-d5e3-427d-bbdb-de267e70bdac tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] Lazy-loading 'resources' on Instance uuid e1afe5d4-42c0-491c-b1c7-c8debf1d5da2 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:43:43 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-b834f9f6-d5e3-427d-bbdb-de267e70bdac tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-15T09:39:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-859857655',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1427271580',id=24,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKavn69DT/YiudqeLC0nG3DEUybkU33QtIjB7fX4OdJJmMo+mhmiPQjcJANuymlxpfxTBdycCs8+kgmwpZOBnByAe9gcjy/ud1YUrlRdkVYRnoGUJsx71JcToY7Fz/5kxA==',key_name='tempest-keypair-171606846',keypairs=<?>,launch_index=0,launched_at=2023-11-15T09:42:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='21d2b24ce1a3452fa6bba669f64ffaba',ramdisk_id='',reservation_id='r-j9e29adc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-380486035',owner_user_name='tempest-ServerActionsV293TestJSON-380486035-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T09:42:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='35c1bd52106641e081d67e05532fbec3',uuid=e1afe5d4-42c0-491c-b1c7-c8debf1d5da2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f2eacefa-263d-4e6f-af4e-3ab293748b4a", "address": "fa:16:3e:f7:23:f8", "network": {"id": "0b825d42-d480-4526-a659-e1a5c5fbb53c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1640851308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21d2b24ce1a3452fa6bba669f64ffaba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2eacefa-26", "ovs_interfaceid": "f2eacefa-263d-4e6f-af4e-3ab293748b4a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 09:43:43 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-b834f9f6-d5e3-427d-bbdb-de267e70bdac tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] Converting VIF {"id": "f2eacefa-263d-4e6f-af4e-3ab293748b4a", "address": "fa:16:3e:f7:23:f8", "network": {"id": "0b825d42-d480-4526-a659-e1a5c5fbb53c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1640851308-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.223", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "21d2b24ce1a3452fa6bba669f64ffaba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2eacefa-26", "ovs_interfaceid": "f2eacefa-263d-4e6f-af4e-3ab293748b4a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 09:43:43 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-b834f9f6-d5e3-427d-bbdb-de267e70bdac tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f7:23:f8,bridge_name='br-int',has_traffic_filtering=True,id=f2eacefa-263d-4e6f-af4e-3ab293748b4a,network=Network(0b825d42-d480-4526-a659-e1a5c5fbb53c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2eacefa-26') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 09:43:43 user nova-compute[75122]: DEBUG os_vif [None req-b834f9f6-d5e3-427d-bbdb-de267e70bdac tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f7:23:f8,bridge_name='br-int',has_traffic_filtering=True,id=f2eacefa-263d-4e6f-af4e-3ab293748b4a,network=Network(0b825d42-d480-4526-a659-e1a5c5fbb53c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2eacefa-26') {{(pid=75122) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 09:43:43 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:43:43 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf2eacefa-26, bridge=br-int, if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:43:43 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:43:43 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:43:43 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:43:43 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=21512433-05eb-4716-81b5-78bde30cb06d) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:43:43 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:43:43 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:43:43 user nova-compute[75122]: INFO os_vif [None req-b834f9f6-d5e3-427d-bbdb-de267e70bdac tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f7:23:f8,bridge_name='br-int',has_traffic_filtering=True,id=f2eacefa-263d-4e6f-af4e-3ab293748b4a,network=Network(0b825d42-d480-4526-a659-e1a5c5fbb53c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2eacefa-26')
Nov 15 09:43:43 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b834f9f6-d5e3-427d-bbdb-de267e70bdac tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] [instance: e1afe5d4-42c0-491c-b1c7-c8debf1d5da2] calling os-brick to detach iSCSI Volume {{(pid=75122) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 09:43:43 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-b834f9f6-d5e3-427d-bbdb-de267e70bdac tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffa04060b80>, {'target_iqn': 'iqn.2010-10.org.openstack:395810b1-e3c3-4660-aaaf-b6d9e7cb5a88', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cRPqjENp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 09:43:43 user nova-compute[75122]: WARNING os_brick.initiator.connectors.base [None req-b834f9f6-d5e3-427d-bbdb-de267e70bdac tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 09:43:43 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-b834f9f6-d5e3-427d-bbdb-de267e70bdac tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 09:43:43 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-b834f9f6-d5e3-427d-bbdb-de267e70bdac tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 09:43:43 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:43:43 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:43:43 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[37aba04a-220f-4a6b-80a1-b41a495524d6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:395810b1-e3c3-4660-aaaf-b6d9e7cb5a88\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:43:43 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-b834f9f6-d5e3-427d-bbdb-de267e70bdac tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 09:43:43 user nova-compute[75122]: No targets found.
Nov 15 09:43:43 user nova-compute[75122]: iSNS:
Nov 15 09:43:43 user nova-compute[75122]: No targets found.
Nov 15 09:43:43 user nova-compute[75122]: STATIC:
Nov 15 09:43:43 user nova-compute[75122]: Target: iqn.2010-10.org.openstack:395810b1-e3c3-4660-aaaf-b6d9e7cb5a88
Nov 15 09:43:43 user nova-compute[75122]:         Portal: 172.16.0.220:3260,-1
Nov 15 09:43:43 user nova-compute[75122]:                 Iface Name: default
Nov 15 09:43:43 user nova-compute[75122]: FIRMWARE:
Nov 15 09:43:43 user nova-compute[75122]: No targets found.
Nov 15 09:43:43 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 09:43:43 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-b834f9f6-d5e3-427d-bbdb-de267e70bdac tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 09:43:43 user nova-compute[75122]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 09:43:43 user nova-compute[75122]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75122) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 09:43:43 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-b834f9f6-d5e3-427d-bbdb-de267e70bdac tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:395810b1-e3c3-4660-aaaf-b6d9e7cb5a88', 0)] {{(pid=75122) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 09:43:43 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:43:43 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.015s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:43:43 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[b32050cb-8cbc-495d-8dcb-9329b545cc64]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:395810b1-e3c3-4660-aaaf-b6d9e7cb5a88\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:43:43 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:43:43 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:43:43 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[489adb22-5313-4cb0-b96a-16598bf861b9]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:395810b1-e3c3-4660-aaaf-b6d9e7cb5a88 (non-flash)\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:43:43 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-b834f9f6-d5e3-427d-bbdb-de267e70bdac tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:395810b1-e3c3-4660-aaaf-b6d9e7cb5a88 (non-flash)
Nov 15 09:43:43 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 09:43:43 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-b834f9f6-d5e3-427d-bbdb-de267e70bdac tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:395810b1-e3c3-4660-aaaf-b6d9e7cb5a88 (non-flash)
Nov 15 09:43:43 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 09:43:43 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-b834f9f6-d5e3-427d-bbdb-de267e70bdac tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff9e438e560>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:395810b1-e3c3-4660-aaaf-b6d9e7cb5a88'): ({'sde'}, set())}) {{(pid=75122) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 09:43:43 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-b834f9f6-d5e3-427d-bbdb-de267e70bdac tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] Removing single pathed devices sde {{(pid=75122) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 09:43:43 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:43:43 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:43:43 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f2fc96e-a28b-4089-851d-8bcbc4ec7917]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:43:43 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:43:43 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:43:43 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[4be06c7b-cb35-4366-bd5c-0399a325e1c3]: (4, ('ok\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:43:43 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-b834f9f6-d5e3-427d-bbdb-de267e70bdac tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] Flushing IO for device /dev/sde {{(pid=75122) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 09:43:43 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:43:43 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.017s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:43:43 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[32b0c60f-f0ea-4959-9a0e-62f59f82a52d]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:43:43 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-b834f9f6-d5e3-427d-bbdb-de267e70bdac tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75122) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 09:43:43 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:43:43 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.056s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:43:43 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc3896b0-e0c6-4c06-8ede-a50e932a508a]: (4, ('1', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:43:43 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-b834f9f6-d5e3-427d-bbdb-de267e70bdac tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75122) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 09:43:43 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-b834f9f6-d5e3-427d-bbdb-de267e70bdac tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] SCSI volumes sde have been removed. {{(pid=75122) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 09:43:43 user nova-compute[75122]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23538613733363566', '/dev/disk/by-id/scsi-1SCST_BIO1faf9349-58a7365f50ce1ddc', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_1faf9349') {{(pid=85998) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 15 09:43:43 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c886b9f-638b-4d74-9979-b9e9a67ffb4c]: (4, None) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:43:43 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-b834f9f6-d5e3-427d-bbdb-de267e70bdac tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:395810b1-e3c3-4660-aaaf-b6d9e7cb5a88')] {{(pid=75122) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 09:43:43 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:395810b1-e3c3-4660-aaaf-b6d9e7cb5a88 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:43:43 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:395810b1-e3c3-4660-aaaf-b6d9e7cb5a88 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.032s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:43:43 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[92293e3c-429a-4d3c-a7a0-43312dabbb96]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:43:43 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-b834f9f6-d5e3-427d-bbdb-de267e70bdac tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:43:43 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:395810b1-e3c3-4660-aaaf-b6d9e7cb5a88 -p 172.16.0.220:3260 --logout {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:43:43 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:395810b1-e3c3-4660-aaaf-b6d9e7cb5a88 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:43:43 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[196204d4-d7f0-4c7c-b957-efc2e32e7b31]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:395810b1-e3c3-4660-aaaf-b6d9e7cb5a88, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:395810b1-e3c3-4660-aaaf-b6d9e7cb5a88, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:43:43 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-b834f9f6-d5e3-427d-bbdb-de267e70bdac tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:395810b1-e3c3-4660-aaaf-b6d9e7cb5a88, portal: 172.16.0.220,3260]
Nov 15 09:43:43 user nova-compute[75122]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:395810b1-e3c3-4660-aaaf-b6d9e7cb5a88, portal: 172.16.0.220,3260] successful.
Nov 15 09:43:43 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:43:43 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:395810b1-e3c3-4660-aaaf-b6d9e7cb5a88 -p 172.16.0.220:3260 --op delete {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:43:43 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:395810b1-e3c3-4660-aaaf-b6d9e7cb5a88 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:43:43 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[01bfd0d3-6dbd-469e-8c0e-a52bb939e6be]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:43:43 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-b834f9f6-d5e3-427d-bbdb-de267e70bdac tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:43:43 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-b834f9f6-d5e3-427d-bbdb-de267e70bdac tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.338s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 09:43:43 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-b834f9f6-d5e3-427d-bbdb-de267e70bdac tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] <== disconnect_volume: return (339ms) None {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 09:43:43 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b834f9f6-d5e3-427d-bbdb-de267e70bdac tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] [instance: e1afe5d4-42c0-491c-b1c7-c8debf1d5da2] Disconnected iSCSI Volume {{(pid=75122) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 09:43:43 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-b834f9f6-d5e3-427d-bbdb-de267e70bdac tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] [instance: e1afe5d4-42c0-491c-b1c7-c8debf1d5da2] Deleting instance files /opt/stack/data/nova/instances/e1afe5d4-42c0-491c-b1c7-c8debf1d5da2_del
Nov 15 09:43:43 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-b834f9f6-d5e3-427d-bbdb-de267e70bdac tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] [instance: e1afe5d4-42c0-491c-b1c7-c8debf1d5da2] Deletion of /opt/stack/data/nova/instances/e1afe5d4-42c0-491c-b1c7-c8debf1d5da2_del complete
Nov 15 09:43:43 user nova-compute[75122]: INFO nova.compute.manager [None req-b834f9f6-d5e3-427d-bbdb-de267e70bdac tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] [instance: e1afe5d4-42c0-491c-b1c7-c8debf1d5da2] Took 1.18 seconds to destroy the instance on the hypervisor.
Nov 15 09:43:43 user nova-compute[75122]: DEBUG oslo.service.loopingcall [None req-b834f9f6-d5e3-427d-bbdb-de267e70bdac tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75122) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 09:43:43 user nova-compute[75122]: DEBUG nova.compute.manager [-] [instance: e1afe5d4-42c0-491c-b1c7-c8debf1d5da2] Deallocating network for instance {{(pid=75122) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 09:43:43 user nova-compute[75122]: DEBUG nova.network.neutron [-] [instance: e1afe5d4-42c0-491c-b1c7-c8debf1d5da2] deallocate_for_instance() {{(pid=75122) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 09:43:43 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-3b843efe-1db5-44f5-b55a-25e62bddc2f5 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] [instance: cc485c6c-5a9a-4c94-b966-68dd9e336e56] Starting finish_migration {{(pid=75122) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Nov 15 09:43:43 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-3b843efe-1db5-44f5-b55a-25e62bddc2f5 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] [instance: cc485c6c-5a9a-4c94-b966-68dd9e336e56] Instance directory exists: not creating {{(pid=75122) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 15 09:43:43 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-3b843efe-1db5-44f5-b55a-25e62bddc2f5 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] [instance: cc485c6c-5a9a-4c94-b966-68dd9e336e56] Creating image(s)
Nov 15 09:43:43 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-3b843efe-1db5-44f5-b55a-25e62bddc2f5 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] [instance: cc485c6c-5a9a-4c94-b966-68dd9e336e56] Did not create local disks {{(pid=75122) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 09:43:43 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-3b843efe-1db5-44f5-b55a-25e62bddc2f5 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] [instance: cc485c6c-5a9a-4c94-b966-68dd9e336e56] Ensure instance console log exists: /opt/stack/data/nova/instances/cc485c6c-5a9a-4c94-b966-68dd9e336e56/console.log {{(pid=75122) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 09:43:43 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-3b843efe-1db5-44f5-b55a-25e62bddc2f5 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:43:43 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-3b843efe-1db5-44f5-b55a-25e62bddc2f5 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:43:43 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-3b843efe-1db5-44f5-b55a-25e62bddc2f5 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:43:43 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-3b843efe-1db5-44f5-b55a-25e62bddc2f5 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] [instance: cc485c6c-5a9a-4c94-b966-68dd9e336e56] Start _get_guest_xml network_info=[{"id": "d3b26bb1-8ddd-4467-af3e-74e39d54390e", "address": "fa:16:3e:8c:a9:0b", "network": {"id": "6e846655-a6f8-4339-a239-65d2f94c8b74", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1923452032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1923452032-network", "vif_mac": "fa:16:3e:8c:a9:0b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b8e67f8a66a4930be3fb65c397cbeb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3b26bb1-8d", "ovs_interfaceid": "d3b26bb1-8ddd-4467-af3e-74e39d54390e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DdRJNhXT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'cc485c6c-5a9a-4c94-b966-68dd9e336e56', 'attached_at': '2023-11-15T09:43:44.000000', 'detached_at': '', 'volume_id': '5aa0e3ae-4004-414c-b0c9-8c089c420c17', 'serial': '5aa0e3ae-4004-414c-b0c9-8c089c420c17'}, 'guest_format': None, 'delete_on_termination': True, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vda', 'attachment_id': 'b8f1e5c3-2f49-4e1d-811c-7ebd652ce5f8', 'volume_type': None} {{(pid=75122) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 09:43:43 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-3b843efe-1db5-44f5-b55a-25e62bddc2f5 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 09:43:43 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-3b843efe-1db5-44f5-b55a-25e62bddc2f5 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 09:43:43 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-3b843efe-1db5-44f5-b55a-25e62bddc2f5 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75122) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 09:43:43 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-3b843efe-1db5-44f5-b55a-25e62bddc2f5 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] CPU controller missing on host. {{(pid=75122) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 09:43:43 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-3b843efe-1db5-44f5-b55a-25e62bddc2f5 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75122) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 09:43:43 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-3b843efe-1db5-44f5-b55a-25e62bddc2f5 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] CPU controller found on host. {{(pid=75122) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 09:43:43 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-3b843efe-1db5-44f5-b55a-25e62bddc2f5 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75122) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 09:43:43 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-3b843efe-1db5-44f5-b55a-25e62bddc2f5 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T09:26:22Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 09:43:43 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-3b843efe-1db5-44f5-b55a-25e62bddc2f5 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Flavor limits 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 09:43:43 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-3b843efe-1db5-44f5-b55a-25e62bddc2f5 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Image limits 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 09:43:43 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-3b843efe-1db5-44f5-b55a-25e62bddc2f5 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Flavor pref 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 09:43:43 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-3b843efe-1db5-44f5-b55a-25e62bddc2f5 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Image pref 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 09:43:43 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-3b843efe-1db5-44f5-b55a-25e62bddc2f5 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 09:43:43 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-3b843efe-1db5-44f5-b55a-25e62bddc2f5 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 09:43:43 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-3b843efe-1db5-44f5-b55a-25e62bddc2f5 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75122) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 09:43:43 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-3b843efe-1db5-44f5-b55a-25e62bddc2f5 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Got 1 possible topologies {{(pid=75122) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 09:43:43 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-3b843efe-1db5-44f5-b55a-25e62bddc2f5 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 09:43:43 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-3b843efe-1db5-44f5-b55a-25e62bddc2f5 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 09:43:43 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b843efe-1db5-44f5-b55a-25e62bddc2f5 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] [instance: cc485c6c-5a9a-4c94-b966-68dd9e336e56] Calling os-brick to attach iSCSI Volume {{(pid=75122) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 09:43:43 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b843efe-1db5-44f5-b55a-25e62bddc2f5 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffa04060b80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DdRJNhXT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 09:43:43 user nova-compute[75122]: WARNING os_brick.initiator.connectors.base [None req-3b843efe-1db5-44f5-b55a-25e62bddc2f5 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 09:43:43 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-3b843efe-1db5-44f5-b55a-25e62bddc2f5 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 09:43:43 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-3b843efe-1db5-44f5-b55a-25e62bddc2f5 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 09:43:43 user nova-compute[75122]: WARNING os_brick.initiator.connectors.base [None req-3b843efe-1db5-44f5-b55a-25e62bddc2f5 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 09:43:43 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-3b843efe-1db5-44f5-b55a-25e62bddc2f5 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 09:43:43 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-3b843efe-1db5-44f5-b55a-25e62bddc2f5 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 09:43:43 user nova-compute[75122]: INFO os_brick.initiator.connectors.iscsi [None req-3b843efe-1db5-44f5-b55a-25e62bddc2f5 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 09:43:43 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17 -p 172.16.0.220:3260 {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:43:43 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:43:43 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f48e268-eb33-400b-97bb-ee0af20d2ab4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:43:43 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b843efe-1db5-44f5-b55a-25e62bddc2f5 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 09:43:43 user nova-compute[75122]:  {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:43:43 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17 -p 172.16.0.220:3260 --interface default --op new {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:43:43 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:43:43 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef4de95e-dfbf-4d82-b88b-7a331e608a37]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17] added\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:43:43 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b843efe-1db5-44f5-b55a-25e62bddc2f5 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17] added
Nov 15 09:43:43 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:43:43 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:43:43 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.044s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:43:43 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9389756-090a-43e4-b54f-774a697497b8]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:43:43 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b843efe-1db5-44f5-b55a-25e62bddc2f5 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:43:43 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:43:43 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:43:43 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1b2c553-fb1f-4e37-aac8-d26e327b300a]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:43:43 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b843efe-1db5-44f5-b55a-25e62bddc2f5 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:43:43 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DdRJNhXT {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:43:43 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DdRJNhXT" returned: 0 in 0.017s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:43:43 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[018809ed-6568-4257-9b1b-dc27a174716c]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:43:43 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b843efe-1db5-44f5-b55a-25e62bddc2f5 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DdRJNhXT'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:43:43 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:43:43 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:43:44 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1caccc0-3c8f-4d45-a820-8c47c3173cbb]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:43:44 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b843efe-1db5-44f5-b55a-25e62bddc2f5 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:43:44 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:43:44 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:43:44 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ee8a738-d5b6-4756-ae56-7bb9f6b61f25]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:43:44 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b843efe-1db5-44f5-b55a-25e62bddc2f5 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 15 09:43:44 user nova-compute[75122]:  {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 09:43:44 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b843efe-1db5-44f5-b55a-25e62bddc2f5 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 15 09:43:44 user nova-compute[75122]:  {{(pid=75122) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 09:43:44 user nova-compute[75122]: WARNING os_brick.initiator.connectors.iscsi [None req-3b843efe-1db5-44f5-b55a-25e62bddc2f5 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 15 09:43:44 user nova-compute[75122]: 
Nov 15 09:43:44 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17 -p 172.16.0.220:3260 --login {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:43:44 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:43:44 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[57a00658-b599-4369-8f37-ccf8d5c4f022]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:43:44 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b843efe-1db5-44f5-b55a-25e62bddc2f5 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17, portal: 172.16.0.220,3260]
Nov 15 09:43:44 user nova-compute[75122]: Login to [iface: default, target: iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17, portal: 172.16.0.220,3260] successful.
Nov 15 09:43:44 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:43:44 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:43:44 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:43:44 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[64401f67-2d78-40d2-9ee1-9f6ab3184ff8]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:43:44 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b843efe-1db5-44f5-b55a-25e62bddc2f5 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:43:44 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:43:44 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:43:44 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[650dc882-7a8e-4f1a-8d84-0a8b09572c81]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17 (non-flash)\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:43:44 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b843efe-1db5-44f5-b55a-25e62bddc2f5 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17 (non-flash)
Nov 15 09:43:44 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 09:43:44 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b843efe-1db5-44f5-b55a-25e62bddc2f5 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17 (non-flash)
Nov 15 09:43:44 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 09:43:44 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-3b843efe-1db5-44f5-b55a-25e62bddc2f5 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.294s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 09:43:44 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b843efe-1db5-44f5-b55a-25e62bddc2f5 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Connected to 172.16.0.220:3260 {{(pid=75122) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 09:43:44 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-3b843efe-1db5-44f5-b55a-25e62bddc2f5 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] HCTL ('33', '-', '-', 0) found on session 38 with lun 0 {{(pid=75122) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 09:43:44 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-3b843efe-1db5-44f5-b55a-25e62bddc2f5 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75122) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 09:43:44 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:43:44 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:43:44 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8803292-0d8d-4ec5-87d1-477bf202cb14]: (4, ('- - 0', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:43:44 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-3b843efe-1db5-44f5-b55a-25e62bddc2f5 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Searching for a device in session 38 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75122) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 09:43:44 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b843efe-1db5-44f5-b55a-25e62bddc2f5 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DdRJNhXT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75122) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 09:43:44 user nova-compute[75122]: DEBUG nova.compute.manager [req-e3cec982-7343-4bc3-8e64-9a14b600fc34 req-2a5c22d1-df6c-4961-a282-11ac3cab74ed service nova] [instance: e1afe5d4-42c0-491c-b1c7-c8debf1d5da2] Received event network-vif-plugged-f2eacefa-263d-4e6f-af4e-3ab293748b4a {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:43:44 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-e3cec982-7343-4bc3-8e64-9a14b600fc34 req-2a5c22d1-df6c-4961-a282-11ac3cab74ed service nova] Acquiring lock "e1afe5d4-42c0-491c-b1c7-c8debf1d5da2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:43:44 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-e3cec982-7343-4bc3-8e64-9a14b600fc34 req-2a5c22d1-df6c-4961-a282-11ac3cab74ed service nova] Lock "e1afe5d4-42c0-491c-b1c7-c8debf1d5da2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:43:44 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-e3cec982-7343-4bc3-8e64-9a14b600fc34 req-2a5c22d1-df6c-4961-a282-11ac3cab74ed service nova] Lock "e1afe5d4-42c0-491c-b1c7-c8debf1d5da2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:43:44 user nova-compute[75122]: DEBUG nova.compute.manager [req-e3cec982-7343-4bc3-8e64-9a14b600fc34 req-2a5c22d1-df6c-4961-a282-11ac3cab74ed service nova] [instance: e1afe5d4-42c0-491c-b1c7-c8debf1d5da2] No waiting events found dispatching network-vif-plugged-f2eacefa-263d-4e6f-af4e-3ab293748b4a {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:43:44 user nova-compute[75122]: WARNING nova.compute.manager [req-e3cec982-7343-4bc3-8e64-9a14b600fc34 req-2a5c22d1-df6c-4961-a282-11ac3cab74ed service nova] [instance: e1afe5d4-42c0-491c-b1c7-c8debf1d5da2] Received unexpected event network-vif-plugged-f2eacefa-263d-4e6f-af4e-3ab293748b4a for instance with vm_state active and task_state deleting.
Nov 15 09:43:45 user nova-compute[75122]: DEBUG nova.network.neutron [-] [instance: e1afe5d4-42c0-491c-b1c7-c8debf1d5da2] Updating instance_info_cache with network_info: [] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:43:45 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-3b843efe-1db5-44f5-b55a-25e62bddc2f5 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.333s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 09:43:45 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b843efe-1db5-44f5-b55a-25e62bddc2f5 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] <== connect_volume: return (1334ms) {'type': 'block', 'scsi_wwn': '23666363463366637', 'path': '/dev/sdb'} {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 09:43:45 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b843efe-1db5-44f5-b55a-25e62bddc2f5 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] [instance: cc485c6c-5a9a-4c94-b966-68dd9e336e56] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23666363463366637', 'path': '/dev/sdb'} {{(pid=75122) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 09:43:45 user nova-compute[75122]: INFO nova.compute.manager [-] [instance: e1afe5d4-42c0-491c-b1c7-c8debf1d5da2] Took 1.41 seconds to deallocate network for instance.
Nov 15 09:43:45 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-3b843efe-1db5-44f5-b55a-25e62bddc2f5 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T09:41:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-876462161',display_name='tempest-ServerActionsTestOtherA-server-876462161',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-876462161',id=28,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOjee/3FY3+bQUxkeNPW0HfKU2TS7/WwlSdJA5dC2LRbPtr2GAllBrZqAcx+1wIVC2pqAFLTFeo/KsxadKKcxACsVLYL8LB97mDl41CXm0aq5TWX4fm1S5aOkZSs0D2eNA==',key_name='tempest-keypair-686734186',keypairs=<?>,launch_index=0,launched_at=2023-11-15T09:41:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='8b8e67f8a66a4930be3fb65c397cbeb2',ramdisk_id='',reservation_id='r-50r2vzfz',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1521412552',owner_user_name='tempest-ServerActionsTestOtherA-1521412552-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T09:43:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='91f1469b2c7c45d6ac27f2b64fd5cefe',uuid=cc485c6c-5a9a-4c94-b966-68dd9e336e56,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d3b26bb1-8ddd-4467-af3e-74e39d54390e", "address": "fa:16:3e:8c:a9:0b", "network": {"id": "6e846655-a6f8-4339-a239-65d2f94c8b74", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1923452032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1923452032-network", "vif_mac": "fa:16:3e:8c:a9:0b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b8e67f8a66a4930be3fb65c397cbeb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3b26bb1-8d", "ovs_interfaceid": "d3b26bb1-8ddd-4467-af3e-74e39d54390e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75122) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 09:43:45 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-3b843efe-1db5-44f5-b55a-25e62bddc2f5 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Converting VIF {"id": "d3b26bb1-8ddd-4467-af3e-74e39d54390e", "address": "fa:16:3e:8c:a9:0b", "network": {"id": "6e846655-a6f8-4339-a239-65d2f94c8b74", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1923452032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1923452032-network", "vif_mac": "fa:16:3e:8c:a9:0b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b8e67f8a66a4930be3fb65c397cbeb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3b26bb1-8d", "ovs_interfaceid": "d3b26bb1-8ddd-4467-af3e-74e39d54390e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 09:43:45 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-3b843efe-1db5-44f5-b55a-25e62bddc2f5 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:a9:0b,bridge_name='br-int',has_traffic_filtering=True,id=d3b26bb1-8ddd-4467-af3e-74e39d54390e,network=Network(6e846655-a6f8-4339-a239-65d2f94c8b74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3b26bb1-8d') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 09:43:45 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-3b843efe-1db5-44f5-b55a-25e62bddc2f5 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] [instance: cc485c6c-5a9a-4c94-b966-68dd9e336e56] End _get_guest_xml xml=<domain type="kvm">
Nov 15 09:43:45 user nova-compute[75122]:   <uuid>cc485c6c-5a9a-4c94-b966-68dd9e336e56</uuid>
Nov 15 09:43:45 user nova-compute[75122]:   <name>instance-0000001c</name>
Nov 15 09:43:45 user nova-compute[75122]:   <memory>2097152</memory>
Nov 15 09:43:45 user nova-compute[75122]:   <vcpu>1</vcpu>
Nov 15 09:43:45 user nova-compute[75122]:   <metadata>
Nov 15 09:43:45 user nova-compute[75122]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 09:43:45 user nova-compute[75122]:       <nova:package version="0.0.0"/>
Nov 15 09:43:45 user nova-compute[75122]:       <nova:name>tempest-ServerActionsTestOtherA-server-876462161</nova:name>
Nov 15 09:43:45 user nova-compute[75122]:       <nova:creationTime>2023-11-15 09:43:43</nova:creationTime>
Nov 15 09:43:45 user nova-compute[75122]:       <nova:flavor name="m1.small">
Nov 15 09:43:45 user nova-compute[75122]:         <nova:memory>2048</nova:memory>
Nov 15 09:43:45 user nova-compute[75122]:         <nova:disk>20</nova:disk>
Nov 15 09:43:45 user nova-compute[75122]:         <nova:swap>0</nova:swap>
Nov 15 09:43:45 user nova-compute[75122]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 09:43:45 user nova-compute[75122]:         <nova:vcpus>1</nova:vcpus>
Nov 15 09:43:45 user nova-compute[75122]:       </nova:flavor>
Nov 15 09:43:45 user nova-compute[75122]:       <nova:owner>
Nov 15 09:43:45 user nova-compute[75122]:         <nova:user uuid="91f1469b2c7c45d6ac27f2b64fd5cefe">tempest-ServerActionsTestOtherA-1521412552-project-member</nova:user>
Nov 15 09:43:45 user nova-compute[75122]:         <nova:project uuid="8b8e67f8a66a4930be3fb65c397cbeb2">tempest-ServerActionsTestOtherA-1521412552</nova:project>
Nov 15 09:43:45 user nova-compute[75122]:       </nova:owner>
Nov 15 09:43:45 user nova-compute[75122]:       <nova:ports>
Nov 15 09:43:45 user nova-compute[75122]:         <nova:port uuid="d3b26bb1-8ddd-4467-af3e-74e39d54390e">
Nov 15 09:43:45 user nova-compute[75122]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 15 09:43:45 user nova-compute[75122]:         </nova:port>
Nov 15 09:43:45 user nova-compute[75122]:       </nova:ports>
Nov 15 09:43:45 user nova-compute[75122]:     </nova:instance>
Nov 15 09:43:45 user nova-compute[75122]:   </metadata>
Nov 15 09:43:45 user nova-compute[75122]:   <sysinfo type="smbios">
Nov 15 09:43:45 user nova-compute[75122]:     <system>
Nov 15 09:43:45 user nova-compute[75122]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 09:43:45 user nova-compute[75122]:       <entry name="product">OpenStack Nova</entry>
Nov 15 09:43:45 user nova-compute[75122]:       <entry name="version">0.0.0</entry>
Nov 15 09:43:45 user nova-compute[75122]:       <entry name="serial">cc485c6c-5a9a-4c94-b966-68dd9e336e56</entry>
Nov 15 09:43:45 user nova-compute[75122]:       <entry name="uuid">cc485c6c-5a9a-4c94-b966-68dd9e336e56</entry>
Nov 15 09:43:45 user nova-compute[75122]:       <entry name="family">Virtual Machine</entry>
Nov 15 09:43:45 user nova-compute[75122]:     </system>
Nov 15 09:43:45 user nova-compute[75122]:   </sysinfo>
Nov 15 09:43:45 user nova-compute[75122]:   <os>
Nov 15 09:43:45 user nova-compute[75122]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 09:43:45 user nova-compute[75122]:     <boot dev="hd"/>
Nov 15 09:43:45 user nova-compute[75122]:     <smbios mode="sysinfo"/>
Nov 15 09:43:45 user nova-compute[75122]:   </os>
Nov 15 09:43:45 user nova-compute[75122]:   <features>
Nov 15 09:43:45 user nova-compute[75122]:     <acpi/>
Nov 15 09:43:45 user nova-compute[75122]:     <apic/>
Nov 15 09:43:45 user nova-compute[75122]:     <vmcoreinfo/>
Nov 15 09:43:45 user nova-compute[75122]:   </features>
Nov 15 09:43:45 user nova-compute[75122]:   <clock offset="utc">
Nov 15 09:43:45 user nova-compute[75122]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 09:43:45 user nova-compute[75122]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 09:43:45 user nova-compute[75122]:     <timer name="hpet" present="no"/>
Nov 15 09:43:45 user nova-compute[75122]:   </clock>
Nov 15 09:43:45 user nova-compute[75122]:   <cpu mode="custom" match="exact">
Nov 15 09:43:45 user nova-compute[75122]:     <model>Nehalem</model>
Nov 15 09:43:45 user nova-compute[75122]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 09:43:45 user nova-compute[75122]:   </cpu>
Nov 15 09:43:45 user nova-compute[75122]:   <devices>
Nov 15 09:43:45 user nova-compute[75122]:     <disk type="block" device="disk">
Nov 15 09:43:45 user nova-compute[75122]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 09:43:45 user nova-compute[75122]:       <source dev="/dev/sdb"/>
Nov 15 09:43:45 user nova-compute[75122]:       <target dev="vda" bus="virtio"/>
Nov 15 09:43:45 user nova-compute[75122]:       <serial>5aa0e3ae-4004-414c-b0c9-8c089c420c17</serial>
Nov 15 09:43:45 user nova-compute[75122]:     </disk>
Nov 15 09:43:45 user nova-compute[75122]:     <interface type="ethernet">
Nov 15 09:43:45 user nova-compute[75122]:       <mac address="fa:16:3e:8c:a9:0b"/>
Nov 15 09:43:45 user nova-compute[75122]:       <model type="virtio"/>
Nov 15 09:43:45 user nova-compute[75122]:       <mtu size="1442"/>
Nov 15 09:43:45 user nova-compute[75122]:       <target dev="tapd3b26bb1-8d"/>
Nov 15 09:43:45 user nova-compute[75122]:     </interface>
Nov 15 09:43:45 user nova-compute[75122]:     <serial type="pty">
Nov 15 09:43:45 user nova-compute[75122]:       <log file="/opt/stack/data/nova/instances/cc485c6c-5a9a-4c94-b966-68dd9e336e56/console.log" append="off"/>
Nov 15 09:43:45 user nova-compute[75122]:     </serial>
Nov 15 09:43:45 user nova-compute[75122]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 09:43:45 user nova-compute[75122]:     <video>
Nov 15 09:43:45 user nova-compute[75122]:       <model type="virtio"/>
Nov 15 09:43:45 user nova-compute[75122]:     </video>
Nov 15 09:43:45 user nova-compute[75122]:     <rng model="virtio">
Nov 15 09:43:45 user nova-compute[75122]:       <backend model="random">/dev/urandom</backend>
Nov 15 09:43:45 user nova-compute[75122]:     </rng>
Nov 15 09:43:45 user nova-compute[75122]:     <controller type="usb" index="0" model="none"/>
Nov 15 09:43:45 user nova-compute[75122]:     <memballoon model="virtio">
Nov 15 09:43:45 user nova-compute[75122]:       <stats period="10"/>
Nov 15 09:43:45 user nova-compute[75122]:     </memballoon>
Nov 15 09:43:45 user nova-compute[75122]:   </devices>
Nov 15 09:43:45 user nova-compute[75122]: </domain>
Nov 15 09:43:45 user nova-compute[75122]:  {{(pid=75122) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 09:43:45 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-3b843efe-1db5-44f5-b55a-25e62bddc2f5 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T09:41:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-876462161',display_name='tempest-ServerActionsTestOtherA-server-876462161',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-876462161',id=28,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOjee/3FY3+bQUxkeNPW0HfKU2TS7/WwlSdJA5dC2LRbPtr2GAllBrZqAcx+1wIVC2pqAFLTFeo/KsxadKKcxACsVLYL8LB97mDl41CXm0aq5TWX4fm1S5aOkZSs0D2eNA==',key_name='tempest-keypair-686734186',keypairs=<?>,launch_index=0,launched_at=2023-11-15T09:41:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='8b8e67f8a66a4930be3fb65c397cbeb2',ramdisk_id='',reservation_id='r-50r2vzfz',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1521412552',owner_user_name='tempest-ServerActionsTestOtherA-1521412552-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T09:43:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='91f1469b2c7c45d6ac27f2b64fd5cefe',uuid=cc485c6c-5a9a-4c94-b966-68dd9e336e56,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d3b26bb1-8ddd-4467-af3e-74e39d54390e", "address": "fa:16:3e:8c:a9:0b", "network": {"id": "6e846655-a6f8-4339-a239-65d2f94c8b74", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1923452032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1923452032-network", "vif_mac": "fa:16:3e:8c:a9:0b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b8e67f8a66a4930be3fb65c397cbeb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3b26bb1-8d", "ovs_interfaceid": "d3b26bb1-8ddd-4467-af3e-74e39d54390e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 09:43:45 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-3b843efe-1db5-44f5-b55a-25e62bddc2f5 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Converting VIF {"id": "d3b26bb1-8ddd-4467-af3e-74e39d54390e", "address": "fa:16:3e:8c:a9:0b", "network": {"id": "6e846655-a6f8-4339-a239-65d2f94c8b74", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1923452032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1923452032-network", "vif_mac": "fa:16:3e:8c:a9:0b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b8e67f8a66a4930be3fb65c397cbeb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3b26bb1-8d", "ovs_interfaceid": "d3b26bb1-8ddd-4467-af3e-74e39d54390e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 09:43:45 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-3b843efe-1db5-44f5-b55a-25e62bddc2f5 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:a9:0b,bridge_name='br-int',has_traffic_filtering=True,id=d3b26bb1-8ddd-4467-af3e-74e39d54390e,network=Network(6e846655-a6f8-4339-a239-65d2f94c8b74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3b26bb1-8d') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 09:43:45 user nova-compute[75122]: DEBUG os_vif [None req-3b843efe-1db5-44f5-b55a-25e62bddc2f5 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:a9:0b,bridge_name='br-int',has_traffic_filtering=True,id=d3b26bb1-8ddd-4467-af3e-74e39d54390e,network=Network(6e846655-a6f8-4339-a239-65d2f94c8b74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3b26bb1-8d') {{(pid=75122) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 09:43:45 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:43:45 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:43:45 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 09:43:45 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:43:45 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd1890972-0a31-50b4-bd14-e1765aeb2d3c', '_type': 'linux-noop'}}, row=False) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:43:45 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:43:45 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:43:45 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:43:45 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd3b26bb1-8d, may_exist=True, interface_attrs={}) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:43:45 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd3b26bb1-8d, col_values=(('qos', UUID('4055392c-ecd6-49f8-a98f-213c61be732c')),), if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:43:45 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd3b26bb1-8d, col_values=(('external_ids', {'iface-id': 'd3b26bb1-8ddd-4467-af3e-74e39d54390e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8c:a9:0b', 'vm-uuid': 'cc485c6c-5a9a-4c94-b966-68dd9e336e56'}),), if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:43:45 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:43:45 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:43:45 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:43:45 user nova-compute[75122]: INFO os_vif [None req-3b843efe-1db5-44f5-b55a-25e62bddc2f5 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:a9:0b,bridge_name='br-int',has_traffic_filtering=True,id=d3b26bb1-8ddd-4467-af3e-74e39d54390e,network=Network(6e846655-a6f8-4339-a239-65d2f94c8b74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3b26bb1-8d')
Nov 15 09:43:45 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-3b843efe-1db5-44f5-b55a-25e62bddc2f5 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] No BDM found with device name vda, not building metadata. {{(pid=75122) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 09:43:45 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-3b843efe-1db5-44f5-b55a-25e62bddc2f5 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] No VIF found with MAC fa:16:3e:8c:a9:0b, not building metadata {{(pid=75122) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 09:43:45 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-4e493a2a-0fa9-42c5-b576-1ecf4e7fc610 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Acquiring lock "8271a429-e252-42bb-8717-e89dfd9739bf" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:43:45 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-4e493a2a-0fa9-42c5-b576-1ecf4e7fc610 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Lock "8271a429-e252-42bb-8717-e89dfd9739bf" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:43:45 user nova-compute[75122]: DEBUG nova.compute.manager [None req-4e493a2a-0fa9-42c5-b576-1ecf4e7fc610 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] [instance: 8271a429-e252-42bb-8717-e89dfd9739bf] Starting instance... {{(pid=75122) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 09:43:45 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-4e493a2a-0fa9-42c5-b576-1ecf4e7fc610 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:43:45 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-4e493a2a-0fa9-42c5-b576-1ecf4e7fc610 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:43:45 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-4e493a2a-0fa9-42c5-b576-1ecf4e7fc610 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75122) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 09:43:45 user nova-compute[75122]: INFO nova.compute.claims [None req-4e493a2a-0fa9-42c5-b576-1ecf4e7fc610 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] [instance: 8271a429-e252-42bb-8717-e89dfd9739bf] Claim successful on node user
Nov 15 09:43:46 user nova-compute[75122]: INFO nova.compute.manager [None req-b834f9f6-d5e3-427d-bbdb-de267e70bdac tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] [instance: e1afe5d4-42c0-491c-b1c7-c8debf1d5da2] Took 0.96 seconds to detach 1 volumes for instance.
Nov 15 09:43:46 user nova-compute[75122]: DEBUG nova.compute.manager [None req-b834f9f6-d5e3-427d-bbdb-de267e70bdac tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] [instance: e1afe5d4-42c0-491c-b1c7-c8debf1d5da2] Deleting volume: 395810b1-e3c3-4660-aaaf-b6d9e7cb5a88 {{(pid=75122) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 15 09:43:46 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:43:46 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-b834f9f6-d5e3-427d-bbdb-de267e70bdac tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:43:46 user nova-compute[75122]: DEBUG nova.compute.provider_tree [None req-4e493a2a-0fa9-42c5-b576-1ecf4e7fc610 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Inventory has not changed in ProviderTree for provider: 69a3da65-47be-44c6-b67c-c692b58284ef {{(pid=75122) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 09:43:46 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-4e493a2a-0fa9-42c5-b576-1ecf4e7fc610 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Inventory has not changed for provider 69a3da65-47be-44c6-b67c-c692b58284ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 09:43:46 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-4e493a2a-0fa9-42c5-b576-1ecf4e7fc610 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.489s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:43:46 user nova-compute[75122]: DEBUG nova.compute.manager [None req-4e493a2a-0fa9-42c5-b576-1ecf4e7fc610 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] [instance: 8271a429-e252-42bb-8717-e89dfd9739bf] Start building networks asynchronously for instance. {{(pid=75122) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 09:43:46 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-b834f9f6-d5e3-427d-bbdb-de267e70bdac tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.100s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:43:46 user nova-compute[75122]: DEBUG nova.compute.manager [None req-4e493a2a-0fa9-42c5-b576-1ecf4e7fc610 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] [instance: 8271a429-e252-42bb-8717-e89dfd9739bf] Allocating IP information in the background. {{(pid=75122) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 09:43:46 user nova-compute[75122]: DEBUG nova.network.neutron [None req-4e493a2a-0fa9-42c5-b576-1ecf4e7fc610 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] [instance: 8271a429-e252-42bb-8717-e89dfd9739bf] allocate_for_instance() {{(pid=75122) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 09:43:46 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-4e493a2a-0fa9-42c5-b576-1ecf4e7fc610 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] [instance: 8271a429-e252-42bb-8717-e89dfd9739bf] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 09:43:46 user nova-compute[75122]: DEBUG nova.compute.manager [None req-4e493a2a-0fa9-42c5-b576-1ecf4e7fc610 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] [instance: 8271a429-e252-42bb-8717-e89dfd9739bf] Start building block device mappings for instance. {{(pid=75122) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 09:43:46 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:43:46 user nova-compute[75122]: DEBUG nova.policy [None req-4e493a2a-0fa9-42c5-b576-1ecf4e7fc610 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd05ef35b07ba45afb142f406d418d8d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeff24cb28f5481fa3941ba399ce82ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75122) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 09:43:46 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:43:46 user nova-compute[75122]: DEBUG nova.compute.manager [None req-4e493a2a-0fa9-42c5-b576-1ecf4e7fc610 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] [instance: 8271a429-e252-42bb-8717-e89dfd9739bf] Start spawning the instance on the hypervisor. {{(pid=75122) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 09:43:46 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-4e493a2a-0fa9-42c5-b576-1ecf4e7fc610 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] [instance: 8271a429-e252-42bb-8717-e89dfd9739bf] Creating instance directory {{(pid=75122) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 09:43:46 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-4e493a2a-0fa9-42c5-b576-1ecf4e7fc610 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] [instance: 8271a429-e252-42bb-8717-e89dfd9739bf] Creating image(s)
Nov 15 09:43:46 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-4e493a2a-0fa9-42c5-b576-1ecf4e7fc610 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Acquiring lock "/opt/stack/data/nova/instances/8271a429-e252-42bb-8717-e89dfd9739bf/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:43:46 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-4e493a2a-0fa9-42c5-b576-1ecf4e7fc610 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Lock "/opt/stack/data/nova/instances/8271a429-e252-42bb-8717-e89dfd9739bf/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:43:46 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-4e493a2a-0fa9-42c5-b576-1ecf4e7fc610 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Lock "/opt/stack/data/nova/instances/8271a429-e252-42bb-8717-e89dfd9739bf/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:43:46 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-4e493a2a-0fa9-42c5-b576-1ecf4e7fc610 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:43:46 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:43:46 user nova-compute[75122]: DEBUG nova.compute.provider_tree [None req-b834f9f6-d5e3-427d-bbdb-de267e70bdac tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] Inventory has not changed in ProviderTree for provider: 69a3da65-47be-44c6-b67c-c692b58284ef {{(pid=75122) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 09:43:46 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-b834f9f6-d5e3-427d-bbdb-de267e70bdac tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] Inventory has not changed for provider 69a3da65-47be-44c6-b67c-c692b58284ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 09:43:46 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-4e493a2a-0fa9-42c5-b576-1ecf4e7fc610 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json" returned: 0 in 0.176s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:43:46 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-4e493a2a-0fa9-42c5-b576-1ecf4e7fc610 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Acquiring lock "95d6e29f74d5408f818e32f3bc29bc8270a4c665" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:43:46 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-4e493a2a-0fa9-42c5-b576-1ecf4e7fc610 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Lock "95d6e29f74d5408f818e32f3bc29bc8270a4c665" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:43:46 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-4e493a2a-0fa9-42c5-b576-1ecf4e7fc610 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:43:46 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-b834f9f6-d5e3-427d-bbdb-de267e70bdac tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.559s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:43:46 user nova-compute[75122]: INFO nova.scheduler.client.report [None req-b834f9f6-d5e3-427d-bbdb-de267e70bdac tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] Deleted allocations for instance e1afe5d4-42c0-491c-b1c7-c8debf1d5da2
Nov 15 09:43:47 user nova-compute[75122]: DEBUG nova.compute.manager [req-0a00a42b-563a-4268-bbed-7729097efdd0 req-683f604c-05a6-4bb8-87c7-2320f454b199 service nova] [instance: e1afe5d4-42c0-491c-b1c7-c8debf1d5da2] Received event network-vif-deleted-f2eacefa-263d-4e6f-af4e-3ab293748b4a {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:43:47 user nova-compute[75122]: DEBUG nova.compute.manager [req-0a00a42b-563a-4268-bbed-7729097efdd0 req-683f604c-05a6-4bb8-87c7-2320f454b199 service nova] [instance: cc485c6c-5a9a-4c94-b966-68dd9e336e56] Received event network-vif-plugged-d3b26bb1-8ddd-4467-af3e-74e39d54390e {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:43:47 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-0a00a42b-563a-4268-bbed-7729097efdd0 req-683f604c-05a6-4bb8-87c7-2320f454b199 service nova] Acquiring lock "cc485c6c-5a9a-4c94-b966-68dd9e336e56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:43:47 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-0a00a42b-563a-4268-bbed-7729097efdd0 req-683f604c-05a6-4bb8-87c7-2320f454b199 service nova] Lock "cc485c6c-5a9a-4c94-b966-68dd9e336e56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:43:47 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-0a00a42b-563a-4268-bbed-7729097efdd0 req-683f604c-05a6-4bb8-87c7-2320f454b199 service nova] Lock "cc485c6c-5a9a-4c94-b966-68dd9e336e56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:43:47 user nova-compute[75122]: DEBUG nova.compute.manager [req-0a00a42b-563a-4268-bbed-7729097efdd0 req-683f604c-05a6-4bb8-87c7-2320f454b199 service nova] [instance: cc485c6c-5a9a-4c94-b966-68dd9e336e56] No waiting events found dispatching network-vif-plugged-d3b26bb1-8ddd-4467-af3e-74e39d54390e {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:43:47 user nova-compute[75122]: WARNING nova.compute.manager [req-0a00a42b-563a-4268-bbed-7729097efdd0 req-683f604c-05a6-4bb8-87c7-2320f454b199 service nova] [instance: cc485c6c-5a9a-4c94-b966-68dd9e336e56] Received unexpected event network-vif-plugged-d3b26bb1-8ddd-4467-af3e-74e39d54390e for instance with vm_state active and task_state resize_finish.
Nov 15 09:43:47 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-b834f9f6-d5e3-427d-bbdb-de267e70bdac tempest-ServerActionsV293TestJSON-380486035 tempest-ServerActionsV293TestJSON-380486035-project-member] Lock "e1afe5d4-42c0-491c-b1c7-c8debf1d5da2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.509s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:43:47 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-4e493a2a-0fa9-42c5-b576-1ecf4e7fc610 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json" returned: 0 in 0.205s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:43:47 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-4e493a2a-0fa9-42c5-b576-1ecf4e7fc610 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665,backing_fmt=raw /opt/stack/data/nova/instances/8271a429-e252-42bb-8717-e89dfd9739bf/disk 1073741824 {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:43:47 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-4e493a2a-0fa9-42c5-b576-1ecf4e7fc610 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665,backing_fmt=raw /opt/stack/data/nova/instances/8271a429-e252-42bb-8717-e89dfd9739bf/disk 1073741824" returned: 0 in 0.060s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:43:47 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-4e493a2a-0fa9-42c5-b576-1ecf4e7fc610 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Lock "95d6e29f74d5408f818e32f3bc29bc8270a4c665" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.269s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:43:47 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-4e493a2a-0fa9-42c5-b576-1ecf4e7fc610 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:43:47 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-4e493a2a-0fa9-42c5-b576-1ecf4e7fc610 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json" returned: 0 in 0.170s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:43:47 user nova-compute[75122]: DEBUG nova.virt.disk.api [None req-4e493a2a-0fa9-42c5-b576-1ecf4e7fc610 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8271a429-e252-42bb-8717-e89dfd9739bf/disk. size=1073741824 {{(pid=75122) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 09:43:47 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-4e493a2a-0fa9-42c5-b576-1ecf4e7fc610 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8271a429-e252-42bb-8717-e89dfd9739bf/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:43:47 user nova-compute[75122]: DEBUG nova.network.neutron [None req-4e493a2a-0fa9-42c5-b576-1ecf4e7fc610 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] [instance: 8271a429-e252-42bb-8717-e89dfd9739bf] Successfully created port: 044ffaae-8351-4c7f-9b12-32ac7d4b3565 {{(pid=75122) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 09:43:47 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-4e493a2a-0fa9-42c5-b576-1ecf4e7fc610 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8271a429-e252-42bb-8717-e89dfd9739bf/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:43:47 user nova-compute[75122]: DEBUG nova.virt.disk.api [None req-4e493a2a-0fa9-42c5-b576-1ecf4e7fc610 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Cannot resize image /opt/stack/data/nova/instances/8271a429-e252-42bb-8717-e89dfd9739bf/disk to a smaller size. {{(pid=75122) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 09:43:47 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-4e493a2a-0fa9-42c5-b576-1ecf4e7fc610 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] [instance: 8271a429-e252-42bb-8717-e89dfd9739bf] Created local disks {{(pid=75122) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 09:43:47 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-4e493a2a-0fa9-42c5-b576-1ecf4e7fc610 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] [instance: 8271a429-e252-42bb-8717-e89dfd9739bf] Ensure instance console log exists: /opt/stack/data/nova/instances/8271a429-e252-42bb-8717-e89dfd9739bf/console.log {{(pid=75122) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 09:43:47 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-4e493a2a-0fa9-42c5-b576-1ecf4e7fc610 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:43:47 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-4e493a2a-0fa9-42c5-b576-1ecf4e7fc610 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:43:47 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-4e493a2a-0fa9-42c5-b576-1ecf4e7fc610 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:43:48 user nova-compute[75122]: DEBUG nova.network.neutron [None req-4e493a2a-0fa9-42c5-b576-1ecf4e7fc610 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] [instance: 8271a429-e252-42bb-8717-e89dfd9739bf] Successfully updated port: 044ffaae-8351-4c7f-9b12-32ac7d4b3565 {{(pid=75122) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 09:43:48 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-4e493a2a-0fa9-42c5-b576-1ecf4e7fc610 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Acquiring lock "refresh_cache-8271a429-e252-42bb-8717-e89dfd9739bf" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 09:43:48 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-4e493a2a-0fa9-42c5-b576-1ecf4e7fc610 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Acquired lock "refresh_cache-8271a429-e252-42bb-8717-e89dfd9739bf" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 09:43:48 user nova-compute[75122]: DEBUG nova.network.neutron [None req-4e493a2a-0fa9-42c5-b576-1ecf4e7fc610 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] [instance: 8271a429-e252-42bb-8717-e89dfd9739bf] Building network info cache for instance {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 09:43:48 user nova-compute[75122]: DEBUG nova.network.neutron [None req-4e493a2a-0fa9-42c5-b576-1ecf4e7fc610 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] [instance: 8271a429-e252-42bb-8717-e89dfd9739bf] Instance cache missing network info. {{(pid=75122) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 09:43:48 user nova-compute[75122]: DEBUG nova.network.neutron [None req-4e493a2a-0fa9-42c5-b576-1ecf4e7fc610 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] [instance: 8271a429-e252-42bb-8717-e89dfd9739bf] Updating instance_info_cache with network_info: [{"id": "044ffaae-8351-4c7f-9b12-32ac7d4b3565", "address": "fa:16:3e:e3:9d:f8", "network": {"id": "c2062f64-d925-42d2-9687-5d2511ef6697", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1134087048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eeff24cb28f5481fa3941ba399ce82ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap044ffaae-83", "ovs_interfaceid": "044ffaae-8351-4c7f-9b12-32ac7d4b3565", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:43:48 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-4e493a2a-0fa9-42c5-b576-1ecf4e7fc610 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Releasing lock "refresh_cache-8271a429-e252-42bb-8717-e89dfd9739bf" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 09:43:48 user nova-compute[75122]: DEBUG nova.compute.manager [None req-4e493a2a-0fa9-42c5-b576-1ecf4e7fc610 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] [instance: 8271a429-e252-42bb-8717-e89dfd9739bf] Instance network_info: |[{"id": "044ffaae-8351-4c7f-9b12-32ac7d4b3565", "address": "fa:16:3e:e3:9d:f8", "network": {"id": "c2062f64-d925-42d2-9687-5d2511ef6697", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1134087048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eeff24cb28f5481fa3941ba399ce82ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap044ffaae-83", "ovs_interfaceid": "044ffaae-8351-4c7f-9b12-32ac7d4b3565", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75122) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 09:43:48 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-4e493a2a-0fa9-42c5-b576-1ecf4e7fc610 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] [instance: 8271a429-e252-42bb-8717-e89dfd9739bf] Start _get_guest_xml network_info=[{"id": "044ffaae-8351-4c7f-9b12-32ac7d4b3565", "address": "fa:16:3e:e3:9d:f8", "network": {"id": "c2062f64-d925-42d2-9687-5d2511ef6697", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1134087048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eeff24cb28f5481fa3941ba399ce82ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap044ffaae-83", "ovs_interfaceid": "044ffaae-8351-4c7f-9b12-32ac7d4b3565", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T09:26:31Z,direct_url=<?>,disk_format='qcow2',id=5e862cfe-47b8-4725-8292-65761ee6d0f5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9c57733cb41847c0b4ad31519c382e5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T09:26:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '5e862cfe-47b8-4725-8292-65761ee6d0f5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75122) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 09:43:48 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-4e493a2a-0fa9-42c5-b576-1ecf4e7fc610 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 09:43:48 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-4e493a2a-0fa9-42c5-b576-1ecf4e7fc610 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 09:43:48 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-4e493a2a-0fa9-42c5-b576-1ecf4e7fc610 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75122) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 09:43:48 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-4e493a2a-0fa9-42c5-b576-1ecf4e7fc610 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] CPU controller missing on host. {{(pid=75122) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 09:43:48 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-4e493a2a-0fa9-42c5-b576-1ecf4e7fc610 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75122) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 09:43:48 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-4e493a2a-0fa9-42c5-b576-1ecf4e7fc610 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] CPU controller found on host. {{(pid=75122) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 09:43:48 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-4e493a2a-0fa9-42c5-b576-1ecf4e7fc610 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75122) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 09:43:48 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-4e493a2a-0fa9-42c5-b576-1ecf4e7fc610 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T09:26:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T09:26:31Z,direct_url=<?>,disk_format='qcow2',id=5e862cfe-47b8-4725-8292-65761ee6d0f5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9c57733cb41847c0b4ad31519c382e5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T09:26:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 09:43:48 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-4e493a2a-0fa9-42c5-b576-1ecf4e7fc610 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Flavor limits 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 09:43:48 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-4e493a2a-0fa9-42c5-b576-1ecf4e7fc610 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Image limits 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 09:43:48 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-4e493a2a-0fa9-42c5-b576-1ecf4e7fc610 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Flavor pref 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 09:43:48 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-4e493a2a-0fa9-42c5-b576-1ecf4e7fc610 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Image pref 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 09:43:48 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-4e493a2a-0fa9-42c5-b576-1ecf4e7fc610 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 09:43:48 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-4e493a2a-0fa9-42c5-b576-1ecf4e7fc610 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 09:43:48 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-4e493a2a-0fa9-42c5-b576-1ecf4e7fc610 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75122) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 09:43:48 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-4e493a2a-0fa9-42c5-b576-1ecf4e7fc610 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Got 1 possible topologies {{(pid=75122) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 09:43:48 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-4e493a2a-0fa9-42c5-b576-1ecf4e7fc610 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 09:43:48 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-4e493a2a-0fa9-42c5-b576-1ecf4e7fc610 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 09:43:48 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-4e493a2a-0fa9-42c5-b576-1ecf4e7fc610 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T09:43:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1557571265',display_name='tempest-ServerRescueNegativeTestJSON-server-1557571265',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1557571265',id=30,image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMbJqP1ByBl8MwFuhgI4Maut89fFXBQm0AZFy/U/KQEQbLyjF3Qkd0mt4JO2QcR+bc5y3VziaM1h7w2MWLT+t2p4sHAYFMiUNVAa5O4UJxoDo7cVDTcqH0mo3/nwMOL2mg==',key_name='tempest-keypair-1317030039',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eeff24cb28f5481fa3941ba399ce82ff',ramdisk_id='',reservation_id='r-weslqkgj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-59965354',owner_user_name='tempest-ServerRescueNegativeTestJSON-59965354-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T09:43:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d05ef35b07ba45afb142f406d418d8d4',uuid=8271a429-e252-42bb-8717-e89dfd9739bf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "044ffaae-8351-4c7f-9b12-32ac7d4b3565", "address": "fa:16:3e:e3:9d:f8", "network": {"id": "c2062f64-d925-42d2-9687-5d2511ef6697", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1134087048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eeff24cb28f5481fa3941ba399ce82ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap044ffaae-83", "ovs_interfaceid": "044ffaae-8351-4c7f-9b12-32ac7d4b3565", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75122) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 09:43:48 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-4e493a2a-0fa9-42c5-b576-1ecf4e7fc610 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Converting VIF {"id": "044ffaae-8351-4c7f-9b12-32ac7d4b3565", "address": "fa:16:3e:e3:9d:f8", "network": {"id": "c2062f64-d925-42d2-9687-5d2511ef6697", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1134087048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eeff24cb28f5481fa3941ba399ce82ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap044ffaae-83", "ovs_interfaceid": "044ffaae-8351-4c7f-9b12-32ac7d4b3565", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 09:43:48 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-4e493a2a-0fa9-42c5-b576-1ecf4e7fc610 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:9d:f8,bridge_name='br-int',has_traffic_filtering=True,id=044ffaae-8351-4c7f-9b12-32ac7d4b3565,network=Network(c2062f64-d925-42d2-9687-5d2511ef6697),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap044ffaae-83') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 09:43:48 user nova-compute[75122]: DEBUG nova.objects.instance [None req-4e493a2a-0fa9-42c5-b576-1ecf4e7fc610 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Lazy-loading 'pci_devices' on Instance uuid 8271a429-e252-42bb-8717-e89dfd9739bf {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:43:48 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-4e493a2a-0fa9-42c5-b576-1ecf4e7fc610 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] [instance: 8271a429-e252-42bb-8717-e89dfd9739bf] End _get_guest_xml xml=<domain type="kvm">
Nov 15 09:43:48 user nova-compute[75122]:   <uuid>8271a429-e252-42bb-8717-e89dfd9739bf</uuid>
Nov 15 09:43:48 user nova-compute[75122]:   <name>instance-0000001e</name>
Nov 15 09:43:48 user nova-compute[75122]:   <memory>524288</memory>
Nov 15 09:43:48 user nova-compute[75122]:   <vcpu>1</vcpu>
Nov 15 09:43:48 user nova-compute[75122]:   <metadata>
Nov 15 09:43:48 user nova-compute[75122]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 09:43:48 user nova-compute[75122]:       <nova:package version="0.0.0"/>
Nov 15 09:43:48 user nova-compute[75122]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1557571265</nova:name>
Nov 15 09:43:48 user nova-compute[75122]:       <nova:creationTime>2023-11-15 09:43:48</nova:creationTime>
Nov 15 09:43:48 user nova-compute[75122]:       <nova:flavor name="m1.tiny">
Nov 15 09:43:48 user nova-compute[75122]:         <nova:memory>512</nova:memory>
Nov 15 09:43:48 user nova-compute[75122]:         <nova:disk>1</nova:disk>
Nov 15 09:43:48 user nova-compute[75122]:         <nova:swap>0</nova:swap>
Nov 15 09:43:48 user nova-compute[75122]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 09:43:48 user nova-compute[75122]:         <nova:vcpus>1</nova:vcpus>
Nov 15 09:43:48 user nova-compute[75122]:       </nova:flavor>
Nov 15 09:43:48 user nova-compute[75122]:       <nova:owner>
Nov 15 09:43:48 user nova-compute[75122]:         <nova:user uuid="d05ef35b07ba45afb142f406d418d8d4">tempest-ServerRescueNegativeTestJSON-59965354-project-member</nova:user>
Nov 15 09:43:48 user nova-compute[75122]:         <nova:project uuid="eeff24cb28f5481fa3941ba399ce82ff">tempest-ServerRescueNegativeTestJSON-59965354</nova:project>
Nov 15 09:43:48 user nova-compute[75122]:       </nova:owner>
Nov 15 09:43:48 user nova-compute[75122]:       <nova:root type="image" uuid="5e862cfe-47b8-4725-8292-65761ee6d0f5"/>
Nov 15 09:43:48 user nova-compute[75122]:       <nova:ports>
Nov 15 09:43:48 user nova-compute[75122]:         <nova:port uuid="044ffaae-8351-4c7f-9b12-32ac7d4b3565">
Nov 15 09:43:48 user nova-compute[75122]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 15 09:43:48 user nova-compute[75122]:         </nova:port>
Nov 15 09:43:48 user nova-compute[75122]:       </nova:ports>
Nov 15 09:43:48 user nova-compute[75122]:     </nova:instance>
Nov 15 09:43:48 user nova-compute[75122]:   </metadata>
Nov 15 09:43:48 user nova-compute[75122]:   <sysinfo type="smbios">
Nov 15 09:43:48 user nova-compute[75122]:     <system>
Nov 15 09:43:48 user nova-compute[75122]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 09:43:48 user nova-compute[75122]:       <entry name="product">OpenStack Nova</entry>
Nov 15 09:43:48 user nova-compute[75122]:       <entry name="version">0.0.0</entry>
Nov 15 09:43:48 user nova-compute[75122]:       <entry name="serial">8271a429-e252-42bb-8717-e89dfd9739bf</entry>
Nov 15 09:43:48 user nova-compute[75122]:       <entry name="uuid">8271a429-e252-42bb-8717-e89dfd9739bf</entry>
Nov 15 09:43:48 user nova-compute[75122]:       <entry name="family">Virtual Machine</entry>
Nov 15 09:43:48 user nova-compute[75122]:     </system>
Nov 15 09:43:48 user nova-compute[75122]:   </sysinfo>
Nov 15 09:43:48 user nova-compute[75122]:   <os>
Nov 15 09:43:48 user nova-compute[75122]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 09:43:48 user nova-compute[75122]:     <boot dev="hd"/>
Nov 15 09:43:48 user nova-compute[75122]:     <smbios mode="sysinfo"/>
Nov 15 09:43:48 user nova-compute[75122]:   </os>
Nov 15 09:43:48 user nova-compute[75122]:   <features>
Nov 15 09:43:48 user nova-compute[75122]:     <acpi/>
Nov 15 09:43:48 user nova-compute[75122]:     <apic/>
Nov 15 09:43:48 user nova-compute[75122]:     <vmcoreinfo/>
Nov 15 09:43:48 user nova-compute[75122]:   </features>
Nov 15 09:43:48 user nova-compute[75122]:   <clock offset="utc">
Nov 15 09:43:48 user nova-compute[75122]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 09:43:48 user nova-compute[75122]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 09:43:48 user nova-compute[75122]:     <timer name="hpet" present="no"/>
Nov 15 09:43:48 user nova-compute[75122]:   </clock>
Nov 15 09:43:48 user nova-compute[75122]:   <cpu mode="custom" match="exact">
Nov 15 09:43:48 user nova-compute[75122]:     <model>Nehalem</model>
Nov 15 09:43:48 user nova-compute[75122]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 09:43:48 user nova-compute[75122]:   </cpu>
Nov 15 09:43:48 user nova-compute[75122]:   <devices>
Nov 15 09:43:48 user nova-compute[75122]:     <disk type="file" device="disk">
Nov 15 09:43:48 user nova-compute[75122]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 09:43:48 user nova-compute[75122]:       <source file="/opt/stack/data/nova/instances/8271a429-e252-42bb-8717-e89dfd9739bf/disk"/>
Nov 15 09:43:48 user nova-compute[75122]:       <target dev="vda" bus="virtio"/>
Nov 15 09:43:48 user nova-compute[75122]:     </disk>
Nov 15 09:43:48 user nova-compute[75122]:     <interface type="ethernet">
Nov 15 09:43:48 user nova-compute[75122]:       <mac address="fa:16:3e:e3:9d:f8"/>
Nov 15 09:43:48 user nova-compute[75122]:       <model type="virtio"/>
Nov 15 09:43:48 user nova-compute[75122]:       <mtu size="1442"/>
Nov 15 09:43:48 user nova-compute[75122]:       <target dev="tap044ffaae-83"/>
Nov 15 09:43:48 user nova-compute[75122]:     </interface>
Nov 15 09:43:48 user nova-compute[75122]:     <serial type="pty">
Nov 15 09:43:48 user nova-compute[75122]:       <log file="/opt/stack/data/nova/instances/8271a429-e252-42bb-8717-e89dfd9739bf/console.log" append="off"/>
Nov 15 09:43:48 user nova-compute[75122]:     </serial>
Nov 15 09:43:48 user nova-compute[75122]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 09:43:48 user nova-compute[75122]:     <video>
Nov 15 09:43:48 user nova-compute[75122]:       <model type="virtio"/>
Nov 15 09:43:48 user nova-compute[75122]:     </video>
Nov 15 09:43:48 user nova-compute[75122]:     <rng model="virtio">
Nov 15 09:43:48 user nova-compute[75122]:       <backend model="random">/dev/urandom</backend>
Nov 15 09:43:48 user nova-compute[75122]:     </rng>
Nov 15 09:43:48 user nova-compute[75122]:     <controller type="usb" index="0" model="none"/>
Nov 15 09:43:48 user nova-compute[75122]:     <memballoon model="virtio">
Nov 15 09:43:48 user nova-compute[75122]:       <stats period="10"/>
Nov 15 09:43:48 user nova-compute[75122]:     </memballoon>
Nov 15 09:43:48 user nova-compute[75122]:   </devices>
Nov 15 09:43:48 user nova-compute[75122]: </domain>
Nov 15 09:43:48 user nova-compute[75122]:  {{(pid=75122) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 09:43:48 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-4e493a2a-0fa9-42c5-b576-1ecf4e7fc610 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T09:43:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1557571265',display_name='tempest-ServerRescueNegativeTestJSON-server-1557571265',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1557571265',id=30,image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMbJqP1ByBl8MwFuhgI4Maut89fFXBQm0AZFy/U/KQEQbLyjF3Qkd0mt4JO2QcR+bc5y3VziaM1h7w2MWLT+t2p4sHAYFMiUNVAa5O4UJxoDo7cVDTcqH0mo3/nwMOL2mg==',key_name='tempest-keypair-1317030039',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eeff24cb28f5481fa3941ba399ce82ff',ramdisk_id='',reservation_id='r-weslqkgj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-59965354',owner_user_name='tempest-ServerRescueNegativeTestJSON-59965354-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T09:43:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d05ef35b07ba45afb142f406d418d8d4',uuid=8271a429-e252-42bb-8717-e89dfd9739bf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "044ffaae-8351-4c7f-9b12-32ac7d4b3565", "address": "fa:16:3e:e3:9d:f8", "network": {"id": "c2062f64-d925-42d2-9687-5d2511ef6697", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1134087048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eeff24cb28f5481fa3941ba399ce82ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap044ffaae-83", "ovs_interfaceid": "044ffaae-8351-4c7f-9b12-32ac7d4b3565", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 09:43:48 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-4e493a2a-0fa9-42c5-b576-1ecf4e7fc610 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Converting VIF {"id": "044ffaae-8351-4c7f-9b12-32ac7d4b3565", "address": "fa:16:3e:e3:9d:f8", "network": {"id": "c2062f64-d925-42d2-9687-5d2511ef6697", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1134087048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eeff24cb28f5481fa3941ba399ce82ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap044ffaae-83", "ovs_interfaceid": "044ffaae-8351-4c7f-9b12-32ac7d4b3565", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 09:43:48 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-4e493a2a-0fa9-42c5-b576-1ecf4e7fc610 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:9d:f8,bridge_name='br-int',has_traffic_filtering=True,id=044ffaae-8351-4c7f-9b12-32ac7d4b3565,network=Network(c2062f64-d925-42d2-9687-5d2511ef6697),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap044ffaae-83') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 09:43:48 user nova-compute[75122]: DEBUG os_vif [None req-4e493a2a-0fa9-42c5-b576-1ecf4e7fc610 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:9d:f8,bridge_name='br-int',has_traffic_filtering=True,id=044ffaae-8351-4c7f-9b12-32ac7d4b3565,network=Network(c2062f64-d925-42d2-9687-5d2511ef6697),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap044ffaae-83') {{(pid=75122) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 09:43:48 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:43:48 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:43:48 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 09:43:48 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:43:48 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7dd2b331-bee2-521a-9f88-7dc70751b18c', '_type': 'linux-noop'}}, row=False) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:43:48 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:43:48 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:43:48 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:43:48 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap044ffaae-83, may_exist=True, interface_attrs={}) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:43:48 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap044ffaae-83, col_values=(('qos', UUID('d4f4fb59-ec65-4a72-9c0d-b37669786927')),), if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:43:48 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap044ffaae-83, col_values=(('external_ids', {'iface-id': '044ffaae-8351-4c7f-9b12-32ac7d4b3565', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e3:9d:f8', 'vm-uuid': '8271a429-e252-42bb-8717-e89dfd9739bf'}),), if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:43:48 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:43:48 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:43:48 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:43:48 user nova-compute[75122]: INFO os_vif [None req-4e493a2a-0fa9-42c5-b576-1ecf4e7fc610 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:9d:f8,bridge_name='br-int',has_traffic_filtering=True,id=044ffaae-8351-4c7f-9b12-32ac7d4b3565,network=Network(c2062f64-d925-42d2-9687-5d2511ef6697),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap044ffaae-83')
Nov 15 09:43:48 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-4e493a2a-0fa9-42c5-b576-1ecf4e7fc610 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] No BDM found with device name vda, not building metadata. {{(pid=75122) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 09:43:48 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-4e493a2a-0fa9-42c5-b576-1ecf4e7fc610 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] No VIF found with MAC fa:16:3e:e3:9d:f8, not building metadata {{(pid=75122) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 09:43:48 user nova-compute[75122]: DEBUG nova.compute.manager [None req-3b843efe-1db5-44f5-b55a-25e62bddc2f5 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] [instance: cc485c6c-5a9a-4c94-b966-68dd9e336e56] Instance event wait completed in 0 seconds for  {{(pid=75122) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 09:43:48 user nova-compute[75122]: INFO nova.virt.libvirt.driver [-] [instance: cc485c6c-5a9a-4c94-b966-68dd9e336e56] Instance running successfully.
Nov 15 09:43:48 user nova-compute[75122]: DEBUG nova.virt.libvirt.guest [None req-3b843efe-1db5-44f5-b55a-25e62bddc2f5 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] [instance: cc485c6c-5a9a-4c94-b966-68dd9e336e56] Failed to set time: agent not configured {{(pid=75122) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 15 09:43:48 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-3b843efe-1db5-44f5-b55a-25e62bddc2f5 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] [instance: cc485c6c-5a9a-4c94-b966-68dd9e336e56] finish_migration finished successfully. {{(pid=75122) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Nov 15 09:43:49 user nova-compute[75122]: DEBUG nova.compute.manager [req-9e67366f-d5d3-48b6-beb3-0acef8ebb192 req-3602881e-4cff-4c1b-95fb-83d5e852ac20 service nova] [instance: cc485c6c-5a9a-4c94-b966-68dd9e336e56] Received event network-vif-plugged-d3b26bb1-8ddd-4467-af3e-74e39d54390e {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:43:49 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-9e67366f-d5d3-48b6-beb3-0acef8ebb192 req-3602881e-4cff-4c1b-95fb-83d5e852ac20 service nova] Acquiring lock "cc485c6c-5a9a-4c94-b966-68dd9e336e56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:43:49 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-9e67366f-d5d3-48b6-beb3-0acef8ebb192 req-3602881e-4cff-4c1b-95fb-83d5e852ac20 service nova] Lock "cc485c6c-5a9a-4c94-b966-68dd9e336e56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:43:49 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-9e67366f-d5d3-48b6-beb3-0acef8ebb192 req-3602881e-4cff-4c1b-95fb-83d5e852ac20 service nova] Lock "cc485c6c-5a9a-4c94-b966-68dd9e336e56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:43:49 user nova-compute[75122]: DEBUG nova.compute.manager [req-9e67366f-d5d3-48b6-beb3-0acef8ebb192 req-3602881e-4cff-4c1b-95fb-83d5e852ac20 service nova] [instance: cc485c6c-5a9a-4c94-b966-68dd9e336e56] No waiting events found dispatching network-vif-plugged-d3b26bb1-8ddd-4467-af3e-74e39d54390e {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:43:49 user nova-compute[75122]: WARNING nova.compute.manager [req-9e67366f-d5d3-48b6-beb3-0acef8ebb192 req-3602881e-4cff-4c1b-95fb-83d5e852ac20 service nova] [instance: cc485c6c-5a9a-4c94-b966-68dd9e336e56] Received unexpected event network-vif-plugged-d3b26bb1-8ddd-4467-af3e-74e39d54390e for instance with vm_state active and task_state resize_finish.
Nov 15 09:43:49 user nova-compute[75122]: DEBUG nova.compute.manager [req-9e67366f-d5d3-48b6-beb3-0acef8ebb192 req-3602881e-4cff-4c1b-95fb-83d5e852ac20 service nova] [instance: 8271a429-e252-42bb-8717-e89dfd9739bf] Received event network-changed-044ffaae-8351-4c7f-9b12-32ac7d4b3565 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:43:49 user nova-compute[75122]: DEBUG nova.compute.manager [req-9e67366f-d5d3-48b6-beb3-0acef8ebb192 req-3602881e-4cff-4c1b-95fb-83d5e852ac20 service nova] [instance: 8271a429-e252-42bb-8717-e89dfd9739bf] Refreshing instance network info cache due to event network-changed-044ffaae-8351-4c7f-9b12-32ac7d4b3565. {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 09:43:49 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-9e67366f-d5d3-48b6-beb3-0acef8ebb192 req-3602881e-4cff-4c1b-95fb-83d5e852ac20 service nova] Acquiring lock "refresh_cache-8271a429-e252-42bb-8717-e89dfd9739bf" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 09:43:49 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-9e67366f-d5d3-48b6-beb3-0acef8ebb192 req-3602881e-4cff-4c1b-95fb-83d5e852ac20 service nova] Acquired lock "refresh_cache-8271a429-e252-42bb-8717-e89dfd9739bf" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 09:43:49 user nova-compute[75122]: DEBUG nova.network.neutron [req-9e67366f-d5d3-48b6-beb3-0acef8ebb192 req-3602881e-4cff-4c1b-95fb-83d5e852ac20 service nova] [instance: 8271a429-e252-42bb-8717-e89dfd9739bf] Refreshing network info cache for port 044ffaae-8351-4c7f-9b12-32ac7d4b3565 {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 09:43:49 user nova-compute[75122]: DEBUG nova.network.neutron [req-9e67366f-d5d3-48b6-beb3-0acef8ebb192 req-3602881e-4cff-4c1b-95fb-83d5e852ac20 service nova] [instance: 8271a429-e252-42bb-8717-e89dfd9739bf] Updated VIF entry in instance network info cache for port 044ffaae-8351-4c7f-9b12-32ac7d4b3565. {{(pid=75122) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 09:43:49 user nova-compute[75122]: DEBUG nova.network.neutron [req-9e67366f-d5d3-48b6-beb3-0acef8ebb192 req-3602881e-4cff-4c1b-95fb-83d5e852ac20 service nova] [instance: 8271a429-e252-42bb-8717-e89dfd9739bf] Updating instance_info_cache with network_info: [{"id": "044ffaae-8351-4c7f-9b12-32ac7d4b3565", "address": "fa:16:3e:e3:9d:f8", "network": {"id": "c2062f64-d925-42d2-9687-5d2511ef6697", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1134087048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eeff24cb28f5481fa3941ba399ce82ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap044ffaae-83", "ovs_interfaceid": "044ffaae-8351-4c7f-9b12-32ac7d4b3565", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:43:49 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-9e67366f-d5d3-48b6-beb3-0acef8ebb192 req-3602881e-4cff-4c1b-95fb-83d5e852ac20 service nova] Releasing lock "refresh_cache-8271a429-e252-42bb-8717-e89dfd9739bf" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 09:43:50 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:43:50 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:43:50 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:43:50 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:43:50 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:43:50 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:43:50 user nova-compute[75122]: DEBUG nova.compute.manager [req-fc9216d3-ae4d-487a-8ff7-fa7af8f5ab08 req-a67094ec-030e-41c9-8964-c7deb5b10ff8 service nova] [instance: 8271a429-e252-42bb-8717-e89dfd9739bf] Received event network-vif-plugged-044ffaae-8351-4c7f-9b12-32ac7d4b3565 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:43:50 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-fc9216d3-ae4d-487a-8ff7-fa7af8f5ab08 req-a67094ec-030e-41c9-8964-c7deb5b10ff8 service nova] Acquiring lock "8271a429-e252-42bb-8717-e89dfd9739bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:43:50 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-fc9216d3-ae4d-487a-8ff7-fa7af8f5ab08 req-a67094ec-030e-41c9-8964-c7deb5b10ff8 service nova] Lock "8271a429-e252-42bb-8717-e89dfd9739bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:43:50 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-fc9216d3-ae4d-487a-8ff7-fa7af8f5ab08 req-a67094ec-030e-41c9-8964-c7deb5b10ff8 service nova] Lock "8271a429-e252-42bb-8717-e89dfd9739bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:43:50 user nova-compute[75122]: DEBUG nova.compute.manager [req-fc9216d3-ae4d-487a-8ff7-fa7af8f5ab08 req-a67094ec-030e-41c9-8964-c7deb5b10ff8 service nova] [instance: 8271a429-e252-42bb-8717-e89dfd9739bf] No waiting events found dispatching network-vif-plugged-044ffaae-8351-4c7f-9b12-32ac7d4b3565 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:43:50 user nova-compute[75122]: WARNING nova.compute.manager [req-fc9216d3-ae4d-487a-8ff7-fa7af8f5ab08 req-a67094ec-030e-41c9-8964-c7deb5b10ff8 service nova] [instance: 8271a429-e252-42bb-8717-e89dfd9739bf] Received unexpected event network-vif-plugged-044ffaae-8351-4c7f-9b12-32ac7d4b3565 for instance with vm_state building and task_state spawning.
Nov 15 09:43:51 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:43:52 user nova-compute[75122]: DEBUG nova.compute.manager [None req-4e493a2a-0fa9-42c5-b576-1ecf4e7fc610 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] [instance: 8271a429-e252-42bb-8717-e89dfd9739bf] Instance event wait completed in 0 seconds for  {{(pid=75122) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 09:43:52 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-4e493a2a-0fa9-42c5-b576-1ecf4e7fc610 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] [instance: 8271a429-e252-42bb-8717-e89dfd9739bf] Guest created on hypervisor {{(pid=75122) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 09:43:52 user nova-compute[75122]: DEBUG nova.compute.manager [req-c3e1e08d-972c-4e15-ad89-ab07c6b6709a req-fbaf7ee0-fe8c-43f7-9bbb-82f16b7c16ca service nova] [instance: 8271a429-e252-42bb-8717-e89dfd9739bf] Received event network-vif-plugged-044ffaae-8351-4c7f-9b12-32ac7d4b3565 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:43:52 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-c3e1e08d-972c-4e15-ad89-ab07c6b6709a req-fbaf7ee0-fe8c-43f7-9bbb-82f16b7c16ca service nova] Acquiring lock "8271a429-e252-42bb-8717-e89dfd9739bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:43:52 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-c3e1e08d-972c-4e15-ad89-ab07c6b6709a req-fbaf7ee0-fe8c-43f7-9bbb-82f16b7c16ca service nova] Lock "8271a429-e252-42bb-8717-e89dfd9739bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:43:52 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-c3e1e08d-972c-4e15-ad89-ab07c6b6709a req-fbaf7ee0-fe8c-43f7-9bbb-82f16b7c16ca service nova] Lock "8271a429-e252-42bb-8717-e89dfd9739bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:43:52 user nova-compute[75122]: DEBUG nova.compute.manager [req-c3e1e08d-972c-4e15-ad89-ab07c6b6709a req-fbaf7ee0-fe8c-43f7-9bbb-82f16b7c16ca service nova] [instance: 8271a429-e252-42bb-8717-e89dfd9739bf] No waiting events found dispatching network-vif-plugged-044ffaae-8351-4c7f-9b12-32ac7d4b3565 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:43:52 user nova-compute[75122]: WARNING nova.compute.manager [req-c3e1e08d-972c-4e15-ad89-ab07c6b6709a req-fbaf7ee0-fe8c-43f7-9bbb-82f16b7c16ca service nova] [instance: 8271a429-e252-42bb-8717-e89dfd9739bf] Received unexpected event network-vif-plugged-044ffaae-8351-4c7f-9b12-32ac7d4b3565 for instance with vm_state building and task_state spawning.
Nov 15 09:43:52 user nova-compute[75122]: INFO nova.virt.libvirt.driver [-] [instance: 8271a429-e252-42bb-8717-e89dfd9739bf] Instance spawned successfully.
Nov 15 09:43:52 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-4e493a2a-0fa9-42c5-b576-1ecf4e7fc610 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] [instance: 8271a429-e252-42bb-8717-e89dfd9739bf] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 09:43:52 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-4e493a2a-0fa9-42c5-b576-1ecf4e7fc610 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] [instance: 8271a429-e252-42bb-8717-e89dfd9739bf] Found default for hw_cdrom_bus of ide {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:43:52 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-4e493a2a-0fa9-42c5-b576-1ecf4e7fc610 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] [instance: 8271a429-e252-42bb-8717-e89dfd9739bf] Found default for hw_disk_bus of virtio {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:43:52 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-4e493a2a-0fa9-42c5-b576-1ecf4e7fc610 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] [instance: 8271a429-e252-42bb-8717-e89dfd9739bf] Found default for hw_input_bus of None {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:43:52 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-4e493a2a-0fa9-42c5-b576-1ecf4e7fc610 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] [instance: 8271a429-e252-42bb-8717-e89dfd9739bf] Found default for hw_pointer_model of None {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:43:52 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-4e493a2a-0fa9-42c5-b576-1ecf4e7fc610 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] [instance: 8271a429-e252-42bb-8717-e89dfd9739bf] Found default for hw_video_model of virtio {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:43:52 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-4e493a2a-0fa9-42c5-b576-1ecf4e7fc610 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] [instance: 8271a429-e252-42bb-8717-e89dfd9739bf] Found default for hw_vif_model of virtio {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:43:52 user nova-compute[75122]: INFO nova.compute.manager [None req-4e493a2a-0fa9-42c5-b576-1ecf4e7fc610 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] [instance: 8271a429-e252-42bb-8717-e89dfd9739bf] Took 6.05 seconds to spawn the instance on the hypervisor.
Nov 15 09:43:52 user nova-compute[75122]: DEBUG nova.compute.manager [None req-4e493a2a-0fa9-42c5-b576-1ecf4e7fc610 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] [instance: 8271a429-e252-42bb-8717-e89dfd9739bf] Checking state {{(pid=75122) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 09:43:52 user nova-compute[75122]: INFO nova.compute.manager [None req-4e493a2a-0fa9-42c5-b576-1ecf4e7fc610 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] [instance: 8271a429-e252-42bb-8717-e89dfd9739bf] Took 6.99 seconds to build instance.
Nov 15 09:43:52 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-4e493a2a-0fa9-42c5-b576-1ecf4e7fc610 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Lock "8271a429-e252-42bb-8717-e89dfd9739bf" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.088s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:43:53 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:43:54 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:43:56 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:43:56 user nova-compute[75122]: DEBUG nova.compute.manager [req-20858d8c-9eb8-4b79-a379-0d6ec87c7da2 req-7d6576c0-f824-412c-940d-a0d8aa45b85e service nova] [instance: 6f6177c5-3048-4a78-b34a-e595d26d69d0] Received event network-changed-8f77c03f-9bb8-441c-97a9-19bb14a14d89 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:43:56 user nova-compute[75122]: DEBUG nova.compute.manager [req-20858d8c-9eb8-4b79-a379-0d6ec87c7da2 req-7d6576c0-f824-412c-940d-a0d8aa45b85e service nova] [instance: 6f6177c5-3048-4a78-b34a-e595d26d69d0] Refreshing instance network info cache due to event network-changed-8f77c03f-9bb8-441c-97a9-19bb14a14d89. {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 09:43:56 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-20858d8c-9eb8-4b79-a379-0d6ec87c7da2 req-7d6576c0-f824-412c-940d-a0d8aa45b85e service nova] Acquiring lock "refresh_cache-6f6177c5-3048-4a78-b34a-e595d26d69d0" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 09:43:56 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-20858d8c-9eb8-4b79-a379-0d6ec87c7da2 req-7d6576c0-f824-412c-940d-a0d8aa45b85e service nova] Acquired lock "refresh_cache-6f6177c5-3048-4a78-b34a-e595d26d69d0" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 09:43:56 user nova-compute[75122]: DEBUG nova.network.neutron [req-20858d8c-9eb8-4b79-a379-0d6ec87c7da2 req-7d6576c0-f824-412c-940d-a0d8aa45b85e service nova] [instance: 6f6177c5-3048-4a78-b34a-e595d26d69d0] Refreshing network info cache for port 8f77c03f-9bb8-441c-97a9-19bb14a14d89 {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 09:43:56 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-b1f8943c-acc0-4fd2-93e8-d46fc6d8af9c tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Acquiring lock "6f6177c5-3048-4a78-b34a-e595d26d69d0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:43:56 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-b1f8943c-acc0-4fd2-93e8-d46fc6d8af9c tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Lock "6f6177c5-3048-4a78-b34a-e595d26d69d0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:43:56 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-b1f8943c-acc0-4fd2-93e8-d46fc6d8af9c tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Acquiring lock "6f6177c5-3048-4a78-b34a-e595d26d69d0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:43:56 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-b1f8943c-acc0-4fd2-93e8-d46fc6d8af9c tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Lock "6f6177c5-3048-4a78-b34a-e595d26d69d0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:43:56 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-b1f8943c-acc0-4fd2-93e8-d46fc6d8af9c tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Lock "6f6177c5-3048-4a78-b34a-e595d26d69d0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:43:56 user nova-compute[75122]: INFO nova.compute.manager [None req-b1f8943c-acc0-4fd2-93e8-d46fc6d8af9c tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] [instance: 6f6177c5-3048-4a78-b34a-e595d26d69d0] Terminating instance
Nov 15 09:43:56 user nova-compute[75122]: DEBUG nova.compute.manager [None req-b1f8943c-acc0-4fd2-93e8-d46fc6d8af9c tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] [instance: 6f6177c5-3048-4a78-b34a-e595d26d69d0] Start destroying the instance on the hypervisor. {{(pid=75122) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 09:43:56 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:43:56 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:43:56 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:43:56 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:43:57 user nova-compute[75122]: DEBUG nova.compute.manager [req-0d2ae157-62b3-4644-8aef-9d71690cad8c req-eb642517-d957-4171-936a-e6a64ee67309 service nova] [instance: 6f6177c5-3048-4a78-b34a-e595d26d69d0] Received event network-vif-unplugged-8f77c03f-9bb8-441c-97a9-19bb14a14d89 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:43:57 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-0d2ae157-62b3-4644-8aef-9d71690cad8c req-eb642517-d957-4171-936a-e6a64ee67309 service nova] Acquiring lock "6f6177c5-3048-4a78-b34a-e595d26d69d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:43:57 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-0d2ae157-62b3-4644-8aef-9d71690cad8c req-eb642517-d957-4171-936a-e6a64ee67309 service nova] Lock "6f6177c5-3048-4a78-b34a-e595d26d69d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:43:57 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-0d2ae157-62b3-4644-8aef-9d71690cad8c req-eb642517-d957-4171-936a-e6a64ee67309 service nova] Lock "6f6177c5-3048-4a78-b34a-e595d26d69d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:43:57 user nova-compute[75122]: DEBUG nova.compute.manager [req-0d2ae157-62b3-4644-8aef-9d71690cad8c req-eb642517-d957-4171-936a-e6a64ee67309 service nova] [instance: 6f6177c5-3048-4a78-b34a-e595d26d69d0] No waiting events found dispatching network-vif-unplugged-8f77c03f-9bb8-441c-97a9-19bb14a14d89 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:43:57 user nova-compute[75122]: DEBUG nova.compute.manager [req-0d2ae157-62b3-4644-8aef-9d71690cad8c req-eb642517-d957-4171-936a-e6a64ee67309 service nova] [instance: 6f6177c5-3048-4a78-b34a-e595d26d69d0] Received event network-vif-unplugged-8f77c03f-9bb8-441c-97a9-19bb14a14d89 for instance with task_state deleting. {{(pid=75122) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 09:43:57 user nova-compute[75122]: DEBUG nova.network.neutron [req-20858d8c-9eb8-4b79-a379-0d6ec87c7da2 req-7d6576c0-f824-412c-940d-a0d8aa45b85e service nova] [instance: 6f6177c5-3048-4a78-b34a-e595d26d69d0] Updated VIF entry in instance network info cache for port 8f77c03f-9bb8-441c-97a9-19bb14a14d89. {{(pid=75122) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 09:43:57 user nova-compute[75122]: DEBUG nova.network.neutron [req-20858d8c-9eb8-4b79-a379-0d6ec87c7da2 req-7d6576c0-f824-412c-940d-a0d8aa45b85e service nova] [instance: 6f6177c5-3048-4a78-b34a-e595d26d69d0] Updating instance_info_cache with network_info: [{"id": "8f77c03f-9bb8-441c-97a9-19bb14a14d89", "address": "fa:16:3e:18:aa:27", "network": {"id": "387b4fc3-39ad-40c3-bcd7-7526b09e30b7", "bridge": "br-int", "label": "tempest-TestStampPattern-1501769990-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bdc0f52b1c744b91b4f1a4ecd07e07c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f77c03f-9b", "ovs_interfaceid": "8f77c03f-9bb8-441c-97a9-19bb14a14d89", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:43:57 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-20858d8c-9eb8-4b79-a379-0d6ec87c7da2 req-7d6576c0-f824-412c-940d-a0d8aa45b85e service nova] Releasing lock "refresh_cache-6f6177c5-3048-4a78-b34a-e595d26d69d0" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 09:43:57 user nova-compute[75122]: INFO nova.virt.libvirt.driver [-] [instance: 6f6177c5-3048-4a78-b34a-e595d26d69d0] Instance destroyed successfully.
Nov 15 09:43:57 user nova-compute[75122]: DEBUG nova.objects.instance [None req-b1f8943c-acc0-4fd2-93e8-d46fc6d8af9c tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Lazy-loading 'resources' on Instance uuid 6f6177c5-3048-4a78-b34a-e595d26d69d0 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:43:57 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-b1f8943c-acc0-4fd2-93e8-d46fc6d8af9c tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T09:41:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-293567681',display_name='tempest-TestStampPattern-server-293567681',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-293567681',id=26,image_ref='5874135a-1a9c-4554-adbd-8a21eca8d6ff',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLTuyc1m0Na8NQ5VH/Tfx2UBRmDQ41qC6ACQUu2KLBVZhr2oW2YpfUnFSSho5blcWwWbXMeGc1bLerwgE7lxS0HgCpcrAeG55ew3eBiC1wjNqqSI1GsVKLlgwinFMYycdQ==',key_name='tempest-TestStampPattern-625128858',keypairs=<?>,launch_index=0,launched_at=2023-11-15T09:41:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bdc0f52b1c744b91b4f1a4ecd07e07c1',ramdisk_id='',reservation_id='r-cdt58emf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='c2f45f49-0bca-4ae2-bc2a-eed293143489',image_min_disk='1',image_min_ram='0',image_owner_id='bdc0f52b1c744b91b4f1a4ecd07e07c1',image_owner_project_name='tempest-TestStampPattern-1896212913',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1896212913-project-member',image_user_id='15a69b87dd164c74af2fed014a3c5f37',owner_project_name='tempest-TestStampPattern-1896212913',owner_user_name='tempest-TestStampPattern-1896212913-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T09:41:13Z,user_data=None,user_id='15a69b87dd164c74af2fed014a3c5f37',uuid=6f6177c5-3048-4a78-b34a-e595d26d69d0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8f77c03f-9bb8-441c-97a9-19bb14a14d89", "address": "fa:16:3e:18:aa:27", "network": {"id": "387b4fc3-39ad-40c3-bcd7-7526b09e30b7", "bridge": "br-int", "label": "tempest-TestStampPattern-1501769990-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.48", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bdc0f52b1c744b91b4f1a4ecd07e07c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f77c03f-9b", "ovs_interfaceid": "8f77c03f-9bb8-441c-97a9-19bb14a14d89", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 09:43:57 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-b1f8943c-acc0-4fd2-93e8-d46fc6d8af9c tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Converting VIF {"id": "8f77c03f-9bb8-441c-97a9-19bb14a14d89", "address": "fa:16:3e:18:aa:27", "network": {"id": "387b4fc3-39ad-40c3-bcd7-7526b09e30b7", "bridge": "br-int", "label": "tempest-TestStampPattern-1501769990-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.48", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bdc0f52b1c744b91b4f1a4ecd07e07c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8f77c03f-9b", "ovs_interfaceid": "8f77c03f-9bb8-441c-97a9-19bb14a14d89", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 09:43:57 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-b1f8943c-acc0-4fd2-93e8-d46fc6d8af9c tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:18:aa:27,bridge_name='br-int',has_traffic_filtering=True,id=8f77c03f-9bb8-441c-97a9-19bb14a14d89,network=Network(387b4fc3-39ad-40c3-bcd7-7526b09e30b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f77c03f-9b') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 09:43:57 user nova-compute[75122]: DEBUG os_vif [None req-b1f8943c-acc0-4fd2-93e8-d46fc6d8af9c tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:18:aa:27,bridge_name='br-int',has_traffic_filtering=True,id=8f77c03f-9bb8-441c-97a9-19bb14a14d89,network=Network(387b4fc3-39ad-40c3-bcd7-7526b09e30b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f77c03f-9b') {{(pid=75122) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 09:43:57 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:43:57 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8f77c03f-9b, bridge=br-int, if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:43:57 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:43:57 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:43:57 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:43:57 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ff7ce761-5815-4ede-9f49-5f195ebda381) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:43:57 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:43:57 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:43:57 user nova-compute[75122]: INFO os_vif [None req-b1f8943c-acc0-4fd2-93e8-d46fc6d8af9c tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:18:aa:27,bridge_name='br-int',has_traffic_filtering=True,id=8f77c03f-9bb8-441c-97a9-19bb14a14d89,network=Network(387b4fc3-39ad-40c3-bcd7-7526b09e30b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8f77c03f-9b')
Nov 15 09:43:57 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-b1f8943c-acc0-4fd2-93e8-d46fc6d8af9c tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] [instance: 6f6177c5-3048-4a78-b34a-e595d26d69d0] Deleting instance files /opt/stack/data/nova/instances/6f6177c5-3048-4a78-b34a-e595d26d69d0_del
Nov 15 09:43:57 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-b1f8943c-acc0-4fd2-93e8-d46fc6d8af9c tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] [instance: 6f6177c5-3048-4a78-b34a-e595d26d69d0] Deletion of /opt/stack/data/nova/instances/6f6177c5-3048-4a78-b34a-e595d26d69d0_del complete
Nov 15 09:43:57 user nova-compute[75122]: INFO nova.compute.manager [None req-b1f8943c-acc0-4fd2-93e8-d46fc6d8af9c tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] [instance: 6f6177c5-3048-4a78-b34a-e595d26d69d0] Took 0.97 seconds to destroy the instance on the hypervisor.
Nov 15 09:43:57 user nova-compute[75122]: DEBUG oslo.service.loopingcall [None req-b1f8943c-acc0-4fd2-93e8-d46fc6d8af9c tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75122) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 09:43:57 user nova-compute[75122]: DEBUG nova.compute.manager [-] [instance: 6f6177c5-3048-4a78-b34a-e595d26d69d0] Deallocating network for instance {{(pid=75122) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 09:43:57 user nova-compute[75122]: DEBUG nova.network.neutron [-] [instance: 6f6177c5-3048-4a78-b34a-e595d26d69d0] deallocate_for_instance() {{(pid=75122) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 09:43:58 user nova-compute[75122]: DEBUG nova.network.neutron [-] [instance: 6f6177c5-3048-4a78-b34a-e595d26d69d0] Updating instance_info_cache with network_info: [] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:43:58 user nova-compute[75122]: INFO nova.compute.manager [-] [instance: 6f6177c5-3048-4a78-b34a-e595d26d69d0] Took 0.55 seconds to deallocate network for instance.
Nov 15 09:43:58 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-b1f8943c-acc0-4fd2-93e8-d46fc6d8af9c tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:43:58 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-b1f8943c-acc0-4fd2-93e8-d46fc6d8af9c tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:43:58 user nova-compute[75122]: DEBUG nova.compute.provider_tree [None req-b1f8943c-acc0-4fd2-93e8-d46fc6d8af9c tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Inventory has not changed in ProviderTree for provider: 69a3da65-47be-44c6-b67c-c692b58284ef {{(pid=75122) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 09:43:58 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-b1f8943c-acc0-4fd2-93e8-d46fc6d8af9c tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Inventory has not changed for provider 69a3da65-47be-44c6-b67c-c692b58284ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 09:43:58 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-b1f8943c-acc0-4fd2-93e8-d46fc6d8af9c tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.428s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:43:58 user nova-compute[75122]: INFO nova.scheduler.client.report [None req-b1f8943c-acc0-4fd2-93e8-d46fc6d8af9c tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Deleted allocations for instance 6f6177c5-3048-4a78-b34a-e595d26d69d0
Nov 15 09:43:58 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-b1f8943c-acc0-4fd2-93e8-d46fc6d8af9c tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Lock "6f6177c5-3048-4a78-b34a-e595d26d69d0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.183s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:43:59 user nova-compute[75122]: DEBUG nova.compute.manager [req-20fa842c-5b02-4c35-a197-76adee5060ed req-dfb175b2-f9a5-414f-aa34-9b50e165a17b service nova] [instance: 6f6177c5-3048-4a78-b34a-e595d26d69d0] Received event network-vif-plugged-8f77c03f-9bb8-441c-97a9-19bb14a14d89 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:43:59 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-20fa842c-5b02-4c35-a197-76adee5060ed req-dfb175b2-f9a5-414f-aa34-9b50e165a17b service nova] Acquiring lock "6f6177c5-3048-4a78-b34a-e595d26d69d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:43:59 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-20fa842c-5b02-4c35-a197-76adee5060ed req-dfb175b2-f9a5-414f-aa34-9b50e165a17b service nova] Lock "6f6177c5-3048-4a78-b34a-e595d26d69d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:43:59 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-20fa842c-5b02-4c35-a197-76adee5060ed req-dfb175b2-f9a5-414f-aa34-9b50e165a17b service nova] Lock "6f6177c5-3048-4a78-b34a-e595d26d69d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:43:59 user nova-compute[75122]: DEBUG nova.compute.manager [req-20fa842c-5b02-4c35-a197-76adee5060ed req-dfb175b2-f9a5-414f-aa34-9b50e165a17b service nova] [instance: 6f6177c5-3048-4a78-b34a-e595d26d69d0] No waiting events found dispatching network-vif-plugged-8f77c03f-9bb8-441c-97a9-19bb14a14d89 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:43:59 user nova-compute[75122]: WARNING nova.compute.manager [req-20fa842c-5b02-4c35-a197-76adee5060ed req-dfb175b2-f9a5-414f-aa34-9b50e165a17b service nova] [instance: 6f6177c5-3048-4a78-b34a-e595d26d69d0] Received unexpected event network-vif-plugged-8f77c03f-9bb8-441c-97a9-19bb14a14d89 for instance with vm_state deleted and task_state None.
Nov 15 09:43:59 user nova-compute[75122]: DEBUG nova.compute.manager [req-20fa842c-5b02-4c35-a197-76adee5060ed req-dfb175b2-f9a5-414f-aa34-9b50e165a17b service nova] [instance: 6f6177c5-3048-4a78-b34a-e595d26d69d0] Received event network-vif-deleted-8f77c03f-9bb8-441c-97a9-19bb14a14d89 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:44:01 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:44:02 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:44:03 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:44:06 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:44:07 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:44:07 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:44:08 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-e3a145e7-3aaf-4a44-b6cc-67f50f498fdd tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] Acquiring lock "52c066f3-dea1-4aa3-9da4-da9397b9fff1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:44:08 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-e3a145e7-3aaf-4a44-b6cc-67f50f498fdd tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] Lock "52c066f3-dea1-4aa3-9da4-da9397b9fff1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:44:08 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-e3a145e7-3aaf-4a44-b6cc-67f50f498fdd tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] Acquiring lock "52c066f3-dea1-4aa3-9da4-da9397b9fff1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:44:08 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-e3a145e7-3aaf-4a44-b6cc-67f50f498fdd tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] Lock "52c066f3-dea1-4aa3-9da4-da9397b9fff1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:44:08 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-e3a145e7-3aaf-4a44-b6cc-67f50f498fdd tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] Lock "52c066f3-dea1-4aa3-9da4-da9397b9fff1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:44:08 user nova-compute[75122]: INFO nova.compute.manager [None req-e3a145e7-3aaf-4a44-b6cc-67f50f498fdd tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] [instance: 52c066f3-dea1-4aa3-9da4-da9397b9fff1] Terminating instance
Nov 15 09:44:08 user nova-compute[75122]: DEBUG nova.compute.manager [None req-e3a145e7-3aaf-4a44-b6cc-67f50f498fdd tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] [instance: 52c066f3-dea1-4aa3-9da4-da9397b9fff1] Start destroying the instance on the hypervisor. {{(pid=75122) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 09:44:08 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:44:08 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:44:08 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:44:08 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:44:08 user nova-compute[75122]: DEBUG nova.compute.manager [req-dafc71dc-4f00-4bbe-9611-98998a634e75 req-58356a6a-904f-4e0a-98f2-411553d02353 service nova] [instance: 52c066f3-dea1-4aa3-9da4-da9397b9fff1] Received event network-vif-unplugged-57222fd9-53d9-4344-b5c7-1b77cb36fd65 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:44:08 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-dafc71dc-4f00-4bbe-9611-98998a634e75 req-58356a6a-904f-4e0a-98f2-411553d02353 service nova] Acquiring lock "52c066f3-dea1-4aa3-9da4-da9397b9fff1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:44:08 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-dafc71dc-4f00-4bbe-9611-98998a634e75 req-58356a6a-904f-4e0a-98f2-411553d02353 service nova] Lock "52c066f3-dea1-4aa3-9da4-da9397b9fff1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:44:08 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-dafc71dc-4f00-4bbe-9611-98998a634e75 req-58356a6a-904f-4e0a-98f2-411553d02353 service nova] Lock "52c066f3-dea1-4aa3-9da4-da9397b9fff1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:44:08 user nova-compute[75122]: DEBUG nova.compute.manager [req-dafc71dc-4f00-4bbe-9611-98998a634e75 req-58356a6a-904f-4e0a-98f2-411553d02353 service nova] [instance: 52c066f3-dea1-4aa3-9da4-da9397b9fff1] No waiting events found dispatching network-vif-unplugged-57222fd9-53d9-4344-b5c7-1b77cb36fd65 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:44:08 user nova-compute[75122]: DEBUG nova.compute.manager [req-dafc71dc-4f00-4bbe-9611-98998a634e75 req-58356a6a-904f-4e0a-98f2-411553d02353 service nova] [instance: 52c066f3-dea1-4aa3-9da4-da9397b9fff1] Received event network-vif-unplugged-57222fd9-53d9-4344-b5c7-1b77cb36fd65 for instance with task_state deleting. {{(pid=75122) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 09:44:09 user nova-compute[75122]: INFO nova.virt.libvirt.driver [-] [instance: 52c066f3-dea1-4aa3-9da4-da9397b9fff1] Instance destroyed successfully.
Nov 15 09:44:09 user nova-compute[75122]: DEBUG nova.objects.instance [None req-e3a145e7-3aaf-4a44-b6cc-67f50f498fdd tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] Lazy-loading 'resources' on Instance uuid 52c066f3-dea1-4aa3-9da4-da9397b9fff1 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:44:09 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-e3a145e7-3aaf-4a44-b6cc-67f50f498fdd tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T09:41:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1892172195',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1892172195',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1892172',id=27,image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPBUmT4sfkb1U+xbzFDHPS8xcVlJkOW5a4VHDucj2MH8kxD6Q4mYTszYeqlAJhLAbR/5hg60tDsQXwx7fLY5RewUgKp3CazqqDpmWsMwkuOk36oG+Yyotz+HvmkhgkebKw==',key_name='tempest-keypair-1437934740',keypairs=<?>,launch_index=0,launched_at=2023-11-15T09:41:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f1030239722241f5ae167b813b4fee15',ramdisk_id='',reservation_id='r-2dp92q16',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1710486673',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T09:41:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8956b45f936640e392df01f3262db471',uuid=52c066f3-dea1-4aa3-9da4-da9397b9fff1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "57222fd9-53d9-4344-b5c7-1b77cb36fd65", "address": "fa:16:3e:dd:19:1b", "network": {"id": "8510a5b3-69c9-4fd8-9f2c-c83a255474b5", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-535784436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1030239722241f5ae167b813b4fee15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57222fd9-53", "ovs_interfaceid": "57222fd9-53d9-4344-b5c7-1b77cb36fd65", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 09:44:09 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-e3a145e7-3aaf-4a44-b6cc-67f50f498fdd tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] Converting VIF {"id": "57222fd9-53d9-4344-b5c7-1b77cb36fd65", "address": "fa:16:3e:dd:19:1b", "network": {"id": "8510a5b3-69c9-4fd8-9f2c-c83a255474b5", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-535784436-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f1030239722241f5ae167b813b4fee15", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57222fd9-53", "ovs_interfaceid": "57222fd9-53d9-4344-b5c7-1b77cb36fd65", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 09:44:09 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-e3a145e7-3aaf-4a44-b6cc-67f50f498fdd tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:dd:19:1b,bridge_name='br-int',has_traffic_filtering=True,id=57222fd9-53d9-4344-b5c7-1b77cb36fd65,network=Network(8510a5b3-69c9-4fd8-9f2c-c83a255474b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57222fd9-53') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 09:44:09 user nova-compute[75122]: DEBUG os_vif [None req-e3a145e7-3aaf-4a44-b6cc-67f50f498fdd tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:dd:19:1b,bridge_name='br-int',has_traffic_filtering=True,id=57222fd9-53d9-4344-b5c7-1b77cb36fd65,network=Network(8510a5b3-69c9-4fd8-9f2c-c83a255474b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57222fd9-53') {{(pid=75122) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 09:44:09 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:44:09 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap57222fd9-53, bridge=br-int, if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:44:09 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:44:09 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:44:09 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:44:09 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2c41a8f4-21ee-40db-b93e-86b3a4253028) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:44:09 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:44:09 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:44:09 user nova-compute[75122]: INFO os_vif [None req-e3a145e7-3aaf-4a44-b6cc-67f50f498fdd tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:dd:19:1b,bridge_name='br-int',has_traffic_filtering=True,id=57222fd9-53d9-4344-b5c7-1b77cb36fd65,network=Network(8510a5b3-69c9-4fd8-9f2c-c83a255474b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57222fd9-53')
Nov 15 09:44:09 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-e3a145e7-3aaf-4a44-b6cc-67f50f498fdd tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] [instance: 52c066f3-dea1-4aa3-9da4-da9397b9fff1] Deleting instance files /opt/stack/data/nova/instances/52c066f3-dea1-4aa3-9da4-da9397b9fff1_del
Nov 15 09:44:09 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-e3a145e7-3aaf-4a44-b6cc-67f50f498fdd tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] [instance: 52c066f3-dea1-4aa3-9da4-da9397b9fff1] Deletion of /opt/stack/data/nova/instances/52c066f3-dea1-4aa3-9da4-da9397b9fff1_del complete
Nov 15 09:44:09 user nova-compute[75122]: INFO nova.compute.manager [None req-e3a145e7-3aaf-4a44-b6cc-67f50f498fdd tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] [instance: 52c066f3-dea1-4aa3-9da4-da9397b9fff1] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 15 09:44:09 user nova-compute[75122]: DEBUG oslo.service.loopingcall [None req-e3a145e7-3aaf-4a44-b6cc-67f50f498fdd tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75122) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 09:44:09 user nova-compute[75122]: DEBUG nova.compute.manager [-] [instance: 52c066f3-dea1-4aa3-9da4-da9397b9fff1] Deallocating network for instance {{(pid=75122) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 09:44:09 user nova-compute[75122]: DEBUG nova.network.neutron [-] [instance: 52c066f3-dea1-4aa3-9da4-da9397b9fff1] deallocate_for_instance() {{(pid=75122) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 09:44:10 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:44:10 user nova-compute[75122]: DEBUG nova.network.neutron [-] [instance: 52c066f3-dea1-4aa3-9da4-da9397b9fff1] Updating instance_info_cache with network_info: [] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:44:10 user nova-compute[75122]: INFO nova.compute.manager [-] [instance: 52c066f3-dea1-4aa3-9da4-da9397b9fff1] Took 1.45 seconds to deallocate network for instance.
Nov 15 09:44:10 user nova-compute[75122]: DEBUG nova.compute.manager [req-19e644f3-4938-42f8-abc0-9fc18c826f53 req-733f7d45-cb0c-4f8a-b97b-bb8677873296 service nova] [instance: 52c066f3-dea1-4aa3-9da4-da9397b9fff1] Received event network-vif-plugged-57222fd9-53d9-4344-b5c7-1b77cb36fd65 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:44:10 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-19e644f3-4938-42f8-abc0-9fc18c826f53 req-733f7d45-cb0c-4f8a-b97b-bb8677873296 service nova] Acquiring lock "52c066f3-dea1-4aa3-9da4-da9397b9fff1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:44:10 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-19e644f3-4938-42f8-abc0-9fc18c826f53 req-733f7d45-cb0c-4f8a-b97b-bb8677873296 service nova] Lock "52c066f3-dea1-4aa3-9da4-da9397b9fff1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:44:10 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-19e644f3-4938-42f8-abc0-9fc18c826f53 req-733f7d45-cb0c-4f8a-b97b-bb8677873296 service nova] Lock "52c066f3-dea1-4aa3-9da4-da9397b9fff1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:44:10 user nova-compute[75122]: DEBUG nova.compute.manager [req-19e644f3-4938-42f8-abc0-9fc18c826f53 req-733f7d45-cb0c-4f8a-b97b-bb8677873296 service nova] [instance: 52c066f3-dea1-4aa3-9da4-da9397b9fff1] No waiting events found dispatching network-vif-plugged-57222fd9-53d9-4344-b5c7-1b77cb36fd65 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:44:10 user nova-compute[75122]: WARNING nova.compute.manager [req-19e644f3-4938-42f8-abc0-9fc18c826f53 req-733f7d45-cb0c-4f8a-b97b-bb8677873296 service nova] [instance: 52c066f3-dea1-4aa3-9da4-da9397b9fff1] Received unexpected event network-vif-plugged-57222fd9-53d9-4344-b5c7-1b77cb36fd65 for instance with vm_state active and task_state deleting.
Nov 15 09:44:10 user nova-compute[75122]: DEBUG nova.compute.manager [req-19e644f3-4938-42f8-abc0-9fc18c826f53 req-733f7d45-cb0c-4f8a-b97b-bb8677873296 service nova] [instance: 52c066f3-dea1-4aa3-9da4-da9397b9fff1] Received event network-vif-deleted-57222fd9-53d9-4344-b5c7-1b77cb36fd65 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:44:10 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-e3a145e7-3aaf-4a44-b6cc-67f50f498fdd tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:44:10 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-e3a145e7-3aaf-4a44-b6cc-67f50f498fdd tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:44:10 user nova-compute[75122]: DEBUG nova.compute.provider_tree [None req-e3a145e7-3aaf-4a44-b6cc-67f50f498fdd tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] Inventory has not changed in ProviderTree for provider: 69a3da65-47be-44c6-b67c-c692b58284ef {{(pid=75122) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 09:44:10 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-e3a145e7-3aaf-4a44-b6cc-67f50f498fdd tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] Inventory has not changed for provider 69a3da65-47be-44c6-b67c-c692b58284ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 09:44:10 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-e3a145e7-3aaf-4a44-b6cc-67f50f498fdd tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.307s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:44:11 user nova-compute[75122]: INFO nova.scheduler.client.report [None req-e3a145e7-3aaf-4a44-b6cc-67f50f498fdd tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] Deleted allocations for instance 52c066f3-dea1-4aa3-9da4-da9397b9fff1
Nov 15 09:44:11 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-e3a145e7-3aaf-4a44-b6cc-67f50f498fdd tempest-TestServerVolumeAttachScenarioOldVersion-1710486673 tempest-TestServerVolumeAttachScenarioOldVersion-1710486673-project-member] Lock "52c066f3-dea1-4aa3-9da4-da9397b9fff1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.823s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:44:11 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:44:14 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:44:15 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bb4138b-53d8-4269-8781-c785097baa95 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Acquiring lock "49154de0-f941-4ae0-a7af-72e75a4d8040" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:44:15 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bb4138b-53d8-4269-8781-c785097baa95 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Lock "49154de0-f941-4ae0-a7af-72e75a4d8040" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:44:15 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bb4138b-53d8-4269-8781-c785097baa95 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] [instance: 49154de0-f941-4ae0-a7af-72e75a4d8040] Starting instance... {{(pid=75122) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 09:44:15 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bb4138b-53d8-4269-8781-c785097baa95 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:44:15 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bb4138b-53d8-4269-8781-c785097baa95 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:44:15 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-0bb4138b-53d8-4269-8781-c785097baa95 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75122) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 09:44:15 user nova-compute[75122]: INFO nova.compute.claims [None req-0bb4138b-53d8-4269-8781-c785097baa95 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] [instance: 49154de0-f941-4ae0-a7af-72e75a4d8040] Claim successful on node user
Nov 15 09:44:15 user nova-compute[75122]: DEBUG nova.compute.provider_tree [None req-0bb4138b-53d8-4269-8781-c785097baa95 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Inventory has not changed in ProviderTree for provider: 69a3da65-47be-44c6-b67c-c692b58284ef {{(pid=75122) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 09:44:15 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-0bb4138b-53d8-4269-8781-c785097baa95 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Inventory has not changed for provider 69a3da65-47be-44c6-b67c-c692b58284ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 09:44:15 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bb4138b-53d8-4269-8781-c785097baa95 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.380s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:44:15 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bb4138b-53d8-4269-8781-c785097baa95 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] [instance: 49154de0-f941-4ae0-a7af-72e75a4d8040] Start building networks asynchronously for instance. {{(pid=75122) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 09:44:15 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bb4138b-53d8-4269-8781-c785097baa95 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] [instance: 49154de0-f941-4ae0-a7af-72e75a4d8040] Allocating IP information in the background. {{(pid=75122) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 09:44:15 user nova-compute[75122]: DEBUG nova.network.neutron [None req-0bb4138b-53d8-4269-8781-c785097baa95 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] [instance: 49154de0-f941-4ae0-a7af-72e75a4d8040] allocate_for_instance() {{(pid=75122) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 09:44:15 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-0bb4138b-53d8-4269-8781-c785097baa95 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] [instance: 49154de0-f941-4ae0-a7af-72e75a4d8040] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 09:44:15 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bb4138b-53d8-4269-8781-c785097baa95 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] [instance: 49154de0-f941-4ae0-a7af-72e75a4d8040] Start building block device mappings for instance. {{(pid=75122) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 09:44:15 user nova-compute[75122]: DEBUG nova.policy [None req-0bb4138b-53d8-4269-8781-c785097baa95 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3fa3032cbc2a4908aa49e892902aea7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d6a287ccfe04bfebdf80d827d49ce51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75122) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 09:44:15 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bb4138b-53d8-4269-8781-c785097baa95 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] [instance: 49154de0-f941-4ae0-a7af-72e75a4d8040] Start spawning the instance on the hypervisor. {{(pid=75122) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 09:44:15 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-0bb4138b-53d8-4269-8781-c785097baa95 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] [instance: 49154de0-f941-4ae0-a7af-72e75a4d8040] Creating instance directory {{(pid=75122) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 09:44:15 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-0bb4138b-53d8-4269-8781-c785097baa95 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] [instance: 49154de0-f941-4ae0-a7af-72e75a4d8040] Creating image(s)
Nov 15 09:44:15 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bb4138b-53d8-4269-8781-c785097baa95 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Acquiring lock "/opt/stack/data/nova/instances/49154de0-f941-4ae0-a7af-72e75a4d8040/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:44:15 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bb4138b-53d8-4269-8781-c785097baa95 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Lock "/opt/stack/data/nova/instances/49154de0-f941-4ae0-a7af-72e75a4d8040/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:44:15 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bb4138b-53d8-4269-8781-c785097baa95 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Lock "/opt/stack/data/nova/instances/49154de0-f941-4ae0-a7af-72e75a4d8040/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:44:15 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bb4138b-53d8-4269-8781-c785097baa95 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:44:15 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bb4138b-53d8-4269-8781-c785097baa95 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json" returned: 0 in 0.180s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:44:15 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bb4138b-53d8-4269-8781-c785097baa95 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Acquiring lock "95d6e29f74d5408f818e32f3bc29bc8270a4c665" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:44:15 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bb4138b-53d8-4269-8781-c785097baa95 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Lock "95d6e29f74d5408f818e32f3bc29bc8270a4c665" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:44:15 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bb4138b-53d8-4269-8781-c785097baa95 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:44:16 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-d8416745-a388-407f-abb5-5a7d944e324b tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Acquiring lock "a1121448-8452-4955-8112-7b984921dac6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:44:16 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-d8416745-a388-407f-abb5-5a7d944e324b tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Lock "a1121448-8452-4955-8112-7b984921dac6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:44:16 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bb4138b-53d8-4269-8781-c785097baa95 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json" returned: 0 in 0.184s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:44:16 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bb4138b-53d8-4269-8781-c785097baa95 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665,backing_fmt=raw /opt/stack/data/nova/instances/49154de0-f941-4ae0-a7af-72e75a4d8040/disk 1073741824 {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:44:16 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:44:16 user nova-compute[75122]: DEBUG nova.compute.manager [None req-d8416745-a388-407f-abb5-5a7d944e324b tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] [instance: a1121448-8452-4955-8112-7b984921dac6] Starting instance... {{(pid=75122) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 09:44:16 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bb4138b-53d8-4269-8781-c785097baa95 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665,backing_fmt=raw /opt/stack/data/nova/instances/49154de0-f941-4ae0-a7af-72e75a4d8040/disk 1073741824" returned: 0 in 0.062s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:44:16 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bb4138b-53d8-4269-8781-c785097baa95 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Lock "95d6e29f74d5408f818e32f3bc29bc8270a4c665" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.249s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:44:16 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bb4138b-53d8-4269-8781-c785097baa95 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:44:16 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-d8416745-a388-407f-abb5-5a7d944e324b tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:44:16 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-d8416745-a388-407f-abb5-5a7d944e324b tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:44:16 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-d8416745-a388-407f-abb5-5a7d944e324b tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75122) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 09:44:16 user nova-compute[75122]: INFO nova.compute.claims [None req-d8416745-a388-407f-abb5-5a7d944e324b tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] [instance: a1121448-8452-4955-8112-7b984921dac6] Claim successful on node user
Nov 15 09:44:16 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bb4138b-53d8-4269-8781-c785097baa95 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json" returned: 0 in 0.196s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:44:16 user nova-compute[75122]: DEBUG nova.virt.disk.api [None req-0bb4138b-53d8-4269-8781-c785097baa95 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Checking if we can resize image /opt/stack/data/nova/instances/49154de0-f941-4ae0-a7af-72e75a4d8040/disk. size=1073741824 {{(pid=75122) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 09:44:16 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bb4138b-53d8-4269-8781-c785097baa95 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49154de0-f941-4ae0-a7af-72e75a4d8040/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:44:16 user nova-compute[75122]: DEBUG nova.network.neutron [None req-0bb4138b-53d8-4269-8781-c785097baa95 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] [instance: 49154de0-f941-4ae0-a7af-72e75a4d8040] Successfully created port: 62759685-70a8-44fe-9a6c-36ec4cd002a2 {{(pid=75122) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 09:44:16 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bb4138b-53d8-4269-8781-c785097baa95 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49154de0-f941-4ae0-a7af-72e75a4d8040/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:44:16 user nova-compute[75122]: DEBUG nova.virt.disk.api [None req-0bb4138b-53d8-4269-8781-c785097baa95 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Cannot resize image /opt/stack/data/nova/instances/49154de0-f941-4ae0-a7af-72e75a4d8040/disk to a smaller size. {{(pid=75122) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 09:44:16 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-0bb4138b-53d8-4269-8781-c785097baa95 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] [instance: 49154de0-f941-4ae0-a7af-72e75a4d8040] Created local disks {{(pid=75122) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 09:44:16 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-0bb4138b-53d8-4269-8781-c785097baa95 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] [instance: 49154de0-f941-4ae0-a7af-72e75a4d8040] Ensure instance console log exists: /opt/stack/data/nova/instances/49154de0-f941-4ae0-a7af-72e75a4d8040/console.log {{(pid=75122) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 09:44:16 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bb4138b-53d8-4269-8781-c785097baa95 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:44:16 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bb4138b-53d8-4269-8781-c785097baa95 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:44:16 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bb4138b-53d8-4269-8781-c785097baa95 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:44:16 user nova-compute[75122]: DEBUG nova.compute.provider_tree [None req-d8416745-a388-407f-abb5-5a7d944e324b tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Inventory has not changed in ProviderTree for provider: 69a3da65-47be-44c6-b67c-c692b58284ef {{(pid=75122) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 09:44:16 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-d8416745-a388-407f-abb5-5a7d944e324b tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Inventory has not changed for provider 69a3da65-47be-44c6-b67c-c692b58284ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 09:44:16 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-d8416745-a388-407f-abb5-5a7d944e324b tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.436s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:44:16 user nova-compute[75122]: DEBUG nova.compute.manager [None req-d8416745-a388-407f-abb5-5a7d944e324b tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] [instance: a1121448-8452-4955-8112-7b984921dac6] Start building networks asynchronously for instance. {{(pid=75122) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 09:44:16 user nova-compute[75122]: DEBUG nova.compute.manager [None req-d8416745-a388-407f-abb5-5a7d944e324b tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] [instance: a1121448-8452-4955-8112-7b984921dac6] Allocating IP information in the background. {{(pid=75122) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 09:44:16 user nova-compute[75122]: DEBUG nova.network.neutron [None req-d8416745-a388-407f-abb5-5a7d944e324b tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] [instance: a1121448-8452-4955-8112-7b984921dac6] allocate_for_instance() {{(pid=75122) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 09:44:16 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-d8416745-a388-407f-abb5-5a7d944e324b tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] [instance: a1121448-8452-4955-8112-7b984921dac6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 09:44:16 user nova-compute[75122]: DEBUG nova.compute.manager [None req-d8416745-a388-407f-abb5-5a7d944e324b tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] [instance: a1121448-8452-4955-8112-7b984921dac6] Start building block device mappings for instance. {{(pid=75122) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 09:44:16 user nova-compute[75122]: DEBUG nova.policy [None req-d8416745-a388-407f-abb5-5a7d944e324b tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd52d39a644924944be943a3200bd5b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f29cd64a8a674d73936b8a0c90bf2d34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75122) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 09:44:16 user nova-compute[75122]: DEBUG nova.compute.manager [None req-d8416745-a388-407f-abb5-5a7d944e324b tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] [instance: a1121448-8452-4955-8112-7b984921dac6] Start spawning the instance on the hypervisor. {{(pid=75122) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 09:44:16 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-d8416745-a388-407f-abb5-5a7d944e324b tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] [instance: a1121448-8452-4955-8112-7b984921dac6] Creating instance directory {{(pid=75122) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 09:44:16 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-d8416745-a388-407f-abb5-5a7d944e324b tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] [instance: a1121448-8452-4955-8112-7b984921dac6] Creating image(s)
Nov 15 09:44:16 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-d8416745-a388-407f-abb5-5a7d944e324b tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Acquiring lock "/opt/stack/data/nova/instances/a1121448-8452-4955-8112-7b984921dac6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:44:16 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-d8416745-a388-407f-abb5-5a7d944e324b tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Lock "/opt/stack/data/nova/instances/a1121448-8452-4955-8112-7b984921dac6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:44:16 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-d8416745-a388-407f-abb5-5a7d944e324b tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Lock "/opt/stack/data/nova/instances/a1121448-8452-4955-8112-7b984921dac6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:44:16 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-d8416745-a388-407f-abb5-5a7d944e324b tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:44:17 user nova-compute[75122]: DEBUG nova.network.neutron [None req-0bb4138b-53d8-4269-8781-c785097baa95 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] [instance: 49154de0-f941-4ae0-a7af-72e75a4d8040] Successfully updated port: 62759685-70a8-44fe-9a6c-36ec4cd002a2 {{(pid=75122) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 09:44:17 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bb4138b-53d8-4269-8781-c785097baa95 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Acquiring lock "refresh_cache-49154de0-f941-4ae0-a7af-72e75a4d8040" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 09:44:17 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bb4138b-53d8-4269-8781-c785097baa95 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Acquired lock "refresh_cache-49154de0-f941-4ae0-a7af-72e75a4d8040" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 09:44:17 user nova-compute[75122]: DEBUG nova.network.neutron [None req-0bb4138b-53d8-4269-8781-c785097baa95 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] [instance: 49154de0-f941-4ae0-a7af-72e75a4d8040] Building network info cache for instance {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 09:44:17 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-d8416745-a388-407f-abb5-5a7d944e324b tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json" returned: 0 in 0.175s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:44:17 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-d8416745-a388-407f-abb5-5a7d944e324b tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Acquiring lock "95d6e29f74d5408f818e32f3bc29bc8270a4c665" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:44:17 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-d8416745-a388-407f-abb5-5a7d944e324b tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Lock "95d6e29f74d5408f818e32f3bc29bc8270a4c665" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:44:17 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-d8416745-a388-407f-abb5-5a7d944e324b tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:44:17 user nova-compute[75122]: DEBUG nova.compute.manager [req-9c08a6b3-559c-4088-9034-eb56c0cdfc50 req-c3265176-2340-400f-984a-7ea444e1aaeb service nova] [instance: 49154de0-f941-4ae0-a7af-72e75a4d8040] Received event network-changed-62759685-70a8-44fe-9a6c-36ec4cd002a2 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:44:17 user nova-compute[75122]: DEBUG nova.compute.manager [req-9c08a6b3-559c-4088-9034-eb56c0cdfc50 req-c3265176-2340-400f-984a-7ea444e1aaeb service nova] [instance: 49154de0-f941-4ae0-a7af-72e75a4d8040] Refreshing instance network info cache due to event network-changed-62759685-70a8-44fe-9a6c-36ec4cd002a2. {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 09:44:17 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-9c08a6b3-559c-4088-9034-eb56c0cdfc50 req-c3265176-2340-400f-984a-7ea444e1aaeb service nova] Acquiring lock "refresh_cache-49154de0-f941-4ae0-a7af-72e75a4d8040" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 09:44:17 user nova-compute[75122]: DEBUG nova.network.neutron [None req-0bb4138b-53d8-4269-8781-c785097baa95 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] [instance: 49154de0-f941-4ae0-a7af-72e75a4d8040] Instance cache missing network info. {{(pid=75122) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 09:44:17 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-d8416745-a388-407f-abb5-5a7d944e324b tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json" returned: 0 in 0.172s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:44:17 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-d8416745-a388-407f-abb5-5a7d944e324b tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665,backing_fmt=raw /opt/stack/data/nova/instances/a1121448-8452-4955-8112-7b984921dac6/disk 1073741824 {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:44:17 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-d8416745-a388-407f-abb5-5a7d944e324b tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665,backing_fmt=raw /opt/stack/data/nova/instances/a1121448-8452-4955-8112-7b984921dac6/disk 1073741824" returned: 0 in 0.053s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:44:17 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-d8416745-a388-407f-abb5-5a7d944e324b tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Lock "95d6e29f74d5408f818e32f3bc29bc8270a4c665" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.229s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:44:17 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-d8416745-a388-407f-abb5-5a7d944e324b tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:44:17 user nova-compute[75122]: DEBUG nova.network.neutron [None req-0bb4138b-53d8-4269-8781-c785097baa95 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] [instance: 49154de0-f941-4ae0-a7af-72e75a4d8040] Updating instance_info_cache with network_info: [{"id": "62759685-70a8-44fe-9a6c-36ec4cd002a2", "address": "fa:16:3e:9a:6e:b1", "network": {"id": "b5966731-865f-495c-9cea-07c563eb13a3", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-641799461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d6a287ccfe04bfebdf80d827d49ce51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62759685-70", "ovs_interfaceid": "62759685-70a8-44fe-9a6c-36ec4cd002a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:44:17 user nova-compute[75122]: DEBUG nova.network.neutron [None req-d8416745-a388-407f-abb5-5a7d944e324b tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] [instance: a1121448-8452-4955-8112-7b984921dac6] Successfully created port: 9d82266f-3fa1-4cc5-994d-4a55b8a77f6f {{(pid=75122) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 09:44:17 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bb4138b-53d8-4269-8781-c785097baa95 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Releasing lock "refresh_cache-49154de0-f941-4ae0-a7af-72e75a4d8040" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 09:44:17 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bb4138b-53d8-4269-8781-c785097baa95 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] [instance: 49154de0-f941-4ae0-a7af-72e75a4d8040] Instance network_info: |[{"id": "62759685-70a8-44fe-9a6c-36ec4cd002a2", "address": "fa:16:3e:9a:6e:b1", "network": {"id": "b5966731-865f-495c-9cea-07c563eb13a3", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-641799461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d6a287ccfe04bfebdf80d827d49ce51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62759685-70", "ovs_interfaceid": "62759685-70a8-44fe-9a6c-36ec4cd002a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75122) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 09:44:17 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-9c08a6b3-559c-4088-9034-eb56c0cdfc50 req-c3265176-2340-400f-984a-7ea444e1aaeb service nova] Acquired lock "refresh_cache-49154de0-f941-4ae0-a7af-72e75a4d8040" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 09:44:17 user nova-compute[75122]: DEBUG nova.network.neutron [req-9c08a6b3-559c-4088-9034-eb56c0cdfc50 req-c3265176-2340-400f-984a-7ea444e1aaeb service nova] [instance: 49154de0-f941-4ae0-a7af-72e75a4d8040] Refreshing network info cache for port 62759685-70a8-44fe-9a6c-36ec4cd002a2 {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 09:44:17 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-0bb4138b-53d8-4269-8781-c785097baa95 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] [instance: 49154de0-f941-4ae0-a7af-72e75a4d8040] Start _get_guest_xml network_info=[{"id": "62759685-70a8-44fe-9a6c-36ec4cd002a2", "address": "fa:16:3e:9a:6e:b1", "network": {"id": "b5966731-865f-495c-9cea-07c563eb13a3", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-641799461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d6a287ccfe04bfebdf80d827d49ce51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62759685-70", "ovs_interfaceid": "62759685-70a8-44fe-9a6c-36ec4cd002a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T09:26:31Z,direct_url=<?>,disk_format='qcow2',id=5e862cfe-47b8-4725-8292-65761ee6d0f5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9c57733cb41847c0b4ad31519c382e5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T09:26:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '5e862cfe-47b8-4725-8292-65761ee6d0f5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75122) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 09:44:17 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-0bb4138b-53d8-4269-8781-c785097baa95 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 09:44:17 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-0bb4138b-53d8-4269-8781-c785097baa95 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 09:44:17 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-0bb4138b-53d8-4269-8781-c785097baa95 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75122) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 09:44:17 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-0bb4138b-53d8-4269-8781-c785097baa95 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] CPU controller missing on host. {{(pid=75122) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 09:44:17 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-0bb4138b-53d8-4269-8781-c785097baa95 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75122) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 09:44:17 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-0bb4138b-53d8-4269-8781-c785097baa95 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] CPU controller found on host. {{(pid=75122) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 09:44:17 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-0bb4138b-53d8-4269-8781-c785097baa95 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75122) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 09:44:17 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-0bb4138b-53d8-4269-8781-c785097baa95 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T09:26:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T09:26:31Z,direct_url=<?>,disk_format='qcow2',id=5e862cfe-47b8-4725-8292-65761ee6d0f5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9c57733cb41847c0b4ad31519c382e5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T09:26:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 09:44:17 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-0bb4138b-53d8-4269-8781-c785097baa95 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Flavor limits 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 09:44:17 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-0bb4138b-53d8-4269-8781-c785097baa95 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Image limits 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 09:44:17 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-0bb4138b-53d8-4269-8781-c785097baa95 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Flavor pref 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 09:44:17 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-0bb4138b-53d8-4269-8781-c785097baa95 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Image pref 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 09:44:17 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-0bb4138b-53d8-4269-8781-c785097baa95 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 09:44:17 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-0bb4138b-53d8-4269-8781-c785097baa95 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 09:44:17 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-0bb4138b-53d8-4269-8781-c785097baa95 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75122) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 09:44:17 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-0bb4138b-53d8-4269-8781-c785097baa95 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Got 1 possible topologies {{(pid=75122) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 09:44:17 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-0bb4138b-53d8-4269-8781-c785097baa95 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 09:44:17 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-0bb4138b-53d8-4269-8781-c785097baa95 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 09:44:17 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-0bb4138b-53d8-4269-8781-c785097baa95 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T09:44:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-802765665',display_name='tempest-SnapshotDataIntegrityTests-server-802765665',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-802765665',id=31,image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDBws3y/Y+ZKzpTaU/1XgxasWjP4ywtJmaWbA4DcNGJF0dgszKP9QWfPd9yyGhz7pscnOnOlFJ99t3aPJUjLrqueGLy2tS0slfA/bB82t48OW8+GJhn7why+5POQJUupKA==',key_name='tempest-keypair-1296118645',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1d6a287ccfe04bfebdf80d827d49ce51',ramdisk_id='',reservation_id='r-edy0sb1p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1604224312',owner_user_name='tempest-SnapshotDataIntegrityTests-1604224312-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T09:44:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3fa3032cbc2a4908aa49e892902aea7d',uuid=49154de0-f941-4ae0-a7af-72e75a4d8040,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "62759685-70a8-44fe-9a6c-36ec4cd002a2", "address": "fa:16:3e:9a:6e:b1", "network": {"id": "b5966731-865f-495c-9cea-07c563eb13a3", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-641799461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d6a287ccfe04bfebdf80d827d49ce51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62759685-70", "ovs_interfaceid": "62759685-70a8-44fe-9a6c-36ec4cd002a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75122) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 09:44:17 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-0bb4138b-53d8-4269-8781-c785097baa95 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Converting VIF {"id": "62759685-70a8-44fe-9a6c-36ec4cd002a2", "address": "fa:16:3e:9a:6e:b1", "network": {"id": "b5966731-865f-495c-9cea-07c563eb13a3", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-641799461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d6a287ccfe04bfebdf80d827d49ce51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62759685-70", "ovs_interfaceid": "62759685-70a8-44fe-9a6c-36ec4cd002a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 09:44:17 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-0bb4138b-53d8-4269-8781-c785097baa95 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:6e:b1,bridge_name='br-int',has_traffic_filtering=True,id=62759685-70a8-44fe-9a6c-36ec4cd002a2,network=Network(b5966731-865f-495c-9cea-07c563eb13a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62759685-70') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 09:44:17 user nova-compute[75122]: DEBUG nova.objects.instance [None req-0bb4138b-53d8-4269-8781-c785097baa95 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Lazy-loading 'pci_devices' on Instance uuid 49154de0-f941-4ae0-a7af-72e75a4d8040 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:44:17 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-d8416745-a388-407f-abb5-5a7d944e324b tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json" returned: 0 in 0.212s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:44:17 user nova-compute[75122]: DEBUG nova.virt.disk.api [None req-d8416745-a388-407f-abb5-5a7d944e324b tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a1121448-8452-4955-8112-7b984921dac6/disk. size=1073741824 {{(pid=75122) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 09:44:17 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-d8416745-a388-407f-abb5-5a7d944e324b tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1121448-8452-4955-8112-7b984921dac6/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:44:17 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-0bb4138b-53d8-4269-8781-c785097baa95 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] [instance: 49154de0-f941-4ae0-a7af-72e75a4d8040] End _get_guest_xml xml=<domain type="kvm">
Nov 15 09:44:17 user nova-compute[75122]:   <uuid>49154de0-f941-4ae0-a7af-72e75a4d8040</uuid>
Nov 15 09:44:17 user nova-compute[75122]:   <name>instance-0000001f</name>
Nov 15 09:44:17 user nova-compute[75122]:   <memory>524288</memory>
Nov 15 09:44:17 user nova-compute[75122]:   <vcpu>1</vcpu>
Nov 15 09:44:17 user nova-compute[75122]:   <metadata>
Nov 15 09:44:17 user nova-compute[75122]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 09:44:17 user nova-compute[75122]:       <nova:package version="0.0.0"/>
Nov 15 09:44:17 user nova-compute[75122]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-802765665</nova:name>
Nov 15 09:44:17 user nova-compute[75122]:       <nova:creationTime>2023-11-15 09:44:17</nova:creationTime>
Nov 15 09:44:17 user nova-compute[75122]:       <nova:flavor name="m1.tiny">
Nov 15 09:44:17 user nova-compute[75122]:         <nova:memory>512</nova:memory>
Nov 15 09:44:17 user nova-compute[75122]:         <nova:disk>1</nova:disk>
Nov 15 09:44:17 user nova-compute[75122]:         <nova:swap>0</nova:swap>
Nov 15 09:44:17 user nova-compute[75122]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 09:44:17 user nova-compute[75122]:         <nova:vcpus>1</nova:vcpus>
Nov 15 09:44:17 user nova-compute[75122]:       </nova:flavor>
Nov 15 09:44:17 user nova-compute[75122]:       <nova:owner>
Nov 15 09:44:17 user nova-compute[75122]:         <nova:user uuid="3fa3032cbc2a4908aa49e892902aea7d">tempest-SnapshotDataIntegrityTests-1604224312-project-member</nova:user>
Nov 15 09:44:17 user nova-compute[75122]:         <nova:project uuid="1d6a287ccfe04bfebdf80d827d49ce51">tempest-SnapshotDataIntegrityTests-1604224312</nova:project>
Nov 15 09:44:17 user nova-compute[75122]:       </nova:owner>
Nov 15 09:44:17 user nova-compute[75122]:       <nova:root type="image" uuid="5e862cfe-47b8-4725-8292-65761ee6d0f5"/>
Nov 15 09:44:17 user nova-compute[75122]:       <nova:ports>
Nov 15 09:44:17 user nova-compute[75122]:         <nova:port uuid="62759685-70a8-44fe-9a6c-36ec4cd002a2">
Nov 15 09:44:17 user nova-compute[75122]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 15 09:44:17 user nova-compute[75122]:         </nova:port>
Nov 15 09:44:17 user nova-compute[75122]:       </nova:ports>
Nov 15 09:44:17 user nova-compute[75122]:     </nova:instance>
Nov 15 09:44:17 user nova-compute[75122]:   </metadata>
Nov 15 09:44:17 user nova-compute[75122]:   <sysinfo type="smbios">
Nov 15 09:44:17 user nova-compute[75122]:     <system>
Nov 15 09:44:17 user nova-compute[75122]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 09:44:17 user nova-compute[75122]:       <entry name="product">OpenStack Nova</entry>
Nov 15 09:44:17 user nova-compute[75122]:       <entry name="version">0.0.0</entry>
Nov 15 09:44:17 user nova-compute[75122]:       <entry name="serial">49154de0-f941-4ae0-a7af-72e75a4d8040</entry>
Nov 15 09:44:17 user nova-compute[75122]:       <entry name="uuid">49154de0-f941-4ae0-a7af-72e75a4d8040</entry>
Nov 15 09:44:17 user nova-compute[75122]:       <entry name="family">Virtual Machine</entry>
Nov 15 09:44:17 user nova-compute[75122]:     </system>
Nov 15 09:44:17 user nova-compute[75122]:   </sysinfo>
Nov 15 09:44:17 user nova-compute[75122]:   <os>
Nov 15 09:44:17 user nova-compute[75122]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 09:44:17 user nova-compute[75122]:     <boot dev="hd"/>
Nov 15 09:44:17 user nova-compute[75122]:     <smbios mode="sysinfo"/>
Nov 15 09:44:17 user nova-compute[75122]:   </os>
Nov 15 09:44:17 user nova-compute[75122]:   <features>
Nov 15 09:44:17 user nova-compute[75122]:     <acpi/>
Nov 15 09:44:17 user nova-compute[75122]:     <apic/>
Nov 15 09:44:17 user nova-compute[75122]:     <vmcoreinfo/>
Nov 15 09:44:17 user nova-compute[75122]:   </features>
Nov 15 09:44:17 user nova-compute[75122]:   <clock offset="utc">
Nov 15 09:44:17 user nova-compute[75122]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 09:44:17 user nova-compute[75122]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 09:44:17 user nova-compute[75122]:     <timer name="hpet" present="no"/>
Nov 15 09:44:17 user nova-compute[75122]:   </clock>
Nov 15 09:44:17 user nova-compute[75122]:   <cpu mode="custom" match="exact">
Nov 15 09:44:17 user nova-compute[75122]:     <model>Nehalem</model>
Nov 15 09:44:17 user nova-compute[75122]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 09:44:17 user nova-compute[75122]:   </cpu>
Nov 15 09:44:17 user nova-compute[75122]:   <devices>
Nov 15 09:44:17 user nova-compute[75122]:     <disk type="file" device="disk">
Nov 15 09:44:17 user nova-compute[75122]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 09:44:17 user nova-compute[75122]:       <source file="/opt/stack/data/nova/instances/49154de0-f941-4ae0-a7af-72e75a4d8040/disk"/>
Nov 15 09:44:17 user nova-compute[75122]:       <target dev="vda" bus="virtio"/>
Nov 15 09:44:17 user nova-compute[75122]:     </disk>
Nov 15 09:44:17 user nova-compute[75122]:     <interface type="ethernet">
Nov 15 09:44:17 user nova-compute[75122]:       <mac address="fa:16:3e:9a:6e:b1"/>
Nov 15 09:44:17 user nova-compute[75122]:       <model type="virtio"/>
Nov 15 09:44:17 user nova-compute[75122]:       <mtu size="1442"/>
Nov 15 09:44:17 user nova-compute[75122]:       <target dev="tap62759685-70"/>
Nov 15 09:44:17 user nova-compute[75122]:     </interface>
Nov 15 09:44:17 user nova-compute[75122]:     <serial type="pty">
Nov 15 09:44:17 user nova-compute[75122]:       <log file="/opt/stack/data/nova/instances/49154de0-f941-4ae0-a7af-72e75a4d8040/console.log" append="off"/>
Nov 15 09:44:17 user nova-compute[75122]:     </serial>
Nov 15 09:44:17 user nova-compute[75122]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 09:44:17 user nova-compute[75122]:     <video>
Nov 15 09:44:17 user nova-compute[75122]:       <model type="virtio"/>
Nov 15 09:44:17 user nova-compute[75122]:     </video>
Nov 15 09:44:17 user nova-compute[75122]:     <rng model="virtio">
Nov 15 09:44:17 user nova-compute[75122]:       <backend model="random">/dev/urandom</backend>
Nov 15 09:44:17 user nova-compute[75122]:     </rng>
Nov 15 09:44:17 user nova-compute[75122]:     <controller type="usb" index="0" model="none"/>
Nov 15 09:44:17 user nova-compute[75122]:     <memballoon model="virtio">
Nov 15 09:44:17 user nova-compute[75122]:       <stats period="10"/>
Nov 15 09:44:17 user nova-compute[75122]:     </memballoon>
Nov 15 09:44:17 user nova-compute[75122]:   </devices>
Nov 15 09:44:17 user nova-compute[75122]: </domain>
Nov 15 09:44:17 user nova-compute[75122]:  {{(pid=75122) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 09:44:17 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-0bb4138b-53d8-4269-8781-c785097baa95 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T09:44:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-802765665',display_name='tempest-SnapshotDataIntegrityTests-server-802765665',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-802765665',id=31,image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDBws3y/Y+ZKzpTaU/1XgxasWjP4ywtJmaWbA4DcNGJF0dgszKP9QWfPd9yyGhz7pscnOnOlFJ99t3aPJUjLrqueGLy2tS0slfA/bB82t48OW8+GJhn7why+5POQJUupKA==',key_name='tempest-keypair-1296118645',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1d6a287ccfe04bfebdf80d827d49ce51',ramdisk_id='',reservation_id='r-edy0sb1p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1604224312',owner_user_name='tempest-SnapshotDataIntegrityTests-1604224312-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T09:44:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3fa3032cbc2a4908aa49e892902aea7d',uuid=49154de0-f941-4ae0-a7af-72e75a4d8040,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "62759685-70a8-44fe-9a6c-36ec4cd002a2", "address": "fa:16:3e:9a:6e:b1", "network": {"id": "b5966731-865f-495c-9cea-07c563eb13a3", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-641799461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d6a287ccfe04bfebdf80d827d49ce51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62759685-70", "ovs_interfaceid": "62759685-70a8-44fe-9a6c-36ec4cd002a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 09:44:17 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-0bb4138b-53d8-4269-8781-c785097baa95 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Converting VIF {"id": "62759685-70a8-44fe-9a6c-36ec4cd002a2", "address": "fa:16:3e:9a:6e:b1", "network": {"id": "b5966731-865f-495c-9cea-07c563eb13a3", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-641799461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d6a287ccfe04bfebdf80d827d49ce51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62759685-70", "ovs_interfaceid": "62759685-70a8-44fe-9a6c-36ec4cd002a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 09:44:17 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-0bb4138b-53d8-4269-8781-c785097baa95 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:6e:b1,bridge_name='br-int',has_traffic_filtering=True,id=62759685-70a8-44fe-9a6c-36ec4cd002a2,network=Network(b5966731-865f-495c-9cea-07c563eb13a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62759685-70') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 09:44:17 user nova-compute[75122]: DEBUG os_vif [None req-0bb4138b-53d8-4269-8781-c785097baa95 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:6e:b1,bridge_name='br-int',has_traffic_filtering=True,id=62759685-70a8-44fe-9a6c-36ec4cd002a2,network=Network(b5966731-865f-495c-9cea-07c563eb13a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62759685-70') {{(pid=75122) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 09:44:17 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:44:17 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:44:17 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 09:44:17 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:44:17 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '48e2bfa0-a115-5bab-a25a-f68c06c56cfd', '_type': 'linux-noop'}}, row=False) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:44:17 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:44:17 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:44:17 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:44:17 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap62759685-70, may_exist=True, interface_attrs={}) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:44:17 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap62759685-70, col_values=(('qos', UUID('9978c1a6-9efb-4e16-9422-ff6e882e3726')),), if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:44:17 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap62759685-70, col_values=(('external_ids', {'iface-id': '62759685-70a8-44fe-9a6c-36ec4cd002a2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9a:6e:b1', 'vm-uuid': '49154de0-f941-4ae0-a7af-72e75a4d8040'}),), if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:44:17 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:44:17 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:44:17 user nova-compute[75122]: INFO os_vif [None req-0bb4138b-53d8-4269-8781-c785097baa95 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:6e:b1,bridge_name='br-int',has_traffic_filtering=True,id=62759685-70a8-44fe-9a6c-36ec4cd002a2,network=Network(b5966731-865f-495c-9cea-07c563eb13a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62759685-70')
Nov 15 09:44:17 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-0bb4138b-53d8-4269-8781-c785097baa95 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] No BDM found with device name vda, not building metadata. {{(pid=75122) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 09:44:17 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-0bb4138b-53d8-4269-8781-c785097baa95 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] No VIF found with MAC fa:16:3e:9a:6e:b1, not building metadata {{(pid=75122) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 09:44:17 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-d8416745-a388-407f-abb5-5a7d944e324b tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1121448-8452-4955-8112-7b984921dac6/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:44:17 user nova-compute[75122]: DEBUG nova.virt.disk.api [None req-d8416745-a388-407f-abb5-5a7d944e324b tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Cannot resize image /opt/stack/data/nova/instances/a1121448-8452-4955-8112-7b984921dac6/disk to a smaller size. {{(pid=75122) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 09:44:17 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-d8416745-a388-407f-abb5-5a7d944e324b tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] [instance: a1121448-8452-4955-8112-7b984921dac6] Created local disks {{(pid=75122) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 09:44:17 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-d8416745-a388-407f-abb5-5a7d944e324b tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] [instance: a1121448-8452-4955-8112-7b984921dac6] Ensure instance console log exists: /opt/stack/data/nova/instances/a1121448-8452-4955-8112-7b984921dac6/console.log {{(pid=75122) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 09:44:17 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-d8416745-a388-407f-abb5-5a7d944e324b tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:44:17 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-d8416745-a388-407f-abb5-5a7d944e324b tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:44:17 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-d8416745-a388-407f-abb5-5a7d944e324b tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:44:17 user nova-compute[75122]: DEBUG nova.network.neutron [req-9c08a6b3-559c-4088-9034-eb56c0cdfc50 req-c3265176-2340-400f-984a-7ea444e1aaeb service nova] [instance: 49154de0-f941-4ae0-a7af-72e75a4d8040] Updated VIF entry in instance network info cache for port 62759685-70a8-44fe-9a6c-36ec4cd002a2. {{(pid=75122) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 09:44:17 user nova-compute[75122]: DEBUG nova.network.neutron [req-9c08a6b3-559c-4088-9034-eb56c0cdfc50 req-c3265176-2340-400f-984a-7ea444e1aaeb service nova] [instance: 49154de0-f941-4ae0-a7af-72e75a4d8040] Updating instance_info_cache with network_info: [{"id": "62759685-70a8-44fe-9a6c-36ec4cd002a2", "address": "fa:16:3e:9a:6e:b1", "network": {"id": "b5966731-865f-495c-9cea-07c563eb13a3", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-641799461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d6a287ccfe04bfebdf80d827d49ce51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62759685-70", "ovs_interfaceid": "62759685-70a8-44fe-9a6c-36ec4cd002a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:44:17 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-9c08a6b3-559c-4088-9034-eb56c0cdfc50 req-c3265176-2340-400f-984a-7ea444e1aaeb service nova] Releasing lock "refresh_cache-49154de0-f941-4ae0-a7af-72e75a4d8040" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 09:44:18 user nova-compute[75122]: DEBUG nova.network.neutron [None req-d8416745-a388-407f-abb5-5a7d944e324b tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] [instance: a1121448-8452-4955-8112-7b984921dac6] Successfully updated port: 9d82266f-3fa1-4cc5-994d-4a55b8a77f6f {{(pid=75122) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 09:44:18 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-d8416745-a388-407f-abb5-5a7d944e324b tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Acquiring lock "refresh_cache-a1121448-8452-4955-8112-7b984921dac6" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 09:44:18 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-d8416745-a388-407f-abb5-5a7d944e324b tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Acquired lock "refresh_cache-a1121448-8452-4955-8112-7b984921dac6" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 09:44:18 user nova-compute[75122]: DEBUG nova.network.neutron [None req-d8416745-a388-407f-abb5-5a7d944e324b tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] [instance: a1121448-8452-4955-8112-7b984921dac6] Building network info cache for instance {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 09:44:18 user nova-compute[75122]: DEBUG nova.compute.manager [req-7bd5aa66-ded8-493e-987b-0e8c7bb3b2c2 req-3d73fd85-ba0e-4fd8-b996-7cba7b23543c service nova] [instance: a1121448-8452-4955-8112-7b984921dac6] Received event network-changed-9d82266f-3fa1-4cc5-994d-4a55b8a77f6f {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:44:18 user nova-compute[75122]: DEBUG nova.compute.manager [req-7bd5aa66-ded8-493e-987b-0e8c7bb3b2c2 req-3d73fd85-ba0e-4fd8-b996-7cba7b23543c service nova] [instance: a1121448-8452-4955-8112-7b984921dac6] Refreshing instance network info cache due to event network-changed-9d82266f-3fa1-4cc5-994d-4a55b8a77f6f. {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 09:44:18 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-7bd5aa66-ded8-493e-987b-0e8c7bb3b2c2 req-3d73fd85-ba0e-4fd8-b996-7cba7b23543c service nova] Acquiring lock "refresh_cache-a1121448-8452-4955-8112-7b984921dac6" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 09:44:18 user nova-compute[75122]: DEBUG nova.network.neutron [None req-d8416745-a388-407f-abb5-5a7d944e324b tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] [instance: a1121448-8452-4955-8112-7b984921dac6] Instance cache missing network info. {{(pid=75122) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 09:44:18 user nova-compute[75122]: DEBUG nova.network.neutron [None req-d8416745-a388-407f-abb5-5a7d944e324b tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] [instance: a1121448-8452-4955-8112-7b984921dac6] Updating instance_info_cache with network_info: [{"id": "9d82266f-3fa1-4cc5-994d-4a55b8a77f6f", "address": "fa:16:3e:c3:ac:e1", "network": {"id": "cc80acf3-8a44-4d7e-aaa0-1214700564b3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1084984321-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f29cd64a8a674d73936b8a0c90bf2d34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d82266f-3f", "ovs_interfaceid": "9d82266f-3fa1-4cc5-994d-4a55b8a77f6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:44:18 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-d8416745-a388-407f-abb5-5a7d944e324b tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Releasing lock "refresh_cache-a1121448-8452-4955-8112-7b984921dac6" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 09:44:18 user nova-compute[75122]: DEBUG nova.compute.manager [None req-d8416745-a388-407f-abb5-5a7d944e324b tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] [instance: a1121448-8452-4955-8112-7b984921dac6] Instance network_info: |[{"id": "9d82266f-3fa1-4cc5-994d-4a55b8a77f6f", "address": "fa:16:3e:c3:ac:e1", "network": {"id": "cc80acf3-8a44-4d7e-aaa0-1214700564b3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1084984321-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f29cd64a8a674d73936b8a0c90bf2d34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d82266f-3f", "ovs_interfaceid": "9d82266f-3fa1-4cc5-994d-4a55b8a77f6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75122) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 09:44:18 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-7bd5aa66-ded8-493e-987b-0e8c7bb3b2c2 req-3d73fd85-ba0e-4fd8-b996-7cba7b23543c service nova] Acquired lock "refresh_cache-a1121448-8452-4955-8112-7b984921dac6" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 09:44:18 user nova-compute[75122]: DEBUG nova.network.neutron [req-7bd5aa66-ded8-493e-987b-0e8c7bb3b2c2 req-3d73fd85-ba0e-4fd8-b996-7cba7b23543c service nova] [instance: a1121448-8452-4955-8112-7b984921dac6] Refreshing network info cache for port 9d82266f-3fa1-4cc5-994d-4a55b8a77f6f {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 09:44:18 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-d8416745-a388-407f-abb5-5a7d944e324b tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] [instance: a1121448-8452-4955-8112-7b984921dac6] Start _get_guest_xml network_info=[{"id": "9d82266f-3fa1-4cc5-994d-4a55b8a77f6f", "address": "fa:16:3e:c3:ac:e1", "network": {"id": "cc80acf3-8a44-4d7e-aaa0-1214700564b3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1084984321-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f29cd64a8a674d73936b8a0c90bf2d34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d82266f-3f", "ovs_interfaceid": "9d82266f-3fa1-4cc5-994d-4a55b8a77f6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T09:26:31Z,direct_url=<?>,disk_format='qcow2',id=5e862cfe-47b8-4725-8292-65761ee6d0f5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9c57733cb41847c0b4ad31519c382e5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T09:26:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '5e862cfe-47b8-4725-8292-65761ee6d0f5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75122) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 09:44:18 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-d8416745-a388-407f-abb5-5a7d944e324b tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 09:44:18 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-d8416745-a388-407f-abb5-5a7d944e324b tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 09:44:18 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-d8416745-a388-407f-abb5-5a7d944e324b tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75122) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 09:44:18 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-d8416745-a388-407f-abb5-5a7d944e324b tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] CPU controller missing on host. {{(pid=75122) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 09:44:18 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-d8416745-a388-407f-abb5-5a7d944e324b tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75122) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 09:44:18 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-d8416745-a388-407f-abb5-5a7d944e324b tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] CPU controller found on host. {{(pid=75122) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 09:44:18 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-d8416745-a388-407f-abb5-5a7d944e324b tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75122) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 09:44:18 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-d8416745-a388-407f-abb5-5a7d944e324b tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T09:26:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T09:26:31Z,direct_url=<?>,disk_format='qcow2',id=5e862cfe-47b8-4725-8292-65761ee6d0f5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9c57733cb41847c0b4ad31519c382e5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T09:26:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 09:44:18 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-d8416745-a388-407f-abb5-5a7d944e324b tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Flavor limits 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 09:44:18 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-d8416745-a388-407f-abb5-5a7d944e324b tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Image limits 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 09:44:18 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-d8416745-a388-407f-abb5-5a7d944e324b tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Flavor pref 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 09:44:18 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-d8416745-a388-407f-abb5-5a7d944e324b tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Image pref 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 09:44:18 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-d8416745-a388-407f-abb5-5a7d944e324b tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 09:44:18 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-d8416745-a388-407f-abb5-5a7d944e324b tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 09:44:18 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-d8416745-a388-407f-abb5-5a7d944e324b tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75122) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 09:44:18 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-d8416745-a388-407f-abb5-5a7d944e324b tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Got 1 possible topologies {{(pid=75122) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 09:44:18 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-d8416745-a388-407f-abb5-5a7d944e324b tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 09:44:18 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-d8416745-a388-407f-abb5-5a7d944e324b tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 09:44:18 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-d8416745-a388-407f-abb5-5a7d944e324b tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T09:44:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-120337552',display_name='tempest-AttachVolumeNegativeTest-server-120337552',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-120337552',id=32,image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIt004arHJAVA9YX1D2h32CCG1NZs5pmS7Nq8kguNJF1nqzEWQDBPJY45HS+YgLBXElVlpJ00RXFjwW3PY8evZ9wx+3Gi8S/JxRAxeXls+Av8MYdiphzSJ7fDXdmgiktLA==',key_name='tempest-keypair-953633772',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f29cd64a8a674d73936b8a0c90bf2d34',ramdisk_id='',reservation_id='r-jawjpd9a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-475232131',owner_user_name='tempest-AttachVolumeNegativeTest-475232131-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T09:44:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d52d39a644924944be943a3200bd5b33',uuid=a1121448-8452-4955-8112-7b984921dac6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9d82266f-3fa1-4cc5-994d-4a55b8a77f6f", "address": "fa:16:3e:c3:ac:e1", "network": {"id": "cc80acf3-8a44-4d7e-aaa0-1214700564b3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1084984321-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f29cd64a8a674d73936b8a0c90bf2d34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d82266f-3f", "ovs_interfaceid": "9d82266f-3fa1-4cc5-994d-4a55b8a77f6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75122) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 09:44:18 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-d8416745-a388-407f-abb5-5a7d944e324b tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Converting VIF {"id": "9d82266f-3fa1-4cc5-994d-4a55b8a77f6f", "address": "fa:16:3e:c3:ac:e1", "network": {"id": "cc80acf3-8a44-4d7e-aaa0-1214700564b3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1084984321-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f29cd64a8a674d73936b8a0c90bf2d34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d82266f-3f", "ovs_interfaceid": "9d82266f-3fa1-4cc5-994d-4a55b8a77f6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 09:44:18 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-d8416745-a388-407f-abb5-5a7d944e324b tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:ac:e1,bridge_name='br-int',has_traffic_filtering=True,id=9d82266f-3fa1-4cc5-994d-4a55b8a77f6f,network=Network(cc80acf3-8a44-4d7e-aaa0-1214700564b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d82266f-3f') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 09:44:18 user nova-compute[75122]: DEBUG nova.objects.instance [None req-d8416745-a388-407f-abb5-5a7d944e324b tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Lazy-loading 'pci_devices' on Instance uuid a1121448-8452-4955-8112-7b984921dac6 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:44:18 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-d8416745-a388-407f-abb5-5a7d944e324b tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] [instance: a1121448-8452-4955-8112-7b984921dac6] End _get_guest_xml xml=<domain type="kvm">
Nov 15 09:44:18 user nova-compute[75122]:   <uuid>a1121448-8452-4955-8112-7b984921dac6</uuid>
Nov 15 09:44:18 user nova-compute[75122]:   <name>instance-00000020</name>
Nov 15 09:44:18 user nova-compute[75122]:   <memory>524288</memory>
Nov 15 09:44:18 user nova-compute[75122]:   <vcpu>1</vcpu>
Nov 15 09:44:18 user nova-compute[75122]:   <metadata>
Nov 15 09:44:18 user nova-compute[75122]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 09:44:18 user nova-compute[75122]:       <nova:package version="0.0.0"/>
Nov 15 09:44:18 user nova-compute[75122]:       <nova:name>tempest-AttachVolumeNegativeTest-server-120337552</nova:name>
Nov 15 09:44:18 user nova-compute[75122]:       <nova:creationTime>2023-11-15 09:44:18</nova:creationTime>
Nov 15 09:44:18 user nova-compute[75122]:       <nova:flavor name="m1.tiny">
Nov 15 09:44:18 user nova-compute[75122]:         <nova:memory>512</nova:memory>
Nov 15 09:44:18 user nova-compute[75122]:         <nova:disk>1</nova:disk>
Nov 15 09:44:18 user nova-compute[75122]:         <nova:swap>0</nova:swap>
Nov 15 09:44:18 user nova-compute[75122]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 09:44:18 user nova-compute[75122]:         <nova:vcpus>1</nova:vcpus>
Nov 15 09:44:18 user nova-compute[75122]:       </nova:flavor>
Nov 15 09:44:18 user nova-compute[75122]:       <nova:owner>
Nov 15 09:44:18 user nova-compute[75122]:         <nova:user uuid="d52d39a644924944be943a3200bd5b33">tempest-AttachVolumeNegativeTest-475232131-project-member</nova:user>
Nov 15 09:44:18 user nova-compute[75122]:         <nova:project uuid="f29cd64a8a674d73936b8a0c90bf2d34">tempest-AttachVolumeNegativeTest-475232131</nova:project>
Nov 15 09:44:18 user nova-compute[75122]:       </nova:owner>
Nov 15 09:44:18 user nova-compute[75122]:       <nova:root type="image" uuid="5e862cfe-47b8-4725-8292-65761ee6d0f5"/>
Nov 15 09:44:18 user nova-compute[75122]:       <nova:ports>
Nov 15 09:44:18 user nova-compute[75122]:         <nova:port uuid="9d82266f-3fa1-4cc5-994d-4a55b8a77f6f">
Nov 15 09:44:18 user nova-compute[75122]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 15 09:44:18 user nova-compute[75122]:         </nova:port>
Nov 15 09:44:18 user nova-compute[75122]:       </nova:ports>
Nov 15 09:44:18 user nova-compute[75122]:     </nova:instance>
Nov 15 09:44:18 user nova-compute[75122]:   </metadata>
Nov 15 09:44:18 user nova-compute[75122]:   <sysinfo type="smbios">
Nov 15 09:44:18 user nova-compute[75122]:     <system>
Nov 15 09:44:18 user nova-compute[75122]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 09:44:18 user nova-compute[75122]:       <entry name="product">OpenStack Nova</entry>
Nov 15 09:44:18 user nova-compute[75122]:       <entry name="version">0.0.0</entry>
Nov 15 09:44:18 user nova-compute[75122]:       <entry name="serial">a1121448-8452-4955-8112-7b984921dac6</entry>
Nov 15 09:44:18 user nova-compute[75122]:       <entry name="uuid">a1121448-8452-4955-8112-7b984921dac6</entry>
Nov 15 09:44:18 user nova-compute[75122]:       <entry name="family">Virtual Machine</entry>
Nov 15 09:44:18 user nova-compute[75122]:     </system>
Nov 15 09:44:18 user nova-compute[75122]:   </sysinfo>
Nov 15 09:44:18 user nova-compute[75122]:   <os>
Nov 15 09:44:18 user nova-compute[75122]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 09:44:18 user nova-compute[75122]:     <boot dev="hd"/>
Nov 15 09:44:18 user nova-compute[75122]:     <smbios mode="sysinfo"/>
Nov 15 09:44:18 user nova-compute[75122]:   </os>
Nov 15 09:44:18 user nova-compute[75122]:   <features>
Nov 15 09:44:18 user nova-compute[75122]:     <acpi/>
Nov 15 09:44:18 user nova-compute[75122]:     <apic/>
Nov 15 09:44:18 user nova-compute[75122]:     <vmcoreinfo/>
Nov 15 09:44:18 user nova-compute[75122]:   </features>
Nov 15 09:44:18 user nova-compute[75122]:   <clock offset="utc">
Nov 15 09:44:18 user nova-compute[75122]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 09:44:18 user nova-compute[75122]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 09:44:18 user nova-compute[75122]:     <timer name="hpet" present="no"/>
Nov 15 09:44:18 user nova-compute[75122]:   </clock>
Nov 15 09:44:18 user nova-compute[75122]:   <cpu mode="custom" match="exact">
Nov 15 09:44:18 user nova-compute[75122]:     <model>Nehalem</model>
Nov 15 09:44:18 user nova-compute[75122]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 09:44:18 user nova-compute[75122]:   </cpu>
Nov 15 09:44:18 user nova-compute[75122]:   <devices>
Nov 15 09:44:18 user nova-compute[75122]:     <disk type="file" device="disk">
Nov 15 09:44:18 user nova-compute[75122]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 09:44:18 user nova-compute[75122]:       <source file="/opt/stack/data/nova/instances/a1121448-8452-4955-8112-7b984921dac6/disk"/>
Nov 15 09:44:18 user nova-compute[75122]:       <target dev="vda" bus="virtio"/>
Nov 15 09:44:18 user nova-compute[75122]:     </disk>
Nov 15 09:44:18 user nova-compute[75122]:     <interface type="ethernet">
Nov 15 09:44:18 user nova-compute[75122]:       <mac address="fa:16:3e:c3:ac:e1"/>
Nov 15 09:44:18 user nova-compute[75122]:       <model type="virtio"/>
Nov 15 09:44:18 user nova-compute[75122]:       <mtu size="1442"/>
Nov 15 09:44:18 user nova-compute[75122]:       <target dev="tap9d82266f-3f"/>
Nov 15 09:44:18 user nova-compute[75122]:     </interface>
Nov 15 09:44:18 user nova-compute[75122]:     <serial type="pty">
Nov 15 09:44:18 user nova-compute[75122]:       <log file="/opt/stack/data/nova/instances/a1121448-8452-4955-8112-7b984921dac6/console.log" append="off"/>
Nov 15 09:44:18 user nova-compute[75122]:     </serial>
Nov 15 09:44:18 user nova-compute[75122]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 09:44:18 user nova-compute[75122]:     <video>
Nov 15 09:44:18 user nova-compute[75122]:       <model type="virtio"/>
Nov 15 09:44:18 user nova-compute[75122]:     </video>
Nov 15 09:44:18 user nova-compute[75122]:     <rng model="virtio">
Nov 15 09:44:18 user nova-compute[75122]:       <backend model="random">/dev/urandom</backend>
Nov 15 09:44:18 user nova-compute[75122]:     </rng>
Nov 15 09:44:18 user nova-compute[75122]:     <controller type="usb" index="0" model="none"/>
Nov 15 09:44:18 user nova-compute[75122]:     <memballoon model="virtio">
Nov 15 09:44:18 user nova-compute[75122]:       <stats period="10"/>
Nov 15 09:44:18 user nova-compute[75122]:     </memballoon>
Nov 15 09:44:18 user nova-compute[75122]:   </devices>
Nov 15 09:44:18 user nova-compute[75122]: </domain>
Nov 15 09:44:18 user nova-compute[75122]:  {{(pid=75122) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 09:44:18 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-d8416745-a388-407f-abb5-5a7d944e324b tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T09:44:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-120337552',display_name='tempest-AttachVolumeNegativeTest-server-120337552',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-120337552',id=32,image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIt004arHJAVA9YX1D2h32CCG1NZs5pmS7Nq8kguNJF1nqzEWQDBPJY45HS+YgLBXElVlpJ00RXFjwW3PY8evZ9wx+3Gi8S/JxRAxeXls+Av8MYdiphzSJ7fDXdmgiktLA==',key_name='tempest-keypair-953633772',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f29cd64a8a674d73936b8a0c90bf2d34',ramdisk_id='',reservation_id='r-jawjpd9a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-475232131',owner_user_name='tempest-AttachVolumeNegativeTest-475232131-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T09:44:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d52d39a644924944be943a3200bd5b33',uuid=a1121448-8452-4955-8112-7b984921dac6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9d82266f-3fa1-4cc5-994d-4a55b8a77f6f", "address": "fa:16:3e:c3:ac:e1", "network": {"id": "cc80acf3-8a44-4d7e-aaa0-1214700564b3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1084984321-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f29cd64a8a674d73936b8a0c90bf2d34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d82266f-3f", "ovs_interfaceid": "9d82266f-3fa1-4cc5-994d-4a55b8a77f6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 09:44:18 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-d8416745-a388-407f-abb5-5a7d944e324b tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Converting VIF {"id": "9d82266f-3fa1-4cc5-994d-4a55b8a77f6f", "address": "fa:16:3e:c3:ac:e1", "network": {"id": "cc80acf3-8a44-4d7e-aaa0-1214700564b3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1084984321-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f29cd64a8a674d73936b8a0c90bf2d34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d82266f-3f", "ovs_interfaceid": "9d82266f-3fa1-4cc5-994d-4a55b8a77f6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 09:44:18 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-d8416745-a388-407f-abb5-5a7d944e324b tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:ac:e1,bridge_name='br-int',has_traffic_filtering=True,id=9d82266f-3fa1-4cc5-994d-4a55b8a77f6f,network=Network(cc80acf3-8a44-4d7e-aaa0-1214700564b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d82266f-3f') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 09:44:18 user nova-compute[75122]: DEBUG os_vif [None req-d8416745-a388-407f-abb5-5a7d944e324b tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:ac:e1,bridge_name='br-int',has_traffic_filtering=True,id=9d82266f-3fa1-4cc5-994d-4a55b8a77f6f,network=Network(cc80acf3-8a44-4d7e-aaa0-1214700564b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d82266f-3f') {{(pid=75122) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 09:44:18 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:44:18 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:44:18 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 09:44:18 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:44:18 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '896d70e0-73f4-5168-89db-b0b670fc95e4', '_type': 'linux-noop'}}, row=False) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:44:18 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:44:18 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:44:18 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:44:18 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:44:18 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9d82266f-3f, may_exist=True, interface_attrs={}) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:44:18 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9d82266f-3f, col_values=(('qos', UUID('c74a8831-ac51-4174-81ba-42c15aba5d88')),), if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:44:18 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9d82266f-3f, col_values=(('external_ids', {'iface-id': '9d82266f-3fa1-4cc5-994d-4a55b8a77f6f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c3:ac:e1', 'vm-uuid': 'a1121448-8452-4955-8112-7b984921dac6'}),), if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:44:18 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:44:18 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:44:18 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:44:18 user nova-compute[75122]: INFO os_vif [None req-d8416745-a388-407f-abb5-5a7d944e324b tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:ac:e1,bridge_name='br-int',has_traffic_filtering=True,id=9d82266f-3fa1-4cc5-994d-4a55b8a77f6f,network=Network(cc80acf3-8a44-4d7e-aaa0-1214700564b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d82266f-3f')
Nov 15 09:44:18 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-d8416745-a388-407f-abb5-5a7d944e324b tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] No BDM found with device name vda, not building metadata. {{(pid=75122) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 09:44:18 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-d8416745-a388-407f-abb5-5a7d944e324b tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] No VIF found with MAC fa:16:3e:c3:ac:e1, not building metadata {{(pid=75122) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 09:44:18 user nova-compute[75122]: DEBUG nova.network.neutron [req-7bd5aa66-ded8-493e-987b-0e8c7bb3b2c2 req-3d73fd85-ba0e-4fd8-b996-7cba7b23543c service nova] [instance: a1121448-8452-4955-8112-7b984921dac6] Updated VIF entry in instance network info cache for port 9d82266f-3fa1-4cc5-994d-4a55b8a77f6f. {{(pid=75122) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 09:44:18 user nova-compute[75122]: DEBUG nova.network.neutron [req-7bd5aa66-ded8-493e-987b-0e8c7bb3b2c2 req-3d73fd85-ba0e-4fd8-b996-7cba7b23543c service nova] [instance: a1121448-8452-4955-8112-7b984921dac6] Updating instance_info_cache with network_info: [{"id": "9d82266f-3fa1-4cc5-994d-4a55b8a77f6f", "address": "fa:16:3e:c3:ac:e1", "network": {"id": "cc80acf3-8a44-4d7e-aaa0-1214700564b3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1084984321-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f29cd64a8a674d73936b8a0c90bf2d34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d82266f-3f", "ovs_interfaceid": "9d82266f-3fa1-4cc5-994d-4a55b8a77f6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:44:18 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-7bd5aa66-ded8-493e-987b-0e8c7bb3b2c2 req-3d73fd85-ba0e-4fd8-b996-7cba7b23543c service nova] Releasing lock "refresh_cache-a1121448-8452-4955-8112-7b984921dac6" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 09:44:19 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:44:19 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:44:19 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:44:19 user nova-compute[75122]: DEBUG nova.compute.manager [req-e4b014c3-6d5f-427b-a90a-b10ef1048849 req-4e8548e2-e3df-48ae-aa7c-e3d77170f697 service nova] [instance: 49154de0-f941-4ae0-a7af-72e75a4d8040] Received event network-vif-plugged-62759685-70a8-44fe-9a6c-36ec4cd002a2 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:44:19 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-e4b014c3-6d5f-427b-a90a-b10ef1048849 req-4e8548e2-e3df-48ae-aa7c-e3d77170f697 service nova] Acquiring lock "49154de0-f941-4ae0-a7af-72e75a4d8040-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:44:19 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-e4b014c3-6d5f-427b-a90a-b10ef1048849 req-4e8548e2-e3df-48ae-aa7c-e3d77170f697 service nova] Lock "49154de0-f941-4ae0-a7af-72e75a4d8040-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:44:19 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-e4b014c3-6d5f-427b-a90a-b10ef1048849 req-4e8548e2-e3df-48ae-aa7c-e3d77170f697 service nova] Lock "49154de0-f941-4ae0-a7af-72e75a4d8040-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:44:19 user nova-compute[75122]: DEBUG nova.compute.manager [req-e4b014c3-6d5f-427b-a90a-b10ef1048849 req-4e8548e2-e3df-48ae-aa7c-e3d77170f697 service nova] [instance: 49154de0-f941-4ae0-a7af-72e75a4d8040] No waiting events found dispatching network-vif-plugged-62759685-70a8-44fe-9a6c-36ec4cd002a2 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:44:19 user nova-compute[75122]: WARNING nova.compute.manager [req-e4b014c3-6d5f-427b-a90a-b10ef1048849 req-4e8548e2-e3df-48ae-aa7c-e3d77170f697 service nova] [instance: 49154de0-f941-4ae0-a7af-72e75a4d8040] Received unexpected event network-vif-plugged-62759685-70a8-44fe-9a6c-36ec4cd002a2 for instance with vm_state building and task_state spawning.
Nov 15 09:44:19 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:44:19 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:44:19 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:44:19 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:44:19 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:44:20 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:44:20 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75122) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 09:44:20 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:44:20 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:44:20 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:44:21 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:44:21 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:44:21 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:44:21 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:44:21 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:44:21 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:44:21 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:44:21 user nova-compute[75122]: DEBUG nova.compute.manager [req-540eb8e6-73ed-47be-b490-cb03fa2a9555 req-646fff3f-1fa9-41cb-a876-98354062b237 service nova] [instance: 49154de0-f941-4ae0-a7af-72e75a4d8040] Received event network-vif-plugged-62759685-70a8-44fe-9a6c-36ec4cd002a2 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:44:21 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-540eb8e6-73ed-47be-b490-cb03fa2a9555 req-646fff3f-1fa9-41cb-a876-98354062b237 service nova] Acquiring lock "49154de0-f941-4ae0-a7af-72e75a4d8040-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:44:21 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-540eb8e6-73ed-47be-b490-cb03fa2a9555 req-646fff3f-1fa9-41cb-a876-98354062b237 service nova] Lock "49154de0-f941-4ae0-a7af-72e75a4d8040-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:44:21 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-540eb8e6-73ed-47be-b490-cb03fa2a9555 req-646fff3f-1fa9-41cb-a876-98354062b237 service nova] Lock "49154de0-f941-4ae0-a7af-72e75a4d8040-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:44:21 user nova-compute[75122]: DEBUG nova.compute.manager [req-540eb8e6-73ed-47be-b490-cb03fa2a9555 req-646fff3f-1fa9-41cb-a876-98354062b237 service nova] [instance: 49154de0-f941-4ae0-a7af-72e75a4d8040] No waiting events found dispatching network-vif-plugged-62759685-70a8-44fe-9a6c-36ec4cd002a2 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:44:21 user nova-compute[75122]: WARNING nova.compute.manager [req-540eb8e6-73ed-47be-b490-cb03fa2a9555 req-646fff3f-1fa9-41cb-a876-98354062b237 service nova] [instance: 49154de0-f941-4ae0-a7af-72e75a4d8040] Received unexpected event network-vif-plugged-62759685-70a8-44fe-9a6c-36ec4cd002a2 for instance with vm_state building and task_state spawning.
Nov 15 09:44:21 user nova-compute[75122]: DEBUG nova.compute.manager [req-540eb8e6-73ed-47be-b490-cb03fa2a9555 req-646fff3f-1fa9-41cb-a876-98354062b237 service nova] [instance: a1121448-8452-4955-8112-7b984921dac6] Received event network-vif-plugged-9d82266f-3fa1-4cc5-994d-4a55b8a77f6f {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:44:21 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-540eb8e6-73ed-47be-b490-cb03fa2a9555 req-646fff3f-1fa9-41cb-a876-98354062b237 service nova] Acquiring lock "a1121448-8452-4955-8112-7b984921dac6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:44:21 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-540eb8e6-73ed-47be-b490-cb03fa2a9555 req-646fff3f-1fa9-41cb-a876-98354062b237 service nova] Lock "a1121448-8452-4955-8112-7b984921dac6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:44:21 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-540eb8e6-73ed-47be-b490-cb03fa2a9555 req-646fff3f-1fa9-41cb-a876-98354062b237 service nova] Lock "a1121448-8452-4955-8112-7b984921dac6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:44:21 user nova-compute[75122]: DEBUG nova.compute.manager [req-540eb8e6-73ed-47be-b490-cb03fa2a9555 req-646fff3f-1fa9-41cb-a876-98354062b237 service nova] [instance: a1121448-8452-4955-8112-7b984921dac6] No waiting events found dispatching network-vif-plugged-9d82266f-3fa1-4cc5-994d-4a55b8a77f6f {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:44:21 user nova-compute[75122]: WARNING nova.compute.manager [req-540eb8e6-73ed-47be-b490-cb03fa2a9555 req-646fff3f-1fa9-41cb-a876-98354062b237 service nova] [instance: a1121448-8452-4955-8112-7b984921dac6] Received unexpected event network-vif-plugged-9d82266f-3fa1-4cc5-994d-4a55b8a77f6f for instance with vm_state building and task_state spawning.
Nov 15 09:44:21 user nova-compute[75122]: DEBUG nova.compute.manager [req-540eb8e6-73ed-47be-b490-cb03fa2a9555 req-646fff3f-1fa9-41cb-a876-98354062b237 service nova] [instance: a1121448-8452-4955-8112-7b984921dac6] Received event network-vif-plugged-9d82266f-3fa1-4cc5-994d-4a55b8a77f6f {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:44:21 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-540eb8e6-73ed-47be-b490-cb03fa2a9555 req-646fff3f-1fa9-41cb-a876-98354062b237 service nova] Acquiring lock "a1121448-8452-4955-8112-7b984921dac6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:44:21 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-540eb8e6-73ed-47be-b490-cb03fa2a9555 req-646fff3f-1fa9-41cb-a876-98354062b237 service nova] Lock "a1121448-8452-4955-8112-7b984921dac6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:44:21 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-540eb8e6-73ed-47be-b490-cb03fa2a9555 req-646fff3f-1fa9-41cb-a876-98354062b237 service nova] Lock "a1121448-8452-4955-8112-7b984921dac6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:44:21 user nova-compute[75122]: DEBUG nova.compute.manager [req-540eb8e6-73ed-47be-b490-cb03fa2a9555 req-646fff3f-1fa9-41cb-a876-98354062b237 service nova] [instance: a1121448-8452-4955-8112-7b984921dac6] No waiting events found dispatching network-vif-plugged-9d82266f-3fa1-4cc5-994d-4a55b8a77f6f {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:44:21 user nova-compute[75122]: WARNING nova.compute.manager [req-540eb8e6-73ed-47be-b490-cb03fa2a9555 req-646fff3f-1fa9-41cb-a876-98354062b237 service nova] [instance: a1121448-8452-4955-8112-7b984921dac6] Received unexpected event network-vif-plugged-9d82266f-3fa1-4cc5-994d-4a55b8a77f6f for instance with vm_state building and task_state spawning.
Nov 15 09:44:22 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:44:22 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Starting heal instance info cache {{(pid=75122) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 09:44:22 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "refresh_cache-c2f45f49-0bca-4ae2-bc2a-eed293143489" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 09:44:22 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquired lock "refresh_cache-c2f45f49-0bca-4ae2-bc2a-eed293143489" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 09:44:22 user nova-compute[75122]: DEBUG nova.network.neutron [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] [instance: c2f45f49-0bca-4ae2-bc2a-eed293143489] Forcefully refreshing network info cache for instance {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 09:44:22 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bb4138b-53d8-4269-8781-c785097baa95 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] [instance: 49154de0-f941-4ae0-a7af-72e75a4d8040] Instance event wait completed in 0 seconds for  {{(pid=75122) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 09:44:22 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-0bb4138b-53d8-4269-8781-c785097baa95 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] [instance: 49154de0-f941-4ae0-a7af-72e75a4d8040] Guest created on hypervisor {{(pid=75122) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 09:44:22 user nova-compute[75122]: DEBUG nova.network.neutron [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] [instance: c2f45f49-0bca-4ae2-bc2a-eed293143489] Updating instance_info_cache with network_info: [{"id": "24f9619f-42ba-42cf-b39c-43e14754e913", "address": "fa:16:3e:92:99:9d", "network": {"id": "387b4fc3-39ad-40c3-bcd7-7526b09e30b7", "bridge": "br-int", "label": "tempest-TestStampPattern-1501769990-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bdc0f52b1c744b91b4f1a4ecd07e07c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24f9619f-42", "ovs_interfaceid": "24f9619f-42ba-42cf-b39c-43e14754e913", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:44:22 user nova-compute[75122]: INFO nova.virt.libvirt.driver [-] [instance: 49154de0-f941-4ae0-a7af-72e75a4d8040] Instance spawned successfully.
Nov 15 09:44:22 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-0bb4138b-53d8-4269-8781-c785097baa95 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] [instance: 49154de0-f941-4ae0-a7af-72e75a4d8040] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 09:44:22 user nova-compute[75122]: DEBUG nova.compute.manager [None req-d8416745-a388-407f-abb5-5a7d944e324b tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] [instance: a1121448-8452-4955-8112-7b984921dac6] Instance event wait completed in 0 seconds for  {{(pid=75122) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 09:44:22 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-d8416745-a388-407f-abb5-5a7d944e324b tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] [instance: a1121448-8452-4955-8112-7b984921dac6] Guest created on hypervisor {{(pid=75122) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 09:44:22 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Releasing lock "refresh_cache-c2f45f49-0bca-4ae2-bc2a-eed293143489" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 09:44:22 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] [instance: c2f45f49-0bca-4ae2-bc2a-eed293143489] Updated the network info_cache for instance {{(pid=75122) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 09:44:22 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:44:22 user nova-compute[75122]: INFO nova.virt.libvirt.driver [-] [instance: a1121448-8452-4955-8112-7b984921dac6] Instance spawned successfully.
Nov 15 09:44:22 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-d8416745-a388-407f-abb5-5a7d944e324b tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] [instance: a1121448-8452-4955-8112-7b984921dac6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 09:44:22 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-0bb4138b-53d8-4269-8781-c785097baa95 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] [instance: 49154de0-f941-4ae0-a7af-72e75a4d8040] Found default for hw_cdrom_bus of ide {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:44:22 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-0bb4138b-53d8-4269-8781-c785097baa95 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] [instance: 49154de0-f941-4ae0-a7af-72e75a4d8040] Found default for hw_disk_bus of virtio {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:44:22 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-0bb4138b-53d8-4269-8781-c785097baa95 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] [instance: 49154de0-f941-4ae0-a7af-72e75a4d8040] Found default for hw_input_bus of None {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:44:22 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-0bb4138b-53d8-4269-8781-c785097baa95 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] [instance: 49154de0-f941-4ae0-a7af-72e75a4d8040] Found default for hw_pointer_model of None {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:44:22 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-0bb4138b-53d8-4269-8781-c785097baa95 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] [instance: 49154de0-f941-4ae0-a7af-72e75a4d8040] Found default for hw_video_model of virtio {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:44:22 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-0bb4138b-53d8-4269-8781-c785097baa95 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] [instance: 49154de0-f941-4ae0-a7af-72e75a4d8040] Found default for hw_vif_model of virtio {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:44:22 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-d8416745-a388-407f-abb5-5a7d944e324b tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] [instance: a1121448-8452-4955-8112-7b984921dac6] Found default for hw_cdrom_bus of ide {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:44:22 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-d8416745-a388-407f-abb5-5a7d944e324b tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] [instance: a1121448-8452-4955-8112-7b984921dac6] Found default for hw_disk_bus of virtio {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:44:22 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-d8416745-a388-407f-abb5-5a7d944e324b tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] [instance: a1121448-8452-4955-8112-7b984921dac6] Found default for hw_input_bus of None {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:44:22 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-d8416745-a388-407f-abb5-5a7d944e324b tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] [instance: a1121448-8452-4955-8112-7b984921dac6] Found default for hw_pointer_model of None {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:44:22 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-d8416745-a388-407f-abb5-5a7d944e324b tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] [instance: a1121448-8452-4955-8112-7b984921dac6] Found default for hw_video_model of virtio {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:44:22 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-d8416745-a388-407f-abb5-5a7d944e324b tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] [instance: a1121448-8452-4955-8112-7b984921dac6] Found default for hw_vif_model of virtio {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:44:22 user nova-compute[75122]: INFO nova.compute.manager [None req-0bb4138b-53d8-4269-8781-c785097baa95 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] [instance: 49154de0-f941-4ae0-a7af-72e75a4d8040] Took 6.96 seconds to spawn the instance on the hypervisor.
Nov 15 09:44:22 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bb4138b-53d8-4269-8781-c785097baa95 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] [instance: 49154de0-f941-4ae0-a7af-72e75a4d8040] Checking state {{(pid=75122) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 09:44:22 user nova-compute[75122]: INFO nova.compute.manager [None req-d8416745-a388-407f-abb5-5a7d944e324b tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] [instance: a1121448-8452-4955-8112-7b984921dac6] Took 5.79 seconds to spawn the instance on the hypervisor.
Nov 15 09:44:22 user nova-compute[75122]: DEBUG nova.compute.manager [None req-d8416745-a388-407f-abb5-5a7d944e324b tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] [instance: a1121448-8452-4955-8112-7b984921dac6] Checking state {{(pid=75122) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 09:44:22 user nova-compute[75122]: INFO nova.compute.manager [None req-d8416745-a388-407f-abb5-5a7d944e324b tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] [instance: a1121448-8452-4955-8112-7b984921dac6] Took 6.56 seconds to build instance.
Nov 15 09:44:22 user nova-compute[75122]: INFO nova.compute.manager [None req-0bb4138b-53d8-4269-8781-c785097baa95 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] [instance: 49154de0-f941-4ae0-a7af-72e75a4d8040] Took 7.68 seconds to build instance.
Nov 15 09:44:22 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-d8416745-a388-407f-abb5-5a7d944e324b tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Lock "a1121448-8452-4955-8112-7b984921dac6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.701s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:44:22 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bb4138b-53d8-4269-8781-c785097baa95 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Lock "49154de0-f941-4ae0-a7af-72e75a4d8040" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.774s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:44:23 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:44:23 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:44:24 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:44:25 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:44:25 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:44:25 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:44:25 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:44:25 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75122) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 09:44:25 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2f45f49-0bca-4ae2-bc2a-eed293143489/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:44:25 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2f45f49-0bca-4ae2-bc2a-eed293143489/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:44:25 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2f45f49-0bca-4ae2-bc2a-eed293143489/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:44:25 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2f45f49-0bca-4ae2-bc2a-eed293143489/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:44:25 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75122) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 09:44:25 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc80e3fb-b5a3-4685-8ec5-12f8c385b833/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:44:26 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc80e3fb-b5a3-4685-8ec5-12f8c385b833/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:44:26 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc80e3fb-b5a3-4685-8ec5-12f8c385b833/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:44:26 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:44:26 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc80e3fb-b5a3-4685-8ec5-12f8c385b833/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:44:26 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd9d52bb-6248-48e6-a798-6dbdaaa68cbc/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:44:26 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd9d52bb-6248-48e6-a798-6dbdaaa68cbc/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:44:26 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd9d52bb-6248-48e6-a798-6dbdaaa68cbc/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:44:26 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd9d52bb-6248-48e6-a798-6dbdaaa68cbc/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:44:26 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49154de0-f941-4ae0-a7af-72e75a4d8040/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:44:26 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49154de0-f941-4ae0-a7af-72e75a4d8040/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:44:26 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49154de0-f941-4ae0-a7af-72e75a4d8040/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:44:27 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49154de0-f941-4ae0-a7af-72e75a4d8040/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:44:27 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1121448-8452-4955-8112-7b984921dac6/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:44:27 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1121448-8452-4955-8112-7b984921dac6/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:44:27 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1121448-8452-4955-8112-7b984921dac6/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:44:27 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1121448-8452-4955-8112-7b984921dac6/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:44:27 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/131142fd-e8ec-42d1-a518-aa21c7bb7cb1/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:44:27 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/131142fd-e8ec-42d1-a518-aa21c7bb7cb1/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:44:27 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/131142fd-e8ec-42d1-a518-aa21c7bb7cb1/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:44:27 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/131142fd-e8ec-42d1-a518-aa21c7bb7cb1/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:44:27 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8271a429-e252-42bb-8717-e89dfd9739bf/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:44:28 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8271a429-e252-42bb-8717-e89dfd9739bf/disk --force-share --output=json" returned: 0 in 0.251s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:44:28 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8271a429-e252-42bb-8717-e89dfd9739bf/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:44:28 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8271a429-e252-42bb-8717-e89dfd9739bf/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:44:28 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00270cc2-4f5b-4f64-8f88-31f21e3b3950/disk.rescue --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:44:28 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:44:28 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00270cc2-4f5b-4f64-8f88-31f21e3b3950/disk.rescue --force-share --output=json" returned: 0 in 0.199s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:44:28 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00270cc2-4f5b-4f64-8f88-31f21e3b3950/disk.rescue --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:44:28 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00270cc2-4f5b-4f64-8f88-31f21e3b3950/disk.rescue --force-share --output=json" returned: 0 in 0.197s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:44:28 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00270cc2-4f5b-4f64-8f88-31f21e3b3950/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:44:29 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00270cc2-4f5b-4f64-8f88-31f21e3b3950/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:44:29 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00270cc2-4f5b-4f64-8f88-31f21e3b3950/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:44:29 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00270cc2-4f5b-4f64-8f88-31f21e3b3950/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:44:29 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 09:44:29 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 09:44:29 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Hypervisor/Node resource view: name=user free_ram=7792MB free_disk=25.255062103271484GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75122) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 09:44:29 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:44:29 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:44:29 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Applying migration context for instance cc485c6c-5a9a-4c94-b966-68dd9e336e56 as it has an incoming, in-progress migration 1c6b84e0-2ff9-44f1-bd0a-20e98d2f2ac0. Migration status is finished {{(pid=75122) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 15 09:44:29 user nova-compute[75122]: INFO nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] [instance: cc485c6c-5a9a-4c94-b966-68dd9e336e56] Updating resource usage from migration 1c6b84e0-2ff9-44f1-bd0a-20e98d2f2ac0
Nov 15 09:44:29 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance 131142fd-e8ec-42d1-a518-aa21c7bb7cb1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:44:29 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance fd9d52bb-6248-48e6-a798-6dbdaaa68cbc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:44:29 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance 00270cc2-4f5b-4f64-8f88-31f21e3b3950 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:44:29 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance c2f45f49-0bca-4ae2-bc2a-eed293143489 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:44:29 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance bc80e3fb-b5a3-4685-8ec5-12f8c385b833 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:44:29 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Migration 1c6b84e0-2ff9-44f1-bd0a-20e98d2f2ac0 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 15 09:44:29 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance cc485c6c-5a9a-4c94-b966-68dd9e336e56 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:44:29 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance 8271a429-e252-42bb-8717-e89dfd9739bf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:44:29 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance 49154de0-f941-4ae0-a7af-72e75a4d8040 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:44:29 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance a1121448-8452-4955-8112-7b984921dac6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:44:29 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75122) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 09:44:29 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75122) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 09:44:30 user nova-compute[75122]: DEBUG nova.compute.provider_tree [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Inventory has not changed in ProviderTree for provider: 69a3da65-47be-44c6-b67c-c692b58284ef {{(pid=75122) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 09:44:30 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Inventory has not changed for provider 69a3da65-47be-44c6-b67c-c692b58284ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 09:44:30 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Compute_service record updated for user:user {{(pid=75122) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 09:44:30 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.491s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:44:33 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:44:35 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:44:36 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:44:36 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:44:38 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:44:41 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:44:43 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:44:46 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:44:48 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:44:51 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:44:51 user nova-compute[75122]: DEBUG nova.compute.manager [req-6a8fd345-c630-466f-9acd-e6eb9751d2e2 req-c345c4fc-cffb-4018-a0f6-f96dead835bd service nova] [instance: c2f45f49-0bca-4ae2-bc2a-eed293143489] Received event network-changed-24f9619f-42ba-42cf-b39c-43e14754e913 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:44:51 user nova-compute[75122]: DEBUG nova.compute.manager [req-6a8fd345-c630-466f-9acd-e6eb9751d2e2 req-c345c4fc-cffb-4018-a0f6-f96dead835bd service nova] [instance: c2f45f49-0bca-4ae2-bc2a-eed293143489] Refreshing instance network info cache due to event network-changed-24f9619f-42ba-42cf-b39c-43e14754e913. {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 09:44:51 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-6a8fd345-c630-466f-9acd-e6eb9751d2e2 req-c345c4fc-cffb-4018-a0f6-f96dead835bd service nova] Acquiring lock "refresh_cache-c2f45f49-0bca-4ae2-bc2a-eed293143489" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 09:44:51 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-6a8fd345-c630-466f-9acd-e6eb9751d2e2 req-c345c4fc-cffb-4018-a0f6-f96dead835bd service nova] Acquired lock "refresh_cache-c2f45f49-0bca-4ae2-bc2a-eed293143489" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 09:44:51 user nova-compute[75122]: DEBUG nova.network.neutron [req-6a8fd345-c630-466f-9acd-e6eb9751d2e2 req-c345c4fc-cffb-4018-a0f6-f96dead835bd service nova] [instance: c2f45f49-0bca-4ae2-bc2a-eed293143489] Refreshing network info cache for port 24f9619f-42ba-42cf-b39c-43e14754e913 {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 09:44:51 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-dfe7c78a-8553-4610-9b45-8e043628c93c tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Acquiring lock "c2f45f49-0bca-4ae2-bc2a-eed293143489" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:44:51 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-dfe7c78a-8553-4610-9b45-8e043628c93c tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Lock "c2f45f49-0bca-4ae2-bc2a-eed293143489" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:44:51 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-dfe7c78a-8553-4610-9b45-8e043628c93c tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Acquiring lock "c2f45f49-0bca-4ae2-bc2a-eed293143489-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:44:51 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-dfe7c78a-8553-4610-9b45-8e043628c93c tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Lock "c2f45f49-0bca-4ae2-bc2a-eed293143489-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:44:51 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-dfe7c78a-8553-4610-9b45-8e043628c93c tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Lock "c2f45f49-0bca-4ae2-bc2a-eed293143489-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:44:51 user nova-compute[75122]: INFO nova.compute.manager [None req-dfe7c78a-8553-4610-9b45-8e043628c93c tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] [instance: c2f45f49-0bca-4ae2-bc2a-eed293143489] Terminating instance
Nov 15 09:44:51 user nova-compute[75122]: DEBUG nova.compute.manager [None req-dfe7c78a-8553-4610-9b45-8e043628c93c tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] [instance: c2f45f49-0bca-4ae2-bc2a-eed293143489] Start destroying the instance on the hypervisor. {{(pid=75122) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 09:44:51 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:44:51 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:44:51 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:44:51 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:44:52 user nova-compute[75122]: DEBUG nova.network.neutron [req-6a8fd345-c630-466f-9acd-e6eb9751d2e2 req-c345c4fc-cffb-4018-a0f6-f96dead835bd service nova] [instance: c2f45f49-0bca-4ae2-bc2a-eed293143489] Updated VIF entry in instance network info cache for port 24f9619f-42ba-42cf-b39c-43e14754e913. {{(pid=75122) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 09:44:52 user nova-compute[75122]: DEBUG nova.network.neutron [req-6a8fd345-c630-466f-9acd-e6eb9751d2e2 req-c345c4fc-cffb-4018-a0f6-f96dead835bd service nova] [instance: c2f45f49-0bca-4ae2-bc2a-eed293143489] Updating instance_info_cache with network_info: [{"id": "24f9619f-42ba-42cf-b39c-43e14754e913", "address": "fa:16:3e:92:99:9d", "network": {"id": "387b4fc3-39ad-40c3-bcd7-7526b09e30b7", "bridge": "br-int", "label": "tempest-TestStampPattern-1501769990-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bdc0f52b1c744b91b4f1a4ecd07e07c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24f9619f-42", "ovs_interfaceid": "24f9619f-42ba-42cf-b39c-43e14754e913", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:44:52 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-6a8fd345-c630-466f-9acd-e6eb9751d2e2 req-c345c4fc-cffb-4018-a0f6-f96dead835bd service nova] Releasing lock "refresh_cache-c2f45f49-0bca-4ae2-bc2a-eed293143489" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 09:44:52 user nova-compute[75122]: INFO nova.virt.libvirt.driver [-] [instance: c2f45f49-0bca-4ae2-bc2a-eed293143489] Instance destroyed successfully.
Nov 15 09:44:52 user nova-compute[75122]: DEBUG nova.objects.instance [None req-dfe7c78a-8553-4610-9b45-8e043628c93c tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Lazy-loading 'resources' on Instance uuid c2f45f49-0bca-4ae2-bc2a-eed293143489 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:44:52 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-dfe7c78a-8553-4610-9b45-8e043628c93c tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T09:37:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-928964176',display_name='tempest-TestStampPattern-server-928964176',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-928964176',id=20,image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLTuyc1m0Na8NQ5VH/Tfx2UBRmDQ41qC6ACQUu2KLBVZhr2oW2YpfUnFSSho5blcWwWbXMeGc1bLerwgE7lxS0HgCpcrAeG55ew3eBiC1wjNqqSI1GsVKLlgwinFMYycdQ==',key_name='tempest-TestStampPattern-625128858',keypairs=<?>,launch_index=0,launched_at=2023-11-15T09:38:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bdc0f52b1c744b91b4f1a4ecd07e07c1',ramdisk_id='',reservation_id='r-luv17aa6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-1896212913',owner_user_name='tempest-TestStampPattern-1896212913-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T09:41:01Z,user_data=None,user_id='15a69b87dd164c74af2fed014a3c5f37',uuid=c2f45f49-0bca-4ae2-bc2a-eed293143489,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "24f9619f-42ba-42cf-b39c-43e14754e913", "address": "fa:16:3e:92:99:9d", "network": {"id": "387b4fc3-39ad-40c3-bcd7-7526b09e30b7", "bridge": "br-int", "label": "tempest-TestStampPattern-1501769990-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bdc0f52b1c744b91b4f1a4ecd07e07c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24f9619f-42", "ovs_interfaceid": "24f9619f-42ba-42cf-b39c-43e14754e913", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 09:44:52 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-dfe7c78a-8553-4610-9b45-8e043628c93c tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Converting VIF {"id": "24f9619f-42ba-42cf-b39c-43e14754e913", "address": "fa:16:3e:92:99:9d", "network": {"id": "387b4fc3-39ad-40c3-bcd7-7526b09e30b7", "bridge": "br-int", "label": "tempest-TestStampPattern-1501769990-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bdc0f52b1c744b91b4f1a4ecd07e07c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap24f9619f-42", "ovs_interfaceid": "24f9619f-42ba-42cf-b39c-43e14754e913", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 09:44:52 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-dfe7c78a-8553-4610-9b45-8e043628c93c tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:92:99:9d,bridge_name='br-int',has_traffic_filtering=True,id=24f9619f-42ba-42cf-b39c-43e14754e913,network=Network(387b4fc3-39ad-40c3-bcd7-7526b09e30b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24f9619f-42') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 09:44:52 user nova-compute[75122]: DEBUG os_vif [None req-dfe7c78a-8553-4610-9b45-8e043628c93c tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:92:99:9d,bridge_name='br-int',has_traffic_filtering=True,id=24f9619f-42ba-42cf-b39c-43e14754e913,network=Network(387b4fc3-39ad-40c3-bcd7-7526b09e30b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24f9619f-42') {{(pid=75122) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 09:44:52 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:44:52 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap24f9619f-42, bridge=br-int, if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:44:52 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:44:52 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:44:52 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:44:52 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ea778172-9bfe-49a9-ad85-dc0913f85954) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:44:52 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:44:52 user nova-compute[75122]: INFO os_vif [None req-dfe7c78a-8553-4610-9b45-8e043628c93c tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:92:99:9d,bridge_name='br-int',has_traffic_filtering=True,id=24f9619f-42ba-42cf-b39c-43e14754e913,network=Network(387b4fc3-39ad-40c3-bcd7-7526b09e30b7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap24f9619f-42')
Nov 15 09:44:52 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-dfe7c78a-8553-4610-9b45-8e043628c93c tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] [instance: c2f45f49-0bca-4ae2-bc2a-eed293143489] Deleting instance files /opt/stack/data/nova/instances/c2f45f49-0bca-4ae2-bc2a-eed293143489_del
Nov 15 09:44:52 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-dfe7c78a-8553-4610-9b45-8e043628c93c tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] [instance: c2f45f49-0bca-4ae2-bc2a-eed293143489] Deletion of /opt/stack/data/nova/instances/c2f45f49-0bca-4ae2-bc2a-eed293143489_del complete
Nov 15 09:44:52 user nova-compute[75122]: INFO nova.compute.manager [None req-dfe7c78a-8553-4610-9b45-8e043628c93c tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] [instance: c2f45f49-0bca-4ae2-bc2a-eed293143489] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 15 09:44:52 user nova-compute[75122]: DEBUG oslo.service.loopingcall [None req-dfe7c78a-8553-4610-9b45-8e043628c93c tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75122) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 09:44:52 user nova-compute[75122]: DEBUG nova.compute.manager [-] [instance: c2f45f49-0bca-4ae2-bc2a-eed293143489] Deallocating network for instance {{(pid=75122) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 09:44:52 user nova-compute[75122]: DEBUG nova.network.neutron [-] [instance: c2f45f49-0bca-4ae2-bc2a-eed293143489] deallocate_for_instance() {{(pid=75122) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 09:44:52 user nova-compute[75122]: DEBUG nova.network.neutron [-] [instance: c2f45f49-0bca-4ae2-bc2a-eed293143489] Updating instance_info_cache with network_info: [] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:44:52 user nova-compute[75122]: INFO nova.compute.manager [-] [instance: c2f45f49-0bca-4ae2-bc2a-eed293143489] Took 0.43 seconds to deallocate network for instance.
Nov 15 09:44:52 user nova-compute[75122]: DEBUG nova.compute.manager [req-9db86a4f-be1d-4244-a3bf-978e6431f7ef req-d677231f-574b-4848-8c3d-59e129c7d953 service nova] [instance: c2f45f49-0bca-4ae2-bc2a-eed293143489] Received event network-vif-deleted-24f9619f-42ba-42cf-b39c-43e14754e913 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:44:52 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-dfe7c78a-8553-4610-9b45-8e043628c93c tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:44:52 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-dfe7c78a-8553-4610-9b45-8e043628c93c tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:44:53 user nova-compute[75122]: DEBUG nova.compute.provider_tree [None req-dfe7c78a-8553-4610-9b45-8e043628c93c tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Inventory has not changed in ProviderTree for provider: 69a3da65-47be-44c6-b67c-c692b58284ef {{(pid=75122) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 09:44:53 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-dfe7c78a-8553-4610-9b45-8e043628c93c tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Inventory has not changed for provider 69a3da65-47be-44c6-b67c-c692b58284ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 09:44:53 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-dfe7c78a-8553-4610-9b45-8e043628c93c tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.363s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:44:53 user nova-compute[75122]: INFO nova.scheduler.client.report [None req-dfe7c78a-8553-4610-9b45-8e043628c93c tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Deleted allocations for instance c2f45f49-0bca-4ae2-bc2a-eed293143489
Nov 15 09:44:53 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-dfe7c78a-8553-4610-9b45-8e043628c93c tempest-TestStampPattern-1896212913 tempest-TestStampPattern-1896212913-project-member] Lock "c2f45f49-0bca-4ae2-bc2a-eed293143489" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.864s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:44:53 user nova-compute[75122]: DEBUG nova.compute.manager [req-53fcc6ae-299f-4e70-9aad-ea07d1e187de req-6abae65f-fa9a-4226-a89d-7304b5c24782 service nova] [instance: c2f45f49-0bca-4ae2-bc2a-eed293143489] Received event network-vif-unplugged-24f9619f-42ba-42cf-b39c-43e14754e913 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:44:53 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-53fcc6ae-299f-4e70-9aad-ea07d1e187de req-6abae65f-fa9a-4226-a89d-7304b5c24782 service nova] Acquiring lock "c2f45f49-0bca-4ae2-bc2a-eed293143489-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:44:53 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-53fcc6ae-299f-4e70-9aad-ea07d1e187de req-6abae65f-fa9a-4226-a89d-7304b5c24782 service nova] Lock "c2f45f49-0bca-4ae2-bc2a-eed293143489-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:44:53 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-53fcc6ae-299f-4e70-9aad-ea07d1e187de req-6abae65f-fa9a-4226-a89d-7304b5c24782 service nova] Lock "c2f45f49-0bca-4ae2-bc2a-eed293143489-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:44:53 user nova-compute[75122]: DEBUG nova.compute.manager [req-53fcc6ae-299f-4e70-9aad-ea07d1e187de req-6abae65f-fa9a-4226-a89d-7304b5c24782 service nova] [instance: c2f45f49-0bca-4ae2-bc2a-eed293143489] No waiting events found dispatching network-vif-unplugged-24f9619f-42ba-42cf-b39c-43e14754e913 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:44:53 user nova-compute[75122]: WARNING nova.compute.manager [req-53fcc6ae-299f-4e70-9aad-ea07d1e187de req-6abae65f-fa9a-4226-a89d-7304b5c24782 service nova] [instance: c2f45f49-0bca-4ae2-bc2a-eed293143489] Received unexpected event network-vif-unplugged-24f9619f-42ba-42cf-b39c-43e14754e913 for instance with vm_state deleted and task_state None.
Nov 15 09:44:53 user nova-compute[75122]: DEBUG nova.compute.manager [req-53fcc6ae-299f-4e70-9aad-ea07d1e187de req-6abae65f-fa9a-4226-a89d-7304b5c24782 service nova] [instance: c2f45f49-0bca-4ae2-bc2a-eed293143489] Received event network-vif-plugged-24f9619f-42ba-42cf-b39c-43e14754e913 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:44:53 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-53fcc6ae-299f-4e70-9aad-ea07d1e187de req-6abae65f-fa9a-4226-a89d-7304b5c24782 service nova] Acquiring lock "c2f45f49-0bca-4ae2-bc2a-eed293143489-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:44:53 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-53fcc6ae-299f-4e70-9aad-ea07d1e187de req-6abae65f-fa9a-4226-a89d-7304b5c24782 service nova] Lock "c2f45f49-0bca-4ae2-bc2a-eed293143489-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:44:53 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-53fcc6ae-299f-4e70-9aad-ea07d1e187de req-6abae65f-fa9a-4226-a89d-7304b5c24782 service nova] Lock "c2f45f49-0bca-4ae2-bc2a-eed293143489-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:44:53 user nova-compute[75122]: DEBUG nova.compute.manager [req-53fcc6ae-299f-4e70-9aad-ea07d1e187de req-6abae65f-fa9a-4226-a89d-7304b5c24782 service nova] [instance: c2f45f49-0bca-4ae2-bc2a-eed293143489] No waiting events found dispatching network-vif-plugged-24f9619f-42ba-42cf-b39c-43e14754e913 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:44:53 user nova-compute[75122]: WARNING nova.compute.manager [req-53fcc6ae-299f-4e70-9aad-ea07d1e187de req-6abae65f-fa9a-4226-a89d-7304b5c24782 service nova] [instance: c2f45f49-0bca-4ae2-bc2a-eed293143489] Received unexpected event network-vif-plugged-24f9619f-42ba-42cf-b39c-43e14754e913 for instance with vm_state deleted and task_state None.
Nov 15 09:44:56 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:44:57 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:44:58 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:45:01 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:45:01 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:45:01 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:45:02 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:45:03 user nova-compute[75122]: DEBUG nova.compute.manager [req-c1f40d44-ad17-45b2-86dc-9653080aaaf1 req-bfc4489d-8b72-4a1a-89c4-811cac17650e service nova] [instance: bc80e3fb-b5a3-4685-8ec5-12f8c385b833] Received event network-changed-a4776ec9-b51c-45f4-8e4c-8cbc3d9e8a59 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:45:03 user nova-compute[75122]: DEBUG nova.compute.manager [req-c1f40d44-ad17-45b2-86dc-9653080aaaf1 req-bfc4489d-8b72-4a1a-89c4-811cac17650e service nova] [instance: bc80e3fb-b5a3-4685-8ec5-12f8c385b833] Refreshing instance network info cache due to event network-changed-a4776ec9-b51c-45f4-8e4c-8cbc3d9e8a59. {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 09:45:03 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-c1f40d44-ad17-45b2-86dc-9653080aaaf1 req-bfc4489d-8b72-4a1a-89c4-811cac17650e service nova] Acquiring lock "refresh_cache-bc80e3fb-b5a3-4685-8ec5-12f8c385b833" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 09:45:03 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-c1f40d44-ad17-45b2-86dc-9653080aaaf1 req-bfc4489d-8b72-4a1a-89c4-811cac17650e service nova] Acquired lock "refresh_cache-bc80e3fb-b5a3-4685-8ec5-12f8c385b833" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 09:45:03 user nova-compute[75122]: DEBUG nova.network.neutron [req-c1f40d44-ad17-45b2-86dc-9653080aaaf1 req-bfc4489d-8b72-4a1a-89c4-811cac17650e service nova] [instance: bc80e3fb-b5a3-4685-8ec5-12f8c385b833] Refreshing network info cache for port a4776ec9-b51c-45f4-8e4c-8cbc3d9e8a59 {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 09:45:04 user nova-compute[75122]: DEBUG nova.network.neutron [req-c1f40d44-ad17-45b2-86dc-9653080aaaf1 req-bfc4489d-8b72-4a1a-89c4-811cac17650e service nova] [instance: bc80e3fb-b5a3-4685-8ec5-12f8c385b833] Updated VIF entry in instance network info cache for port a4776ec9-b51c-45f4-8e4c-8cbc3d9e8a59. {{(pid=75122) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 09:45:04 user nova-compute[75122]: DEBUG nova.network.neutron [req-c1f40d44-ad17-45b2-86dc-9653080aaaf1 req-bfc4489d-8b72-4a1a-89c4-811cac17650e service nova] [instance: bc80e3fb-b5a3-4685-8ec5-12f8c385b833] Updating instance_info_cache with network_info: [{"id": "a4776ec9-b51c-45f4-8e4c-8cbc3d9e8a59", "address": "fa:16:3e:8c:f1:36", "network": {"id": "7ab99c1b-e670-416e-b5fe-e1337db6b28d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-487518933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "535c751b9e76421c9262e48fbab3fb6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4776ec9-b5", "ovs_interfaceid": "a4776ec9-b51c-45f4-8e4c-8cbc3d9e8a59", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:45:04 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-c1f40d44-ad17-45b2-86dc-9653080aaaf1 req-bfc4489d-8b72-4a1a-89c4-811cac17650e service nova] Releasing lock "refresh_cache-bc80e3fb-b5a3-4685-8ec5-12f8c385b833" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 09:45:04 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:45:05 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:45:05 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-d8c01b63-6f77-440c-b1c1-ecd98bf15719 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Acquiring lock "bc80e3fb-b5a3-4685-8ec5-12f8c385b833" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:45:05 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-d8c01b63-6f77-440c-b1c1-ecd98bf15719 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Lock "bc80e3fb-b5a3-4685-8ec5-12f8c385b833" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:45:05 user nova-compute[75122]: INFO nova.compute.manager [None req-d8c01b63-6f77-440c-b1c1-ecd98bf15719 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] [instance: bc80e3fb-b5a3-4685-8ec5-12f8c385b833] Shelving
Nov 15 09:45:06 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:45:06 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:45:06 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:45:06 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:45:06 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:45:06 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:45:06 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:45:06 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:45:06 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:45:06 user nova-compute[75122]: INFO nova.virt.libvirt.driver [-] [instance: bc80e3fb-b5a3-4685-8ec5-12f8c385b833] Instance destroyed successfully.
Nov 15 09:45:06 user nova-compute[75122]: DEBUG nova.compute.manager [req-8e020a5b-d587-4c05-b520-a4466c66bcb4 req-642dade1-9821-4cdb-8781-249fcb71b70f service nova] [instance: bc80e3fb-b5a3-4685-8ec5-12f8c385b833] Received event network-vif-unplugged-a4776ec9-b51c-45f4-8e4c-8cbc3d9e8a59 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:45:06 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-8e020a5b-d587-4c05-b520-a4466c66bcb4 req-642dade1-9821-4cdb-8781-249fcb71b70f service nova] Acquiring lock "bc80e3fb-b5a3-4685-8ec5-12f8c385b833-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:45:06 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-8e020a5b-d587-4c05-b520-a4466c66bcb4 req-642dade1-9821-4cdb-8781-249fcb71b70f service nova] Lock "bc80e3fb-b5a3-4685-8ec5-12f8c385b833-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:45:06 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-8e020a5b-d587-4c05-b520-a4466c66bcb4 req-642dade1-9821-4cdb-8781-249fcb71b70f service nova] Lock "bc80e3fb-b5a3-4685-8ec5-12f8c385b833-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:45:06 user nova-compute[75122]: DEBUG nova.compute.manager [req-8e020a5b-d587-4c05-b520-a4466c66bcb4 req-642dade1-9821-4cdb-8781-249fcb71b70f service nova] [instance: bc80e3fb-b5a3-4685-8ec5-12f8c385b833] No waiting events found dispatching network-vif-unplugged-a4776ec9-b51c-45f4-8e4c-8cbc3d9e8a59 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:45:06 user nova-compute[75122]: WARNING nova.compute.manager [req-8e020a5b-d587-4c05-b520-a4466c66bcb4 req-642dade1-9821-4cdb-8781-249fcb71b70f service nova] [instance: bc80e3fb-b5a3-4685-8ec5-12f8c385b833] Received unexpected event network-vif-unplugged-a4776ec9-b51c-45f4-8e4c-8cbc3d9e8a59 for instance with vm_state active and task_state shelving.
Nov 15 09:45:06 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-d8c01b63-6f77-440c-b1c1-ecd98bf15719 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] [instance: bc80e3fb-b5a3-4685-8ec5-12f8c385b833] Beginning cold snapshot process
Nov 15 09:45:06 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:45:07 user nova-compute[75122]: DEBUG nova.privsep.utils [None req-d8c01b63-6f77-440c-b1c1-ecd98bf15719 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75122) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 09:45:07 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-d8c01b63-6f77-440c-b1c1-ecd98bf15719 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/bc80e3fb-b5a3-4685-8ec5-12f8c385b833/disk /opt/stack/data/nova/instances/snapshots/tmpmtdtvtn4/552cb76023d6497ab872536585383fbe {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:45:07 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:45:07 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:45:07 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:45:07 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:45:07 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:45:07 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:45:07 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:45:07 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-d8c01b63-6f77-440c-b1c1-ecd98bf15719 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/bc80e3fb-b5a3-4685-8ec5-12f8c385b833/disk /opt/stack/data/nova/instances/snapshots/tmpmtdtvtn4/552cb76023d6497ab872536585383fbe" returned: 0 in 0.864s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:45:07 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-d8c01b63-6f77-440c-b1c1-ecd98bf15719 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] [instance: bc80e3fb-b5a3-4685-8ec5-12f8c385b833] Snapshot extracted, beginning image upload
Nov 15 09:45:08 user nova-compute[75122]: DEBUG nova.compute.manager [req-17e9d9e0-7a55-4774-9230-ffce74ac80c3 req-afae1263-42a7-4d87-9da8-2abf101d71dd service nova] [instance: bc80e3fb-b5a3-4685-8ec5-12f8c385b833] Received event network-vif-plugged-a4776ec9-b51c-45f4-8e4c-8cbc3d9e8a59 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:45:08 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-17e9d9e0-7a55-4774-9230-ffce74ac80c3 req-afae1263-42a7-4d87-9da8-2abf101d71dd service nova] Acquiring lock "bc80e3fb-b5a3-4685-8ec5-12f8c385b833-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:45:08 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-17e9d9e0-7a55-4774-9230-ffce74ac80c3 req-afae1263-42a7-4d87-9da8-2abf101d71dd service nova] Lock "bc80e3fb-b5a3-4685-8ec5-12f8c385b833-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:45:08 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-17e9d9e0-7a55-4774-9230-ffce74ac80c3 req-afae1263-42a7-4d87-9da8-2abf101d71dd service nova] Lock "bc80e3fb-b5a3-4685-8ec5-12f8c385b833-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:45:08 user nova-compute[75122]: DEBUG nova.compute.manager [req-17e9d9e0-7a55-4774-9230-ffce74ac80c3 req-afae1263-42a7-4d87-9da8-2abf101d71dd service nova] [instance: bc80e3fb-b5a3-4685-8ec5-12f8c385b833] No waiting events found dispatching network-vif-plugged-a4776ec9-b51c-45f4-8e4c-8cbc3d9e8a59 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:45:08 user nova-compute[75122]: WARNING nova.compute.manager [req-17e9d9e0-7a55-4774-9230-ffce74ac80c3 req-afae1263-42a7-4d87-9da8-2abf101d71dd service nova] [instance: bc80e3fb-b5a3-4685-8ec5-12f8c385b833] Received unexpected event network-vif-plugged-a4776ec9-b51c-45f4-8e4c-8cbc3d9e8a59 for instance with vm_state active and task_state shelving_image_uploading.
Nov 15 09:45:08 user nova-compute[75122]: DEBUG nova.compute.manager [req-17e9d9e0-7a55-4774-9230-ffce74ac80c3 req-afae1263-42a7-4d87-9da8-2abf101d71dd service nova] [instance: bc80e3fb-b5a3-4685-8ec5-12f8c385b833] Received event network-vif-plugged-a4776ec9-b51c-45f4-8e4c-8cbc3d9e8a59 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:45:08 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-17e9d9e0-7a55-4774-9230-ffce74ac80c3 req-afae1263-42a7-4d87-9da8-2abf101d71dd service nova] Acquiring lock "bc80e3fb-b5a3-4685-8ec5-12f8c385b833-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:45:08 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-17e9d9e0-7a55-4774-9230-ffce74ac80c3 req-afae1263-42a7-4d87-9da8-2abf101d71dd service nova] Lock "bc80e3fb-b5a3-4685-8ec5-12f8c385b833-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:45:08 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-17e9d9e0-7a55-4774-9230-ffce74ac80c3 req-afae1263-42a7-4d87-9da8-2abf101d71dd service nova] Lock "bc80e3fb-b5a3-4685-8ec5-12f8c385b833-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:45:08 user nova-compute[75122]: DEBUG nova.compute.manager [req-17e9d9e0-7a55-4774-9230-ffce74ac80c3 req-afae1263-42a7-4d87-9da8-2abf101d71dd service nova] [instance: bc80e3fb-b5a3-4685-8ec5-12f8c385b833] No waiting events found dispatching network-vif-plugged-a4776ec9-b51c-45f4-8e4c-8cbc3d9e8a59 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:45:08 user nova-compute[75122]: WARNING nova.compute.manager [req-17e9d9e0-7a55-4774-9230-ffce74ac80c3 req-afae1263-42a7-4d87-9da8-2abf101d71dd service nova] [instance: bc80e3fb-b5a3-4685-8ec5-12f8c385b833] Received unexpected event network-vif-plugged-a4776ec9-b51c-45f4-8e4c-8cbc3d9e8a59 for instance with vm_state active and task_state shelving_image_uploading.
Nov 15 09:45:08 user nova-compute[75122]: DEBUG nova.compute.manager [req-17e9d9e0-7a55-4774-9230-ffce74ac80c3 req-afae1263-42a7-4d87-9da8-2abf101d71dd service nova] [instance: bc80e3fb-b5a3-4685-8ec5-12f8c385b833] Received event network-vif-plugged-a4776ec9-b51c-45f4-8e4c-8cbc3d9e8a59 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:45:08 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-17e9d9e0-7a55-4774-9230-ffce74ac80c3 req-afae1263-42a7-4d87-9da8-2abf101d71dd service nova] Acquiring lock "bc80e3fb-b5a3-4685-8ec5-12f8c385b833-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:45:08 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-17e9d9e0-7a55-4774-9230-ffce74ac80c3 req-afae1263-42a7-4d87-9da8-2abf101d71dd service nova] Lock "bc80e3fb-b5a3-4685-8ec5-12f8c385b833-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:45:08 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-17e9d9e0-7a55-4774-9230-ffce74ac80c3 req-afae1263-42a7-4d87-9da8-2abf101d71dd service nova] Lock "bc80e3fb-b5a3-4685-8ec5-12f8c385b833-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:45:08 user nova-compute[75122]: DEBUG nova.compute.manager [req-17e9d9e0-7a55-4774-9230-ffce74ac80c3 req-afae1263-42a7-4d87-9da8-2abf101d71dd service nova] [instance: bc80e3fb-b5a3-4685-8ec5-12f8c385b833] No waiting events found dispatching network-vif-plugged-a4776ec9-b51c-45f4-8e4c-8cbc3d9e8a59 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:45:08 user nova-compute[75122]: WARNING nova.compute.manager [req-17e9d9e0-7a55-4774-9230-ffce74ac80c3 req-afae1263-42a7-4d87-9da8-2abf101d71dd service nova] [instance: bc80e3fb-b5a3-4685-8ec5-12f8c385b833] Received unexpected event network-vif-plugged-a4776ec9-b51c-45f4-8e4c-8cbc3d9e8a59 for instance with vm_state active and task_state shelving_image_uploading.
Nov 15 09:45:08 user nova-compute[75122]: DEBUG nova.compute.manager [req-17e9d9e0-7a55-4774-9230-ffce74ac80c3 req-afae1263-42a7-4d87-9da8-2abf101d71dd service nova] [instance: bc80e3fb-b5a3-4685-8ec5-12f8c385b833] Received event network-vif-unplugged-a4776ec9-b51c-45f4-8e4c-8cbc3d9e8a59 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:45:08 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-17e9d9e0-7a55-4774-9230-ffce74ac80c3 req-afae1263-42a7-4d87-9da8-2abf101d71dd service nova] Acquiring lock "bc80e3fb-b5a3-4685-8ec5-12f8c385b833-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:45:08 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-17e9d9e0-7a55-4774-9230-ffce74ac80c3 req-afae1263-42a7-4d87-9da8-2abf101d71dd service nova] Lock "bc80e3fb-b5a3-4685-8ec5-12f8c385b833-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:45:08 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-17e9d9e0-7a55-4774-9230-ffce74ac80c3 req-afae1263-42a7-4d87-9da8-2abf101d71dd service nova] Lock "bc80e3fb-b5a3-4685-8ec5-12f8c385b833-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:45:08 user nova-compute[75122]: DEBUG nova.compute.manager [req-17e9d9e0-7a55-4774-9230-ffce74ac80c3 req-afae1263-42a7-4d87-9da8-2abf101d71dd service nova] [instance: bc80e3fb-b5a3-4685-8ec5-12f8c385b833] No waiting events found dispatching network-vif-unplugged-a4776ec9-b51c-45f4-8e4c-8cbc3d9e8a59 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:45:08 user nova-compute[75122]: WARNING nova.compute.manager [req-17e9d9e0-7a55-4774-9230-ffce74ac80c3 req-afae1263-42a7-4d87-9da8-2abf101d71dd service nova] [instance: bc80e3fb-b5a3-4685-8ec5-12f8c385b833] Received unexpected event network-vif-unplugged-a4776ec9-b51c-45f4-8e4c-8cbc3d9e8a59 for instance with vm_state active and task_state shelving_image_uploading.
Nov 15 09:45:08 user nova-compute[75122]: DEBUG nova.compute.manager [req-17e9d9e0-7a55-4774-9230-ffce74ac80c3 req-afae1263-42a7-4d87-9da8-2abf101d71dd service nova] [instance: bc80e3fb-b5a3-4685-8ec5-12f8c385b833] Received event network-vif-plugged-a4776ec9-b51c-45f4-8e4c-8cbc3d9e8a59 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:45:08 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-17e9d9e0-7a55-4774-9230-ffce74ac80c3 req-afae1263-42a7-4d87-9da8-2abf101d71dd service nova] Acquiring lock "bc80e3fb-b5a3-4685-8ec5-12f8c385b833-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:45:08 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-17e9d9e0-7a55-4774-9230-ffce74ac80c3 req-afae1263-42a7-4d87-9da8-2abf101d71dd service nova] Lock "bc80e3fb-b5a3-4685-8ec5-12f8c385b833-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:45:08 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-17e9d9e0-7a55-4774-9230-ffce74ac80c3 req-afae1263-42a7-4d87-9da8-2abf101d71dd service nova] Lock "bc80e3fb-b5a3-4685-8ec5-12f8c385b833-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:45:08 user nova-compute[75122]: DEBUG nova.compute.manager [req-17e9d9e0-7a55-4774-9230-ffce74ac80c3 req-afae1263-42a7-4d87-9da8-2abf101d71dd service nova] [instance: bc80e3fb-b5a3-4685-8ec5-12f8c385b833] No waiting events found dispatching network-vif-plugged-a4776ec9-b51c-45f4-8e4c-8cbc3d9e8a59 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:45:08 user nova-compute[75122]: WARNING nova.compute.manager [req-17e9d9e0-7a55-4774-9230-ffce74ac80c3 req-afae1263-42a7-4d87-9da8-2abf101d71dd service nova] [instance: bc80e3fb-b5a3-4685-8ec5-12f8c385b833] Received unexpected event network-vif-plugged-a4776ec9-b51c-45f4-8e4c-8cbc3d9e8a59 for instance with vm_state active and task_state shelving_image_uploading.
Nov 15 09:45:08 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:45:10 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-18680f7a-4d78-4744-9962-887452922f5b tempest-VolumesActionsTest-604748613 tempest-VolumesActionsTest-604748613-project-member] Acquiring lock "ca2defb6-c4ac-4d39-bdd2-1e0ac3265e02" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:45:10 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-18680f7a-4d78-4744-9962-887452922f5b tempest-VolumesActionsTest-604748613 tempest-VolumesActionsTest-604748613-project-member] Lock "ca2defb6-c4ac-4d39-bdd2-1e0ac3265e02" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:45:10 user nova-compute[75122]: DEBUG nova.compute.manager [None req-18680f7a-4d78-4744-9962-887452922f5b tempest-VolumesActionsTest-604748613 tempest-VolumesActionsTest-604748613-project-member] [instance: ca2defb6-c4ac-4d39-bdd2-1e0ac3265e02] Starting instance... {{(pid=75122) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 09:45:10 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-18680f7a-4d78-4744-9962-887452922f5b tempest-VolumesActionsTest-604748613 tempest-VolumesActionsTest-604748613-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:45:10 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-18680f7a-4d78-4744-9962-887452922f5b tempest-VolumesActionsTest-604748613 tempest-VolumesActionsTest-604748613-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:45:10 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-18680f7a-4d78-4744-9962-887452922f5b tempest-VolumesActionsTest-604748613 tempest-VolumesActionsTest-604748613-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75122) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 09:45:10 user nova-compute[75122]: INFO nova.compute.claims [None req-18680f7a-4d78-4744-9962-887452922f5b tempest-VolumesActionsTest-604748613 tempest-VolumesActionsTest-604748613-project-member] [instance: ca2defb6-c4ac-4d39-bdd2-1e0ac3265e02] Claim successful on node user
Nov 15 09:45:10 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-d8c01b63-6f77-440c-b1c1-ecd98bf15719 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] [instance: bc80e3fb-b5a3-4685-8ec5-12f8c385b833] Snapshot image upload complete
Nov 15 09:45:10 user nova-compute[75122]: DEBUG nova.compute.manager [None req-d8c01b63-6f77-440c-b1c1-ecd98bf15719 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] [instance: bc80e3fb-b5a3-4685-8ec5-12f8c385b833] Checking state {{(pid=75122) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 09:45:10 user nova-compute[75122]: INFO nova.compute.manager [None req-d8c01b63-6f77-440c-b1c1-ecd98bf15719 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] [instance: bc80e3fb-b5a3-4685-8ec5-12f8c385b833] Shelve offloading
Nov 15 09:45:10 user nova-compute[75122]: INFO nova.virt.libvirt.driver [-] [instance: bc80e3fb-b5a3-4685-8ec5-12f8c385b833] Instance destroyed successfully.
Nov 15 09:45:10 user nova-compute[75122]: DEBUG nova.compute.manager [None req-d8c01b63-6f77-440c-b1c1-ecd98bf15719 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] [instance: bc80e3fb-b5a3-4685-8ec5-12f8c385b833] Checking state {{(pid=75122) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 09:45:10 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-d8c01b63-6f77-440c-b1c1-ecd98bf15719 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Acquiring lock "refresh_cache-bc80e3fb-b5a3-4685-8ec5-12f8c385b833" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 09:45:10 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-d8c01b63-6f77-440c-b1c1-ecd98bf15719 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Acquired lock "refresh_cache-bc80e3fb-b5a3-4685-8ec5-12f8c385b833" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 09:45:10 user nova-compute[75122]: DEBUG nova.network.neutron [None req-d8c01b63-6f77-440c-b1c1-ecd98bf15719 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] [instance: bc80e3fb-b5a3-4685-8ec5-12f8c385b833] Building network info cache for instance {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 09:45:10 user nova-compute[75122]: DEBUG nova.compute.provider_tree [None req-18680f7a-4d78-4744-9962-887452922f5b tempest-VolumesActionsTest-604748613 tempest-VolumesActionsTest-604748613-project-member] Inventory has not changed in ProviderTree for provider: 69a3da65-47be-44c6-b67c-c692b58284ef {{(pid=75122) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 09:45:10 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-18680f7a-4d78-4744-9962-887452922f5b tempest-VolumesActionsTest-604748613 tempest-VolumesActionsTest-604748613-project-member] Inventory has not changed for provider 69a3da65-47be-44c6-b67c-c692b58284ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 09:45:10 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-18680f7a-4d78-4744-9962-887452922f5b tempest-VolumesActionsTest-604748613 tempest-VolumesActionsTest-604748613-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.408s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:45:10 user nova-compute[75122]: DEBUG nova.compute.manager [None req-18680f7a-4d78-4744-9962-887452922f5b tempest-VolumesActionsTest-604748613 tempest-VolumesActionsTest-604748613-project-member] [instance: ca2defb6-c4ac-4d39-bdd2-1e0ac3265e02] Start building networks asynchronously for instance. {{(pid=75122) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 09:45:10 user nova-compute[75122]: DEBUG nova.compute.manager [None req-18680f7a-4d78-4744-9962-887452922f5b tempest-VolumesActionsTest-604748613 tempest-VolumesActionsTest-604748613-project-member] [instance: ca2defb6-c4ac-4d39-bdd2-1e0ac3265e02] Allocating IP information in the background. {{(pid=75122) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 09:45:10 user nova-compute[75122]: DEBUG nova.network.neutron [None req-18680f7a-4d78-4744-9962-887452922f5b tempest-VolumesActionsTest-604748613 tempest-VolumesActionsTest-604748613-project-member] [instance: ca2defb6-c4ac-4d39-bdd2-1e0ac3265e02] allocate_for_instance() {{(pid=75122) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 09:45:11 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-18680f7a-4d78-4744-9962-887452922f5b tempest-VolumesActionsTest-604748613 tempest-VolumesActionsTest-604748613-project-member] [instance: ca2defb6-c4ac-4d39-bdd2-1e0ac3265e02] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 09:45:11 user nova-compute[75122]: DEBUG nova.compute.manager [None req-18680f7a-4d78-4744-9962-887452922f5b tempest-VolumesActionsTest-604748613 tempest-VolumesActionsTest-604748613-project-member] [instance: ca2defb6-c4ac-4d39-bdd2-1e0ac3265e02] Start building block device mappings for instance. {{(pid=75122) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 09:45:11 user nova-compute[75122]: DEBUG nova.policy [None req-18680f7a-4d78-4744-9962-887452922f5b tempest-VolumesActionsTest-604748613 tempest-VolumesActionsTest-604748613-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '59a289904f92493d83167ac2ff91e6b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdd526581df1473887708d42296c94b2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75122) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 09:45:11 user nova-compute[75122]: DEBUG nova.network.neutron [None req-d8c01b63-6f77-440c-b1c1-ecd98bf15719 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] [instance: bc80e3fb-b5a3-4685-8ec5-12f8c385b833] Updating instance_info_cache with network_info: [{"id": "a4776ec9-b51c-45f4-8e4c-8cbc3d9e8a59", "address": "fa:16:3e:8c:f1:36", "network": {"id": "7ab99c1b-e670-416e-b5fe-e1337db6b28d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-487518933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "535c751b9e76421c9262e48fbab3fb6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4776ec9-b5", "ovs_interfaceid": "a4776ec9-b51c-45f4-8e4c-8cbc3d9e8a59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:45:11 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-d8c01b63-6f77-440c-b1c1-ecd98bf15719 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Releasing lock "refresh_cache-bc80e3fb-b5a3-4685-8ec5-12f8c385b833" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 09:45:11 user nova-compute[75122]: DEBUG nova.compute.manager [None req-18680f7a-4d78-4744-9962-887452922f5b tempest-VolumesActionsTest-604748613 tempest-VolumesActionsTest-604748613-project-member] [instance: ca2defb6-c4ac-4d39-bdd2-1e0ac3265e02] Start spawning the instance on the hypervisor. {{(pid=75122) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 09:45:11 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-18680f7a-4d78-4744-9962-887452922f5b tempest-VolumesActionsTest-604748613 tempest-VolumesActionsTest-604748613-project-member] [instance: ca2defb6-c4ac-4d39-bdd2-1e0ac3265e02] Creating instance directory {{(pid=75122) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 09:45:11 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-18680f7a-4d78-4744-9962-887452922f5b tempest-VolumesActionsTest-604748613 tempest-VolumesActionsTest-604748613-project-member] [instance: ca2defb6-c4ac-4d39-bdd2-1e0ac3265e02] Creating image(s)
Nov 15 09:45:11 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-18680f7a-4d78-4744-9962-887452922f5b tempest-VolumesActionsTest-604748613 tempest-VolumesActionsTest-604748613-project-member] Acquiring lock "/opt/stack/data/nova/instances/ca2defb6-c4ac-4d39-bdd2-1e0ac3265e02/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:45:11 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-18680f7a-4d78-4744-9962-887452922f5b tempest-VolumesActionsTest-604748613 tempest-VolumesActionsTest-604748613-project-member] Lock "/opt/stack/data/nova/instances/ca2defb6-c4ac-4d39-bdd2-1e0ac3265e02/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:45:11 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-18680f7a-4d78-4744-9962-887452922f5b tempest-VolumesActionsTest-604748613 tempest-VolumesActionsTest-604748613-project-member] Lock "/opt/stack/data/nova/instances/ca2defb6-c4ac-4d39-bdd2-1e0ac3265e02/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:45:11 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-18680f7a-4d78-4744-9962-887452922f5b tempest-VolumesActionsTest-604748613 tempest-VolumesActionsTest-604748613-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:45:11 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:45:11 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-18680f7a-4d78-4744-9962-887452922f5b tempest-VolumesActionsTest-604748613 tempest-VolumesActionsTest-604748613-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json" returned: 0 in 0.173s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:45:11 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-18680f7a-4d78-4744-9962-887452922f5b tempest-VolumesActionsTest-604748613 tempest-VolumesActionsTest-604748613-project-member] Acquiring lock "95d6e29f74d5408f818e32f3bc29bc8270a4c665" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:45:11 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-18680f7a-4d78-4744-9962-887452922f5b tempest-VolumesActionsTest-604748613 tempest-VolumesActionsTest-604748613-project-member] Lock "95d6e29f74d5408f818e32f3bc29bc8270a4c665" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:45:11 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-18680f7a-4d78-4744-9962-887452922f5b tempest-VolumesActionsTest-604748613 tempest-VolumesActionsTest-604748613-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:45:11 user nova-compute[75122]: DEBUG nova.network.neutron [None req-18680f7a-4d78-4744-9962-887452922f5b tempest-VolumesActionsTest-604748613 tempest-VolumesActionsTest-604748613-project-member] [instance: ca2defb6-c4ac-4d39-bdd2-1e0ac3265e02] Successfully created port: df4e3999-a4c6-439b-9407-6f2e8127a3b6 {{(pid=75122) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 09:45:11 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-18680f7a-4d78-4744-9962-887452922f5b tempest-VolumesActionsTest-604748613 tempest-VolumesActionsTest-604748613-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json" returned: 0 in 0.195s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:45:11 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-18680f7a-4d78-4744-9962-887452922f5b tempest-VolumesActionsTest-604748613 tempest-VolumesActionsTest-604748613-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665,backing_fmt=raw /opt/stack/data/nova/instances/ca2defb6-c4ac-4d39-bdd2-1e0ac3265e02/disk 1073741824 {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:45:11 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-18680f7a-4d78-4744-9962-887452922f5b tempest-VolumesActionsTest-604748613 tempest-VolumesActionsTest-604748613-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665,backing_fmt=raw /opt/stack/data/nova/instances/ca2defb6-c4ac-4d39-bdd2-1e0ac3265e02/disk 1073741824" returned: 0 in 0.051s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:45:11 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-18680f7a-4d78-4744-9962-887452922f5b tempest-VolumesActionsTest-604748613 tempest-VolumesActionsTest-604748613-project-member] Lock "95d6e29f74d5408f818e32f3bc29bc8270a4c665" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.252s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:45:11 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-18680f7a-4d78-4744-9962-887452922f5b tempest-VolumesActionsTest-604748613 tempest-VolumesActionsTest-604748613-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:45:11 user nova-compute[75122]: INFO nova.virt.libvirt.driver [-] [instance: bc80e3fb-b5a3-4685-8ec5-12f8c385b833] Instance destroyed successfully.
Nov 15 09:45:11 user nova-compute[75122]: DEBUG nova.objects.instance [None req-d8c01b63-6f77-440c-b1c1-ecd98bf15719 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Lazy-loading 'resources' on Instance uuid bc80e3fb-b5a3-4685-8ec5-12f8c385b833 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:45:11 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-d8c01b63-6f77-440c-b1c1-ecd98bf15719 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T09:43:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-163449221',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-163449221',id=29,image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJfEuPLuVH5xqWrSMchZ/D472KVFUB0l6HnFeBNP5ISHr0hl+yReqPqomRDnTEO/skiLFiaQqOkcDJWvEVPbCsE6HHOsaS7zMjbvhh02/xzV3QyLU+3VyYUKh9zh6YINxw==',key_name='tempest-keypair-785756428',keypairs=<?>,launch_index=0,launched_at=2023-11-15T09:43:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='535c751b9e76421c9262e48fbab3fb6f',ramdisk_id='',reservation_id='r-s195psec',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1659813957',owner_user_name='tempest-AttachVolumeShelveTestJSON-1659813957-project-member',shelved_at='2023-11-15T09:45:10.578990',shelved_host='user',shelved_image_id='6aff3e94-be37-4c75-ab89-92e2c713f30e'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T09:45:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad06186836ed40a49a05ef7cc9afd1bc',uuid=bc80e3fb-b5a3-4685-8ec5-12f8c385b833,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "a4776ec9-b51c-45f4-8e4c-8cbc3d9e8a59", "address": "fa:16:3e:8c:f1:36", "network": {"id": "7ab99c1b-e670-416e-b5fe-e1337db6b28d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-487518933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "535c751b9e76421c9262e48fbab3fb6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4776ec9-b5", "ovs_interfaceid": "a4776ec9-b51c-45f4-8e4c-8cbc3d9e8a59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 09:45:11 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-d8c01b63-6f77-440c-b1c1-ecd98bf15719 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Converting VIF {"id": "a4776ec9-b51c-45f4-8e4c-8cbc3d9e8a59", "address": "fa:16:3e:8c:f1:36", "network": {"id": "7ab99c1b-e670-416e-b5fe-e1337db6b28d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-487518933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "535c751b9e76421c9262e48fbab3fb6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4776ec9-b5", "ovs_interfaceid": "a4776ec9-b51c-45f4-8e4c-8cbc3d9e8a59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 09:45:11 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-d8c01b63-6f77-440c-b1c1-ecd98bf15719 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:f1:36,bridge_name='br-int',has_traffic_filtering=True,id=a4776ec9-b51c-45f4-8e4c-8cbc3d9e8a59,network=Network(7ab99c1b-e670-416e-b5fe-e1337db6b28d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4776ec9-b5') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 09:45:11 user nova-compute[75122]: DEBUG os_vif [None req-d8c01b63-6f77-440c-b1c1-ecd98bf15719 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:f1:36,bridge_name='br-int',has_traffic_filtering=True,id=a4776ec9-b51c-45f4-8e4c-8cbc3d9e8a59,network=Network(7ab99c1b-e670-416e-b5fe-e1337db6b28d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4776ec9-b5') {{(pid=75122) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 09:45:11 user nova-compute[75122]: DEBUG nova.compute.manager [req-9c83483b-a0e4-4ca9-9198-2ae490e164fe req-bca5a6ba-f57c-48bf-8b11-dba9cd5ee619 service nova] [instance: bc80e3fb-b5a3-4685-8ec5-12f8c385b833] Received event network-changed-a4776ec9-b51c-45f4-8e4c-8cbc3d9e8a59 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:45:11 user nova-compute[75122]: DEBUG nova.compute.manager [req-9c83483b-a0e4-4ca9-9198-2ae490e164fe req-bca5a6ba-f57c-48bf-8b11-dba9cd5ee619 service nova] [instance: bc80e3fb-b5a3-4685-8ec5-12f8c385b833] Refreshing instance network info cache due to event network-changed-a4776ec9-b51c-45f4-8e4c-8cbc3d9e8a59. {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 09:45:11 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-9c83483b-a0e4-4ca9-9198-2ae490e164fe req-bca5a6ba-f57c-48bf-8b11-dba9cd5ee619 service nova] Acquiring lock "refresh_cache-bc80e3fb-b5a3-4685-8ec5-12f8c385b833" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 09:45:11 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-9c83483b-a0e4-4ca9-9198-2ae490e164fe req-bca5a6ba-f57c-48bf-8b11-dba9cd5ee619 service nova] Acquired lock "refresh_cache-bc80e3fb-b5a3-4685-8ec5-12f8c385b833" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 09:45:11 user nova-compute[75122]: DEBUG nova.network.neutron [req-9c83483b-a0e4-4ca9-9198-2ae490e164fe req-bca5a6ba-f57c-48bf-8b11-dba9cd5ee619 service nova] [instance: bc80e3fb-b5a3-4685-8ec5-12f8c385b833] Refreshing network info cache for port a4776ec9-b51c-45f4-8e4c-8cbc3d9e8a59 {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 09:45:11 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:45:11 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa4776ec9-b5, bridge=br-int, if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:45:11 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:45:11 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:45:11 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:45:11 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=18b7d54d-8f65-4c1a-9fbe-5401d20593c4) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:45:11 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:45:11 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:45:11 user nova-compute[75122]: INFO os_vif [None req-d8c01b63-6f77-440c-b1c1-ecd98bf15719 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:f1:36,bridge_name='br-int',has_traffic_filtering=True,id=a4776ec9-b51c-45f4-8e4c-8cbc3d9e8a59,network=Network(7ab99c1b-e670-416e-b5fe-e1337db6b28d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4776ec9-b5')
Nov 15 09:45:11 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-d8c01b63-6f77-440c-b1c1-ecd98bf15719 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] [instance: bc80e3fb-b5a3-4685-8ec5-12f8c385b833] Deleting instance files /opt/stack/data/nova/instances/bc80e3fb-b5a3-4685-8ec5-12f8c385b833_del
Nov 15 09:45:11 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-d8c01b63-6f77-440c-b1c1-ecd98bf15719 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] [instance: bc80e3fb-b5a3-4685-8ec5-12f8c385b833] Deletion of /opt/stack/data/nova/instances/bc80e3fb-b5a3-4685-8ec5-12f8c385b833_del complete
Nov 15 09:45:11 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-18680f7a-4d78-4744-9962-887452922f5b tempest-VolumesActionsTest-604748613 tempest-VolumesActionsTest-604748613-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json" returned: 0 in 0.189s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:45:11 user nova-compute[75122]: DEBUG nova.virt.disk.api [None req-18680f7a-4d78-4744-9962-887452922f5b tempest-VolumesActionsTest-604748613 tempest-VolumesActionsTest-604748613-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ca2defb6-c4ac-4d39-bdd2-1e0ac3265e02/disk. size=1073741824 {{(pid=75122) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 09:45:11 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-18680f7a-4d78-4744-9962-887452922f5b tempest-VolumesActionsTest-604748613 tempest-VolumesActionsTest-604748613-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca2defb6-c4ac-4d39-bdd2-1e0ac3265e02/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:45:11 user nova-compute[75122]: INFO nova.scheduler.client.report [None req-d8c01b63-6f77-440c-b1c1-ecd98bf15719 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Deleted allocations for instance bc80e3fb-b5a3-4685-8ec5-12f8c385b833
Nov 15 09:45:11 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-d8c01b63-6f77-440c-b1c1-ecd98bf15719 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:45:11 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-d8c01b63-6f77-440c-b1c1-ecd98bf15719 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:45:11 user nova-compute[75122]: DEBUG nova.objects.instance [None req-d8c01b63-6f77-440c-b1c1-ecd98bf15719 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Lazy-loading 'numa_topology' on Instance uuid bc80e3fb-b5a3-4685-8ec5-12f8c385b833 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:45:11 user nova-compute[75122]: DEBUG nova.objects.base [None req-d8c01b63-6f77-440c-b1c1-ecd98bf15719 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Object Instance<bc80e3fb-b5a3-4685-8ec5-12f8c385b833> lazy-loaded attributes: resources,numa_topology {{(pid=75122) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 09:45:11 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-18680f7a-4d78-4744-9962-887452922f5b tempest-VolumesActionsTest-604748613 tempest-VolumesActionsTest-604748613-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca2defb6-c4ac-4d39-bdd2-1e0ac3265e02/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:45:11 user nova-compute[75122]: DEBUG nova.virt.disk.api [None req-18680f7a-4d78-4744-9962-887452922f5b tempest-VolumesActionsTest-604748613 tempest-VolumesActionsTest-604748613-project-member] Cannot resize image /opt/stack/data/nova/instances/ca2defb6-c4ac-4d39-bdd2-1e0ac3265e02/disk to a smaller size. {{(pid=75122) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 09:45:11 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-18680f7a-4d78-4744-9962-887452922f5b tempest-VolumesActionsTest-604748613 tempest-VolumesActionsTest-604748613-project-member] [instance: ca2defb6-c4ac-4d39-bdd2-1e0ac3265e02] Created local disks {{(pid=75122) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 09:45:11 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-18680f7a-4d78-4744-9962-887452922f5b tempest-VolumesActionsTest-604748613 tempest-VolumesActionsTest-604748613-project-member] [instance: ca2defb6-c4ac-4d39-bdd2-1e0ac3265e02] Ensure instance console log exists: /opt/stack/data/nova/instances/ca2defb6-c4ac-4d39-bdd2-1e0ac3265e02/console.log {{(pid=75122) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 09:45:11 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-18680f7a-4d78-4744-9962-887452922f5b tempest-VolumesActionsTest-604748613 tempest-VolumesActionsTest-604748613-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:45:11 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-18680f7a-4d78-4744-9962-887452922f5b tempest-VolumesActionsTest-604748613 tempest-VolumesActionsTest-604748613-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:45:11 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-18680f7a-4d78-4744-9962-887452922f5b tempest-VolumesActionsTest-604748613 tempest-VolumesActionsTest-604748613-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:45:12 user nova-compute[75122]: DEBUG nova.network.neutron [req-9c83483b-a0e4-4ca9-9198-2ae490e164fe req-bca5a6ba-f57c-48bf-8b11-dba9cd5ee619 service nova] [instance: bc80e3fb-b5a3-4685-8ec5-12f8c385b833] Updated VIF entry in instance network info cache for port a4776ec9-b51c-45f4-8e4c-8cbc3d9e8a59. {{(pid=75122) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 09:45:12 user nova-compute[75122]: DEBUG nova.network.neutron [req-9c83483b-a0e4-4ca9-9198-2ae490e164fe req-bca5a6ba-f57c-48bf-8b11-dba9cd5ee619 service nova] [instance: bc80e3fb-b5a3-4685-8ec5-12f8c385b833] Updating instance_info_cache with network_info: [{"id": "a4776ec9-b51c-45f4-8e4c-8cbc3d9e8a59", "address": "fa:16:3e:8c:f1:36", "network": {"id": "7ab99c1b-e670-416e-b5fe-e1337db6b28d", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-487518933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "535c751b9e76421c9262e48fbab3fb6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapa4776ec9-b5", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:45:12 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-9c83483b-a0e4-4ca9-9198-2ae490e164fe req-bca5a6ba-f57c-48bf-8b11-dba9cd5ee619 service nova] Releasing lock "refresh_cache-bc80e3fb-b5a3-4685-8ec5-12f8c385b833" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 09:45:12 user nova-compute[75122]: DEBUG nova.network.neutron [None req-18680f7a-4d78-4744-9962-887452922f5b tempest-VolumesActionsTest-604748613 tempest-VolumesActionsTest-604748613-project-member] [instance: ca2defb6-c4ac-4d39-bdd2-1e0ac3265e02] Successfully updated port: df4e3999-a4c6-439b-9407-6f2e8127a3b6 {{(pid=75122) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 09:45:12 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-18680f7a-4d78-4744-9962-887452922f5b tempest-VolumesActionsTest-604748613 tempest-VolumesActionsTest-604748613-project-member] Acquiring lock "refresh_cache-ca2defb6-c4ac-4d39-bdd2-1e0ac3265e02" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 09:45:12 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-18680f7a-4d78-4744-9962-887452922f5b tempest-VolumesActionsTest-604748613 tempest-VolumesActionsTest-604748613-project-member] Acquired lock "refresh_cache-ca2defb6-c4ac-4d39-bdd2-1e0ac3265e02" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 09:45:12 user nova-compute[75122]: DEBUG nova.network.neutron [None req-18680f7a-4d78-4744-9962-887452922f5b tempest-VolumesActionsTest-604748613 tempest-VolumesActionsTest-604748613-project-member] [instance: ca2defb6-c4ac-4d39-bdd2-1e0ac3265e02] Building network info cache for instance {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 09:45:12 user nova-compute[75122]: DEBUG nova.compute.manager [req-889024af-2ad6-4ec2-8be5-4a84c629e76b req-f39bf394-9d56-4a46-bf61-a58717862c1e service nova] [instance: ca2defb6-c4ac-4d39-bdd2-1e0ac3265e02] Received event network-changed-df4e3999-a4c6-439b-9407-6f2e8127a3b6 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:45:12 user nova-compute[75122]: DEBUG nova.compute.manager [req-889024af-2ad6-4ec2-8be5-4a84c629e76b req-f39bf394-9d56-4a46-bf61-a58717862c1e service nova] [instance: ca2defb6-c4ac-4d39-bdd2-1e0ac3265e02] Refreshing instance network info cache due to event network-changed-df4e3999-a4c6-439b-9407-6f2e8127a3b6. {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 09:45:12 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-889024af-2ad6-4ec2-8be5-4a84c629e76b req-f39bf394-9d56-4a46-bf61-a58717862c1e service nova] Acquiring lock "refresh_cache-ca2defb6-c4ac-4d39-bdd2-1e0ac3265e02" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 09:45:12 user nova-compute[75122]: DEBUG nova.compute.provider_tree [None req-d8c01b63-6f77-440c-b1c1-ecd98bf15719 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Inventory has not changed in ProviderTree for provider: 69a3da65-47be-44c6-b67c-c692b58284ef {{(pid=75122) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 09:45:12 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-d8c01b63-6f77-440c-b1c1-ecd98bf15719 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Inventory has not changed for provider 69a3da65-47be-44c6-b67c-c692b58284ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 09:45:12 user nova-compute[75122]: DEBUG nova.network.neutron [None req-18680f7a-4d78-4744-9962-887452922f5b tempest-VolumesActionsTest-604748613 tempest-VolumesActionsTest-604748613-project-member] [instance: ca2defb6-c4ac-4d39-bdd2-1e0ac3265e02] Instance cache missing network info. {{(pid=75122) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 09:45:12 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-d8c01b63-6f77-440c-b1c1-ecd98bf15719 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.634s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:45:12 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-d8c01b63-6f77-440c-b1c1-ecd98bf15719 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Lock "bc80e3fb-b5a3-4685-8ec5-12f8c385b833" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.729s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:45:12 user nova-compute[75122]: DEBUG nova.network.neutron [None req-18680f7a-4d78-4744-9962-887452922f5b tempest-VolumesActionsTest-604748613 tempest-VolumesActionsTest-604748613-project-member] [instance: ca2defb6-c4ac-4d39-bdd2-1e0ac3265e02] Updating instance_info_cache with network_info: [{"id": "df4e3999-a4c6-439b-9407-6f2e8127a3b6", "address": "fa:16:3e:80:13:ef", "network": {"id": "1c55a58a-06fb-4975-bf19-fd2936a31571", "bridge": "br-int", "label": "tempest-VolumesActionsTest-636321201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bdd526581df1473887708d42296c94b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf4e3999-a4", "ovs_interfaceid": "df4e3999-a4c6-439b-9407-6f2e8127a3b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:45:12 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-18680f7a-4d78-4744-9962-887452922f5b tempest-VolumesActionsTest-604748613 tempest-VolumesActionsTest-604748613-project-member] Releasing lock "refresh_cache-ca2defb6-c4ac-4d39-bdd2-1e0ac3265e02" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 09:45:12 user nova-compute[75122]: DEBUG nova.compute.manager [None req-18680f7a-4d78-4744-9962-887452922f5b tempest-VolumesActionsTest-604748613 tempest-VolumesActionsTest-604748613-project-member] [instance: ca2defb6-c4ac-4d39-bdd2-1e0ac3265e02] Instance network_info: |[{"id": "df4e3999-a4c6-439b-9407-6f2e8127a3b6", "address": "fa:16:3e:80:13:ef", "network": {"id": "1c55a58a-06fb-4975-bf19-fd2936a31571", "bridge": "br-int", "label": "tempest-VolumesActionsTest-636321201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bdd526581df1473887708d42296c94b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf4e3999-a4", "ovs_interfaceid": "df4e3999-a4c6-439b-9407-6f2e8127a3b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75122) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 09:45:12 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-889024af-2ad6-4ec2-8be5-4a84c629e76b req-f39bf394-9d56-4a46-bf61-a58717862c1e service nova] Acquired lock "refresh_cache-ca2defb6-c4ac-4d39-bdd2-1e0ac3265e02" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 09:45:12 user nova-compute[75122]: DEBUG nova.network.neutron [req-889024af-2ad6-4ec2-8be5-4a84c629e76b req-f39bf394-9d56-4a46-bf61-a58717862c1e service nova] [instance: ca2defb6-c4ac-4d39-bdd2-1e0ac3265e02] Refreshing network info cache for port df4e3999-a4c6-439b-9407-6f2e8127a3b6 {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 09:45:12 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-18680f7a-4d78-4744-9962-887452922f5b tempest-VolumesActionsTest-604748613 tempest-VolumesActionsTest-604748613-project-member] [instance: ca2defb6-c4ac-4d39-bdd2-1e0ac3265e02] Start _get_guest_xml network_info=[{"id": "df4e3999-a4c6-439b-9407-6f2e8127a3b6", "address": "fa:16:3e:80:13:ef", "network": {"id": "1c55a58a-06fb-4975-bf19-fd2936a31571", "bridge": "br-int", "label": "tempest-VolumesActionsTest-636321201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bdd526581df1473887708d42296c94b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf4e3999-a4", "ovs_interfaceid": "df4e3999-a4c6-439b-9407-6f2e8127a3b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T09:26:31Z,direct_url=<?>,disk_format='qcow2',id=5e862cfe-47b8-4725-8292-65761ee6d0f5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9c57733cb41847c0b4ad31519c382e5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T09:26:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '5e862cfe-47b8-4725-8292-65761ee6d0f5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75122) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 09:45:12 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-18680f7a-4d78-4744-9962-887452922f5b tempest-VolumesActionsTest-604748613 tempest-VolumesActionsTest-604748613-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 09:45:12 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-18680f7a-4d78-4744-9962-887452922f5b tempest-VolumesActionsTest-604748613 tempest-VolumesActionsTest-604748613-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 09:45:12 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-18680f7a-4d78-4744-9962-887452922f5b tempest-VolumesActionsTest-604748613 tempest-VolumesActionsTest-604748613-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75122) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 09:45:12 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-18680f7a-4d78-4744-9962-887452922f5b tempest-VolumesActionsTest-604748613 tempest-VolumesActionsTest-604748613-project-member] CPU controller missing on host. {{(pid=75122) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 09:45:12 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-18680f7a-4d78-4744-9962-887452922f5b tempest-VolumesActionsTest-604748613 tempest-VolumesActionsTest-604748613-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75122) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 09:45:12 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-18680f7a-4d78-4744-9962-887452922f5b tempest-VolumesActionsTest-604748613 tempest-VolumesActionsTest-604748613-project-member] CPU controller found on host. {{(pid=75122) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 09:45:12 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-18680f7a-4d78-4744-9962-887452922f5b tempest-VolumesActionsTest-604748613 tempest-VolumesActionsTest-604748613-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75122) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 09:45:12 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-18680f7a-4d78-4744-9962-887452922f5b tempest-VolumesActionsTest-604748613 tempest-VolumesActionsTest-604748613-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T09:26:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T09:26:31Z,direct_url=<?>,disk_format='qcow2',id=5e862cfe-47b8-4725-8292-65761ee6d0f5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9c57733cb41847c0b4ad31519c382e5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T09:26:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 09:45:12 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-18680f7a-4d78-4744-9962-887452922f5b tempest-VolumesActionsTest-604748613 tempest-VolumesActionsTest-604748613-project-member] Flavor limits 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 09:45:12 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-18680f7a-4d78-4744-9962-887452922f5b tempest-VolumesActionsTest-604748613 tempest-VolumesActionsTest-604748613-project-member] Image limits 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 09:45:12 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-18680f7a-4d78-4744-9962-887452922f5b tempest-VolumesActionsTest-604748613 tempest-VolumesActionsTest-604748613-project-member] Flavor pref 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 09:45:12 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-18680f7a-4d78-4744-9962-887452922f5b tempest-VolumesActionsTest-604748613 tempest-VolumesActionsTest-604748613-project-member] Image pref 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 09:45:12 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-18680f7a-4d78-4744-9962-887452922f5b tempest-VolumesActionsTest-604748613 tempest-VolumesActionsTest-604748613-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 09:45:12 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-18680f7a-4d78-4744-9962-887452922f5b tempest-VolumesActionsTest-604748613 tempest-VolumesActionsTest-604748613-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 09:45:12 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-18680f7a-4d78-4744-9962-887452922f5b tempest-VolumesActionsTest-604748613 tempest-VolumesActionsTest-604748613-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75122) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 09:45:12 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-18680f7a-4d78-4744-9962-887452922f5b tempest-VolumesActionsTest-604748613 tempest-VolumesActionsTest-604748613-project-member] Got 1 possible topologies {{(pid=75122) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 09:45:12 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-18680f7a-4d78-4744-9962-887452922f5b tempest-VolumesActionsTest-604748613 tempest-VolumesActionsTest-604748613-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 09:45:12 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-18680f7a-4d78-4744-9962-887452922f5b tempest-VolumesActionsTest-604748613 tempest-VolumesActionsTest-604748613-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 09:45:12 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-18680f7a-4d78-4744-9962-887452922f5b tempest-VolumesActionsTest-604748613 tempest-VolumesActionsTest-604748613-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T09:45:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-200829963',display_name='tempest-VolumesActionsTest-instance-200829963',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-200829963',id=33,image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bdd526581df1473887708d42296c94b2',ramdisk_id='',reservation_id='r-0lr2fgic',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-604748613',owner_user_name='tempest-VolumesActionsTest-604748613-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T09:45:11Z,user_data=None,user_id='59a289904f92493d83167ac2ff91e6b7',uuid=ca2defb6-c4ac-4d39-bdd2-1e0ac3265e02,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "df4e3999-a4c6-439b-9407-6f2e8127a3b6", "address": "fa:16:3e:80:13:ef", "network": {"id": "1c55a58a-06fb-4975-bf19-fd2936a31571", "bridge": "br-int", "label": "tempest-VolumesActionsTest-636321201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bdd526581df1473887708d42296c94b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf4e3999-a4", "ovs_interfaceid": "df4e3999-a4c6-439b-9407-6f2e8127a3b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75122) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 09:45:12 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-18680f7a-4d78-4744-9962-887452922f5b tempest-VolumesActionsTest-604748613 tempest-VolumesActionsTest-604748613-project-member] Converting VIF {"id": "df4e3999-a4c6-439b-9407-6f2e8127a3b6", "address": "fa:16:3e:80:13:ef", "network": {"id": "1c55a58a-06fb-4975-bf19-fd2936a31571", "bridge": "br-int", "label": "tempest-VolumesActionsTest-636321201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bdd526581df1473887708d42296c94b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf4e3999-a4", "ovs_interfaceid": "df4e3999-a4c6-439b-9407-6f2e8127a3b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 09:45:12 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-18680f7a-4d78-4744-9962-887452922f5b tempest-VolumesActionsTest-604748613 tempest-VolumesActionsTest-604748613-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:80:13:ef,bridge_name='br-int',has_traffic_filtering=True,id=df4e3999-a4c6-439b-9407-6f2e8127a3b6,network=Network(1c55a58a-06fb-4975-bf19-fd2936a31571),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf4e3999-a4') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 09:45:12 user nova-compute[75122]: DEBUG nova.objects.instance [None req-18680f7a-4d78-4744-9962-887452922f5b tempest-VolumesActionsTest-604748613 tempest-VolumesActionsTest-604748613-project-member] Lazy-loading 'pci_devices' on Instance uuid ca2defb6-c4ac-4d39-bdd2-1e0ac3265e02 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:45:12 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-18680f7a-4d78-4744-9962-887452922f5b tempest-VolumesActionsTest-604748613 tempest-VolumesActionsTest-604748613-project-member] [instance: ca2defb6-c4ac-4d39-bdd2-1e0ac3265e02] End _get_guest_xml xml=<domain type="kvm">
Nov 15 09:45:12 user nova-compute[75122]:   <uuid>ca2defb6-c4ac-4d39-bdd2-1e0ac3265e02</uuid>
Nov 15 09:45:12 user nova-compute[75122]:   <name>instance-00000021</name>
Nov 15 09:45:12 user nova-compute[75122]:   <memory>524288</memory>
Nov 15 09:45:12 user nova-compute[75122]:   <vcpu>1</vcpu>
Nov 15 09:45:12 user nova-compute[75122]:   <metadata>
Nov 15 09:45:12 user nova-compute[75122]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 09:45:12 user nova-compute[75122]:       <nova:package version="0.0.0"/>
Nov 15 09:45:12 user nova-compute[75122]:       <nova:name>tempest-VolumesActionsTest-instance-200829963</nova:name>
Nov 15 09:45:12 user nova-compute[75122]:       <nova:creationTime>2023-11-15 09:45:12</nova:creationTime>
Nov 15 09:45:12 user nova-compute[75122]:       <nova:flavor name="m1.tiny">
Nov 15 09:45:12 user nova-compute[75122]:         <nova:memory>512</nova:memory>
Nov 15 09:45:12 user nova-compute[75122]:         <nova:disk>1</nova:disk>
Nov 15 09:45:12 user nova-compute[75122]:         <nova:swap>0</nova:swap>
Nov 15 09:45:12 user nova-compute[75122]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 09:45:12 user nova-compute[75122]:         <nova:vcpus>1</nova:vcpus>
Nov 15 09:45:12 user nova-compute[75122]:       </nova:flavor>
Nov 15 09:45:12 user nova-compute[75122]:       <nova:owner>
Nov 15 09:45:12 user nova-compute[75122]:         <nova:user uuid="59a289904f92493d83167ac2ff91e6b7">tempest-VolumesActionsTest-604748613-project-member</nova:user>
Nov 15 09:45:12 user nova-compute[75122]:         <nova:project uuid="bdd526581df1473887708d42296c94b2">tempest-VolumesActionsTest-604748613</nova:project>
Nov 15 09:45:12 user nova-compute[75122]:       </nova:owner>
Nov 15 09:45:12 user nova-compute[75122]:       <nova:root type="image" uuid="5e862cfe-47b8-4725-8292-65761ee6d0f5"/>
Nov 15 09:45:12 user nova-compute[75122]:       <nova:ports>
Nov 15 09:45:12 user nova-compute[75122]:         <nova:port uuid="df4e3999-a4c6-439b-9407-6f2e8127a3b6">
Nov 15 09:45:12 user nova-compute[75122]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 15 09:45:12 user nova-compute[75122]:         </nova:port>
Nov 15 09:45:12 user nova-compute[75122]:       </nova:ports>
Nov 15 09:45:12 user nova-compute[75122]:     </nova:instance>
Nov 15 09:45:12 user nova-compute[75122]:   </metadata>
Nov 15 09:45:12 user nova-compute[75122]:   <sysinfo type="smbios">
Nov 15 09:45:12 user nova-compute[75122]:     <system>
Nov 15 09:45:12 user nova-compute[75122]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 09:45:12 user nova-compute[75122]:       <entry name="product">OpenStack Nova</entry>
Nov 15 09:45:12 user nova-compute[75122]:       <entry name="version">0.0.0</entry>
Nov 15 09:45:12 user nova-compute[75122]:       <entry name="serial">ca2defb6-c4ac-4d39-bdd2-1e0ac3265e02</entry>
Nov 15 09:45:12 user nova-compute[75122]:       <entry name="uuid">ca2defb6-c4ac-4d39-bdd2-1e0ac3265e02</entry>
Nov 15 09:45:12 user nova-compute[75122]:       <entry name="family">Virtual Machine</entry>
Nov 15 09:45:12 user nova-compute[75122]:     </system>
Nov 15 09:45:12 user nova-compute[75122]:   </sysinfo>
Nov 15 09:45:12 user nova-compute[75122]:   <os>
Nov 15 09:45:12 user nova-compute[75122]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 09:45:12 user nova-compute[75122]:     <boot dev="hd"/>
Nov 15 09:45:12 user nova-compute[75122]:     <smbios mode="sysinfo"/>
Nov 15 09:45:12 user nova-compute[75122]:   </os>
Nov 15 09:45:12 user nova-compute[75122]:   <features>
Nov 15 09:45:12 user nova-compute[75122]:     <acpi/>
Nov 15 09:45:12 user nova-compute[75122]:     <apic/>
Nov 15 09:45:12 user nova-compute[75122]:     <vmcoreinfo/>
Nov 15 09:45:12 user nova-compute[75122]:   </features>
Nov 15 09:45:12 user nova-compute[75122]:   <clock offset="utc">
Nov 15 09:45:12 user nova-compute[75122]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 09:45:12 user nova-compute[75122]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 09:45:12 user nova-compute[75122]:     <timer name="hpet" present="no"/>
Nov 15 09:45:12 user nova-compute[75122]:   </clock>
Nov 15 09:45:12 user nova-compute[75122]:   <cpu mode="custom" match="exact">
Nov 15 09:45:12 user nova-compute[75122]:     <model>Nehalem</model>
Nov 15 09:45:12 user nova-compute[75122]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 09:45:12 user nova-compute[75122]:   </cpu>
Nov 15 09:45:12 user nova-compute[75122]:   <devices>
Nov 15 09:45:12 user nova-compute[75122]:     <disk type="file" device="disk">
Nov 15 09:45:12 user nova-compute[75122]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 09:45:12 user nova-compute[75122]:       <source file="/opt/stack/data/nova/instances/ca2defb6-c4ac-4d39-bdd2-1e0ac3265e02/disk"/>
Nov 15 09:45:12 user nova-compute[75122]:       <target dev="vda" bus="virtio"/>
Nov 15 09:45:12 user nova-compute[75122]:     </disk>
Nov 15 09:45:12 user nova-compute[75122]:     <interface type="ethernet">
Nov 15 09:45:12 user nova-compute[75122]:       <mac address="fa:16:3e:80:13:ef"/>
Nov 15 09:45:12 user nova-compute[75122]:       <model type="virtio"/>
Nov 15 09:45:12 user nova-compute[75122]:       <mtu size="1442"/>
Nov 15 09:45:12 user nova-compute[75122]:       <target dev="tapdf4e3999-a4"/>
Nov 15 09:45:12 user nova-compute[75122]:     </interface>
Nov 15 09:45:12 user nova-compute[75122]:     <serial type="pty">
Nov 15 09:45:12 user nova-compute[75122]:       <log file="/opt/stack/data/nova/instances/ca2defb6-c4ac-4d39-bdd2-1e0ac3265e02/console.log" append="off"/>
Nov 15 09:45:12 user nova-compute[75122]:     </serial>
Nov 15 09:45:12 user nova-compute[75122]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 09:45:12 user nova-compute[75122]:     <video>
Nov 15 09:45:12 user nova-compute[75122]:       <model type="virtio"/>
Nov 15 09:45:12 user nova-compute[75122]:     </video>
Nov 15 09:45:12 user nova-compute[75122]:     <rng model="virtio">
Nov 15 09:45:12 user nova-compute[75122]:       <backend model="random">/dev/urandom</backend>
Nov 15 09:45:12 user nova-compute[75122]:     </rng>
Nov 15 09:45:12 user nova-compute[75122]:     <controller type="usb" index="0" model="none"/>
Nov 15 09:45:12 user nova-compute[75122]:     <memballoon model="virtio">
Nov 15 09:45:12 user nova-compute[75122]:       <stats period="10"/>
Nov 15 09:45:12 user nova-compute[75122]:     </memballoon>
Nov 15 09:45:12 user nova-compute[75122]:   </devices>
Nov 15 09:45:12 user nova-compute[75122]: </domain>
Nov 15 09:45:12 user nova-compute[75122]:  {{(pid=75122) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 09:45:12 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-18680f7a-4d78-4744-9962-887452922f5b tempest-VolumesActionsTest-604748613 tempest-VolumesActionsTest-604748613-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T09:45:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-200829963',display_name='tempest-VolumesActionsTest-instance-200829963',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-200829963',id=33,image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bdd526581df1473887708d42296c94b2',ramdisk_id='',reservation_id='r-0lr2fgic',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-604748613',owner_user_name='tempest-VolumesActionsTest-604748613-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T09:45:11Z,user_data=None,user_id='59a289904f92493d83167ac2ff91e6b7',uuid=ca2defb6-c4ac-4d39-bdd2-1e0ac3265e02,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "df4e3999-a4c6-439b-9407-6f2e8127a3b6", "address": "fa:16:3e:80:13:ef", "network": {"id": "1c55a58a-06fb-4975-bf19-fd2936a31571", "bridge": "br-int", "label": "tempest-VolumesActionsTest-636321201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bdd526581df1473887708d42296c94b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf4e3999-a4", "ovs_interfaceid": "df4e3999-a4c6-439b-9407-6f2e8127a3b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 09:45:12 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-18680f7a-4d78-4744-9962-887452922f5b tempest-VolumesActionsTest-604748613 tempest-VolumesActionsTest-604748613-project-member] Converting VIF {"id": "df4e3999-a4c6-439b-9407-6f2e8127a3b6", "address": "fa:16:3e:80:13:ef", "network": {"id": "1c55a58a-06fb-4975-bf19-fd2936a31571", "bridge": "br-int", "label": "tempest-VolumesActionsTest-636321201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bdd526581df1473887708d42296c94b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf4e3999-a4", "ovs_interfaceid": "df4e3999-a4c6-439b-9407-6f2e8127a3b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 09:45:12 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-18680f7a-4d78-4744-9962-887452922f5b tempest-VolumesActionsTest-604748613 tempest-VolumesActionsTest-604748613-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:80:13:ef,bridge_name='br-int',has_traffic_filtering=True,id=df4e3999-a4c6-439b-9407-6f2e8127a3b6,network=Network(1c55a58a-06fb-4975-bf19-fd2936a31571),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf4e3999-a4') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 09:45:12 user nova-compute[75122]: DEBUG os_vif [None req-18680f7a-4d78-4744-9962-887452922f5b tempest-VolumesActionsTest-604748613 tempest-VolumesActionsTest-604748613-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:13:ef,bridge_name='br-int',has_traffic_filtering=True,id=df4e3999-a4c6-439b-9407-6f2e8127a3b6,network=Network(1c55a58a-06fb-4975-bf19-fd2936a31571),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf4e3999-a4') {{(pid=75122) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 09:45:12 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:45:12 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:45:12 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 09:45:12 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:45:12 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ffbf0aab-d261-51fd-8001-53ba5add7656', '_type': 'linux-noop'}}, row=False) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:45:12 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:45:12 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:45:12 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:45:12 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdf4e3999-a4, may_exist=True, interface_attrs={}) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:45:12 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdf4e3999-a4, col_values=(('qos', UUID('1b826fee-d547-4797-9f35-83a425503540')),), if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:45:12 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdf4e3999-a4, col_values=(('external_ids', {'iface-id': 'df4e3999-a4c6-439b-9407-6f2e8127a3b6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:80:13:ef', 'vm-uuid': 'ca2defb6-c4ac-4d39-bdd2-1e0ac3265e02'}),), if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:45:12 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:45:12 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:45:12 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:45:12 user nova-compute[75122]: INFO os_vif [None req-18680f7a-4d78-4744-9962-887452922f5b tempest-VolumesActionsTest-604748613 tempest-VolumesActionsTest-604748613-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:13:ef,bridge_name='br-int',has_traffic_filtering=True,id=df4e3999-a4c6-439b-9407-6f2e8127a3b6,network=Network(1c55a58a-06fb-4975-bf19-fd2936a31571),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf4e3999-a4')
Nov 15 09:45:13 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-18680f7a-4d78-4744-9962-887452922f5b tempest-VolumesActionsTest-604748613 tempest-VolumesActionsTest-604748613-project-member] No BDM found with device name vda, not building metadata. {{(pid=75122) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 09:45:13 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-18680f7a-4d78-4744-9962-887452922f5b tempest-VolumesActionsTest-604748613 tempest-VolumesActionsTest-604748613-project-member] No VIF found with MAC fa:16:3e:80:13:ef, not building metadata {{(pid=75122) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 09:45:13 user nova-compute[75122]: DEBUG nova.network.neutron [req-889024af-2ad6-4ec2-8be5-4a84c629e76b req-f39bf394-9d56-4a46-bf61-a58717862c1e service nova] [instance: ca2defb6-c4ac-4d39-bdd2-1e0ac3265e02] Updated VIF entry in instance network info cache for port df4e3999-a4c6-439b-9407-6f2e8127a3b6. {{(pid=75122) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 09:45:13 user nova-compute[75122]: DEBUG nova.network.neutron [req-889024af-2ad6-4ec2-8be5-4a84c629e76b req-f39bf394-9d56-4a46-bf61-a58717862c1e service nova] [instance: ca2defb6-c4ac-4d39-bdd2-1e0ac3265e02] Updating instance_info_cache with network_info: [{"id": "df4e3999-a4c6-439b-9407-6f2e8127a3b6", "address": "fa:16:3e:80:13:ef", "network": {"id": "1c55a58a-06fb-4975-bf19-fd2936a31571", "bridge": "br-int", "label": "tempest-VolumesActionsTest-636321201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bdd526581df1473887708d42296c94b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf4e3999-a4", "ovs_interfaceid": "df4e3999-a4c6-439b-9407-6f2e8127a3b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:45:13 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-889024af-2ad6-4ec2-8be5-4a84c629e76b req-f39bf394-9d56-4a46-bf61-a58717862c1e service nova] Releasing lock "refresh_cache-ca2defb6-c4ac-4d39-bdd2-1e0ac3265e02" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 09:45:14 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:45:14 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:45:14 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:45:14 user nova-compute[75122]: DEBUG nova.compute.manager [req-3aec27e5-9f4f-4247-9eb9-6d1c0f0754c4 req-623bd359-2d19-438e-9f0a-d053d7c633c7 service nova] [instance: ca2defb6-c4ac-4d39-bdd2-1e0ac3265e02] Received event network-vif-plugged-df4e3999-a4c6-439b-9407-6f2e8127a3b6 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:45:14 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-3aec27e5-9f4f-4247-9eb9-6d1c0f0754c4 req-623bd359-2d19-438e-9f0a-d053d7c633c7 service nova] Acquiring lock "ca2defb6-c4ac-4d39-bdd2-1e0ac3265e02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:45:14 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-3aec27e5-9f4f-4247-9eb9-6d1c0f0754c4 req-623bd359-2d19-438e-9f0a-d053d7c633c7 service nova] Lock "ca2defb6-c4ac-4d39-bdd2-1e0ac3265e02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:45:14 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-3aec27e5-9f4f-4247-9eb9-6d1c0f0754c4 req-623bd359-2d19-438e-9f0a-d053d7c633c7 service nova] Lock "ca2defb6-c4ac-4d39-bdd2-1e0ac3265e02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:45:14 user nova-compute[75122]: DEBUG nova.compute.manager [req-3aec27e5-9f4f-4247-9eb9-6d1c0f0754c4 req-623bd359-2d19-438e-9f0a-d053d7c633c7 service nova] [instance: ca2defb6-c4ac-4d39-bdd2-1e0ac3265e02] No waiting events found dispatching network-vif-plugged-df4e3999-a4c6-439b-9407-6f2e8127a3b6 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:45:14 user nova-compute[75122]: WARNING nova.compute.manager [req-3aec27e5-9f4f-4247-9eb9-6d1c0f0754c4 req-623bd359-2d19-438e-9f0a-d053d7c633c7 service nova] [instance: ca2defb6-c4ac-4d39-bdd2-1e0ac3265e02] Received unexpected event network-vif-plugged-df4e3999-a4c6-439b-9407-6f2e8127a3b6 for instance with vm_state building and task_state spawning.
Nov 15 09:45:14 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:45:14 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:45:14 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:45:14 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:45:14 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:45:16 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:45:16 user nova-compute[75122]: DEBUG nova.compute.manager [None req-18680f7a-4d78-4744-9962-887452922f5b tempest-VolumesActionsTest-604748613 tempest-VolumesActionsTest-604748613-project-member] [instance: ca2defb6-c4ac-4d39-bdd2-1e0ac3265e02] Instance event wait completed in 0 seconds for  {{(pid=75122) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 09:45:16 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-18680f7a-4d78-4744-9962-887452922f5b tempest-VolumesActionsTest-604748613 tempest-VolumesActionsTest-604748613-project-member] [instance: ca2defb6-c4ac-4d39-bdd2-1e0ac3265e02] Guest created on hypervisor {{(pid=75122) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 09:45:16 user nova-compute[75122]: INFO nova.virt.libvirt.driver [-] [instance: ca2defb6-c4ac-4d39-bdd2-1e0ac3265e02] Instance spawned successfully.
Nov 15 09:45:16 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-18680f7a-4d78-4744-9962-887452922f5b tempest-VolumesActionsTest-604748613 tempest-VolumesActionsTest-604748613-project-member] [instance: ca2defb6-c4ac-4d39-bdd2-1e0ac3265e02] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 09:45:16 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-18680f7a-4d78-4744-9962-887452922f5b tempest-VolumesActionsTest-604748613 tempest-VolumesActionsTest-604748613-project-member] [instance: ca2defb6-c4ac-4d39-bdd2-1e0ac3265e02] Found default for hw_cdrom_bus of ide {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:45:16 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-18680f7a-4d78-4744-9962-887452922f5b tempest-VolumesActionsTest-604748613 tempest-VolumesActionsTest-604748613-project-member] [instance: ca2defb6-c4ac-4d39-bdd2-1e0ac3265e02] Found default for hw_disk_bus of virtio {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:45:16 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-18680f7a-4d78-4744-9962-887452922f5b tempest-VolumesActionsTest-604748613 tempest-VolumesActionsTest-604748613-project-member] [instance: ca2defb6-c4ac-4d39-bdd2-1e0ac3265e02] Found default for hw_input_bus of None {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:45:16 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-18680f7a-4d78-4744-9962-887452922f5b tempest-VolumesActionsTest-604748613 tempest-VolumesActionsTest-604748613-project-member] [instance: ca2defb6-c4ac-4d39-bdd2-1e0ac3265e02] Found default for hw_pointer_model of None {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:45:16 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-18680f7a-4d78-4744-9962-887452922f5b tempest-VolumesActionsTest-604748613 tempest-VolumesActionsTest-604748613-project-member] [instance: ca2defb6-c4ac-4d39-bdd2-1e0ac3265e02] Found default for hw_video_model of virtio {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:45:16 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-18680f7a-4d78-4744-9962-887452922f5b tempest-VolumesActionsTest-604748613 tempest-VolumesActionsTest-604748613-project-member] [instance: ca2defb6-c4ac-4d39-bdd2-1e0ac3265e02] Found default for hw_vif_model of virtio {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:45:16 user nova-compute[75122]: DEBUG nova.compute.manager [req-46c8b2e7-7d0f-4dcb-919e-11308bef989d req-e488e3de-1606-49c4-854e-585ccf2befee service nova] [instance: ca2defb6-c4ac-4d39-bdd2-1e0ac3265e02] Received event network-vif-plugged-df4e3999-a4c6-439b-9407-6f2e8127a3b6 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:45:16 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-46c8b2e7-7d0f-4dcb-919e-11308bef989d req-e488e3de-1606-49c4-854e-585ccf2befee service nova] Acquiring lock "ca2defb6-c4ac-4d39-bdd2-1e0ac3265e02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:45:16 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-46c8b2e7-7d0f-4dcb-919e-11308bef989d req-e488e3de-1606-49c4-854e-585ccf2befee service nova] Lock "ca2defb6-c4ac-4d39-bdd2-1e0ac3265e02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:45:16 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-46c8b2e7-7d0f-4dcb-919e-11308bef989d req-e488e3de-1606-49c4-854e-585ccf2befee service nova] Lock "ca2defb6-c4ac-4d39-bdd2-1e0ac3265e02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:45:16 user nova-compute[75122]: DEBUG nova.compute.manager [req-46c8b2e7-7d0f-4dcb-919e-11308bef989d req-e488e3de-1606-49c4-854e-585ccf2befee service nova] [instance: ca2defb6-c4ac-4d39-bdd2-1e0ac3265e02] No waiting events found dispatching network-vif-plugged-df4e3999-a4c6-439b-9407-6f2e8127a3b6 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:45:16 user nova-compute[75122]: WARNING nova.compute.manager [req-46c8b2e7-7d0f-4dcb-919e-11308bef989d req-e488e3de-1606-49c4-854e-585ccf2befee service nova] [instance: ca2defb6-c4ac-4d39-bdd2-1e0ac3265e02] Received unexpected event network-vif-plugged-df4e3999-a4c6-439b-9407-6f2e8127a3b6 for instance with vm_state building and task_state spawning.
Nov 15 09:45:16 user nova-compute[75122]: INFO nova.compute.manager [None req-18680f7a-4d78-4744-9962-887452922f5b tempest-VolumesActionsTest-604748613 tempest-VolumesActionsTest-604748613-project-member] [instance: ca2defb6-c4ac-4d39-bdd2-1e0ac3265e02] Took 5.30 seconds to spawn the instance on the hypervisor.
Nov 15 09:45:16 user nova-compute[75122]: DEBUG nova.compute.manager [None req-18680f7a-4d78-4744-9962-887452922f5b tempest-VolumesActionsTest-604748613 tempest-VolumesActionsTest-604748613-project-member] [instance: ca2defb6-c4ac-4d39-bdd2-1e0ac3265e02] Checking state {{(pid=75122) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 09:45:16 user nova-compute[75122]: INFO nova.compute.manager [None req-18680f7a-4d78-4744-9962-887452922f5b tempest-VolumesActionsTest-604748613 tempest-VolumesActionsTest-604748613-project-member] [instance: ca2defb6-c4ac-4d39-bdd2-1e0ac3265e02] Took 6.09 seconds to build instance.
Nov 15 09:45:16 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-18680f7a-4d78-4744-9962-887452922f5b tempest-VolumesActionsTest-604748613 tempest-VolumesActionsTest-604748613-project-member] Lock "ca2defb6-c4ac-4d39-bdd2-1e0ac3265e02" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.192s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:45:17 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:45:20 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-c713c74c-cbce-449f-9141-a028e677aca8 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Acquiring lock "cc485c6c-5a9a-4c94-b966-68dd9e336e56" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:45:20 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-c713c74c-cbce-449f-9141-a028e677aca8 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Lock "cc485c6c-5a9a-4c94-b966-68dd9e336e56" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:45:20 user nova-compute[75122]: DEBUG nova.compute.manager [None req-c713c74c-cbce-449f-9141-a028e677aca8 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] [instance: cc485c6c-5a9a-4c94-b966-68dd9e336e56] Going to confirm migration 2 {{(pid=75122) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4774}}
Nov 15 09:45:20 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-c713c74c-cbce-449f-9141-a028e677aca8 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Acquiring lock "refresh_cache-cc485c6c-5a9a-4c94-b966-68dd9e336e56" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 09:45:20 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-c713c74c-cbce-449f-9141-a028e677aca8 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Acquired lock "refresh_cache-cc485c6c-5a9a-4c94-b966-68dd9e336e56" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 09:45:20 user nova-compute[75122]: DEBUG nova.network.neutron [None req-c713c74c-cbce-449f-9141-a028e677aca8 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] [instance: cc485c6c-5a9a-4c94-b966-68dd9e336e56] Building network info cache for instance {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 09:45:20 user nova-compute[75122]: DEBUG nova.objects.instance [None req-c713c74c-cbce-449f-9141-a028e677aca8 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Lazy-loading 'info_cache' on Instance uuid cc485c6c-5a9a-4c94-b966-68dd9e336e56 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:45:20 user nova-compute[75122]: DEBUG nova.network.neutron [None req-c713c74c-cbce-449f-9141-a028e677aca8 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] [instance: cc485c6c-5a9a-4c94-b966-68dd9e336e56] Updating instance_info_cache with network_info: [{"id": "d3b26bb1-8ddd-4467-af3e-74e39d54390e", "address": "fa:16:3e:8c:a9:0b", "network": {"id": "6e846655-a6f8-4339-a239-65d2f94c8b74", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1923452032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b8e67f8a66a4930be3fb65c397cbeb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3b26bb1-8d", "ovs_interfaceid": "d3b26bb1-8ddd-4467-af3e-74e39d54390e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:45:20 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-c713c74c-cbce-449f-9141-a028e677aca8 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Releasing lock "refresh_cache-cc485c6c-5a9a-4c94-b966-68dd9e336e56" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 09:45:20 user nova-compute[75122]: DEBUG nova.objects.instance [None req-c713c74c-cbce-449f-9141-a028e677aca8 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Lazy-loading 'migration_context' on Instance uuid cc485c6c-5a9a-4c94-b966-68dd9e336e56 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:45:20 user nova-compute[75122]: DEBUG nova.objects.base [None req-c713c74c-cbce-449f-9141-a028e677aca8 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Object Instance<cc485c6c-5a9a-4c94-b966-68dd9e336e56> lazy-loaded attributes: info_cache,migration_context {{(pid=75122) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 09:45:20 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-c713c74c-cbce-449f-9141-a028e677aca8 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:45:20 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-c713c74c-cbce-449f-9141-a028e677aca8 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:45:21 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:45:21 user nova-compute[75122]: DEBUG nova.compute.provider_tree [None req-c713c74c-cbce-449f-9141-a028e677aca8 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Inventory has not changed in ProviderTree for provider: 69a3da65-47be-44c6-b67c-c692b58284ef {{(pid=75122) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 09:45:21 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-c713c74c-cbce-449f-9141-a028e677aca8 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Inventory has not changed for provider 69a3da65-47be-44c6-b67c-c692b58284ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 09:45:21 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:45:21 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-c713c74c-cbce-449f-9141-a028e677aca8 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.347s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:45:21 user nova-compute[75122]: INFO nova.scheduler.client.report [None req-c713c74c-cbce-449f-9141-a028e677aca8 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Deleted allocation for migration 1c6b84e0-2ff9-44f1-bd0a-20e98d2f2ac0
Nov 15 09:45:21 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-c713c74c-cbce-449f-9141-a028e677aca8 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Lock "cc485c6c-5a9a-4c94-b966-68dd9e336e56" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.427s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:45:22 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:45:22 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:45:22 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75122) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 09:45:22 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:45:23 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:45:23 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Starting heal instance info cache {{(pid=75122) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 09:45:23 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Didn't find any instances for network info cache update. {{(pid=75122) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 15 09:45:23 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:45:24 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:45:24 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:45:25 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:45:25 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:45:25 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:45:25 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:45:25 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75122) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 09:45:25 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75122) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 09:45:25 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd9d52bb-6248-48e6-a798-6dbdaaa68cbc/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:45:25 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd9d52bb-6248-48e6-a798-6dbdaaa68cbc/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:45:25 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd9d52bb-6248-48e6-a798-6dbdaaa68cbc/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:45:25 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd9d52bb-6248-48e6-a798-6dbdaaa68cbc/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:45:25 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49154de0-f941-4ae0-a7af-72e75a4d8040/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:45:25 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49154de0-f941-4ae0-a7af-72e75a4d8040/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:45:25 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49154de0-f941-4ae0-a7af-72e75a4d8040/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:45:26 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49154de0-f941-4ae0-a7af-72e75a4d8040/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:45:26 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca2defb6-c4ac-4d39-bdd2-1e0ac3265e02/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:45:26 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca2defb6-c4ac-4d39-bdd2-1e0ac3265e02/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:45:26 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca2defb6-c4ac-4d39-bdd2-1e0ac3265e02/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:45:26 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca2defb6-c4ac-4d39-bdd2-1e0ac3265e02/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:45:26 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1121448-8452-4955-8112-7b984921dac6/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:45:26 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1121448-8452-4955-8112-7b984921dac6/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:45:26 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1121448-8452-4955-8112-7b984921dac6/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:45:26 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1121448-8452-4955-8112-7b984921dac6/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:45:26 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/131142fd-e8ec-42d1-a518-aa21c7bb7cb1/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:45:27 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/131142fd-e8ec-42d1-a518-aa21c7bb7cb1/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:45:27 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/131142fd-e8ec-42d1-a518-aa21c7bb7cb1/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:45:27 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/131142fd-e8ec-42d1-a518-aa21c7bb7cb1/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:45:27 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8271a429-e252-42bb-8717-e89dfd9739bf/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:45:27 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8271a429-e252-42bb-8717-e89dfd9739bf/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:45:27 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8271a429-e252-42bb-8717-e89dfd9739bf/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:45:27 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8271a429-e252-42bb-8717-e89dfd9739bf/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:45:27 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00270cc2-4f5b-4f64-8f88-31f21e3b3950/disk.rescue --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:45:27 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:45:27 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00270cc2-4f5b-4f64-8f88-31f21e3b3950/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:45:27 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00270cc2-4f5b-4f64-8f88-31f21e3b3950/disk.rescue --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:45:28 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00270cc2-4f5b-4f64-8f88-31f21e3b3950/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:45:28 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00270cc2-4f5b-4f64-8f88-31f21e3b3950/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:45:28 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00270cc2-4f5b-4f64-8f88-31f21e3b3950/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:45:28 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00270cc2-4f5b-4f64-8f88-31f21e3b3950/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:45:28 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00270cc2-4f5b-4f64-8f88-31f21e3b3950/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:45:28 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 09:45:28 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 09:45:28 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Hypervisor/Node resource view: name=user free_ram=7758MB free_disk=25.299152374267578GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75122) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 09:45:28 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:45:28 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:45:29 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance 131142fd-e8ec-42d1-a518-aa21c7bb7cb1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:45:29 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance fd9d52bb-6248-48e6-a798-6dbdaaa68cbc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:45:29 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance 00270cc2-4f5b-4f64-8f88-31f21e3b3950 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:45:29 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance cc485c6c-5a9a-4c94-b966-68dd9e336e56 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:45:29 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance 8271a429-e252-42bb-8717-e89dfd9739bf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:45:29 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance 49154de0-f941-4ae0-a7af-72e75a4d8040 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:45:29 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance a1121448-8452-4955-8112-7b984921dac6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:45:29 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance ca2defb6-c4ac-4d39-bdd2-1e0ac3265e02 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:45:29 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75122) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 09:45:29 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75122) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 09:45:29 user nova-compute[75122]: DEBUG nova.compute.provider_tree [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Inventory has not changed in ProviderTree for provider: 69a3da65-47be-44c6-b67c-c692b58284ef {{(pid=75122) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 09:45:29 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Inventory has not changed for provider 69a3da65-47be-44c6-b67c-c692b58284ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 09:45:29 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Compute_service record updated for user:user {{(pid=75122) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 09:45:29 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.452s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:45:31 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:45:32 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:45:35 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:45:36 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:45:36 user nova-compute[75122]: DEBUG nova.compute.manager [req-2e1a870b-4efa-41ba-a5ac-9766c4a9e86c req-58f3423d-f848-4d93-b9af-27d3ca116acf service nova] [instance: 8271a429-e252-42bb-8717-e89dfd9739bf] Received event network-changed-044ffaae-8351-4c7f-9b12-32ac7d4b3565 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:45:36 user nova-compute[75122]: DEBUG nova.compute.manager [req-2e1a870b-4efa-41ba-a5ac-9766c4a9e86c req-58f3423d-f848-4d93-b9af-27d3ca116acf service nova] [instance: 8271a429-e252-42bb-8717-e89dfd9739bf] Refreshing instance network info cache due to event network-changed-044ffaae-8351-4c7f-9b12-32ac7d4b3565. {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 09:45:36 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-2e1a870b-4efa-41ba-a5ac-9766c4a9e86c req-58f3423d-f848-4d93-b9af-27d3ca116acf service nova] Acquiring lock "refresh_cache-8271a429-e252-42bb-8717-e89dfd9739bf" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 09:45:36 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-2e1a870b-4efa-41ba-a5ac-9766c4a9e86c req-58f3423d-f848-4d93-b9af-27d3ca116acf service nova] Acquired lock "refresh_cache-8271a429-e252-42bb-8717-e89dfd9739bf" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 09:45:36 user nova-compute[75122]: DEBUG nova.network.neutron [req-2e1a870b-4efa-41ba-a5ac-9766c4a9e86c req-58f3423d-f848-4d93-b9af-27d3ca116acf service nova] [instance: 8271a429-e252-42bb-8717-e89dfd9739bf] Refreshing network info cache for port 044ffaae-8351-4c7f-9b12-32ac7d4b3565 {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 09:45:36 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-f15dfa72-4ed6-49c2-8a0c-51a54fdea1d8 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Acquiring lock "8271a429-e252-42bb-8717-e89dfd9739bf" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:45:36 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-f15dfa72-4ed6-49c2-8a0c-51a54fdea1d8 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Lock "8271a429-e252-42bb-8717-e89dfd9739bf" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:45:36 user nova-compute[75122]: DEBUG nova.objects.instance [None req-f15dfa72-4ed6-49c2-8a0c-51a54fdea1d8 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Lazy-loading 'flavor' on Instance uuid 8271a429-e252-42bb-8717-e89dfd9739bf {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:45:37 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-f15dfa72-4ed6-49c2-8a0c-51a54fdea1d8 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Lock "8271a429-e252-42bb-8717-e89dfd9739bf" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:45:37 user nova-compute[75122]: DEBUG nova.network.neutron [req-2e1a870b-4efa-41ba-a5ac-9766c4a9e86c req-58f3423d-f848-4d93-b9af-27d3ca116acf service nova] [instance: 8271a429-e252-42bb-8717-e89dfd9739bf] Updated VIF entry in instance network info cache for port 044ffaae-8351-4c7f-9b12-32ac7d4b3565. {{(pid=75122) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 09:45:37 user nova-compute[75122]: DEBUG nova.network.neutron [req-2e1a870b-4efa-41ba-a5ac-9766c4a9e86c req-58f3423d-f848-4d93-b9af-27d3ca116acf service nova] [instance: 8271a429-e252-42bb-8717-e89dfd9739bf] Updating instance_info_cache with network_info: [{"id": "044ffaae-8351-4c7f-9b12-32ac7d4b3565", "address": "fa:16:3e:e3:9d:f8", "network": {"id": "c2062f64-d925-42d2-9687-5d2511ef6697", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1134087048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eeff24cb28f5481fa3941ba399ce82ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap044ffaae-83", "ovs_interfaceid": "044ffaae-8351-4c7f-9b12-32ac7d4b3565", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:45:37 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-2e1a870b-4efa-41ba-a5ac-9766c4a9e86c req-58f3423d-f848-4d93-b9af-27d3ca116acf service nova] Releasing lock "refresh_cache-8271a429-e252-42bb-8717-e89dfd9739bf" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 09:45:37 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-f15dfa72-4ed6-49c2-8a0c-51a54fdea1d8 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Acquiring lock "8271a429-e252-42bb-8717-e89dfd9739bf" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:45:37 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-f15dfa72-4ed6-49c2-8a0c-51a54fdea1d8 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Lock "8271a429-e252-42bb-8717-e89dfd9739bf" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:45:37 user nova-compute[75122]: INFO nova.compute.manager [None req-f15dfa72-4ed6-49c2-8a0c-51a54fdea1d8 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] [instance: 8271a429-e252-42bb-8717-e89dfd9739bf] Attaching volume 6224c0df-13b0-4ff7-928f-9a2282386a2a to /dev/vdb
Nov 15 09:45:37 user nova-compute[75122]: DEBUG os_brick.utils [None req-f15dfa72-4ed6-49c2-8a0c-51a54fdea1d8 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 09:45:37 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:45:37 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:45:37 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb252abd-05dc-48ed-b21b-09888d98d80a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:742fb64b3587\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:45:37 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:45:37 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:45:37 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[415f3728-b864-442c-aeab-303359f298ba]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:45:37 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:45:37 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:45:37 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fe3228c-9c2e-4b77-9bb9-ac2ed472ee26]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:45:37 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[d508aa35-443a-4173-8d1b-66e9e70c61ae]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:45:37 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-f15dfa72-4ed6-49c2-8a0c-51a54fdea1d8 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Running cmd (subprocess): nvme version {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:45:37 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-f15dfa72-4ed6-49c2-8a0c-51a54fdea1d8 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] 'nvme version' failed. Not Retrying. {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 09:45:37 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f15dfa72-4ed6-49c2-8a0c-51a54fdea1d8 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] nvme not present on system {{(pid=75122) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 09:45:37 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:45:37 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 09:45:37 user nova-compute[75122]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 09:45:37 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0d0afed-75ff-42d0-9baf-683ea84b8acd]: (4, '') {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:45:37 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.lightos [None req-f15dfa72-4ed6-49c2-8a0c-51a54fdea1d8 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75122) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 09:45:37 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.lightos [None req-f15dfa72-4ed6-49c2-8a0c-51a54fdea1d8 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75122) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 09:45:37 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.lightos [None req-f15dfa72-4ed6-49c2-8a0c-51a54fdea1d8 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] LIGHTOS: no hostnqn found. {{(pid=75122) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 09:45:37 user nova-compute[75122]: DEBUG os_brick.utils [None req-f15dfa72-4ed6-49c2-8a0c-51a54fdea1d8 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:742fb64b3587', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 09:45:37 user nova-compute[75122]: DEBUG nova.virt.block_device [None req-f15dfa72-4ed6-49c2-8a0c-51a54fdea1d8 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] [instance: 8271a429-e252-42bb-8717-e89dfd9739bf] Updating existing volume attachment record: 58562f84-906a-459d-9e92-659a778d0210 {{(pid=75122) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 09:45:37 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:45:41 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:45:42 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f15dfa72-4ed6-49c2-8a0c-51a54fdea1d8 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] [instance: 8271a429-e252-42bb-8717-e89dfd9739bf] Calling os-brick to attach iSCSI Volume {{(pid=75122) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 09:45:42 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-f15dfa72-4ed6-49c2-8a0c-51a54fdea1d8 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffa04060b80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6224c0df-13b0-4ff7-928f-9a2282386a2a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AmXEUxDY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 09:45:42 user nova-compute[75122]: WARNING os_brick.initiator.connectors.base [None req-f15dfa72-4ed6-49c2-8a0c-51a54fdea1d8 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 09:45:42 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-f15dfa72-4ed6-49c2-8a0c-51a54fdea1d8 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 09:45:42 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-f15dfa72-4ed6-49c2-8a0c-51a54fdea1d8 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 09:45:42 user nova-compute[75122]: WARNING os_brick.initiator.connectors.base [None req-f15dfa72-4ed6-49c2-8a0c-51a54fdea1d8 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 09:45:42 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-f15dfa72-4ed6-49c2-8a0c-51a54fdea1d8 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6224c0df-13b0-4ff7-928f-9a2282386a2a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 09:45:42 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-f15dfa72-4ed6-49c2-8a0c-51a54fdea1d8 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6224c0df-13b0-4ff7-928f-9a2282386a2a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 09:45:42 user nova-compute[75122]: INFO os_brick.initiator.connectors.iscsi [None req-f15dfa72-4ed6-49c2-8a0c-51a54fdea1d8 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 09:45:42 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6224c0df-13b0-4ff7-928f-9a2282386a2a -p 172.16.0.220:3260 {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:45:42 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6224c0df-13b0-4ff7-928f-9a2282386a2a -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:45:42 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[95cc8af3-04c8-4c3c-85e3-b72bbb03c132]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:45:42 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-f15dfa72-4ed6-49c2-8a0c-51a54fdea1d8 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 09:45:42 user nova-compute[75122]:  {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:45:42 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6224c0df-13b0-4ff7-928f-9a2282386a2a -p 172.16.0.220:3260 --interface default --op new {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:45:42 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6224c0df-13b0-4ff7-928f-9a2282386a2a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:45:42 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff8d3341-d751-47a8-be65-ab1205d9c857]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6224c0df-13b0-4ff7-928f-9a2282386a2a] added\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:45:42 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-f15dfa72-4ed6-49c2-8a0c-51a54fdea1d8 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6224c0df-13b0-4ff7-928f-9a2282386a2a] added
Nov 15 09:45:42 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:45:42 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6224c0df-13b0-4ff7-928f-9a2282386a2a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:45:42 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6224c0df-13b0-4ff7-928f-9a2282386a2a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.034s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:45:42 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[443d87ac-b529-4e23-b011-e5df1139f54c]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:45:42 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-f15dfa72-4ed6-49c2-8a0c-51a54fdea1d8 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:45:42 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6224c0df-13b0-4ff7-928f-9a2282386a2a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:45:42 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:45:42 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6224c0df-13b0-4ff7-928f-9a2282386a2a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:45:42 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5112f24-a17f-4912-a861-08c2cc70ed52]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:45:42 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-f15dfa72-4ed6-49c2-8a0c-51a54fdea1d8 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:45:42 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6224c0df-13b0-4ff7-928f-9a2282386a2a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AmXEUxDY {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:45:42 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6224c0df-13b0-4ff7-928f-9a2282386a2a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AmXEUxDY" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:45:42 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e25bfb4-db23-4a56-a5b1-e82d6d6b4d4a]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:45:42 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-f15dfa72-4ed6-49c2-8a0c-51a54fdea1d8 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AmXEUxDY'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:45:42 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6224c0df-13b0-4ff7-928f-9a2282386a2a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:45:42 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6224c0df-13b0-4ff7-928f-9a2282386a2a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:45:42 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[94d7cbd4-38a6-4761-9104-eca4d1226209]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:45:42 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-f15dfa72-4ed6-49c2-8a0c-51a54fdea1d8 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:45:42 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:45:43 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:45:43 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[56623dca-c4b4-45c4-a93b-f006f0c7ba1d]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17 (non-flash)\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:45:43 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-f15dfa72-4ed6-49c2-8a0c-51a54fdea1d8 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17 (non-flash)
Nov 15 09:45:43 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 09:45:43 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-f15dfa72-4ed6-49c2-8a0c-51a54fdea1d8 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17 (non-flash)
Nov 15 09:45:43 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 09:45:43 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6224c0df-13b0-4ff7-928f-9a2282386a2a -p 172.16.0.220:3260 --login {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:45:43 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6224c0df-13b0-4ff7-928f-9a2282386a2a -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:45:43 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[755517e5-e69a-4e23-bdd2-b0e975fa900e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6224c0df-13b0-4ff7-928f-9a2282386a2a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6224c0df-13b0-4ff7-928f-9a2282386a2a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:45:43 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-f15dfa72-4ed6-49c2-8a0c-51a54fdea1d8 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6224c0df-13b0-4ff7-928f-9a2282386a2a, portal: 172.16.0.220,3260]
Nov 15 09:45:43 user nova-compute[75122]: Login to [iface: default, target: iqn.2010-10.org.openstack:6224c0df-13b0-4ff7-928f-9a2282386a2a, portal: 172.16.0.220,3260] successful.
Nov 15 09:45:43 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:45:43 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6224c0df-13b0-4ff7-928f-9a2282386a2a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:45:43 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6224c0df-13b0-4ff7-928f-9a2282386a2a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.016s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:45:43 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee6b540b-7e05-4db4-8223-c58089a66a7d]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:45:43 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-f15dfa72-4ed6-49c2-8a0c-51a54fdea1d8 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:45:43 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:45:43 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:45:43 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[f89fa61c-ffe8-42ef-b838-9057468e00be]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6224c0df-13b0-4ff7-928f-9a2282386a2a (non-flash)\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:45:43 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-f15dfa72-4ed6-49c2-8a0c-51a54fdea1d8 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17 (non-flash)
Nov 15 09:45:43 user nova-compute[75122]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6224c0df-13b0-4ff7-928f-9a2282386a2a (non-flash)
Nov 15 09:45:43 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 09:45:43 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-f15dfa72-4ed6-49c2-8a0c-51a54fdea1d8 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17 (non-flash)
Nov 15 09:45:43 user nova-compute[75122]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6224c0df-13b0-4ff7-928f-9a2282386a2a (non-flash)
Nov 15 09:45:43 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 09:45:43 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-f15dfa72-4ed6-49c2-8a0c-51a54fdea1d8 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6224c0df-13b0-4ff7-928f-9a2282386a2a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.298s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 09:45:43 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-f15dfa72-4ed6-49c2-8a0c-51a54fdea1d8 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Connected to 172.16.0.220:3260 {{(pid=75122) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 09:45:43 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-f15dfa72-4ed6-49c2-8a0c-51a54fdea1d8 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] HCTL ('34', '-', '-', 0) found on session 39 with lun 0 {{(pid=75122) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 09:45:43 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-f15dfa72-4ed6-49c2-8a0c-51a54fdea1d8 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75122) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 09:45:43 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:45:43 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:45:43 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[3099fd2e-1660-4203-a4a6-e59a2701862f]: (4, ('- - 0', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:45:43 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-f15dfa72-4ed6-49c2-8a0c-51a54fdea1d8 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Searching for a device in session 39 and hctl ['34', '*', '*', 0] yield: None {{(pid=75122) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 09:45:44 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-f15dfa72-4ed6-49c2-8a0c-51a54fdea1d8 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Searching for a device in session 39 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75122) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 09:45:44 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-f15dfa72-4ed6-49c2-8a0c-51a54fdea1d8 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:6224c0df-13b0-4ff7-928f-9a2282386a2a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AmXEUxDY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75122) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 09:45:44 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-f15dfa72-4ed6-49c2-8a0c-51a54fdea1d8 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.328s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 09:45:44 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-f15dfa72-4ed6-49c2-8a0c-51a54fdea1d8 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] <== connect_volume: return (1330ms) {'type': 'block', 'scsi_wwn': '23765366331613533', 'path': '/dev/sdc'} {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 09:45:44 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f15dfa72-4ed6-49c2-8a0c-51a54fdea1d8 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] [instance: 8271a429-e252-42bb-8717-e89dfd9739bf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23765366331613533', 'path': '/dev/sdc'} {{(pid=75122) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 09:45:44 user nova-compute[75122]: DEBUG nova.objects.instance [None req-f15dfa72-4ed6-49c2-8a0c-51a54fdea1d8 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Lazy-loading 'flavor' on Instance uuid 8271a429-e252-42bb-8717-e89dfd9739bf {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:45:44 user nova-compute[75122]: DEBUG nova.virt.libvirt.guest [None req-f15dfa72-4ed6-49c2-8a0c-51a54fdea1d8 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 09:45:44 user nova-compute[75122]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 09:45:44 user nova-compute[75122]:   <source dev="/dev/sdc"/>
Nov 15 09:45:44 user nova-compute[75122]:   <target dev="vdb" bus="virtio"/>
Nov 15 09:45:44 user nova-compute[75122]:   <serial>6224c0df-13b0-4ff7-928f-9a2282386a2a</serial>
Nov 15 09:45:44 user nova-compute[75122]: </disk>
Nov 15 09:45:44 user nova-compute[75122]:  {{(pid=75122) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 09:45:44 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-f15dfa72-4ed6-49c2-8a0c-51a54fdea1d8 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] No BDM found with device name vda, not building metadata. {{(pid=75122) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 09:45:44 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-f15dfa72-4ed6-49c2-8a0c-51a54fdea1d8 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75122) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 09:45:44 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-f15dfa72-4ed6-49c2-8a0c-51a54fdea1d8 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] No VIF found with MAC fa:16:3e:e3:9d:f8, not building metadata {{(pid=75122) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 09:45:44 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:45:44 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-f15dfa72-4ed6-49c2-8a0c-51a54fdea1d8 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Lock "8271a429-e252-42bb-8717-e89dfd9739bf" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.534s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:45:46 user nova-compute[75122]: INFO nova.compute.manager [None req-a6a874e3-129b-4580-a47f-ddfabd98acc7 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] [instance: 8271a429-e252-42bb-8717-e89dfd9739bf] Rescuing
Nov 15 09:45:46 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-a6a874e3-129b-4580-a47f-ddfabd98acc7 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Acquiring lock "refresh_cache-8271a429-e252-42bb-8717-e89dfd9739bf" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 09:45:46 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-a6a874e3-129b-4580-a47f-ddfabd98acc7 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Acquired lock "refresh_cache-8271a429-e252-42bb-8717-e89dfd9739bf" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 09:45:46 user nova-compute[75122]: DEBUG nova.network.neutron [None req-a6a874e3-129b-4580-a47f-ddfabd98acc7 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] [instance: 8271a429-e252-42bb-8717-e89dfd9739bf] Building network info cache for instance {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 09:45:46 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:45:47 user nova-compute[75122]: DEBUG nova.network.neutron [None req-a6a874e3-129b-4580-a47f-ddfabd98acc7 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] [instance: 8271a429-e252-42bb-8717-e89dfd9739bf] Updating instance_info_cache with network_info: [{"id": "044ffaae-8351-4c7f-9b12-32ac7d4b3565", "address": "fa:16:3e:e3:9d:f8", "network": {"id": "c2062f64-d925-42d2-9687-5d2511ef6697", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1134087048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eeff24cb28f5481fa3941ba399ce82ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap044ffaae-83", "ovs_interfaceid": "044ffaae-8351-4c7f-9b12-32ac7d4b3565", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:45:47 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-a6a874e3-129b-4580-a47f-ddfabd98acc7 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Releasing lock "refresh_cache-8271a429-e252-42bb-8717-e89dfd9739bf" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 09:45:47 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:45:47 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:45:47 user nova-compute[75122]: DEBUG nova.compute.manager [req-3c88ad58-1c38-421b-8058-90716b634515 req-49bc8b2f-94c1-40e6-bf21-27c0debd129d service nova] [instance: 8271a429-e252-42bb-8717-e89dfd9739bf] Received event network-vif-unplugged-044ffaae-8351-4c7f-9b12-32ac7d4b3565 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:45:47 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-3c88ad58-1c38-421b-8058-90716b634515 req-49bc8b2f-94c1-40e6-bf21-27c0debd129d service nova] Acquiring lock "8271a429-e252-42bb-8717-e89dfd9739bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:45:47 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-3c88ad58-1c38-421b-8058-90716b634515 req-49bc8b2f-94c1-40e6-bf21-27c0debd129d service nova] Lock "8271a429-e252-42bb-8717-e89dfd9739bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:45:47 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-3c88ad58-1c38-421b-8058-90716b634515 req-49bc8b2f-94c1-40e6-bf21-27c0debd129d service nova] Lock "8271a429-e252-42bb-8717-e89dfd9739bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:45:47 user nova-compute[75122]: DEBUG nova.compute.manager [req-3c88ad58-1c38-421b-8058-90716b634515 req-49bc8b2f-94c1-40e6-bf21-27c0debd129d service nova] [instance: 8271a429-e252-42bb-8717-e89dfd9739bf] No waiting events found dispatching network-vif-unplugged-044ffaae-8351-4c7f-9b12-32ac7d4b3565 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:45:47 user nova-compute[75122]: WARNING nova.compute.manager [req-3c88ad58-1c38-421b-8058-90716b634515 req-49bc8b2f-94c1-40e6-bf21-27c0debd129d service nova] [instance: 8271a429-e252-42bb-8717-e89dfd9739bf] Received unexpected event network-vif-unplugged-044ffaae-8351-4c7f-9b12-32ac7d4b3565 for instance with vm_state active and task_state rescuing.
Nov 15 09:45:47 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:45:47 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:45:47 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:45:48 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:45:48 user nova-compute[75122]: INFO nova.virt.libvirt.driver [-] [instance: 8271a429-e252-42bb-8717-e89dfd9739bf] Instance destroyed successfully.
Nov 15 09:45:48 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-a6a874e3-129b-4580-a47f-ddfabd98acc7 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] [instance: 8271a429-e252-42bb-8717-e89dfd9739bf] Attempting rescue
Nov 15 09:45:48 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-a6a874e3-129b-4580-a47f-ddfabd98acc7 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75122) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 15 09:45:48 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-a6a874e3-129b-4580-a47f-ddfabd98acc7 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] [instance: 8271a429-e252-42bb-8717-e89dfd9739bf] Instance directory exists: not creating {{(pid=75122) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 15 09:45:48 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-a6a874e3-129b-4580-a47f-ddfabd98acc7 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] [instance: 8271a429-e252-42bb-8717-e89dfd9739bf] Creating image(s)
Nov 15 09:45:48 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-a6a874e3-129b-4580-a47f-ddfabd98acc7 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Acquiring lock "/opt/stack/data/nova/instances/8271a429-e252-42bb-8717-e89dfd9739bf/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:45:48 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-a6a874e3-129b-4580-a47f-ddfabd98acc7 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Lock "/opt/stack/data/nova/instances/8271a429-e252-42bb-8717-e89dfd9739bf/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:45:48 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-a6a874e3-129b-4580-a47f-ddfabd98acc7 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Lock "/opt/stack/data/nova/instances/8271a429-e252-42bb-8717-e89dfd9739bf/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:45:48 user nova-compute[75122]: DEBUG nova.objects.instance [None req-a6a874e3-129b-4580-a47f-ddfabd98acc7 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Lazy-loading 'trusted_certs' on Instance uuid 8271a429-e252-42bb-8717-e89dfd9739bf {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:45:48 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-a6a874e3-129b-4580-a47f-ddfabd98acc7 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Acquiring lock "95d6e29f74d5408f818e32f3bc29bc8270a4c665" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:45:48 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-a6a874e3-129b-4580-a47f-ddfabd98acc7 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Lock "95d6e29f74d5408f818e32f3bc29bc8270a4c665" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:45:48 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-a6a874e3-129b-4580-a47f-ddfabd98acc7 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:45:48 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-a6a874e3-129b-4580-a47f-ddfabd98acc7 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json" returned: 0 in 0.177s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:45:48 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-a6a874e3-129b-4580-a47f-ddfabd98acc7 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665,backing_fmt=raw /opt/stack/data/nova/instances/8271a429-e252-42bb-8717-e89dfd9739bf/disk.rescue {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:45:48 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-a6a874e3-129b-4580-a47f-ddfabd98acc7 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665,backing_fmt=raw /opt/stack/data/nova/instances/8271a429-e252-42bb-8717-e89dfd9739bf/disk.rescue" returned: 0 in 0.050s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:45:48 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-a6a874e3-129b-4580-a47f-ddfabd98acc7 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Lock "95d6e29f74d5408f818e32f3bc29bc8270a4c665" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.233s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:45:48 user nova-compute[75122]: DEBUG nova.objects.instance [None req-a6a874e3-129b-4580-a47f-ddfabd98acc7 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Lazy-loading 'migration_context' on Instance uuid 8271a429-e252-42bb-8717-e89dfd9739bf {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:45:48 user nova-compute[75122]: DEBUG nova.objects.base [None req-a6a874e3-129b-4580-a47f-ddfabd98acc7 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Object Instance<8271a429-e252-42bb-8717-e89dfd9739bf> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75122) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 09:45:48 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-a6a874e3-129b-4580-a47f-ddfabd98acc7 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] [instance: 8271a429-e252-42bb-8717-e89dfd9739bf] Created local disks {{(pid=75122) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 09:45:48 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-a6a874e3-129b-4580-a47f-ddfabd98acc7 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] [instance: 8271a429-e252-42bb-8717-e89dfd9739bf] Start _get_guest_xml network_info=[{"id": "044ffaae-8351-4c7f-9b12-32ac7d4b3565", "address": "fa:16:3e:e3:9d:f8", "network": {"id": "c2062f64-d925-42d2-9687-5d2511ef6697", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1134087048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1134087048-network", "vif_mac": "fa:16:3e:e3:9d:f8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eeff24cb28f5481fa3941ba399ce82ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap044ffaae-83", "ovs_interfaceid": "044ffaae-8351-4c7f-9b12-32ac7d4b3565", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T09:26:31Z,direct_url=<?>,disk_format='qcow2',id=5e862cfe-47b8-4725-8292-65761ee6d0f5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9c57733cb41847c0b4ad31519c382e5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T09:26:33Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '5e862cfe-47b8-4725-8292-65761ee6d0f5', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75122) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 09:45:48 user nova-compute[75122]: DEBUG nova.objects.instance [None req-a6a874e3-129b-4580-a47f-ddfabd98acc7 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Lazy-loading 'resources' on Instance uuid 8271a429-e252-42bb-8717-e89dfd9739bf {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:45:48 user nova-compute[75122]: DEBUG nova.objects.base [None req-a6a874e3-129b-4580-a47f-ddfabd98acc7 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Object Instance<8271a429-e252-42bb-8717-e89dfd9739bf> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75122) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 09:45:48 user nova-compute[75122]: DEBUG nova.objects.instance [None req-a6a874e3-129b-4580-a47f-ddfabd98acc7 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Lazy-loading 'numa_topology' on Instance uuid 8271a429-e252-42bb-8717-e89dfd9739bf {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:45:48 user nova-compute[75122]: DEBUG nova.objects.base [None req-a6a874e3-129b-4580-a47f-ddfabd98acc7 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Object Instance<8271a429-e252-42bb-8717-e89dfd9739bf> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75122) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 09:45:48 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-a6a874e3-129b-4580-a47f-ddfabd98acc7 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 09:45:48 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-a6a874e3-129b-4580-a47f-ddfabd98acc7 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 09:45:48 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-a6a874e3-129b-4580-a47f-ddfabd98acc7 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75122) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 09:45:48 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-a6a874e3-129b-4580-a47f-ddfabd98acc7 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] CPU controller missing on host. {{(pid=75122) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 09:45:48 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-a6a874e3-129b-4580-a47f-ddfabd98acc7 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75122) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 09:45:48 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-a6a874e3-129b-4580-a47f-ddfabd98acc7 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] CPU controller found on host. {{(pid=75122) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 09:45:48 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-a6a874e3-129b-4580-a47f-ddfabd98acc7 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75122) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 09:45:48 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-a6a874e3-129b-4580-a47f-ddfabd98acc7 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T09:26:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T09:26:31Z,direct_url=<?>,disk_format='qcow2',id=5e862cfe-47b8-4725-8292-65761ee6d0f5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9c57733cb41847c0b4ad31519c382e5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T09:26:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 09:45:48 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-a6a874e3-129b-4580-a47f-ddfabd98acc7 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Flavor limits 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 09:45:48 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-a6a874e3-129b-4580-a47f-ddfabd98acc7 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Image limits 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 09:45:48 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-a6a874e3-129b-4580-a47f-ddfabd98acc7 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Flavor pref 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 09:45:48 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-a6a874e3-129b-4580-a47f-ddfabd98acc7 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Image pref 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 09:45:48 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-a6a874e3-129b-4580-a47f-ddfabd98acc7 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 09:45:48 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-a6a874e3-129b-4580-a47f-ddfabd98acc7 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 09:45:48 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-a6a874e3-129b-4580-a47f-ddfabd98acc7 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75122) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 09:45:48 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-a6a874e3-129b-4580-a47f-ddfabd98acc7 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Got 1 possible topologies {{(pid=75122) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 09:45:48 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-a6a874e3-129b-4580-a47f-ddfabd98acc7 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 09:45:48 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-a6a874e3-129b-4580-a47f-ddfabd98acc7 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 09:45:48 user nova-compute[75122]: DEBUG nova.objects.instance [None req-a6a874e3-129b-4580-a47f-ddfabd98acc7 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Lazy-loading 'vcpu_model' on Instance uuid 8271a429-e252-42bb-8717-e89dfd9739bf {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:45:48 user nova-compute[75122]: DEBUG nova.objects.base [None req-a6a874e3-129b-4580-a47f-ddfabd98acc7 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Object Instance<8271a429-e252-42bb-8717-e89dfd9739bf> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75122) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 09:45:48 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-a6a874e3-129b-4580-a47f-ddfabd98acc7 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T09:43:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1557571265',display_name='tempest-ServerRescueNegativeTestJSON-server-1557571265',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1557571265',id=30,image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMbJqP1ByBl8MwFuhgI4Maut89fFXBQm0AZFy/U/KQEQbLyjF3Qkd0mt4JO2QcR+bc5y3VziaM1h7w2MWLT+t2p4sHAYFMiUNVAa5O4UJxoDo7cVDTcqH0mo3/nwMOL2mg==',key_name='tempest-keypair-1317030039',keypairs=<?>,launch_index=0,launched_at=2023-11-15T09:43:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='eeff24cb28f5481fa3941ba399ce82ff',ramdisk_id='',reservation_id='r-weslqkgj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-59965354',owner_user_name='tempest-ServerRescueNegativeTestJSON-59965354-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T09:43:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d05ef35b07ba45afb142f406d418d8d4',uuid=8271a429-e252-42bb-8717-e89dfd9739bf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "044ffaae-8351-4c7f-9b12-32ac7d4b3565", "address": "fa:16:3e:e3:9d:f8", "network": {"id": "c2062f64-d925-42d2-9687-5d2511ef6697", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1134087048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1134087048-network", "vif_mac": "fa:16:3e:e3:9d:f8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eeff24cb28f5481fa3941ba399ce82ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap044ffaae-83", "ovs_interfaceid": "044ffaae-8351-4c7f-9b12-32ac7d4b3565", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75122) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 09:45:48 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-a6a874e3-129b-4580-a47f-ddfabd98acc7 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Converting VIF {"id": "044ffaae-8351-4c7f-9b12-32ac7d4b3565", "address": "fa:16:3e:e3:9d:f8", "network": {"id": "c2062f64-d925-42d2-9687-5d2511ef6697", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1134087048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1134087048-network", "vif_mac": "fa:16:3e:e3:9d:f8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eeff24cb28f5481fa3941ba399ce82ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap044ffaae-83", "ovs_interfaceid": "044ffaae-8351-4c7f-9b12-32ac7d4b3565", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 09:45:48 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-a6a874e3-129b-4580-a47f-ddfabd98acc7 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e3:9d:f8,bridge_name='br-int',has_traffic_filtering=True,id=044ffaae-8351-4c7f-9b12-32ac7d4b3565,network=Network(c2062f64-d925-42d2-9687-5d2511ef6697),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap044ffaae-83') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 09:45:48 user nova-compute[75122]: DEBUG nova.objects.instance [None req-a6a874e3-129b-4580-a47f-ddfabd98acc7 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Lazy-loading 'pci_devices' on Instance uuid 8271a429-e252-42bb-8717-e89dfd9739bf {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:45:48 user nova-compute[75122]: DEBUG nova.objects.base [None req-a6a874e3-129b-4580-a47f-ddfabd98acc7 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Object Instance<8271a429-e252-42bb-8717-e89dfd9739bf> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75122) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 09:45:48 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-a6a874e3-129b-4580-a47f-ddfabd98acc7 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] [instance: 8271a429-e252-42bb-8717-e89dfd9739bf] End _get_guest_xml xml=<domain type="kvm">
Nov 15 09:45:48 user nova-compute[75122]:   <uuid>8271a429-e252-42bb-8717-e89dfd9739bf</uuid>
Nov 15 09:45:48 user nova-compute[75122]:   <name>instance-0000001e</name>
Nov 15 09:45:48 user nova-compute[75122]:   <memory>524288</memory>
Nov 15 09:45:48 user nova-compute[75122]:   <vcpu>1</vcpu>
Nov 15 09:45:48 user nova-compute[75122]:   <metadata>
Nov 15 09:45:48 user nova-compute[75122]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 09:45:48 user nova-compute[75122]:       <nova:package version="0.0.0"/>
Nov 15 09:45:48 user nova-compute[75122]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1557571265</nova:name>
Nov 15 09:45:48 user nova-compute[75122]:       <nova:creationTime>2023-11-15 09:45:48</nova:creationTime>
Nov 15 09:45:48 user nova-compute[75122]:       <nova:flavor name="m1.tiny">
Nov 15 09:45:48 user nova-compute[75122]:         <nova:memory>512</nova:memory>
Nov 15 09:45:48 user nova-compute[75122]:         <nova:disk>1</nova:disk>
Nov 15 09:45:48 user nova-compute[75122]:         <nova:swap>0</nova:swap>
Nov 15 09:45:48 user nova-compute[75122]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 09:45:48 user nova-compute[75122]:         <nova:vcpus>1</nova:vcpus>
Nov 15 09:45:48 user nova-compute[75122]:       </nova:flavor>
Nov 15 09:45:48 user nova-compute[75122]:       <nova:owner>
Nov 15 09:45:48 user nova-compute[75122]:         <nova:user uuid="d05ef35b07ba45afb142f406d418d8d4">tempest-ServerRescueNegativeTestJSON-59965354-project-member</nova:user>
Nov 15 09:45:48 user nova-compute[75122]:         <nova:project uuid="eeff24cb28f5481fa3941ba399ce82ff">tempest-ServerRescueNegativeTestJSON-59965354</nova:project>
Nov 15 09:45:48 user nova-compute[75122]:       </nova:owner>
Nov 15 09:45:48 user nova-compute[75122]:       <nova:root type="image" uuid="5e862cfe-47b8-4725-8292-65761ee6d0f5"/>
Nov 15 09:45:48 user nova-compute[75122]:       <nova:ports>
Nov 15 09:45:48 user nova-compute[75122]:         <nova:port uuid="044ffaae-8351-4c7f-9b12-32ac7d4b3565">
Nov 15 09:45:48 user nova-compute[75122]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 15 09:45:48 user nova-compute[75122]:         </nova:port>
Nov 15 09:45:48 user nova-compute[75122]:       </nova:ports>
Nov 15 09:45:48 user nova-compute[75122]:     </nova:instance>
Nov 15 09:45:48 user nova-compute[75122]:   </metadata>
Nov 15 09:45:48 user nova-compute[75122]:   <sysinfo type="smbios">
Nov 15 09:45:48 user nova-compute[75122]:     <system>
Nov 15 09:45:48 user nova-compute[75122]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 09:45:48 user nova-compute[75122]:       <entry name="product">OpenStack Nova</entry>
Nov 15 09:45:48 user nova-compute[75122]:       <entry name="version">0.0.0</entry>
Nov 15 09:45:48 user nova-compute[75122]:       <entry name="serial">8271a429-e252-42bb-8717-e89dfd9739bf</entry>
Nov 15 09:45:48 user nova-compute[75122]:       <entry name="uuid">8271a429-e252-42bb-8717-e89dfd9739bf</entry>
Nov 15 09:45:48 user nova-compute[75122]:       <entry name="family">Virtual Machine</entry>
Nov 15 09:45:48 user nova-compute[75122]:     </system>
Nov 15 09:45:48 user nova-compute[75122]:   </sysinfo>
Nov 15 09:45:48 user nova-compute[75122]:   <os>
Nov 15 09:45:48 user nova-compute[75122]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 09:45:48 user nova-compute[75122]:     <smbios mode="sysinfo"/>
Nov 15 09:45:48 user nova-compute[75122]:   </os>
Nov 15 09:45:48 user nova-compute[75122]:   <features>
Nov 15 09:45:48 user nova-compute[75122]:     <acpi/>
Nov 15 09:45:48 user nova-compute[75122]:     <apic/>
Nov 15 09:45:48 user nova-compute[75122]:     <vmcoreinfo/>
Nov 15 09:45:48 user nova-compute[75122]:   </features>
Nov 15 09:45:48 user nova-compute[75122]:   <clock offset="utc">
Nov 15 09:45:48 user nova-compute[75122]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 09:45:48 user nova-compute[75122]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 09:45:48 user nova-compute[75122]:     <timer name="hpet" present="no"/>
Nov 15 09:45:48 user nova-compute[75122]:   </clock>
Nov 15 09:45:48 user nova-compute[75122]:   <cpu mode="custom" match="exact">
Nov 15 09:45:48 user nova-compute[75122]:     <model>Nehalem</model>
Nov 15 09:45:48 user nova-compute[75122]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 09:45:48 user nova-compute[75122]:   </cpu>
Nov 15 09:45:48 user nova-compute[75122]:   <devices>
Nov 15 09:45:48 user nova-compute[75122]:     <disk type="file" device="disk">
Nov 15 09:45:48 user nova-compute[75122]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 09:45:48 user nova-compute[75122]:       <source file="/opt/stack/data/nova/instances/8271a429-e252-42bb-8717-e89dfd9739bf/disk.rescue"/>
Nov 15 09:45:48 user nova-compute[75122]:       <target dev="vda" bus="virtio"/>
Nov 15 09:45:48 user nova-compute[75122]:     </disk>
Nov 15 09:45:48 user nova-compute[75122]:     <disk type="file" device="disk">
Nov 15 09:45:48 user nova-compute[75122]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 09:45:48 user nova-compute[75122]:       <source file="/opt/stack/data/nova/instances/8271a429-e252-42bb-8717-e89dfd9739bf/disk"/>
Nov 15 09:45:48 user nova-compute[75122]:       <target dev="vdb" bus="virtio"/>
Nov 15 09:45:48 user nova-compute[75122]:     </disk>
Nov 15 09:45:48 user nova-compute[75122]:     <interface type="ethernet">
Nov 15 09:45:48 user nova-compute[75122]:       <mac address="fa:16:3e:e3:9d:f8"/>
Nov 15 09:45:48 user nova-compute[75122]:       <model type="virtio"/>
Nov 15 09:45:48 user nova-compute[75122]:       <mtu size="1442"/>
Nov 15 09:45:48 user nova-compute[75122]:       <target dev="tap044ffaae-83"/>
Nov 15 09:45:48 user nova-compute[75122]:     </interface>
Nov 15 09:45:48 user nova-compute[75122]:     <serial type="pty">
Nov 15 09:45:48 user nova-compute[75122]:       <log file="/opt/stack/data/nova/instances/8271a429-e252-42bb-8717-e89dfd9739bf/console.log" append="off"/>
Nov 15 09:45:48 user nova-compute[75122]:     </serial>
Nov 15 09:45:48 user nova-compute[75122]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 09:45:48 user nova-compute[75122]:     <video>
Nov 15 09:45:48 user nova-compute[75122]:       <model type="virtio"/>
Nov 15 09:45:48 user nova-compute[75122]:     </video>
Nov 15 09:45:48 user nova-compute[75122]:     <rng model="virtio">
Nov 15 09:45:48 user nova-compute[75122]:       <backend model="random">/dev/urandom</backend>
Nov 15 09:45:48 user nova-compute[75122]:     </rng>
Nov 15 09:45:48 user nova-compute[75122]:     <controller type="usb" index="0" model="none"/>
Nov 15 09:45:48 user nova-compute[75122]:     <memballoon model="virtio">
Nov 15 09:45:48 user nova-compute[75122]:       <stats period="10"/>
Nov 15 09:45:48 user nova-compute[75122]:     </memballoon>
Nov 15 09:45:48 user nova-compute[75122]:   </devices>
Nov 15 09:45:48 user nova-compute[75122]: </domain>
Nov 15 09:45:48 user nova-compute[75122]:  {{(pid=75122) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 09:45:48 user nova-compute[75122]: INFO nova.virt.libvirt.driver [-] [instance: 8271a429-e252-42bb-8717-e89dfd9739bf] Instance destroyed successfully.
Nov 15 09:45:48 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-a6a874e3-129b-4580-a47f-ddfabd98acc7 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] No BDM found with device name vda, not building metadata. {{(pid=75122) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 09:45:48 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-a6a874e3-129b-4580-a47f-ddfabd98acc7 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75122) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 09:45:48 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-a6a874e3-129b-4580-a47f-ddfabd98acc7 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] No VIF found with MAC fa:16:3e:e3:9d:f8, not building metadata {{(pid=75122) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 09:45:49 user nova-compute[75122]: DEBUG nova.compute.manager [req-59442ec1-76c4-4c8e-869e-74388cf77e07 req-ef6f6a96-7e5e-4a1d-84af-22ff3811c893 service nova] [instance: 8271a429-e252-42bb-8717-e89dfd9739bf] Received event network-vif-plugged-044ffaae-8351-4c7f-9b12-32ac7d4b3565 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:45:49 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-59442ec1-76c4-4c8e-869e-74388cf77e07 req-ef6f6a96-7e5e-4a1d-84af-22ff3811c893 service nova] Acquiring lock "8271a429-e252-42bb-8717-e89dfd9739bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:45:49 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-59442ec1-76c4-4c8e-869e-74388cf77e07 req-ef6f6a96-7e5e-4a1d-84af-22ff3811c893 service nova] Lock "8271a429-e252-42bb-8717-e89dfd9739bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:45:49 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-59442ec1-76c4-4c8e-869e-74388cf77e07 req-ef6f6a96-7e5e-4a1d-84af-22ff3811c893 service nova] Lock "8271a429-e252-42bb-8717-e89dfd9739bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:45:49 user nova-compute[75122]: DEBUG nova.compute.manager [req-59442ec1-76c4-4c8e-869e-74388cf77e07 req-ef6f6a96-7e5e-4a1d-84af-22ff3811c893 service nova] [instance: 8271a429-e252-42bb-8717-e89dfd9739bf] No waiting events found dispatching network-vif-plugged-044ffaae-8351-4c7f-9b12-32ac7d4b3565 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:45:49 user nova-compute[75122]: WARNING nova.compute.manager [req-59442ec1-76c4-4c8e-869e-74388cf77e07 req-ef6f6a96-7e5e-4a1d-84af-22ff3811c893 service nova] [instance: 8271a429-e252-42bb-8717-e89dfd9739bf] Received unexpected event network-vif-plugged-044ffaae-8351-4c7f-9b12-32ac7d4b3565 for instance with vm_state active and task_state rescuing.
Nov 15 09:45:49 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:45:49 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:45:49 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:45:49 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:45:50 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:45:51 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:45:51 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:45:51 user nova-compute[75122]: DEBUG nova.compute.manager [req-abc47bba-c942-4e6a-963d-7e5653fedbd9 req-a6109717-cb55-422a-b0df-f410e05c2b69 service nova] [instance: 8271a429-e252-42bb-8717-e89dfd9739bf] Received event network-vif-plugged-044ffaae-8351-4c7f-9b12-32ac7d4b3565 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:45:51 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-abc47bba-c942-4e6a-963d-7e5653fedbd9 req-a6109717-cb55-422a-b0df-f410e05c2b69 service nova] Acquiring lock "8271a429-e252-42bb-8717-e89dfd9739bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:45:51 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-abc47bba-c942-4e6a-963d-7e5653fedbd9 req-a6109717-cb55-422a-b0df-f410e05c2b69 service nova] Lock "8271a429-e252-42bb-8717-e89dfd9739bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:45:51 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-abc47bba-c942-4e6a-963d-7e5653fedbd9 req-a6109717-cb55-422a-b0df-f410e05c2b69 service nova] Lock "8271a429-e252-42bb-8717-e89dfd9739bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:45:51 user nova-compute[75122]: DEBUG nova.compute.manager [req-abc47bba-c942-4e6a-963d-7e5653fedbd9 req-a6109717-cb55-422a-b0df-f410e05c2b69 service nova] [instance: 8271a429-e252-42bb-8717-e89dfd9739bf] No waiting events found dispatching network-vif-plugged-044ffaae-8351-4c7f-9b12-32ac7d4b3565 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:45:51 user nova-compute[75122]: WARNING nova.compute.manager [req-abc47bba-c942-4e6a-963d-7e5653fedbd9 req-a6109717-cb55-422a-b0df-f410e05c2b69 service nova] [instance: 8271a429-e252-42bb-8717-e89dfd9739bf] Received unexpected event network-vif-plugged-044ffaae-8351-4c7f-9b12-32ac7d4b3565 for instance with vm_state active and task_state rescuing.
Nov 15 09:45:51 user nova-compute[75122]: DEBUG nova.compute.manager [req-abc47bba-c942-4e6a-963d-7e5653fedbd9 req-a6109717-cb55-422a-b0df-f410e05c2b69 service nova] [instance: 8271a429-e252-42bb-8717-e89dfd9739bf] Received event network-vif-plugged-044ffaae-8351-4c7f-9b12-32ac7d4b3565 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:45:51 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-abc47bba-c942-4e6a-963d-7e5653fedbd9 req-a6109717-cb55-422a-b0df-f410e05c2b69 service nova] Acquiring lock "8271a429-e252-42bb-8717-e89dfd9739bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:45:51 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-abc47bba-c942-4e6a-963d-7e5653fedbd9 req-a6109717-cb55-422a-b0df-f410e05c2b69 service nova] Lock "8271a429-e252-42bb-8717-e89dfd9739bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:45:51 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-abc47bba-c942-4e6a-963d-7e5653fedbd9 req-a6109717-cb55-422a-b0df-f410e05c2b69 service nova] Lock "8271a429-e252-42bb-8717-e89dfd9739bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:45:51 user nova-compute[75122]: DEBUG nova.compute.manager [req-abc47bba-c942-4e6a-963d-7e5653fedbd9 req-a6109717-cb55-422a-b0df-f410e05c2b69 service nova] [instance: 8271a429-e252-42bb-8717-e89dfd9739bf] No waiting events found dispatching network-vif-plugged-044ffaae-8351-4c7f-9b12-32ac7d4b3565 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:45:51 user nova-compute[75122]: WARNING nova.compute.manager [req-abc47bba-c942-4e6a-963d-7e5653fedbd9 req-a6109717-cb55-422a-b0df-f410e05c2b69 service nova] [instance: 8271a429-e252-42bb-8717-e89dfd9739bf] Received unexpected event network-vif-plugged-044ffaae-8351-4c7f-9b12-32ac7d4b3565 for instance with vm_state active and task_state rescuing.
Nov 15 09:45:52 user nova-compute[75122]: DEBUG nova.compute.manager [None req-a6a874e3-129b-4580-a47f-ddfabd98acc7 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] [instance: 8271a429-e252-42bb-8717-e89dfd9739bf] Checking state {{(pid=75122) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 09:45:52 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:45:56 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:45:57 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:46:02 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:46:06 user nova-compute[75122]: DEBUG nova.compute.manager [req-37a5bd55-314a-4a91-9a41-92cd8e445f14 req-6b04e2ac-7a9e-45a9-943a-5beb78ec31a9 service nova] [instance: 49154de0-f941-4ae0-a7af-72e75a4d8040] Received event network-changed-62759685-70a8-44fe-9a6c-36ec4cd002a2 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:46:06 user nova-compute[75122]: DEBUG nova.compute.manager [req-37a5bd55-314a-4a91-9a41-92cd8e445f14 req-6b04e2ac-7a9e-45a9-943a-5beb78ec31a9 service nova] [instance: 49154de0-f941-4ae0-a7af-72e75a4d8040] Refreshing instance network info cache due to event network-changed-62759685-70a8-44fe-9a6c-36ec4cd002a2. {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 09:46:06 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-37a5bd55-314a-4a91-9a41-92cd8e445f14 req-6b04e2ac-7a9e-45a9-943a-5beb78ec31a9 service nova] Acquiring lock "refresh_cache-49154de0-f941-4ae0-a7af-72e75a4d8040" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 09:46:06 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-37a5bd55-314a-4a91-9a41-92cd8e445f14 req-6b04e2ac-7a9e-45a9-943a-5beb78ec31a9 service nova] Acquired lock "refresh_cache-49154de0-f941-4ae0-a7af-72e75a4d8040" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 09:46:06 user nova-compute[75122]: DEBUG nova.network.neutron [req-37a5bd55-314a-4a91-9a41-92cd8e445f14 req-6b04e2ac-7a9e-45a9-943a-5beb78ec31a9 service nova] [instance: 49154de0-f941-4ae0-a7af-72e75a4d8040] Refreshing network info cache for port 62759685-70a8-44fe-9a6c-36ec4cd002a2 {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 09:46:06 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:46:06 user nova-compute[75122]: DEBUG nova.network.neutron [req-37a5bd55-314a-4a91-9a41-92cd8e445f14 req-6b04e2ac-7a9e-45a9-943a-5beb78ec31a9 service nova] [instance: 49154de0-f941-4ae0-a7af-72e75a4d8040] Updated VIF entry in instance network info cache for port 62759685-70a8-44fe-9a6c-36ec4cd002a2. {{(pid=75122) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 09:46:06 user nova-compute[75122]: DEBUG nova.network.neutron [req-37a5bd55-314a-4a91-9a41-92cd8e445f14 req-6b04e2ac-7a9e-45a9-943a-5beb78ec31a9 service nova] [instance: 49154de0-f941-4ae0-a7af-72e75a4d8040] Updating instance_info_cache with network_info: [{"id": "62759685-70a8-44fe-9a6c-36ec4cd002a2", "address": "fa:16:3e:9a:6e:b1", "network": {"id": "b5966731-865f-495c-9cea-07c563eb13a3", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-641799461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d6a287ccfe04bfebdf80d827d49ce51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62759685-70", "ovs_interfaceid": "62759685-70a8-44fe-9a6c-36ec4cd002a2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:46:06 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-37a5bd55-314a-4a91-9a41-92cd8e445f14 req-6b04e2ac-7a9e-45a9-943a-5beb78ec31a9 service nova] Releasing lock "refresh_cache-49154de0-f941-4ae0-a7af-72e75a4d8040" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 09:46:07 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:46:08 user nova-compute[75122]: DEBUG nova.compute.manager [req-ac25b0d9-bea2-4cf6-b4b1-b764d6f7732c req-a37048f5-fc87-4229-a417-ca3bffae8918 service nova] [instance: a1121448-8452-4955-8112-7b984921dac6] Received event network-changed-9d82266f-3fa1-4cc5-994d-4a55b8a77f6f {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:46:08 user nova-compute[75122]: DEBUG nova.compute.manager [req-ac25b0d9-bea2-4cf6-b4b1-b764d6f7732c req-a37048f5-fc87-4229-a417-ca3bffae8918 service nova] [instance: a1121448-8452-4955-8112-7b984921dac6] Refreshing instance network info cache due to event network-changed-9d82266f-3fa1-4cc5-994d-4a55b8a77f6f. {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 09:46:08 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-ac25b0d9-bea2-4cf6-b4b1-b764d6f7732c req-a37048f5-fc87-4229-a417-ca3bffae8918 service nova] Acquiring lock "refresh_cache-a1121448-8452-4955-8112-7b984921dac6" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 09:46:08 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-ac25b0d9-bea2-4cf6-b4b1-b764d6f7732c req-a37048f5-fc87-4229-a417-ca3bffae8918 service nova] Acquired lock "refresh_cache-a1121448-8452-4955-8112-7b984921dac6" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 09:46:08 user nova-compute[75122]: DEBUG nova.network.neutron [req-ac25b0d9-bea2-4cf6-b4b1-b764d6f7732c req-a37048f5-fc87-4229-a417-ca3bffae8918 service nova] [instance: a1121448-8452-4955-8112-7b984921dac6] Refreshing network info cache for port 9d82266f-3fa1-4cc5-994d-4a55b8a77f6f {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 09:46:08 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-9069c3b3-c379-4a1e-bd60-42128a1608b1 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Acquiring lock "49154de0-f941-4ae0-a7af-72e75a4d8040" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:46:08 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-9069c3b3-c379-4a1e-bd60-42128a1608b1 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Lock "49154de0-f941-4ae0-a7af-72e75a4d8040" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:46:08 user nova-compute[75122]: DEBUG nova.objects.instance [None req-9069c3b3-c379-4a1e-bd60-42128a1608b1 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Lazy-loading 'flavor' on Instance uuid 49154de0-f941-4ae0-a7af-72e75a4d8040 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:46:08 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-9069c3b3-c379-4a1e-bd60-42128a1608b1 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Lock "49154de0-f941-4ae0-a7af-72e75a4d8040" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:46:08 user nova-compute[75122]: DEBUG nova.network.neutron [req-ac25b0d9-bea2-4cf6-b4b1-b764d6f7732c req-a37048f5-fc87-4229-a417-ca3bffae8918 service nova] [instance: a1121448-8452-4955-8112-7b984921dac6] Updated VIF entry in instance network info cache for port 9d82266f-3fa1-4cc5-994d-4a55b8a77f6f. {{(pid=75122) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 09:46:08 user nova-compute[75122]: DEBUG nova.network.neutron [req-ac25b0d9-bea2-4cf6-b4b1-b764d6f7732c req-a37048f5-fc87-4229-a417-ca3bffae8918 service nova] [instance: a1121448-8452-4955-8112-7b984921dac6] Updating instance_info_cache with network_info: [{"id": "9d82266f-3fa1-4cc5-994d-4a55b8a77f6f", "address": "fa:16:3e:c3:ac:e1", "network": {"id": "cc80acf3-8a44-4d7e-aaa0-1214700564b3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1084984321-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f29cd64a8a674d73936b8a0c90bf2d34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d82266f-3f", "ovs_interfaceid": "9d82266f-3fa1-4cc5-994d-4a55b8a77f6f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:46:08 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-ac25b0d9-bea2-4cf6-b4b1-b764d6f7732c req-a37048f5-fc87-4229-a417-ca3bffae8918 service nova] Releasing lock "refresh_cache-a1121448-8452-4955-8112-7b984921dac6" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 09:46:08 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-9069c3b3-c379-4a1e-bd60-42128a1608b1 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Acquiring lock "49154de0-f941-4ae0-a7af-72e75a4d8040" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:46:08 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-9069c3b3-c379-4a1e-bd60-42128a1608b1 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Lock "49154de0-f941-4ae0-a7af-72e75a4d8040" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:46:08 user nova-compute[75122]: INFO nova.compute.manager [None req-9069c3b3-c379-4a1e-bd60-42128a1608b1 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] [instance: 49154de0-f941-4ae0-a7af-72e75a4d8040] Attaching volume 2c145d4b-3d4e-4d11-9b72-2373acc012e3 to /dev/vdb
Nov 15 09:46:08 user nova-compute[75122]: DEBUG os_brick.utils [None req-9069c3b3-c379-4a1e-bd60-42128a1608b1 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 09:46:08 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:46:08 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:46:08 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[055d04e1-dcc8-4b54-b3e6-99ec5ba321cd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:742fb64b3587\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:46:08 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:46:08 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:46:08 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[f47a00a5-c78f-4d59-b47d-c48e2895b702]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:46:08 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:46:08 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:46:08 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[efbb8f97-1968-4ed5-9fca-b9d2665dc06d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:46:08 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b082f7d-f6d4-40cb-b95d-cf5a5d079aed]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:46:08 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-9069c3b3-c379-4a1e-bd60-42128a1608b1 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Running cmd (subprocess): nvme version {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:46:08 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-9069c3b3-c379-4a1e-bd60-42128a1608b1 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] 'nvme version' failed. Not Retrying. {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 09:46:08 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9069c3b3-c379-4a1e-bd60-42128a1608b1 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] nvme not present on system {{(pid=75122) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 09:46:08 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:46:08 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 09:46:08 user nova-compute[75122]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 09:46:08 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[624d0801-2126-4c80-be59-a45828247e88]: (4, '') {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:46:08 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.lightos [None req-9069c3b3-c379-4a1e-bd60-42128a1608b1 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75122) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 09:46:08 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.lightos [None req-9069c3b3-c379-4a1e-bd60-42128a1608b1 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75122) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 09:46:08 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.lightos [None req-9069c3b3-c379-4a1e-bd60-42128a1608b1 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] LIGHTOS: no hostnqn found. {{(pid=75122) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 09:46:08 user nova-compute[75122]: DEBUG os_brick.utils [None req-9069c3b3-c379-4a1e-bd60-42128a1608b1 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:742fb64b3587', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 09:46:08 user nova-compute[75122]: DEBUG nova.virt.block_device [None req-9069c3b3-c379-4a1e-bd60-42128a1608b1 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] [instance: 49154de0-f941-4ae0-a7af-72e75a4d8040] Updating existing volume attachment record: de2a1842-d7be-4dfc-862a-9e95bdd0d9ad {{(pid=75122) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 09:46:10 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-492dde4c-1373-47be-ac55-7cc009023318 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Acquiring lock "a1121448-8452-4955-8112-7b984921dac6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:46:10 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-492dde4c-1373-47be-ac55-7cc009023318 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Lock "a1121448-8452-4955-8112-7b984921dac6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:46:10 user nova-compute[75122]: DEBUG nova.objects.instance [None req-492dde4c-1373-47be-ac55-7cc009023318 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Lazy-loading 'flavor' on Instance uuid a1121448-8452-4955-8112-7b984921dac6 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:46:10 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-492dde4c-1373-47be-ac55-7cc009023318 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Lock "a1121448-8452-4955-8112-7b984921dac6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:46:10 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-492dde4c-1373-47be-ac55-7cc009023318 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Acquiring lock "a1121448-8452-4955-8112-7b984921dac6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:46:10 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-492dde4c-1373-47be-ac55-7cc009023318 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Lock "a1121448-8452-4955-8112-7b984921dac6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:46:10 user nova-compute[75122]: INFO nova.compute.manager [None req-492dde4c-1373-47be-ac55-7cc009023318 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] [instance: a1121448-8452-4955-8112-7b984921dac6] Attaching volume fa46e0b9-44fe-4c2a-9627-87bcb42f57e1 to /dev/vdb
Nov 15 09:46:10 user nova-compute[75122]: DEBUG os_brick.utils [None req-492dde4c-1373-47be-ac55-7cc009023318 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 09:46:10 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:46:10 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:46:10 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d767abf-58aa-4b8e-9a73-7d30fdedf08f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:742fb64b3587\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:46:10 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:46:10 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:46:10 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[f730e094-305e-4592-8d3d-cb9d567577a1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:46:10 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:46:10 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:46:10 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[dff58f0f-77a4-4814-ae54-e94bc03f92c6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:46:10 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[bca5fcba-4221-41d3-9975-e80984b4d289]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:46:10 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-492dde4c-1373-47be-ac55-7cc009023318 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Running cmd (subprocess): nvme version {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:46:10 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-492dde4c-1373-47be-ac55-7cc009023318 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] 'nvme version' failed. Not Retrying. {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 09:46:10 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.nvmeof [None req-492dde4c-1373-47be-ac55-7cc009023318 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] nvme not present on system {{(pid=75122) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 09:46:10 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:46:10 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 09:46:10 user nova-compute[75122]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 09:46:10 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2cb3c75-5c8c-45ab-b5bf-fb22a9cd716c]: (4, '') {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:46:10 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.lightos [None req-492dde4c-1373-47be-ac55-7cc009023318 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75122) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 09:46:10 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.lightos [None req-492dde4c-1373-47be-ac55-7cc009023318 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75122) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 09:46:10 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.lightos [None req-492dde4c-1373-47be-ac55-7cc009023318 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] LIGHTOS: no hostnqn found. {{(pid=75122) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 09:46:10 user nova-compute[75122]: DEBUG os_brick.utils [None req-492dde4c-1373-47be-ac55-7cc009023318 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:742fb64b3587', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 09:46:10 user nova-compute[75122]: DEBUG nova.virt.block_device [None req-492dde4c-1373-47be-ac55-7cc009023318 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] [instance: a1121448-8452-4955-8112-7b984921dac6] Updating existing volume attachment record: 6e37a899-95bb-4705-9f4f-81052d49816b {{(pid=75122) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 09:46:11 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:46:12 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:46:13 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9069c3b3-c379-4a1e-bd60-42128a1608b1 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] [instance: 49154de0-f941-4ae0-a7af-72e75a4d8040] Calling os-brick to attach iSCSI Volume {{(pid=75122) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 09:46:13 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-9069c3b3-c379-4a1e-bd60-42128a1608b1 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffa04060b80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2c145d4b-3d4e-4d11-9b72-2373acc012e3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cyZrSTOX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 09:46:13 user nova-compute[75122]: WARNING os_brick.initiator.connectors.base [None req-9069c3b3-c379-4a1e-bd60-42128a1608b1 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 09:46:13 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-9069c3b3-c379-4a1e-bd60-42128a1608b1 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 09:46:13 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-9069c3b3-c379-4a1e-bd60-42128a1608b1 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 09:46:13 user nova-compute[75122]: WARNING os_brick.initiator.connectors.base [None req-9069c3b3-c379-4a1e-bd60-42128a1608b1 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 09:46:13 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-9069c3b3-c379-4a1e-bd60-42128a1608b1 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2c145d4b-3d4e-4d11-9b72-2373acc012e3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 09:46:13 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-9069c3b3-c379-4a1e-bd60-42128a1608b1 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2c145d4b-3d4e-4d11-9b72-2373acc012e3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 09:46:13 user nova-compute[75122]: INFO os_brick.initiator.connectors.iscsi [None req-9069c3b3-c379-4a1e-bd60-42128a1608b1 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 09:46:13 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c145d4b-3d4e-4d11-9b72-2373acc012e3 -p 172.16.0.220:3260 {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:46:13 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c145d4b-3d4e-4d11-9b72-2373acc012e3 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:46:13 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a6580c7-70a6-4efc-888b-fae807502170]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:46:13 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-9069c3b3-c379-4a1e-bd60-42128a1608b1 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 09:46:13 user nova-compute[75122]:  {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:46:13 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c145d4b-3d4e-4d11-9b72-2373acc012e3 -p 172.16.0.220:3260 --interface default --op new {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:46:13 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c145d4b-3d4e-4d11-9b72-2373acc012e3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:46:13 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[3174b950-bbab-40be-9490-8ff00f61d26b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2c145d4b-3d4e-4d11-9b72-2373acc012e3] added\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:46:13 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-9069c3b3-c379-4a1e-bd60-42128a1608b1 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2c145d4b-3d4e-4d11-9b72-2373acc012e3] added
Nov 15 09:46:13 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:46:13 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c145d4b-3d4e-4d11-9b72-2373acc012e3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:46:13 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c145d4b-3d4e-4d11-9b72-2373acc012e3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:46:13 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[619b4de2-4237-4fd2-8ef2-81c64e41eeee]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:46:13 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-9069c3b3-c379-4a1e-bd60-42128a1608b1 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:46:13 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c145d4b-3d4e-4d11-9b72-2373acc012e3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:46:13 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c145d4b-3d4e-4d11-9b72-2373acc012e3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:46:13 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[9df9b79a-a024-4cf0-b16a-c4bc54511268]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:46:13 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-9069c3b3-c379-4a1e-bd60-42128a1608b1 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:46:13 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c145d4b-3d4e-4d11-9b72-2373acc012e3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cyZrSTOX {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:46:13 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c145d4b-3d4e-4d11-9b72-2373acc012e3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cyZrSTOX" returned: 0 in 0.023s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:46:13 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[81c55e97-8fd2-4f86-b2fe-6ceed7ab3209]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:46:13 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-9069c3b3-c379-4a1e-bd60-42128a1608b1 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cyZrSTOX'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:46:13 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c145d4b-3d4e-4d11-9b72-2373acc012e3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:46:13 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c145d4b-3d4e-4d11-9b72-2373acc012e3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:46:13 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ad7c72d-9f5a-49e6-bad1-01481eaf4f98]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:46:13 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-9069c3b3-c379-4a1e-bd60-42128a1608b1 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:46:13 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:46:13 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:46:13 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9d4d7e8-aca9-499f-8c08-a516cc4e0d8d]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6224c0df-13b0-4ff7-928f-9a2282386a2a (non-flash)\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:46:13 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-9069c3b3-c379-4a1e-bd60-42128a1608b1 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17 (non-flash)
Nov 15 09:46:13 user nova-compute[75122]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6224c0df-13b0-4ff7-928f-9a2282386a2a (non-flash)
Nov 15 09:46:13 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 09:46:13 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-9069c3b3-c379-4a1e-bd60-42128a1608b1 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17 (non-flash)
Nov 15 09:46:13 user nova-compute[75122]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6224c0df-13b0-4ff7-928f-9a2282386a2a (non-flash)
Nov 15 09:46:13 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 09:46:13 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c145d4b-3d4e-4d11-9b72-2373acc012e3 -p 172.16.0.220:3260 --login {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:46:13 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c145d4b-3d4e-4d11-9b72-2373acc012e3 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:46:13 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5612720-64fd-4d7c-9301-2309beb0c540]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2c145d4b-3d4e-4d11-9b72-2373acc012e3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2c145d4b-3d4e-4d11-9b72-2373acc012e3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:46:13 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-9069c3b3-c379-4a1e-bd60-42128a1608b1 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2c145d4b-3d4e-4d11-9b72-2373acc012e3, portal: 172.16.0.220,3260]
Nov 15 09:46:13 user nova-compute[75122]: Login to [iface: default, target: iqn.2010-10.org.openstack:2c145d4b-3d4e-4d11-9b72-2373acc012e3, portal: 172.16.0.220,3260] successful.
Nov 15 09:46:13 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:46:13 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c145d4b-3d4e-4d11-9b72-2373acc012e3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:46:13 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c145d4b-3d4e-4d11-9b72-2373acc012e3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:46:13 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[a97be977-c11f-4777-aa13-99fe3b9cf254]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:46:13 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-9069c3b3-c379-4a1e-bd60-42128a1608b1 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:46:13 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:46:13 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:46:13 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[71f5f9de-bc19-4c9d-91b1-08a8bddf0f56]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6224c0df-13b0-4ff7-928f-9a2282386a2a (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c145d4b-3d4e-4d11-9b72-2373acc012e3 (non-flash)\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:46:13 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-9069c3b3-c379-4a1e-bd60-42128a1608b1 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17 (non-flash)
Nov 15 09:46:13 user nova-compute[75122]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6224c0df-13b0-4ff7-928f-9a2282386a2a (non-flash)
Nov 15 09:46:13 user nova-compute[75122]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c145d4b-3d4e-4d11-9b72-2373acc012e3 (non-flash)
Nov 15 09:46:13 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 09:46:13 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-9069c3b3-c379-4a1e-bd60-42128a1608b1 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17 (non-flash)
Nov 15 09:46:13 user nova-compute[75122]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6224c0df-13b0-4ff7-928f-9a2282386a2a (non-flash)
Nov 15 09:46:13 user nova-compute[75122]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c145d4b-3d4e-4d11-9b72-2373acc012e3 (non-flash)
Nov 15 09:46:13 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 09:46:13 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-9069c3b3-c379-4a1e-bd60-42128a1608b1 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2c145d4b-3d4e-4d11-9b72-2373acc012e3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.299s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 09:46:13 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-9069c3b3-c379-4a1e-bd60-42128a1608b1 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Connected to 172.16.0.220:3260 {{(pid=75122) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 09:46:13 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-9069c3b3-c379-4a1e-bd60-42128a1608b1 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] HCTL ('35', '-', '-', 0) found on session 40 with lun 0 {{(pid=75122) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 09:46:13 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-9069c3b3-c379-4a1e-bd60-42128a1608b1 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75122) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 09:46:13 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:46:13 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:46:13 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ce4f676-57b9-40fd-8c9e-b9b81c6afac8]: (4, ('- - 0', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:46:13 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-9069c3b3-c379-4a1e-bd60-42128a1608b1 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Searching for a device in session 40 and hctl ['35', '*', '*', 0] yield: None {{(pid=75122) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 09:46:14 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-9069c3b3-c379-4a1e-bd60-42128a1608b1 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Searching for a device in session 40 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75122) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 09:46:14 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-9069c3b3-c379-4a1e-bd60-42128a1608b1 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:2c145d4b-3d4e-4d11-9b72-2373acc012e3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cyZrSTOX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75122) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 09:46:14 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-9069c3b3-c379-4a1e-bd60-42128a1608b1 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.331s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 09:46:14 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-9069c3b3-c379-4a1e-bd60-42128a1608b1 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] <== connect_volume: return (1332ms) {'type': 'block', 'scsi_wwn': '26639663539613264', 'path': '/dev/sdd'} {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 09:46:14 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9069c3b3-c379-4a1e-bd60-42128a1608b1 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] [instance: 49154de0-f941-4ae0-a7af-72e75a4d8040] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26639663539613264', 'path': '/dev/sdd'} {{(pid=75122) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 09:46:14 user nova-compute[75122]: DEBUG nova.objects.instance [None req-9069c3b3-c379-4a1e-bd60-42128a1608b1 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Lazy-loading 'flavor' on Instance uuid 49154de0-f941-4ae0-a7af-72e75a4d8040 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:46:14 user nova-compute[75122]: DEBUG nova.virt.libvirt.guest [None req-9069c3b3-c379-4a1e-bd60-42128a1608b1 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 09:46:14 user nova-compute[75122]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 09:46:14 user nova-compute[75122]:   <source dev="/dev/sdd"/>
Nov 15 09:46:14 user nova-compute[75122]:   <target dev="vdb" bus="virtio"/>
Nov 15 09:46:14 user nova-compute[75122]:   <serial>2c145d4b-3d4e-4d11-9b72-2373acc012e3</serial>
Nov 15 09:46:14 user nova-compute[75122]: </disk>
Nov 15 09:46:14 user nova-compute[75122]:  {{(pid=75122) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 09:46:15 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-9069c3b3-c379-4a1e-bd60-42128a1608b1 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] No BDM found with device name vda, not building metadata. {{(pid=75122) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 09:46:15 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-9069c3b3-c379-4a1e-bd60-42128a1608b1 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75122) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 09:46:15 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-9069c3b3-c379-4a1e-bd60-42128a1608b1 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] No VIF found with MAC fa:16:3e:9a:6e:b1, not building metadata {{(pid=75122) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 09:46:15 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-492dde4c-1373-47be-ac55-7cc009023318 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] [instance: a1121448-8452-4955-8112-7b984921dac6] Calling os-brick to attach iSCSI Volume {{(pid=75122) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 09:46:15 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-492dde4c-1373-47be-ac55-7cc009023318 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffa04060b80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fa46e0b9-44fe-4c2a-9627-87bcb42f57e1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pVEdfxui', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 09:46:15 user nova-compute[75122]: WARNING os_brick.initiator.connectors.base [None req-492dde4c-1373-47be-ac55-7cc009023318 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 09:46:15 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-492dde4c-1373-47be-ac55-7cc009023318 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 09:46:15 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-492dde4c-1373-47be-ac55-7cc009023318 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 09:46:15 user nova-compute[75122]: WARNING os_brick.initiator.connectors.base [None req-492dde4c-1373-47be-ac55-7cc009023318 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 09:46:15 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-492dde4c-1373-47be-ac55-7cc009023318 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fa46e0b9-44fe-4c2a-9627-87bcb42f57e1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 09:46:15 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-492dde4c-1373-47be-ac55-7cc009023318 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fa46e0b9-44fe-4c2a-9627-87bcb42f57e1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 09:46:15 user nova-compute[75122]: INFO os_brick.initiator.connectors.iscsi [None req-492dde4c-1373-47be-ac55-7cc009023318 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 09:46:15 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa46e0b9-44fe-4c2a-9627-87bcb42f57e1 -p 172.16.0.220:3260 {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:46:15 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa46e0b9-44fe-4c2a-9627-87bcb42f57e1 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:46:15 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[51590912-a02a-43b7-9882-4d9881dd22f8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:46:15 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-492dde4c-1373-47be-ac55-7cc009023318 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 09:46:15 user nova-compute[75122]:  {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:46:15 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa46e0b9-44fe-4c2a-9627-87bcb42f57e1 -p 172.16.0.220:3260 --interface default --op new {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:46:15 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa46e0b9-44fe-4c2a-9627-87bcb42f57e1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:46:15 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[de0c62b6-bdb9-49b1-9343-619412442c62]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fa46e0b9-44fe-4c2a-9627-87bcb42f57e1] added\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:46:15 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-492dde4c-1373-47be-ac55-7cc009023318 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fa46e0b9-44fe-4c2a-9627-87bcb42f57e1] added
Nov 15 09:46:15 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:46:15 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa46e0b9-44fe-4c2a-9627-87bcb42f57e1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:46:15 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa46e0b9-44fe-4c2a-9627-87bcb42f57e1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:46:15 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[67b8ede8-c41c-452e-b45e-25b5d840a148]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:46:15 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-492dde4c-1373-47be-ac55-7cc009023318 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:46:15 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa46e0b9-44fe-4c2a-9627-87bcb42f57e1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:46:15 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-9069c3b3-c379-4a1e-bd60-42128a1608b1 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Lock "49154de0-f941-4ae0-a7af-72e75a4d8040" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.674s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:46:15 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa46e0b9-44fe-4c2a-9627-87bcb42f57e1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:46:15 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e806122-0344-4ec6-b9e4-abac7e1ae019]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:46:15 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-492dde4c-1373-47be-ac55-7cc009023318 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:46:15 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa46e0b9-44fe-4c2a-9627-87bcb42f57e1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pVEdfxui {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:46:15 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa46e0b9-44fe-4c2a-9627-87bcb42f57e1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pVEdfxui" returned: 0 in 0.017s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:46:15 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed776813-3a16-4a12-a2d0-a556ea52cff1]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:46:15 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-492dde4c-1373-47be-ac55-7cc009023318 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pVEdfxui'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:46:15 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa46e0b9-44fe-4c2a-9627-87bcb42f57e1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:46:15 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa46e0b9-44fe-4c2a-9627-87bcb42f57e1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:46:15 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[5349e603-34f2-444c-ade5-4fb57f7cdd1f]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:46:15 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-492dde4c-1373-47be-ac55-7cc009023318 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:46:15 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:46:15 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:46:15 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5f6570f-74f6-48e1-9dba-64fb81254203]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6224c0df-13b0-4ff7-928f-9a2282386a2a (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c145d4b-3d4e-4d11-9b72-2373acc012e3 (non-flash)\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:46:15 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-492dde4c-1373-47be-ac55-7cc009023318 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17 (non-flash)
Nov 15 09:46:15 user nova-compute[75122]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6224c0df-13b0-4ff7-928f-9a2282386a2a (non-flash)
Nov 15 09:46:15 user nova-compute[75122]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c145d4b-3d4e-4d11-9b72-2373acc012e3 (non-flash)
Nov 15 09:46:15 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 09:46:15 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-492dde4c-1373-47be-ac55-7cc009023318 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17 (non-flash)
Nov 15 09:46:15 user nova-compute[75122]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6224c0df-13b0-4ff7-928f-9a2282386a2a (non-flash)
Nov 15 09:46:15 user nova-compute[75122]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c145d4b-3d4e-4d11-9b72-2373acc012e3 (non-flash)
Nov 15 09:46:15 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 09:46:15 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa46e0b9-44fe-4c2a-9627-87bcb42f57e1 -p 172.16.0.220:3260 --login {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:46:15 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa46e0b9-44fe-4c2a-9627-87bcb42f57e1 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:46:15 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae3eb952-9991-4aa9-8f29-758d9e6ee36a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fa46e0b9-44fe-4c2a-9627-87bcb42f57e1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fa46e0b9-44fe-4c2a-9627-87bcb42f57e1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:46:15 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-492dde4c-1373-47be-ac55-7cc009023318 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fa46e0b9-44fe-4c2a-9627-87bcb42f57e1, portal: 172.16.0.220,3260]
Nov 15 09:46:15 user nova-compute[75122]: Login to [iface: default, target: iqn.2010-10.org.openstack:fa46e0b9-44fe-4c2a-9627-87bcb42f57e1, portal: 172.16.0.220,3260] successful.
Nov 15 09:46:15 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:46:15 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa46e0b9-44fe-4c2a-9627-87bcb42f57e1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:46:15 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa46e0b9-44fe-4c2a-9627-87bcb42f57e1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:46:15 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[269c6486-1077-4888-8ba9-587f5781b558]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:46:15 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-492dde4c-1373-47be-ac55-7cc009023318 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:46:15 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:46:15 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:46:15 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[51936fc6-6107-4fba-a9d2-d9c48b92afd1]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6224c0df-13b0-4ff7-928f-9a2282386a2a (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c145d4b-3d4e-4d11-9b72-2373acc012e3 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa46e0b9-44fe-4c2a-9627-87bcb42f57e1 (non-flash)\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:46:15 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-492dde4c-1373-47be-ac55-7cc009023318 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17 (non-flash)
Nov 15 09:46:15 user nova-compute[75122]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6224c0df-13b0-4ff7-928f-9a2282386a2a (non-flash)
Nov 15 09:46:15 user nova-compute[75122]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c145d4b-3d4e-4d11-9b72-2373acc012e3 (non-flash)
Nov 15 09:46:15 user nova-compute[75122]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa46e0b9-44fe-4c2a-9627-87bcb42f57e1 (non-flash)
Nov 15 09:46:15 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 09:46:15 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-492dde4c-1373-47be-ac55-7cc009023318 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17 (non-flash)
Nov 15 09:46:15 user nova-compute[75122]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6224c0df-13b0-4ff7-928f-9a2282386a2a (non-flash)
Nov 15 09:46:15 user nova-compute[75122]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c145d4b-3d4e-4d11-9b72-2373acc012e3 (non-flash)
Nov 15 09:46:15 user nova-compute[75122]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa46e0b9-44fe-4c2a-9627-87bcb42f57e1 (non-flash)
Nov 15 09:46:15 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 09:46:15 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-492dde4c-1373-47be-ac55-7cc009023318 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fa46e0b9-44fe-4c2a-9627-87bcb42f57e1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.265s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 09:46:15 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-492dde4c-1373-47be-ac55-7cc009023318 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Connected to 172.16.0.220:3260 {{(pid=75122) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 09:46:15 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-492dde4c-1373-47be-ac55-7cc009023318 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] HCTL ('36', '-', '-', 0) found on session 41 with lun 0 {{(pid=75122) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 09:46:15 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-492dde4c-1373-47be-ac55-7cc009023318 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75122) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 09:46:15 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:46:15 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:46:15 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[52814692-cb2e-4dcf-8a6e-48116136c3c7]: (4, ('- - 0', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:46:15 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-492dde4c-1373-47be-ac55-7cc009023318 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Searching for a device in session 41 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75122) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 09:46:15 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-492dde4c-1373-47be-ac55-7cc009023318 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:fa46e0b9-44fe-4c2a-9627-87bcb42f57e1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pVEdfxui', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75122) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 09:46:16 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:46:16 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-492dde4c-1373-47be-ac55-7cc009023318 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.303s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 09:46:16 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-492dde4c-1373-47be-ac55-7cc009023318 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] <== connect_volume: return (1305ms) {'type': 'block', 'scsi_wwn': '26234616563383666', 'path': '/dev/sde'} {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 09:46:16 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-492dde4c-1373-47be-ac55-7cc009023318 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] [instance: a1121448-8452-4955-8112-7b984921dac6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26234616563383666', 'path': '/dev/sde'} {{(pid=75122) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 09:46:16 user nova-compute[75122]: DEBUG nova.objects.instance [None req-492dde4c-1373-47be-ac55-7cc009023318 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Lazy-loading 'flavor' on Instance uuid a1121448-8452-4955-8112-7b984921dac6 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:46:16 user nova-compute[75122]: DEBUG nova.virt.libvirt.guest [None req-492dde4c-1373-47be-ac55-7cc009023318 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 09:46:16 user nova-compute[75122]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 09:46:16 user nova-compute[75122]:   <source dev="/dev/sde"/>
Nov 15 09:46:16 user nova-compute[75122]:   <target dev="vdb" bus="virtio"/>
Nov 15 09:46:16 user nova-compute[75122]:   <serial>fa46e0b9-44fe-4c2a-9627-87bcb42f57e1</serial>
Nov 15 09:46:16 user nova-compute[75122]: </disk>
Nov 15 09:46:16 user nova-compute[75122]:  {{(pid=75122) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 09:46:16 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-492dde4c-1373-47be-ac55-7cc009023318 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] No BDM found with device name vda, not building metadata. {{(pid=75122) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 09:46:16 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-492dde4c-1373-47be-ac55-7cc009023318 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75122) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 09:46:16 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-492dde4c-1373-47be-ac55-7cc009023318 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] No VIF found with MAC fa:16:3e:c3:ac:e1, not building metadata {{(pid=75122) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 09:46:17 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-492dde4c-1373-47be-ac55-7cc009023318 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Lock "a1121448-8452-4955-8112-7b984921dac6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.677s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:46:17 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:46:18 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:46:18 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Cleaning up deleted instances {{(pid=75122) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 15 09:46:18 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] There are 0 instances to clean {{(pid=75122) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 15 09:46:18 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-c68a206a-e47d-43ef-b3af-e1d47cdccc37 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Acquiring lock "a1121448-8452-4955-8112-7b984921dac6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:46:18 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-c68a206a-e47d-43ef-b3af-e1d47cdccc37 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Lock "a1121448-8452-4955-8112-7b984921dac6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:46:18 user nova-compute[75122]: INFO nova.compute.manager [None req-c68a206a-e47d-43ef-b3af-e1d47cdccc37 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] [instance: a1121448-8452-4955-8112-7b984921dac6] Detaching volume fa46e0b9-44fe-4c2a-9627-87bcb42f57e1
Nov 15 09:46:18 user nova-compute[75122]: INFO nova.virt.block_device [None req-c68a206a-e47d-43ef-b3af-e1d47cdccc37 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] [instance: a1121448-8452-4955-8112-7b984921dac6] Attempting to driver detach volume fa46e0b9-44fe-4c2a-9627-87bcb42f57e1 from mountpoint /dev/vdb
Nov 15 09:46:18 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-c68a206a-e47d-43ef-b3af-e1d47cdccc37 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Attempting to detach device vdb from instance a1121448-8452-4955-8112-7b984921dac6 from the persistent domain config. {{(pid=75122) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 09:46:18 user nova-compute[75122]: DEBUG nova.virt.libvirt.guest [None req-c68a206a-e47d-43ef-b3af-e1d47cdccc37 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 09:46:18 user nova-compute[75122]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 09:46:18 user nova-compute[75122]:   <source dev="/dev/sde"/>
Nov 15 09:46:18 user nova-compute[75122]:   <target dev="vdb" bus="virtio"/>
Nov 15 09:46:18 user nova-compute[75122]:   <serial>fa46e0b9-44fe-4c2a-9627-87bcb42f57e1</serial>
Nov 15 09:46:18 user nova-compute[75122]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 09:46:18 user nova-compute[75122]: </disk>
Nov 15 09:46:18 user nova-compute[75122]:  {{(pid=75122) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 09:46:18 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-c68a206a-e47d-43ef-b3af-e1d47cdccc37 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Successfully detached device vdb from instance a1121448-8452-4955-8112-7b984921dac6 from the persistent domain config.
Nov 15 09:46:18 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-c68a206a-e47d-43ef-b3af-e1d47cdccc37 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a1121448-8452-4955-8112-7b984921dac6 from the live domain config. {{(pid=75122) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 09:46:18 user nova-compute[75122]: DEBUG nova.virt.libvirt.guest [None req-c68a206a-e47d-43ef-b3af-e1d47cdccc37 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 09:46:18 user nova-compute[75122]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 09:46:18 user nova-compute[75122]:   <source dev="/dev/sde"/>
Nov 15 09:46:18 user nova-compute[75122]:   <target dev="vdb" bus="virtio"/>
Nov 15 09:46:18 user nova-compute[75122]:   <serial>fa46e0b9-44fe-4c2a-9627-87bcb42f57e1</serial>
Nov 15 09:46:18 user nova-compute[75122]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 09:46:18 user nova-compute[75122]: </disk>
Nov 15 09:46:18 user nova-compute[75122]:  {{(pid=75122) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 09:46:18 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-c68a206a-e47d-43ef-b3af-e1d47cdccc37 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a1121448-8452-4955-8112-7b984921dac6 {{(pid=75122) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 09:46:21 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:46:22 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:46:22 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:46:23 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:46:23 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Starting heal instance info cache {{(pid=75122) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 09:46:23 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Rebuilding the list of instances to heal {{(pid=75122) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 09:46:23 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "refresh_cache-131142fd-e8ec-42d1-a518-aa21c7bb7cb1" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 09:46:23 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquired lock "refresh_cache-131142fd-e8ec-42d1-a518-aa21c7bb7cb1" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 09:46:23 user nova-compute[75122]: DEBUG nova.network.neutron [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] [instance: 131142fd-e8ec-42d1-a518-aa21c7bb7cb1] Forcefully refreshing network info cache for instance {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 09:46:23 user nova-compute[75122]: DEBUG nova.objects.instance [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lazy-loading 'info_cache' on Instance uuid 131142fd-e8ec-42d1-a518-aa21c7bb7cb1 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:46:23 user nova-compute[75122]: DEBUG nova.network.neutron [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] [instance: 131142fd-e8ec-42d1-a518-aa21c7bb7cb1] Updating instance_info_cache with network_info: [{"id": "f8302d0d-f140-479c-96da-b21516385381", "address": "fa:16:3e:06:1e:34", "network": {"id": "6e846655-a6f8-4339-a239-65d2f94c8b74", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1923452032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b8e67f8a66a4930be3fb65c397cbeb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8302d0d-f1", "ovs_interfaceid": "f8302d0d-f140-479c-96da-b21516385381", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:46:23 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Releasing lock "refresh_cache-131142fd-e8ec-42d1-a518-aa21c7bb7cb1" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 09:46:23 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] [instance: 131142fd-e8ec-42d1-a518-aa21c7bb7cb1] Updated the network info_cache for instance {{(pid=75122) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 09:46:23 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:46:23 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:46:23 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75122) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 09:46:23 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-5ceacabd-8ec3-4fe1-9b6e-5da576a15989 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Acquiring lock "49154de0-f941-4ae0-a7af-72e75a4d8040" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:46:23 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-5ceacabd-8ec3-4fe1-9b6e-5da576a15989 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Lock "49154de0-f941-4ae0-a7af-72e75a4d8040" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:46:23 user nova-compute[75122]: INFO nova.compute.manager [None req-5ceacabd-8ec3-4fe1-9b6e-5da576a15989 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] [instance: 49154de0-f941-4ae0-a7af-72e75a4d8040] Detaching volume 2c145d4b-3d4e-4d11-9b72-2373acc012e3
Nov 15 09:46:24 user nova-compute[75122]: INFO nova.virt.block_device [None req-5ceacabd-8ec3-4fe1-9b6e-5da576a15989 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] [instance: 49154de0-f941-4ae0-a7af-72e75a4d8040] Attempting to driver detach volume 2c145d4b-3d4e-4d11-9b72-2373acc012e3 from mountpoint /dev/vdb
Nov 15 09:46:24 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-5ceacabd-8ec3-4fe1-9b6e-5da576a15989 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Attempting to detach device vdb from instance 49154de0-f941-4ae0-a7af-72e75a4d8040 from the persistent domain config. {{(pid=75122) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 09:46:24 user nova-compute[75122]: DEBUG nova.virt.libvirt.guest [None req-5ceacabd-8ec3-4fe1-9b6e-5da576a15989 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 09:46:24 user nova-compute[75122]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 09:46:24 user nova-compute[75122]:   <source dev="/dev/sdd"/>
Nov 15 09:46:24 user nova-compute[75122]:   <target dev="vdb" bus="virtio"/>
Nov 15 09:46:24 user nova-compute[75122]:   <serial>2c145d4b-3d4e-4d11-9b72-2373acc012e3</serial>
Nov 15 09:46:24 user nova-compute[75122]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 09:46:24 user nova-compute[75122]: </disk>
Nov 15 09:46:24 user nova-compute[75122]:  {{(pid=75122) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 09:46:24 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-5ceacabd-8ec3-4fe1-9b6e-5da576a15989 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Successfully detached device vdb from instance 49154de0-f941-4ae0-a7af-72e75a4d8040 from the persistent domain config.
Nov 15 09:46:24 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-5ceacabd-8ec3-4fe1-9b6e-5da576a15989 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 49154de0-f941-4ae0-a7af-72e75a4d8040 from the live domain config. {{(pid=75122) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 09:46:24 user nova-compute[75122]: DEBUG nova.virt.libvirt.guest [None req-5ceacabd-8ec3-4fe1-9b6e-5da576a15989 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 09:46:24 user nova-compute[75122]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 09:46:24 user nova-compute[75122]:   <source dev="/dev/sdd"/>
Nov 15 09:46:24 user nova-compute[75122]:   <target dev="vdb" bus="virtio"/>
Nov 15 09:46:24 user nova-compute[75122]:   <serial>2c145d4b-3d4e-4d11-9b72-2373acc012e3</serial>
Nov 15 09:46:24 user nova-compute[75122]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 09:46:24 user nova-compute[75122]: </disk>
Nov 15 09:46:24 user nova-compute[75122]:  {{(pid=75122) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 09:46:24 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:46:24 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75122) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 15 09:46:24 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-5ceacabd-8ec3-4fe1-9b6e-5da576a15989 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 49154de0-f941-4ae0-a7af-72e75a4d8040 {{(pid=75122) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 09:46:25 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:46:25 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:46:25 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:46:25 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:46:25 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:46:25 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:46:25 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75122) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 09:46:25 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75122) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 09:46:25 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd9d52bb-6248-48e6-a798-6dbdaaa68cbc/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:46:25 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd9d52bb-6248-48e6-a798-6dbdaaa68cbc/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:46:25 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd9d52bb-6248-48e6-a798-6dbdaaa68cbc/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:46:25 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd9d52bb-6248-48e6-a798-6dbdaaa68cbc/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:46:25 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49154de0-f941-4ae0-a7af-72e75a4d8040/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:46:25 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49154de0-f941-4ae0-a7af-72e75a4d8040/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:46:25 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49154de0-f941-4ae0-a7af-72e75a4d8040/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:46:26 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49154de0-f941-4ae0-a7af-72e75a4d8040/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:46:26 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca2defb6-c4ac-4d39-bdd2-1e0ac3265e02/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:46:26 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca2defb6-c4ac-4d39-bdd2-1e0ac3265e02/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:46:26 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca2defb6-c4ac-4d39-bdd2-1e0ac3265e02/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:46:26 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:46:26 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ca2defb6-c4ac-4d39-bdd2-1e0ac3265e02/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:46:26 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1121448-8452-4955-8112-7b984921dac6/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:46:26 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1121448-8452-4955-8112-7b984921dac6/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:46:26 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1121448-8452-4955-8112-7b984921dac6/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:46:26 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1121448-8452-4955-8112-7b984921dac6/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:46:26 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/131142fd-e8ec-42d1-a518-aa21c7bb7cb1/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:46:27 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/131142fd-e8ec-42d1-a518-aa21c7bb7cb1/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:46:27 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/131142fd-e8ec-42d1-a518-aa21c7bb7cb1/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:46:27 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/131142fd-e8ec-42d1-a518-aa21c7bb7cb1/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:46:27 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8271a429-e252-42bb-8717-e89dfd9739bf/disk.rescue --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:46:27 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8271a429-e252-42bb-8717-e89dfd9739bf/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:46:27 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8271a429-e252-42bb-8717-e89dfd9739bf/disk.rescue --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:46:27 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8271a429-e252-42bb-8717-e89dfd9739bf/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:46:27 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] skipping disk /opt/stack/data/nova/instances/8271a429-e252-42bb-8717-e89dfd9739bf/disk (vdb) as it is a volume {{(pid=75122) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 09:46:27 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00270cc2-4f5b-4f64-8f88-31f21e3b3950/disk.rescue --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:46:27 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00270cc2-4f5b-4f64-8f88-31f21e3b3950/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:46:27 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00270cc2-4f5b-4f64-8f88-31f21e3b3950/disk.rescue --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:46:27 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00270cc2-4f5b-4f64-8f88-31f21e3b3950/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:46:27 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00270cc2-4f5b-4f64-8f88-31f21e3b3950/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:46:27 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:46:28 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00270cc2-4f5b-4f64-8f88-31f21e3b3950/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:46:28 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00270cc2-4f5b-4f64-8f88-31f21e3b3950/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:46:28 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00270cc2-4f5b-4f64-8f88-31f21e3b3950/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:46:28 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 09:46:28 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 09:46:28 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Hypervisor/Node resource view: name=user free_ram=7935MB free_disk=25.259864807128906GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75122) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 09:46:28 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:46:28 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:46:28 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance 131142fd-e8ec-42d1-a518-aa21c7bb7cb1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:46:28 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance fd9d52bb-6248-48e6-a798-6dbdaaa68cbc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:46:28 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance 00270cc2-4f5b-4f64-8f88-31f21e3b3950 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:46:28 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance cc485c6c-5a9a-4c94-b966-68dd9e336e56 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:46:28 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance 8271a429-e252-42bb-8717-e89dfd9739bf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:46:28 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance 49154de0-f941-4ae0-a7af-72e75a4d8040 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:46:28 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance a1121448-8452-4955-8112-7b984921dac6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:46:28 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance ca2defb6-c4ac-4d39-bdd2-1e0ac3265e02 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:46:28 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75122) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 09:46:28 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75122) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 09:46:28 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Refreshing inventories for resource provider 69a3da65-47be-44c6-b67c-c692b58284ef {{(pid=75122) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 15 09:46:29 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Updating ProviderTree inventory for provider 69a3da65-47be-44c6-b67c-c692b58284ef from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 15 09:46:29 user nova-compute[75122]: DEBUG nova.compute.provider_tree [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Updating inventory in ProviderTree for provider 69a3da65-47be-44c6-b67c-c692b58284ef with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 15 09:46:29 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Refreshing aggregate associations for resource provider 69a3da65-47be-44c6-b67c-c692b58284ef, aggregates: None {{(pid=75122) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 15 09:46:29 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Refreshing trait associations for resource provider 69a3da65-47be-44c6-b67c-c692b58284ef, traits: COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_RESCUE_BFV,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE,COMPUTE_NODE,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_ACCELERATORS,HW_CPU_X86_MMX {{(pid=75122) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 15 09:46:29 user nova-compute[75122]: DEBUG nova.compute.provider_tree [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Inventory has not changed in ProviderTree for provider: 69a3da65-47be-44c6-b67c-c692b58284ef {{(pid=75122) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 09:46:29 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Inventory has not changed for provider 69a3da65-47be-44c6-b67c-c692b58284ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 09:46:29 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Compute_service record updated for user:user {{(pid=75122) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 09:46:29 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.633s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:46:29 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:46:30 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:46:30 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:46:31 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:46:32 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:46:32 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:46:32 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75122) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 09:46:32 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75122) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 09:46:32 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75122) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 09:46:32 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:46:37 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:46:38 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-c68a206a-e47d-43ef-b3af-e1d47cdccc37 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance a1121448-8452-4955-8112-7b984921dac6 is timed out.
Nov 15 09:46:38 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-c68a206a-e47d-43ef-b3af-e1d47cdccc37 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Successfully detached device vdb from instance a1121448-8452-4955-8112-7b984921dac6 from the live domain config.
Nov 15 09:46:38 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c68a206a-e47d-43ef-b3af-e1d47cdccc37 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] [instance: a1121448-8452-4955-8112-7b984921dac6] calling os-brick to detach iSCSI Volume {{(pid=75122) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 09:46:38 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-c68a206a-e47d-43ef-b3af-e1d47cdccc37 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffa04060b80>, {'target_iqn': 'iqn.2010-10.org.openstack:fa46e0b9-44fe-4c2a-9627-87bcb42f57e1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pVEdfxui', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 09:46:38 user nova-compute[75122]: WARNING os_brick.initiator.connectors.base [None req-c68a206a-e47d-43ef-b3af-e1d47cdccc37 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 09:46:38 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-c68a206a-e47d-43ef-b3af-e1d47cdccc37 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 09:46:38 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-c68a206a-e47d-43ef-b3af-e1d47cdccc37 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 09:46:38 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:46:38 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:46:38 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[b26ae016-aab6-486f-afb4-4c4820a7e450]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2c145d4b-3d4e-4d11-9b72-2373acc012e3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6224c0df-13b0-4ff7-928f-9a2282386a2a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fa46e0b9-44fe-4c2a-9627-87bcb42f57e1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:46:38 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-c68a206a-e47d-43ef-b3af-e1d47cdccc37 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 09:46:38 user nova-compute[75122]: No targets found.
Nov 15 09:46:38 user nova-compute[75122]: iSNS:
Nov 15 09:46:38 user nova-compute[75122]: No targets found.
Nov 15 09:46:38 user nova-compute[75122]: STATIC:
Nov 15 09:46:38 user nova-compute[75122]: Target: iqn.2010-10.org.openstack:2c145d4b-3d4e-4d11-9b72-2373acc012e3
Nov 15 09:46:38 user nova-compute[75122]:         Portal: 172.16.0.220:3260,-1
Nov 15 09:46:38 user nova-compute[75122]:                 Iface Name: default
Nov 15 09:46:38 user nova-compute[75122]: Target: iqn.2010-10.org.openstack:6224c0df-13b0-4ff7-928f-9a2282386a2a
Nov 15 09:46:38 user nova-compute[75122]:         Portal: 172.16.0.220:3260,-1
Nov 15 09:46:38 user nova-compute[75122]:                 Iface Name: default
Nov 15 09:46:38 user nova-compute[75122]: Target: iqn.2010-10.org.openstack:fa46e0b9-44fe-4c2a-9627-87bcb42f57e1
Nov 15 09:46:38 user nova-compute[75122]:         Portal: 172.16.0.220:3260,-1
Nov 15 09:46:38 user nova-compute[75122]:                 Iface Name: default
Nov 15 09:46:38 user nova-compute[75122]: Target: iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17
Nov 15 09:46:38 user nova-compute[75122]:         Portal: 172.16.0.220:3260,-1
Nov 15 09:46:38 user nova-compute[75122]:                 Iface Name: default
Nov 15 09:46:38 user nova-compute[75122]: FIRMWARE:
Nov 15 09:46:38 user nova-compute[75122]: No targets found.
Nov 15 09:46:38 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 09:46:38 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-c68a206a-e47d-43ef-b3af-e1d47cdccc37 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 09:46:38 user nova-compute[75122]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 09:46:38 user nova-compute[75122]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75122) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 09:46:38 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-c68a206a-e47d-43ef-b3af-e1d47cdccc37 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fa46e0b9-44fe-4c2a-9627-87bcb42f57e1', 0)] {{(pid=75122) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 09:46:38 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:46:38 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:46:38 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bd6b314-a9af-4078-97df-f90be52e96ad]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2c145d4b-3d4e-4d11-9b72-2373acc012e3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6224c0df-13b0-4ff7-928f-9a2282386a2a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fa46e0b9-44fe-4c2a-9627-87bcb42f57e1\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:46:38 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:46:38 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:46:38 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9646b43-ca99-49ec-b61c-193debb2d363]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6224c0df-13b0-4ff7-928f-9a2282386a2a (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c145d4b-3d4e-4d11-9b72-2373acc012e3 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa46e0b9-44fe-4c2a-9627-87bcb42f57e1 (non-flash)\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:46:38 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-c68a206a-e47d-43ef-b3af-e1d47cdccc37 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17 (non-flash)
Nov 15 09:46:38 user nova-compute[75122]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6224c0df-13b0-4ff7-928f-9a2282386a2a (non-flash)
Nov 15 09:46:38 user nova-compute[75122]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c145d4b-3d4e-4d11-9b72-2373acc012e3 (non-flash)
Nov 15 09:46:38 user nova-compute[75122]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa46e0b9-44fe-4c2a-9627-87bcb42f57e1 (non-flash)
Nov 15 09:46:38 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 09:46:38 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-c68a206a-e47d-43ef-b3af-e1d47cdccc37 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17 (non-flash)
Nov 15 09:46:38 user nova-compute[75122]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6224c0df-13b0-4ff7-928f-9a2282386a2a (non-flash)
Nov 15 09:46:38 user nova-compute[75122]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c145d4b-3d4e-4d11-9b72-2373acc012e3 (non-flash)
Nov 15 09:46:38 user nova-compute[75122]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fa46e0b9-44fe-4c2a-9627-87bcb42f57e1 (non-flash)
Nov 15 09:46:38 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 09:46:38 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-c68a206a-e47d-43ef-b3af-e1d47cdccc37 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff9e438d510>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fa46e0b9-44fe-4c2a-9627-87bcb42f57e1'): ({'sde'}, set())}) {{(pid=75122) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 09:46:38 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-c68a206a-e47d-43ef-b3af-e1d47cdccc37 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Removing single pathed devices sde {{(pid=75122) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 09:46:38 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:46:38 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:46:38 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[93f4d747-e35b-46bc-8cfc-5c16616ea410]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:46:38 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:46:38 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.023s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:46:38 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[299b0952-443d-4217-9811-9c6d0a37e9db]: (4, ('ok\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:46:38 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-c68a206a-e47d-43ef-b3af-e1d47cdccc37 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Flushing IO for device /dev/sde {{(pid=75122) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 09:46:38 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:46:39 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:46:39 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[747e1a3e-0124-4192-9b39-255a71fee5f4]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:46:39 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-c68a206a-e47d-43ef-b3af-e1d47cdccc37 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75122) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 09:46:39 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:46:39 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.033s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:46:39 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c66ed06-bb1a-440f-a662-6fd91a2602b6]: (4, ('1', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:46:39 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-c68a206a-e47d-43ef-b3af-e1d47cdccc37 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75122) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 09:46:39 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-c68a206a-e47d-43ef-b3af-e1d47cdccc37 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] SCSI volumes sde have been removed. {{(pid=75122) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 09:46:39 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-c68a206a-e47d-43ef-b3af-e1d47cdccc37 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fa46e0b9-44fe-4c2a-9627-87bcb42f57e1')] {{(pid=75122) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 09:46:39 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa46e0b9-44fe-4c2a-9627-87bcb42f57e1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:46:39 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa46e0b9-44fe-4c2a-9627-87bcb42f57e1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:46:39 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c691e6b-0f5b-41a9-be14-3ea457e8e2f5]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:46:39 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-c68a206a-e47d-43ef-b3af-e1d47cdccc37 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:46:39 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa46e0b9-44fe-4c2a-9627-87bcb42f57e1 -p 172.16.0.220:3260 --logout {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:46:39 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa46e0b9-44fe-4c2a-9627-87bcb42f57e1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:46:39 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[11e6364a-dc2c-413d-b130-2fc4183141cd]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:fa46e0b9-44fe-4c2a-9627-87bcb42f57e1, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:fa46e0b9-44fe-4c2a-9627-87bcb42f57e1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:46:39 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-c68a206a-e47d-43ef-b3af-e1d47cdccc37 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:fa46e0b9-44fe-4c2a-9627-87bcb42f57e1, portal: 172.16.0.220,3260]
Nov 15 09:46:39 user nova-compute[75122]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:fa46e0b9-44fe-4c2a-9627-87bcb42f57e1, portal: 172.16.0.220,3260] successful.
Nov 15 09:46:39 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:46:39 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fa46e0b9-44fe-4c2a-9627-87bcb42f57e1 -p 172.16.0.220:3260 --op delete {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:46:39 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fa46e0b9-44fe-4c2a-9627-87bcb42f57e1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:46:39 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e053d28-e024-4ff4-8be0-72e6c29ce344]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:46:39 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-c68a206a-e47d-43ef-b3af-e1d47cdccc37 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:46:39 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-c68a206a-e47d-43ef-b3af-e1d47cdccc37 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.309s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 09:46:39 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-c68a206a-e47d-43ef-b3af-e1d47cdccc37 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] <== disconnect_volume: return (310ms) None {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 09:46:39 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c68a206a-e47d-43ef-b3af-e1d47cdccc37 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] [instance: a1121448-8452-4955-8112-7b984921dac6] Disconnected iSCSI Volume {{(pid=75122) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 09:46:39 user nova-compute[75122]: DEBUG nova.objects.instance [None req-c68a206a-e47d-43ef-b3af-e1d47cdccc37 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Lazy-loading 'flavor' on Instance uuid a1121448-8452-4955-8112-7b984921dac6 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:46:39 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-c68a206a-e47d-43ef-b3af-e1d47cdccc37 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Lock "a1121448-8452-4955-8112-7b984921dac6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.665s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:46:41 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:46:42 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:46:44 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-5ceacabd-8ec3-4fe1-9b6e-5da576a15989 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 49154de0-f941-4ae0-a7af-72e75a4d8040 is timed out.
Nov 15 09:46:44 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-5ceacabd-8ec3-4fe1-9b6e-5da576a15989 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Successfully detached device vdb from instance 49154de0-f941-4ae0-a7af-72e75a4d8040 from the live domain config.
Nov 15 09:46:44 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5ceacabd-8ec3-4fe1-9b6e-5da576a15989 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] [instance: 49154de0-f941-4ae0-a7af-72e75a4d8040] calling os-brick to detach iSCSI Volume {{(pid=75122) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 09:46:44 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ceacabd-8ec3-4fe1-9b6e-5da576a15989 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffa04060b80>, {'target_iqn': 'iqn.2010-10.org.openstack:2c145d4b-3d4e-4d11-9b72-2373acc012e3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cyZrSTOX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 09:46:44 user nova-compute[75122]: WARNING os_brick.initiator.connectors.base [None req-5ceacabd-8ec3-4fe1-9b6e-5da576a15989 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 09:46:44 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-5ceacabd-8ec3-4fe1-9b6e-5da576a15989 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 09:46:44 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-5ceacabd-8ec3-4fe1-9b6e-5da576a15989 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 09:46:44 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:46:44 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:46:44 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bf2b661-53f2-4176-a6fc-bde85f91deec]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2c145d4b-3d4e-4d11-9b72-2373acc012e3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6224c0df-13b0-4ff7-928f-9a2282386a2a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:46:44 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ceacabd-8ec3-4fe1-9b6e-5da576a15989 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 09:46:44 user nova-compute[75122]: No targets found.
Nov 15 09:46:44 user nova-compute[75122]: iSNS:
Nov 15 09:46:44 user nova-compute[75122]: No targets found.
Nov 15 09:46:44 user nova-compute[75122]: STATIC:
Nov 15 09:46:44 user nova-compute[75122]: Target: iqn.2010-10.org.openstack:2c145d4b-3d4e-4d11-9b72-2373acc012e3
Nov 15 09:46:44 user nova-compute[75122]:         Portal: 172.16.0.220:3260,-1
Nov 15 09:46:44 user nova-compute[75122]:                 Iface Name: default
Nov 15 09:46:44 user nova-compute[75122]: Target: iqn.2010-10.org.openstack:6224c0df-13b0-4ff7-928f-9a2282386a2a
Nov 15 09:46:44 user nova-compute[75122]:         Portal: 172.16.0.220:3260,-1
Nov 15 09:46:44 user nova-compute[75122]:                 Iface Name: default
Nov 15 09:46:44 user nova-compute[75122]: Target: iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17
Nov 15 09:46:44 user nova-compute[75122]:         Portal: 172.16.0.220:3260,-1
Nov 15 09:46:44 user nova-compute[75122]:                 Iface Name: default
Nov 15 09:46:44 user nova-compute[75122]: FIRMWARE:
Nov 15 09:46:44 user nova-compute[75122]: No targets found.
Nov 15 09:46:44 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 09:46:44 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ceacabd-8ec3-4fe1-9b6e-5da576a15989 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 09:46:44 user nova-compute[75122]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 09:46:44 user nova-compute[75122]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75122) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 09:46:44 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ceacabd-8ec3-4fe1-9b6e-5da576a15989 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2c145d4b-3d4e-4d11-9b72-2373acc012e3', 0)] {{(pid=75122) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 09:46:44 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:46:44 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:46:44 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aed1d5e-aa66-40fb-a00c-1a5b4cd9faae]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2c145d4b-3d4e-4d11-9b72-2373acc012e3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6224c0df-13b0-4ff7-928f-9a2282386a2a\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:46:44 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:46:44 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:46:44 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[99a6b9b4-cf29-4ea7-ad34-d841d835ee6a]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6224c0df-13b0-4ff7-928f-9a2282386a2a (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c145d4b-3d4e-4d11-9b72-2373acc012e3 (non-flash)\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:46:44 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ceacabd-8ec3-4fe1-9b6e-5da576a15989 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17 (non-flash)
Nov 15 09:46:44 user nova-compute[75122]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6224c0df-13b0-4ff7-928f-9a2282386a2a (non-flash)
Nov 15 09:46:44 user nova-compute[75122]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c145d4b-3d4e-4d11-9b72-2373acc012e3 (non-flash)
Nov 15 09:46:44 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 09:46:44 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ceacabd-8ec3-4fe1-9b6e-5da576a15989 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17 (non-flash)
Nov 15 09:46:44 user nova-compute[75122]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6224c0df-13b0-4ff7-928f-9a2282386a2a (non-flash)
Nov 15 09:46:44 user nova-compute[75122]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c145d4b-3d4e-4d11-9b72-2373acc012e3 (non-flash)
Nov 15 09:46:44 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 09:46:44 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ceacabd-8ec3-4fe1-9b6e-5da576a15989 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff9e434f370>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2c145d4b-3d4e-4d11-9b72-2373acc012e3'): ({'sdd'}, set())}) {{(pid=75122) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 09:46:44 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-5ceacabd-8ec3-4fe1-9b6e-5da576a15989 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Removing single pathed devices sdd {{(pid=75122) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 09:46:44 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:46:44 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:46:44 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff15522f-0f89-4664-88ac-ee508e4c4c82]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:46:44 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:46:44 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.023s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:46:44 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[a01246ff-0052-4335-b6b0-34beb2479197]: (4, ('ok\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:46:44 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-5ceacabd-8ec3-4fe1-9b6e-5da576a15989 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Flushing IO for device /dev/sdd {{(pid=75122) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 09:46:44 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:46:44 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:46:44 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c3df105-bf7f-476e-996a-17b220b67585]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:46:44 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-5ceacabd-8ec3-4fe1-9b6e-5da576a15989 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75122) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 09:46:44 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:46:44 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.043s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:46:44 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f3f41b5-73d6-42b5-9b95-0350828d8efd]: (4, ('1', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:46:44 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-5ceacabd-8ec3-4fe1-9b6e-5da576a15989 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75122) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 09:46:44 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-5ceacabd-8ec3-4fe1-9b6e-5da576a15989 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] SCSI volumes sdd have been removed. {{(pid=75122) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 09:46:44 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ceacabd-8ec3-4fe1-9b6e-5da576a15989 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2c145d4b-3d4e-4d11-9b72-2373acc012e3')] {{(pid=75122) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 09:46:44 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c145d4b-3d4e-4d11-9b72-2373acc012e3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:46:44 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c145d4b-3d4e-4d11-9b72-2373acc012e3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:46:44 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[182d272a-d77c-4680-b509-19ed2d77a7e8]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:46:44 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ceacabd-8ec3-4fe1-9b6e-5da576a15989 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:46:44 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c145d4b-3d4e-4d11-9b72-2373acc012e3 -p 172.16.0.220:3260 --logout {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:46:44 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c145d4b-3d4e-4d11-9b72-2373acc012e3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:46:44 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[8de9a7cc-e6ee-48a3-ac1f-64f0beda6fbd]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:2c145d4b-3d4e-4d11-9b72-2373acc012e3, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:2c145d4b-3d4e-4d11-9b72-2373acc012e3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:46:44 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ceacabd-8ec3-4fe1-9b6e-5da576a15989 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:2c145d4b-3d4e-4d11-9b72-2373acc012e3, portal: 172.16.0.220,3260]
Nov 15 09:46:44 user nova-compute[75122]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:2c145d4b-3d4e-4d11-9b72-2373acc012e3, portal: 172.16.0.220,3260] successful.
Nov 15 09:46:44 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:46:44 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c145d4b-3d4e-4d11-9b72-2373acc012e3 -p 172.16.0.220:3260 --op delete {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:46:44 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c145d4b-3d4e-4d11-9b72-2373acc012e3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:46:44 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb152b9d-4458-46cf-ac87-21ef3edac43e]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:46:44 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ceacabd-8ec3-4fe1-9b6e-5da576a15989 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:46:44 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-5ceacabd-8ec3-4fe1-9b6e-5da576a15989 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.307s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 09:46:44 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ceacabd-8ec3-4fe1-9b6e-5da576a15989 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] <== disconnect_volume: return (309ms) None {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 09:46:44 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5ceacabd-8ec3-4fe1-9b6e-5da576a15989 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] [instance: 49154de0-f941-4ae0-a7af-72e75a4d8040] Disconnected iSCSI Volume {{(pid=75122) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 09:46:45 user nova-compute[75122]: DEBUG nova.objects.instance [None req-5ceacabd-8ec3-4fe1-9b6e-5da576a15989 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Lazy-loading 'flavor' on Instance uuid 49154de0-f941-4ae0-a7af-72e75a4d8040 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:46:45 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-5ceacabd-8ec3-4fe1-9b6e-5da576a15989 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Lock "49154de0-f941-4ae0-a7af-72e75a4d8040" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.628s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:46:47 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:46:47 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:46:47 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75122) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 09:46:47 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75122) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 09:46:47 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75122) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 09:46:47 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:46:53 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:46:53 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:46:53 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75122) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 09:46:53 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75122) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 09:46:53 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75122) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 09:46:53 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:46:57 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:46:57 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Triggering sync for uuid 131142fd-e8ec-42d1-a518-aa21c7bb7cb1 {{(pid=75122) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 09:46:57 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Triggering sync for uuid fd9d52bb-6248-48e6-a798-6dbdaaa68cbc {{(pid=75122) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 09:46:57 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Triggering sync for uuid 00270cc2-4f5b-4f64-8f88-31f21e3b3950 {{(pid=75122) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 09:46:57 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Triggering sync for uuid cc485c6c-5a9a-4c94-b966-68dd9e336e56 {{(pid=75122) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 09:46:57 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Triggering sync for uuid 8271a429-e252-42bb-8717-e89dfd9739bf {{(pid=75122) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 09:46:57 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Triggering sync for uuid 49154de0-f941-4ae0-a7af-72e75a4d8040 {{(pid=75122) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 09:46:57 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Triggering sync for uuid a1121448-8452-4955-8112-7b984921dac6 {{(pid=75122) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 09:46:57 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Triggering sync for uuid ca2defb6-c4ac-4d39-bdd2-1e0ac3265e02 {{(pid=75122) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 09:46:57 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "131142fd-e8ec-42d1-a518-aa21c7bb7cb1" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:46:57 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "131142fd-e8ec-42d1-a518-aa21c7bb7cb1" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:46:57 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "fd9d52bb-6248-48e6-a798-6dbdaaa68cbc" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:46:57 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "fd9d52bb-6248-48e6-a798-6dbdaaa68cbc" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:46:57 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "00270cc2-4f5b-4f64-8f88-31f21e3b3950" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:46:57 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "00270cc2-4f5b-4f64-8f88-31f21e3b3950" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:46:57 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "cc485c6c-5a9a-4c94-b966-68dd9e336e56" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:46:57 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "cc485c6c-5a9a-4c94-b966-68dd9e336e56" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:46:57 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "8271a429-e252-42bb-8717-e89dfd9739bf" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:46:57 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "8271a429-e252-42bb-8717-e89dfd9739bf" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:46:57 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "49154de0-f941-4ae0-a7af-72e75a4d8040" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:46:57 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "49154de0-f941-4ae0-a7af-72e75a4d8040" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:46:57 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "a1121448-8452-4955-8112-7b984921dac6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:46:57 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "a1121448-8452-4955-8112-7b984921dac6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:46:57 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "ca2defb6-c4ac-4d39-bdd2-1e0ac3265e02" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:46:57 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "ca2defb6-c4ac-4d39-bdd2-1e0ac3265e02" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:46:57 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "131142fd-e8ec-42d1-a518-aa21c7bb7cb1" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.038s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:46:57 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "00270cc2-4f5b-4f64-8f88-31f21e3b3950" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.038s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:46:57 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "fd9d52bb-6248-48e6-a798-6dbdaaa68cbc" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.047s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:46:57 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "cc485c6c-5a9a-4c94-b966-68dd9e336e56" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.047s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:46:57 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "8271a429-e252-42bb-8717-e89dfd9739bf" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.052s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:46:57 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "49154de0-f941-4ae0-a7af-72e75a4d8040" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.065s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:46:57 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "a1121448-8452-4955-8112-7b984921dac6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.069s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:46:57 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "ca2defb6-c4ac-4d39-bdd2-1e0ac3265e02" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.070s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:46:58 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:46:58 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-17ab83f2-a973-4cca-b0b7-f4fb235647d3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Acquiring lock "bc80e3fb-b5a3-4685-8ec5-12f8c385b833" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:46:58 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-17ab83f2-a973-4cca-b0b7-f4fb235647d3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Lock "bc80e3fb-b5a3-4685-8ec5-12f8c385b833" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:46:58 user nova-compute[75122]: INFO nova.compute.manager [None req-17ab83f2-a973-4cca-b0b7-f4fb235647d3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] [instance: bc80e3fb-b5a3-4685-8ec5-12f8c385b833] Unshelving
Nov 15 09:46:58 user nova-compute[75122]: INFO nova.virt.block_device [None req-17ab83f2-a973-4cca-b0b7-f4fb235647d3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] [instance: bc80e3fb-b5a3-4685-8ec5-12f8c385b833] Booting with volume 6cd246c1-08d6-43ce-b2b5-2a6c42e46135 at /dev/vdc
Nov 15 09:46:58 user nova-compute[75122]: DEBUG os_brick.utils [None req-17ab83f2-a973-4cca-b0b7-f4fb235647d3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 09:46:58 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:46:58 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:46:58 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b94b6a4-6992-4a0f-b2eb-d3aa5ee73fdf]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:742fb64b3587\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:46:58 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:46:58 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:46:58 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[84898b68-6aa2-4361-9504-752e1ecd5b65]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:46:58 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:46:58 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:46:58 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[e33b5c32-4342-4a97-b344-fbd43fe6b870]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:46:58 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[061ae4b3-447a-433f-bc2e-c18a74c91033]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:46:58 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-17ab83f2-a973-4cca-b0b7-f4fb235647d3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Running cmd (subprocess): nvme version {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:46:58 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-17ab83f2-a973-4cca-b0b7-f4fb235647d3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] 'nvme version' failed. Not Retrying. {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 09:46:58 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.nvmeof [None req-17ab83f2-a973-4cca-b0b7-f4fb235647d3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] nvme not present on system {{(pid=75122) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 09:46:58 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:46:58 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 09:46:58 user nova-compute[75122]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 09:46:58 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[b697c640-9fb3-4cdc-9711-3905ecaaa215]: (4, '') {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:46:58 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.lightos [None req-17ab83f2-a973-4cca-b0b7-f4fb235647d3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75122) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 09:46:58 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.lightos [None req-17ab83f2-a973-4cca-b0b7-f4fb235647d3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75122) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 09:46:58 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.lightos [None req-17ab83f2-a973-4cca-b0b7-f4fb235647d3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] LIGHTOS: no hostnqn found. {{(pid=75122) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 09:46:58 user nova-compute[75122]: DEBUG os_brick.utils [None req-17ab83f2-a973-4cca-b0b7-f4fb235647d3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] <== get_connector_properties: return (111ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:742fb64b3587', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 09:46:58 user nova-compute[75122]: DEBUG nova.virt.block_device [None req-17ab83f2-a973-4cca-b0b7-f4fb235647d3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] [instance: bc80e3fb-b5a3-4685-8ec5-12f8c385b833] Updating existing volume attachment record: 5cd9ccb8-963d-4385-9bf7-4b3befaeb988 {{(pid=75122) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 09:47:03 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:47:04 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-17ab83f2-a973-4cca-b0b7-f4fb235647d3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:47:04 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-17ab83f2-a973-4cca-b0b7-f4fb235647d3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:47:04 user nova-compute[75122]: DEBUG nova.objects.instance [None req-17ab83f2-a973-4cca-b0b7-f4fb235647d3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Lazy-loading 'pci_requests' on Instance uuid bc80e3fb-b5a3-4685-8ec5-12f8c385b833 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:47:04 user nova-compute[75122]: DEBUG nova.objects.instance [None req-17ab83f2-a973-4cca-b0b7-f4fb235647d3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Lazy-loading 'numa_topology' on Instance uuid bc80e3fb-b5a3-4685-8ec5-12f8c385b833 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:47:04 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-17ab83f2-a973-4cca-b0b7-f4fb235647d3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75122) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 09:47:04 user nova-compute[75122]: INFO nova.compute.claims [None req-17ab83f2-a973-4cca-b0b7-f4fb235647d3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] [instance: bc80e3fb-b5a3-4685-8ec5-12f8c385b833] Claim successful on node user
Nov 15 09:47:04 user nova-compute[75122]: DEBUG nova.compute.provider_tree [None req-17ab83f2-a973-4cca-b0b7-f4fb235647d3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Inventory has not changed in ProviderTree for provider: 69a3da65-47be-44c6-b67c-c692b58284ef {{(pid=75122) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 09:47:04 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-17ab83f2-a973-4cca-b0b7-f4fb235647d3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Inventory has not changed for provider 69a3da65-47be-44c6-b67c-c692b58284ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 09:47:04 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-17ab83f2-a973-4cca-b0b7-f4fb235647d3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.409s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:47:04 user nova-compute[75122]: INFO nova.network.neutron [None req-17ab83f2-a973-4cca-b0b7-f4fb235647d3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] [instance: bc80e3fb-b5a3-4685-8ec5-12f8c385b833] Updating port a4776ec9-b51c-45f4-8e4c-8cbc3d9e8a59 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 15 09:47:05 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:47:05 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-17ab83f2-a973-4cca-b0b7-f4fb235647d3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Acquiring lock "refresh_cache-bc80e3fb-b5a3-4685-8ec5-12f8c385b833" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 09:47:05 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-17ab83f2-a973-4cca-b0b7-f4fb235647d3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Acquired lock "refresh_cache-bc80e3fb-b5a3-4685-8ec5-12f8c385b833" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 09:47:05 user nova-compute[75122]: DEBUG nova.network.neutron [None req-17ab83f2-a973-4cca-b0b7-f4fb235647d3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] [instance: bc80e3fb-b5a3-4685-8ec5-12f8c385b833] Building network info cache for instance {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 09:47:05 user nova-compute[75122]: DEBUG nova.compute.manager [req-b5cdb4ce-5b22-4b86-8540-bb50b2bfbee2 req-6254c538-50a0-45ca-8524-c1eb2211274a service nova] [instance: bc80e3fb-b5a3-4685-8ec5-12f8c385b833] Received event network-changed-a4776ec9-b51c-45f4-8e4c-8cbc3d9e8a59 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:47:05 user nova-compute[75122]: DEBUG nova.compute.manager [req-b5cdb4ce-5b22-4b86-8540-bb50b2bfbee2 req-6254c538-50a0-45ca-8524-c1eb2211274a service nova] [instance: bc80e3fb-b5a3-4685-8ec5-12f8c385b833] Refreshing instance network info cache due to event network-changed-a4776ec9-b51c-45f4-8e4c-8cbc3d9e8a59. {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 09:47:05 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-b5cdb4ce-5b22-4b86-8540-bb50b2bfbee2 req-6254c538-50a0-45ca-8524-c1eb2211274a service nova] Acquiring lock "refresh_cache-bc80e3fb-b5a3-4685-8ec5-12f8c385b833" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 09:47:06 user nova-compute[75122]: DEBUG nova.network.neutron [None req-17ab83f2-a973-4cca-b0b7-f4fb235647d3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] [instance: bc80e3fb-b5a3-4685-8ec5-12f8c385b833] Updating instance_info_cache with network_info: [{"id": "a4776ec9-b51c-45f4-8e4c-8cbc3d9e8a59", "address": "fa:16:3e:8c:f1:36", "network": {"id": "7ab99c1b-e670-416e-b5fe-e1337db6b28d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-487518933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "535c751b9e76421c9262e48fbab3fb6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4776ec9-b5", "ovs_interfaceid": "a4776ec9-b51c-45f4-8e4c-8cbc3d9e8a59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:47:06 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-17ab83f2-a973-4cca-b0b7-f4fb235647d3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Releasing lock "refresh_cache-bc80e3fb-b5a3-4685-8ec5-12f8c385b833" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 09:47:06 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-17ab83f2-a973-4cca-b0b7-f4fb235647d3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] [instance: bc80e3fb-b5a3-4685-8ec5-12f8c385b833] Creating instance directory {{(pid=75122) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 09:47:06 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-17ab83f2-a973-4cca-b0b7-f4fb235647d3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] [instance: bc80e3fb-b5a3-4685-8ec5-12f8c385b833] Creating image(s)
Nov 15 09:47:06 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-17ab83f2-a973-4cca-b0b7-f4fb235647d3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Acquiring lock "/opt/stack/data/nova/instances/bc80e3fb-b5a3-4685-8ec5-12f8c385b833/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:47:06 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-17ab83f2-a973-4cca-b0b7-f4fb235647d3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Lock "/opt/stack/data/nova/instances/bc80e3fb-b5a3-4685-8ec5-12f8c385b833/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:47:06 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-17ab83f2-a973-4cca-b0b7-f4fb235647d3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Lock "/opt/stack/data/nova/instances/bc80e3fb-b5a3-4685-8ec5-12f8c385b833/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:47:06 user nova-compute[75122]: DEBUG nova.objects.instance [None req-17ab83f2-a973-4cca-b0b7-f4fb235647d3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Lazy-loading 'trusted_certs' on Instance uuid bc80e3fb-b5a3-4685-8ec5-12f8c385b833 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:47:06 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-b5cdb4ce-5b22-4b86-8540-bb50b2bfbee2 req-6254c538-50a0-45ca-8524-c1eb2211274a service nova] Acquired lock "refresh_cache-bc80e3fb-b5a3-4685-8ec5-12f8c385b833" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 09:47:06 user nova-compute[75122]: DEBUG nova.network.neutron [req-b5cdb4ce-5b22-4b86-8540-bb50b2bfbee2 req-6254c538-50a0-45ca-8524-c1eb2211274a service nova] [instance: bc80e3fb-b5a3-4685-8ec5-12f8c385b833] Refreshing network info cache for port a4776ec9-b51c-45f4-8e4c-8cbc3d9e8a59 {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 09:47:06 user nova-compute[75122]: DEBUG nova.objects.base [None req-17ab83f2-a973-4cca-b0b7-f4fb235647d3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Object Instance<bc80e3fb-b5a3-4685-8ec5-12f8c385b833> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=75122) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 09:47:06 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-17ab83f2-a973-4cca-b0b7-f4fb235647d3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Acquiring lock "d0c596623ad7a7d7aeed895499cfae51405fcbde" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:47:06 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-17ab83f2-a973-4cca-b0b7-f4fb235647d3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Lock "d0c596623ad7a7d7aeed895499cfae51405fcbde" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:47:07 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-17ab83f2-a973-4cca-b0b7-f4fb235647d3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d0c596623ad7a7d7aeed895499cfae51405fcbde.part --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:47:07 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-12b52f04-6a0a-442b-a169-85d3aaf56f93 tempest-VolumesActionsTest-604748613 tempest-VolumesActionsTest-604748613-project-member] Acquiring lock "ca2defb6-c4ac-4d39-bdd2-1e0ac3265e02" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:47:07 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-12b52f04-6a0a-442b-a169-85d3aaf56f93 tempest-VolumesActionsTest-604748613 tempest-VolumesActionsTest-604748613-project-member] Lock "ca2defb6-c4ac-4d39-bdd2-1e0ac3265e02" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:47:07 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-12b52f04-6a0a-442b-a169-85d3aaf56f93 tempest-VolumesActionsTest-604748613 tempest-VolumesActionsTest-604748613-project-member] Acquiring lock "ca2defb6-c4ac-4d39-bdd2-1e0ac3265e02-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:47:07 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-12b52f04-6a0a-442b-a169-85d3aaf56f93 tempest-VolumesActionsTest-604748613 tempest-VolumesActionsTest-604748613-project-member] Lock "ca2defb6-c4ac-4d39-bdd2-1e0ac3265e02-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:47:07 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-12b52f04-6a0a-442b-a169-85d3aaf56f93 tempest-VolumesActionsTest-604748613 tempest-VolumesActionsTest-604748613-project-member] Lock "ca2defb6-c4ac-4d39-bdd2-1e0ac3265e02-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:47:07 user nova-compute[75122]: INFO nova.compute.manager [None req-12b52f04-6a0a-442b-a169-85d3aaf56f93 tempest-VolumesActionsTest-604748613 tempest-VolumesActionsTest-604748613-project-member] [instance: ca2defb6-c4ac-4d39-bdd2-1e0ac3265e02] Terminating instance
Nov 15 09:47:07 user nova-compute[75122]: DEBUG nova.compute.manager [None req-12b52f04-6a0a-442b-a169-85d3aaf56f93 tempest-VolumesActionsTest-604748613 tempest-VolumesActionsTest-604748613-project-member] [instance: ca2defb6-c4ac-4d39-bdd2-1e0ac3265e02] Start destroying the instance on the hypervisor. {{(pid=75122) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 09:47:07 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:47:07 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:47:07 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:47:07 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-17ab83f2-a973-4cca-b0b7-f4fb235647d3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d0c596623ad7a7d7aeed895499cfae51405fcbde.part --force-share --output=json" returned: 0 in 0.190s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:47:07 user nova-compute[75122]: DEBUG nova.virt.images [None req-17ab83f2-a973-4cca-b0b7-f4fb235647d3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] 6aff3e94-be37-4c75-ab89-92e2c713f30e was qcow2, converting to raw {{(pid=75122) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 15 09:47:07 user nova-compute[75122]: DEBUG nova.privsep.utils [None req-17ab83f2-a973-4cca-b0b7-f4fb235647d3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75122) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 09:47:07 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-17ab83f2-a973-4cca-b0b7-f4fb235647d3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d0c596623ad7a7d7aeed895499cfae51405fcbde.part /opt/stack/data/nova/instances/_base/d0c596623ad7a7d7aeed895499cfae51405fcbde.converted {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:47:07 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:47:07 user nova-compute[75122]: DEBUG nova.compute.manager [req-79950db3-05c9-4634-9b47-3751d4f2872d req-c28c2149-5a0e-451e-86b2-55a34f036bc5 service nova] [instance: ca2defb6-c4ac-4d39-bdd2-1e0ac3265e02] Received event network-vif-unplugged-df4e3999-a4c6-439b-9407-6f2e8127a3b6 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:47:07 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-79950db3-05c9-4634-9b47-3751d4f2872d req-c28c2149-5a0e-451e-86b2-55a34f036bc5 service nova] Acquiring lock "ca2defb6-c4ac-4d39-bdd2-1e0ac3265e02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:47:07 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-79950db3-05c9-4634-9b47-3751d4f2872d req-c28c2149-5a0e-451e-86b2-55a34f036bc5 service nova] Lock "ca2defb6-c4ac-4d39-bdd2-1e0ac3265e02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:47:07 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-79950db3-05c9-4634-9b47-3751d4f2872d req-c28c2149-5a0e-451e-86b2-55a34f036bc5 service nova] Lock "ca2defb6-c4ac-4d39-bdd2-1e0ac3265e02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:47:07 user nova-compute[75122]: DEBUG nova.compute.manager [req-79950db3-05c9-4634-9b47-3751d4f2872d req-c28c2149-5a0e-451e-86b2-55a34f036bc5 service nova] [instance: ca2defb6-c4ac-4d39-bdd2-1e0ac3265e02] No waiting events found dispatching network-vif-unplugged-df4e3999-a4c6-439b-9407-6f2e8127a3b6 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:47:07 user nova-compute[75122]: DEBUG nova.compute.manager [req-79950db3-05c9-4634-9b47-3751d4f2872d req-c28c2149-5a0e-451e-86b2-55a34f036bc5 service nova] [instance: ca2defb6-c4ac-4d39-bdd2-1e0ac3265e02] Received event network-vif-unplugged-df4e3999-a4c6-439b-9407-6f2e8127a3b6 for instance with task_state deleting. {{(pid=75122) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 09:47:07 user nova-compute[75122]: DEBUG nova.network.neutron [req-b5cdb4ce-5b22-4b86-8540-bb50b2bfbee2 req-6254c538-50a0-45ca-8524-c1eb2211274a service nova] [instance: bc80e3fb-b5a3-4685-8ec5-12f8c385b833] Updated VIF entry in instance network info cache for port a4776ec9-b51c-45f4-8e4c-8cbc3d9e8a59. {{(pid=75122) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 09:47:07 user nova-compute[75122]: DEBUG nova.network.neutron [req-b5cdb4ce-5b22-4b86-8540-bb50b2bfbee2 req-6254c538-50a0-45ca-8524-c1eb2211274a service nova] [instance: bc80e3fb-b5a3-4685-8ec5-12f8c385b833] Updating instance_info_cache with network_info: [{"id": "a4776ec9-b51c-45f4-8e4c-8cbc3d9e8a59", "address": "fa:16:3e:8c:f1:36", "network": {"id": "7ab99c1b-e670-416e-b5fe-e1337db6b28d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-487518933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "535c751b9e76421c9262e48fbab3fb6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4776ec9-b5", "ovs_interfaceid": "a4776ec9-b51c-45f4-8e4c-8cbc3d9e8a59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:47:07 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-b5cdb4ce-5b22-4b86-8540-bb50b2bfbee2 req-6254c538-50a0-45ca-8524-c1eb2211274a service nova] Releasing lock "refresh_cache-bc80e3fb-b5a3-4685-8ec5-12f8c385b833" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 09:47:08 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:47:08 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:47:08 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:47:08 user nova-compute[75122]: INFO nova.virt.libvirt.driver [-] [instance: ca2defb6-c4ac-4d39-bdd2-1e0ac3265e02] Instance destroyed successfully.
Nov 15 09:47:08 user nova-compute[75122]: DEBUG nova.objects.instance [None req-12b52f04-6a0a-442b-a169-85d3aaf56f93 tempest-VolumesActionsTest-604748613 tempest-VolumesActionsTest-604748613-project-member] Lazy-loading 'resources' on Instance uuid ca2defb6-c4ac-4d39-bdd2-1e0ac3265e02 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:47:08 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-12b52f04-6a0a-442b-a169-85d3aaf56f93 tempest-VolumesActionsTest-604748613 tempest-VolumesActionsTest-604748613-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T09:45:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-200829963',display_name='tempest-VolumesActionsTest-instance-200829963',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-200829963',id=33,image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T09:45:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bdd526581df1473887708d42296c94b2',ramdisk_id='',reservation_id='r-0lr2fgic',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-604748613',owner_user_name='tempest-VolumesActionsTest-604748613-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T09:45:17Z,user_data=None,user_id='59a289904f92493d83167ac2ff91e6b7',uuid=ca2defb6-c4ac-4d39-bdd2-1e0ac3265e02,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "df4e3999-a4c6-439b-9407-6f2e8127a3b6", "address": "fa:16:3e:80:13:ef", "network": {"id": "1c55a58a-06fb-4975-bf19-fd2936a31571", "bridge": "br-int", "label": "tempest-VolumesActionsTest-636321201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bdd526581df1473887708d42296c94b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf4e3999-a4", "ovs_interfaceid": "df4e3999-a4c6-439b-9407-6f2e8127a3b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 09:47:08 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-12b52f04-6a0a-442b-a169-85d3aaf56f93 tempest-VolumesActionsTest-604748613 tempest-VolumesActionsTest-604748613-project-member] Converting VIF {"id": "df4e3999-a4c6-439b-9407-6f2e8127a3b6", "address": "fa:16:3e:80:13:ef", "network": {"id": "1c55a58a-06fb-4975-bf19-fd2936a31571", "bridge": "br-int", "label": "tempest-VolumesActionsTest-636321201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bdd526581df1473887708d42296c94b2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf4e3999-a4", "ovs_interfaceid": "df4e3999-a4c6-439b-9407-6f2e8127a3b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 09:47:08 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-12b52f04-6a0a-442b-a169-85d3aaf56f93 tempest-VolumesActionsTest-604748613 tempest-VolumesActionsTest-604748613-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:80:13:ef,bridge_name='br-int',has_traffic_filtering=True,id=df4e3999-a4c6-439b-9407-6f2e8127a3b6,network=Network(1c55a58a-06fb-4975-bf19-fd2936a31571),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf4e3999-a4') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 09:47:08 user nova-compute[75122]: DEBUG os_vif [None req-12b52f04-6a0a-442b-a169-85d3aaf56f93 tempest-VolumesActionsTest-604748613 tempest-VolumesActionsTest-604748613-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:13:ef,bridge_name='br-int',has_traffic_filtering=True,id=df4e3999-a4c6-439b-9407-6f2e8127a3b6,network=Network(1c55a58a-06fb-4975-bf19-fd2936a31571),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf4e3999-a4') {{(pid=75122) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 09:47:08 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:47:08 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdf4e3999-a4, bridge=br-int, if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:47:08 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:47:08 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:47:08 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:47:08 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1b826fee-d547-4797-9f35-83a425503540) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:47:08 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:47:08 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:47:08 user nova-compute[75122]: INFO os_vif [None req-12b52f04-6a0a-442b-a169-85d3aaf56f93 tempest-VolumesActionsTest-604748613 tempest-VolumesActionsTest-604748613-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:13:ef,bridge_name='br-int',has_traffic_filtering=True,id=df4e3999-a4c6-439b-9407-6f2e8127a3b6,network=Network(1c55a58a-06fb-4975-bf19-fd2936a31571),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf4e3999-a4')
Nov 15 09:47:08 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-12b52f04-6a0a-442b-a169-85d3aaf56f93 tempest-VolumesActionsTest-604748613 tempest-VolumesActionsTest-604748613-project-member] [instance: ca2defb6-c4ac-4d39-bdd2-1e0ac3265e02] Deleting instance files /opt/stack/data/nova/instances/ca2defb6-c4ac-4d39-bdd2-1e0ac3265e02_del
Nov 15 09:47:08 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-12b52f04-6a0a-442b-a169-85d3aaf56f93 tempest-VolumesActionsTest-604748613 tempest-VolumesActionsTest-604748613-project-member] [instance: ca2defb6-c4ac-4d39-bdd2-1e0ac3265e02] Deletion of /opt/stack/data/nova/instances/ca2defb6-c4ac-4d39-bdd2-1e0ac3265e02_del complete
Nov 15 09:47:08 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-17ab83f2-a973-4cca-b0b7-f4fb235647d3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d0c596623ad7a7d7aeed895499cfae51405fcbde.part /opt/stack/data/nova/instances/_base/d0c596623ad7a7d7aeed895499cfae51405fcbde.converted" returned: 0 in 0.697s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:47:08 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-17ab83f2-a973-4cca-b0b7-f4fb235647d3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d0c596623ad7a7d7aeed895499cfae51405fcbde.converted --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:47:08 user nova-compute[75122]: INFO nova.compute.manager [None req-12b52f04-6a0a-442b-a169-85d3aaf56f93 tempest-VolumesActionsTest-604748613 tempest-VolumesActionsTest-604748613-project-member] [instance: ca2defb6-c4ac-4d39-bdd2-1e0ac3265e02] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 15 09:47:08 user nova-compute[75122]: DEBUG oslo.service.loopingcall [None req-12b52f04-6a0a-442b-a169-85d3aaf56f93 tempest-VolumesActionsTest-604748613 tempest-VolumesActionsTest-604748613-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75122) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 09:47:08 user nova-compute[75122]: DEBUG nova.compute.manager [-] [instance: ca2defb6-c4ac-4d39-bdd2-1e0ac3265e02] Deallocating network for instance {{(pid=75122) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 09:47:08 user nova-compute[75122]: DEBUG nova.network.neutron [-] [instance: ca2defb6-c4ac-4d39-bdd2-1e0ac3265e02] deallocate_for_instance() {{(pid=75122) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 09:47:08 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-17ab83f2-a973-4cca-b0b7-f4fb235647d3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d0c596623ad7a7d7aeed895499cfae51405fcbde.converted --force-share --output=json" returned: 0 in 0.171s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:47:08 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-17ab83f2-a973-4cca-b0b7-f4fb235647d3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Lock "d0c596623ad7a7d7aeed895499cfae51405fcbde" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.225s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:47:08 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-17ab83f2-a973-4cca-b0b7-f4fb235647d3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d0c596623ad7a7d7aeed895499cfae51405fcbde --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:47:08 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-70b0cc0f-2018-4695-bc85-bc753c0c1d5c tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Acquiring lock "a1121448-8452-4955-8112-7b984921dac6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:47:08 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-70b0cc0f-2018-4695-bc85-bc753c0c1d5c tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Lock "a1121448-8452-4955-8112-7b984921dac6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:47:08 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-70b0cc0f-2018-4695-bc85-bc753c0c1d5c tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Acquiring lock "a1121448-8452-4955-8112-7b984921dac6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:47:08 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-70b0cc0f-2018-4695-bc85-bc753c0c1d5c tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Lock "a1121448-8452-4955-8112-7b984921dac6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:47:08 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-70b0cc0f-2018-4695-bc85-bc753c0c1d5c tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Lock "a1121448-8452-4955-8112-7b984921dac6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:47:08 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-17ab83f2-a973-4cca-b0b7-f4fb235647d3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d0c596623ad7a7d7aeed895499cfae51405fcbde --force-share --output=json" returned: 0 in 0.194s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:47:08 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-17ab83f2-a973-4cca-b0b7-f4fb235647d3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Acquiring lock "d0c596623ad7a7d7aeed895499cfae51405fcbde" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:47:08 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-17ab83f2-a973-4cca-b0b7-f4fb235647d3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Lock "d0c596623ad7a7d7aeed895499cfae51405fcbde" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:47:08 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-17ab83f2-a973-4cca-b0b7-f4fb235647d3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d0c596623ad7a7d7aeed895499cfae51405fcbde --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:47:08 user nova-compute[75122]: INFO nova.compute.manager [None req-70b0cc0f-2018-4695-bc85-bc753c0c1d5c tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] [instance: a1121448-8452-4955-8112-7b984921dac6] Terminating instance
Nov 15 09:47:08 user nova-compute[75122]: DEBUG nova.compute.manager [None req-70b0cc0f-2018-4695-bc85-bc753c0c1d5c tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] [instance: a1121448-8452-4955-8112-7b984921dac6] Start destroying the instance on the hypervisor. {{(pid=75122) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 09:47:08 user nova-compute[75122]: DEBUG nova.network.neutron [-] [instance: ca2defb6-c4ac-4d39-bdd2-1e0ac3265e02] Updating instance_info_cache with network_info: [] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:47:08 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:47:08 user nova-compute[75122]: DEBUG nova.compute.manager [req-8d099b80-db9f-4edd-93e4-c6dac8b7ce11 req-5bac73a2-0e6f-4ad7-9e26-b7d5b4f75d17 service nova] [instance: ca2defb6-c4ac-4d39-bdd2-1e0ac3265e02] Received event network-vif-deleted-df4e3999-a4c6-439b-9407-6f2e8127a3b6 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:47:08 user nova-compute[75122]: INFO nova.compute.manager [req-8d099b80-db9f-4edd-93e4-c6dac8b7ce11 req-5bac73a2-0e6f-4ad7-9e26-b7d5b4f75d17 service nova] [instance: ca2defb6-c4ac-4d39-bdd2-1e0ac3265e02] Neutron deleted interface df4e3999-a4c6-439b-9407-6f2e8127a3b6; detaching it from the instance and deleting it from the info cache
Nov 15 09:47:08 user nova-compute[75122]: DEBUG nova.network.neutron [req-8d099b80-db9f-4edd-93e4-c6dac8b7ce11 req-5bac73a2-0e6f-4ad7-9e26-b7d5b4f75d17 service nova] [instance: ca2defb6-c4ac-4d39-bdd2-1e0ac3265e02] Updating instance_info_cache with network_info: [] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:47:08 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:47:08 user nova-compute[75122]: INFO nova.compute.manager [-] [instance: ca2defb6-c4ac-4d39-bdd2-1e0ac3265e02] Took 0.47 seconds to deallocate network for instance.
Nov 15 09:47:08 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:47:08 user nova-compute[75122]: DEBUG nova.compute.manager [req-8d099b80-db9f-4edd-93e4-c6dac8b7ce11 req-5bac73a2-0e6f-4ad7-9e26-b7d5b4f75d17 service nova] [instance: ca2defb6-c4ac-4d39-bdd2-1e0ac3265e02] Detach interface failed, port_id=df4e3999-a4c6-439b-9407-6f2e8127a3b6, reason: Instance ca2defb6-c4ac-4d39-bdd2-1e0ac3265e02 could not be found. {{(pid=75122) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 09:47:08 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-17ab83f2-a973-4cca-b0b7-f4fb235647d3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d0c596623ad7a7d7aeed895499cfae51405fcbde --force-share --output=json" returned: 0 in 0.182s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:47:08 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-17ab83f2-a973-4cca-b0b7-f4fb235647d3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d0c596623ad7a7d7aeed895499cfae51405fcbde,backing_fmt=raw /opt/stack/data/nova/instances/bc80e3fb-b5a3-4685-8ec5-12f8c385b833/disk 1073741824 {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:47:08 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:47:08 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-12b52f04-6a0a-442b-a169-85d3aaf56f93 tempest-VolumesActionsTest-604748613 tempest-VolumesActionsTest-604748613-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:47:08 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-12b52f04-6a0a-442b-a169-85d3aaf56f93 tempest-VolumesActionsTest-604748613 tempest-VolumesActionsTest-604748613-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:47:08 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-17ab83f2-a973-4cca-b0b7-f4fb235647d3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d0c596623ad7a7d7aeed895499cfae51405fcbde,backing_fmt=raw /opt/stack/data/nova/instances/bc80e3fb-b5a3-4685-8ec5-12f8c385b833/disk 1073741824" returned: 0 in 0.066s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:47:08 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-17ab83f2-a973-4cca-b0b7-f4fb235647d3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Lock "d0c596623ad7a7d7aeed895499cfae51405fcbde" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.252s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:47:08 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-17ab83f2-a973-4cca-b0b7-f4fb235647d3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d0c596623ad7a7d7aeed895499cfae51405fcbde --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:47:09 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-17ab83f2-a973-4cca-b0b7-f4fb235647d3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d0c596623ad7a7d7aeed895499cfae51405fcbde --force-share --output=json" returned: 0 in 0.177s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:47:09 user nova-compute[75122]: DEBUG nova.objects.instance [None req-17ab83f2-a973-4cca-b0b7-f4fb235647d3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Lazy-loading 'migration_context' on Instance uuid bc80e3fb-b5a3-4685-8ec5-12f8c385b833 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:47:09 user nova-compute[75122]: DEBUG nova.objects.base [None req-17ab83f2-a973-4cca-b0b7-f4fb235647d3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Object Instance<bc80e3fb-b5a3-4685-8ec5-12f8c385b833> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=75122) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 09:47:09 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-17ab83f2-a973-4cca-b0b7-f4fb235647d3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] [instance: bc80e3fb-b5a3-4685-8ec5-12f8c385b833] Rebasing disk image.
Nov 15 09:47:09 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-17ab83f2-a973-4cca-b0b7-f4fb235647d3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:47:09 user nova-compute[75122]: DEBUG nova.compute.manager [req-02e80019-2e56-42b7-a140-09d372c0ab04 req-683b3872-8a31-466c-a078-eadecb2ad4fd service nova] [instance: a1121448-8452-4955-8112-7b984921dac6] Received event network-vif-unplugged-9d82266f-3fa1-4cc5-994d-4a55b8a77f6f {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:47:09 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-02e80019-2e56-42b7-a140-09d372c0ab04 req-683b3872-8a31-466c-a078-eadecb2ad4fd service nova] Acquiring lock "a1121448-8452-4955-8112-7b984921dac6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:47:09 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-02e80019-2e56-42b7-a140-09d372c0ab04 req-683b3872-8a31-466c-a078-eadecb2ad4fd service nova] Lock "a1121448-8452-4955-8112-7b984921dac6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:47:09 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-02e80019-2e56-42b7-a140-09d372c0ab04 req-683b3872-8a31-466c-a078-eadecb2ad4fd service nova] Lock "a1121448-8452-4955-8112-7b984921dac6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:47:09 user nova-compute[75122]: DEBUG nova.compute.manager [req-02e80019-2e56-42b7-a140-09d372c0ab04 req-683b3872-8a31-466c-a078-eadecb2ad4fd service nova] [instance: a1121448-8452-4955-8112-7b984921dac6] No waiting events found dispatching network-vif-unplugged-9d82266f-3fa1-4cc5-994d-4a55b8a77f6f {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:47:09 user nova-compute[75122]: DEBUG nova.compute.manager [req-02e80019-2e56-42b7-a140-09d372c0ab04 req-683b3872-8a31-466c-a078-eadecb2ad4fd service nova] [instance: a1121448-8452-4955-8112-7b984921dac6] Received event network-vif-unplugged-9d82266f-3fa1-4cc5-994d-4a55b8a77f6f for instance with task_state deleting. {{(pid=75122) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 09:47:09 user nova-compute[75122]: DEBUG nova.compute.provider_tree [None req-12b52f04-6a0a-442b-a169-85d3aaf56f93 tempest-VolumesActionsTest-604748613 tempest-VolumesActionsTest-604748613-project-member] Inventory has not changed in ProviderTree for provider: 69a3da65-47be-44c6-b67c-c692b58284ef {{(pid=75122) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 09:47:09 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-17ab83f2-a973-4cca-b0b7-f4fb235647d3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json" returned: 0 in 0.189s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:47:09 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-17ab83f2-a973-4cca-b0b7-f4fb235647d3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 -F raw /opt/stack/data/nova/instances/bc80e3fb-b5a3-4685-8ec5-12f8c385b833/disk {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:47:09 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-12b52f04-6a0a-442b-a169-85d3aaf56f93 tempest-VolumesActionsTest-604748613 tempest-VolumesActionsTest-604748613-project-member] Inventory has not changed for provider 69a3da65-47be-44c6-b67c-c692b58284ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 09:47:09 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-12b52f04-6a0a-442b-a169-85d3aaf56f93 tempest-VolumesActionsTest-604748613 tempest-VolumesActionsTest-604748613-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.543s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:47:09 user nova-compute[75122]: INFO nova.virt.libvirt.driver [-] [instance: a1121448-8452-4955-8112-7b984921dac6] Instance destroyed successfully.
Nov 15 09:47:09 user nova-compute[75122]: DEBUG nova.objects.instance [None req-70b0cc0f-2018-4695-bc85-bc753c0c1d5c tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Lazy-loading 'resources' on Instance uuid a1121448-8452-4955-8112-7b984921dac6 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:47:09 user nova-compute[75122]: INFO nova.scheduler.client.report [None req-12b52f04-6a0a-442b-a169-85d3aaf56f93 tempest-VolumesActionsTest-604748613 tempest-VolumesActionsTest-604748613-project-member] Deleted allocations for instance ca2defb6-c4ac-4d39-bdd2-1e0ac3265e02
Nov 15 09:47:09 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-70b0cc0f-2018-4695-bc85-bc753c0c1d5c tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T09:44:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-120337552',display_name='tempest-AttachVolumeNegativeTest-server-120337552',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-120337552',id=32,image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIt004arHJAVA9YX1D2h32CCG1NZs5pmS7Nq8kguNJF1nqzEWQDBPJY45HS+YgLBXElVlpJ00RXFjwW3PY8evZ9wx+3Gi8S/JxRAxeXls+Av8MYdiphzSJ7fDXdmgiktLA==',key_name='tempest-keypair-953633772',keypairs=<?>,launch_index=0,launched_at=2023-11-15T09:44:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f29cd64a8a674d73936b8a0c90bf2d34',ramdisk_id='',reservation_id='r-jawjpd9a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-475232131',owner_user_name='tempest-AttachVolumeNegativeTest-475232131-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T09:44:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d52d39a644924944be943a3200bd5b33',uuid=a1121448-8452-4955-8112-7b984921dac6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9d82266f-3fa1-4cc5-994d-4a55b8a77f6f", "address": "fa:16:3e:c3:ac:e1", "network": {"id": "cc80acf3-8a44-4d7e-aaa0-1214700564b3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1084984321-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f29cd64a8a674d73936b8a0c90bf2d34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d82266f-3f", "ovs_interfaceid": "9d82266f-3fa1-4cc5-994d-4a55b8a77f6f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 09:47:09 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-70b0cc0f-2018-4695-bc85-bc753c0c1d5c tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Converting VIF {"id": "9d82266f-3fa1-4cc5-994d-4a55b8a77f6f", "address": "fa:16:3e:c3:ac:e1", "network": {"id": "cc80acf3-8a44-4d7e-aaa0-1214700564b3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1084984321-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f29cd64a8a674d73936b8a0c90bf2d34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d82266f-3f", "ovs_interfaceid": "9d82266f-3fa1-4cc5-994d-4a55b8a77f6f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 09:47:09 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-70b0cc0f-2018-4695-bc85-bc753c0c1d5c tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c3:ac:e1,bridge_name='br-int',has_traffic_filtering=True,id=9d82266f-3fa1-4cc5-994d-4a55b8a77f6f,network=Network(cc80acf3-8a44-4d7e-aaa0-1214700564b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d82266f-3f') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 09:47:09 user nova-compute[75122]: DEBUG os_vif [None req-70b0cc0f-2018-4695-bc85-bc753c0c1d5c tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c3:ac:e1,bridge_name='br-int',has_traffic_filtering=True,id=9d82266f-3fa1-4cc5-994d-4a55b8a77f6f,network=Network(cc80acf3-8a44-4d7e-aaa0-1214700564b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d82266f-3f') {{(pid=75122) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 09:47:09 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:47:09 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9d82266f-3f, bridge=br-int, if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:47:09 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:47:09 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:47:09 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:47:09 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c74a8831-ac51-4174-81ba-42c15aba5d88) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:47:09 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:47:09 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:47:09 user nova-compute[75122]: INFO os_vif [None req-70b0cc0f-2018-4695-bc85-bc753c0c1d5c tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c3:ac:e1,bridge_name='br-int',has_traffic_filtering=True,id=9d82266f-3fa1-4cc5-994d-4a55b8a77f6f,network=Network(cc80acf3-8a44-4d7e-aaa0-1214700564b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d82266f-3f')
Nov 15 09:47:09 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-70b0cc0f-2018-4695-bc85-bc753c0c1d5c tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] [instance: a1121448-8452-4955-8112-7b984921dac6] Deleting instance files /opt/stack/data/nova/instances/a1121448-8452-4955-8112-7b984921dac6_del
Nov 15 09:47:09 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-70b0cc0f-2018-4695-bc85-bc753c0c1d5c tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] [instance: a1121448-8452-4955-8112-7b984921dac6] Deletion of /opt/stack/data/nova/instances/a1121448-8452-4955-8112-7b984921dac6_del complete
Nov 15 09:47:09 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-12b52f04-6a0a-442b-a169-85d3aaf56f93 tempest-VolumesActionsTest-604748613 tempest-VolumesActionsTest-604748613-project-member] Lock "ca2defb6-c4ac-4d39-bdd2-1e0ac3265e02" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.136s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:47:09 user nova-compute[75122]: INFO nova.compute.manager [None req-70b0cc0f-2018-4695-bc85-bc753c0c1d5c tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] [instance: a1121448-8452-4955-8112-7b984921dac6] Took 0.91 seconds to destroy the instance on the hypervisor.
Nov 15 09:47:09 user nova-compute[75122]: DEBUG oslo.service.loopingcall [None req-70b0cc0f-2018-4695-bc85-bc753c0c1d5c tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75122) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 09:47:09 user nova-compute[75122]: DEBUG nova.compute.manager [-] [instance: a1121448-8452-4955-8112-7b984921dac6] Deallocating network for instance {{(pid=75122) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 09:47:09 user nova-compute[75122]: DEBUG nova.network.neutron [-] [instance: a1121448-8452-4955-8112-7b984921dac6] deallocate_for_instance() {{(pid=75122) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 09:47:09 user nova-compute[75122]: DEBUG nova.compute.manager [req-165a035c-dda8-4187-abcd-2a386cc89474 req-0018c821-62bf-43f1-b88b-2a75b3be3d71 service nova] [instance: ca2defb6-c4ac-4d39-bdd2-1e0ac3265e02] Received event network-vif-plugged-df4e3999-a4c6-439b-9407-6f2e8127a3b6 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:47:09 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-165a035c-dda8-4187-abcd-2a386cc89474 req-0018c821-62bf-43f1-b88b-2a75b3be3d71 service nova] Acquiring lock "ca2defb6-c4ac-4d39-bdd2-1e0ac3265e02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:47:09 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-165a035c-dda8-4187-abcd-2a386cc89474 req-0018c821-62bf-43f1-b88b-2a75b3be3d71 service nova] Lock "ca2defb6-c4ac-4d39-bdd2-1e0ac3265e02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:47:09 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-165a035c-dda8-4187-abcd-2a386cc89474 req-0018c821-62bf-43f1-b88b-2a75b3be3d71 service nova] Lock "ca2defb6-c4ac-4d39-bdd2-1e0ac3265e02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:47:09 user nova-compute[75122]: DEBUG nova.compute.manager [req-165a035c-dda8-4187-abcd-2a386cc89474 req-0018c821-62bf-43f1-b88b-2a75b3be3d71 service nova] [instance: ca2defb6-c4ac-4d39-bdd2-1e0ac3265e02] No waiting events found dispatching network-vif-plugged-df4e3999-a4c6-439b-9407-6f2e8127a3b6 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:47:09 user nova-compute[75122]: WARNING nova.compute.manager [req-165a035c-dda8-4187-abcd-2a386cc89474 req-0018c821-62bf-43f1-b88b-2a75b3be3d71 service nova] [instance: ca2defb6-c4ac-4d39-bdd2-1e0ac3265e02] Received unexpected event network-vif-plugged-df4e3999-a4c6-439b-9407-6f2e8127a3b6 for instance with vm_state deleted and task_state None.
Nov 15 09:47:10 user nova-compute[75122]: DEBUG nova.network.neutron [-] [instance: a1121448-8452-4955-8112-7b984921dac6] Updating instance_info_cache with network_info: [] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:47:10 user nova-compute[75122]: INFO nova.compute.manager [-] [instance: a1121448-8452-4955-8112-7b984921dac6] Took 0.73 seconds to deallocate network for instance.
Nov 15 09:47:10 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-70b0cc0f-2018-4695-bc85-bc753c0c1d5c tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:47:10 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-70b0cc0f-2018-4695-bc85-bc753c0c1d5c tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:47:10 user nova-compute[75122]: DEBUG nova.compute.provider_tree [None req-70b0cc0f-2018-4695-bc85-bc753c0c1d5c tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Inventory has not changed in ProviderTree for provider: 69a3da65-47be-44c6-b67c-c692b58284ef {{(pid=75122) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 09:47:10 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-70b0cc0f-2018-4695-bc85-bc753c0c1d5c tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Inventory has not changed for provider 69a3da65-47be-44c6-b67c-c692b58284ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 09:47:10 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-70b0cc0f-2018-4695-bc85-bc753c0c1d5c tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.402s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:47:10 user nova-compute[75122]: DEBUG nova.compute.manager [req-6e8a6bad-d778-4b12-88d9-c4ebe222abe3 req-c3e6263c-92d8-478c-ad94-04ccb51d8add service nova] [instance: a1121448-8452-4955-8112-7b984921dac6] Received event network-vif-deleted-9d82266f-3fa1-4cc5-994d-4a55b8a77f6f {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:47:10 user nova-compute[75122]: INFO nova.scheduler.client.report [None req-70b0cc0f-2018-4695-bc85-bc753c0c1d5c tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Deleted allocations for instance a1121448-8452-4955-8112-7b984921dac6
Nov 15 09:47:10 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-70b0cc0f-2018-4695-bc85-bc753c0c1d5c tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Lock "a1121448-8452-4955-8112-7b984921dac6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.328s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:47:11 user nova-compute[75122]: DEBUG nova.compute.manager [req-ad143196-5734-4c24-9d47-c3e19739bd63 req-4665a453-ae36-4956-8a91-940d449a07aa service nova] [instance: a1121448-8452-4955-8112-7b984921dac6] Received event network-vif-plugged-9d82266f-3fa1-4cc5-994d-4a55b8a77f6f {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:47:11 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-ad143196-5734-4c24-9d47-c3e19739bd63 req-4665a453-ae36-4956-8a91-940d449a07aa service nova] Acquiring lock "a1121448-8452-4955-8112-7b984921dac6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:47:11 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-ad143196-5734-4c24-9d47-c3e19739bd63 req-4665a453-ae36-4956-8a91-940d449a07aa service nova] Lock "a1121448-8452-4955-8112-7b984921dac6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:47:11 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-ad143196-5734-4c24-9d47-c3e19739bd63 req-4665a453-ae36-4956-8a91-940d449a07aa service nova] Lock "a1121448-8452-4955-8112-7b984921dac6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:47:11 user nova-compute[75122]: DEBUG nova.compute.manager [req-ad143196-5734-4c24-9d47-c3e19739bd63 req-4665a453-ae36-4956-8a91-940d449a07aa service nova] [instance: a1121448-8452-4955-8112-7b984921dac6] No waiting events found dispatching network-vif-plugged-9d82266f-3fa1-4cc5-994d-4a55b8a77f6f {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:47:11 user nova-compute[75122]: WARNING nova.compute.manager [req-ad143196-5734-4c24-9d47-c3e19739bd63 req-4665a453-ae36-4956-8a91-940d449a07aa service nova] [instance: a1121448-8452-4955-8112-7b984921dac6] Received unexpected event network-vif-plugged-9d82266f-3fa1-4cc5-994d-4a55b8a77f6f for instance with vm_state deleted and task_state None.
Nov 15 09:47:11 user nova-compute[75122]: INFO nova.compute.manager [None req-33c23fc0-9476-4244-9984-0513875557b9 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] [instance: cc485c6c-5a9a-4c94-b966-68dd9e336e56] Get console output
Nov 15 09:47:11 user nova-compute[75122]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Nov 15 09:47:11 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-17ab83f2-a973-4cca-b0b7-f4fb235647d3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 -F raw /opt/stack/data/nova/instances/bc80e3fb-b5a3-4685-8ec5-12f8c385b833/disk" returned: 0 in 2.360s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:47:11 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-17ab83f2-a973-4cca-b0b7-f4fb235647d3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] [instance: bc80e3fb-b5a3-4685-8ec5-12f8c385b833] Created local disks {{(pid=75122) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 09:47:11 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-17ab83f2-a973-4cca-b0b7-f4fb235647d3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] [instance: bc80e3fb-b5a3-4685-8ec5-12f8c385b833] Ensure instance console log exists: /opt/stack/data/nova/instances/bc80e3fb-b5a3-4685-8ec5-12f8c385b833/console.log {{(pid=75122) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 09:47:11 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-17ab83f2-a973-4cca-b0b7-f4fb235647d3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:47:11 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-17ab83f2-a973-4cca-b0b7-f4fb235647d3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:47:11 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-17ab83f2-a973-4cca-b0b7-f4fb235647d3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:47:11 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-17ab83f2-a973-4cca-b0b7-f4fb235647d3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] [instance: bc80e3fb-b5a3-4685-8ec5-12f8c385b833] Start _get_guest_xml network_info=[{"id": "a4776ec9-b51c-45f4-8e4c-8cbc3d9e8a59", "address": "fa:16:3e:8c:f1:36", "network": {"id": "7ab99c1b-e670-416e-b5fe-e1337db6b28d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-487518933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "535c751b9e76421c9262e48fbab3fb6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4776ec9-b5", "ovs_interfaceid": "a4776ec9-b51c-45f4-8e4c-8cbc3d9e8a59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='820569c0a7f549068e60849ebfd12074',container_format='bare',created_at=2023-11-15T09:45:06Z,direct_url=<?>,disk_format='qcow2',id=6aff3e94-be37-4c75-ab89-92e2c713f30e,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-163449221-shelved',owner='535c751b9e76421c9262e48fbab3fb6f',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-15T09:45:10Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '5e862cfe-47b8-4725-8292-65761ee6d0f5'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6cd246c1-08d6-43ce-b2b5-2a6c42e46135', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CXgpWwhs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': 'bc80e3fb-b5a3-4685-8ec5-12f8c385b833', 'attached_at': '', 'detached_at': '', 'volume_id': '6cd246c1-08d6-43ce-b2b5-2a6c42e46135', 'serial': '6cd246c1-08d6-43ce-b2b5-2a6c42e46135'}, 'guest_format': None, 'delete_on_termination': False, 'boot_index': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vdc', 'attachment_id': '5cd9ccb8-963d-4385-9bf7-4b3befaeb988', 'volume_type': None} {{(pid=75122) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 09:47:11 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-17ab83f2-a973-4cca-b0b7-f4fb235647d3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 09:47:11 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-17ab83f2-a973-4cca-b0b7-f4fb235647d3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 09:47:11 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-17ab83f2-a973-4cca-b0b7-f4fb235647d3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75122) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 09:47:11 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-17ab83f2-a973-4cca-b0b7-f4fb235647d3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] CPU controller missing on host. {{(pid=75122) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 09:47:11 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-17ab83f2-a973-4cca-b0b7-f4fb235647d3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75122) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 09:47:11 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-17ab83f2-a973-4cca-b0b7-f4fb235647d3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] CPU controller found on host. {{(pid=75122) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 09:47:11 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-17ab83f2-a973-4cca-b0b7-f4fb235647d3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75122) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 09:47:11 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-17ab83f2-a973-4cca-b0b7-f4fb235647d3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T09:26:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='820569c0a7f549068e60849ebfd12074',container_format='bare',created_at=2023-11-15T09:45:06Z,direct_url=<?>,disk_format='qcow2',id=6aff3e94-be37-4c75-ab89-92e2c713f30e,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-163449221-shelved',owner='535c751b9e76421c9262e48fbab3fb6f',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-15T09:45:10Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 09:47:11 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-17ab83f2-a973-4cca-b0b7-f4fb235647d3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Flavor limits 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 09:47:11 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-17ab83f2-a973-4cca-b0b7-f4fb235647d3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Image limits 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 09:47:11 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-17ab83f2-a973-4cca-b0b7-f4fb235647d3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Flavor pref 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 09:47:11 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-17ab83f2-a973-4cca-b0b7-f4fb235647d3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Image pref 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 09:47:11 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-17ab83f2-a973-4cca-b0b7-f4fb235647d3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 09:47:11 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-17ab83f2-a973-4cca-b0b7-f4fb235647d3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 09:47:11 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-17ab83f2-a973-4cca-b0b7-f4fb235647d3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75122) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 09:47:11 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-17ab83f2-a973-4cca-b0b7-f4fb235647d3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Got 1 possible topologies {{(pid=75122) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 09:47:11 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-17ab83f2-a973-4cca-b0b7-f4fb235647d3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 09:47:11 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-17ab83f2-a973-4cca-b0b7-f4fb235647d3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 09:47:11 user nova-compute[75122]: DEBUG nova.objects.instance [None req-17ab83f2-a973-4cca-b0b7-f4fb235647d3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Lazy-loading 'vcpu_model' on Instance uuid bc80e3fb-b5a3-4685-8ec5-12f8c385b833 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:47:11 user nova-compute[75122]: DEBUG nova.objects.base [None req-17ab83f2-a973-4cca-b0b7-f4fb235647d3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Object Instance<bc80e3fb-b5a3-4685-8ec5-12f8c385b833> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=75122) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 09:47:11 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-17ab83f2-a973-4cca-b0b7-f4fb235647d3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] [instance: bc80e3fb-b5a3-4685-8ec5-12f8c385b833] Calling os-brick to attach iSCSI Volume {{(pid=75122) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 09:47:11 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-17ab83f2-a973-4cca-b0b7-f4fb235647d3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffa04060b80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6cd246c1-08d6-43ce-b2b5-2a6c42e46135', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CXgpWwhs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 09:47:11 user nova-compute[75122]: WARNING os_brick.initiator.connectors.base [None req-17ab83f2-a973-4cca-b0b7-f4fb235647d3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 09:47:11 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-17ab83f2-a973-4cca-b0b7-f4fb235647d3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 09:47:11 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-17ab83f2-a973-4cca-b0b7-f4fb235647d3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 09:47:11 user nova-compute[75122]: WARNING os_brick.initiator.connectors.base [None req-17ab83f2-a973-4cca-b0b7-f4fb235647d3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 09:47:11 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-17ab83f2-a973-4cca-b0b7-f4fb235647d3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6cd246c1-08d6-43ce-b2b5-2a6c42e46135" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 09:47:11 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-17ab83f2-a973-4cca-b0b7-f4fb235647d3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6cd246c1-08d6-43ce-b2b5-2a6c42e46135" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 09:47:11 user nova-compute[75122]: INFO os_brick.initiator.connectors.iscsi [None req-17ab83f2-a973-4cca-b0b7-f4fb235647d3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 09:47:11 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cd246c1-08d6-43ce-b2b5-2a6c42e46135 -p 172.16.0.220:3260 {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:47:11 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cd246c1-08d6-43ce-b2b5-2a6c42e46135 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:47:11 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[cebd6131-1a29-45d5-af3c-747fc718a405]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:47:11 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-17ab83f2-a973-4cca-b0b7-f4fb235647d3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 09:47:11 user nova-compute[75122]:  {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:47:11 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cd246c1-08d6-43ce-b2b5-2a6c42e46135 -p 172.16.0.220:3260 --interface default --op new {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:47:11 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cd246c1-08d6-43ce-b2b5-2a6c42e46135 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:47:11 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe457c14-1a4b-488e-b90a-160349d602b4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6cd246c1-08d6-43ce-b2b5-2a6c42e46135] added\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:47:11 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-17ab83f2-a973-4cca-b0b7-f4fb235647d3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6cd246c1-08d6-43ce-b2b5-2a6c42e46135] added
Nov 15 09:47:11 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:47:11 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cd246c1-08d6-43ce-b2b5-2a6c42e46135 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:47:11 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cd246c1-08d6-43ce-b2b5-2a6c42e46135 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:47:11 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[010e4c03-50bf-461b-9325-04d8fbccd793]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:47:11 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-17ab83f2-a973-4cca-b0b7-f4fb235647d3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:47:11 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cd246c1-08d6-43ce-b2b5-2a6c42e46135 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:47:11 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cd246c1-08d6-43ce-b2b5-2a6c42e46135 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:47:11 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5321425-6340-4804-96cd-5df62c6cce45]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:47:11 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-17ab83f2-a973-4cca-b0b7-f4fb235647d3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:47:11 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cd246c1-08d6-43ce-b2b5-2a6c42e46135 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CXgpWwhs {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:47:11 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cd246c1-08d6-43ce-b2b5-2a6c42e46135 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CXgpWwhs" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:47:11 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ee58554-9cf4-417a-aca5-9cf0b17b8c1a]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:47:11 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-17ab83f2-a973-4cca-b0b7-f4fb235647d3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CXgpWwhs'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:47:11 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cd246c1-08d6-43ce-b2b5-2a6c42e46135 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:47:11 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cd246c1-08d6-43ce-b2b5-2a6c42e46135 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:47:11 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c9d0308-4de8-42c9-a3c4-af774d5fc91a]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:47:11 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-17ab83f2-a973-4cca-b0b7-f4fb235647d3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:47:11 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:47:11 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:47:11 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a8b3019-79e4-4587-8002-7d89df778fcf]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6224c0df-13b0-4ff7-928f-9a2282386a2a (non-flash)\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:47:11 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-17ab83f2-a973-4cca-b0b7-f4fb235647d3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17 (non-flash)
Nov 15 09:47:11 user nova-compute[75122]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6224c0df-13b0-4ff7-928f-9a2282386a2a (non-flash)
Nov 15 09:47:11 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 09:47:11 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-17ab83f2-a973-4cca-b0b7-f4fb235647d3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17 (non-flash)
Nov 15 09:47:11 user nova-compute[75122]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6224c0df-13b0-4ff7-928f-9a2282386a2a (non-flash)
Nov 15 09:47:11 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 09:47:11 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cd246c1-08d6-43ce-b2b5-2a6c42e46135 -p 172.16.0.220:3260 --login {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:47:11 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cd246c1-08d6-43ce-b2b5-2a6c42e46135 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:47:11 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[80fce03e-d15e-4ee9-b5eb-ff277be38a6a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6cd246c1-08d6-43ce-b2b5-2a6c42e46135, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6cd246c1-08d6-43ce-b2b5-2a6c42e46135, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:47:11 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-17ab83f2-a973-4cca-b0b7-f4fb235647d3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6cd246c1-08d6-43ce-b2b5-2a6c42e46135, portal: 172.16.0.220,3260]
Nov 15 09:47:11 user nova-compute[75122]: Login to [iface: default, target: iqn.2010-10.org.openstack:6cd246c1-08d6-43ce-b2b5-2a6c42e46135, portal: 172.16.0.220,3260] successful.
Nov 15 09:47:11 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:47:11 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cd246c1-08d6-43ce-b2b5-2a6c42e46135 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:47:11 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cd246c1-08d6-43ce-b2b5-2a6c42e46135 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:47:11 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbec692f-43ce-4c4e-bd11-6ad144f77252]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:47:11 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-17ab83f2-a973-4cca-b0b7-f4fb235647d3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:47:11 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:47:12 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:47:12 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[73865c5b-db48-417b-80a1-bf280be11297]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6224c0df-13b0-4ff7-928f-9a2282386a2a (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cd246c1-08d6-43ce-b2b5-2a6c42e46135 (non-flash)\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:47:12 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-17ab83f2-a973-4cca-b0b7-f4fb235647d3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17 (non-flash)
Nov 15 09:47:12 user nova-compute[75122]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6224c0df-13b0-4ff7-928f-9a2282386a2a (non-flash)
Nov 15 09:47:12 user nova-compute[75122]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cd246c1-08d6-43ce-b2b5-2a6c42e46135 (non-flash)
Nov 15 09:47:12 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 09:47:12 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-17ab83f2-a973-4cca-b0b7-f4fb235647d3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17 (non-flash)
Nov 15 09:47:12 user nova-compute[75122]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6224c0df-13b0-4ff7-928f-9a2282386a2a (non-flash)
Nov 15 09:47:12 user nova-compute[75122]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cd246c1-08d6-43ce-b2b5-2a6c42e46135 (non-flash)
Nov 15 09:47:12 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 09:47:12 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-17ab83f2-a973-4cca-b0b7-f4fb235647d3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6cd246c1-08d6-43ce-b2b5-2a6c42e46135" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.287s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 09:47:12 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-17ab83f2-a973-4cca-b0b7-f4fb235647d3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Connected to 172.16.0.220:3260 {{(pid=75122) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 09:47:12 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-17ab83f2-a973-4cca-b0b7-f4fb235647d3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] HCTL ('35', '-', '-', 0) found on session 42 with lun 0 {{(pid=75122) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 09:47:12 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-17ab83f2-a973-4cca-b0b7-f4fb235647d3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75122) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 09:47:12 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:47:12 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:47:12 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[faf5bef3-b98a-4fdb-a3b4-993d7180d8c3]: (4, ('- - 0', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:47:12 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-17ab83f2-a973-4cca-b0b7-f4fb235647d3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Searching for a device in session 42 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75122) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 09:47:12 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-17ab83f2-a973-4cca-b0b7-f4fb235647d3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:6cd246c1-08d6-43ce-b2b5-2a6c42e46135', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CXgpWwhs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75122) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 09:47:13 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-17ab83f2-a973-4cca-b0b7-f4fb235647d3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.321s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 09:47:13 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-17ab83f2-a973-4cca-b0b7-f4fb235647d3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] <== connect_volume: return (1322ms) {'type': 'block', 'scsi_wwn': '23864396363636134', 'path': '/dev/sdd'} {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 09:47:13 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-17ab83f2-a973-4cca-b0b7-f4fb235647d3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] [instance: bc80e3fb-b5a3-4685-8ec5-12f8c385b833] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23864396363636134', 'path': '/dev/sdd'} {{(pid=75122) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 09:47:13 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-17ab83f2-a973-4cca-b0b7-f4fb235647d3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-15T09:43:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-163449221',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-163449221',id=29,image_ref='6aff3e94-be37-4c75-ab89-92e2c713f30e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-785756428',keypairs=<?>,launch_index=0,launched_at=2023-11-15T09:43:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='535c751b9e76421c9262e48fbab3fb6f',ramdisk_id='',reservation_id='r-s195psec',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1659813957',owner_user_name='tempest-AttachVolumeShelveTestJSON-1659813957-project-member',shelved_at='2023-11-15T09:45:10.578990',shelved_host='user',shelved_image_id='6aff3e94-be37-4c75-ab89-92e2c713f30e'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T09:46:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad06186836ed40a49a05ef7cc9afd1bc',uuid=bc80e3fb-b5a3-4685-8ec5-12f8c385b833,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "a4776ec9-b51c-45f4-8e4c-8cbc3d9e8a59", "address": "fa:16:3e:8c:f1:36", "network": {"id": "7ab99c1b-e670-416e-b5fe-e1337db6b28d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-487518933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "535c751b9e76421c9262e48fbab3fb6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4776ec9-b5", "ovs_interfaceid": "a4776ec9-b51c-45f4-8e4c-8cbc3d9e8a59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75122) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 09:47:13 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-17ab83f2-a973-4cca-b0b7-f4fb235647d3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Converting VIF {"id": "a4776ec9-b51c-45f4-8e4c-8cbc3d9e8a59", "address": "fa:16:3e:8c:f1:36", "network": {"id": "7ab99c1b-e670-416e-b5fe-e1337db6b28d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-487518933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "535c751b9e76421c9262e48fbab3fb6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4776ec9-b5", "ovs_interfaceid": "a4776ec9-b51c-45f4-8e4c-8cbc3d9e8a59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 09:47:13 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-17ab83f2-a973-4cca-b0b7-f4fb235647d3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:f1:36,bridge_name='br-int',has_traffic_filtering=True,id=a4776ec9-b51c-45f4-8e4c-8cbc3d9e8a59,network=Network(7ab99c1b-e670-416e-b5fe-e1337db6b28d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4776ec9-b5') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 09:47:13 user nova-compute[75122]: DEBUG nova.objects.instance [None req-17ab83f2-a973-4cca-b0b7-f4fb235647d3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Lazy-loading 'pci_devices' on Instance uuid bc80e3fb-b5a3-4685-8ec5-12f8c385b833 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:47:13 user nova-compute[75122]: DEBUG nova.objects.base [None req-17ab83f2-a973-4cca-b0b7-f4fb235647d3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Object Instance<bc80e3fb-b5a3-4685-8ec5-12f8c385b833> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=75122) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 09:47:13 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-17ab83f2-a973-4cca-b0b7-f4fb235647d3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] [instance: bc80e3fb-b5a3-4685-8ec5-12f8c385b833] End _get_guest_xml xml=<domain type="kvm">
Nov 15 09:47:13 user nova-compute[75122]:   <uuid>bc80e3fb-b5a3-4685-8ec5-12f8c385b833</uuid>
Nov 15 09:47:13 user nova-compute[75122]:   <name>instance-0000001d</name>
Nov 15 09:47:13 user nova-compute[75122]:   <memory>524288</memory>
Nov 15 09:47:13 user nova-compute[75122]:   <vcpu>1</vcpu>
Nov 15 09:47:13 user nova-compute[75122]:   <metadata>
Nov 15 09:47:13 user nova-compute[75122]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 09:47:13 user nova-compute[75122]:       <nova:package version="0.0.0"/>
Nov 15 09:47:13 user nova-compute[75122]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-163449221</nova:name>
Nov 15 09:47:13 user nova-compute[75122]:       <nova:creationTime>2023-11-15 09:47:11</nova:creationTime>
Nov 15 09:47:13 user nova-compute[75122]:       <nova:flavor name="m1.tiny">
Nov 15 09:47:13 user nova-compute[75122]:         <nova:memory>512</nova:memory>
Nov 15 09:47:13 user nova-compute[75122]:         <nova:disk>1</nova:disk>
Nov 15 09:47:13 user nova-compute[75122]:         <nova:swap>0</nova:swap>
Nov 15 09:47:13 user nova-compute[75122]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 09:47:13 user nova-compute[75122]:         <nova:vcpus>1</nova:vcpus>
Nov 15 09:47:13 user nova-compute[75122]:       </nova:flavor>
Nov 15 09:47:13 user nova-compute[75122]:       <nova:owner>
Nov 15 09:47:13 user nova-compute[75122]:         <nova:user uuid="ad06186836ed40a49a05ef7cc9afd1bc">tempest-AttachVolumeShelveTestJSON-1659813957-project-member</nova:user>
Nov 15 09:47:13 user nova-compute[75122]:         <nova:project uuid="535c751b9e76421c9262e48fbab3fb6f">tempest-AttachVolumeShelveTestJSON-1659813957</nova:project>
Nov 15 09:47:13 user nova-compute[75122]:       </nova:owner>
Nov 15 09:47:13 user nova-compute[75122]:       <nova:root type="image" uuid="6aff3e94-be37-4c75-ab89-92e2c713f30e"/>
Nov 15 09:47:13 user nova-compute[75122]:       <nova:ports>
Nov 15 09:47:13 user nova-compute[75122]:         <nova:port uuid="a4776ec9-b51c-45f4-8e4c-8cbc3d9e8a59">
Nov 15 09:47:13 user nova-compute[75122]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 15 09:47:13 user nova-compute[75122]:         </nova:port>
Nov 15 09:47:13 user nova-compute[75122]:       </nova:ports>
Nov 15 09:47:13 user nova-compute[75122]:     </nova:instance>
Nov 15 09:47:13 user nova-compute[75122]:   </metadata>
Nov 15 09:47:13 user nova-compute[75122]:   <sysinfo type="smbios">
Nov 15 09:47:13 user nova-compute[75122]:     <system>
Nov 15 09:47:13 user nova-compute[75122]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 09:47:13 user nova-compute[75122]:       <entry name="product">OpenStack Nova</entry>
Nov 15 09:47:13 user nova-compute[75122]:       <entry name="version">0.0.0</entry>
Nov 15 09:47:13 user nova-compute[75122]:       <entry name="serial">bc80e3fb-b5a3-4685-8ec5-12f8c385b833</entry>
Nov 15 09:47:13 user nova-compute[75122]:       <entry name="uuid">bc80e3fb-b5a3-4685-8ec5-12f8c385b833</entry>
Nov 15 09:47:13 user nova-compute[75122]:       <entry name="family">Virtual Machine</entry>
Nov 15 09:47:13 user nova-compute[75122]:     </system>
Nov 15 09:47:13 user nova-compute[75122]:   </sysinfo>
Nov 15 09:47:13 user nova-compute[75122]:   <os>
Nov 15 09:47:13 user nova-compute[75122]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 09:47:13 user nova-compute[75122]:     <boot dev="hd"/>
Nov 15 09:47:13 user nova-compute[75122]:     <smbios mode="sysinfo"/>
Nov 15 09:47:13 user nova-compute[75122]:   </os>
Nov 15 09:47:13 user nova-compute[75122]:   <features>
Nov 15 09:47:13 user nova-compute[75122]:     <acpi/>
Nov 15 09:47:13 user nova-compute[75122]:     <apic/>
Nov 15 09:47:13 user nova-compute[75122]:     <vmcoreinfo/>
Nov 15 09:47:13 user nova-compute[75122]:   </features>
Nov 15 09:47:13 user nova-compute[75122]:   <clock offset="utc">
Nov 15 09:47:13 user nova-compute[75122]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 09:47:13 user nova-compute[75122]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 09:47:13 user nova-compute[75122]:     <timer name="hpet" present="no"/>
Nov 15 09:47:13 user nova-compute[75122]:   </clock>
Nov 15 09:47:13 user nova-compute[75122]:   <cpu mode="custom" match="exact">
Nov 15 09:47:13 user nova-compute[75122]:     <model>Nehalem</model>
Nov 15 09:47:13 user nova-compute[75122]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 09:47:13 user nova-compute[75122]:   </cpu>
Nov 15 09:47:13 user nova-compute[75122]:   <devices>
Nov 15 09:47:13 user nova-compute[75122]:     <disk type="file" device="disk">
Nov 15 09:47:13 user nova-compute[75122]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 09:47:13 user nova-compute[75122]:       <source file="/opt/stack/data/nova/instances/bc80e3fb-b5a3-4685-8ec5-12f8c385b833/disk"/>
Nov 15 09:47:13 user nova-compute[75122]:       <target dev="vda" bus="virtio"/>
Nov 15 09:47:13 user nova-compute[75122]:     </disk>
Nov 15 09:47:13 user nova-compute[75122]:     <disk type="block" device="disk">
Nov 15 09:47:13 user nova-compute[75122]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 09:47:13 user nova-compute[75122]:       <source dev="/dev/sdd"/>
Nov 15 09:47:13 user nova-compute[75122]:       <target dev="vdc" bus="virtio"/>
Nov 15 09:47:13 user nova-compute[75122]:       <serial>6cd246c1-08d6-43ce-b2b5-2a6c42e46135</serial>
Nov 15 09:47:13 user nova-compute[75122]:     </disk>
Nov 15 09:47:13 user nova-compute[75122]:     <interface type="ethernet">
Nov 15 09:47:13 user nova-compute[75122]:       <mac address="fa:16:3e:8c:f1:36"/>
Nov 15 09:47:13 user nova-compute[75122]:       <model type="virtio"/>
Nov 15 09:47:13 user nova-compute[75122]:       <mtu size="1442"/>
Nov 15 09:47:13 user nova-compute[75122]:       <target dev="tapa4776ec9-b5"/>
Nov 15 09:47:13 user nova-compute[75122]:     </interface>
Nov 15 09:47:13 user nova-compute[75122]:     <serial type="pty">
Nov 15 09:47:13 user nova-compute[75122]:       <log file="/opt/stack/data/nova/instances/bc80e3fb-b5a3-4685-8ec5-12f8c385b833/console.log" append="off"/>
Nov 15 09:47:13 user nova-compute[75122]:     </serial>
Nov 15 09:47:13 user nova-compute[75122]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 09:47:13 user nova-compute[75122]:     <video>
Nov 15 09:47:13 user nova-compute[75122]:       <model type="virtio"/>
Nov 15 09:47:13 user nova-compute[75122]:     </video>
Nov 15 09:47:13 user nova-compute[75122]:     <rng model="virtio">
Nov 15 09:47:13 user nova-compute[75122]:       <backend model="random">/dev/urandom</backend>
Nov 15 09:47:13 user nova-compute[75122]:     </rng>
Nov 15 09:47:13 user nova-compute[75122]:     <controller type="usb" index="0" model="none"/>
Nov 15 09:47:13 user nova-compute[75122]:     <memballoon model="virtio">
Nov 15 09:47:13 user nova-compute[75122]:       <stats period="10"/>
Nov 15 09:47:13 user nova-compute[75122]:     </memballoon>
Nov 15 09:47:13 user nova-compute[75122]:   </devices>
Nov 15 09:47:13 user nova-compute[75122]: </domain>
Nov 15 09:47:13 user nova-compute[75122]:  {{(pid=75122) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 09:47:13 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-17ab83f2-a973-4cca-b0b7-f4fb235647d3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-15T09:43:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-163449221',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-163449221',id=29,image_ref='6aff3e94-be37-4c75-ab89-92e2c713f30e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-785756428',keypairs=<?>,launch_index=0,launched_at=2023-11-15T09:43:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='535c751b9e76421c9262e48fbab3fb6f',ramdisk_id='',reservation_id='r-s195psec',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1659813957',owner_user_name='tempest-AttachVolumeShelveTestJSON-1659813957-project-member',shelved_at='2023-11-15T09:45:10.578990',shelved_host='user',shelved_image_id='6aff3e94-be37-4c75-ab89-92e2c713f30e'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T09:46:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad06186836ed40a49a05ef7cc9afd1bc',uuid=bc80e3fb-b5a3-4685-8ec5-12f8c385b833,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "a4776ec9-b51c-45f4-8e4c-8cbc3d9e8a59", "address": "fa:16:3e:8c:f1:36", "network": {"id": "7ab99c1b-e670-416e-b5fe-e1337db6b28d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-487518933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "535c751b9e76421c9262e48fbab3fb6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4776ec9-b5", "ovs_interfaceid": "a4776ec9-b51c-45f4-8e4c-8cbc3d9e8a59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 09:47:13 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-17ab83f2-a973-4cca-b0b7-f4fb235647d3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Converting VIF {"id": "a4776ec9-b51c-45f4-8e4c-8cbc3d9e8a59", "address": "fa:16:3e:8c:f1:36", "network": {"id": "7ab99c1b-e670-416e-b5fe-e1337db6b28d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-487518933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "535c751b9e76421c9262e48fbab3fb6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4776ec9-b5", "ovs_interfaceid": "a4776ec9-b51c-45f4-8e4c-8cbc3d9e8a59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 09:47:13 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-17ab83f2-a973-4cca-b0b7-f4fb235647d3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:f1:36,bridge_name='br-int',has_traffic_filtering=True,id=a4776ec9-b51c-45f4-8e4c-8cbc3d9e8a59,network=Network(7ab99c1b-e670-416e-b5fe-e1337db6b28d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4776ec9-b5') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 09:47:13 user nova-compute[75122]: DEBUG os_vif [None req-17ab83f2-a973-4cca-b0b7-f4fb235647d3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:f1:36,bridge_name='br-int',has_traffic_filtering=True,id=a4776ec9-b51c-45f4-8e4c-8cbc3d9e8a59,network=Network(7ab99c1b-e670-416e-b5fe-e1337db6b28d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4776ec9-b5') {{(pid=75122) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 09:47:13 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:47:13 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:47:13 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 09:47:13 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:47:13 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8560e877-fdd6-5ae9-82ec-68f448ef54ff', '_type': 'linux-noop'}}, row=False) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:47:13 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:47:13 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:47:13 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:47:13 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa4776ec9-b5, may_exist=True, interface_attrs={}) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:47:13 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa4776ec9-b5, col_values=(('qos', UUID('4c08650b-53e1-4df5-8b6f-cf703ebff221')),), if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:47:13 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa4776ec9-b5, col_values=(('external_ids', {'iface-id': 'a4776ec9-b51c-45f4-8e4c-8cbc3d9e8a59', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8c:f1:36', 'vm-uuid': 'bc80e3fb-b5a3-4685-8ec5-12f8c385b833'}),), if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:47:13 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:47:13 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:47:13 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:47:13 user nova-compute[75122]: INFO os_vif [None req-17ab83f2-a973-4cca-b0b7-f4fb235647d3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:f1:36,bridge_name='br-int',has_traffic_filtering=True,id=a4776ec9-b51c-45f4-8e4c-8cbc3d9e8a59,network=Network(7ab99c1b-e670-416e-b5fe-e1337db6b28d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4776ec9-b5')
Nov 15 09:47:13 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-17ab83f2-a973-4cca-b0b7-f4fb235647d3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] No BDM found with device name vda, not building metadata. {{(pid=75122) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 09:47:13 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-17ab83f2-a973-4cca-b0b7-f4fb235647d3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75122) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 09:47:13 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-17ab83f2-a973-4cca-b0b7-f4fb235647d3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] No VIF found with MAC fa:16:3e:8c:f1:36, not building metadata {{(pid=75122) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 09:47:14 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:47:14 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:47:14 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:47:14 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:47:14 user nova-compute[75122]: DEBUG nova.compute.manager [req-e8d31a2e-d0f0-49dd-bde8-63c8f9e20755 req-1d1a411d-20ff-4f63-968b-26de3ea4ee4d service nova] [instance: bc80e3fb-b5a3-4685-8ec5-12f8c385b833] Received event network-vif-plugged-a4776ec9-b51c-45f4-8e4c-8cbc3d9e8a59 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:47:14 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-e8d31a2e-d0f0-49dd-bde8-63c8f9e20755 req-1d1a411d-20ff-4f63-968b-26de3ea4ee4d service nova] Acquiring lock "bc80e3fb-b5a3-4685-8ec5-12f8c385b833-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:47:14 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-e8d31a2e-d0f0-49dd-bde8-63c8f9e20755 req-1d1a411d-20ff-4f63-968b-26de3ea4ee4d service nova] Lock "bc80e3fb-b5a3-4685-8ec5-12f8c385b833-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:47:14 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-e8d31a2e-d0f0-49dd-bde8-63c8f9e20755 req-1d1a411d-20ff-4f63-968b-26de3ea4ee4d service nova] Lock "bc80e3fb-b5a3-4685-8ec5-12f8c385b833-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:47:14 user nova-compute[75122]: DEBUG nova.compute.manager [req-e8d31a2e-d0f0-49dd-bde8-63c8f9e20755 req-1d1a411d-20ff-4f63-968b-26de3ea4ee4d service nova] [instance: bc80e3fb-b5a3-4685-8ec5-12f8c385b833] No waiting events found dispatching network-vif-plugged-a4776ec9-b51c-45f4-8e4c-8cbc3d9e8a59 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:47:14 user nova-compute[75122]: WARNING nova.compute.manager [req-e8d31a2e-d0f0-49dd-bde8-63c8f9e20755 req-1d1a411d-20ff-4f63-968b-26de3ea4ee4d service nova] [instance: bc80e3fb-b5a3-4685-8ec5-12f8c385b833] Received unexpected event network-vif-plugged-a4776ec9-b51c-45f4-8e4c-8cbc3d9e8a59 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 15 09:47:15 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:47:15 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:47:15 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:47:15 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:47:15 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:47:16 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-6cade813-3495-4c5f-b30d-4c5e961da98c tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Acquiring lock "49154de0-f941-4ae0-a7af-72e75a4d8040" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:47:16 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-6cade813-3495-4c5f-b30d-4c5e961da98c tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Lock "49154de0-f941-4ae0-a7af-72e75a4d8040" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:47:16 user nova-compute[75122]: DEBUG nova.objects.instance [None req-6cade813-3495-4c5f-b30d-4c5e961da98c tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Lazy-loading 'flavor' on Instance uuid 49154de0-f941-4ae0-a7af-72e75a4d8040 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:47:16 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-6cade813-3495-4c5f-b30d-4c5e961da98c tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Lock "49154de0-f941-4ae0-a7af-72e75a4d8040" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.048s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:47:16 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:47:16 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-6cade813-3495-4c5f-b30d-4c5e961da98c tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Acquiring lock "49154de0-f941-4ae0-a7af-72e75a4d8040" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:47:16 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-6cade813-3495-4c5f-b30d-4c5e961da98c tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Lock "49154de0-f941-4ae0-a7af-72e75a4d8040" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:47:16 user nova-compute[75122]: INFO nova.compute.manager [None req-6cade813-3495-4c5f-b30d-4c5e961da98c tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] [instance: 49154de0-f941-4ae0-a7af-72e75a4d8040] Attaching volume a240e1dd-c999-4796-8c31-131e7fc84e56 to /dev/vdb
Nov 15 09:47:16 user nova-compute[75122]: DEBUG os_brick.utils [None req-6cade813-3495-4c5f-b30d-4c5e961da98c tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 09:47:16 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:47:16 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:47:16 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[8265085b-03e2-491a-a210-07782aa537aa]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:742fb64b3587\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:47:16 user nova-compute[75122]: DEBUG nova.compute.manager [req-67ca1dc7-3f71-4558-bc89-d4e586618995 req-11035a50-c5f5-4686-b9e4-cb02dd9fdd1a service nova] [instance: bc80e3fb-b5a3-4685-8ec5-12f8c385b833] Received event network-vif-plugged-a4776ec9-b51c-45f4-8e4c-8cbc3d9e8a59 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:47:16 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-67ca1dc7-3f71-4558-bc89-d4e586618995 req-11035a50-c5f5-4686-b9e4-cb02dd9fdd1a service nova] Acquiring lock "bc80e3fb-b5a3-4685-8ec5-12f8c385b833-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:47:16 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-67ca1dc7-3f71-4558-bc89-d4e586618995 req-11035a50-c5f5-4686-b9e4-cb02dd9fdd1a service nova] Lock "bc80e3fb-b5a3-4685-8ec5-12f8c385b833-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:47:16 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-67ca1dc7-3f71-4558-bc89-d4e586618995 req-11035a50-c5f5-4686-b9e4-cb02dd9fdd1a service nova] Lock "bc80e3fb-b5a3-4685-8ec5-12f8c385b833-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:47:16 user nova-compute[75122]: DEBUG nova.compute.manager [req-67ca1dc7-3f71-4558-bc89-d4e586618995 req-11035a50-c5f5-4686-b9e4-cb02dd9fdd1a service nova] [instance: bc80e3fb-b5a3-4685-8ec5-12f8c385b833] No waiting events found dispatching network-vif-plugged-a4776ec9-b51c-45f4-8e4c-8cbc3d9e8a59 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:47:16 user nova-compute[75122]: WARNING nova.compute.manager [req-67ca1dc7-3f71-4558-bc89-d4e586618995 req-11035a50-c5f5-4686-b9e4-cb02dd9fdd1a service nova] [instance: bc80e3fb-b5a3-4685-8ec5-12f8c385b833] Received unexpected event network-vif-plugged-a4776ec9-b51c-45f4-8e4c-8cbc3d9e8a59 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 15 09:47:16 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:47:16 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:47:16 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ca1410f-a41d-4467-876b-e53c271aaf94]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:47:16 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:47:16 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:47:16 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[933a55c2-6429-44ed-96cb-83a54e0fd295]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:47:16 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[67789f4d-0b28-44a8-bff3-0d9826cb74d1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:47:16 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-6cade813-3495-4c5f-b30d-4c5e961da98c tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Running cmd (subprocess): nvme version {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:47:16 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-6cade813-3495-4c5f-b30d-4c5e961da98c tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] 'nvme version' failed. Not Retrying. {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 09:47:16 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6cade813-3495-4c5f-b30d-4c5e961da98c tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] nvme not present on system {{(pid=75122) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 09:47:16 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:47:16 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 09:47:16 user nova-compute[75122]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 09:47:16 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[13d8f2c9-7e6e-4cb1-abdc-5a30de7cb56f]: (4, '') {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:47:16 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.lightos [None req-6cade813-3495-4c5f-b30d-4c5e961da98c tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75122) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 09:47:16 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.lightos [None req-6cade813-3495-4c5f-b30d-4c5e961da98c tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75122) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 09:47:16 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.lightos [None req-6cade813-3495-4c5f-b30d-4c5e961da98c tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] LIGHTOS: no hostnqn found. {{(pid=75122) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 09:47:16 user nova-compute[75122]: DEBUG os_brick.utils [None req-6cade813-3495-4c5f-b30d-4c5e961da98c tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:742fb64b3587', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 09:47:16 user nova-compute[75122]: DEBUG nova.virt.block_device [None req-6cade813-3495-4c5f-b30d-4c5e961da98c tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] [instance: 49154de0-f941-4ae0-a7af-72e75a4d8040] Updating existing volume attachment record: 1701f1be-1492-407d-a801-edd802b7df43 {{(pid=75122) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 09:47:17 user nova-compute[75122]: DEBUG nova.compute.manager [None req-17ab83f2-a973-4cca-b0b7-f4fb235647d3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] [instance: bc80e3fb-b5a3-4685-8ec5-12f8c385b833] Instance event wait completed in 0 seconds for  {{(pid=75122) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 09:47:17 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-17ab83f2-a973-4cca-b0b7-f4fb235647d3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] [instance: bc80e3fb-b5a3-4685-8ec5-12f8c385b833] Guest created on hypervisor {{(pid=75122) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 09:47:17 user nova-compute[75122]: INFO nova.virt.libvirt.driver [-] [instance: bc80e3fb-b5a3-4685-8ec5-12f8c385b833] Instance spawned successfully.
Nov 15 09:47:17 user nova-compute[75122]: DEBUG nova.compute.manager [None req-17ab83f2-a973-4cca-b0b7-f4fb235647d3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] [instance: bc80e3fb-b5a3-4685-8ec5-12f8c385b833] Checking state {{(pid=75122) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 09:47:17 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-17ab83f2-a973-4cca-b0b7-f4fb235647d3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Lock "bc80e3fb-b5a3-4685-8ec5-12f8c385b833" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 18.766s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:47:18 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:47:21 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:47:21 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6cade813-3495-4c5f-b30d-4c5e961da98c tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] [instance: 49154de0-f941-4ae0-a7af-72e75a4d8040] Calling os-brick to attach iSCSI Volume {{(pid=75122) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 09:47:21 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cade813-3495-4c5f-b30d-4c5e961da98c tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffa04060b80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a240e1dd-c999-4796-8c31-131e7fc84e56', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SDCsaOjk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 09:47:21 user nova-compute[75122]: WARNING os_brick.initiator.connectors.base [None req-6cade813-3495-4c5f-b30d-4c5e961da98c tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 09:47:21 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-6cade813-3495-4c5f-b30d-4c5e961da98c tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 09:47:21 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-6cade813-3495-4c5f-b30d-4c5e961da98c tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 09:47:21 user nova-compute[75122]: WARNING os_brick.initiator.connectors.base [None req-6cade813-3495-4c5f-b30d-4c5e961da98c tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 09:47:21 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-6cade813-3495-4c5f-b30d-4c5e961da98c tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a240e1dd-c999-4796-8c31-131e7fc84e56" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 09:47:21 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-6cade813-3495-4c5f-b30d-4c5e961da98c tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a240e1dd-c999-4796-8c31-131e7fc84e56" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 09:47:21 user nova-compute[75122]: INFO os_brick.initiator.connectors.iscsi [None req-6cade813-3495-4c5f-b30d-4c5e961da98c tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 09:47:21 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a240e1dd-c999-4796-8c31-131e7fc84e56 -p 172.16.0.220:3260 {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:47:21 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a240e1dd-c999-4796-8c31-131e7fc84e56 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:47:21 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0f844b7-bdb2-41b8-bccc-1fa1e0bf13ac]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:47:21 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cade813-3495-4c5f-b30d-4c5e961da98c tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 09:47:21 user nova-compute[75122]:  {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:47:21 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a240e1dd-c999-4796-8c31-131e7fc84e56 -p 172.16.0.220:3260 --interface default --op new {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:47:21 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a240e1dd-c999-4796-8c31-131e7fc84e56 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:47:21 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8907033-5df8-4286-a13f-393e8ea503b6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a240e1dd-c999-4796-8c31-131e7fc84e56] added\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:47:21 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cade813-3495-4c5f-b30d-4c5e961da98c tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a240e1dd-c999-4796-8c31-131e7fc84e56] added
Nov 15 09:47:21 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:47:21 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a240e1dd-c999-4796-8c31-131e7fc84e56 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:47:21 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a240e1dd-c999-4796-8c31-131e7fc84e56 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:47:21 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[11e01309-781f-4bda-98ec-4d434d90331a]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:47:21 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cade813-3495-4c5f-b30d-4c5e961da98c tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:47:21 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a240e1dd-c999-4796-8c31-131e7fc84e56 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:47:21 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a240e1dd-c999-4796-8c31-131e7fc84e56 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:47:21 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca989e3e-c4aa-4a8b-8ccf-575418ddaa94]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:47:21 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cade813-3495-4c5f-b30d-4c5e961da98c tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:47:21 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a240e1dd-c999-4796-8c31-131e7fc84e56 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SDCsaOjk {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:47:21 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a240e1dd-c999-4796-8c31-131e7fc84e56 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SDCsaOjk" returned: 0 in 0.019s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:47:21 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[536c451b-b3d2-44e6-8f77-777445227c53]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:47:21 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cade813-3495-4c5f-b30d-4c5e961da98c tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SDCsaOjk'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:47:21 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a240e1dd-c999-4796-8c31-131e7fc84e56 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:47:21 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a240e1dd-c999-4796-8c31-131e7fc84e56 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:47:21 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfbf8632-1c33-4d6d-8889-1457d24dac26]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:47:21 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cade813-3495-4c5f-b30d-4c5e961da98c tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:47:21 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:47:21 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:47:21 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4be7364-dfc8-4e42-af79-cdd0ce996265]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6224c0df-13b0-4ff7-928f-9a2282386a2a (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cd246c1-08d6-43ce-b2b5-2a6c42e46135 (non-flash)\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:47:21 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cade813-3495-4c5f-b30d-4c5e961da98c tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17 (non-flash)
Nov 15 09:47:21 user nova-compute[75122]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6224c0df-13b0-4ff7-928f-9a2282386a2a (non-flash)
Nov 15 09:47:21 user nova-compute[75122]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cd246c1-08d6-43ce-b2b5-2a6c42e46135 (non-flash)
Nov 15 09:47:21 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 09:47:21 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cade813-3495-4c5f-b30d-4c5e961da98c tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17 (non-flash)
Nov 15 09:47:21 user nova-compute[75122]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6224c0df-13b0-4ff7-928f-9a2282386a2a (non-flash)
Nov 15 09:47:21 user nova-compute[75122]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cd246c1-08d6-43ce-b2b5-2a6c42e46135 (non-flash)
Nov 15 09:47:21 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 09:47:21 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a240e1dd-c999-4796-8c31-131e7fc84e56 -p 172.16.0.220:3260 --login {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:47:21 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a240e1dd-c999-4796-8c31-131e7fc84e56 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:47:21 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[901a41fe-78c6-4745-aa6c-a55fda6f7f11]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a240e1dd-c999-4796-8c31-131e7fc84e56, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a240e1dd-c999-4796-8c31-131e7fc84e56, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:47:21 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cade813-3495-4c5f-b30d-4c5e961da98c tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a240e1dd-c999-4796-8c31-131e7fc84e56, portal: 172.16.0.220,3260]
Nov 15 09:47:21 user nova-compute[75122]: Login to [iface: default, target: iqn.2010-10.org.openstack:a240e1dd-c999-4796-8c31-131e7fc84e56, portal: 172.16.0.220,3260] successful.
Nov 15 09:47:21 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:47:21 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a240e1dd-c999-4796-8c31-131e7fc84e56 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:47:21 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a240e1dd-c999-4796-8c31-131e7fc84e56 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:47:21 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b4b0033-269a-49f9-a093-64059f5dd158]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:47:21 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cade813-3495-4c5f-b30d-4c5e961da98c tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:47:21 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:47:21 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:47:21 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[399f24d5-505c-44a6-819b-9f4958461608]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6224c0df-13b0-4ff7-928f-9a2282386a2a (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cd246c1-08d6-43ce-b2b5-2a6c42e46135 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a240e1dd-c999-4796-8c31-131e7fc84e56 (non-flash)\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:47:21 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cade813-3495-4c5f-b30d-4c5e961da98c tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17 (non-flash)
Nov 15 09:47:21 user nova-compute[75122]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6224c0df-13b0-4ff7-928f-9a2282386a2a (non-flash)
Nov 15 09:47:21 user nova-compute[75122]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cd246c1-08d6-43ce-b2b5-2a6c42e46135 (non-flash)
Nov 15 09:47:21 user nova-compute[75122]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a240e1dd-c999-4796-8c31-131e7fc84e56 (non-flash)
Nov 15 09:47:21 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 09:47:21 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cade813-3495-4c5f-b30d-4c5e961da98c tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17 (non-flash)
Nov 15 09:47:21 user nova-compute[75122]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6224c0df-13b0-4ff7-928f-9a2282386a2a (non-flash)
Nov 15 09:47:21 user nova-compute[75122]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cd246c1-08d6-43ce-b2b5-2a6c42e46135 (non-flash)
Nov 15 09:47:21 user nova-compute[75122]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a240e1dd-c999-4796-8c31-131e7fc84e56 (non-flash)
Nov 15 09:47:21 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 09:47:21 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-6cade813-3495-4c5f-b30d-4c5e961da98c tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a240e1dd-c999-4796-8c31-131e7fc84e56" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.267s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 09:47:21 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cade813-3495-4c5f-b30d-4c5e961da98c tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Connected to 172.16.0.220:3260 {{(pid=75122) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 09:47:21 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-6cade813-3495-4c5f-b30d-4c5e961da98c tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] HCTL ('36', '-', '-', 0) found on session 43 with lun 0 {{(pid=75122) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 09:47:21 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-6cade813-3495-4c5f-b30d-4c5e961da98c tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75122) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 09:47:21 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:47:21 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.015s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:47:21 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[2197ec98-3fa4-45af-9a82-d83becab002a]: (4, ('- - 0', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:47:21 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-6cade813-3495-4c5f-b30d-4c5e961da98c tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Searching for a device in session 43 and hctl ['36', '*', '*', 0] yield: None {{(pid=75122) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 09:47:22 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-6cade813-3495-4c5f-b30d-4c5e961da98c tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Searching for a device in session 43 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75122) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 09:47:22 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cade813-3495-4c5f-b30d-4c5e961da98c tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:a240e1dd-c999-4796-8c31-131e7fc84e56', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SDCsaOjk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75122) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 09:47:22 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-6cade813-3495-4c5f-b30d-4c5e961da98c tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.295s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 09:47:22 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cade813-3495-4c5f-b30d-4c5e961da98c tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] <== connect_volume: return (1296ms) {'type': 'block', 'scsi_wwn': '26632623465656438', 'path': '/dev/sde'} {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 09:47:22 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6cade813-3495-4c5f-b30d-4c5e961da98c tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] [instance: 49154de0-f941-4ae0-a7af-72e75a4d8040] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26632623465656438', 'path': '/dev/sde'} {{(pid=75122) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 09:47:22 user nova-compute[75122]: DEBUG nova.objects.instance [None req-6cade813-3495-4c5f-b30d-4c5e961da98c tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Lazy-loading 'flavor' on Instance uuid 49154de0-f941-4ae0-a7af-72e75a4d8040 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:47:22 user nova-compute[75122]: DEBUG nova.virt.libvirt.guest [None req-6cade813-3495-4c5f-b30d-4c5e961da98c tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 09:47:22 user nova-compute[75122]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 09:47:22 user nova-compute[75122]:   <source dev="/dev/sde"/>
Nov 15 09:47:22 user nova-compute[75122]:   <target dev="vdb" bus="virtio"/>
Nov 15 09:47:22 user nova-compute[75122]:   <serial>a240e1dd-c999-4796-8c31-131e7fc84e56</serial>
Nov 15 09:47:22 user nova-compute[75122]: </disk>
Nov 15 09:47:22 user nova-compute[75122]:  {{(pid=75122) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 09:47:23 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:47:23 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:47:23 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Starting heal instance info cache {{(pid=75122) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 09:47:23 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-6cade813-3495-4c5f-b30d-4c5e961da98c tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] No BDM found with device name vda, not building metadata. {{(pid=75122) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 09:47:23 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-6cade813-3495-4c5f-b30d-4c5e961da98c tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75122) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 09:47:23 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-6cade813-3495-4c5f-b30d-4c5e961da98c tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] No VIF found with MAC fa:16:3e:9a:6e:b1, not building metadata {{(pid=75122) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 09:47:23 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "refresh_cache-fd9d52bb-6248-48e6-a798-6dbdaaa68cbc" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 09:47:23 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquired lock "refresh_cache-fd9d52bb-6248-48e6-a798-6dbdaaa68cbc" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 09:47:23 user nova-compute[75122]: DEBUG nova.network.neutron [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] [instance: fd9d52bb-6248-48e6-a798-6dbdaaa68cbc] Forcefully refreshing network info cache for instance {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 09:47:23 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-6cade813-3495-4c5f-b30d-4c5e961da98c tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Lock "49154de0-f941-4ae0-a7af-72e75a4d8040" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.743s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:47:23 user nova-compute[75122]: DEBUG nova.network.neutron [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] [instance: fd9d52bb-6248-48e6-a798-6dbdaaa68cbc] Updating instance_info_cache with network_info: [{"id": "f6892701-aba2-4c9a-88bd-996d00963301", "address": "fa:16:3e:a5:6f:a0", "network": {"id": "c2062f64-d925-42d2-9687-5d2511ef6697", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1134087048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eeff24cb28f5481fa3941ba399ce82ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6892701-ab", "ovs_interfaceid": "f6892701-aba2-4c9a-88bd-996d00963301", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:47:23 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Releasing lock "refresh_cache-fd9d52bb-6248-48e6-a798-6dbdaaa68cbc" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 09:47:23 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] [instance: fd9d52bb-6248-48e6-a798-6dbdaaa68cbc] Updated the network info_cache for instance {{(pid=75122) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 09:47:23 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:47:25 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:47:25 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:47:25 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:47:25 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:47:25 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75122) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 09:47:25 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-a5c6300e-5797-49fe-8e79-6151b410cc15 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Acquiring lock "49154de0-f941-4ae0-a7af-72e75a4d8040" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:47:25 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-a5c6300e-5797-49fe-8e79-6151b410cc15 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Lock "49154de0-f941-4ae0-a7af-72e75a4d8040" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:47:25 user nova-compute[75122]: INFO nova.compute.manager [None req-a5c6300e-5797-49fe-8e79-6151b410cc15 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] [instance: 49154de0-f941-4ae0-a7af-72e75a4d8040] Detaching volume a240e1dd-c999-4796-8c31-131e7fc84e56
Nov 15 09:47:25 user nova-compute[75122]: INFO nova.virt.block_device [None req-a5c6300e-5797-49fe-8e79-6151b410cc15 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] [instance: 49154de0-f941-4ae0-a7af-72e75a4d8040] Attempting to driver detach volume a240e1dd-c999-4796-8c31-131e7fc84e56 from mountpoint /dev/vdb
Nov 15 09:47:25 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-a5c6300e-5797-49fe-8e79-6151b410cc15 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Attempting to detach device vdb from instance 49154de0-f941-4ae0-a7af-72e75a4d8040 from the persistent domain config. {{(pid=75122) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 09:47:25 user nova-compute[75122]: DEBUG nova.virt.libvirt.guest [None req-a5c6300e-5797-49fe-8e79-6151b410cc15 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 09:47:25 user nova-compute[75122]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 09:47:25 user nova-compute[75122]:   <source dev="/dev/sde"/>
Nov 15 09:47:25 user nova-compute[75122]:   <target dev="vdb" bus="virtio"/>
Nov 15 09:47:25 user nova-compute[75122]:   <serial>a240e1dd-c999-4796-8c31-131e7fc84e56</serial>
Nov 15 09:47:25 user nova-compute[75122]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 09:47:25 user nova-compute[75122]: </disk>
Nov 15 09:47:25 user nova-compute[75122]:  {{(pid=75122) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 09:47:25 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-a5c6300e-5797-49fe-8e79-6151b410cc15 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Successfully detached device vdb from instance 49154de0-f941-4ae0-a7af-72e75a4d8040 from the persistent domain config.
Nov 15 09:47:25 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-a5c6300e-5797-49fe-8e79-6151b410cc15 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 49154de0-f941-4ae0-a7af-72e75a4d8040 from the live domain config. {{(pid=75122) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 09:47:25 user nova-compute[75122]: DEBUG nova.virt.libvirt.guest [None req-a5c6300e-5797-49fe-8e79-6151b410cc15 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 09:47:25 user nova-compute[75122]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 09:47:25 user nova-compute[75122]:   <source dev="/dev/sde"/>
Nov 15 09:47:25 user nova-compute[75122]:   <target dev="vdb" bus="virtio"/>
Nov 15 09:47:25 user nova-compute[75122]:   <serial>a240e1dd-c999-4796-8c31-131e7fc84e56</serial>
Nov 15 09:47:25 user nova-compute[75122]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 09:47:25 user nova-compute[75122]: </disk>
Nov 15 09:47:25 user nova-compute[75122]:  {{(pid=75122) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 09:47:26 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:47:26 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:47:26 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:47:26 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:47:26 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:47:26 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75122) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 09:47:26 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:47:26 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-a5c6300e-5797-49fe-8e79-6151b410cc15 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 49154de0-f941-4ae0-a7af-72e75a4d8040 {{(pid=75122) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 09:47:26 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75122) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 09:47:26 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc80e3fb-b5a3-4685-8ec5-12f8c385b833/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:47:26 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc80e3fb-b5a3-4685-8ec5-12f8c385b833/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:47:26 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc80e3fb-b5a3-4685-8ec5-12f8c385b833/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:47:26 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc80e3fb-b5a3-4685-8ec5-12f8c385b833/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:47:26 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=75122) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 09:47:26 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd9d52bb-6248-48e6-a798-6dbdaaa68cbc/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:47:27 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd9d52bb-6248-48e6-a798-6dbdaaa68cbc/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:47:27 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd9d52bb-6248-48e6-a798-6dbdaaa68cbc/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:47:27 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd9d52bb-6248-48e6-a798-6dbdaaa68cbc/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:47:27 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49154de0-f941-4ae0-a7af-72e75a4d8040/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:47:27 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49154de0-f941-4ae0-a7af-72e75a4d8040/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:47:27 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49154de0-f941-4ae0-a7af-72e75a4d8040/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:47:27 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49154de0-f941-4ae0-a7af-72e75a4d8040/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:47:27 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/131142fd-e8ec-42d1-a518-aa21c7bb7cb1/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:47:27 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/131142fd-e8ec-42d1-a518-aa21c7bb7cb1/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:47:27 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/131142fd-e8ec-42d1-a518-aa21c7bb7cb1/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:47:27 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/131142fd-e8ec-42d1-a518-aa21c7bb7cb1/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:47:28 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8271a429-e252-42bb-8717-e89dfd9739bf/disk.rescue --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:47:28 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:47:28 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8271a429-e252-42bb-8717-e89dfd9739bf/disk.rescue --force-share --output=json" returned: 0 in 0.204s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:47:28 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8271a429-e252-42bb-8717-e89dfd9739bf/disk.rescue --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:47:28 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8271a429-e252-42bb-8717-e89dfd9739bf/disk.rescue --force-share --output=json" returned: 0 in 0.198s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:47:28 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] skipping disk /opt/stack/data/nova/instances/8271a429-e252-42bb-8717-e89dfd9739bf/disk (vdb) as it is a volume {{(pid=75122) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 09:47:28 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00270cc2-4f5b-4f64-8f88-31f21e3b3950/disk.rescue --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:47:28 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00270cc2-4f5b-4f64-8f88-31f21e3b3950/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:47:28 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00270cc2-4f5b-4f64-8f88-31f21e3b3950/disk.rescue --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:47:28 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00270cc2-4f5b-4f64-8f88-31f21e3b3950/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:47:28 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00270cc2-4f5b-4f64-8f88-31f21e3b3950/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:47:28 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00270cc2-4f5b-4f64-8f88-31f21e3b3950/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:47:28 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00270cc2-4f5b-4f64-8f88-31f21e3b3950/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:47:29 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00270cc2-4f5b-4f64-8f88-31f21e3b3950/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:47:29 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 09:47:29 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 09:47:29 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Hypervisor/Node resource view: name=user free_ram=8165MB free_disk=25.288436889648438GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75122) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 09:47:29 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:47:29 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:47:29 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance 131142fd-e8ec-42d1-a518-aa21c7bb7cb1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:47:29 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance fd9d52bb-6248-48e6-a798-6dbdaaa68cbc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:47:29 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance 00270cc2-4f5b-4f64-8f88-31f21e3b3950 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:47:29 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance cc485c6c-5a9a-4c94-b966-68dd9e336e56 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:47:29 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance 8271a429-e252-42bb-8717-e89dfd9739bf actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:47:29 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance 49154de0-f941-4ae0-a7af-72e75a4d8040 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:47:29 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance bc80e3fb-b5a3-4685-8ec5-12f8c385b833 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:47:29 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75122) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 09:47:29 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75122) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 09:47:29 user nova-compute[75122]: DEBUG nova.compute.provider_tree [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Inventory has not changed in ProviderTree for provider: 69a3da65-47be-44c6-b67c-c692b58284ef {{(pid=75122) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 09:47:29 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Inventory has not changed for provider 69a3da65-47be-44c6-b67c-c692b58284ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 09:47:29 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Compute_service record updated for user:user {{(pid=75122) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 09:47:29 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.363s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:47:31 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:47:33 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:47:35 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:47:36 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:47:37 user nova-compute[75122]: INFO nova.compute.manager [None req-d126480e-b017-4b79-b261-e309fd875afb tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] [instance: 8271a429-e252-42bb-8717-e89dfd9739bf] Unrescuing
Nov 15 09:47:37 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-d126480e-b017-4b79-b261-e309fd875afb tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Acquiring lock "refresh_cache-8271a429-e252-42bb-8717-e89dfd9739bf" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 09:47:37 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-d126480e-b017-4b79-b261-e309fd875afb tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Acquired lock "refresh_cache-8271a429-e252-42bb-8717-e89dfd9739bf" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 09:47:37 user nova-compute[75122]: DEBUG nova.network.neutron [None req-d126480e-b017-4b79-b261-e309fd875afb tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] [instance: 8271a429-e252-42bb-8717-e89dfd9739bf] Building network info cache for instance {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 09:47:37 user nova-compute[75122]: DEBUG nova.network.neutron [None req-d126480e-b017-4b79-b261-e309fd875afb tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] [instance: 8271a429-e252-42bb-8717-e89dfd9739bf] Updating instance_info_cache with network_info: [{"id": "044ffaae-8351-4c7f-9b12-32ac7d4b3565", "address": "fa:16:3e:e3:9d:f8", "network": {"id": "c2062f64-d925-42d2-9687-5d2511ef6697", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1134087048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eeff24cb28f5481fa3941ba399ce82ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap044ffaae-83", "ovs_interfaceid": "044ffaae-8351-4c7f-9b12-32ac7d4b3565", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:47:37 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-d126480e-b017-4b79-b261-e309fd875afb tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Releasing lock "refresh_cache-8271a429-e252-42bb-8717-e89dfd9739bf" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 09:47:37 user nova-compute[75122]: DEBUG nova.objects.instance [None req-d126480e-b017-4b79-b261-e309fd875afb tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Lazy-loading 'flavor' on Instance uuid 8271a429-e252-42bb-8717-e89dfd9739bf {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:47:37 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:47:37 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:47:37 user nova-compute[75122]: DEBUG nova.compute.manager [req-ada9916e-ad0d-499e-9125-a881d8ba8842 req-59cb29e3-873c-4b28-af80-d43fb9944ceb service nova] [instance: 8271a429-e252-42bb-8717-e89dfd9739bf] Received event network-vif-unplugged-044ffaae-8351-4c7f-9b12-32ac7d4b3565 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:47:37 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-ada9916e-ad0d-499e-9125-a881d8ba8842 req-59cb29e3-873c-4b28-af80-d43fb9944ceb service nova] Acquiring lock "8271a429-e252-42bb-8717-e89dfd9739bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:47:37 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-ada9916e-ad0d-499e-9125-a881d8ba8842 req-59cb29e3-873c-4b28-af80-d43fb9944ceb service nova] Lock "8271a429-e252-42bb-8717-e89dfd9739bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:47:37 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-ada9916e-ad0d-499e-9125-a881d8ba8842 req-59cb29e3-873c-4b28-af80-d43fb9944ceb service nova] Lock "8271a429-e252-42bb-8717-e89dfd9739bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:47:37 user nova-compute[75122]: DEBUG nova.compute.manager [req-ada9916e-ad0d-499e-9125-a881d8ba8842 req-59cb29e3-873c-4b28-af80-d43fb9944ceb service nova] [instance: 8271a429-e252-42bb-8717-e89dfd9739bf] No waiting events found dispatching network-vif-unplugged-044ffaae-8351-4c7f-9b12-32ac7d4b3565 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:47:37 user nova-compute[75122]: WARNING nova.compute.manager [req-ada9916e-ad0d-499e-9125-a881d8ba8842 req-59cb29e3-873c-4b28-af80-d43fb9944ceb service nova] [instance: 8271a429-e252-42bb-8717-e89dfd9739bf] Received unexpected event network-vif-unplugged-044ffaae-8351-4c7f-9b12-32ac7d4b3565 for instance with vm_state rescued and task_state unrescuing.
Nov 15 09:47:37 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:47:37 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:47:38 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:47:38 user nova-compute[75122]: INFO nova.virt.libvirt.driver [-] [instance: 8271a429-e252-42bb-8717-e89dfd9739bf] Instance destroyed successfully.
Nov 15 09:47:39 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:47:39 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:47:39 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:47:39 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:47:39 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:47:39 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:47:39 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:47:39 user nova-compute[75122]: DEBUG nova.compute.manager [req-dab5739d-f40a-4f45-9740-0192d2cdf2ac req-b677cf35-385f-4fc5-a153-4703ea30bfce service nova] [instance: 8271a429-e252-42bb-8717-e89dfd9739bf] Received event network-vif-plugged-044ffaae-8351-4c7f-9b12-32ac7d4b3565 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:47:39 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-dab5739d-f40a-4f45-9740-0192d2cdf2ac req-b677cf35-385f-4fc5-a153-4703ea30bfce service nova] Acquiring lock "8271a429-e252-42bb-8717-e89dfd9739bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:47:39 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-dab5739d-f40a-4f45-9740-0192d2cdf2ac req-b677cf35-385f-4fc5-a153-4703ea30bfce service nova] Lock "8271a429-e252-42bb-8717-e89dfd9739bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:47:39 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-dab5739d-f40a-4f45-9740-0192d2cdf2ac req-b677cf35-385f-4fc5-a153-4703ea30bfce service nova] Lock "8271a429-e252-42bb-8717-e89dfd9739bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:47:39 user nova-compute[75122]: DEBUG nova.compute.manager [req-dab5739d-f40a-4f45-9740-0192d2cdf2ac req-b677cf35-385f-4fc5-a153-4703ea30bfce service nova] [instance: 8271a429-e252-42bb-8717-e89dfd9739bf] No waiting events found dispatching network-vif-plugged-044ffaae-8351-4c7f-9b12-32ac7d4b3565 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:47:39 user nova-compute[75122]: WARNING nova.compute.manager [req-dab5739d-f40a-4f45-9740-0192d2cdf2ac req-b677cf35-385f-4fc5-a153-4703ea30bfce service nova] [instance: 8271a429-e252-42bb-8717-e89dfd9739bf] Received unexpected event network-vif-plugged-044ffaae-8351-4c7f-9b12-32ac7d4b3565 for instance with vm_state rescued and task_state unrescuing.
Nov 15 09:47:39 user nova-compute[75122]: DEBUG nova.compute.manager [req-dab5739d-f40a-4f45-9740-0192d2cdf2ac req-b677cf35-385f-4fc5-a153-4703ea30bfce service nova] [instance: 8271a429-e252-42bb-8717-e89dfd9739bf] Received event network-vif-plugged-044ffaae-8351-4c7f-9b12-32ac7d4b3565 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:47:39 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-dab5739d-f40a-4f45-9740-0192d2cdf2ac req-b677cf35-385f-4fc5-a153-4703ea30bfce service nova] Acquiring lock "8271a429-e252-42bb-8717-e89dfd9739bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:47:39 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-dab5739d-f40a-4f45-9740-0192d2cdf2ac req-b677cf35-385f-4fc5-a153-4703ea30bfce service nova] Lock "8271a429-e252-42bb-8717-e89dfd9739bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:47:39 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-dab5739d-f40a-4f45-9740-0192d2cdf2ac req-b677cf35-385f-4fc5-a153-4703ea30bfce service nova] Lock "8271a429-e252-42bb-8717-e89dfd9739bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:47:39 user nova-compute[75122]: DEBUG nova.compute.manager [req-dab5739d-f40a-4f45-9740-0192d2cdf2ac req-b677cf35-385f-4fc5-a153-4703ea30bfce service nova] [instance: 8271a429-e252-42bb-8717-e89dfd9739bf] No waiting events found dispatching network-vif-plugged-044ffaae-8351-4c7f-9b12-32ac7d4b3565 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:47:39 user nova-compute[75122]: WARNING nova.compute.manager [req-dab5739d-f40a-4f45-9740-0192d2cdf2ac req-b677cf35-385f-4fc5-a153-4703ea30bfce service nova] [instance: 8271a429-e252-42bb-8717-e89dfd9739bf] Received unexpected event network-vif-plugged-044ffaae-8351-4c7f-9b12-32ac7d4b3565 for instance with vm_state rescued and task_state unrescuing.
Nov 15 09:47:39 user nova-compute[75122]: DEBUG nova.compute.manager [req-dab5739d-f40a-4f45-9740-0192d2cdf2ac req-b677cf35-385f-4fc5-a153-4703ea30bfce service nova] [instance: 8271a429-e252-42bb-8717-e89dfd9739bf] Received event network-vif-plugged-044ffaae-8351-4c7f-9b12-32ac7d4b3565 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:47:39 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-dab5739d-f40a-4f45-9740-0192d2cdf2ac req-b677cf35-385f-4fc5-a153-4703ea30bfce service nova] Acquiring lock "8271a429-e252-42bb-8717-e89dfd9739bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:47:39 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-dab5739d-f40a-4f45-9740-0192d2cdf2ac req-b677cf35-385f-4fc5-a153-4703ea30bfce service nova] Lock "8271a429-e252-42bb-8717-e89dfd9739bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:47:39 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-dab5739d-f40a-4f45-9740-0192d2cdf2ac req-b677cf35-385f-4fc5-a153-4703ea30bfce service nova] Lock "8271a429-e252-42bb-8717-e89dfd9739bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:47:39 user nova-compute[75122]: DEBUG nova.compute.manager [req-dab5739d-f40a-4f45-9740-0192d2cdf2ac req-b677cf35-385f-4fc5-a153-4703ea30bfce service nova] [instance: 8271a429-e252-42bb-8717-e89dfd9739bf] No waiting events found dispatching network-vif-plugged-044ffaae-8351-4c7f-9b12-32ac7d4b3565 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:47:39 user nova-compute[75122]: WARNING nova.compute.manager [req-dab5739d-f40a-4f45-9740-0192d2cdf2ac req-b677cf35-385f-4fc5-a153-4703ea30bfce service nova] [instance: 8271a429-e252-42bb-8717-e89dfd9739bf] Received unexpected event network-vif-plugged-044ffaae-8351-4c7f-9b12-32ac7d4b3565 for instance with vm_state rescued and task_state unrescuing.
Nov 15 09:47:41 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:47:41 user nova-compute[75122]: DEBUG nova.compute.manager [None req-d126480e-b017-4b79-b261-e309fd875afb tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] [instance: 8271a429-e252-42bb-8717-e89dfd9739bf] Checking state {{(pid=75122) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 09:47:43 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:47:46 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:47:46 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-a5c6300e-5797-49fe-8e79-6151b410cc15 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 49154de0-f941-4ae0-a7af-72e75a4d8040 is timed out.
Nov 15 09:47:46 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-a5c6300e-5797-49fe-8e79-6151b410cc15 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Successfully detached device vdb from instance 49154de0-f941-4ae0-a7af-72e75a4d8040 from the live domain config.
Nov 15 09:47:46 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a5c6300e-5797-49fe-8e79-6151b410cc15 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] [instance: 49154de0-f941-4ae0-a7af-72e75a4d8040] calling os-brick to detach iSCSI Volume {{(pid=75122) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 09:47:46 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5c6300e-5797-49fe-8e79-6151b410cc15 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffa04060b80>, {'target_iqn': 'iqn.2010-10.org.openstack:a240e1dd-c999-4796-8c31-131e7fc84e56', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SDCsaOjk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 09:47:46 user nova-compute[75122]: WARNING os_brick.initiator.connectors.base [None req-a5c6300e-5797-49fe-8e79-6151b410cc15 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 09:47:46 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-a5c6300e-5797-49fe-8e79-6151b410cc15 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 09:47:46 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-a5c6300e-5797-49fe-8e79-6151b410cc15 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 09:47:46 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:47:46 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:47:46 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[043661a5-894b-4d1d-b441-9e5fdacf954d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6cd246c1-08d6-43ce-b2b5-2a6c42e46135\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a240e1dd-c999-4796-8c31-131e7fc84e56\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6224c0df-13b0-4ff7-928f-9a2282386a2a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:47:46 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5c6300e-5797-49fe-8e79-6151b410cc15 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 09:47:46 user nova-compute[75122]: No targets found.
Nov 15 09:47:46 user nova-compute[75122]: iSNS:
Nov 15 09:47:46 user nova-compute[75122]: No targets found.
Nov 15 09:47:46 user nova-compute[75122]: STATIC:
Nov 15 09:47:46 user nova-compute[75122]: Target: iqn.2010-10.org.openstack:6cd246c1-08d6-43ce-b2b5-2a6c42e46135
Nov 15 09:47:46 user nova-compute[75122]:         Portal: 172.16.0.220:3260,-1
Nov 15 09:47:46 user nova-compute[75122]:                 Iface Name: default
Nov 15 09:47:46 user nova-compute[75122]: Target: iqn.2010-10.org.openstack:a240e1dd-c999-4796-8c31-131e7fc84e56
Nov 15 09:47:46 user nova-compute[75122]:         Portal: 172.16.0.220:3260,-1
Nov 15 09:47:46 user nova-compute[75122]:                 Iface Name: default
Nov 15 09:47:46 user nova-compute[75122]: Target: iqn.2010-10.org.openstack:6224c0df-13b0-4ff7-928f-9a2282386a2a
Nov 15 09:47:46 user nova-compute[75122]:         Portal: 172.16.0.220:3260,-1
Nov 15 09:47:46 user nova-compute[75122]:                 Iface Name: default
Nov 15 09:47:46 user nova-compute[75122]: Target: iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17
Nov 15 09:47:46 user nova-compute[75122]:         Portal: 172.16.0.220:3260,-1
Nov 15 09:47:46 user nova-compute[75122]:                 Iface Name: default
Nov 15 09:47:46 user nova-compute[75122]: FIRMWARE:
Nov 15 09:47:46 user nova-compute[75122]: No targets found.
Nov 15 09:47:46 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 09:47:46 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5c6300e-5797-49fe-8e79-6151b410cc15 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 09:47:46 user nova-compute[75122]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 09:47:46 user nova-compute[75122]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75122) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 09:47:46 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5c6300e-5797-49fe-8e79-6151b410cc15 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a240e1dd-c999-4796-8c31-131e7fc84e56', 0)] {{(pid=75122) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 09:47:46 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:47:46 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:47:46 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[f03a22e6-59f1-4508-b461-2c0d02599bc3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6224c0df-13b0-4ff7-928f-9a2282386a2a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6cd246c1-08d6-43ce-b2b5-2a6c42e46135\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a240e1dd-c999-4796-8c31-131e7fc84e56\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:47:46 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:47:46 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:47:46 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[7501e8c8-458b-40ce-a58e-d69799b5f52d]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6224c0df-13b0-4ff7-928f-9a2282386a2a (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cd246c1-08d6-43ce-b2b5-2a6c42e46135 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a240e1dd-c999-4796-8c31-131e7fc84e56 (non-flash)\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:47:46 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5c6300e-5797-49fe-8e79-6151b410cc15 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17 (non-flash)
Nov 15 09:47:46 user nova-compute[75122]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6224c0df-13b0-4ff7-928f-9a2282386a2a (non-flash)
Nov 15 09:47:46 user nova-compute[75122]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cd246c1-08d6-43ce-b2b5-2a6c42e46135 (non-flash)
Nov 15 09:47:46 user nova-compute[75122]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a240e1dd-c999-4796-8c31-131e7fc84e56 (non-flash)
Nov 15 09:47:46 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 09:47:46 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5c6300e-5797-49fe-8e79-6151b410cc15 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17 (non-flash)
Nov 15 09:47:46 user nova-compute[75122]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6224c0df-13b0-4ff7-928f-9a2282386a2a (non-flash)
Nov 15 09:47:46 user nova-compute[75122]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cd246c1-08d6-43ce-b2b5-2a6c42e46135 (non-flash)
Nov 15 09:47:46 user nova-compute[75122]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a240e1dd-c999-4796-8c31-131e7fc84e56 (non-flash)
Nov 15 09:47:46 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 09:47:46 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5c6300e-5797-49fe-8e79-6151b410cc15 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff9fc3a5d80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a240e1dd-c999-4796-8c31-131e7fc84e56'): ({'sde'}, set())}) {{(pid=75122) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 09:47:46 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-a5c6300e-5797-49fe-8e79-6151b410cc15 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Removing single pathed devices sde {{(pid=75122) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 09:47:46 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:47:46 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:47:46 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f88c51c-d692-4eac-bdde-a04d7daa3c66]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:47:46 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:47:46 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:47:46 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[76791072-d791-406a-b9bd-9feb556446b5]: (4, ('ok\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:47:46 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-a5c6300e-5797-49fe-8e79-6151b410cc15 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Flushing IO for device /dev/sde {{(pid=75122) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 09:47:46 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:47:46 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:47:46 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[84e7d256-42ab-40cd-b9a3-191762fb9bfc]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:47:46 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-a5c6300e-5797-49fe-8e79-6151b410cc15 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75122) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 09:47:46 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:47:46 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.038s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:47:46 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[b64a962b-41e3-45d8-9c4f-f40bafad5e63]: (4, ('1', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:47:46 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-a5c6300e-5797-49fe-8e79-6151b410cc15 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75122) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 09:47:46 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-a5c6300e-5797-49fe-8e79-6151b410cc15 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] SCSI volumes sde have been removed. {{(pid=75122) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 09:47:46 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5c6300e-5797-49fe-8e79-6151b410cc15 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a240e1dd-c999-4796-8c31-131e7fc84e56')] {{(pid=75122) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 09:47:46 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a240e1dd-c999-4796-8c31-131e7fc84e56 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:47:46 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a240e1dd-c999-4796-8c31-131e7fc84e56 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:47:46 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[6271e16e-5b05-490f-a6ad-2bf1bda26784]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:47:46 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5c6300e-5797-49fe-8e79-6151b410cc15 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:47:46 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a240e1dd-c999-4796-8c31-131e7fc84e56 -p 172.16.0.220:3260 --logout {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:47:46 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a240e1dd-c999-4796-8c31-131e7fc84e56 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:47:46 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[9771626a-6473-4478-8909-e2749a7f254c]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:a240e1dd-c999-4796-8c31-131e7fc84e56, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:a240e1dd-c999-4796-8c31-131e7fc84e56, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:47:46 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5c6300e-5797-49fe-8e79-6151b410cc15 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:a240e1dd-c999-4796-8c31-131e7fc84e56, portal: 172.16.0.220,3260]
Nov 15 09:47:46 user nova-compute[75122]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:a240e1dd-c999-4796-8c31-131e7fc84e56, portal: 172.16.0.220,3260] successful.
Nov 15 09:47:46 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:47:46 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a240e1dd-c999-4796-8c31-131e7fc84e56 -p 172.16.0.220:3260 --op delete {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:47:46 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a240e1dd-c999-4796-8c31-131e7fc84e56 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:47:46 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c17f189-20a6-4f67-abae-44a79ca0596a]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:47:46 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5c6300e-5797-49fe-8e79-6151b410cc15 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:47:46 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-a5c6300e-5797-49fe-8e79-6151b410cc15 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.294s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 09:47:46 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5c6300e-5797-49fe-8e79-6151b410cc15 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] <== disconnect_volume: return (295ms) None {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 09:47:46 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a5c6300e-5797-49fe-8e79-6151b410cc15 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] [instance: 49154de0-f941-4ae0-a7af-72e75a4d8040] Disconnected iSCSI Volume {{(pid=75122) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 09:47:47 user nova-compute[75122]: DEBUG nova.objects.instance [None req-a5c6300e-5797-49fe-8e79-6151b410cc15 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Lazy-loading 'flavor' on Instance uuid 49154de0-f941-4ae0-a7af-72e75a4d8040 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:47:47 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-a5c6300e-5797-49fe-8e79-6151b410cc15 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Lock "49154de0-f941-4ae0-a7af-72e75a4d8040" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.602s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:47:48 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:47:53 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:47:56 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:47:58 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:48:01 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:48:02 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-a839251d-1543-43e4-9ab4-3a002a8eff36 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Acquiring lock "3fbf220d-ad09-4436-8a0a-7a527dd00c6f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:48:02 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-a839251d-1543-43e4-9ab4-3a002a8eff36 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Lock "3fbf220d-ad09-4436-8a0a-7a527dd00c6f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:48:02 user nova-compute[75122]: DEBUG nova.compute.manager [None req-a839251d-1543-43e4-9ab4-3a002a8eff36 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] [instance: 3fbf220d-ad09-4436-8a0a-7a527dd00c6f] Starting instance... {{(pid=75122) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 09:48:02 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-a839251d-1543-43e4-9ab4-3a002a8eff36 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:48:02 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-a839251d-1543-43e4-9ab4-3a002a8eff36 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:48:02 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-a839251d-1543-43e4-9ab4-3a002a8eff36 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75122) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 09:48:02 user nova-compute[75122]: INFO nova.compute.claims [None req-a839251d-1543-43e4-9ab4-3a002a8eff36 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] [instance: 3fbf220d-ad09-4436-8a0a-7a527dd00c6f] Claim successful on node user
Nov 15 09:48:02 user nova-compute[75122]: DEBUG nova.compute.provider_tree [None req-a839251d-1543-43e4-9ab4-3a002a8eff36 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Inventory has not changed in ProviderTree for provider: 69a3da65-47be-44c6-b67c-c692b58284ef {{(pid=75122) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 09:48:02 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-a839251d-1543-43e4-9ab4-3a002a8eff36 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Inventory has not changed for provider 69a3da65-47be-44c6-b67c-c692b58284ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 09:48:02 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-a839251d-1543-43e4-9ab4-3a002a8eff36 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.376s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:48:02 user nova-compute[75122]: DEBUG nova.compute.manager [None req-a839251d-1543-43e4-9ab4-3a002a8eff36 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] [instance: 3fbf220d-ad09-4436-8a0a-7a527dd00c6f] Start building networks asynchronously for instance. {{(pid=75122) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 09:48:02 user nova-compute[75122]: DEBUG nova.compute.manager [None req-a839251d-1543-43e4-9ab4-3a002a8eff36 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] [instance: 3fbf220d-ad09-4436-8a0a-7a527dd00c6f] Allocating IP information in the background. {{(pid=75122) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 09:48:02 user nova-compute[75122]: DEBUG nova.network.neutron [None req-a839251d-1543-43e4-9ab4-3a002a8eff36 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] [instance: 3fbf220d-ad09-4436-8a0a-7a527dd00c6f] allocate_for_instance() {{(pid=75122) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 09:48:02 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-a839251d-1543-43e4-9ab4-3a002a8eff36 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] [instance: 3fbf220d-ad09-4436-8a0a-7a527dd00c6f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 09:48:02 user nova-compute[75122]: DEBUG nova.compute.manager [None req-a839251d-1543-43e4-9ab4-3a002a8eff36 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] [instance: 3fbf220d-ad09-4436-8a0a-7a527dd00c6f] Start building block device mappings for instance. {{(pid=75122) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 09:48:02 user nova-compute[75122]: DEBUG nova.policy [None req-a839251d-1543-43e4-9ab4-3a002a8eff36 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd52d39a644924944be943a3200bd5b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f29cd64a8a674d73936b8a0c90bf2d34', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75122) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 09:48:02 user nova-compute[75122]: DEBUG nova.compute.manager [None req-a839251d-1543-43e4-9ab4-3a002a8eff36 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] [instance: 3fbf220d-ad09-4436-8a0a-7a527dd00c6f] Start spawning the instance on the hypervisor. {{(pid=75122) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 09:48:02 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-a839251d-1543-43e4-9ab4-3a002a8eff36 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] [instance: 3fbf220d-ad09-4436-8a0a-7a527dd00c6f] Creating instance directory {{(pid=75122) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 09:48:02 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-a839251d-1543-43e4-9ab4-3a002a8eff36 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] [instance: 3fbf220d-ad09-4436-8a0a-7a527dd00c6f] Creating image(s)
Nov 15 09:48:02 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-a839251d-1543-43e4-9ab4-3a002a8eff36 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Acquiring lock "/opt/stack/data/nova/instances/3fbf220d-ad09-4436-8a0a-7a527dd00c6f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:48:02 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-a839251d-1543-43e4-9ab4-3a002a8eff36 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Lock "/opt/stack/data/nova/instances/3fbf220d-ad09-4436-8a0a-7a527dd00c6f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:48:03 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-a839251d-1543-43e4-9ab4-3a002a8eff36 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Lock "/opt/stack/data/nova/instances/3fbf220d-ad09-4436-8a0a-7a527dd00c6f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:48:03 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-a839251d-1543-43e4-9ab4-3a002a8eff36 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:48:03 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:48:03 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-a839251d-1543-43e4-9ab4-3a002a8eff36 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json" returned: 0 in 0.315s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:48:03 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-a839251d-1543-43e4-9ab4-3a002a8eff36 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Acquiring lock "95d6e29f74d5408f818e32f3bc29bc8270a4c665" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:48:03 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-a839251d-1543-43e4-9ab4-3a002a8eff36 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Lock "95d6e29f74d5408f818e32f3bc29bc8270a4c665" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:48:03 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-a839251d-1543-43e4-9ab4-3a002a8eff36 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:48:03 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-a839251d-1543-43e4-9ab4-3a002a8eff36 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json" returned: 0 in 0.192s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:48:03 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-a839251d-1543-43e4-9ab4-3a002a8eff36 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665,backing_fmt=raw /opt/stack/data/nova/instances/3fbf220d-ad09-4436-8a0a-7a527dd00c6f/disk 1073741824 {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:48:03 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-a839251d-1543-43e4-9ab4-3a002a8eff36 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665,backing_fmt=raw /opt/stack/data/nova/instances/3fbf220d-ad09-4436-8a0a-7a527dd00c6f/disk 1073741824" returned: 0 in 0.050s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:48:03 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-a839251d-1543-43e4-9ab4-3a002a8eff36 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Lock "95d6e29f74d5408f818e32f3bc29bc8270a4c665" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.251s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:48:03 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-a839251d-1543-43e4-9ab4-3a002a8eff36 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:48:03 user nova-compute[75122]: DEBUG nova.network.neutron [None req-a839251d-1543-43e4-9ab4-3a002a8eff36 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] [instance: 3fbf220d-ad09-4436-8a0a-7a527dd00c6f] Successfully created port: e5cf676d-827d-4867-8846-b468acff8b6d {{(pid=75122) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 09:48:03 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-a839251d-1543-43e4-9ab4-3a002a8eff36 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json" returned: 0 in 0.209s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:48:03 user nova-compute[75122]: DEBUG nova.virt.disk.api [None req-a839251d-1543-43e4-9ab4-3a002a8eff36 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3fbf220d-ad09-4436-8a0a-7a527dd00c6f/disk. size=1073741824 {{(pid=75122) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 09:48:03 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-a839251d-1543-43e4-9ab4-3a002a8eff36 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fbf220d-ad09-4436-8a0a-7a527dd00c6f/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:48:03 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-a839251d-1543-43e4-9ab4-3a002a8eff36 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fbf220d-ad09-4436-8a0a-7a527dd00c6f/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:48:03 user nova-compute[75122]: DEBUG nova.virt.disk.api [None req-a839251d-1543-43e4-9ab4-3a002a8eff36 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Cannot resize image /opt/stack/data/nova/instances/3fbf220d-ad09-4436-8a0a-7a527dd00c6f/disk to a smaller size. {{(pid=75122) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 09:48:03 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-a839251d-1543-43e4-9ab4-3a002a8eff36 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] [instance: 3fbf220d-ad09-4436-8a0a-7a527dd00c6f] Created local disks {{(pid=75122) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 09:48:03 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-a839251d-1543-43e4-9ab4-3a002a8eff36 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] [instance: 3fbf220d-ad09-4436-8a0a-7a527dd00c6f] Ensure instance console log exists: /opt/stack/data/nova/instances/3fbf220d-ad09-4436-8a0a-7a527dd00c6f/console.log {{(pid=75122) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 09:48:03 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-a839251d-1543-43e4-9ab4-3a002a8eff36 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:48:03 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-a839251d-1543-43e4-9ab4-3a002a8eff36 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:48:03 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-a839251d-1543-43e4-9ab4-3a002a8eff36 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:48:04 user nova-compute[75122]: DEBUG nova.network.neutron [None req-a839251d-1543-43e4-9ab4-3a002a8eff36 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] [instance: 3fbf220d-ad09-4436-8a0a-7a527dd00c6f] Successfully updated port: e5cf676d-827d-4867-8846-b468acff8b6d {{(pid=75122) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 09:48:04 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-a839251d-1543-43e4-9ab4-3a002a8eff36 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Acquiring lock "refresh_cache-3fbf220d-ad09-4436-8a0a-7a527dd00c6f" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 09:48:04 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-a839251d-1543-43e4-9ab4-3a002a8eff36 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Acquired lock "refresh_cache-3fbf220d-ad09-4436-8a0a-7a527dd00c6f" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 09:48:04 user nova-compute[75122]: DEBUG nova.network.neutron [None req-a839251d-1543-43e4-9ab4-3a002a8eff36 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] [instance: 3fbf220d-ad09-4436-8a0a-7a527dd00c6f] Building network info cache for instance {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 09:48:04 user nova-compute[75122]: DEBUG nova.compute.manager [req-7b3f1f15-04e4-443d-8d8a-5978e046254e req-f568007f-0890-4ed5-b828-8e49d202ba4d service nova] [instance: 3fbf220d-ad09-4436-8a0a-7a527dd00c6f] Received event network-changed-e5cf676d-827d-4867-8846-b468acff8b6d {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:48:04 user nova-compute[75122]: DEBUG nova.compute.manager [req-7b3f1f15-04e4-443d-8d8a-5978e046254e req-f568007f-0890-4ed5-b828-8e49d202ba4d service nova] [instance: 3fbf220d-ad09-4436-8a0a-7a527dd00c6f] Refreshing instance network info cache due to event network-changed-e5cf676d-827d-4867-8846-b468acff8b6d. {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 09:48:04 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-7b3f1f15-04e4-443d-8d8a-5978e046254e req-f568007f-0890-4ed5-b828-8e49d202ba4d service nova] Acquiring lock "refresh_cache-3fbf220d-ad09-4436-8a0a-7a527dd00c6f" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 09:48:04 user nova-compute[75122]: DEBUG nova.network.neutron [None req-a839251d-1543-43e4-9ab4-3a002a8eff36 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] [instance: 3fbf220d-ad09-4436-8a0a-7a527dd00c6f] Instance cache missing network info. {{(pid=75122) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 09:48:04 user nova-compute[75122]: DEBUG nova.network.neutron [None req-a839251d-1543-43e4-9ab4-3a002a8eff36 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] [instance: 3fbf220d-ad09-4436-8a0a-7a527dd00c6f] Updating instance_info_cache with network_info: [{"id": "e5cf676d-827d-4867-8846-b468acff8b6d", "address": "fa:16:3e:7d:32:4e", "network": {"id": "cc80acf3-8a44-4d7e-aaa0-1214700564b3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1084984321-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f29cd64a8a674d73936b8a0c90bf2d34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5cf676d-82", "ovs_interfaceid": "e5cf676d-827d-4867-8846-b468acff8b6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:48:04 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-a839251d-1543-43e4-9ab4-3a002a8eff36 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Releasing lock "refresh_cache-3fbf220d-ad09-4436-8a0a-7a527dd00c6f" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 09:48:04 user nova-compute[75122]: DEBUG nova.compute.manager [None req-a839251d-1543-43e4-9ab4-3a002a8eff36 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] [instance: 3fbf220d-ad09-4436-8a0a-7a527dd00c6f] Instance network_info: |[{"id": "e5cf676d-827d-4867-8846-b468acff8b6d", "address": "fa:16:3e:7d:32:4e", "network": {"id": "cc80acf3-8a44-4d7e-aaa0-1214700564b3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1084984321-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f29cd64a8a674d73936b8a0c90bf2d34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5cf676d-82", "ovs_interfaceid": "e5cf676d-827d-4867-8846-b468acff8b6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75122) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 09:48:04 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-7b3f1f15-04e4-443d-8d8a-5978e046254e req-f568007f-0890-4ed5-b828-8e49d202ba4d service nova] Acquired lock "refresh_cache-3fbf220d-ad09-4436-8a0a-7a527dd00c6f" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 09:48:04 user nova-compute[75122]: DEBUG nova.network.neutron [req-7b3f1f15-04e4-443d-8d8a-5978e046254e req-f568007f-0890-4ed5-b828-8e49d202ba4d service nova] [instance: 3fbf220d-ad09-4436-8a0a-7a527dd00c6f] Refreshing network info cache for port e5cf676d-827d-4867-8846-b468acff8b6d {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 09:48:04 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-a839251d-1543-43e4-9ab4-3a002a8eff36 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] [instance: 3fbf220d-ad09-4436-8a0a-7a527dd00c6f] Start _get_guest_xml network_info=[{"id": "e5cf676d-827d-4867-8846-b468acff8b6d", "address": "fa:16:3e:7d:32:4e", "network": {"id": "cc80acf3-8a44-4d7e-aaa0-1214700564b3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1084984321-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f29cd64a8a674d73936b8a0c90bf2d34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5cf676d-82", "ovs_interfaceid": "e5cf676d-827d-4867-8846-b468acff8b6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T09:26:31Z,direct_url=<?>,disk_format='qcow2',id=5e862cfe-47b8-4725-8292-65761ee6d0f5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9c57733cb41847c0b4ad31519c382e5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T09:26:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '5e862cfe-47b8-4725-8292-65761ee6d0f5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75122) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 09:48:04 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-a839251d-1543-43e4-9ab4-3a002a8eff36 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 09:48:04 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-a839251d-1543-43e4-9ab4-3a002a8eff36 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 09:48:04 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-a839251d-1543-43e4-9ab4-3a002a8eff36 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75122) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 09:48:04 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-a839251d-1543-43e4-9ab4-3a002a8eff36 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] CPU controller missing on host. {{(pid=75122) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 09:48:04 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-a839251d-1543-43e4-9ab4-3a002a8eff36 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75122) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 09:48:04 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-a839251d-1543-43e4-9ab4-3a002a8eff36 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] CPU controller found on host. {{(pid=75122) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 09:48:04 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-a839251d-1543-43e4-9ab4-3a002a8eff36 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75122) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 09:48:04 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-a839251d-1543-43e4-9ab4-3a002a8eff36 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T09:26:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T09:26:31Z,direct_url=<?>,disk_format='qcow2',id=5e862cfe-47b8-4725-8292-65761ee6d0f5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9c57733cb41847c0b4ad31519c382e5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T09:26:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 09:48:04 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-a839251d-1543-43e4-9ab4-3a002a8eff36 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Flavor limits 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 09:48:04 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-a839251d-1543-43e4-9ab4-3a002a8eff36 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Image limits 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 09:48:04 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-a839251d-1543-43e4-9ab4-3a002a8eff36 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Flavor pref 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 09:48:04 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-a839251d-1543-43e4-9ab4-3a002a8eff36 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Image pref 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 09:48:04 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-a839251d-1543-43e4-9ab4-3a002a8eff36 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 09:48:04 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-a839251d-1543-43e4-9ab4-3a002a8eff36 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 09:48:04 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-a839251d-1543-43e4-9ab4-3a002a8eff36 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75122) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 09:48:04 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-a839251d-1543-43e4-9ab4-3a002a8eff36 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Got 1 possible topologies {{(pid=75122) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 09:48:04 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-a839251d-1543-43e4-9ab4-3a002a8eff36 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 09:48:04 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-a839251d-1543-43e4-9ab4-3a002a8eff36 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 09:48:04 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-a839251d-1543-43e4-9ab4-3a002a8eff36 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T09:48:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1299938130',display_name='tempest-AttachVolumeNegativeTest-server-1299938130',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1299938130',id=34,image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDHQuMYCoBgGPXLQVY3CAXhR6ld1Z9VSBItS0SzOk1ECAAt/ZRyOoJvBsgIrm1QEmJf1OJy4Q/Bu3Celsv4mIYT16LyV2uiAQpdHfqudiapAh+IvxNi0aYAZAkH/Z5flAA==',key_name='tempest-keypair-549936525',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f29cd64a8a674d73936b8a0c90bf2d34',ramdisk_id='',reservation_id='r-62dzr9bk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-475232131',owner_user_name='tempest-AttachVolumeNegativeTest-475232131-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T09:48:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d52d39a644924944be943a3200bd5b33',uuid=3fbf220d-ad09-4436-8a0a-7a527dd00c6f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e5cf676d-827d-4867-8846-b468acff8b6d", "address": "fa:16:3e:7d:32:4e", "network": {"id": "cc80acf3-8a44-4d7e-aaa0-1214700564b3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1084984321-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f29cd64a8a674d73936b8a0c90bf2d34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5cf676d-82", "ovs_interfaceid": "e5cf676d-827d-4867-8846-b468acff8b6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75122) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 09:48:04 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-a839251d-1543-43e4-9ab4-3a002a8eff36 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Converting VIF {"id": "e5cf676d-827d-4867-8846-b468acff8b6d", "address": "fa:16:3e:7d:32:4e", "network": {"id": "cc80acf3-8a44-4d7e-aaa0-1214700564b3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1084984321-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f29cd64a8a674d73936b8a0c90bf2d34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5cf676d-82", "ovs_interfaceid": "e5cf676d-827d-4867-8846-b468acff8b6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 09:48:04 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-a839251d-1543-43e4-9ab4-3a002a8eff36 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:32:4e,bridge_name='br-int',has_traffic_filtering=True,id=e5cf676d-827d-4867-8846-b468acff8b6d,network=Network(cc80acf3-8a44-4d7e-aaa0-1214700564b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5cf676d-82') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 09:48:04 user nova-compute[75122]: DEBUG nova.objects.instance [None req-a839251d-1543-43e4-9ab4-3a002a8eff36 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Lazy-loading 'pci_devices' on Instance uuid 3fbf220d-ad09-4436-8a0a-7a527dd00c6f {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:48:04 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-a839251d-1543-43e4-9ab4-3a002a8eff36 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] [instance: 3fbf220d-ad09-4436-8a0a-7a527dd00c6f] End _get_guest_xml xml=<domain type="kvm">
Nov 15 09:48:04 user nova-compute[75122]:   <uuid>3fbf220d-ad09-4436-8a0a-7a527dd00c6f</uuid>
Nov 15 09:48:04 user nova-compute[75122]:   <name>instance-00000022</name>
Nov 15 09:48:04 user nova-compute[75122]:   <memory>524288</memory>
Nov 15 09:48:04 user nova-compute[75122]:   <vcpu>1</vcpu>
Nov 15 09:48:04 user nova-compute[75122]:   <metadata>
Nov 15 09:48:04 user nova-compute[75122]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 09:48:04 user nova-compute[75122]:       <nova:package version="0.0.0"/>
Nov 15 09:48:04 user nova-compute[75122]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1299938130</nova:name>
Nov 15 09:48:04 user nova-compute[75122]:       <nova:creationTime>2023-11-15 09:48:04</nova:creationTime>
Nov 15 09:48:04 user nova-compute[75122]:       <nova:flavor name="m1.tiny">
Nov 15 09:48:04 user nova-compute[75122]:         <nova:memory>512</nova:memory>
Nov 15 09:48:04 user nova-compute[75122]:         <nova:disk>1</nova:disk>
Nov 15 09:48:04 user nova-compute[75122]:         <nova:swap>0</nova:swap>
Nov 15 09:48:04 user nova-compute[75122]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 09:48:04 user nova-compute[75122]:         <nova:vcpus>1</nova:vcpus>
Nov 15 09:48:04 user nova-compute[75122]:       </nova:flavor>
Nov 15 09:48:04 user nova-compute[75122]:       <nova:owner>
Nov 15 09:48:04 user nova-compute[75122]:         <nova:user uuid="d52d39a644924944be943a3200bd5b33">tempest-AttachVolumeNegativeTest-475232131-project-member</nova:user>
Nov 15 09:48:04 user nova-compute[75122]:         <nova:project uuid="f29cd64a8a674d73936b8a0c90bf2d34">tempest-AttachVolumeNegativeTest-475232131</nova:project>
Nov 15 09:48:04 user nova-compute[75122]:       </nova:owner>
Nov 15 09:48:04 user nova-compute[75122]:       <nova:root type="image" uuid="5e862cfe-47b8-4725-8292-65761ee6d0f5"/>
Nov 15 09:48:04 user nova-compute[75122]:       <nova:ports>
Nov 15 09:48:04 user nova-compute[75122]:         <nova:port uuid="e5cf676d-827d-4867-8846-b468acff8b6d">
Nov 15 09:48:04 user nova-compute[75122]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 15 09:48:04 user nova-compute[75122]:         </nova:port>
Nov 15 09:48:04 user nova-compute[75122]:       </nova:ports>
Nov 15 09:48:04 user nova-compute[75122]:     </nova:instance>
Nov 15 09:48:04 user nova-compute[75122]:   </metadata>
Nov 15 09:48:04 user nova-compute[75122]:   <sysinfo type="smbios">
Nov 15 09:48:04 user nova-compute[75122]:     <system>
Nov 15 09:48:04 user nova-compute[75122]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 09:48:04 user nova-compute[75122]:       <entry name="product">OpenStack Nova</entry>
Nov 15 09:48:04 user nova-compute[75122]:       <entry name="version">0.0.0</entry>
Nov 15 09:48:04 user nova-compute[75122]:       <entry name="serial">3fbf220d-ad09-4436-8a0a-7a527dd00c6f</entry>
Nov 15 09:48:04 user nova-compute[75122]:       <entry name="uuid">3fbf220d-ad09-4436-8a0a-7a527dd00c6f</entry>
Nov 15 09:48:04 user nova-compute[75122]:       <entry name="family">Virtual Machine</entry>
Nov 15 09:48:04 user nova-compute[75122]:     </system>
Nov 15 09:48:04 user nova-compute[75122]:   </sysinfo>
Nov 15 09:48:04 user nova-compute[75122]:   <os>
Nov 15 09:48:04 user nova-compute[75122]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 09:48:04 user nova-compute[75122]:     <boot dev="hd"/>
Nov 15 09:48:04 user nova-compute[75122]:     <smbios mode="sysinfo"/>
Nov 15 09:48:04 user nova-compute[75122]:   </os>
Nov 15 09:48:04 user nova-compute[75122]:   <features>
Nov 15 09:48:04 user nova-compute[75122]:     <acpi/>
Nov 15 09:48:04 user nova-compute[75122]:     <apic/>
Nov 15 09:48:04 user nova-compute[75122]:     <vmcoreinfo/>
Nov 15 09:48:04 user nova-compute[75122]:   </features>
Nov 15 09:48:04 user nova-compute[75122]:   <clock offset="utc">
Nov 15 09:48:04 user nova-compute[75122]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 09:48:04 user nova-compute[75122]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 09:48:04 user nova-compute[75122]:     <timer name="hpet" present="no"/>
Nov 15 09:48:04 user nova-compute[75122]:   </clock>
Nov 15 09:48:04 user nova-compute[75122]:   <cpu mode="custom" match="exact">
Nov 15 09:48:04 user nova-compute[75122]:     <model>Nehalem</model>
Nov 15 09:48:04 user nova-compute[75122]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 09:48:04 user nova-compute[75122]:   </cpu>
Nov 15 09:48:04 user nova-compute[75122]:   <devices>
Nov 15 09:48:04 user nova-compute[75122]:     <disk type="file" device="disk">
Nov 15 09:48:04 user nova-compute[75122]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 09:48:04 user nova-compute[75122]:       <source file="/opt/stack/data/nova/instances/3fbf220d-ad09-4436-8a0a-7a527dd00c6f/disk"/>
Nov 15 09:48:04 user nova-compute[75122]:       <target dev="vda" bus="virtio"/>
Nov 15 09:48:04 user nova-compute[75122]:     </disk>
Nov 15 09:48:04 user nova-compute[75122]:     <interface type="ethernet">
Nov 15 09:48:04 user nova-compute[75122]:       <mac address="fa:16:3e:7d:32:4e"/>
Nov 15 09:48:04 user nova-compute[75122]:       <model type="virtio"/>
Nov 15 09:48:04 user nova-compute[75122]:       <mtu size="1442"/>
Nov 15 09:48:04 user nova-compute[75122]:       <target dev="tape5cf676d-82"/>
Nov 15 09:48:04 user nova-compute[75122]:     </interface>
Nov 15 09:48:04 user nova-compute[75122]:     <serial type="pty">
Nov 15 09:48:04 user nova-compute[75122]:       <log file="/opt/stack/data/nova/instances/3fbf220d-ad09-4436-8a0a-7a527dd00c6f/console.log" append="off"/>
Nov 15 09:48:04 user nova-compute[75122]:     </serial>
Nov 15 09:48:04 user nova-compute[75122]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 09:48:04 user nova-compute[75122]:     <video>
Nov 15 09:48:04 user nova-compute[75122]:       <model type="virtio"/>
Nov 15 09:48:04 user nova-compute[75122]:     </video>
Nov 15 09:48:04 user nova-compute[75122]:     <rng model="virtio">
Nov 15 09:48:04 user nova-compute[75122]:       <backend model="random">/dev/urandom</backend>
Nov 15 09:48:04 user nova-compute[75122]:     </rng>
Nov 15 09:48:04 user nova-compute[75122]:     <controller type="usb" index="0" model="none"/>
Nov 15 09:48:04 user nova-compute[75122]:     <memballoon model="virtio">
Nov 15 09:48:04 user nova-compute[75122]:       <stats period="10"/>
Nov 15 09:48:04 user nova-compute[75122]:     </memballoon>
Nov 15 09:48:04 user nova-compute[75122]:   </devices>
Nov 15 09:48:04 user nova-compute[75122]: </domain>
Nov 15 09:48:04 user nova-compute[75122]:  {{(pid=75122) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 09:48:04 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-a839251d-1543-43e4-9ab4-3a002a8eff36 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T09:48:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1299938130',display_name='tempest-AttachVolumeNegativeTest-server-1299938130',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1299938130',id=34,image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDHQuMYCoBgGPXLQVY3CAXhR6ld1Z9VSBItS0SzOk1ECAAt/ZRyOoJvBsgIrm1QEmJf1OJy4Q/Bu3Celsv4mIYT16LyV2uiAQpdHfqudiapAh+IvxNi0aYAZAkH/Z5flAA==',key_name='tempest-keypair-549936525',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f29cd64a8a674d73936b8a0c90bf2d34',ramdisk_id='',reservation_id='r-62dzr9bk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-475232131',owner_user_name='tempest-AttachVolumeNegativeTest-475232131-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T09:48:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d52d39a644924944be943a3200bd5b33',uuid=3fbf220d-ad09-4436-8a0a-7a527dd00c6f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e5cf676d-827d-4867-8846-b468acff8b6d", "address": "fa:16:3e:7d:32:4e", "network": {"id": "cc80acf3-8a44-4d7e-aaa0-1214700564b3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1084984321-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f29cd64a8a674d73936b8a0c90bf2d34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5cf676d-82", "ovs_interfaceid": "e5cf676d-827d-4867-8846-b468acff8b6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 09:48:04 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-a839251d-1543-43e4-9ab4-3a002a8eff36 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Converting VIF {"id": "e5cf676d-827d-4867-8846-b468acff8b6d", "address": "fa:16:3e:7d:32:4e", "network": {"id": "cc80acf3-8a44-4d7e-aaa0-1214700564b3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1084984321-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f29cd64a8a674d73936b8a0c90bf2d34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5cf676d-82", "ovs_interfaceid": "e5cf676d-827d-4867-8846-b468acff8b6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 09:48:04 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-a839251d-1543-43e4-9ab4-3a002a8eff36 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:32:4e,bridge_name='br-int',has_traffic_filtering=True,id=e5cf676d-827d-4867-8846-b468acff8b6d,network=Network(cc80acf3-8a44-4d7e-aaa0-1214700564b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5cf676d-82') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 09:48:04 user nova-compute[75122]: DEBUG os_vif [None req-a839251d-1543-43e4-9ab4-3a002a8eff36 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:32:4e,bridge_name='br-int',has_traffic_filtering=True,id=e5cf676d-827d-4867-8846-b468acff8b6d,network=Network(cc80acf3-8a44-4d7e-aaa0-1214700564b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5cf676d-82') {{(pid=75122) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 09:48:04 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:48:04 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:48:04 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 09:48:04 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:48:04 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '53a6cdcc-e75f-5482-9f21-48350720c19c', '_type': 'linux-noop'}}, row=False) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:48:04 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:48:04 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:48:04 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:48:04 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape5cf676d-82, may_exist=True, interface_attrs={}) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:48:04 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape5cf676d-82, col_values=(('qos', UUID('b421f9c9-f0ef-4f1c-b387-8b8c6d522a87')),), if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:48:04 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape5cf676d-82, col_values=(('external_ids', {'iface-id': 'e5cf676d-827d-4867-8846-b468acff8b6d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7d:32:4e', 'vm-uuid': '3fbf220d-ad09-4436-8a0a-7a527dd00c6f'}),), if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:48:04 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:48:04 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:48:04 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:48:04 user nova-compute[75122]: INFO os_vif [None req-a839251d-1543-43e4-9ab4-3a002a8eff36 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:32:4e,bridge_name='br-int',has_traffic_filtering=True,id=e5cf676d-827d-4867-8846-b468acff8b6d,network=Network(cc80acf3-8a44-4d7e-aaa0-1214700564b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5cf676d-82')
Nov 15 09:48:04 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-a839251d-1543-43e4-9ab4-3a002a8eff36 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] No BDM found with device name vda, not building metadata. {{(pid=75122) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 09:48:04 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-a839251d-1543-43e4-9ab4-3a002a8eff36 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] No VIF found with MAC fa:16:3e:7d:32:4e, not building metadata {{(pid=75122) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 09:48:05 user nova-compute[75122]: DEBUG nova.network.neutron [req-7b3f1f15-04e4-443d-8d8a-5978e046254e req-f568007f-0890-4ed5-b828-8e49d202ba4d service nova] [instance: 3fbf220d-ad09-4436-8a0a-7a527dd00c6f] Updated VIF entry in instance network info cache for port e5cf676d-827d-4867-8846-b468acff8b6d. {{(pid=75122) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 09:48:05 user nova-compute[75122]: DEBUG nova.network.neutron [req-7b3f1f15-04e4-443d-8d8a-5978e046254e req-f568007f-0890-4ed5-b828-8e49d202ba4d service nova] [instance: 3fbf220d-ad09-4436-8a0a-7a527dd00c6f] Updating instance_info_cache with network_info: [{"id": "e5cf676d-827d-4867-8846-b468acff8b6d", "address": "fa:16:3e:7d:32:4e", "network": {"id": "cc80acf3-8a44-4d7e-aaa0-1214700564b3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1084984321-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f29cd64a8a674d73936b8a0c90bf2d34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5cf676d-82", "ovs_interfaceid": "e5cf676d-827d-4867-8846-b468acff8b6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:48:05 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-7b3f1f15-04e4-443d-8d8a-5978e046254e req-f568007f-0890-4ed5-b828-8e49d202ba4d service nova] Releasing lock "refresh_cache-3fbf220d-ad09-4436-8a0a-7a527dd00c6f" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 09:48:06 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:48:06 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:48:06 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:48:06 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:48:06 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:48:06 user nova-compute[75122]: DEBUG nova.compute.manager [req-8c9a704f-54c5-42fc-b43c-1c134920fbc4 req-439a34bd-b7a1-41c7-b480-0a4ad607be72 service nova] [instance: 3fbf220d-ad09-4436-8a0a-7a527dd00c6f] Received event network-vif-plugged-e5cf676d-827d-4867-8846-b468acff8b6d {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:48:06 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-8c9a704f-54c5-42fc-b43c-1c134920fbc4 req-439a34bd-b7a1-41c7-b480-0a4ad607be72 service nova] Acquiring lock "3fbf220d-ad09-4436-8a0a-7a527dd00c6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:48:06 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-8c9a704f-54c5-42fc-b43c-1c134920fbc4 req-439a34bd-b7a1-41c7-b480-0a4ad607be72 service nova] Lock "3fbf220d-ad09-4436-8a0a-7a527dd00c6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:48:06 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-8c9a704f-54c5-42fc-b43c-1c134920fbc4 req-439a34bd-b7a1-41c7-b480-0a4ad607be72 service nova] Lock "3fbf220d-ad09-4436-8a0a-7a527dd00c6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:48:06 user nova-compute[75122]: DEBUG nova.compute.manager [req-8c9a704f-54c5-42fc-b43c-1c134920fbc4 req-439a34bd-b7a1-41c7-b480-0a4ad607be72 service nova] [instance: 3fbf220d-ad09-4436-8a0a-7a527dd00c6f] No waiting events found dispatching network-vif-plugged-e5cf676d-827d-4867-8846-b468acff8b6d {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:48:06 user nova-compute[75122]: WARNING nova.compute.manager [req-8c9a704f-54c5-42fc-b43c-1c134920fbc4 req-439a34bd-b7a1-41c7-b480-0a4ad607be72 service nova] [instance: 3fbf220d-ad09-4436-8a0a-7a527dd00c6f] Received unexpected event network-vif-plugged-e5cf676d-827d-4867-8846-b468acff8b6d for instance with vm_state building and task_state spawning.
Nov 15 09:48:06 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:48:06 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:48:06 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:48:06 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:48:08 user nova-compute[75122]: DEBUG nova.compute.manager [None req-a839251d-1543-43e4-9ab4-3a002a8eff36 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] [instance: 3fbf220d-ad09-4436-8a0a-7a527dd00c6f] Instance event wait completed in 0 seconds for  {{(pid=75122) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 09:48:08 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-a839251d-1543-43e4-9ab4-3a002a8eff36 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] [instance: 3fbf220d-ad09-4436-8a0a-7a527dd00c6f] Guest created on hypervisor {{(pid=75122) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 09:48:08 user nova-compute[75122]: INFO nova.virt.libvirt.driver [-] [instance: 3fbf220d-ad09-4436-8a0a-7a527dd00c6f] Instance spawned successfully.
Nov 15 09:48:08 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-a839251d-1543-43e4-9ab4-3a002a8eff36 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] [instance: 3fbf220d-ad09-4436-8a0a-7a527dd00c6f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 09:48:08 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-a839251d-1543-43e4-9ab4-3a002a8eff36 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] [instance: 3fbf220d-ad09-4436-8a0a-7a527dd00c6f] Found default for hw_cdrom_bus of ide {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:48:08 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-a839251d-1543-43e4-9ab4-3a002a8eff36 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] [instance: 3fbf220d-ad09-4436-8a0a-7a527dd00c6f] Found default for hw_disk_bus of virtio {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:48:08 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-a839251d-1543-43e4-9ab4-3a002a8eff36 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] [instance: 3fbf220d-ad09-4436-8a0a-7a527dd00c6f] Found default for hw_input_bus of None {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:48:08 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-a839251d-1543-43e4-9ab4-3a002a8eff36 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] [instance: 3fbf220d-ad09-4436-8a0a-7a527dd00c6f] Found default for hw_pointer_model of None {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:48:08 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-a839251d-1543-43e4-9ab4-3a002a8eff36 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] [instance: 3fbf220d-ad09-4436-8a0a-7a527dd00c6f] Found default for hw_video_model of virtio {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:48:08 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-a839251d-1543-43e4-9ab4-3a002a8eff36 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] [instance: 3fbf220d-ad09-4436-8a0a-7a527dd00c6f] Found default for hw_vif_model of virtio {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:48:08 user nova-compute[75122]: INFO nova.compute.manager [None req-a839251d-1543-43e4-9ab4-3a002a8eff36 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] [instance: 3fbf220d-ad09-4436-8a0a-7a527dd00c6f] Took 5.44 seconds to spawn the instance on the hypervisor.
Nov 15 09:48:08 user nova-compute[75122]: DEBUG nova.compute.manager [None req-a839251d-1543-43e4-9ab4-3a002a8eff36 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] [instance: 3fbf220d-ad09-4436-8a0a-7a527dd00c6f] Checking state {{(pid=75122) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 09:48:08 user nova-compute[75122]: DEBUG nova.compute.manager [req-ae00ffdd-f8d6-4e6f-a3b2-1b00de5ace48 req-37fbc4fd-c97a-40e9-81f0-0e6ca611b927 service nova] [instance: 3fbf220d-ad09-4436-8a0a-7a527dd00c6f] Received event network-vif-plugged-e5cf676d-827d-4867-8846-b468acff8b6d {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:48:08 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-ae00ffdd-f8d6-4e6f-a3b2-1b00de5ace48 req-37fbc4fd-c97a-40e9-81f0-0e6ca611b927 service nova] Acquiring lock "3fbf220d-ad09-4436-8a0a-7a527dd00c6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:48:08 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-ae00ffdd-f8d6-4e6f-a3b2-1b00de5ace48 req-37fbc4fd-c97a-40e9-81f0-0e6ca611b927 service nova] Lock "3fbf220d-ad09-4436-8a0a-7a527dd00c6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:48:08 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-ae00ffdd-f8d6-4e6f-a3b2-1b00de5ace48 req-37fbc4fd-c97a-40e9-81f0-0e6ca611b927 service nova] Lock "3fbf220d-ad09-4436-8a0a-7a527dd00c6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:48:08 user nova-compute[75122]: DEBUG nova.compute.manager [req-ae00ffdd-f8d6-4e6f-a3b2-1b00de5ace48 req-37fbc4fd-c97a-40e9-81f0-0e6ca611b927 service nova] [instance: 3fbf220d-ad09-4436-8a0a-7a527dd00c6f] No waiting events found dispatching network-vif-plugged-e5cf676d-827d-4867-8846-b468acff8b6d {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:48:08 user nova-compute[75122]: WARNING nova.compute.manager [req-ae00ffdd-f8d6-4e6f-a3b2-1b00de5ace48 req-37fbc4fd-c97a-40e9-81f0-0e6ca611b927 service nova] [instance: 3fbf220d-ad09-4436-8a0a-7a527dd00c6f] Received unexpected event network-vif-plugged-e5cf676d-827d-4867-8846-b468acff8b6d for instance with vm_state building and task_state spawning.
Nov 15 09:48:08 user nova-compute[75122]: INFO nova.compute.manager [None req-a839251d-1543-43e4-9ab4-3a002a8eff36 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] [instance: 3fbf220d-ad09-4436-8a0a-7a527dd00c6f] Took 6.23 seconds to build instance.
Nov 15 09:48:08 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-a839251d-1543-43e4-9ab4-3a002a8eff36 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Lock "3fbf220d-ad09-4436-8a0a-7a527dd00c6f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.326s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:48:09 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:48:11 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:48:12 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-de90b66d-2af8-4c92-b9bb-40036280a94c tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Acquiring lock "cc485c6c-5a9a-4c94-b966-68dd9e336e56" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:48:12 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-de90b66d-2af8-4c92-b9bb-40036280a94c tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Lock "cc485c6c-5a9a-4c94-b966-68dd9e336e56" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:48:12 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-de90b66d-2af8-4c92-b9bb-40036280a94c tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Acquiring lock "cc485c6c-5a9a-4c94-b966-68dd9e336e56-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:48:12 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-de90b66d-2af8-4c92-b9bb-40036280a94c tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Lock "cc485c6c-5a9a-4c94-b966-68dd9e336e56-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:48:12 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-de90b66d-2af8-4c92-b9bb-40036280a94c tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Lock "cc485c6c-5a9a-4c94-b966-68dd9e336e56-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:48:12 user nova-compute[75122]: INFO nova.compute.manager [None req-de90b66d-2af8-4c92-b9bb-40036280a94c tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] [instance: cc485c6c-5a9a-4c94-b966-68dd9e336e56] Terminating instance
Nov 15 09:48:12 user nova-compute[75122]: DEBUG nova.compute.manager [None req-de90b66d-2af8-4c92-b9bb-40036280a94c tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] [instance: cc485c6c-5a9a-4c94-b966-68dd9e336e56] Start destroying the instance on the hypervisor. {{(pid=75122) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 09:48:12 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:48:12 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:48:12 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:48:12 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:48:12 user nova-compute[75122]: DEBUG nova.compute.manager [req-2fc754ef-14a5-4840-96cd-3d0ea3ff785d req-15a81ae8-e39d-487a-be99-94a64dcca98f service nova] [instance: cc485c6c-5a9a-4c94-b966-68dd9e336e56] Received event network-vif-unplugged-d3b26bb1-8ddd-4467-af3e-74e39d54390e {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:48:12 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-2fc754ef-14a5-4840-96cd-3d0ea3ff785d req-15a81ae8-e39d-487a-be99-94a64dcca98f service nova] Acquiring lock "cc485c6c-5a9a-4c94-b966-68dd9e336e56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:48:12 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-2fc754ef-14a5-4840-96cd-3d0ea3ff785d req-15a81ae8-e39d-487a-be99-94a64dcca98f service nova] Lock "cc485c6c-5a9a-4c94-b966-68dd9e336e56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:48:12 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-2fc754ef-14a5-4840-96cd-3d0ea3ff785d req-15a81ae8-e39d-487a-be99-94a64dcca98f service nova] Lock "cc485c6c-5a9a-4c94-b966-68dd9e336e56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:48:12 user nova-compute[75122]: DEBUG nova.compute.manager [req-2fc754ef-14a5-4840-96cd-3d0ea3ff785d req-15a81ae8-e39d-487a-be99-94a64dcca98f service nova] [instance: cc485c6c-5a9a-4c94-b966-68dd9e336e56] No waiting events found dispatching network-vif-unplugged-d3b26bb1-8ddd-4467-af3e-74e39d54390e {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:48:12 user nova-compute[75122]: DEBUG nova.compute.manager [req-2fc754ef-14a5-4840-96cd-3d0ea3ff785d req-15a81ae8-e39d-487a-be99-94a64dcca98f service nova] [instance: cc485c6c-5a9a-4c94-b966-68dd9e336e56] Received event network-vif-unplugged-d3b26bb1-8ddd-4467-af3e-74e39d54390e for instance with task_state deleting. {{(pid=75122) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 09:48:13 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:48:13 user nova-compute[75122]: INFO nova.virt.libvirt.driver [-] [instance: cc485c6c-5a9a-4c94-b966-68dd9e336e56] Instance destroyed successfully.
Nov 15 09:48:13 user nova-compute[75122]: DEBUG nova.objects.instance [None req-de90b66d-2af8-4c92-b9bb-40036280a94c tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Lazy-loading 'resources' on Instance uuid cc485c6c-5a9a-4c94-b966-68dd9e336e56 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:48:13 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-de90b66d-2af8-4c92-b9bb-40036280a94c tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T09:41:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-876462161',display_name='tempest-ServerActionsTestOtherA-server-876462161',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-876462161',id=28,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOjee/3FY3+bQUxkeNPW0HfKU2TS7/WwlSdJA5dC2LRbPtr2GAllBrZqAcx+1wIVC2pqAFLTFeo/KsxadKKcxACsVLYL8LB97mDl41CXm0aq5TWX4fm1S5aOkZSs0D2eNA==',key_name='tempest-keypair-686734186',keypairs=<?>,launch_index=0,launched_at=2023-11-15T09:43:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8b8e67f8a66a4930be3fb65c397cbeb2',ramdisk_id='',reservation_id='r-50r2vzfz',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1521412552',owner_user_name='tempest-ServerActionsTestOtherA-1521412552-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T09:45:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='91f1469b2c7c45d6ac27f2b64fd5cefe',uuid=cc485c6c-5a9a-4c94-b966-68dd9e336e56,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d3b26bb1-8ddd-4467-af3e-74e39d54390e", "address": "fa:16:3e:8c:a9:0b", "network": {"id": "6e846655-a6f8-4339-a239-65d2f94c8b74", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1923452032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b8e67f8a66a4930be3fb65c397cbeb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3b26bb1-8d", "ovs_interfaceid": "d3b26bb1-8ddd-4467-af3e-74e39d54390e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 09:48:13 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-de90b66d-2af8-4c92-b9bb-40036280a94c tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Converting VIF {"id": "d3b26bb1-8ddd-4467-af3e-74e39d54390e", "address": "fa:16:3e:8c:a9:0b", "network": {"id": "6e846655-a6f8-4339-a239-65d2f94c8b74", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1923452032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b8e67f8a66a4930be3fb65c397cbeb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3b26bb1-8d", "ovs_interfaceid": "d3b26bb1-8ddd-4467-af3e-74e39d54390e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 09:48:13 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-de90b66d-2af8-4c92-b9bb-40036280a94c tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8c:a9:0b,bridge_name='br-int',has_traffic_filtering=True,id=d3b26bb1-8ddd-4467-af3e-74e39d54390e,network=Network(6e846655-a6f8-4339-a239-65d2f94c8b74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3b26bb1-8d') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 09:48:13 user nova-compute[75122]: DEBUG os_vif [None req-de90b66d-2af8-4c92-b9bb-40036280a94c tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8c:a9:0b,bridge_name='br-int',has_traffic_filtering=True,id=d3b26bb1-8ddd-4467-af3e-74e39d54390e,network=Network(6e846655-a6f8-4339-a239-65d2f94c8b74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3b26bb1-8d') {{(pid=75122) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 09:48:13 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:48:13 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd3b26bb1-8d, bridge=br-int, if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:48:13 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:48:13 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:48:13 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:48:13 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4055392c-ecd6-49f8-a98f-213c61be732c) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:48:13 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:48:13 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:48:13 user nova-compute[75122]: INFO os_vif [None req-de90b66d-2af8-4c92-b9bb-40036280a94c tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8c:a9:0b,bridge_name='br-int',has_traffic_filtering=True,id=d3b26bb1-8ddd-4467-af3e-74e39d54390e,network=Network(6e846655-a6f8-4339-a239-65d2f94c8b74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3b26bb1-8d')
Nov 15 09:48:13 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de90b66d-2af8-4c92-b9bb-40036280a94c tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] [instance: cc485c6c-5a9a-4c94-b966-68dd9e336e56] calling os-brick to detach iSCSI Volume {{(pid=75122) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 09:48:13 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-de90b66d-2af8-4c92-b9bb-40036280a94c tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffa04060b80>, {'target_iqn': 'iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DdRJNhXT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 09:48:13 user nova-compute[75122]: WARNING os_brick.initiator.connectors.base [None req-de90b66d-2af8-4c92-b9bb-40036280a94c tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 09:48:13 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-de90b66d-2af8-4c92-b9bb-40036280a94c tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 09:48:13 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-de90b66d-2af8-4c92-b9bb-40036280a94c tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 09:48:13 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:48:13 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:48:13 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[35ab726b-22e5-49e4-969f-1c4931b0e0fd]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6cd246c1-08d6-43ce-b2b5-2a6c42e46135\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6224c0df-13b0-4ff7-928f-9a2282386a2a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:48:13 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-de90b66d-2af8-4c92-b9bb-40036280a94c tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 09:48:13 user nova-compute[75122]: No targets found.
Nov 15 09:48:13 user nova-compute[75122]: iSNS:
Nov 15 09:48:13 user nova-compute[75122]: No targets found.
Nov 15 09:48:13 user nova-compute[75122]: STATIC:
Nov 15 09:48:13 user nova-compute[75122]: Target: iqn.2010-10.org.openstack:6cd246c1-08d6-43ce-b2b5-2a6c42e46135
Nov 15 09:48:13 user nova-compute[75122]:         Portal: 172.16.0.220:3260,-1
Nov 15 09:48:13 user nova-compute[75122]:                 Iface Name: default
Nov 15 09:48:13 user nova-compute[75122]: Target: iqn.2010-10.org.openstack:6224c0df-13b0-4ff7-928f-9a2282386a2a
Nov 15 09:48:13 user nova-compute[75122]:         Portal: 172.16.0.220:3260,-1
Nov 15 09:48:13 user nova-compute[75122]:                 Iface Name: default
Nov 15 09:48:13 user nova-compute[75122]: Target: iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17
Nov 15 09:48:13 user nova-compute[75122]:         Portal: 172.16.0.220:3260,-1
Nov 15 09:48:13 user nova-compute[75122]:                 Iface Name: default
Nov 15 09:48:13 user nova-compute[75122]: FIRMWARE:
Nov 15 09:48:13 user nova-compute[75122]: No targets found.
Nov 15 09:48:13 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 09:48:13 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-de90b66d-2af8-4c92-b9bb-40036280a94c tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 09:48:13 user nova-compute[75122]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 09:48:13 user nova-compute[75122]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75122) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 09:48:13 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-de90b66d-2af8-4c92-b9bb-40036280a94c tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17', 0)] {{(pid=75122) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 09:48:13 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:48:13 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:48:13 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[b36b39ec-605f-4103-ac8f-512e9ecdc5f9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6224c0df-13b0-4ff7-928f-9a2282386a2a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6cd246c1-08d6-43ce-b2b5-2a6c42e46135\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:48:13 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:48:13 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:48:13 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[62ecea8b-0367-40e6-ad39-adad6bfc27f7]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6224c0df-13b0-4ff7-928f-9a2282386a2a (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cd246c1-08d6-43ce-b2b5-2a6c42e46135 (non-flash)\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:48:13 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-de90b66d-2af8-4c92-b9bb-40036280a94c tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17 (non-flash)
Nov 15 09:48:13 user nova-compute[75122]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6224c0df-13b0-4ff7-928f-9a2282386a2a (non-flash)
Nov 15 09:48:13 user nova-compute[75122]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cd246c1-08d6-43ce-b2b5-2a6c42e46135 (non-flash)
Nov 15 09:48:13 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 09:48:13 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-de90b66d-2af8-4c92-b9bb-40036280a94c tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17 (non-flash)
Nov 15 09:48:13 user nova-compute[75122]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6224c0df-13b0-4ff7-928f-9a2282386a2a (non-flash)
Nov 15 09:48:13 user nova-compute[75122]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cd246c1-08d6-43ce-b2b5-2a6c42e46135 (non-flash)
Nov 15 09:48:13 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 09:48:13 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-de90b66d-2af8-4c92-b9bb-40036280a94c tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff9e4330af0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17'): ({'sdb'}, set())}) {{(pid=75122) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 09:48:13 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-de90b66d-2af8-4c92-b9bb-40036280a94c tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Removing single pathed devices sdb {{(pid=75122) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 09:48:13 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:48:13 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:48:13 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d1694d2-5e3d-440e-92c2-c0e614ab3d24]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:48:13 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:48:13 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:48:13 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[d637a7c9-df09-48a8-a693-44bcafd2d2a5]: (4, ('ok\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:48:13 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-de90b66d-2af8-4c92-b9bb-40036280a94c tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Flushing IO for device /dev/sdb {{(pid=75122) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 09:48:13 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:48:13 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:48:13 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[be55ea3c-2b9a-41e1-b417-53eff289ac08]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:48:13 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-de90b66d-2af8-4c92-b9bb-40036280a94c tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75122) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 09:48:13 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:48:13 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.073s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:48:13 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d127c45-3d8b-4c5a-9461-b945c534335f]: (4, ('1', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:48:13 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-de90b66d-2af8-4c92-b9bb-40036280a94c tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75122) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 09:48:13 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-de90b66d-2af8-4c92-b9bb-40036280a94c tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] SCSI volumes sdb have been removed. {{(pid=75122) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 09:48:13 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-de90b66d-2af8-4c92-b9bb-40036280a94c tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17')] {{(pid=75122) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 09:48:13 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:48:13 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:48:13 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[025c5079-422b-4c28-a8f4-85ff854c0b5e]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:48:13 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-de90b66d-2af8-4c92-b9bb-40036280a94c tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:48:13 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17 -p 172.16.0.220:3260 --logout {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:48:13 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17 -p 172.16.0.220:3260 --logout" returned: 0 in 0.043s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:48:13 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[be37879c-57b7-409a-9c10-795c033c376d]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:48:13 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-de90b66d-2af8-4c92-b9bb-40036280a94c tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17, portal: 172.16.0.220,3260]
Nov 15 09:48:13 user nova-compute[75122]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17, portal: 172.16.0.220,3260] successful.
Nov 15 09:48:13 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:48:13 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17 -p 172.16.0.220:3260 --op delete {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:48:13 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5aa0e3ae-4004-414c-b0c9-8c089c420c17 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:48:13 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[217d0093-a608-44a4-b2f2-1e78538faccd]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:48:13 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-de90b66d-2af8-4c92-b9bb-40036280a94c tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:48:13 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-de90b66d-2af8-4c92-b9bb-40036280a94c tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.334s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 09:48:13 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-de90b66d-2af8-4c92-b9bb-40036280a94c tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] <== disconnect_volume: return (335ms) None {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 09:48:13 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de90b66d-2af8-4c92-b9bb-40036280a94c tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] [instance: cc485c6c-5a9a-4c94-b966-68dd9e336e56] Disconnected iSCSI Volume {{(pid=75122) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 09:48:13 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-de90b66d-2af8-4c92-b9bb-40036280a94c tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] [instance: cc485c6c-5a9a-4c94-b966-68dd9e336e56] Deleting instance files /opt/stack/data/nova/instances/cc485c6c-5a9a-4c94-b966-68dd9e336e56_del
Nov 15 09:48:13 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-de90b66d-2af8-4c92-b9bb-40036280a94c tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] [instance: cc485c6c-5a9a-4c94-b966-68dd9e336e56] Deletion of /opt/stack/data/nova/instances/cc485c6c-5a9a-4c94-b966-68dd9e336e56_del complete
Nov 15 09:48:13 user nova-compute[75122]: INFO nova.compute.manager [None req-de90b66d-2af8-4c92-b9bb-40036280a94c tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] [instance: cc485c6c-5a9a-4c94-b966-68dd9e336e56] Took 1.26 seconds to destroy the instance on the hypervisor.
Nov 15 09:48:13 user nova-compute[75122]: DEBUG oslo.service.loopingcall [None req-de90b66d-2af8-4c92-b9bb-40036280a94c tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75122) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 09:48:13 user nova-compute[75122]: DEBUG nova.compute.manager [-] [instance: cc485c6c-5a9a-4c94-b966-68dd9e336e56] Deallocating network for instance {{(pid=75122) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 09:48:13 user nova-compute[75122]: DEBUG nova.network.neutron [-] [instance: cc485c6c-5a9a-4c94-b966-68dd9e336e56] deallocate_for_instance() {{(pid=75122) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 09:48:14 user nova-compute[75122]: DEBUG nova.compute.manager [req-6fe7cd63-abc3-4b98-bcd8-152ff0af5e19 req-95b4e866-c9f6-489d-ae21-a7cebc0fcdfd service nova] [instance: cc485c6c-5a9a-4c94-b966-68dd9e336e56] Received event network-vif-plugged-d3b26bb1-8ddd-4467-af3e-74e39d54390e {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:48:14 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-6fe7cd63-abc3-4b98-bcd8-152ff0af5e19 req-95b4e866-c9f6-489d-ae21-a7cebc0fcdfd service nova] Acquiring lock "cc485c6c-5a9a-4c94-b966-68dd9e336e56-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:48:14 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-6fe7cd63-abc3-4b98-bcd8-152ff0af5e19 req-95b4e866-c9f6-489d-ae21-a7cebc0fcdfd service nova] Lock "cc485c6c-5a9a-4c94-b966-68dd9e336e56-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:48:14 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-6fe7cd63-abc3-4b98-bcd8-152ff0af5e19 req-95b4e866-c9f6-489d-ae21-a7cebc0fcdfd service nova] Lock "cc485c6c-5a9a-4c94-b966-68dd9e336e56-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:48:14 user nova-compute[75122]: DEBUG nova.compute.manager [req-6fe7cd63-abc3-4b98-bcd8-152ff0af5e19 req-95b4e866-c9f6-489d-ae21-a7cebc0fcdfd service nova] [instance: cc485c6c-5a9a-4c94-b966-68dd9e336e56] No waiting events found dispatching network-vif-plugged-d3b26bb1-8ddd-4467-af3e-74e39d54390e {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:48:14 user nova-compute[75122]: WARNING nova.compute.manager [req-6fe7cd63-abc3-4b98-bcd8-152ff0af5e19 req-95b4e866-c9f6-489d-ae21-a7cebc0fcdfd service nova] [instance: cc485c6c-5a9a-4c94-b966-68dd9e336e56] Received unexpected event network-vif-plugged-d3b26bb1-8ddd-4467-af3e-74e39d54390e for instance with vm_state active and task_state deleting.
Nov 15 09:48:14 user nova-compute[75122]: DEBUG nova.network.neutron [-] [instance: cc485c6c-5a9a-4c94-b966-68dd9e336e56] Updating instance_info_cache with network_info: [] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:48:14 user nova-compute[75122]: INFO nova.compute.manager [-] [instance: cc485c6c-5a9a-4c94-b966-68dd9e336e56] Took 1.30 seconds to deallocate network for instance.
Nov 15 09:48:15 user nova-compute[75122]: INFO nova.compute.manager [None req-de90b66d-2af8-4c92-b9bb-40036280a94c tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] [instance: cc485c6c-5a9a-4c94-b966-68dd9e336e56] Took 0.74 seconds to detach 1 volumes for instance.
Nov 15 09:48:15 user nova-compute[75122]: DEBUG nova.compute.manager [None req-de90b66d-2af8-4c92-b9bb-40036280a94c tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] [instance: cc485c6c-5a9a-4c94-b966-68dd9e336e56] Deleting volume: 5aa0e3ae-4004-414c-b0c9-8c089c420c17 {{(pid=75122) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 15 09:48:15 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-de90b66d-2af8-4c92-b9bb-40036280a94c tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:48:15 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-de90b66d-2af8-4c92-b9bb-40036280a94c tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:48:16 user nova-compute[75122]: DEBUG nova.compute.provider_tree [None req-de90b66d-2af8-4c92-b9bb-40036280a94c tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Inventory has not changed in ProviderTree for provider: 69a3da65-47be-44c6-b67c-c692b58284ef {{(pid=75122) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 09:48:16 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-de90b66d-2af8-4c92-b9bb-40036280a94c tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Inventory has not changed for provider 69a3da65-47be-44c6-b67c-c692b58284ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 09:48:16 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-de90b66d-2af8-4c92-b9bb-40036280a94c tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.373s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:48:16 user nova-compute[75122]: INFO nova.scheduler.client.report [None req-de90b66d-2af8-4c92-b9bb-40036280a94c tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Deleted allocations for instance cc485c6c-5a9a-4c94-b966-68dd9e336e56
Nov 15 09:48:16 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-de90b66d-2af8-4c92-b9bb-40036280a94c tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Lock "cc485c6c-5a9a-4c94-b966-68dd9e336e56" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.024s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:48:16 user nova-compute[75122]: DEBUG nova.compute.manager [req-9203c837-bd0c-4d20-a659-b64fc818086e req-20d1390c-e3ab-42b8-b49a-5977b4e02907 service nova] [instance: cc485c6c-5a9a-4c94-b966-68dd9e336e56] Received event network-vif-deleted-d3b26bb1-8ddd-4467-af3e-74e39d54390e {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:48:17 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-713e952b-77b5-4e2e-8e81-2f1be01cf9a0 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Acquiring lock "49154de0-f941-4ae0-a7af-72e75a4d8040" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:48:17 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-713e952b-77b5-4e2e-8e81-2f1be01cf9a0 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Lock "49154de0-f941-4ae0-a7af-72e75a4d8040" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:48:17 user nova-compute[75122]: DEBUG nova.objects.instance [None req-713e952b-77b5-4e2e-8e81-2f1be01cf9a0 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Lazy-loading 'flavor' on Instance uuid 49154de0-f941-4ae0-a7af-72e75a4d8040 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:48:17 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-713e952b-77b5-4e2e-8e81-2f1be01cf9a0 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Lock "49154de0-f941-4ae0-a7af-72e75a4d8040" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:48:18 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-713e952b-77b5-4e2e-8e81-2f1be01cf9a0 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Acquiring lock "49154de0-f941-4ae0-a7af-72e75a4d8040" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:48:18 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-713e952b-77b5-4e2e-8e81-2f1be01cf9a0 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Lock "49154de0-f941-4ae0-a7af-72e75a4d8040" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:48:18 user nova-compute[75122]: INFO nova.compute.manager [None req-713e952b-77b5-4e2e-8e81-2f1be01cf9a0 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] [instance: 49154de0-f941-4ae0-a7af-72e75a4d8040] Attaching volume c3e65739-7eb6-4876-af4c-bfb0db7dcfa3 to /dev/vdb
Nov 15 09:48:18 user nova-compute[75122]: DEBUG os_brick.utils [None req-713e952b-77b5-4e2e-8e81-2f1be01cf9a0 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 09:48:18 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:48:18 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:48:18 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:48:18 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[f42ec50c-3f12-42e1-b814-3f65e2cb5565]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:742fb64b3587\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:48:18 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:48:18 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:48:18 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd5b8b4e-f8de-430b-9f9a-f6e2deb3213b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:48:18 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:48:18 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:48:18 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[4501c0ac-2284-41af-9d35-f73c372b573a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:48:18 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c1e566e-0ce5-4d3c-9662-85a020d9f6f0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:48:18 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-713e952b-77b5-4e2e-8e81-2f1be01cf9a0 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Running cmd (subprocess): nvme version {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:48:18 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-713e952b-77b5-4e2e-8e81-2f1be01cf9a0 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] 'nvme version' failed. Not Retrying. {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 09:48:18 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.nvmeof [None req-713e952b-77b5-4e2e-8e81-2f1be01cf9a0 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] nvme not present on system {{(pid=75122) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 09:48:18 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:48:18 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 09:48:18 user nova-compute[75122]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 09:48:18 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7637989-7d03-45d0-aa5b-b901f10b2691]: (4, '') {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:48:18 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.lightos [None req-713e952b-77b5-4e2e-8e81-2f1be01cf9a0 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75122) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 09:48:18 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.lightos [None req-713e952b-77b5-4e2e-8e81-2f1be01cf9a0 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75122) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 09:48:18 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.lightos [None req-713e952b-77b5-4e2e-8e81-2f1be01cf9a0 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] LIGHTOS: no hostnqn found. {{(pid=75122) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 09:48:18 user nova-compute[75122]: DEBUG os_brick.utils [None req-713e952b-77b5-4e2e-8e81-2f1be01cf9a0 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:742fb64b3587', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 09:48:18 user nova-compute[75122]: DEBUG nova.virt.block_device [None req-713e952b-77b5-4e2e-8e81-2f1be01cf9a0 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] [instance: 49154de0-f941-4ae0-a7af-72e75a4d8040] Updating existing volume attachment record: e682169f-588c-44f3-8a15-55a033835d45 {{(pid=75122) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 09:48:18 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:48:21 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:48:21 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:48:22 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-713e952b-77b5-4e2e-8e81-2f1be01cf9a0 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] [instance: 49154de0-f941-4ae0-a7af-72e75a4d8040] Calling os-brick to attach iSCSI Volume {{(pid=75122) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 09:48:22 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-713e952b-77b5-4e2e-8e81-2f1be01cf9a0 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffa04060b80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c3e65739-7eb6-4876-af4c-bfb0db7dcfa3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ckStLEqn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 09:48:22 user nova-compute[75122]: WARNING os_brick.initiator.connectors.base [None req-713e952b-77b5-4e2e-8e81-2f1be01cf9a0 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 09:48:22 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-713e952b-77b5-4e2e-8e81-2f1be01cf9a0 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 09:48:22 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-713e952b-77b5-4e2e-8e81-2f1be01cf9a0 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 09:48:22 user nova-compute[75122]: WARNING os_brick.initiator.connectors.base [None req-713e952b-77b5-4e2e-8e81-2f1be01cf9a0 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 09:48:22 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-713e952b-77b5-4e2e-8e81-2f1be01cf9a0 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c3e65739-7eb6-4876-af4c-bfb0db7dcfa3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 09:48:22 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-713e952b-77b5-4e2e-8e81-2f1be01cf9a0 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c3e65739-7eb6-4876-af4c-bfb0db7dcfa3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 09:48:22 user nova-compute[75122]: INFO os_brick.initiator.connectors.iscsi [None req-713e952b-77b5-4e2e-8e81-2f1be01cf9a0 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 09:48:22 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3e65739-7eb6-4876-af4c-bfb0db7dcfa3 -p 172.16.0.220:3260 {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:48:22 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3e65739-7eb6-4876-af4c-bfb0db7dcfa3 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:48:22 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[b869dcd1-e514-4b19-b814-ca3c89aa773a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:48:22 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-713e952b-77b5-4e2e-8e81-2f1be01cf9a0 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 09:48:22 user nova-compute[75122]:  {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:48:22 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3e65739-7eb6-4876-af4c-bfb0db7dcfa3 -p 172.16.0.220:3260 --interface default --op new {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:48:22 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3e65739-7eb6-4876-af4c-bfb0db7dcfa3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:48:22 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[11b9c313-6525-4e22-91af-5ffe781c3547]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c3e65739-7eb6-4876-af4c-bfb0db7dcfa3] added\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:48:22 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-713e952b-77b5-4e2e-8e81-2f1be01cf9a0 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c3e65739-7eb6-4876-af4c-bfb0db7dcfa3] added
Nov 15 09:48:22 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:48:22 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3e65739-7eb6-4876-af4c-bfb0db7dcfa3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:48:23 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3e65739-7eb6-4876-af4c-bfb0db7dcfa3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:48:23 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2a4eafb-3771-40e8-8e03-66ca2e86272a]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:48:23 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-713e952b-77b5-4e2e-8e81-2f1be01cf9a0 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:48:23 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3e65739-7eb6-4876-af4c-bfb0db7dcfa3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:48:23 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3e65739-7eb6-4876-af4c-bfb0db7dcfa3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:48:23 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[99ba8765-45d2-4efb-ab10-f4ea9498fbbc]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:48:23 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-713e952b-77b5-4e2e-8e81-2f1be01cf9a0 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:48:23 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3e65739-7eb6-4876-af4c-bfb0db7dcfa3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ckStLEqn {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:48:23 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3e65739-7eb6-4876-af4c-bfb0db7dcfa3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ckStLEqn" returned: 0 in 0.016s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:48:23 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a048f61-e51a-47c5-b80a-764a05052a57]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:48:23 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-713e952b-77b5-4e2e-8e81-2f1be01cf9a0 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ckStLEqn'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:48:23 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3e65739-7eb6-4876-af4c-bfb0db7dcfa3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:48:23 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3e65739-7eb6-4876-af4c-bfb0db7dcfa3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:48:23 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c2f4599-cfae-4153-a1c0-4bef16a2372f]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:48:23 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-713e952b-77b5-4e2e-8e81-2f1be01cf9a0 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:48:23 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:48:23 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:48:23 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4758fb6-e36b-4773-893b-a59f10fe238c]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6224c0df-13b0-4ff7-928f-9a2282386a2a (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cd246c1-08d6-43ce-b2b5-2a6c42e46135 (non-flash)\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:48:23 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-713e952b-77b5-4e2e-8e81-2f1be01cf9a0 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6224c0df-13b0-4ff7-928f-9a2282386a2a (non-flash)
Nov 15 09:48:23 user nova-compute[75122]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cd246c1-08d6-43ce-b2b5-2a6c42e46135 (non-flash)
Nov 15 09:48:23 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 09:48:23 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-713e952b-77b5-4e2e-8e81-2f1be01cf9a0 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6224c0df-13b0-4ff7-928f-9a2282386a2a (non-flash)
Nov 15 09:48:23 user nova-compute[75122]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cd246c1-08d6-43ce-b2b5-2a6c42e46135 (non-flash)
Nov 15 09:48:23 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 09:48:23 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3e65739-7eb6-4876-af4c-bfb0db7dcfa3 -p 172.16.0.220:3260 --login {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:48:23 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:48:23 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3e65739-7eb6-4876-af4c-bfb0db7dcfa3 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:48:23 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[95539101-2b87-47c7-b434-cb652ac20622]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c3e65739-7eb6-4876-af4c-bfb0db7dcfa3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c3e65739-7eb6-4876-af4c-bfb0db7dcfa3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:48:23 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-713e952b-77b5-4e2e-8e81-2f1be01cf9a0 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c3e65739-7eb6-4876-af4c-bfb0db7dcfa3, portal: 172.16.0.220,3260]
Nov 15 09:48:23 user nova-compute[75122]: Login to [iface: default, target: iqn.2010-10.org.openstack:c3e65739-7eb6-4876-af4c-bfb0db7dcfa3, portal: 172.16.0.220,3260] successful.
Nov 15 09:48:23 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:48:23 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3e65739-7eb6-4876-af4c-bfb0db7dcfa3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:48:23 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3e65739-7eb6-4876-af4c-bfb0db7dcfa3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:48:23 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[aec437d0-4dbd-42c4-9a8a-99b728e525da]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:48:23 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-713e952b-77b5-4e2e-8e81-2f1be01cf9a0 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:48:23 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:48:23 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:48:23 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Starting heal instance info cache {{(pid=75122) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 09:48:23 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:48:23 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab06a0e7-35f3-45c2-b7f8-2e840880bf71]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6224c0df-13b0-4ff7-928f-9a2282386a2a (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cd246c1-08d6-43ce-b2b5-2a6c42e46135 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3e65739-7eb6-4876-af4c-bfb0db7dcfa3 (non-flash)\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:48:23 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-713e952b-77b5-4e2e-8e81-2f1be01cf9a0 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6224c0df-13b0-4ff7-928f-9a2282386a2a (non-flash)
Nov 15 09:48:23 user nova-compute[75122]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cd246c1-08d6-43ce-b2b5-2a6c42e46135 (non-flash)
Nov 15 09:48:23 user nova-compute[75122]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3e65739-7eb6-4876-af4c-bfb0db7dcfa3 (non-flash)
Nov 15 09:48:23 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 09:48:23 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-713e952b-77b5-4e2e-8e81-2f1be01cf9a0 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6224c0df-13b0-4ff7-928f-9a2282386a2a (non-flash)
Nov 15 09:48:23 user nova-compute[75122]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cd246c1-08d6-43ce-b2b5-2a6c42e46135 (non-flash)
Nov 15 09:48:23 user nova-compute[75122]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3e65739-7eb6-4876-af4c-bfb0db7dcfa3 (non-flash)
Nov 15 09:48:23 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 09:48:23 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-713e952b-77b5-4e2e-8e81-2f1be01cf9a0 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c3e65739-7eb6-4876-af4c-bfb0db7dcfa3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.270s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 09:48:23 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-713e952b-77b5-4e2e-8e81-2f1be01cf9a0 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Connected to 172.16.0.220:3260 {{(pid=75122) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 09:48:23 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-713e952b-77b5-4e2e-8e81-2f1be01cf9a0 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] HCTL ('33', '-', '-', 0) found on session 44 with lun 0 {{(pid=75122) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 09:48:23 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-713e952b-77b5-4e2e-8e81-2f1be01cf9a0 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75122) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 09:48:23 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:48:23 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:48:23 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[130842f2-7f84-4171-bae2-643b0fedb363]: (4, ('- - 0', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:48:23 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-713e952b-77b5-4e2e-8e81-2f1be01cf9a0 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Searching for a device in session 44 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75122) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 09:48:23 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-713e952b-77b5-4e2e-8e81-2f1be01cf9a0 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:c3e65739-7eb6-4876-af4c-bfb0db7dcfa3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ckStLEqn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75122) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 09:48:23 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "refresh_cache-00270cc2-4f5b-4f64-8f88-31f21e3b3950" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 09:48:23 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquired lock "refresh_cache-00270cc2-4f5b-4f64-8f88-31f21e3b3950" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 09:48:23 user nova-compute[75122]: DEBUG nova.network.neutron [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] [instance: 00270cc2-4f5b-4f64-8f88-31f21e3b3950] Forcefully refreshing network info cache for instance {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 09:48:23 user nova-compute[75122]: DEBUG nova.network.neutron [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] [instance: 00270cc2-4f5b-4f64-8f88-31f21e3b3950] Updating instance_info_cache with network_info: [{"id": "bb6552dc-ebef-427a-beea-b41083f05e70", "address": "fa:16:3e:44:9c:f9", "network": {"id": "c2062f64-d925-42d2-9687-5d2511ef6697", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1134087048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eeff24cb28f5481fa3941ba399ce82ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb6552dc-eb", "ovs_interfaceid": "bb6552dc-ebef-427a-beea-b41083f05e70", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:48:23 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Releasing lock "refresh_cache-00270cc2-4f5b-4f64-8f88-31f21e3b3950" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 09:48:23 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] [instance: 00270cc2-4f5b-4f64-8f88-31f21e3b3950] Updated the network info_cache for instance {{(pid=75122) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 09:48:24 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:48:24 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-713e952b-77b5-4e2e-8e81-2f1be01cf9a0 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.304s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 09:48:24 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-713e952b-77b5-4e2e-8e81-2f1be01cf9a0 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] <== connect_volume: return (1306ms) {'type': 'block', 'scsi_wwn': '23134373638656134', 'path': '/dev/sdb'} {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 09:48:24 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-713e952b-77b5-4e2e-8e81-2f1be01cf9a0 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] [instance: 49154de0-f941-4ae0-a7af-72e75a4d8040] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23134373638656134', 'path': '/dev/sdb'} {{(pid=75122) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 09:48:24 user nova-compute[75122]: DEBUG nova.objects.instance [None req-713e952b-77b5-4e2e-8e81-2f1be01cf9a0 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Lazy-loading 'flavor' on Instance uuid 49154de0-f941-4ae0-a7af-72e75a4d8040 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:48:24 user nova-compute[75122]: DEBUG nova.virt.libvirt.guest [None req-713e952b-77b5-4e2e-8e81-2f1be01cf9a0 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 09:48:24 user nova-compute[75122]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 09:48:24 user nova-compute[75122]:   <source dev="/dev/sdb"/>
Nov 15 09:48:24 user nova-compute[75122]:   <target dev="vdb" bus="virtio"/>
Nov 15 09:48:24 user nova-compute[75122]:   <serial>c3e65739-7eb6-4876-af4c-bfb0db7dcfa3</serial>
Nov 15 09:48:24 user nova-compute[75122]: </disk>
Nov 15 09:48:24 user nova-compute[75122]:  {{(pid=75122) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 09:48:24 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-713e952b-77b5-4e2e-8e81-2f1be01cf9a0 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] No BDM found with device name vda, not building metadata. {{(pid=75122) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 09:48:24 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-713e952b-77b5-4e2e-8e81-2f1be01cf9a0 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75122) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 09:48:24 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-713e952b-77b5-4e2e-8e81-2f1be01cf9a0 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] No VIF found with MAC fa:16:3e:9a:6e:b1, not building metadata {{(pid=75122) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 09:48:24 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-713e952b-77b5-4e2e-8e81-2f1be01cf9a0 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Lock "49154de0-f941-4ae0-a7af-72e75a4d8040" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.776s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:48:25 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:48:26 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:48:26 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:48:26 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:48:26 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:48:26 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:48:26 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:48:26 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75122) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 09:48:26 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc80e3fb-b5a3-4685-8ec5-12f8c385b833/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:48:26 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:48:26 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc80e3fb-b5a3-4685-8ec5-12f8c385b833/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:48:26 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc80e3fb-b5a3-4685-8ec5-12f8c385b833/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:48:26 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc80e3fb-b5a3-4685-8ec5-12f8c385b833/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:48:26 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=75122) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 09:48:26 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd9d52bb-6248-48e6-a798-6dbdaaa68cbc/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:48:27 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd9d52bb-6248-48e6-a798-6dbdaaa68cbc/disk --force-share --output=json" returned: 0 in 0.326s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:48:27 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd9d52bb-6248-48e6-a798-6dbdaaa68cbc/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:48:27 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd9d52bb-6248-48e6-a798-6dbdaaa68cbc/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:48:27 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49154de0-f941-4ae0-a7af-72e75a4d8040/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:48:27 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-447383cb-2222-42ca-b1ee-d84847b5ad39 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Acquiring lock "49154de0-f941-4ae0-a7af-72e75a4d8040" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:48:27 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-447383cb-2222-42ca-b1ee-d84847b5ad39 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Lock "49154de0-f941-4ae0-a7af-72e75a4d8040" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.003s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:48:27 user nova-compute[75122]: INFO nova.compute.manager [None req-447383cb-2222-42ca-b1ee-d84847b5ad39 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] [instance: 49154de0-f941-4ae0-a7af-72e75a4d8040] Detaching volume c3e65739-7eb6-4876-af4c-bfb0db7dcfa3
Nov 15 09:48:27 user nova-compute[75122]: INFO nova.virt.block_device [None req-447383cb-2222-42ca-b1ee-d84847b5ad39 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] [instance: 49154de0-f941-4ae0-a7af-72e75a4d8040] Attempting to driver detach volume c3e65739-7eb6-4876-af4c-bfb0db7dcfa3 from mountpoint /dev/vdb
Nov 15 09:48:27 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-447383cb-2222-42ca-b1ee-d84847b5ad39 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Attempting to detach device vdb from instance 49154de0-f941-4ae0-a7af-72e75a4d8040 from the persistent domain config. {{(pid=75122) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 09:48:27 user nova-compute[75122]: DEBUG nova.virt.libvirt.guest [None req-447383cb-2222-42ca-b1ee-d84847b5ad39 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 09:48:27 user nova-compute[75122]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 09:48:27 user nova-compute[75122]:   <source dev="/dev/sdb"/>
Nov 15 09:48:27 user nova-compute[75122]:   <target dev="vdb" bus="virtio"/>
Nov 15 09:48:27 user nova-compute[75122]:   <serial>c3e65739-7eb6-4876-af4c-bfb0db7dcfa3</serial>
Nov 15 09:48:27 user nova-compute[75122]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 09:48:27 user nova-compute[75122]: </disk>
Nov 15 09:48:27 user nova-compute[75122]:  {{(pid=75122) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 09:48:27 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-447383cb-2222-42ca-b1ee-d84847b5ad39 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Successfully detached device vdb from instance 49154de0-f941-4ae0-a7af-72e75a4d8040 from the persistent domain config.
Nov 15 09:48:27 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-447383cb-2222-42ca-b1ee-d84847b5ad39 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 49154de0-f941-4ae0-a7af-72e75a4d8040 from the live domain config. {{(pid=75122) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 09:48:27 user nova-compute[75122]: DEBUG nova.virt.libvirt.guest [None req-447383cb-2222-42ca-b1ee-d84847b5ad39 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 09:48:27 user nova-compute[75122]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 09:48:27 user nova-compute[75122]:   <source dev="/dev/sdb"/>
Nov 15 09:48:27 user nova-compute[75122]:   <target dev="vdb" bus="virtio"/>
Nov 15 09:48:27 user nova-compute[75122]:   <serial>c3e65739-7eb6-4876-af4c-bfb0db7dcfa3</serial>
Nov 15 09:48:27 user nova-compute[75122]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 09:48:27 user nova-compute[75122]: </disk>
Nov 15 09:48:27 user nova-compute[75122]:  {{(pid=75122) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 09:48:27 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49154de0-f941-4ae0-a7af-72e75a4d8040/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:48:27 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49154de0-f941-4ae0-a7af-72e75a4d8040/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:48:27 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49154de0-f941-4ae0-a7af-72e75a4d8040/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:48:27 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75122) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 09:48:27 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/131142fd-e8ec-42d1-a518-aa21c7bb7cb1/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:48:27 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/131142fd-e8ec-42d1-a518-aa21c7bb7cb1/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:48:27 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/131142fd-e8ec-42d1-a518-aa21c7bb7cb1/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:48:28 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-447383cb-2222-42ca-b1ee-d84847b5ad39 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 49154de0-f941-4ae0-a7af-72e75a4d8040 {{(pid=75122) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 09:48:28 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:48:28 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/131142fd-e8ec-42d1-a518-aa21c7bb7cb1/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:48:28 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8271a429-e252-42bb-8717-e89dfd9739bf/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:48:28 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8271a429-e252-42bb-8717-e89dfd9739bf/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:48:28 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8271a429-e252-42bb-8717-e89dfd9739bf/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:48:28 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8271a429-e252-42bb-8717-e89dfd9739bf/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:48:28 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75122) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 09:48:28 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fbf220d-ad09-4436-8a0a-7a527dd00c6f/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:48:28 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fbf220d-ad09-4436-8a0a-7a527dd00c6f/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:48:28 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fbf220d-ad09-4436-8a0a-7a527dd00c6f/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:48:28 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fbf220d-ad09-4436-8a0a-7a527dd00c6f/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:48:28 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00270cc2-4f5b-4f64-8f88-31f21e3b3950/disk.rescue --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:48:29 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00270cc2-4f5b-4f64-8f88-31f21e3b3950/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:48:29 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00270cc2-4f5b-4f64-8f88-31f21e3b3950/disk.rescue --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:48:29 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00270cc2-4f5b-4f64-8f88-31f21e3b3950/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:48:29 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00270cc2-4f5b-4f64-8f88-31f21e3b3950/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:48:29 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00270cc2-4f5b-4f64-8f88-31f21e3b3950/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:48:29 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00270cc2-4f5b-4f64-8f88-31f21e3b3950/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:48:29 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00270cc2-4f5b-4f64-8f88-31f21e3b3950/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:48:29 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 09:48:29 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 09:48:29 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Hypervisor/Node resource view: name=user free_ram=8056MB free_disk=25.257694244384766GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75122) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 09:48:29 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:48:29 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:48:30 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance 131142fd-e8ec-42d1-a518-aa21c7bb7cb1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:48:30 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance fd9d52bb-6248-48e6-a798-6dbdaaa68cbc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:48:30 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance 00270cc2-4f5b-4f64-8f88-31f21e3b3950 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:48:30 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance 8271a429-e252-42bb-8717-e89dfd9739bf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:48:30 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance 49154de0-f941-4ae0-a7af-72e75a4d8040 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:48:30 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance bc80e3fb-b5a3-4685-8ec5-12f8c385b833 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:48:30 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance 3fbf220d-ad09-4436-8a0a-7a527dd00c6f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:48:30 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75122) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 09:48:30 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75122) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 09:48:30 user nova-compute[75122]: DEBUG nova.compute.provider_tree [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Inventory has not changed in ProviderTree for provider: 69a3da65-47be-44c6-b67c-c692b58284ef {{(pid=75122) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 09:48:30 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Inventory has not changed for provider 69a3da65-47be-44c6-b67c-c692b58284ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 09:48:30 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Compute_service record updated for user:user {{(pid=75122) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 09:48:30 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.360s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:48:31 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:48:31 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:48:31 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:48:31 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75122) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 09:48:31 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:48:33 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:48:33 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:48:36 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:48:38 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:48:43 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:48:48 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-447383cb-2222-42ca-b1ee-d84847b5ad39 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 49154de0-f941-4ae0-a7af-72e75a4d8040 is timed out.
Nov 15 09:48:48 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-447383cb-2222-42ca-b1ee-d84847b5ad39 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Successfully detached device vdb from instance 49154de0-f941-4ae0-a7af-72e75a4d8040 from the live domain config.
Nov 15 09:48:48 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-447383cb-2222-42ca-b1ee-d84847b5ad39 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] [instance: 49154de0-f941-4ae0-a7af-72e75a4d8040] calling os-brick to detach iSCSI Volume {{(pid=75122) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 09:48:48 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-447383cb-2222-42ca-b1ee-d84847b5ad39 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffa04060b80>, {'target_iqn': 'iqn.2010-10.org.openstack:c3e65739-7eb6-4876-af4c-bfb0db7dcfa3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ckStLEqn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 09:48:48 user nova-compute[75122]: WARNING os_brick.initiator.connectors.base [None req-447383cb-2222-42ca-b1ee-d84847b5ad39 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 09:48:48 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-447383cb-2222-42ca-b1ee-d84847b5ad39 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 09:48:48 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-447383cb-2222-42ca-b1ee-d84847b5ad39 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 09:48:48 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:48:48 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:48:48 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[3554439e-69ec-42e8-87f1-e755c503e13c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6cd246c1-08d6-43ce-b2b5-2a6c42e46135\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6224c0df-13b0-4ff7-928f-9a2282386a2a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c3e65739-7eb6-4876-af4c-bfb0db7dcfa3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:48:48 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-447383cb-2222-42ca-b1ee-d84847b5ad39 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 09:48:48 user nova-compute[75122]: No targets found.
Nov 15 09:48:48 user nova-compute[75122]: iSNS:
Nov 15 09:48:48 user nova-compute[75122]: No targets found.
Nov 15 09:48:48 user nova-compute[75122]: STATIC:
Nov 15 09:48:48 user nova-compute[75122]: Target: iqn.2010-10.org.openstack:6cd246c1-08d6-43ce-b2b5-2a6c42e46135
Nov 15 09:48:48 user nova-compute[75122]:         Portal: 172.16.0.220:3260,-1
Nov 15 09:48:48 user nova-compute[75122]:                 Iface Name: default
Nov 15 09:48:48 user nova-compute[75122]: Target: iqn.2010-10.org.openstack:6224c0df-13b0-4ff7-928f-9a2282386a2a
Nov 15 09:48:48 user nova-compute[75122]:         Portal: 172.16.0.220:3260,-1
Nov 15 09:48:48 user nova-compute[75122]:                 Iface Name: default
Nov 15 09:48:48 user nova-compute[75122]: Target: iqn.2010-10.org.openstack:c3e65739-7eb6-4876-af4c-bfb0db7dcfa3
Nov 15 09:48:48 user nova-compute[75122]:         Portal: 172.16.0.220:3260,-1
Nov 15 09:48:48 user nova-compute[75122]:                 Iface Name: default
Nov 15 09:48:48 user nova-compute[75122]: FIRMWARE:
Nov 15 09:48:48 user nova-compute[75122]: No targets found.
Nov 15 09:48:48 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 09:48:48 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-447383cb-2222-42ca-b1ee-d84847b5ad39 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 09:48:48 user nova-compute[75122]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 09:48:48 user nova-compute[75122]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75122) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 09:48:48 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-447383cb-2222-42ca-b1ee-d84847b5ad39 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c3e65739-7eb6-4876-af4c-bfb0db7dcfa3', 0)] {{(pid=75122) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 09:48:48 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:48:48 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:48:48 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[e83815c5-44eb-411f-b57c-0be7149ac6db]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6224c0df-13b0-4ff7-928f-9a2282386a2a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6cd246c1-08d6-43ce-b2b5-2a6c42e46135\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c3e65739-7eb6-4876-af4c-bfb0db7dcfa3\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:48:48 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:48:48 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:48:48 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0e457bf-d793-4595-9525-e5692f0511c5]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6224c0df-13b0-4ff7-928f-9a2282386a2a (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cd246c1-08d6-43ce-b2b5-2a6c42e46135 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3e65739-7eb6-4876-af4c-bfb0db7dcfa3 (non-flash)\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:48:48 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-447383cb-2222-42ca-b1ee-d84847b5ad39 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6224c0df-13b0-4ff7-928f-9a2282386a2a (non-flash)
Nov 15 09:48:48 user nova-compute[75122]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cd246c1-08d6-43ce-b2b5-2a6c42e46135 (non-flash)
Nov 15 09:48:48 user nova-compute[75122]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3e65739-7eb6-4876-af4c-bfb0db7dcfa3 (non-flash)
Nov 15 09:48:48 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 09:48:48 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-447383cb-2222-42ca-b1ee-d84847b5ad39 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6224c0df-13b0-4ff7-928f-9a2282386a2a (non-flash)
Nov 15 09:48:48 user nova-compute[75122]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cd246c1-08d6-43ce-b2b5-2a6c42e46135 (non-flash)
Nov 15 09:48:48 user nova-compute[75122]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3e65739-7eb6-4876-af4c-bfb0db7dcfa3 (non-flash)
Nov 15 09:48:48 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 09:48:48 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-447383cb-2222-42ca-b1ee-d84847b5ad39 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff9fc25fd00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c3e65739-7eb6-4876-af4c-bfb0db7dcfa3'): ({'sdb'}, set())}) {{(pid=75122) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 09:48:48 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-447383cb-2222-42ca-b1ee-d84847b5ad39 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Removing single pathed devices sdb {{(pid=75122) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 09:48:48 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:48:48 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:48:48 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:48:48 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[153787f2-302e-4d93-8217-6cf4aa31c990]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:48:48 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:48:48 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:48:48 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[a109e298-a775-4818-b0b0-c943676c8e03]: (4, ('ok\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:48:48 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-447383cb-2222-42ca-b1ee-d84847b5ad39 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Flushing IO for device /dev/sdb {{(pid=75122) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 09:48:48 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:48:48 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:48:48 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[b096cd3b-55f5-47b7-9284-e3e96267c75e]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:48:48 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-447383cb-2222-42ca-b1ee-d84847b5ad39 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75122) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 09:48:48 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:48:48 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:48:48 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[98a7eedd-4328-4434-a757-0a253662b883]: (4, ('1', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:48:48 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-447383cb-2222-42ca-b1ee-d84847b5ad39 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75122) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 09:48:48 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-447383cb-2222-42ca-b1ee-d84847b5ad39 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] SCSI volumes sdb have been removed. {{(pid=75122) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 09:48:48 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-447383cb-2222-42ca-b1ee-d84847b5ad39 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c3e65739-7eb6-4876-af4c-bfb0db7dcfa3')] {{(pid=75122) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 09:48:48 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3e65739-7eb6-4876-af4c-bfb0db7dcfa3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:48:48 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3e65739-7eb6-4876-af4c-bfb0db7dcfa3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:48:48 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a837784-6925-4957-a718-1a44c833f6b5]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:48:48 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-447383cb-2222-42ca-b1ee-d84847b5ad39 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:48:48 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3e65739-7eb6-4876-af4c-bfb0db7dcfa3 -p 172.16.0.220:3260 --logout {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:48:48 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3e65739-7eb6-4876-af4c-bfb0db7dcfa3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:48:48 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[221d0976-0a2a-4cd7-a83e-2222f659d16a]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:c3e65739-7eb6-4876-af4c-bfb0db7dcfa3, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:c3e65739-7eb6-4876-af4c-bfb0db7dcfa3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:48:48 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-447383cb-2222-42ca-b1ee-d84847b5ad39 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:c3e65739-7eb6-4876-af4c-bfb0db7dcfa3, portal: 172.16.0.220,3260]
Nov 15 09:48:48 user nova-compute[75122]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:c3e65739-7eb6-4876-af4c-bfb0db7dcfa3, portal: 172.16.0.220,3260] successful.
Nov 15 09:48:48 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:48:48 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3e65739-7eb6-4876-af4c-bfb0db7dcfa3 -p 172.16.0.220:3260 --op delete {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:48:48 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3e65739-7eb6-4876-af4c-bfb0db7dcfa3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:48:48 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcbad98f-f1ba-4e7a-96f9-c0d770def99d]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:48:48 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-447383cb-2222-42ca-b1ee-d84847b5ad39 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:48:48 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-447383cb-2222-42ca-b1ee-d84847b5ad39 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.306s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 09:48:48 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-447383cb-2222-42ca-b1ee-d84847b5ad39 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] <== disconnect_volume: return (308ms) None {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 09:48:48 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-447383cb-2222-42ca-b1ee-d84847b5ad39 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] [instance: 49154de0-f941-4ae0-a7af-72e75a4d8040] Disconnected iSCSI Volume {{(pid=75122) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 09:48:49 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0205eea5-77f6-473d-becf-bf337c8cab7e tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Acquiring lock "bc80e3fb-b5a3-4685-8ec5-12f8c385b833" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:48:49 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0205eea5-77f6-473d-becf-bf337c8cab7e tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Lock "bc80e3fb-b5a3-4685-8ec5-12f8c385b833" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:48:49 user nova-compute[75122]: INFO nova.compute.manager [None req-0205eea5-77f6-473d-becf-bf337c8cab7e tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] [instance: bc80e3fb-b5a3-4685-8ec5-12f8c385b833] Detaching volume 6cd246c1-08d6-43ce-b2b5-2a6c42e46135
Nov 15 09:48:49 user nova-compute[75122]: INFO nova.virt.block_device [None req-0205eea5-77f6-473d-becf-bf337c8cab7e tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] [instance: bc80e3fb-b5a3-4685-8ec5-12f8c385b833] Attempting to driver detach volume 6cd246c1-08d6-43ce-b2b5-2a6c42e46135 from mountpoint /dev/vdc
Nov 15 09:48:49 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-0205eea5-77f6-473d-becf-bf337c8cab7e tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Attempting to detach device vdc from instance bc80e3fb-b5a3-4685-8ec5-12f8c385b833 from the persistent domain config. {{(pid=75122) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 09:48:49 user nova-compute[75122]: DEBUG nova.virt.libvirt.guest [None req-0205eea5-77f6-473d-becf-bf337c8cab7e tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 09:48:49 user nova-compute[75122]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 09:48:49 user nova-compute[75122]:   <source dev="/dev/sdd"/>
Nov 15 09:48:49 user nova-compute[75122]:   <target dev="vdc" bus="virtio"/>
Nov 15 09:48:49 user nova-compute[75122]:   <serial>6cd246c1-08d6-43ce-b2b5-2a6c42e46135</serial>
Nov 15 09:48:49 user nova-compute[75122]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 15 09:48:49 user nova-compute[75122]: </disk>
Nov 15 09:48:49 user nova-compute[75122]:  {{(pid=75122) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 09:48:49 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-0205eea5-77f6-473d-becf-bf337c8cab7e tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Successfully detached device vdc from instance bc80e3fb-b5a3-4685-8ec5-12f8c385b833 from the persistent domain config.
Nov 15 09:48:49 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-0205eea5-77f6-473d-becf-bf337c8cab7e tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance bc80e3fb-b5a3-4685-8ec5-12f8c385b833 from the live domain config. {{(pid=75122) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 09:48:49 user nova-compute[75122]: DEBUG nova.virt.libvirt.guest [None req-0205eea5-77f6-473d-becf-bf337c8cab7e tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 09:48:49 user nova-compute[75122]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 09:48:49 user nova-compute[75122]:   <source dev="/dev/sdd"/>
Nov 15 09:48:49 user nova-compute[75122]:   <target dev="vdc" bus="virtio"/>
Nov 15 09:48:49 user nova-compute[75122]:   <serial>6cd246c1-08d6-43ce-b2b5-2a6c42e46135</serial>
Nov 15 09:48:49 user nova-compute[75122]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 15 09:48:49 user nova-compute[75122]: </disk>
Nov 15 09:48:49 user nova-compute[75122]:  {{(pid=75122) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 09:48:49 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-0205eea5-77f6-473d-becf-bf337c8cab7e tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance bc80e3fb-b5a3-4685-8ec5-12f8c385b833 {{(pid=75122) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 09:48:50 user nova-compute[75122]: DEBUG nova.objects.instance [None req-447383cb-2222-42ca-b1ee-d84847b5ad39 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Lazy-loading 'flavor' on Instance uuid 49154de0-f941-4ae0-a7af-72e75a4d8040 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:48:50 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-447383cb-2222-42ca-b1ee-d84847b5ad39 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Lock "49154de0-f941-4ae0-a7af-72e75a4d8040" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.912s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:48:51 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:48:53 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:48:58 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:49:03 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:49:05 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-e32b6cf2-5026-4f6f-aadb-8f256b90a683 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Acquiring lock "131142fd-e8ec-42d1-a518-aa21c7bb7cb1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:49:05 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-e32b6cf2-5026-4f6f-aadb-8f256b90a683 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Lock "131142fd-e8ec-42d1-a518-aa21c7bb7cb1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:49:05 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-e32b6cf2-5026-4f6f-aadb-8f256b90a683 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Acquiring lock "131142fd-e8ec-42d1-a518-aa21c7bb7cb1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:49:05 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-e32b6cf2-5026-4f6f-aadb-8f256b90a683 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Lock "131142fd-e8ec-42d1-a518-aa21c7bb7cb1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:49:05 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-e32b6cf2-5026-4f6f-aadb-8f256b90a683 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Lock "131142fd-e8ec-42d1-a518-aa21c7bb7cb1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:49:05 user nova-compute[75122]: INFO nova.compute.manager [None req-e32b6cf2-5026-4f6f-aadb-8f256b90a683 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] [instance: 131142fd-e8ec-42d1-a518-aa21c7bb7cb1] Terminating instance
Nov 15 09:49:05 user nova-compute[75122]: DEBUG nova.compute.manager [None req-e32b6cf2-5026-4f6f-aadb-8f256b90a683 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] [instance: 131142fd-e8ec-42d1-a518-aa21c7bb7cb1] Start destroying the instance on the hypervisor. {{(pid=75122) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 09:49:05 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:49:05 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:49:05 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:49:05 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:49:05 user nova-compute[75122]: DEBUG nova.compute.manager [req-9d9a7ae7-5a23-44f9-9bc8-04151810ba7f req-a375597c-f810-46b8-829f-9b2512a43cec service nova] [instance: 131142fd-e8ec-42d1-a518-aa21c7bb7cb1] Received event network-vif-unplugged-f8302d0d-f140-479c-96da-b21516385381 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:49:05 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-9d9a7ae7-5a23-44f9-9bc8-04151810ba7f req-a375597c-f810-46b8-829f-9b2512a43cec service nova] Acquiring lock "131142fd-e8ec-42d1-a518-aa21c7bb7cb1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:49:05 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-9d9a7ae7-5a23-44f9-9bc8-04151810ba7f req-a375597c-f810-46b8-829f-9b2512a43cec service nova] Lock "131142fd-e8ec-42d1-a518-aa21c7bb7cb1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:49:05 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-9d9a7ae7-5a23-44f9-9bc8-04151810ba7f req-a375597c-f810-46b8-829f-9b2512a43cec service nova] Lock "131142fd-e8ec-42d1-a518-aa21c7bb7cb1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:49:05 user nova-compute[75122]: DEBUG nova.compute.manager [req-9d9a7ae7-5a23-44f9-9bc8-04151810ba7f req-a375597c-f810-46b8-829f-9b2512a43cec service nova] [instance: 131142fd-e8ec-42d1-a518-aa21c7bb7cb1] No waiting events found dispatching network-vif-unplugged-f8302d0d-f140-479c-96da-b21516385381 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:49:05 user nova-compute[75122]: DEBUG nova.compute.manager [req-9d9a7ae7-5a23-44f9-9bc8-04151810ba7f req-a375597c-f810-46b8-829f-9b2512a43cec service nova] [instance: 131142fd-e8ec-42d1-a518-aa21c7bb7cb1] Received event network-vif-unplugged-f8302d0d-f140-479c-96da-b21516385381 for instance with task_state deleting. {{(pid=75122) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 09:49:05 user nova-compute[75122]: INFO nova.virt.libvirt.driver [-] [instance: 131142fd-e8ec-42d1-a518-aa21c7bb7cb1] Instance destroyed successfully.
Nov 15 09:49:05 user nova-compute[75122]: DEBUG nova.objects.instance [None req-e32b6cf2-5026-4f6f-aadb-8f256b90a683 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Lazy-loading 'resources' on Instance uuid 131142fd-e8ec-42d1-a518-aa21c7bb7cb1 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:49:05 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-e32b6cf2-5026-4f6f-aadb-8f256b90a683 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T09:30:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1475115621',display_name='tempest-ServerActionsTestOtherA-server-1475115621',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1475115621',id=3,image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOjee/3FY3+bQUxkeNPW0HfKU2TS7/WwlSdJA5dC2LRbPtr2GAllBrZqAcx+1wIVC2pqAFLTFeo/KsxadKKcxACsVLYL8LB97mDl41CXm0aq5TWX4fm1S5aOkZSs0D2eNA==',key_name='tempest-keypair-686734186',keypairs=<?>,launch_index=0,launched_at=2023-11-15T09:30:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8b8e67f8a66a4930be3fb65c397cbeb2',ramdisk_id='',reservation_id='r-v7hru7rf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1521412552',owner_user_name='tempest-ServerActionsTestOtherA-1521412552-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T09:30:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='91f1469b2c7c45d6ac27f2b64fd5cefe',uuid=131142fd-e8ec-42d1-a518-aa21c7bb7cb1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f8302d0d-f140-479c-96da-b21516385381", "address": "fa:16:3e:06:1e:34", "network": {"id": "6e846655-a6f8-4339-a239-65d2f94c8b74", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1923452032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b8e67f8a66a4930be3fb65c397cbeb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8302d0d-f1", "ovs_interfaceid": "f8302d0d-f140-479c-96da-b21516385381", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 09:49:05 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-e32b6cf2-5026-4f6f-aadb-8f256b90a683 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Converting VIF {"id": "f8302d0d-f140-479c-96da-b21516385381", "address": "fa:16:3e:06:1e:34", "network": {"id": "6e846655-a6f8-4339-a239-65d2f94c8b74", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1923452032-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b8e67f8a66a4930be3fb65c397cbeb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf8302d0d-f1", "ovs_interfaceid": "f8302d0d-f140-479c-96da-b21516385381", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 09:49:05 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-e32b6cf2-5026-4f6f-aadb-8f256b90a683 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:06:1e:34,bridge_name='br-int',has_traffic_filtering=True,id=f8302d0d-f140-479c-96da-b21516385381,network=Network(6e846655-a6f8-4339-a239-65d2f94c8b74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8302d0d-f1') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 09:49:05 user nova-compute[75122]: DEBUG os_vif [None req-e32b6cf2-5026-4f6f-aadb-8f256b90a683 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:06:1e:34,bridge_name='br-int',has_traffic_filtering=True,id=f8302d0d-f140-479c-96da-b21516385381,network=Network(6e846655-a6f8-4339-a239-65d2f94c8b74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8302d0d-f1') {{(pid=75122) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 09:49:05 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:49:05 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf8302d0d-f1, bridge=br-int, if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:49:05 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:49:05 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:49:05 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:49:05 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6094add3-5323-4b6f-acfd-5c2b2805c6cc) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:49:05 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:49:05 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:49:05 user nova-compute[75122]: INFO os_vif [None req-e32b6cf2-5026-4f6f-aadb-8f256b90a683 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:06:1e:34,bridge_name='br-int',has_traffic_filtering=True,id=f8302d0d-f140-479c-96da-b21516385381,network=Network(6e846655-a6f8-4339-a239-65d2f94c8b74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf8302d0d-f1')
Nov 15 09:49:05 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-e32b6cf2-5026-4f6f-aadb-8f256b90a683 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] [instance: 131142fd-e8ec-42d1-a518-aa21c7bb7cb1] Deleting instance files /opt/stack/data/nova/instances/131142fd-e8ec-42d1-a518-aa21c7bb7cb1_del
Nov 15 09:49:05 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-e32b6cf2-5026-4f6f-aadb-8f256b90a683 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] [instance: 131142fd-e8ec-42d1-a518-aa21c7bb7cb1] Deletion of /opt/stack/data/nova/instances/131142fd-e8ec-42d1-a518-aa21c7bb7cb1_del complete
Nov 15 09:49:05 user nova-compute[75122]: INFO nova.compute.manager [None req-e32b6cf2-5026-4f6f-aadb-8f256b90a683 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] [instance: 131142fd-e8ec-42d1-a518-aa21c7bb7cb1] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 15 09:49:05 user nova-compute[75122]: DEBUG oslo.service.loopingcall [None req-e32b6cf2-5026-4f6f-aadb-8f256b90a683 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75122) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 09:49:05 user nova-compute[75122]: DEBUG nova.compute.manager [-] [instance: 131142fd-e8ec-42d1-a518-aa21c7bb7cb1] Deallocating network for instance {{(pid=75122) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 09:49:05 user nova-compute[75122]: DEBUG nova.network.neutron [-] [instance: 131142fd-e8ec-42d1-a518-aa21c7bb7cb1] deallocate_for_instance() {{(pid=75122) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 09:49:06 user nova-compute[75122]: DEBUG nova.network.neutron [-] [instance: 131142fd-e8ec-42d1-a518-aa21c7bb7cb1] Updating instance_info_cache with network_info: [] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:49:06 user nova-compute[75122]: INFO nova.compute.manager [-] [instance: 131142fd-e8ec-42d1-a518-aa21c7bb7cb1] Took 0.43 seconds to deallocate network for instance.
Nov 15 09:49:06 user nova-compute[75122]: DEBUG nova.compute.manager [req-d0dd87e1-7174-452c-aa8f-ec520a493ac1 req-ea051de8-41e7-4ba8-a064-c52d883471cd service nova] [instance: 131142fd-e8ec-42d1-a518-aa21c7bb7cb1] Received event network-vif-deleted-f8302d0d-f140-479c-96da-b21516385381 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:49:06 user nova-compute[75122]: INFO nova.compute.manager [req-d0dd87e1-7174-452c-aa8f-ec520a493ac1 req-ea051de8-41e7-4ba8-a064-c52d883471cd service nova] [instance: 131142fd-e8ec-42d1-a518-aa21c7bb7cb1] Neutron deleted interface f8302d0d-f140-479c-96da-b21516385381; detaching it from the instance and deleting it from the info cache
Nov 15 09:49:06 user nova-compute[75122]: DEBUG nova.network.neutron [req-d0dd87e1-7174-452c-aa8f-ec520a493ac1 req-ea051de8-41e7-4ba8-a064-c52d883471cd service nova] [instance: 131142fd-e8ec-42d1-a518-aa21c7bb7cb1] Updating instance_info_cache with network_info: [] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:49:06 user nova-compute[75122]: DEBUG nova.compute.manager [req-d0dd87e1-7174-452c-aa8f-ec520a493ac1 req-ea051de8-41e7-4ba8-a064-c52d883471cd service nova] [instance: 131142fd-e8ec-42d1-a518-aa21c7bb7cb1] Detach interface failed, port_id=f8302d0d-f140-479c-96da-b21516385381, reason: Instance 131142fd-e8ec-42d1-a518-aa21c7bb7cb1 could not be found. {{(pid=75122) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 09:49:06 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-e32b6cf2-5026-4f6f-aadb-8f256b90a683 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:49:06 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-e32b6cf2-5026-4f6f-aadb-8f256b90a683 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:49:06 user nova-compute[75122]: DEBUG nova.compute.provider_tree [None req-e32b6cf2-5026-4f6f-aadb-8f256b90a683 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Inventory has not changed in ProviderTree for provider: 69a3da65-47be-44c6-b67c-c692b58284ef {{(pid=75122) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 09:49:06 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-e32b6cf2-5026-4f6f-aadb-8f256b90a683 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Inventory has not changed for provider 69a3da65-47be-44c6-b67c-c692b58284ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 09:49:06 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-e32b6cf2-5026-4f6f-aadb-8f256b90a683 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.226s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:49:06 user nova-compute[75122]: INFO nova.scheduler.client.report [None req-e32b6cf2-5026-4f6f-aadb-8f256b90a683 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Deleted allocations for instance 131142fd-e8ec-42d1-a518-aa21c7bb7cb1
Nov 15 09:49:06 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-e32b6cf2-5026-4f6f-aadb-8f256b90a683 tempest-ServerActionsTestOtherA-1521412552 tempest-ServerActionsTestOtherA-1521412552-project-member] Lock "131142fd-e8ec-42d1-a518-aa21c7bb7cb1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.702s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:49:07 user nova-compute[75122]: DEBUG nova.compute.manager [req-25df5c28-c835-48a5-8d83-33510800d291 req-5df4fb88-6fb4-4176-a7b4-43c2ab95d539 service nova] [instance: 131142fd-e8ec-42d1-a518-aa21c7bb7cb1] Received event network-vif-plugged-f8302d0d-f140-479c-96da-b21516385381 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:49:07 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-25df5c28-c835-48a5-8d83-33510800d291 req-5df4fb88-6fb4-4176-a7b4-43c2ab95d539 service nova] Acquiring lock "131142fd-e8ec-42d1-a518-aa21c7bb7cb1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:49:07 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-25df5c28-c835-48a5-8d83-33510800d291 req-5df4fb88-6fb4-4176-a7b4-43c2ab95d539 service nova] Lock "131142fd-e8ec-42d1-a518-aa21c7bb7cb1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:49:07 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-25df5c28-c835-48a5-8d83-33510800d291 req-5df4fb88-6fb4-4176-a7b4-43c2ab95d539 service nova] Lock "131142fd-e8ec-42d1-a518-aa21c7bb7cb1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:49:07 user nova-compute[75122]: DEBUG nova.compute.manager [req-25df5c28-c835-48a5-8d83-33510800d291 req-5df4fb88-6fb4-4176-a7b4-43c2ab95d539 service nova] [instance: 131142fd-e8ec-42d1-a518-aa21c7bb7cb1] No waiting events found dispatching network-vif-plugged-f8302d0d-f140-479c-96da-b21516385381 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:49:07 user nova-compute[75122]: WARNING nova.compute.manager [req-25df5c28-c835-48a5-8d83-33510800d291 req-5df4fb88-6fb4-4176-a7b4-43c2ab95d539 service nova] [instance: 131142fd-e8ec-42d1-a518-aa21c7bb7cb1] Received unexpected event network-vif-plugged-f8302d0d-f140-479c-96da-b21516385381 for instance with vm_state deleted and task_state None.
Nov 15 09:49:09 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-0205eea5-77f6-473d-becf-bf337c8cab7e tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance bc80e3fb-b5a3-4685-8ec5-12f8c385b833 is timed out.
Nov 15 09:49:09 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-0205eea5-77f6-473d-becf-bf337c8cab7e tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Successfully detached device vdc from instance bc80e3fb-b5a3-4685-8ec5-12f8c385b833 from the live domain config.
Nov 15 09:49:09 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0205eea5-77f6-473d-becf-bf337c8cab7e tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] [instance: bc80e3fb-b5a3-4685-8ec5-12f8c385b833] calling os-brick to detach iSCSI Volume {{(pid=75122) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 09:49:09 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-0205eea5-77f6-473d-becf-bf337c8cab7e tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffa04060b80>, {'target_iqn': 'iqn.2010-10.org.openstack:6cd246c1-08d6-43ce-b2b5-2a6c42e46135', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CXgpWwhs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 09:49:09 user nova-compute[75122]: WARNING os_brick.initiator.connectors.base [None req-0205eea5-77f6-473d-becf-bf337c8cab7e tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 09:49:09 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-0205eea5-77f6-473d-becf-bf337c8cab7e tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 09:49:09 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-0205eea5-77f6-473d-becf-bf337c8cab7e tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 09:49:09 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:49:09 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:49:09 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[faaead01-333e-4fda-b16c-9d5d6ba0cd9c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6cd246c1-08d6-43ce-b2b5-2a6c42e46135\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6224c0df-13b0-4ff7-928f-9a2282386a2a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:49:09 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-0205eea5-77f6-473d-becf-bf337c8cab7e tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 09:49:09 user nova-compute[75122]: No targets found.
Nov 15 09:49:09 user nova-compute[75122]: iSNS:
Nov 15 09:49:09 user nova-compute[75122]: No targets found.
Nov 15 09:49:09 user nova-compute[75122]: STATIC:
Nov 15 09:49:09 user nova-compute[75122]: Target: iqn.2010-10.org.openstack:6cd246c1-08d6-43ce-b2b5-2a6c42e46135
Nov 15 09:49:09 user nova-compute[75122]:         Portal: 172.16.0.220:3260,-1
Nov 15 09:49:09 user nova-compute[75122]:                 Iface Name: default
Nov 15 09:49:09 user nova-compute[75122]: Target: iqn.2010-10.org.openstack:6224c0df-13b0-4ff7-928f-9a2282386a2a
Nov 15 09:49:09 user nova-compute[75122]:         Portal: 172.16.0.220:3260,-1
Nov 15 09:49:09 user nova-compute[75122]:                 Iface Name: default
Nov 15 09:49:09 user nova-compute[75122]: FIRMWARE:
Nov 15 09:49:09 user nova-compute[75122]: No targets found.
Nov 15 09:49:09 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 09:49:09 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-0205eea5-77f6-473d-becf-bf337c8cab7e tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 09:49:09 user nova-compute[75122]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 09:49:09 user nova-compute[75122]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75122) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 09:49:09 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-0205eea5-77f6-473d-becf-bf337c8cab7e tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6cd246c1-08d6-43ce-b2b5-2a6c42e46135', 0)] {{(pid=75122) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 09:49:09 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:49:09 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:49:09 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac0ae630-1680-4afa-984c-20be0f596b7d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6224c0df-13b0-4ff7-928f-9a2282386a2a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6cd246c1-08d6-43ce-b2b5-2a6c42e46135\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:49:09 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:49:09 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:49:09 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ba41dab-ce90-4744-ad6f-dd51e19872ed]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6224c0df-13b0-4ff7-928f-9a2282386a2a (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cd246c1-08d6-43ce-b2b5-2a6c42e46135 (non-flash)\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:49:09 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-0205eea5-77f6-473d-becf-bf337c8cab7e tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6224c0df-13b0-4ff7-928f-9a2282386a2a (non-flash)
Nov 15 09:49:09 user nova-compute[75122]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cd246c1-08d6-43ce-b2b5-2a6c42e46135 (non-flash)
Nov 15 09:49:09 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 09:49:09 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-0205eea5-77f6-473d-becf-bf337c8cab7e tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6224c0df-13b0-4ff7-928f-9a2282386a2a (non-flash)
Nov 15 09:49:09 user nova-compute[75122]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cd246c1-08d6-43ce-b2b5-2a6c42e46135 (non-flash)
Nov 15 09:49:09 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 09:49:09 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-0205eea5-77f6-473d-becf-bf337c8cab7e tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ffa044c5ab0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6cd246c1-08d6-43ce-b2b5-2a6c42e46135'): ({'sdd'}, set())}) {{(pid=75122) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 09:49:09 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-0205eea5-77f6-473d-becf-bf337c8cab7e tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Removing single pathed devices sdd {{(pid=75122) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 09:49:09 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:49:09 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:49:09 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b68a47b-ab84-4df2-ac18-f750727d14d6]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:49:09 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:49:09 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:49:09 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[7330f4dd-9ddf-44f7-b0f1-2ddf3739c5f4]: (4, ('ok\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:49:09 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-0205eea5-77f6-473d-becf-bf337c8cab7e tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Flushing IO for device /dev/sdd {{(pid=75122) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 09:49:09 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:49:09 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:49:09 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[857f9692-af66-4f92-a4ea-16ff7bfd3e53]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:49:09 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-0205eea5-77f6-473d-becf-bf337c8cab7e tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75122) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 09:49:09 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:49:09 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.040s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:49:09 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a71b1ff-7ba9-43cc-b20c-c2d9ba4fd7f7]: (4, ('1', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:49:09 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-0205eea5-77f6-473d-becf-bf337c8cab7e tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75122) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 09:49:09 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-0205eea5-77f6-473d-becf-bf337c8cab7e tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] SCSI volumes sdd have been removed. {{(pid=75122) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 09:49:09 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-0205eea5-77f6-473d-becf-bf337c8cab7e tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6cd246c1-08d6-43ce-b2b5-2a6c42e46135')] {{(pid=75122) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 09:49:09 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cd246c1-08d6-43ce-b2b5-2a6c42e46135 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:49:09 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cd246c1-08d6-43ce-b2b5-2a6c42e46135 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:49:09 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e35041e-e8e6-4819-a824-bbbad47033d2]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:49:09 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-0205eea5-77f6-473d-becf-bf337c8cab7e tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:49:09 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cd246c1-08d6-43ce-b2b5-2a6c42e46135 -p 172.16.0.220:3260 --logout {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:49:09 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cd246c1-08d6-43ce-b2b5-2a6c42e46135 -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:49:09 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[8137639e-0104-47f2-acf5-534679ee0fac]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:6cd246c1-08d6-43ce-b2b5-2a6c42e46135, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:6cd246c1-08d6-43ce-b2b5-2a6c42e46135, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:49:09 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-0205eea5-77f6-473d-becf-bf337c8cab7e tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:6cd246c1-08d6-43ce-b2b5-2a6c42e46135, portal: 172.16.0.220,3260]
Nov 15 09:49:09 user nova-compute[75122]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:6cd246c1-08d6-43ce-b2b5-2a6c42e46135, portal: 172.16.0.220,3260] successful.
Nov 15 09:49:09 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:49:09 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cd246c1-08d6-43ce-b2b5-2a6c42e46135 -p 172.16.0.220:3260 --op delete {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:49:09 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cd246c1-08d6-43ce-b2b5-2a6c42e46135 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:49:09 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[4452ce0f-0f91-4c65-846a-8beabdb2b95d]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:49:09 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-0205eea5-77f6-473d-becf-bf337c8cab7e tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:49:09 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-0205eea5-77f6-473d-becf-bf337c8cab7e tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.278s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 09:49:09 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-0205eea5-77f6-473d-becf-bf337c8cab7e tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] <== disconnect_volume: return (279ms) None {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 09:49:09 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0205eea5-77f6-473d-becf-bf337c8cab7e tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] [instance: bc80e3fb-b5a3-4685-8ec5-12f8c385b833] Disconnected iSCSI Volume {{(pid=75122) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 09:49:10 user nova-compute[75122]: DEBUG nova.objects.instance [None req-0205eea5-77f6-473d-becf-bf337c8cab7e tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Lazy-loading 'flavor' on Instance uuid bc80e3fb-b5a3-4685-8ec5-12f8c385b833 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:49:10 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0205eea5-77f6-473d-becf-bf337c8cab7e tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Lock "bc80e3fb-b5a3-4685-8ec5-12f8c385b833" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.667s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:49:10 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:49:15 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:49:19 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-34617ba2-3c87-4446-8f09-be9e4ffc11b7 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Acquiring lock "49154de0-f941-4ae0-a7af-72e75a4d8040" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:49:19 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-34617ba2-3c87-4446-8f09-be9e4ffc11b7 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Lock "49154de0-f941-4ae0-a7af-72e75a4d8040" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:49:19 user nova-compute[75122]: DEBUG nova.objects.instance [None req-34617ba2-3c87-4446-8f09-be9e4ffc11b7 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Lazy-loading 'flavor' on Instance uuid 49154de0-f941-4ae0-a7af-72e75a4d8040 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:49:19 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-34617ba2-3c87-4446-8f09-be9e4ffc11b7 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Lock "49154de0-f941-4ae0-a7af-72e75a4d8040" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.073s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:49:19 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-34617ba2-3c87-4446-8f09-be9e4ffc11b7 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Acquiring lock "49154de0-f941-4ae0-a7af-72e75a4d8040" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:49:19 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-34617ba2-3c87-4446-8f09-be9e4ffc11b7 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Lock "49154de0-f941-4ae0-a7af-72e75a4d8040" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:49:19 user nova-compute[75122]: INFO nova.compute.manager [None req-34617ba2-3c87-4446-8f09-be9e4ffc11b7 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] [instance: 49154de0-f941-4ae0-a7af-72e75a4d8040] Attaching volume b9eb425d-fec8-4b38-9d64-62158ba2d03f to /dev/vdb
Nov 15 09:49:19 user nova-compute[75122]: DEBUG os_brick.utils [None req-34617ba2-3c87-4446-8f09-be9e4ffc11b7 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 09:49:19 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:49:19 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:49:19 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddac2df9-9b23-421f-8bd0-9d75c8f1ab37]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:742fb64b3587\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:49:19 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:49:19 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:49:19 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e6a7782-11b4-4d65-9e0f-98a227f1f369]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:49:19 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:49:19 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:49:19 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a765fe7-8370-4a3c-9532-8b6bf614288e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:49:19 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb9af2bf-98fb-4162-826b-43611879b0ee]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:49:19 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-34617ba2-3c87-4446-8f09-be9e4ffc11b7 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Running cmd (subprocess): nvme version {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:49:19 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-34617ba2-3c87-4446-8f09-be9e4ffc11b7 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] 'nvme version' failed. Not Retrying. {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 09:49:19 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.nvmeof [None req-34617ba2-3c87-4446-8f09-be9e4ffc11b7 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] nvme not present on system {{(pid=75122) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 09:49:19 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:49:19 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 09:49:19 user nova-compute[75122]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 09:49:19 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6e12d3a-bdfc-455c-8ffd-a41671b33963]: (4, '') {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:49:19 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.lightos [None req-34617ba2-3c87-4446-8f09-be9e4ffc11b7 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75122) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 09:49:19 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.lightos [None req-34617ba2-3c87-4446-8f09-be9e4ffc11b7 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75122) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 09:49:19 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.lightos [None req-34617ba2-3c87-4446-8f09-be9e4ffc11b7 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] LIGHTOS: no hostnqn found. {{(pid=75122) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 09:49:19 user nova-compute[75122]: DEBUG os_brick.utils [None req-34617ba2-3c87-4446-8f09-be9e4ffc11b7 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:742fb64b3587', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 09:49:19 user nova-compute[75122]: DEBUG nova.virt.block_device [None req-34617ba2-3c87-4446-8f09-be9e4ffc11b7 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] [instance: 49154de0-f941-4ae0-a7af-72e75a4d8040] Updating existing volume attachment record: 1052999d-26a8-4dc8-87db-ca70fc16bf9e {{(pid=75122) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 09:49:20 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:49:21 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:49:24 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:49:24 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Starting heal instance info cache {{(pid=75122) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 09:49:24 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "refresh_cache-8271a429-e252-42bb-8717-e89dfd9739bf" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 09:49:24 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquired lock "refresh_cache-8271a429-e252-42bb-8717-e89dfd9739bf" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 09:49:24 user nova-compute[75122]: DEBUG nova.network.neutron [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] [instance: 8271a429-e252-42bb-8717-e89dfd9739bf] Forcefully refreshing network info cache for instance {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 09:49:24 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34617ba2-3c87-4446-8f09-be9e4ffc11b7 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] [instance: 49154de0-f941-4ae0-a7af-72e75a4d8040] Calling os-brick to attach iSCSI Volume {{(pid=75122) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 09:49:24 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-34617ba2-3c87-4446-8f09-be9e4ffc11b7 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffa04060b80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b9eb425d-fec8-4b38-9d64-62158ba2d03f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DhmgOqcz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 09:49:24 user nova-compute[75122]: WARNING os_brick.initiator.connectors.base [None req-34617ba2-3c87-4446-8f09-be9e4ffc11b7 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 09:49:24 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-34617ba2-3c87-4446-8f09-be9e4ffc11b7 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 09:49:24 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-34617ba2-3c87-4446-8f09-be9e4ffc11b7 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 09:49:24 user nova-compute[75122]: WARNING os_brick.initiator.connectors.base [None req-34617ba2-3c87-4446-8f09-be9e4ffc11b7 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 09:49:24 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-34617ba2-3c87-4446-8f09-be9e4ffc11b7 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b9eb425d-fec8-4b38-9d64-62158ba2d03f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 09:49:24 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-34617ba2-3c87-4446-8f09-be9e4ffc11b7 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b9eb425d-fec8-4b38-9d64-62158ba2d03f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 09:49:24 user nova-compute[75122]: INFO os_brick.initiator.connectors.iscsi [None req-34617ba2-3c87-4446-8f09-be9e4ffc11b7 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 09:49:24 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9eb425d-fec8-4b38-9d64-62158ba2d03f -p 172.16.0.220:3260 {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:49:24 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9eb425d-fec8-4b38-9d64-62158ba2d03f -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:49:24 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fe6990a-66f2-4af8-b511-2adc1cd29e7d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:49:24 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-34617ba2-3c87-4446-8f09-be9e4ffc11b7 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 09:49:24 user nova-compute[75122]:  {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:49:24 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9eb425d-fec8-4b38-9d64-62158ba2d03f -p 172.16.0.220:3260 --interface default --op new {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:49:24 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9eb425d-fec8-4b38-9d64-62158ba2d03f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:49:24 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[d031a0d1-6209-4f3b-aca4-d3bb3194abe8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b9eb425d-fec8-4b38-9d64-62158ba2d03f] added\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:49:24 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-34617ba2-3c87-4446-8f09-be9e4ffc11b7 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b9eb425d-fec8-4b38-9d64-62158ba2d03f] added
Nov 15 09:49:24 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:49:24 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9eb425d-fec8-4b38-9d64-62158ba2d03f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:49:24 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9eb425d-fec8-4b38-9d64-62158ba2d03f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:49:24 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[a41feaec-e4e8-419f-886c-9cfd1cb2c131]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:49:24 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-34617ba2-3c87-4446-8f09-be9e4ffc11b7 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:49:24 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9eb425d-fec8-4b38-9d64-62158ba2d03f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:49:24 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9eb425d-fec8-4b38-9d64-62158ba2d03f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:49:24 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[8666dfc8-9734-4dcb-ad2f-d877358c37b7]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:49:24 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-34617ba2-3c87-4446-8f09-be9e4ffc11b7 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:49:24 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9eb425d-fec8-4b38-9d64-62158ba2d03f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DhmgOqcz {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:49:24 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9eb425d-fec8-4b38-9d64-62158ba2d03f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DhmgOqcz" returned: 0 in 0.017s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:49:24 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[57cb80e9-179f-4581-93e7-696021999b9a]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:49:24 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-34617ba2-3c87-4446-8f09-be9e4ffc11b7 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DhmgOqcz'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:49:24 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9eb425d-fec8-4b38-9d64-62158ba2d03f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:49:24 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9eb425d-fec8-4b38-9d64-62158ba2d03f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:49:24 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[36370032-3945-4434-b7a0-ad650f4e5407]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:49:24 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-34617ba2-3c87-4446-8f09-be9e4ffc11b7 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:49:24 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:49:24 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:49:24 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[fee99b98-08ff-4227-97a9-104d7b5cf054]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6224c0df-13b0-4ff7-928f-9a2282386a2a (non-flash)\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:49:24 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-34617ba2-3c87-4446-8f09-be9e4ffc11b7 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6224c0df-13b0-4ff7-928f-9a2282386a2a (non-flash)
Nov 15 09:49:24 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 09:49:24 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-34617ba2-3c87-4446-8f09-be9e4ffc11b7 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6224c0df-13b0-4ff7-928f-9a2282386a2a (non-flash)
Nov 15 09:49:24 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 09:49:24 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9eb425d-fec8-4b38-9d64-62158ba2d03f -p 172.16.0.220:3260 --login {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:49:24 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9eb425d-fec8-4b38-9d64-62158ba2d03f -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:49:24 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[7464890b-0369-48c8-98a1-994981b9f0a9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b9eb425d-fec8-4b38-9d64-62158ba2d03f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b9eb425d-fec8-4b38-9d64-62158ba2d03f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:49:24 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-34617ba2-3c87-4446-8f09-be9e4ffc11b7 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b9eb425d-fec8-4b38-9d64-62158ba2d03f, portal: 172.16.0.220,3260]
Nov 15 09:49:24 user nova-compute[75122]: Login to [iface: default, target: iqn.2010-10.org.openstack:b9eb425d-fec8-4b38-9d64-62158ba2d03f, portal: 172.16.0.220,3260] successful.
Nov 15 09:49:24 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:49:24 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9eb425d-fec8-4b38-9d64-62158ba2d03f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:49:24 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9eb425d-fec8-4b38-9d64-62158ba2d03f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:49:24 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[16b40529-0b94-4416-ab39-f261d08a31c1]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:49:24 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-34617ba2-3c87-4446-8f09-be9e4ffc11b7 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:49:24 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:49:24 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:49:24 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[e93042b6-88e2-4bff-adf6-8d4381335cdb]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6224c0df-13b0-4ff7-928f-9a2282386a2a (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9eb425d-fec8-4b38-9d64-62158ba2d03f (non-flash)\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:49:24 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-34617ba2-3c87-4446-8f09-be9e4ffc11b7 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6224c0df-13b0-4ff7-928f-9a2282386a2a (non-flash)
Nov 15 09:49:24 user nova-compute[75122]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9eb425d-fec8-4b38-9d64-62158ba2d03f (non-flash)
Nov 15 09:49:24 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 09:49:24 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-34617ba2-3c87-4446-8f09-be9e4ffc11b7 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6224c0df-13b0-4ff7-928f-9a2282386a2a (non-flash)
Nov 15 09:49:24 user nova-compute[75122]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9eb425d-fec8-4b38-9d64-62158ba2d03f (non-flash)
Nov 15 09:49:24 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 09:49:24 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-34617ba2-3c87-4446-8f09-be9e4ffc11b7 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b9eb425d-fec8-4b38-9d64-62158ba2d03f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.247s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 09:49:24 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-34617ba2-3c87-4446-8f09-be9e4ffc11b7 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Connected to 172.16.0.220:3260 {{(pid=75122) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 09:49:24 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-34617ba2-3c87-4446-8f09-be9e4ffc11b7 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] HCTL ('33', '-', '-', 0) found on session 45 with lun 0 {{(pid=75122) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 09:49:24 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-34617ba2-3c87-4446-8f09-be9e4ffc11b7 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75122) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 09:49:24 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:49:24 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:49:24 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[2374bb98-1295-4e2a-b36e-23db79db3512]: (4, ('- - 0', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:49:24 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-34617ba2-3c87-4446-8f09-be9e4ffc11b7 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Searching for a device in session 45 and hctl ['33', '*', '*', 0] yield: None {{(pid=75122) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 09:49:24 user nova-compute[75122]: DEBUG nova.network.neutron [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] [instance: 8271a429-e252-42bb-8717-e89dfd9739bf] Updating instance_info_cache with network_info: [{"id": "044ffaae-8351-4c7f-9b12-32ac7d4b3565", "address": "fa:16:3e:e3:9d:f8", "network": {"id": "c2062f64-d925-42d2-9687-5d2511ef6697", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1134087048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eeff24cb28f5481fa3941ba399ce82ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap044ffaae-83", "ovs_interfaceid": "044ffaae-8351-4c7f-9b12-32ac7d4b3565", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:49:24 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Releasing lock "refresh_cache-8271a429-e252-42bb-8717-e89dfd9739bf" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 09:49:24 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] [instance: 8271a429-e252-42bb-8717-e89dfd9739bf] Updated the network info_cache for instance {{(pid=75122) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 09:49:25 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-34617ba2-3c87-4446-8f09-be9e4ffc11b7 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Searching for a device in session 45 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75122) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 09:49:25 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-34617ba2-3c87-4446-8f09-be9e4ffc11b7 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:b9eb425d-fec8-4b38-9d64-62158ba2d03f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DhmgOqcz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75122) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 09:49:25 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-34617ba2-3c87-4446-8f09-be9e4ffc11b7 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.280s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 09:49:25 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-34617ba2-3c87-4446-8f09-be9e4ffc11b7 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] <== connect_volume: return (1281ms) {'type': 'block', 'scsi_wwn': '23737616339333737', 'path': '/dev/sdb'} {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 09:49:25 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34617ba2-3c87-4446-8f09-be9e4ffc11b7 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] [instance: 49154de0-f941-4ae0-a7af-72e75a4d8040] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23737616339333737', 'path': '/dev/sdb'} {{(pid=75122) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 09:49:25 user nova-compute[75122]: DEBUG nova.objects.instance [None req-34617ba2-3c87-4446-8f09-be9e4ffc11b7 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Lazy-loading 'flavor' on Instance uuid 49154de0-f941-4ae0-a7af-72e75a4d8040 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:49:25 user nova-compute[75122]: DEBUG nova.virt.libvirt.guest [None req-34617ba2-3c87-4446-8f09-be9e4ffc11b7 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 09:49:25 user nova-compute[75122]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 09:49:25 user nova-compute[75122]:   <source dev="/dev/sdb"/>
Nov 15 09:49:25 user nova-compute[75122]:   <target dev="vdb" bus="virtio"/>
Nov 15 09:49:25 user nova-compute[75122]:   <serial>b9eb425d-fec8-4b38-9d64-62158ba2d03f</serial>
Nov 15 09:49:25 user nova-compute[75122]: </disk>
Nov 15 09:49:25 user nova-compute[75122]:  {{(pid=75122) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 09:49:25 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:49:26 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-34617ba2-3c87-4446-8f09-be9e4ffc11b7 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] No BDM found with device name vda, not building metadata. {{(pid=75122) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 09:49:26 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-34617ba2-3c87-4446-8f09-be9e4ffc11b7 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75122) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 09:49:26 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-34617ba2-3c87-4446-8f09-be9e4ffc11b7 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] No VIF found with MAC fa:16:3e:9a:6e:b1, not building metadata {{(pid=75122) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 09:49:26 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:49:26 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:49:26 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:49:26 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:49:26 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-34617ba2-3c87-4446-8f09-be9e4ffc11b7 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Lock "49154de0-f941-4ae0-a7af-72e75a4d8040" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.501s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:49:27 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:49:27 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:49:27 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:49:27 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:49:27 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75122) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 09:49:27 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc80e3fb-b5a3-4685-8ec5-12f8c385b833/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:49:27 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc80e3fb-b5a3-4685-8ec5-12f8c385b833/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:49:27 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc80e3fb-b5a3-4685-8ec5-12f8c385b833/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:49:27 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc80e3fb-b5a3-4685-8ec5-12f8c385b833/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:49:27 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd9d52bb-6248-48e6-a798-6dbdaaa68cbc/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:49:27 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd9d52bb-6248-48e6-a798-6dbdaaa68cbc/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:49:27 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd9d52bb-6248-48e6-a798-6dbdaaa68cbc/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:49:28 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd9d52bb-6248-48e6-a798-6dbdaaa68cbc/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:49:28 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49154de0-f941-4ae0-a7af-72e75a4d8040/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:49:28 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49154de0-f941-4ae0-a7af-72e75a4d8040/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:49:28 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49154de0-f941-4ae0-a7af-72e75a4d8040/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:49:28 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49154de0-f941-4ae0-a7af-72e75a4d8040/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:49:28 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75122) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 09:49:28 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8271a429-e252-42bb-8717-e89dfd9739bf/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:49:28 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8271a429-e252-42bb-8717-e89dfd9739bf/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:49:28 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8271a429-e252-42bb-8717-e89dfd9739bf/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:49:28 user nova-compute[75122]: DEBUG nova.compute.manager [req-89a25edd-270e-4f07-a036-27e7cf10fcef req-3b21e0c5-fdb8-4b1b-9514-eeec35fc18c9 service nova] [instance: 8271a429-e252-42bb-8717-e89dfd9739bf] Received event network-changed-044ffaae-8351-4c7f-9b12-32ac7d4b3565 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:49:28 user nova-compute[75122]: DEBUG nova.compute.manager [req-89a25edd-270e-4f07-a036-27e7cf10fcef req-3b21e0c5-fdb8-4b1b-9514-eeec35fc18c9 service nova] [instance: 8271a429-e252-42bb-8717-e89dfd9739bf] Refreshing instance network info cache due to event network-changed-044ffaae-8351-4c7f-9b12-32ac7d4b3565. {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 09:49:28 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-89a25edd-270e-4f07-a036-27e7cf10fcef req-3b21e0c5-fdb8-4b1b-9514-eeec35fc18c9 service nova] Acquiring lock "refresh_cache-8271a429-e252-42bb-8717-e89dfd9739bf" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 09:49:28 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-89a25edd-270e-4f07-a036-27e7cf10fcef req-3b21e0c5-fdb8-4b1b-9514-eeec35fc18c9 service nova] Acquired lock "refresh_cache-8271a429-e252-42bb-8717-e89dfd9739bf" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 09:49:29 user nova-compute[75122]: DEBUG nova.network.neutron [req-89a25edd-270e-4f07-a036-27e7cf10fcef req-3b21e0c5-fdb8-4b1b-9514-eeec35fc18c9 service nova] [instance: 8271a429-e252-42bb-8717-e89dfd9739bf] Refreshing network info cache for port 044ffaae-8351-4c7f-9b12-32ac7d4b3565 {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 09:49:29 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8271a429-e252-42bb-8717-e89dfd9739bf/disk --force-share --output=json" returned: 0 in 0.488s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:49:29 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75122) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 09:49:29 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-9cb529e4-9826-404a-8c9b-f33a8e120141 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Acquiring lock "49154de0-f941-4ae0-a7af-72e75a4d8040" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:49:29 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-9cb529e4-9826-404a-8c9b-f33a8e120141 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Lock "49154de0-f941-4ae0-a7af-72e75a4d8040" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:49:29 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-f2c56344-0d2e-40ed-9ea8-b2fd522d8da0 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Acquiring lock "8271a429-e252-42bb-8717-e89dfd9739bf" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:49:29 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-f2c56344-0d2e-40ed-9ea8-b2fd522d8da0 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Lock "8271a429-e252-42bb-8717-e89dfd9739bf" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:49:29 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fbf220d-ad09-4436-8a0a-7a527dd00c6f/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:49:29 user nova-compute[75122]: INFO nova.compute.manager [None req-f2c56344-0d2e-40ed-9ea8-b2fd522d8da0 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] [instance: 8271a429-e252-42bb-8717-e89dfd9739bf] Detaching volume 6224c0df-13b0-4ff7-928f-9a2282386a2a
Nov 15 09:49:29 user nova-compute[75122]: INFO nova.compute.manager [None req-9cb529e4-9826-404a-8c9b-f33a8e120141 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] [instance: 49154de0-f941-4ae0-a7af-72e75a4d8040] Detaching volume b9eb425d-fec8-4b38-9d64-62158ba2d03f
Nov 15 09:49:29 user nova-compute[75122]: INFO nova.virt.block_device [None req-f2c56344-0d2e-40ed-9ea8-b2fd522d8da0 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] [instance: 8271a429-e252-42bb-8717-e89dfd9739bf] Attempting to driver detach volume 6224c0df-13b0-4ff7-928f-9a2282386a2a from mountpoint /dev/vdb
Nov 15 09:49:29 user nova-compute[75122]: INFO nova.virt.block_device [None req-9cb529e4-9826-404a-8c9b-f33a8e120141 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] [instance: 49154de0-f941-4ae0-a7af-72e75a4d8040] Attempting to driver detach volume b9eb425d-fec8-4b38-9d64-62158ba2d03f from mountpoint /dev/vdb
Nov 15 09:49:29 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-f2c56344-0d2e-40ed-9ea8-b2fd522d8da0 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Attempting to detach device vdb from instance 8271a429-e252-42bb-8717-e89dfd9739bf from the persistent domain config. {{(pid=75122) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 09:49:29 user nova-compute[75122]: DEBUG nova.virt.libvirt.guest [None req-f2c56344-0d2e-40ed-9ea8-b2fd522d8da0 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 09:49:29 user nova-compute[75122]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 09:49:29 user nova-compute[75122]:   <source dev="/dev/sdc"/>
Nov 15 09:49:29 user nova-compute[75122]:   <target dev="vdb" bus="virtio"/>
Nov 15 09:49:29 user nova-compute[75122]:   <serial>6224c0df-13b0-4ff7-928f-9a2282386a2a</serial>
Nov 15 09:49:29 user nova-compute[75122]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 09:49:29 user nova-compute[75122]: </disk>
Nov 15 09:49:29 user nova-compute[75122]:  {{(pid=75122) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 09:49:29 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-9cb529e4-9826-404a-8c9b-f33a8e120141 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Attempting to detach device vdb from instance 49154de0-f941-4ae0-a7af-72e75a4d8040 from the persistent domain config. {{(pid=75122) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 09:49:29 user nova-compute[75122]: DEBUG nova.virt.libvirt.guest [None req-9cb529e4-9826-404a-8c9b-f33a8e120141 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 09:49:29 user nova-compute[75122]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 09:49:29 user nova-compute[75122]:   <source dev="/dev/sdb"/>
Nov 15 09:49:29 user nova-compute[75122]:   <target dev="vdb" bus="virtio"/>
Nov 15 09:49:29 user nova-compute[75122]:   <serial>b9eb425d-fec8-4b38-9d64-62158ba2d03f</serial>
Nov 15 09:49:29 user nova-compute[75122]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 09:49:29 user nova-compute[75122]: </disk>
Nov 15 09:49:29 user nova-compute[75122]:  {{(pid=75122) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 09:49:29 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-f2c56344-0d2e-40ed-9ea8-b2fd522d8da0 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Successfully detached device vdb from instance 8271a429-e252-42bb-8717-e89dfd9739bf from the persistent domain config.
Nov 15 09:49:29 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-f2c56344-0d2e-40ed-9ea8-b2fd522d8da0 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8271a429-e252-42bb-8717-e89dfd9739bf from the live domain config. {{(pid=75122) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 09:49:29 user nova-compute[75122]: DEBUG nova.virt.libvirt.guest [None req-f2c56344-0d2e-40ed-9ea8-b2fd522d8da0 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 09:49:29 user nova-compute[75122]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 09:49:29 user nova-compute[75122]:   <source dev="/dev/sdc"/>
Nov 15 09:49:29 user nova-compute[75122]:   <target dev="vdb" bus="virtio"/>
Nov 15 09:49:29 user nova-compute[75122]:   <serial>6224c0df-13b0-4ff7-928f-9a2282386a2a</serial>
Nov 15 09:49:29 user nova-compute[75122]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 09:49:29 user nova-compute[75122]: </disk>
Nov 15 09:49:29 user nova-compute[75122]:  {{(pid=75122) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 09:49:29 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-9cb529e4-9826-404a-8c9b-f33a8e120141 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Successfully detached device vdb from instance 49154de0-f941-4ae0-a7af-72e75a4d8040 from the persistent domain config.
Nov 15 09:49:29 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-9cb529e4-9826-404a-8c9b-f33a8e120141 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 49154de0-f941-4ae0-a7af-72e75a4d8040 from the live domain config. {{(pid=75122) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 09:49:29 user nova-compute[75122]: DEBUG nova.virt.libvirt.guest [None req-9cb529e4-9826-404a-8c9b-f33a8e120141 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 09:49:29 user nova-compute[75122]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 09:49:29 user nova-compute[75122]:   <source dev="/dev/sdb"/>
Nov 15 09:49:29 user nova-compute[75122]:   <target dev="vdb" bus="virtio"/>
Nov 15 09:49:29 user nova-compute[75122]:   <serial>b9eb425d-fec8-4b38-9d64-62158ba2d03f</serial>
Nov 15 09:49:29 user nova-compute[75122]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 09:49:29 user nova-compute[75122]: </disk>
Nov 15 09:49:29 user nova-compute[75122]:  {{(pid=75122) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 09:49:29 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fbf220d-ad09-4436-8a0a-7a527dd00c6f/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:49:29 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fbf220d-ad09-4436-8a0a-7a527dd00c6f/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:49:29 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fbf220d-ad09-4436-8a0a-7a527dd00c6f/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:49:29 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00270cc2-4f5b-4f64-8f88-31f21e3b3950/disk.rescue --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:49:29 user nova-compute[75122]: DEBUG nova.network.neutron [req-89a25edd-270e-4f07-a036-27e7cf10fcef req-3b21e0c5-fdb8-4b1b-9514-eeec35fc18c9 service nova] [instance: 8271a429-e252-42bb-8717-e89dfd9739bf] Updated VIF entry in instance network info cache for port 044ffaae-8351-4c7f-9b12-32ac7d4b3565. {{(pid=75122) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 09:49:29 user nova-compute[75122]: DEBUG nova.network.neutron [req-89a25edd-270e-4f07-a036-27e7cf10fcef req-3b21e0c5-fdb8-4b1b-9514-eeec35fc18c9 service nova] [instance: 8271a429-e252-42bb-8717-e89dfd9739bf] Updating instance_info_cache with network_info: [{"id": "044ffaae-8351-4c7f-9b12-32ac7d4b3565", "address": "fa:16:3e:e3:9d:f8", "network": {"id": "c2062f64-d925-42d2-9687-5d2511ef6697", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1134087048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eeff24cb28f5481fa3941ba399ce82ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap044ffaae-83", "ovs_interfaceid": "044ffaae-8351-4c7f-9b12-32ac7d4b3565", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:49:29 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-89a25edd-270e-4f07-a036-27e7cf10fcef req-3b21e0c5-fdb8-4b1b-9514-eeec35fc18c9 service nova] Releasing lock "refresh_cache-8271a429-e252-42bb-8717-e89dfd9739bf" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 09:49:29 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00270cc2-4f5b-4f64-8f88-31f21e3b3950/disk.rescue --force-share --output=json" returned: 0 in 0.169s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:49:29 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00270cc2-4f5b-4f64-8f88-31f21e3b3950/disk.rescue --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:49:29 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-9cb529e4-9826-404a-8c9b-f33a8e120141 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 49154de0-f941-4ae0-a7af-72e75a4d8040 {{(pid=75122) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 09:49:30 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00270cc2-4f5b-4f64-8f88-31f21e3b3950/disk.rescue --force-share --output=json" returned: 0 in 0.167s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:49:30 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00270cc2-4f5b-4f64-8f88-31f21e3b3950/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:49:30 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-f2c56344-0d2e-40ed-9ea8-b2fd522d8da0 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8271a429-e252-42bb-8717-e89dfd9739bf {{(pid=75122) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 09:49:30 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00270cc2-4f5b-4f64-8f88-31f21e3b3950/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:49:30 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00270cc2-4f5b-4f64-8f88-31f21e3b3950/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:49:30 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00270cc2-4f5b-4f64-8f88-31f21e3b3950/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:49:30 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 09:49:30 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 09:49:30 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Hypervisor/Node resource view: name=user free_ram=8384MB free_disk=25.273693084716797GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75122) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 09:49:30 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:49:30 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:49:30 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:49:30 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance fd9d52bb-6248-48e6-a798-6dbdaaa68cbc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:49:30 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance 00270cc2-4f5b-4f64-8f88-31f21e3b3950 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:49:30 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance 8271a429-e252-42bb-8717-e89dfd9739bf actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:49:30 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance 49154de0-f941-4ae0-a7af-72e75a4d8040 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:49:30 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance bc80e3fb-b5a3-4685-8ec5-12f8c385b833 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:49:30 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance 3fbf220d-ad09-4436-8a0a-7a527dd00c6f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:49:30 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=75122) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 09:49:30 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=75122) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 09:49:30 user nova-compute[75122]: DEBUG nova.compute.manager [req-f4c80a48-aed7-43ae-814c-432080ceef03 req-d75d31df-33cb-49e8-b47f-3bb525d67fd6 service nova] [instance: 8271a429-e252-42bb-8717-e89dfd9739bf] Received event network-changed-044ffaae-8351-4c7f-9b12-32ac7d4b3565 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:49:30 user nova-compute[75122]: DEBUG nova.compute.manager [req-f4c80a48-aed7-43ae-814c-432080ceef03 req-d75d31df-33cb-49e8-b47f-3bb525d67fd6 service nova] [instance: 8271a429-e252-42bb-8717-e89dfd9739bf] Refreshing instance network info cache due to event network-changed-044ffaae-8351-4c7f-9b12-32ac7d4b3565. {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 09:49:30 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-f4c80a48-aed7-43ae-814c-432080ceef03 req-d75d31df-33cb-49e8-b47f-3bb525d67fd6 service nova] Acquiring lock "refresh_cache-8271a429-e252-42bb-8717-e89dfd9739bf" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 09:49:30 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-f4c80a48-aed7-43ae-814c-432080ceef03 req-d75d31df-33cb-49e8-b47f-3bb525d67fd6 service nova] Acquired lock "refresh_cache-8271a429-e252-42bb-8717-e89dfd9739bf" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 09:49:30 user nova-compute[75122]: DEBUG nova.network.neutron [req-f4c80a48-aed7-43ae-814c-432080ceef03 req-d75d31df-33cb-49e8-b47f-3bb525d67fd6 service nova] [instance: 8271a429-e252-42bb-8717-e89dfd9739bf] Refreshing network info cache for port 044ffaae-8351-4c7f-9b12-32ac7d4b3565 {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 09:49:31 user nova-compute[75122]: DEBUG nova.compute.provider_tree [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Inventory has not changed in ProviderTree for provider: 69a3da65-47be-44c6-b67c-c692b58284ef {{(pid=75122) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 09:49:31 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Inventory has not changed for provider 69a3da65-47be-44c6-b67c-c692b58284ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 09:49:31 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Compute_service record updated for user:user {{(pid=75122) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 09:49:31 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.381s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:49:31 user nova-compute[75122]: DEBUG nova.network.neutron [req-f4c80a48-aed7-43ae-814c-432080ceef03 req-d75d31df-33cb-49e8-b47f-3bb525d67fd6 service nova] [instance: 8271a429-e252-42bb-8717-e89dfd9739bf] Updated VIF entry in instance network info cache for port 044ffaae-8351-4c7f-9b12-32ac7d4b3565. {{(pid=75122) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 09:49:31 user nova-compute[75122]: DEBUG nova.network.neutron [req-f4c80a48-aed7-43ae-814c-432080ceef03 req-d75d31df-33cb-49e8-b47f-3bb525d67fd6 service nova] [instance: 8271a429-e252-42bb-8717-e89dfd9739bf] Updating instance_info_cache with network_info: [{"id": "044ffaae-8351-4c7f-9b12-32ac7d4b3565", "address": "fa:16:3e:e3:9d:f8", "network": {"id": "c2062f64-d925-42d2-9687-5d2511ef6697", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1134087048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eeff24cb28f5481fa3941ba399ce82ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap044ffaae-83", "ovs_interfaceid": "044ffaae-8351-4c7f-9b12-32ac7d4b3565", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:49:31 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-f4c80a48-aed7-43ae-814c-432080ceef03 req-d75d31df-33cb-49e8-b47f-3bb525d67fd6 service nova] Releasing lock "refresh_cache-8271a429-e252-42bb-8717-e89dfd9739bf" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 09:49:31 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:49:32 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:49:32 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:49:32 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75122) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 09:49:34 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:49:35 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:49:39 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-ea602b4d-759b-41a3-8d48-73a989beae8b tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Acquiring lock "bc80e3fb-b5a3-4685-8ec5-12f8c385b833" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:49:39 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-ea602b4d-759b-41a3-8d48-73a989beae8b tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Lock "bc80e3fb-b5a3-4685-8ec5-12f8c385b833" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:49:39 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-ea602b4d-759b-41a3-8d48-73a989beae8b tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Acquiring lock "bc80e3fb-b5a3-4685-8ec5-12f8c385b833-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:49:39 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-ea602b4d-759b-41a3-8d48-73a989beae8b tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Lock "bc80e3fb-b5a3-4685-8ec5-12f8c385b833-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:49:39 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-ea602b4d-759b-41a3-8d48-73a989beae8b tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Lock "bc80e3fb-b5a3-4685-8ec5-12f8c385b833-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:49:39 user nova-compute[75122]: INFO nova.compute.manager [None req-ea602b4d-759b-41a3-8d48-73a989beae8b tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] [instance: bc80e3fb-b5a3-4685-8ec5-12f8c385b833] Terminating instance
Nov 15 09:49:39 user nova-compute[75122]: DEBUG nova.compute.manager [None req-ea602b4d-759b-41a3-8d48-73a989beae8b tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] [instance: bc80e3fb-b5a3-4685-8ec5-12f8c385b833] Start destroying the instance on the hypervisor. {{(pid=75122) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 09:49:39 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:49:39 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:49:39 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:49:39 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:49:39 user nova-compute[75122]: DEBUG nova.compute.manager [req-0144dcbf-54ea-42e1-96a8-affed0461b53 req-4e1880bc-b779-4a2a-8cbb-27e362582eba service nova] [instance: bc80e3fb-b5a3-4685-8ec5-12f8c385b833] Received event network-vif-unplugged-a4776ec9-b51c-45f4-8e4c-8cbc3d9e8a59 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:49:39 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-0144dcbf-54ea-42e1-96a8-affed0461b53 req-4e1880bc-b779-4a2a-8cbb-27e362582eba service nova] Acquiring lock "bc80e3fb-b5a3-4685-8ec5-12f8c385b833-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:49:39 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-0144dcbf-54ea-42e1-96a8-affed0461b53 req-4e1880bc-b779-4a2a-8cbb-27e362582eba service nova] Lock "bc80e3fb-b5a3-4685-8ec5-12f8c385b833-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:49:39 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-0144dcbf-54ea-42e1-96a8-affed0461b53 req-4e1880bc-b779-4a2a-8cbb-27e362582eba service nova] Lock "bc80e3fb-b5a3-4685-8ec5-12f8c385b833-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:49:39 user nova-compute[75122]: DEBUG nova.compute.manager [req-0144dcbf-54ea-42e1-96a8-affed0461b53 req-4e1880bc-b779-4a2a-8cbb-27e362582eba service nova] [instance: bc80e3fb-b5a3-4685-8ec5-12f8c385b833] No waiting events found dispatching network-vif-unplugged-a4776ec9-b51c-45f4-8e4c-8cbc3d9e8a59 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:49:39 user nova-compute[75122]: DEBUG nova.compute.manager [req-0144dcbf-54ea-42e1-96a8-affed0461b53 req-4e1880bc-b779-4a2a-8cbb-27e362582eba service nova] [instance: bc80e3fb-b5a3-4685-8ec5-12f8c385b833] Received event network-vif-unplugged-a4776ec9-b51c-45f4-8e4c-8cbc3d9e8a59 for instance with task_state deleting. {{(pid=75122) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 09:49:39 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:49:40 user nova-compute[75122]: INFO nova.virt.libvirt.driver [-] [instance: bc80e3fb-b5a3-4685-8ec5-12f8c385b833] Instance destroyed successfully.
Nov 15 09:49:40 user nova-compute[75122]: DEBUG nova.objects.instance [None req-ea602b4d-759b-41a3-8d48-73a989beae8b tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Lazy-loading 'resources' on Instance uuid bc80e3fb-b5a3-4685-8ec5-12f8c385b833 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:49:40 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-ea602b4d-759b-41a3-8d48-73a989beae8b tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-15T09:43:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-163449221',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-163449221',id=29,image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJfEuPLuVH5xqWrSMchZ/D472KVFUB0l6HnFeBNP5ISHr0hl+yReqPqomRDnTEO/skiLFiaQqOkcDJWvEVPbCsE6HHOsaS7zMjbvhh02/xzV3QyLU+3VyYUKh9zh6YINxw==',key_name='tempest-keypair-785756428',keypairs=<?>,launch_index=0,launched_at=2023-11-15T09:47:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='535c751b9e76421c9262e48fbab3fb6f',ramdisk_id='',reservation_id='r-s195psec',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1659813957',owner_user_name='tempest-AttachVolumeShelveTestJSON-1659813957-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T09:47:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad06186836ed40a49a05ef7cc9afd1bc',uuid=bc80e3fb-b5a3-4685-8ec5-12f8c385b833,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a4776ec9-b51c-45f4-8e4c-8cbc3d9e8a59", "address": "fa:16:3e:8c:f1:36", "network": {"id": "7ab99c1b-e670-416e-b5fe-e1337db6b28d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-487518933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "535c751b9e76421c9262e48fbab3fb6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4776ec9-b5", "ovs_interfaceid": "a4776ec9-b51c-45f4-8e4c-8cbc3d9e8a59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 09:49:40 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-ea602b4d-759b-41a3-8d48-73a989beae8b tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Converting VIF {"id": "a4776ec9-b51c-45f4-8e4c-8cbc3d9e8a59", "address": "fa:16:3e:8c:f1:36", "network": {"id": "7ab99c1b-e670-416e-b5fe-e1337db6b28d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-487518933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "535c751b9e76421c9262e48fbab3fb6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4776ec9-b5", "ovs_interfaceid": "a4776ec9-b51c-45f4-8e4c-8cbc3d9e8a59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 09:49:40 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-ea602b4d-759b-41a3-8d48-73a989beae8b tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:f1:36,bridge_name='br-int',has_traffic_filtering=True,id=a4776ec9-b51c-45f4-8e4c-8cbc3d9e8a59,network=Network(7ab99c1b-e670-416e-b5fe-e1337db6b28d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4776ec9-b5') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 09:49:40 user nova-compute[75122]: DEBUG os_vif [None req-ea602b4d-759b-41a3-8d48-73a989beae8b tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:f1:36,bridge_name='br-int',has_traffic_filtering=True,id=a4776ec9-b51c-45f4-8e4c-8cbc3d9e8a59,network=Network(7ab99c1b-e670-416e-b5fe-e1337db6b28d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4776ec9-b5') {{(pid=75122) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 09:49:40 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:49:40 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa4776ec9-b5, bridge=br-int, if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:49:40 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:49:40 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:49:40 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:49:40 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4c08650b-53e1-4df5-8b6f-cf703ebff221) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:49:40 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:49:40 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:49:40 user nova-compute[75122]: INFO os_vif [None req-ea602b4d-759b-41a3-8d48-73a989beae8b tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:f1:36,bridge_name='br-int',has_traffic_filtering=True,id=a4776ec9-b51c-45f4-8e4c-8cbc3d9e8a59,network=Network(7ab99c1b-e670-416e-b5fe-e1337db6b28d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4776ec9-b5')
Nov 15 09:49:40 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-ea602b4d-759b-41a3-8d48-73a989beae8b tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] [instance: bc80e3fb-b5a3-4685-8ec5-12f8c385b833] Deleting instance files /opt/stack/data/nova/instances/bc80e3fb-b5a3-4685-8ec5-12f8c385b833_del
Nov 15 09:49:40 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-ea602b4d-759b-41a3-8d48-73a989beae8b tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] [instance: bc80e3fb-b5a3-4685-8ec5-12f8c385b833] Deletion of /opt/stack/data/nova/instances/bc80e3fb-b5a3-4685-8ec5-12f8c385b833_del complete
Nov 15 09:49:40 user nova-compute[75122]: INFO nova.compute.manager [None req-ea602b4d-759b-41a3-8d48-73a989beae8b tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] [instance: bc80e3fb-b5a3-4685-8ec5-12f8c385b833] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 15 09:49:40 user nova-compute[75122]: DEBUG oslo.service.loopingcall [None req-ea602b4d-759b-41a3-8d48-73a989beae8b tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75122) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 09:49:40 user nova-compute[75122]: DEBUG nova.compute.manager [-] [instance: bc80e3fb-b5a3-4685-8ec5-12f8c385b833] Deallocating network for instance {{(pid=75122) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 09:49:40 user nova-compute[75122]: DEBUG nova.network.neutron [-] [instance: bc80e3fb-b5a3-4685-8ec5-12f8c385b833] deallocate_for_instance() {{(pid=75122) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 09:49:41 user nova-compute[75122]: DEBUG nova.network.neutron [-] [instance: bc80e3fb-b5a3-4685-8ec5-12f8c385b833] Updating instance_info_cache with network_info: [] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:49:41 user nova-compute[75122]: INFO nova.compute.manager [-] [instance: bc80e3fb-b5a3-4685-8ec5-12f8c385b833] Took 0.78 seconds to deallocate network for instance.
Nov 15 09:49:41 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-ea602b4d-759b-41a3-8d48-73a989beae8b tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:49:41 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-ea602b4d-759b-41a3-8d48-73a989beae8b tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:49:41 user nova-compute[75122]: DEBUG nova.compute.provider_tree [None req-ea602b4d-759b-41a3-8d48-73a989beae8b tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Inventory has not changed in ProviderTree for provider: 69a3da65-47be-44c6-b67c-c692b58284ef {{(pid=75122) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 09:49:41 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-ea602b4d-759b-41a3-8d48-73a989beae8b tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Inventory has not changed for provider 69a3da65-47be-44c6-b67c-c692b58284ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 09:49:41 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-ea602b4d-759b-41a3-8d48-73a989beae8b tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.223s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:49:41 user nova-compute[75122]: INFO nova.scheduler.client.report [None req-ea602b4d-759b-41a3-8d48-73a989beae8b tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Deleted allocations for instance bc80e3fb-b5a3-4685-8ec5-12f8c385b833
Nov 15 09:49:41 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-ea602b4d-759b-41a3-8d48-73a989beae8b tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Lock "bc80e3fb-b5a3-4685-8ec5-12f8c385b833" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.072s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:49:41 user nova-compute[75122]: DEBUG nova.compute.manager [req-a24bc750-ea09-48f3-ad4c-8c9f35602356 req-5a84c379-9f93-4895-abfa-0a3313adf73a service nova] [instance: bc80e3fb-b5a3-4685-8ec5-12f8c385b833] Received event network-vif-plugged-a4776ec9-b51c-45f4-8e4c-8cbc3d9e8a59 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:49:41 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-a24bc750-ea09-48f3-ad4c-8c9f35602356 req-5a84c379-9f93-4895-abfa-0a3313adf73a service nova] Acquiring lock "bc80e3fb-b5a3-4685-8ec5-12f8c385b833-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:49:41 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-a24bc750-ea09-48f3-ad4c-8c9f35602356 req-5a84c379-9f93-4895-abfa-0a3313adf73a service nova] Lock "bc80e3fb-b5a3-4685-8ec5-12f8c385b833-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:49:41 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-a24bc750-ea09-48f3-ad4c-8c9f35602356 req-5a84c379-9f93-4895-abfa-0a3313adf73a service nova] Lock "bc80e3fb-b5a3-4685-8ec5-12f8c385b833-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:49:41 user nova-compute[75122]: DEBUG nova.compute.manager [req-a24bc750-ea09-48f3-ad4c-8c9f35602356 req-5a84c379-9f93-4895-abfa-0a3313adf73a service nova] [instance: bc80e3fb-b5a3-4685-8ec5-12f8c385b833] No waiting events found dispatching network-vif-plugged-a4776ec9-b51c-45f4-8e4c-8cbc3d9e8a59 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:49:41 user nova-compute[75122]: WARNING nova.compute.manager [req-a24bc750-ea09-48f3-ad4c-8c9f35602356 req-5a84c379-9f93-4895-abfa-0a3313adf73a service nova] [instance: bc80e3fb-b5a3-4685-8ec5-12f8c385b833] Received unexpected event network-vif-plugged-a4776ec9-b51c-45f4-8e4c-8cbc3d9e8a59 for instance with vm_state deleted and task_state None.
Nov 15 09:49:41 user nova-compute[75122]: DEBUG nova.compute.manager [req-a24bc750-ea09-48f3-ad4c-8c9f35602356 req-5a84c379-9f93-4895-abfa-0a3313adf73a service nova] [instance: bc80e3fb-b5a3-4685-8ec5-12f8c385b833] Received event network-vif-deleted-a4776ec9-b51c-45f4-8e4c-8cbc3d9e8a59 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:49:45 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:49:49 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-9cb529e4-9826-404a-8c9b-f33a8e120141 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 49154de0-f941-4ae0-a7af-72e75a4d8040 is timed out.
Nov 15 09:49:49 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-9cb529e4-9826-404a-8c9b-f33a8e120141 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Successfully detached device vdb from instance 49154de0-f941-4ae0-a7af-72e75a4d8040 from the live domain config.
Nov 15 09:49:49 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9cb529e4-9826-404a-8c9b-f33a8e120141 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] [instance: 49154de0-f941-4ae0-a7af-72e75a4d8040] calling os-brick to detach iSCSI Volume {{(pid=75122) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 09:49:49 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cb529e4-9826-404a-8c9b-f33a8e120141 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffa04060b80>, {'target_iqn': 'iqn.2010-10.org.openstack:b9eb425d-fec8-4b38-9d64-62158ba2d03f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DhmgOqcz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 09:49:49 user nova-compute[75122]: WARNING os_brick.initiator.connectors.base [None req-9cb529e4-9826-404a-8c9b-f33a8e120141 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 09:49:49 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-9cb529e4-9826-404a-8c9b-f33a8e120141 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 09:49:49 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-9cb529e4-9826-404a-8c9b-f33a8e120141 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 09:49:49 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:49:49 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:49:49 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[8987c675-4374-4d4b-ad25-05fff78579a7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b9eb425d-fec8-4b38-9d64-62158ba2d03f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6224c0df-13b0-4ff7-928f-9a2282386a2a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:49:49 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cb529e4-9826-404a-8c9b-f33a8e120141 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 09:49:49 user nova-compute[75122]: No targets found.
Nov 15 09:49:49 user nova-compute[75122]: iSNS:
Nov 15 09:49:49 user nova-compute[75122]: No targets found.
Nov 15 09:49:49 user nova-compute[75122]: STATIC:
Nov 15 09:49:49 user nova-compute[75122]: Target: iqn.2010-10.org.openstack:b9eb425d-fec8-4b38-9d64-62158ba2d03f
Nov 15 09:49:49 user nova-compute[75122]:         Portal: 172.16.0.220:3260,-1
Nov 15 09:49:49 user nova-compute[75122]:                 Iface Name: default
Nov 15 09:49:49 user nova-compute[75122]: Target: iqn.2010-10.org.openstack:6224c0df-13b0-4ff7-928f-9a2282386a2a
Nov 15 09:49:49 user nova-compute[75122]:         Portal: 172.16.0.220:3260,-1
Nov 15 09:49:49 user nova-compute[75122]:                 Iface Name: default
Nov 15 09:49:49 user nova-compute[75122]: FIRMWARE:
Nov 15 09:49:49 user nova-compute[75122]: No targets found.
Nov 15 09:49:49 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 09:49:49 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cb529e4-9826-404a-8c9b-f33a8e120141 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 09:49:49 user nova-compute[75122]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 09:49:49 user nova-compute[75122]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75122) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 09:49:49 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cb529e4-9826-404a-8c9b-f33a8e120141 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b9eb425d-fec8-4b38-9d64-62158ba2d03f', 0)] {{(pid=75122) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 09:49:49 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:49:49 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.046s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:49:49 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4957f58-b7f0-4a8c-ae0c-eb304b56bb05]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6224c0df-13b0-4ff7-928f-9a2282386a2a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b9eb425d-fec8-4b38-9d64-62158ba2d03f\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:49:49 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:49:49 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:49:49 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[b146c942-dfe7-4eab-9a4f-da9b24b2522e]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6224c0df-13b0-4ff7-928f-9a2282386a2a (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9eb425d-fec8-4b38-9d64-62158ba2d03f (non-flash)\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:49:49 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cb529e4-9826-404a-8c9b-f33a8e120141 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6224c0df-13b0-4ff7-928f-9a2282386a2a (non-flash)
Nov 15 09:49:49 user nova-compute[75122]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9eb425d-fec8-4b38-9d64-62158ba2d03f (non-flash)
Nov 15 09:49:49 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 09:49:49 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cb529e4-9826-404a-8c9b-f33a8e120141 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6224c0df-13b0-4ff7-928f-9a2282386a2a (non-flash)
Nov 15 09:49:49 user nova-compute[75122]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9eb425d-fec8-4b38-9d64-62158ba2d03f (non-flash)
Nov 15 09:49:49 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 09:49:49 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cb529e4-9826-404a-8c9b-f33a8e120141 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff9e45a2f80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b9eb425d-fec8-4b38-9d64-62158ba2d03f'): ({'sdb'}, set())}) {{(pid=75122) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 09:49:49 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-9cb529e4-9826-404a-8c9b-f33a8e120141 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Removing single pathed devices sdb {{(pid=75122) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 09:49:49 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:49:50 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:49:50 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[01cbceff-13dc-428e-a811-e359e6fe54b7]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:49:50 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:49:50 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:49:50 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ec7a54e-d84a-4102-9003-f1677e04ce4e]: (4, ('ok\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:49:50 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-9cb529e4-9826-404a-8c9b-f33a8e120141 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Flushing IO for device /dev/sdb {{(pid=75122) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 09:49:50 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:49:50 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:49:50 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[f47ccb0a-2adb-4af5-b921-4496490ebf2c]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:49:50 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-9cb529e4-9826-404a-8c9b-f33a8e120141 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75122) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 09:49:50 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:49:50 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.052s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:49:50 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[c487fa7c-be91-418f-86e6-6c336e12cbe5]: (4, ('1', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:49:50 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-9cb529e4-9826-404a-8c9b-f33a8e120141 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75122) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 09:49:50 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-9cb529e4-9826-404a-8c9b-f33a8e120141 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] SCSI volumes sdb have been removed. {{(pid=75122) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 09:49:50 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cb529e4-9826-404a-8c9b-f33a8e120141 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b9eb425d-fec8-4b38-9d64-62158ba2d03f')] {{(pid=75122) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 09:49:50 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9eb425d-fec8-4b38-9d64-62158ba2d03f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:49:50 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9eb425d-fec8-4b38-9d64-62158ba2d03f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:49:50 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[b61a9bb2-3312-4c25-8fe8-bcb648381e24]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:49:50 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cb529e4-9826-404a-8c9b-f33a8e120141 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:49:50 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9eb425d-fec8-4b38-9d64-62158ba2d03f -p 172.16.0.220:3260 --logout {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:49:50 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-f2c56344-0d2e-40ed-9ea8-b2fd522d8da0 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 8271a429-e252-42bb-8717-e89dfd9739bf is timed out.
Nov 15 09:49:50 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-f2c56344-0d2e-40ed-9ea8-b2fd522d8da0 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Successfully detached device vdb from instance 8271a429-e252-42bb-8717-e89dfd9739bf from the live domain config.
Nov 15 09:49:50 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f2c56344-0d2e-40ed-9ea8-b2fd522d8da0 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] [instance: 8271a429-e252-42bb-8717-e89dfd9739bf] calling os-brick to detach iSCSI Volume {{(pid=75122) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 09:49:50 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2c56344-0d2e-40ed-9ea8-b2fd522d8da0 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffa04060b80>, {'target_iqn': 'iqn.2010-10.org.openstack:6224c0df-13b0-4ff7-928f-9a2282386a2a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AmXEUxDY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 09:49:50 user nova-compute[75122]: WARNING os_brick.initiator.connectors.base [None req-f2c56344-0d2e-40ed-9ea8-b2fd522d8da0 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 09:49:50 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-f2c56344-0d2e-40ed-9ea8-b2fd522d8da0 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 09:49:50 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:49:50 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:49:50 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75122) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 09:49:50 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75122) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 09:49:50 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75122) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 09:49:50 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:49:50 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9eb425d-fec8-4b38-9d64-62158ba2d03f -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:49:50 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[da921dc4-9bc2-4af6-ad30-f887b561e900]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:b9eb425d-fec8-4b38-9d64-62158ba2d03f, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:b9eb425d-fec8-4b38-9d64-62158ba2d03f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:49:50 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cb529e4-9826-404a-8c9b-f33a8e120141 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:b9eb425d-fec8-4b38-9d64-62158ba2d03f, portal: 172.16.0.220,3260]
Nov 15 09:49:50 user nova-compute[75122]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:b9eb425d-fec8-4b38-9d64-62158ba2d03f, portal: 172.16.0.220,3260] successful.
Nov 15 09:49:50 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:49:50 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9eb425d-fec8-4b38-9d64-62158ba2d03f -p 172.16.0.220:3260 --op delete {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:49:50 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9eb425d-fec8-4b38-9d64-62158ba2d03f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:49:50 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f2d1939-491b-434d-9cc1-19019444c43d]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:49:50 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cb529e4-9826-404a-8c9b-f33a8e120141 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:49:50 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-9cb529e4-9826-404a-8c9b-f33a8e120141 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.354s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 09:49:50 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cb529e4-9826-404a-8c9b-f33a8e120141 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] <== disconnect_volume: return (356ms) None {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 09:49:50 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9cb529e4-9826-404a-8c9b-f33a8e120141 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] [instance: 49154de0-f941-4ae0-a7af-72e75a4d8040] Disconnected iSCSI Volume {{(pid=75122) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 09:49:50 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-f2c56344-0d2e-40ed-9ea8-b2fd522d8da0 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.063s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 09:49:50 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:49:50 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:49:50 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e478163-4788-497e-80ea-da38e9f79a3b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6224c0df-13b0-4ff7-928f-9a2282386a2a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:49:50 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2c56344-0d2e-40ed-9ea8-b2fd522d8da0 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 09:49:50 user nova-compute[75122]: No targets found.
Nov 15 09:49:50 user nova-compute[75122]: iSNS:
Nov 15 09:49:50 user nova-compute[75122]: No targets found.
Nov 15 09:49:50 user nova-compute[75122]: STATIC:
Nov 15 09:49:50 user nova-compute[75122]: Target: iqn.2010-10.org.openstack:6224c0df-13b0-4ff7-928f-9a2282386a2a
Nov 15 09:49:50 user nova-compute[75122]:         Portal: 172.16.0.220:3260,-1
Nov 15 09:49:50 user nova-compute[75122]:                 Iface Name: default
Nov 15 09:49:50 user nova-compute[75122]: FIRMWARE:
Nov 15 09:49:50 user nova-compute[75122]: No targets found.
Nov 15 09:49:50 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 09:49:50 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2c56344-0d2e-40ed-9ea8-b2fd522d8da0 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 09:49:50 user nova-compute[75122]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 09:49:50 user nova-compute[75122]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75122) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 09:49:50 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2c56344-0d2e-40ed-9ea8-b2fd522d8da0 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6224c0df-13b0-4ff7-928f-9a2282386a2a', 0)] {{(pid=75122) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 09:49:50 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:49:50 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.015s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:49:50 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[b44f5668-0bb4-4099-8aef-af20fce8c25d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6224c0df-13b0-4ff7-928f-9a2282386a2a\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:49:50 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:49:50 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:49:50 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3e853ec-7e46-489e-8338-195f3d17e1e1]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6224c0df-13b0-4ff7-928f-9a2282386a2a (non-flash)\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:49:50 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2c56344-0d2e-40ed-9ea8-b2fd522d8da0 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6224c0df-13b0-4ff7-928f-9a2282386a2a (non-flash)
Nov 15 09:49:50 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 09:49:50 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2c56344-0d2e-40ed-9ea8-b2fd522d8da0 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6224c0df-13b0-4ff7-928f-9a2282386a2a (non-flash)
Nov 15 09:49:50 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 09:49:50 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2c56344-0d2e-40ed-9ea8-b2fd522d8da0 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff9fc0f0040>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6224c0df-13b0-4ff7-928f-9a2282386a2a'): ({'sdc'}, set())}) {{(pid=75122) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 09:49:50 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-f2c56344-0d2e-40ed-9ea8-b2fd522d8da0 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Removing single pathed devices sdc {{(pid=75122) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 09:49:50 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:49:50 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:49:50 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac679b59-0a28-4bf1-8d5a-f2f3dae673eb]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:49:50 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:49:50 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:49:50 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a1364b8-51b0-4411-a17b-27bd33471ba5]: (4, ('ok\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:49:50 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-f2c56344-0d2e-40ed-9ea8-b2fd522d8da0 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Flushing IO for device /dev/sdc {{(pid=75122) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 09:49:50 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:49:50 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:49:50 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[99d8f666-32bf-4c8b-ad81-88825bf13f9a]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:49:50 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-f2c56344-0d2e-40ed-9ea8-b2fd522d8da0 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75122) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 09:49:50 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:49:50 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.042s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:49:50 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[420a7bc7-a2be-4460-a21f-44496ad5c4af]: (4, ('1', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:49:50 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-f2c56344-0d2e-40ed-9ea8-b2fd522d8da0 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75122) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 09:49:50 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-f2c56344-0d2e-40ed-9ea8-b2fd522d8da0 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] SCSI volumes sdc have been removed. {{(pid=75122) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 09:49:50 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2c56344-0d2e-40ed-9ea8-b2fd522d8da0 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6224c0df-13b0-4ff7-928f-9a2282386a2a')] {{(pid=75122) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 09:49:50 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6224c0df-13b0-4ff7-928f-9a2282386a2a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:49:50 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6224c0df-13b0-4ff7-928f-9a2282386a2a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:49:50 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e4d8b27-be9e-43be-888e-7c6d57b7df02]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:49:50 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2c56344-0d2e-40ed-9ea8-b2fd522d8da0 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:49:50 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6224c0df-13b0-4ff7-928f-9a2282386a2a -p 172.16.0.220:3260 --logout {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:49:50 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6224c0df-13b0-4ff7-928f-9a2282386a2a -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:49:50 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[682d92f1-183f-4400-89b5-0980d7442ce2]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:6224c0df-13b0-4ff7-928f-9a2282386a2a, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:6224c0df-13b0-4ff7-928f-9a2282386a2a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:49:50 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2c56344-0d2e-40ed-9ea8-b2fd522d8da0 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:6224c0df-13b0-4ff7-928f-9a2282386a2a, portal: 172.16.0.220,3260]
Nov 15 09:49:50 user nova-compute[75122]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:6224c0df-13b0-4ff7-928f-9a2282386a2a, portal: 172.16.0.220,3260] successful.
Nov 15 09:49:50 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:49:50 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6224c0df-13b0-4ff7-928f-9a2282386a2a -p 172.16.0.220:3260 --op delete {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:49:50 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6224c0df-13b0-4ff7-928f-9a2282386a2a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:49:50 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[59de9924-43fa-4f53-bb54-6717eeb1ba88]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:49:50 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2c56344-0d2e-40ed-9ea8-b2fd522d8da0 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:49:50 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-f2c56344-0d2e-40ed-9ea8-b2fd522d8da0 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.297s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 09:49:50 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2c56344-0d2e-40ed-9ea8-b2fd522d8da0 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] <== disconnect_volume: return (360ms) None {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 09:49:50 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f2c56344-0d2e-40ed-9ea8-b2fd522d8da0 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] [instance: 8271a429-e252-42bb-8717-e89dfd9739bf] Disconnected iSCSI Volume {{(pid=75122) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 09:49:50 user nova-compute[75122]: DEBUG nova.objects.instance [None req-9cb529e4-9826-404a-8c9b-f33a8e120141 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Lazy-loading 'flavor' on Instance uuid 49154de0-f941-4ae0-a7af-72e75a4d8040 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:49:51 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-9cb529e4-9826-404a-8c9b-f33a8e120141 tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Lock "49154de0-f941-4ae0-a7af-72e75a4d8040" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.728s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:49:51 user nova-compute[75122]: DEBUG nova.objects.instance [None req-f2c56344-0d2e-40ed-9ea8-b2fd522d8da0 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Lazy-loading 'flavor' on Instance uuid 8271a429-e252-42bb-8717-e89dfd9739bf {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:49:51 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-f2c56344-0d2e-40ed-9ea8-b2fd522d8da0 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Lock "8271a429-e252-42bb-8717-e89dfd9739bf" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.047s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:49:53 user nova-compute[75122]: DEBUG nova.compute.manager [req-a3600deb-3be8-4a56-8faf-5dee9abe4548 req-b8f06a79-8d56-4b9b-b9bd-4a8cc0dcd7ae service nova] [instance: 3fbf220d-ad09-4436-8a0a-7a527dd00c6f] Received event network-changed-e5cf676d-827d-4867-8846-b468acff8b6d {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:49:53 user nova-compute[75122]: DEBUG nova.compute.manager [req-a3600deb-3be8-4a56-8faf-5dee9abe4548 req-b8f06a79-8d56-4b9b-b9bd-4a8cc0dcd7ae service nova] [instance: 3fbf220d-ad09-4436-8a0a-7a527dd00c6f] Refreshing instance network info cache due to event network-changed-e5cf676d-827d-4867-8846-b468acff8b6d. {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 09:49:53 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-a3600deb-3be8-4a56-8faf-5dee9abe4548 req-b8f06a79-8d56-4b9b-b9bd-4a8cc0dcd7ae service nova] Acquiring lock "refresh_cache-3fbf220d-ad09-4436-8a0a-7a527dd00c6f" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 09:49:53 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-a3600deb-3be8-4a56-8faf-5dee9abe4548 req-b8f06a79-8d56-4b9b-b9bd-4a8cc0dcd7ae service nova] Acquired lock "refresh_cache-3fbf220d-ad09-4436-8a0a-7a527dd00c6f" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 09:49:53 user nova-compute[75122]: DEBUG nova.network.neutron [req-a3600deb-3be8-4a56-8faf-5dee9abe4548 req-b8f06a79-8d56-4b9b-b9bd-4a8cc0dcd7ae service nova] [instance: 3fbf220d-ad09-4436-8a0a-7a527dd00c6f] Refreshing network info cache for port e5cf676d-827d-4867-8846-b468acff8b6d {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 09:49:53 user nova-compute[75122]: DEBUG nova.network.neutron [req-a3600deb-3be8-4a56-8faf-5dee9abe4548 req-b8f06a79-8d56-4b9b-b9bd-4a8cc0dcd7ae service nova] [instance: 3fbf220d-ad09-4436-8a0a-7a527dd00c6f] Updated VIF entry in instance network info cache for port e5cf676d-827d-4867-8846-b468acff8b6d. {{(pid=75122) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 09:49:53 user nova-compute[75122]: DEBUG nova.network.neutron [req-a3600deb-3be8-4a56-8faf-5dee9abe4548 req-b8f06a79-8d56-4b9b-b9bd-4a8cc0dcd7ae service nova] [instance: 3fbf220d-ad09-4436-8a0a-7a527dd00c6f] Updating instance_info_cache with network_info: [{"id": "e5cf676d-827d-4867-8846-b468acff8b6d", "address": "fa:16:3e:7d:32:4e", "network": {"id": "cc80acf3-8a44-4d7e-aaa0-1214700564b3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1084984321-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f29cd64a8a674d73936b8a0c90bf2d34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5cf676d-82", "ovs_interfaceid": "e5cf676d-827d-4867-8846-b468acff8b6d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:49:53 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-a3600deb-3be8-4a56-8faf-5dee9abe4548 req-b8f06a79-8d56-4b9b-b9bd-4a8cc0dcd7ae service nova] Releasing lock "refresh_cache-3fbf220d-ad09-4436-8a0a-7a527dd00c6f" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 09:49:54 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-621b158f-4fad-483e-b6db-821a7f76c911 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Acquiring lock "3fbf220d-ad09-4436-8a0a-7a527dd00c6f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:49:54 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-621b158f-4fad-483e-b6db-821a7f76c911 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Lock "3fbf220d-ad09-4436-8a0a-7a527dd00c6f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:49:54 user nova-compute[75122]: DEBUG nova.objects.instance [None req-621b158f-4fad-483e-b6db-821a7f76c911 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Lazy-loading 'flavor' on Instance uuid 3fbf220d-ad09-4436-8a0a-7a527dd00c6f {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:49:54 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-621b158f-4fad-483e-b6db-821a7f76c911 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Lock "3fbf220d-ad09-4436-8a0a-7a527dd00c6f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:49:54 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-621b158f-4fad-483e-b6db-821a7f76c911 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Acquiring lock "3fbf220d-ad09-4436-8a0a-7a527dd00c6f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:49:54 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-621b158f-4fad-483e-b6db-821a7f76c911 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Lock "3fbf220d-ad09-4436-8a0a-7a527dd00c6f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:49:54 user nova-compute[75122]: INFO nova.compute.manager [None req-621b158f-4fad-483e-b6db-821a7f76c911 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] [instance: 3fbf220d-ad09-4436-8a0a-7a527dd00c6f] Attaching volume 8d7a8c81-f259-4301-b461-d12ad0b05d67 to /dev/vdb
Nov 15 09:49:54 user nova-compute[75122]: DEBUG os_brick.utils [None req-621b158f-4fad-483e-b6db-821a7f76c911 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 09:49:54 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:49:55 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:49:55 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[3735c14a-8ad0-4fc8-b48e-883626da3a1b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:742fb64b3587\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:49:55 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:49:55 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:49:55 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[436a963e-901d-42f3-98d3-4040476fdfd8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:49:55 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:49:55 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:49:55 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[d21841c1-cc37-4dd2-99f5-95dbcba6a9d5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:49:55 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff41909e-700e-499a-96b6-52f4f3a8fc44]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:49:55 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-621b158f-4fad-483e-b6db-821a7f76c911 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Running cmd (subprocess): nvme version {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:49:55 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-621b158f-4fad-483e-b6db-821a7f76c911 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] 'nvme version' failed. Not Retrying. {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 09:49:55 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.nvmeof [None req-621b158f-4fad-483e-b6db-821a7f76c911 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] nvme not present on system {{(pid=75122) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 09:49:55 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:49:55 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 09:49:55 user nova-compute[75122]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 09:49:55 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[80e4d7e2-cb11-4641-9277-61c452855748]: (4, '') {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:49:55 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.lightos [None req-621b158f-4fad-483e-b6db-821a7f76c911 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75122) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 09:49:55 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.lightos [None req-621b158f-4fad-483e-b6db-821a7f76c911 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75122) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 09:49:55 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.lightos [None req-621b158f-4fad-483e-b6db-821a7f76c911 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] LIGHTOS: no hostnqn found. {{(pid=75122) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 09:49:55 user nova-compute[75122]: DEBUG os_brick.utils [None req-621b158f-4fad-483e-b6db-821a7f76c911 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:742fb64b3587', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 09:49:55 user nova-compute[75122]: DEBUG nova.virt.block_device [None req-621b158f-4fad-483e-b6db-821a7f76c911 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] [instance: 3fbf220d-ad09-4436-8a0a-7a527dd00c6f] Updating existing volume attachment record: 3d59e513-ba50-4fd3-a2d6-45c358575393 {{(pid=75122) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 09:49:55 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:49:56 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:49:58 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:49:59 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-621b158f-4fad-483e-b6db-821a7f76c911 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] [instance: 3fbf220d-ad09-4436-8a0a-7a527dd00c6f] Calling os-brick to attach iSCSI Volume {{(pid=75122) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 09:49:59 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-621b158f-4fad-483e-b6db-821a7f76c911 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffa04060b80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8d7a8c81-f259-4301-b461-d12ad0b05d67', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'amDCvTRj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 09:49:59 user nova-compute[75122]: WARNING os_brick.initiator.connectors.base [None req-621b158f-4fad-483e-b6db-821a7f76c911 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 09:49:59 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-621b158f-4fad-483e-b6db-821a7f76c911 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 09:49:59 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-621b158f-4fad-483e-b6db-821a7f76c911 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 09:49:59 user nova-compute[75122]: WARNING os_brick.initiator.connectors.base [None req-621b158f-4fad-483e-b6db-821a7f76c911 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 09:49:59 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-621b158f-4fad-483e-b6db-821a7f76c911 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8d7a8c81-f259-4301-b461-d12ad0b05d67" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 09:49:59 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-621b158f-4fad-483e-b6db-821a7f76c911 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8d7a8c81-f259-4301-b461-d12ad0b05d67" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 09:49:59 user nova-compute[75122]: INFO os_brick.initiator.connectors.iscsi [None req-621b158f-4fad-483e-b6db-821a7f76c911 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 09:49:59 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d7a8c81-f259-4301-b461-d12ad0b05d67 -p 172.16.0.220:3260 {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:49:59 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d7a8c81-f259-4301-b461-d12ad0b05d67 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:49:59 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[748e18d3-c7b1-486d-bd45-bb117c8b7fd0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:49:59 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-621b158f-4fad-483e-b6db-821a7f76c911 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 09:49:59 user nova-compute[75122]:  {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:49:59 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d7a8c81-f259-4301-b461-d12ad0b05d67 -p 172.16.0.220:3260 --interface default --op new {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:49:59 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d7a8c81-f259-4301-b461-d12ad0b05d67 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:49:59 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[27426876-2a03-4cd9-a260-d9457773a9a0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8d7a8c81-f259-4301-b461-d12ad0b05d67] added\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:49:59 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-621b158f-4fad-483e-b6db-821a7f76c911 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8d7a8c81-f259-4301-b461-d12ad0b05d67] added
Nov 15 09:49:59 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:49:59 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d7a8c81-f259-4301-b461-d12ad0b05d67 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:49:59 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d7a8c81-f259-4301-b461-d12ad0b05d67 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:49:59 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dc11d5d-cb98-4852-8dde-6825e94aa59e]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:49:59 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-621b158f-4fad-483e-b6db-821a7f76c911 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:49:59 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d7a8c81-f259-4301-b461-d12ad0b05d67 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:49:59 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d7a8c81-f259-4301-b461-d12ad0b05d67 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:49:59 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[315eca40-3573-4c9c-b578-2da1a210e67b]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:49:59 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-621b158f-4fad-483e-b6db-821a7f76c911 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:49:59 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d7a8c81-f259-4301-b461-d12ad0b05d67 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v amDCvTRj {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:49:59 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d7a8c81-f259-4301-b461-d12ad0b05d67 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v amDCvTRj" returned: 0 in 0.017s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:49:59 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[67821ce7-8e2b-45cd-bf56-7d7c50e23b6b]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:49:59 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-621b158f-4fad-483e-b6db-821a7f76c911 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'amDCvTRj'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:49:59 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d7a8c81-f259-4301-b461-d12ad0b05d67 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:49:59 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d7a8c81-f259-4301-b461-d12ad0b05d67 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:49:59 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4501206-5741-473d-804a-afaa7fdd16ad]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:49:59 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-621b158f-4fad-483e-b6db-821a7f76c911 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:49:59 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:49:59 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:49:59 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[cff01e5b-c65b-4afd-9597-f3e299c56a52]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:49:59 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-621b158f-4fad-483e-b6db-821a7f76c911 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 15 09:49:59 user nova-compute[75122]:  {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 09:49:59 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-621b158f-4fad-483e-b6db-821a7f76c911 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 15 09:49:59 user nova-compute[75122]:  {{(pid=75122) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 09:49:59 user nova-compute[75122]: WARNING os_brick.initiator.connectors.iscsi [None req-621b158f-4fad-483e-b6db-821a7f76c911 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 15 09:49:59 user nova-compute[75122]: 
Nov 15 09:49:59 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d7a8c81-f259-4301-b461-d12ad0b05d67 -p 172.16.0.220:3260 --login {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:49:59 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d7a8c81-f259-4301-b461-d12ad0b05d67 -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:49:59 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6e25234-8617-4a6e-bca0-78ade6e0a21b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8d7a8c81-f259-4301-b461-d12ad0b05d67, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8d7a8c81-f259-4301-b461-d12ad0b05d67, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:49:59 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-621b158f-4fad-483e-b6db-821a7f76c911 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8d7a8c81-f259-4301-b461-d12ad0b05d67, portal: 172.16.0.220,3260]
Nov 15 09:49:59 user nova-compute[75122]: Login to [iface: default, target: iqn.2010-10.org.openstack:8d7a8c81-f259-4301-b461-d12ad0b05d67, portal: 172.16.0.220,3260] successful.
Nov 15 09:49:59 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:49:59 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d7a8c81-f259-4301-b461-d12ad0b05d67 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:49:59 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d7a8c81-f259-4301-b461-d12ad0b05d67 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:49:59 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f3f2e0d-97b1-4d61-be8d-d68b050fa8f6]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:49:59 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-621b158f-4fad-483e-b6db-821a7f76c911 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:49:59 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:49:59 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:49:59 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[11f5bd42-1ecb-4eb4-9de3-495dd7466e3a]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d7a8c81-f259-4301-b461-d12ad0b05d67 (non-flash)\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:49:59 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-621b158f-4fad-483e-b6db-821a7f76c911 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d7a8c81-f259-4301-b461-d12ad0b05d67 (non-flash)
Nov 15 09:49:59 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 09:49:59 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-621b158f-4fad-483e-b6db-821a7f76c911 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d7a8c81-f259-4301-b461-d12ad0b05d67 (non-flash)
Nov 15 09:49:59 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 09:49:59 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-621b158f-4fad-483e-b6db-821a7f76c911 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8d7a8c81-f259-4301-b461-d12ad0b05d67" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.241s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 09:49:59 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-621b158f-4fad-483e-b6db-821a7f76c911 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Connected to 172.16.0.220:3260 {{(pid=75122) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 09:49:59 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-621b158f-4fad-483e-b6db-821a7f76c911 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] HCTL ('33', '-', '-', 0) found on session 46 with lun 0 {{(pid=75122) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 09:49:59 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-621b158f-4fad-483e-b6db-821a7f76c911 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75122) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 09:49:59 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:49:59 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:49:59 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb061f8d-22e5-422b-8c35-e16e7b70c89e]: (4, ('- - 0', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:49:59 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-621b158f-4fad-483e-b6db-821a7f76c911 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Searching for a device in session 46 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75122) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 09:49:59 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-621b158f-4fad-483e-b6db-821a7f76c911 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:8d7a8c81-f259-4301-b461-d12ad0b05d67', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'amDCvTRj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75122) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 09:50:00 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:50:00 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-621b158f-4fad-483e-b6db-821a7f76c911 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.273s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 09:50:00 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-621b158f-4fad-483e-b6db-821a7f76c911 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] <== connect_volume: return (1275ms) {'type': 'block', 'scsi_wwn': '26634663562356238', 'path': '/dev/sdb'} {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 09:50:00 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-621b158f-4fad-483e-b6db-821a7f76c911 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] [instance: 3fbf220d-ad09-4436-8a0a-7a527dd00c6f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26634663562356238', 'path': '/dev/sdb'} {{(pid=75122) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 09:50:00 user nova-compute[75122]: DEBUG nova.objects.instance [None req-621b158f-4fad-483e-b6db-821a7f76c911 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Lazy-loading 'flavor' on Instance uuid 3fbf220d-ad09-4436-8a0a-7a527dd00c6f {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:50:00 user nova-compute[75122]: DEBUG nova.virt.libvirt.guest [None req-621b158f-4fad-483e-b6db-821a7f76c911 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 09:50:00 user nova-compute[75122]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 09:50:00 user nova-compute[75122]:   <source dev="/dev/sdb"/>
Nov 15 09:50:00 user nova-compute[75122]:   <target dev="vdb" bus="virtio"/>
Nov 15 09:50:00 user nova-compute[75122]:   <serial>8d7a8c81-f259-4301-b461-d12ad0b05d67</serial>
Nov 15 09:50:00 user nova-compute[75122]: </disk>
Nov 15 09:50:00 user nova-compute[75122]:  {{(pid=75122) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 09:50:01 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-621b158f-4fad-483e-b6db-821a7f76c911 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] No BDM found with device name vda, not building metadata. {{(pid=75122) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 09:50:01 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-621b158f-4fad-483e-b6db-821a7f76c911 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75122) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 09:50:01 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-621b158f-4fad-483e-b6db-821a7f76c911 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] No VIF found with MAC fa:16:3e:7d:32:4e, not building metadata {{(pid=75122) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 09:50:01 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-621b158f-4fad-483e-b6db-821a7f76c911 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Lock "3fbf220d-ad09-4436-8a0a-7a527dd00c6f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.455s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:50:01 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:50:02 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-822497ff-2afc-42d6-a53e-b7fe99eb67c2 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Acquiring lock "3fbf220d-ad09-4436-8a0a-7a527dd00c6f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:50:02 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-822497ff-2afc-42d6-a53e-b7fe99eb67c2 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Lock "3fbf220d-ad09-4436-8a0a-7a527dd00c6f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:50:02 user nova-compute[75122]: INFO nova.compute.manager [None req-822497ff-2afc-42d6-a53e-b7fe99eb67c2 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] [instance: 3fbf220d-ad09-4436-8a0a-7a527dd00c6f] Detaching volume 8d7a8c81-f259-4301-b461-d12ad0b05d67
Nov 15 09:50:02 user nova-compute[75122]: INFO nova.virt.block_device [None req-822497ff-2afc-42d6-a53e-b7fe99eb67c2 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] [instance: 3fbf220d-ad09-4436-8a0a-7a527dd00c6f] Attempting to driver detach volume 8d7a8c81-f259-4301-b461-d12ad0b05d67 from mountpoint /dev/vdb
Nov 15 09:50:02 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-822497ff-2afc-42d6-a53e-b7fe99eb67c2 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Attempting to detach device vdb from instance 3fbf220d-ad09-4436-8a0a-7a527dd00c6f from the persistent domain config. {{(pid=75122) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 09:50:02 user nova-compute[75122]: DEBUG nova.virt.libvirt.guest [None req-822497ff-2afc-42d6-a53e-b7fe99eb67c2 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 09:50:02 user nova-compute[75122]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 09:50:02 user nova-compute[75122]:   <source dev="/dev/sdb"/>
Nov 15 09:50:02 user nova-compute[75122]:   <target dev="vdb" bus="virtio"/>
Nov 15 09:50:02 user nova-compute[75122]:   <serial>8d7a8c81-f259-4301-b461-d12ad0b05d67</serial>
Nov 15 09:50:02 user nova-compute[75122]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 09:50:02 user nova-compute[75122]: </disk>
Nov 15 09:50:02 user nova-compute[75122]:  {{(pid=75122) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 09:50:02 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-822497ff-2afc-42d6-a53e-b7fe99eb67c2 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Successfully detached device vdb from instance 3fbf220d-ad09-4436-8a0a-7a527dd00c6f from the persistent domain config.
Nov 15 09:50:02 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-822497ff-2afc-42d6-a53e-b7fe99eb67c2 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3fbf220d-ad09-4436-8a0a-7a527dd00c6f from the live domain config. {{(pid=75122) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 09:50:02 user nova-compute[75122]: DEBUG nova.virt.libvirt.guest [None req-822497ff-2afc-42d6-a53e-b7fe99eb67c2 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 09:50:02 user nova-compute[75122]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 09:50:02 user nova-compute[75122]:   <source dev="/dev/sdb"/>
Nov 15 09:50:02 user nova-compute[75122]:   <target dev="vdb" bus="virtio"/>
Nov 15 09:50:02 user nova-compute[75122]:   <serial>8d7a8c81-f259-4301-b461-d12ad0b05d67</serial>
Nov 15 09:50:02 user nova-compute[75122]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 09:50:02 user nova-compute[75122]: </disk>
Nov 15 09:50:02 user nova-compute[75122]:  {{(pid=75122) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 09:50:03 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-822497ff-2afc-42d6-a53e-b7fe99eb67c2 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3fbf220d-ad09-4436-8a0a-7a527dd00c6f {{(pid=75122) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 09:50:03 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:50:04 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:50:05 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:50:06 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-d9c185b0-caf8-49c6-b168-35cc02343d40 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Acquiring lock "001d589e-1bee-42da-8422-233ba796fbab" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:50:06 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-d9c185b0-caf8-49c6-b168-35cc02343d40 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Lock "001d589e-1bee-42da-8422-233ba796fbab" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:50:06 user nova-compute[75122]: DEBUG nova.compute.manager [None req-d9c185b0-caf8-49c6-b168-35cc02343d40 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: 001d589e-1bee-42da-8422-233ba796fbab] Starting instance... {{(pid=75122) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 09:50:06 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:50:06 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-d9c185b0-caf8-49c6-b168-35cc02343d40 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:50:06 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-d9c185b0-caf8-49c6-b168-35cc02343d40 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:50:06 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-d9c185b0-caf8-49c6-b168-35cc02343d40 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75122) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 09:50:06 user nova-compute[75122]: INFO nova.compute.claims [None req-d9c185b0-caf8-49c6-b168-35cc02343d40 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: 001d589e-1bee-42da-8422-233ba796fbab] Claim successful on node user
Nov 15 09:50:06 user nova-compute[75122]: DEBUG nova.compute.provider_tree [None req-d9c185b0-caf8-49c6-b168-35cc02343d40 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Inventory has not changed in ProviderTree for provider: 69a3da65-47be-44c6-b67c-c692b58284ef {{(pid=75122) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 09:50:06 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-d9c185b0-caf8-49c6-b168-35cc02343d40 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Inventory has not changed for provider 69a3da65-47be-44c6-b67c-c692b58284ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 09:50:06 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-d9c185b0-caf8-49c6-b168-35cc02343d40 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.319s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:50:06 user nova-compute[75122]: DEBUG nova.compute.manager [None req-d9c185b0-caf8-49c6-b168-35cc02343d40 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: 001d589e-1bee-42da-8422-233ba796fbab] Start building networks asynchronously for instance. {{(pid=75122) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 09:50:06 user nova-compute[75122]: DEBUG nova.compute.manager [None req-d9c185b0-caf8-49c6-b168-35cc02343d40 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: 001d589e-1bee-42da-8422-233ba796fbab] Allocating IP information in the background. {{(pid=75122) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 09:50:06 user nova-compute[75122]: DEBUG nova.network.neutron [None req-d9c185b0-caf8-49c6-b168-35cc02343d40 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: 001d589e-1bee-42da-8422-233ba796fbab] allocate_for_instance() {{(pid=75122) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 09:50:06 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-d9c185b0-caf8-49c6-b168-35cc02343d40 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: 001d589e-1bee-42da-8422-233ba796fbab] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 09:50:06 user nova-compute[75122]: DEBUG nova.compute.manager [None req-d9c185b0-caf8-49c6-b168-35cc02343d40 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: 001d589e-1bee-42da-8422-233ba796fbab] Start building block device mappings for instance. {{(pid=75122) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 09:50:06 user nova-compute[75122]: DEBUG nova.policy [None req-d9c185b0-caf8-49c6-b168-35cc02343d40 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '53d187e2a07b4437a02f65fb47a003ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c046170a2ad44ebba5d2de236d940be0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75122) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 09:50:06 user nova-compute[75122]: DEBUG nova.compute.manager [None req-d9c185b0-caf8-49c6-b168-35cc02343d40 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: 001d589e-1bee-42da-8422-233ba796fbab] Start spawning the instance on the hypervisor. {{(pid=75122) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 09:50:06 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-d9c185b0-caf8-49c6-b168-35cc02343d40 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: 001d589e-1bee-42da-8422-233ba796fbab] Creating instance directory {{(pid=75122) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 09:50:06 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-d9c185b0-caf8-49c6-b168-35cc02343d40 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: 001d589e-1bee-42da-8422-233ba796fbab] Creating image(s)
Nov 15 09:50:06 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-d9c185b0-caf8-49c6-b168-35cc02343d40 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Acquiring lock "/opt/stack/data/nova/instances/001d589e-1bee-42da-8422-233ba796fbab/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:50:06 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-d9c185b0-caf8-49c6-b168-35cc02343d40 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Lock "/opt/stack/data/nova/instances/001d589e-1bee-42da-8422-233ba796fbab/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:50:07 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-d9c185b0-caf8-49c6-b168-35cc02343d40 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Lock "/opt/stack/data/nova/instances/001d589e-1bee-42da-8422-233ba796fbab/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.010s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:50:07 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-d9c185b0-caf8-49c6-b168-35cc02343d40 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:50:07 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-d9c185b0-caf8-49c6-b168-35cc02343d40 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json" returned: 0 in 0.178s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:50:07 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-d9c185b0-caf8-49c6-b168-35cc02343d40 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Acquiring lock "95d6e29f74d5408f818e32f3bc29bc8270a4c665" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:50:07 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-d9c185b0-caf8-49c6-b168-35cc02343d40 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Lock "95d6e29f74d5408f818e32f3bc29bc8270a4c665" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:50:07 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-d9c185b0-caf8-49c6-b168-35cc02343d40 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:50:07 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-d9c185b0-caf8-49c6-b168-35cc02343d40 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json" returned: 0 in 0.176s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:50:07 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-d9c185b0-caf8-49c6-b168-35cc02343d40 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665,backing_fmt=raw /opt/stack/data/nova/instances/001d589e-1bee-42da-8422-233ba796fbab/disk 1073741824 {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:50:07 user nova-compute[75122]: DEBUG nova.network.neutron [None req-d9c185b0-caf8-49c6-b168-35cc02343d40 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: 001d589e-1bee-42da-8422-233ba796fbab] Successfully created port: 6a77f68d-d3da-47c6-a3de-09bd69399762 {{(pid=75122) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 09:50:07 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-d9c185b0-caf8-49c6-b168-35cc02343d40 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665,backing_fmt=raw /opt/stack/data/nova/instances/001d589e-1bee-42da-8422-233ba796fbab/disk 1073741824" returned: 0 in 0.066s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:50:07 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-d9c185b0-caf8-49c6-b168-35cc02343d40 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Lock "95d6e29f74d5408f818e32f3bc29bc8270a4c665" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.249s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:50:07 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-d9c185b0-caf8-49c6-b168-35cc02343d40 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:50:07 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-d9c185b0-caf8-49c6-b168-35cc02343d40 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json" returned: 0 in 0.171s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:50:07 user nova-compute[75122]: DEBUG nova.virt.disk.api [None req-d9c185b0-caf8-49c6-b168-35cc02343d40 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Checking if we can resize image /opt/stack/data/nova/instances/001d589e-1bee-42da-8422-233ba796fbab/disk. size=1073741824 {{(pid=75122) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 09:50:07 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-d9c185b0-caf8-49c6-b168-35cc02343d40 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/001d589e-1bee-42da-8422-233ba796fbab/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:50:07 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-d9c185b0-caf8-49c6-b168-35cc02343d40 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/001d589e-1bee-42da-8422-233ba796fbab/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:50:07 user nova-compute[75122]: DEBUG nova.virt.disk.api [None req-d9c185b0-caf8-49c6-b168-35cc02343d40 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Cannot resize image /opt/stack/data/nova/instances/001d589e-1bee-42da-8422-233ba796fbab/disk to a smaller size. {{(pid=75122) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 09:50:07 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-d9c185b0-caf8-49c6-b168-35cc02343d40 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: 001d589e-1bee-42da-8422-233ba796fbab] Created local disks {{(pid=75122) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 09:50:07 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-d9c185b0-caf8-49c6-b168-35cc02343d40 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: 001d589e-1bee-42da-8422-233ba796fbab] Ensure instance console log exists: /opt/stack/data/nova/instances/001d589e-1bee-42da-8422-233ba796fbab/console.log {{(pid=75122) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 09:50:07 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-d9c185b0-caf8-49c6-b168-35cc02343d40 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:50:07 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-d9c185b0-caf8-49c6-b168-35cc02343d40 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:50:07 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-d9c185b0-caf8-49c6-b168-35cc02343d40 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:50:08 user nova-compute[75122]: DEBUG nova.network.neutron [None req-d9c185b0-caf8-49c6-b168-35cc02343d40 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: 001d589e-1bee-42da-8422-233ba796fbab] Successfully updated port: 6a77f68d-d3da-47c6-a3de-09bd69399762 {{(pid=75122) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 09:50:08 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-d9c185b0-caf8-49c6-b168-35cc02343d40 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Acquiring lock "refresh_cache-001d589e-1bee-42da-8422-233ba796fbab" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 09:50:08 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-d9c185b0-caf8-49c6-b168-35cc02343d40 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Acquired lock "refresh_cache-001d589e-1bee-42da-8422-233ba796fbab" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 09:50:08 user nova-compute[75122]: DEBUG nova.network.neutron [None req-d9c185b0-caf8-49c6-b168-35cc02343d40 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: 001d589e-1bee-42da-8422-233ba796fbab] Building network info cache for instance {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 09:50:08 user nova-compute[75122]: DEBUG nova.compute.manager [req-d84e0467-64e5-4c6a-93e5-2b199129462c req-e3b0b12f-ecd1-442d-965f-2024d9bc4dd5 service nova] [instance: 001d589e-1bee-42da-8422-233ba796fbab] Received event network-changed-6a77f68d-d3da-47c6-a3de-09bd69399762 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:50:08 user nova-compute[75122]: DEBUG nova.compute.manager [req-d84e0467-64e5-4c6a-93e5-2b199129462c req-e3b0b12f-ecd1-442d-965f-2024d9bc4dd5 service nova] [instance: 001d589e-1bee-42da-8422-233ba796fbab] Refreshing instance network info cache due to event network-changed-6a77f68d-d3da-47c6-a3de-09bd69399762. {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 09:50:08 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-d84e0467-64e5-4c6a-93e5-2b199129462c req-e3b0b12f-ecd1-442d-965f-2024d9bc4dd5 service nova] Acquiring lock "refresh_cache-001d589e-1bee-42da-8422-233ba796fbab" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 09:50:08 user nova-compute[75122]: DEBUG nova.network.neutron [None req-d9c185b0-caf8-49c6-b168-35cc02343d40 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: 001d589e-1bee-42da-8422-233ba796fbab] Instance cache missing network info. {{(pid=75122) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 09:50:08 user nova-compute[75122]: DEBUG nova.network.neutron [None req-d9c185b0-caf8-49c6-b168-35cc02343d40 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: 001d589e-1bee-42da-8422-233ba796fbab] Updating instance_info_cache with network_info: [{"id": "6a77f68d-d3da-47c6-a3de-09bd69399762", "address": "fa:16:3e:87:a0:de", "network": {"id": "b780d5c1-a549-4b49-a036-5a272697d4b6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-229344021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c046170a2ad44ebba5d2de236d940be0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a77f68d-d3", "ovs_interfaceid": "6a77f68d-d3da-47c6-a3de-09bd69399762", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:50:08 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-d9c185b0-caf8-49c6-b168-35cc02343d40 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Releasing lock "refresh_cache-001d589e-1bee-42da-8422-233ba796fbab" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 09:50:08 user nova-compute[75122]: DEBUG nova.compute.manager [None req-d9c185b0-caf8-49c6-b168-35cc02343d40 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: 001d589e-1bee-42da-8422-233ba796fbab] Instance network_info: |[{"id": "6a77f68d-d3da-47c6-a3de-09bd69399762", "address": "fa:16:3e:87:a0:de", "network": {"id": "b780d5c1-a549-4b49-a036-5a272697d4b6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-229344021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c046170a2ad44ebba5d2de236d940be0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a77f68d-d3", "ovs_interfaceid": "6a77f68d-d3da-47c6-a3de-09bd69399762", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75122) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 09:50:08 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-d84e0467-64e5-4c6a-93e5-2b199129462c req-e3b0b12f-ecd1-442d-965f-2024d9bc4dd5 service nova] Acquired lock "refresh_cache-001d589e-1bee-42da-8422-233ba796fbab" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 09:50:08 user nova-compute[75122]: DEBUG nova.network.neutron [req-d84e0467-64e5-4c6a-93e5-2b199129462c req-e3b0b12f-ecd1-442d-965f-2024d9bc4dd5 service nova] [instance: 001d589e-1bee-42da-8422-233ba796fbab] Refreshing network info cache for port 6a77f68d-d3da-47c6-a3de-09bd69399762 {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 09:50:08 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-d9c185b0-caf8-49c6-b168-35cc02343d40 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: 001d589e-1bee-42da-8422-233ba796fbab] Start _get_guest_xml network_info=[{"id": "6a77f68d-d3da-47c6-a3de-09bd69399762", "address": "fa:16:3e:87:a0:de", "network": {"id": "b780d5c1-a549-4b49-a036-5a272697d4b6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-229344021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c046170a2ad44ebba5d2de236d940be0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a77f68d-d3", "ovs_interfaceid": "6a77f68d-d3da-47c6-a3de-09bd69399762", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T09:26:31Z,direct_url=<?>,disk_format='qcow2',id=5e862cfe-47b8-4725-8292-65761ee6d0f5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9c57733cb41847c0b4ad31519c382e5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T09:26:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '5e862cfe-47b8-4725-8292-65761ee6d0f5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75122) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 09:50:08 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-d9c185b0-caf8-49c6-b168-35cc02343d40 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 09:50:08 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-d9c185b0-caf8-49c6-b168-35cc02343d40 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 09:50:08 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-d9c185b0-caf8-49c6-b168-35cc02343d40 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75122) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 09:50:08 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-d9c185b0-caf8-49c6-b168-35cc02343d40 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] CPU controller missing on host. {{(pid=75122) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 09:50:08 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-d9c185b0-caf8-49c6-b168-35cc02343d40 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75122) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 09:50:08 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-d9c185b0-caf8-49c6-b168-35cc02343d40 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] CPU controller found on host. {{(pid=75122) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 09:50:08 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-d9c185b0-caf8-49c6-b168-35cc02343d40 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75122) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 09:50:08 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-d9c185b0-caf8-49c6-b168-35cc02343d40 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T09:26:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T09:26:31Z,direct_url=<?>,disk_format='qcow2',id=5e862cfe-47b8-4725-8292-65761ee6d0f5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9c57733cb41847c0b4ad31519c382e5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T09:26:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 09:50:08 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-d9c185b0-caf8-49c6-b168-35cc02343d40 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Flavor limits 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 09:50:08 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-d9c185b0-caf8-49c6-b168-35cc02343d40 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Image limits 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 09:50:08 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-d9c185b0-caf8-49c6-b168-35cc02343d40 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Flavor pref 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 09:50:08 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-d9c185b0-caf8-49c6-b168-35cc02343d40 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Image pref 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 09:50:08 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-d9c185b0-caf8-49c6-b168-35cc02343d40 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 09:50:08 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-d9c185b0-caf8-49c6-b168-35cc02343d40 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 09:50:08 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-d9c185b0-caf8-49c6-b168-35cc02343d40 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75122) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 09:50:08 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-d9c185b0-caf8-49c6-b168-35cc02343d40 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Got 1 possible topologies {{(pid=75122) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 09:50:08 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-d9c185b0-caf8-49c6-b168-35cc02343d40 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 09:50:08 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-d9c185b0-caf8-49c6-b168-35cc02343d40 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 09:50:08 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-d9c185b0-caf8-49c6-b168-35cc02343d40 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T09:50:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1100516819',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1100516819',id=35,image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c046170a2ad44ebba5d2de236d940be0',ramdisk_id='',reservation_id='r-aenl36am',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1545444983',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T09:50:07Z,user_data=None,user_id='53d187e2a07b4437a02f65fb47a003ee',uuid=001d589e-1bee-42da-8422-233ba796fbab,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6a77f68d-d3da-47c6-a3de-09bd69399762", "address": "fa:16:3e:87:a0:de", "network": {"id": "b780d5c1-a549-4b49-a036-5a272697d4b6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-229344021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c046170a2ad44ebba5d2de236d940be0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a77f68d-d3", "ovs_interfaceid": "6a77f68d-d3da-47c6-a3de-09bd69399762", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75122) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 09:50:08 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-d9c185b0-caf8-49c6-b168-35cc02343d40 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Converting VIF {"id": "6a77f68d-d3da-47c6-a3de-09bd69399762", "address": "fa:16:3e:87:a0:de", "network": {"id": "b780d5c1-a549-4b49-a036-5a272697d4b6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-229344021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c046170a2ad44ebba5d2de236d940be0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a77f68d-d3", "ovs_interfaceid": "6a77f68d-d3da-47c6-a3de-09bd69399762", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 09:50:08 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-d9c185b0-caf8-49c6-b168-35cc02343d40 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:a0:de,bridge_name='br-int',has_traffic_filtering=True,id=6a77f68d-d3da-47c6-a3de-09bd69399762,network=Network(b780d5c1-a549-4b49-a036-5a272697d4b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a77f68d-d3') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 09:50:08 user nova-compute[75122]: DEBUG nova.objects.instance [None req-d9c185b0-caf8-49c6-b168-35cc02343d40 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Lazy-loading 'pci_devices' on Instance uuid 001d589e-1bee-42da-8422-233ba796fbab {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:50:08 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-d9c185b0-caf8-49c6-b168-35cc02343d40 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: 001d589e-1bee-42da-8422-233ba796fbab] End _get_guest_xml xml=<domain type="kvm">
Nov 15 09:50:08 user nova-compute[75122]:   <uuid>001d589e-1bee-42da-8422-233ba796fbab</uuid>
Nov 15 09:50:08 user nova-compute[75122]:   <name>instance-00000023</name>
Nov 15 09:50:08 user nova-compute[75122]:   <memory>524288</memory>
Nov 15 09:50:08 user nova-compute[75122]:   <vcpu>1</vcpu>
Nov 15 09:50:08 user nova-compute[75122]:   <metadata>
Nov 15 09:50:08 user nova-compute[75122]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 09:50:08 user nova-compute[75122]:       <nova:package version="0.0.0"/>
Nov 15 09:50:08 user nova-compute[75122]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1100516819</nova:name>
Nov 15 09:50:08 user nova-compute[75122]:       <nova:creationTime>2023-11-15 09:50:08</nova:creationTime>
Nov 15 09:50:08 user nova-compute[75122]:       <nova:flavor name="m1.tiny">
Nov 15 09:50:08 user nova-compute[75122]:         <nova:memory>512</nova:memory>
Nov 15 09:50:08 user nova-compute[75122]:         <nova:disk>1</nova:disk>
Nov 15 09:50:08 user nova-compute[75122]:         <nova:swap>0</nova:swap>
Nov 15 09:50:08 user nova-compute[75122]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 09:50:08 user nova-compute[75122]:         <nova:vcpus>1</nova:vcpus>
Nov 15 09:50:08 user nova-compute[75122]:       </nova:flavor>
Nov 15 09:50:08 user nova-compute[75122]:       <nova:owner>
Nov 15 09:50:08 user nova-compute[75122]:         <nova:user uuid="53d187e2a07b4437a02f65fb47a003ee">tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member</nova:user>
Nov 15 09:50:08 user nova-compute[75122]:         <nova:project uuid="c046170a2ad44ebba5d2de236d940be0">tempest-ServerBootFromVolumeStableRescueTest-1545444983</nova:project>
Nov 15 09:50:08 user nova-compute[75122]:       </nova:owner>
Nov 15 09:50:08 user nova-compute[75122]:       <nova:root type="image" uuid="5e862cfe-47b8-4725-8292-65761ee6d0f5"/>
Nov 15 09:50:08 user nova-compute[75122]:       <nova:ports>
Nov 15 09:50:08 user nova-compute[75122]:         <nova:port uuid="6a77f68d-d3da-47c6-a3de-09bd69399762">
Nov 15 09:50:08 user nova-compute[75122]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 15 09:50:08 user nova-compute[75122]:         </nova:port>
Nov 15 09:50:08 user nova-compute[75122]:       </nova:ports>
Nov 15 09:50:08 user nova-compute[75122]:     </nova:instance>
Nov 15 09:50:08 user nova-compute[75122]:   </metadata>
Nov 15 09:50:08 user nova-compute[75122]:   <sysinfo type="smbios">
Nov 15 09:50:08 user nova-compute[75122]:     <system>
Nov 15 09:50:08 user nova-compute[75122]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 09:50:08 user nova-compute[75122]:       <entry name="product">OpenStack Nova</entry>
Nov 15 09:50:08 user nova-compute[75122]:       <entry name="version">0.0.0</entry>
Nov 15 09:50:08 user nova-compute[75122]:       <entry name="serial">001d589e-1bee-42da-8422-233ba796fbab</entry>
Nov 15 09:50:08 user nova-compute[75122]:       <entry name="uuid">001d589e-1bee-42da-8422-233ba796fbab</entry>
Nov 15 09:50:08 user nova-compute[75122]:       <entry name="family">Virtual Machine</entry>
Nov 15 09:50:08 user nova-compute[75122]:     </system>
Nov 15 09:50:08 user nova-compute[75122]:   </sysinfo>
Nov 15 09:50:08 user nova-compute[75122]:   <os>
Nov 15 09:50:08 user nova-compute[75122]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 09:50:08 user nova-compute[75122]:     <boot dev="hd"/>
Nov 15 09:50:08 user nova-compute[75122]:     <smbios mode="sysinfo"/>
Nov 15 09:50:08 user nova-compute[75122]:   </os>
Nov 15 09:50:08 user nova-compute[75122]:   <features>
Nov 15 09:50:08 user nova-compute[75122]:     <acpi/>
Nov 15 09:50:08 user nova-compute[75122]:     <apic/>
Nov 15 09:50:08 user nova-compute[75122]:     <vmcoreinfo/>
Nov 15 09:50:08 user nova-compute[75122]:   </features>
Nov 15 09:50:08 user nova-compute[75122]:   <clock offset="utc">
Nov 15 09:50:08 user nova-compute[75122]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 09:50:08 user nova-compute[75122]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 09:50:08 user nova-compute[75122]:     <timer name="hpet" present="no"/>
Nov 15 09:50:08 user nova-compute[75122]:   </clock>
Nov 15 09:50:08 user nova-compute[75122]:   <cpu mode="custom" match="exact">
Nov 15 09:50:08 user nova-compute[75122]:     <model>Nehalem</model>
Nov 15 09:50:08 user nova-compute[75122]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 09:50:08 user nova-compute[75122]:   </cpu>
Nov 15 09:50:08 user nova-compute[75122]:   <devices>
Nov 15 09:50:08 user nova-compute[75122]:     <disk type="file" device="disk">
Nov 15 09:50:08 user nova-compute[75122]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 09:50:08 user nova-compute[75122]:       <source file="/opt/stack/data/nova/instances/001d589e-1bee-42da-8422-233ba796fbab/disk"/>
Nov 15 09:50:08 user nova-compute[75122]:       <target dev="vda" bus="virtio"/>
Nov 15 09:50:08 user nova-compute[75122]:     </disk>
Nov 15 09:50:08 user nova-compute[75122]:     <interface type="ethernet">
Nov 15 09:50:08 user nova-compute[75122]:       <mac address="fa:16:3e:87:a0:de"/>
Nov 15 09:50:08 user nova-compute[75122]:       <model type="virtio"/>
Nov 15 09:50:08 user nova-compute[75122]:       <mtu size="1442"/>
Nov 15 09:50:08 user nova-compute[75122]:       <target dev="tap6a77f68d-d3"/>
Nov 15 09:50:08 user nova-compute[75122]:     </interface>
Nov 15 09:50:08 user nova-compute[75122]:     <serial type="pty">
Nov 15 09:50:08 user nova-compute[75122]:       <log file="/opt/stack/data/nova/instances/001d589e-1bee-42da-8422-233ba796fbab/console.log" append="off"/>
Nov 15 09:50:08 user nova-compute[75122]:     </serial>
Nov 15 09:50:08 user nova-compute[75122]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 09:50:08 user nova-compute[75122]:     <video>
Nov 15 09:50:08 user nova-compute[75122]:       <model type="virtio"/>
Nov 15 09:50:08 user nova-compute[75122]:     </video>
Nov 15 09:50:08 user nova-compute[75122]:     <rng model="virtio">
Nov 15 09:50:08 user nova-compute[75122]:       <backend model="random">/dev/urandom</backend>
Nov 15 09:50:08 user nova-compute[75122]:     </rng>
Nov 15 09:50:08 user nova-compute[75122]:     <controller type="usb" index="0" model="none"/>
Nov 15 09:50:08 user nova-compute[75122]:     <memballoon model="virtio">
Nov 15 09:50:08 user nova-compute[75122]:       <stats period="10"/>
Nov 15 09:50:08 user nova-compute[75122]:     </memballoon>
Nov 15 09:50:08 user nova-compute[75122]:   </devices>
Nov 15 09:50:08 user nova-compute[75122]: </domain>
Nov 15 09:50:08 user nova-compute[75122]:  {{(pid=75122) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 09:50:08 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-d9c185b0-caf8-49c6-b168-35cc02343d40 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T09:50:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1100516819',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1100516819',id=35,image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c046170a2ad44ebba5d2de236d940be0',ramdisk_id='',reservation_id='r-aenl36am',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1545444983',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T09:50:07Z,user_data=None,user_id='53d187e2a07b4437a02f65fb47a003ee',uuid=001d589e-1bee-42da-8422-233ba796fbab,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6a77f68d-d3da-47c6-a3de-09bd69399762", "address": "fa:16:3e:87:a0:de", "network": {"id": "b780d5c1-a549-4b49-a036-5a272697d4b6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-229344021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c046170a2ad44ebba5d2de236d940be0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a77f68d-d3", "ovs_interfaceid": "6a77f68d-d3da-47c6-a3de-09bd69399762", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 09:50:08 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-d9c185b0-caf8-49c6-b168-35cc02343d40 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Converting VIF {"id": "6a77f68d-d3da-47c6-a3de-09bd69399762", "address": "fa:16:3e:87:a0:de", "network": {"id": "b780d5c1-a549-4b49-a036-5a272697d4b6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-229344021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c046170a2ad44ebba5d2de236d940be0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a77f68d-d3", "ovs_interfaceid": "6a77f68d-d3da-47c6-a3de-09bd69399762", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 09:50:08 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-d9c185b0-caf8-49c6-b168-35cc02343d40 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:a0:de,bridge_name='br-int',has_traffic_filtering=True,id=6a77f68d-d3da-47c6-a3de-09bd69399762,network=Network(b780d5c1-a549-4b49-a036-5a272697d4b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a77f68d-d3') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 09:50:08 user nova-compute[75122]: DEBUG os_vif [None req-d9c185b0-caf8-49c6-b168-35cc02343d40 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:a0:de,bridge_name='br-int',has_traffic_filtering=True,id=6a77f68d-d3da-47c6-a3de-09bd69399762,network=Network(b780d5c1-a549-4b49-a036-5a272697d4b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a77f68d-d3') {{(pid=75122) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 09:50:08 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:50:08 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:50:08 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 09:50:08 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:50:08 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '74615282-478a-58ac-be64-8722b37fa029', '_type': 'linux-noop'}}, row=False) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:50:08 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:50:08 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:50:08 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:50:08 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6a77f68d-d3, may_exist=True, interface_attrs={}) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:50:08 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6a77f68d-d3, col_values=(('qos', UUID('22078380-9f76-4de7-a8ca-65426f731101')),), if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:50:08 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6a77f68d-d3, col_values=(('external_ids', {'iface-id': '6a77f68d-d3da-47c6-a3de-09bd69399762', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:87:a0:de', 'vm-uuid': '001d589e-1bee-42da-8422-233ba796fbab'}),), if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:50:08 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:50:08 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:50:08 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:50:08 user nova-compute[75122]: INFO os_vif [None req-d9c185b0-caf8-49c6-b168-35cc02343d40 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:a0:de,bridge_name='br-int',has_traffic_filtering=True,id=6a77f68d-d3da-47c6-a3de-09bd69399762,network=Network(b780d5c1-a549-4b49-a036-5a272697d4b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a77f68d-d3')
Nov 15 09:50:08 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-d9c185b0-caf8-49c6-b168-35cc02343d40 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] No BDM found with device name vda, not building metadata. {{(pid=75122) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 09:50:08 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-d9c185b0-caf8-49c6-b168-35cc02343d40 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] No VIF found with MAC fa:16:3e:87:a0:de, not building metadata {{(pid=75122) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 09:50:08 user nova-compute[75122]: DEBUG nova.network.neutron [req-d84e0467-64e5-4c6a-93e5-2b199129462c req-e3b0b12f-ecd1-442d-965f-2024d9bc4dd5 service nova] [instance: 001d589e-1bee-42da-8422-233ba796fbab] Updated VIF entry in instance network info cache for port 6a77f68d-d3da-47c6-a3de-09bd69399762. {{(pid=75122) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 09:50:08 user nova-compute[75122]: DEBUG nova.network.neutron [req-d84e0467-64e5-4c6a-93e5-2b199129462c req-e3b0b12f-ecd1-442d-965f-2024d9bc4dd5 service nova] [instance: 001d589e-1bee-42da-8422-233ba796fbab] Updating instance_info_cache with network_info: [{"id": "6a77f68d-d3da-47c6-a3de-09bd69399762", "address": "fa:16:3e:87:a0:de", "network": {"id": "b780d5c1-a549-4b49-a036-5a272697d4b6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-229344021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c046170a2ad44ebba5d2de236d940be0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a77f68d-d3", "ovs_interfaceid": "6a77f68d-d3da-47c6-a3de-09bd69399762", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:50:08 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-d84e0467-64e5-4c6a-93e5-2b199129462c req-e3b0b12f-ecd1-442d-965f-2024d9bc4dd5 service nova] Releasing lock "refresh_cache-001d589e-1bee-42da-8422-233ba796fbab" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 09:50:09 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:50:09 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:50:09 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:50:10 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:50:10 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:50:10 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:50:10 user nova-compute[75122]: DEBUG nova.compute.manager [req-c88022fc-24a0-45f2-8ab3-5dd2771ae89e req-76822de2-5344-4ef2-83da-431bc79af2cd service nova] [instance: 001d589e-1bee-42da-8422-233ba796fbab] Received event network-vif-plugged-6a77f68d-d3da-47c6-a3de-09bd69399762 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:50:10 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-c88022fc-24a0-45f2-8ab3-5dd2771ae89e req-76822de2-5344-4ef2-83da-431bc79af2cd service nova] Acquiring lock "001d589e-1bee-42da-8422-233ba796fbab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:50:10 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-c88022fc-24a0-45f2-8ab3-5dd2771ae89e req-76822de2-5344-4ef2-83da-431bc79af2cd service nova] Lock "001d589e-1bee-42da-8422-233ba796fbab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:50:10 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-c88022fc-24a0-45f2-8ab3-5dd2771ae89e req-76822de2-5344-4ef2-83da-431bc79af2cd service nova] Lock "001d589e-1bee-42da-8422-233ba796fbab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:50:10 user nova-compute[75122]: DEBUG nova.compute.manager [req-c88022fc-24a0-45f2-8ab3-5dd2771ae89e req-76822de2-5344-4ef2-83da-431bc79af2cd service nova] [instance: 001d589e-1bee-42da-8422-233ba796fbab] No waiting events found dispatching network-vif-plugged-6a77f68d-d3da-47c6-a3de-09bd69399762 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:50:10 user nova-compute[75122]: WARNING nova.compute.manager [req-c88022fc-24a0-45f2-8ab3-5dd2771ae89e req-76822de2-5344-4ef2-83da-431bc79af2cd service nova] [instance: 001d589e-1bee-42da-8422-233ba796fbab] Received unexpected event network-vif-plugged-6a77f68d-d3da-47c6-a3de-09bd69399762 for instance with vm_state building and task_state spawning.
Nov 15 09:50:10 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:50:11 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:50:11 user nova-compute[75122]: DEBUG nova.compute.manager [None req-d9c185b0-caf8-49c6-b168-35cc02343d40 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: 001d589e-1bee-42da-8422-233ba796fbab] Instance event wait completed in 0 seconds for  {{(pid=75122) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 09:50:11 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-d9c185b0-caf8-49c6-b168-35cc02343d40 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: 001d589e-1bee-42da-8422-233ba796fbab] Guest created on hypervisor {{(pid=75122) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 09:50:11 user nova-compute[75122]: INFO nova.virt.libvirt.driver [-] [instance: 001d589e-1bee-42da-8422-233ba796fbab] Instance spawned successfully.
Nov 15 09:50:11 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-d9c185b0-caf8-49c6-b168-35cc02343d40 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: 001d589e-1bee-42da-8422-233ba796fbab] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 09:50:11 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-d9c185b0-caf8-49c6-b168-35cc02343d40 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: 001d589e-1bee-42da-8422-233ba796fbab] Found default for hw_cdrom_bus of ide {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:50:11 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-d9c185b0-caf8-49c6-b168-35cc02343d40 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: 001d589e-1bee-42da-8422-233ba796fbab] Found default for hw_disk_bus of virtio {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:50:11 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-d9c185b0-caf8-49c6-b168-35cc02343d40 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: 001d589e-1bee-42da-8422-233ba796fbab] Found default for hw_input_bus of None {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:50:11 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-d9c185b0-caf8-49c6-b168-35cc02343d40 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: 001d589e-1bee-42da-8422-233ba796fbab] Found default for hw_pointer_model of None {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:50:11 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-d9c185b0-caf8-49c6-b168-35cc02343d40 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: 001d589e-1bee-42da-8422-233ba796fbab] Found default for hw_video_model of virtio {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:50:11 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-d9c185b0-caf8-49c6-b168-35cc02343d40 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: 001d589e-1bee-42da-8422-233ba796fbab] Found default for hw_vif_model of virtio {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:50:12 user nova-compute[75122]: INFO nova.compute.manager [None req-d9c185b0-caf8-49c6-b168-35cc02343d40 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: 001d589e-1bee-42da-8422-233ba796fbab] Took 5.02 seconds to spawn the instance on the hypervisor.
Nov 15 09:50:12 user nova-compute[75122]: DEBUG nova.compute.manager [None req-d9c185b0-caf8-49c6-b168-35cc02343d40 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: 001d589e-1bee-42da-8422-233ba796fbab] Checking state {{(pid=75122) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 09:50:12 user nova-compute[75122]: INFO nova.compute.manager [None req-d9c185b0-caf8-49c6-b168-35cc02343d40 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: 001d589e-1bee-42da-8422-233ba796fbab] Took 5.66 seconds to build instance.
Nov 15 09:50:12 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-d9c185b0-caf8-49c6-b168-35cc02343d40 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Lock "001d589e-1bee-42da-8422-233ba796fbab" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.768s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:50:12 user nova-compute[75122]: DEBUG nova.compute.manager [req-942bad06-c314-49a2-8c3f-22ca09528001 req-79d1be40-b92e-4473-b431-d5a4329fc278 service nova] [instance: 001d589e-1bee-42da-8422-233ba796fbab] Received event network-vif-plugged-6a77f68d-d3da-47c6-a3de-09bd69399762 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:50:12 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-942bad06-c314-49a2-8c3f-22ca09528001 req-79d1be40-b92e-4473-b431-d5a4329fc278 service nova] Acquiring lock "001d589e-1bee-42da-8422-233ba796fbab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:50:12 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-942bad06-c314-49a2-8c3f-22ca09528001 req-79d1be40-b92e-4473-b431-d5a4329fc278 service nova] Lock "001d589e-1bee-42da-8422-233ba796fbab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:50:12 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-942bad06-c314-49a2-8c3f-22ca09528001 req-79d1be40-b92e-4473-b431-d5a4329fc278 service nova] Lock "001d589e-1bee-42da-8422-233ba796fbab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:50:12 user nova-compute[75122]: DEBUG nova.compute.manager [req-942bad06-c314-49a2-8c3f-22ca09528001 req-79d1be40-b92e-4473-b431-d5a4329fc278 service nova] [instance: 001d589e-1bee-42da-8422-233ba796fbab] No waiting events found dispatching network-vif-plugged-6a77f68d-d3da-47c6-a3de-09bd69399762 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:50:12 user nova-compute[75122]: WARNING nova.compute.manager [req-942bad06-c314-49a2-8c3f-22ca09528001 req-79d1be40-b92e-4473-b431-d5a4329fc278 service nova] [instance: 001d589e-1bee-42da-8422-233ba796fbab] Received unexpected event network-vif-plugged-6a77f68d-d3da-47c6-a3de-09bd69399762 for instance with vm_state active and task_state None.
Nov 15 09:50:13 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:50:16 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:50:18 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:50:19 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-96afcc20-1665-4d70-9162-0e5e173fa6fe tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Acquiring lock "8271a429-e252-42bb-8717-e89dfd9739bf" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:50:19 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-96afcc20-1665-4d70-9162-0e5e173fa6fe tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Lock "8271a429-e252-42bb-8717-e89dfd9739bf" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:50:19 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-96afcc20-1665-4d70-9162-0e5e173fa6fe tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Acquiring lock "8271a429-e252-42bb-8717-e89dfd9739bf-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:50:19 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-96afcc20-1665-4d70-9162-0e5e173fa6fe tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Lock "8271a429-e252-42bb-8717-e89dfd9739bf-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:50:19 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-96afcc20-1665-4d70-9162-0e5e173fa6fe tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Lock "8271a429-e252-42bb-8717-e89dfd9739bf-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:50:19 user nova-compute[75122]: INFO nova.compute.manager [None req-96afcc20-1665-4d70-9162-0e5e173fa6fe tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] [instance: 8271a429-e252-42bb-8717-e89dfd9739bf] Terminating instance
Nov 15 09:50:19 user nova-compute[75122]: DEBUG nova.compute.manager [None req-96afcc20-1665-4d70-9162-0e5e173fa6fe tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] [instance: 8271a429-e252-42bb-8717-e89dfd9739bf] Start destroying the instance on the hypervisor. {{(pid=75122) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 09:50:19 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:50:19 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:50:19 user nova-compute[75122]: DEBUG nova.compute.manager [req-bd867f81-b9eb-4e68-a86c-270238d5119f req-5f17ff37-8374-4c51-b1f4-e6453bac347c service nova] [instance: 8271a429-e252-42bb-8717-e89dfd9739bf] Received event network-vif-unplugged-044ffaae-8351-4c7f-9b12-32ac7d4b3565 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:50:19 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-bd867f81-b9eb-4e68-a86c-270238d5119f req-5f17ff37-8374-4c51-b1f4-e6453bac347c service nova] Acquiring lock "8271a429-e252-42bb-8717-e89dfd9739bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:50:19 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-bd867f81-b9eb-4e68-a86c-270238d5119f req-5f17ff37-8374-4c51-b1f4-e6453bac347c service nova] Lock "8271a429-e252-42bb-8717-e89dfd9739bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:50:19 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-bd867f81-b9eb-4e68-a86c-270238d5119f req-5f17ff37-8374-4c51-b1f4-e6453bac347c service nova] Lock "8271a429-e252-42bb-8717-e89dfd9739bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:50:19 user nova-compute[75122]: DEBUG nova.compute.manager [req-bd867f81-b9eb-4e68-a86c-270238d5119f req-5f17ff37-8374-4c51-b1f4-e6453bac347c service nova] [instance: 8271a429-e252-42bb-8717-e89dfd9739bf] No waiting events found dispatching network-vif-unplugged-044ffaae-8351-4c7f-9b12-32ac7d4b3565 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:50:19 user nova-compute[75122]: DEBUG nova.compute.manager [req-bd867f81-b9eb-4e68-a86c-270238d5119f req-5f17ff37-8374-4c51-b1f4-e6453bac347c service nova] [instance: 8271a429-e252-42bb-8717-e89dfd9739bf] Received event network-vif-unplugged-044ffaae-8351-4c7f-9b12-32ac7d4b3565 for instance with task_state deleting. {{(pid=75122) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 09:50:20 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:50:20 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:50:20 user nova-compute[75122]: INFO nova.virt.libvirt.driver [-] [instance: 8271a429-e252-42bb-8717-e89dfd9739bf] Instance destroyed successfully.
Nov 15 09:50:20 user nova-compute[75122]: DEBUG nova.objects.instance [None req-96afcc20-1665-4d70-9162-0e5e173fa6fe tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Lazy-loading 'resources' on Instance uuid 8271a429-e252-42bb-8717-e89dfd9739bf {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:50:20 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-96afcc20-1665-4d70-9162-0e5e173fa6fe tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T09:43:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1557571265',display_name='tempest-ServerRescueNegativeTestJSON-server-1557571265',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1557571265',id=30,image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMbJqP1ByBl8MwFuhgI4Maut89fFXBQm0AZFy/U/KQEQbLyjF3Qkd0mt4JO2QcR+bc5y3VziaM1h7w2MWLT+t2p4sHAYFMiUNVAa5O4UJxoDo7cVDTcqH0mo3/nwMOL2mg==',key_name='tempest-keypair-1317030039',keypairs=<?>,launch_index=0,launched_at=2023-11-15T09:45:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='eeff24cb28f5481fa3941ba399ce82ff',ramdisk_id='',reservation_id='r-weslqkgj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-59965354',owner_user_name='tempest-ServerRescueNegativeTestJSON-59965354-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T09:47:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d05ef35b07ba45afb142f406d418d8d4',uuid=8271a429-e252-42bb-8717-e89dfd9739bf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "044ffaae-8351-4c7f-9b12-32ac7d4b3565", "address": "fa:16:3e:e3:9d:f8", "network": {"id": "c2062f64-d925-42d2-9687-5d2511ef6697", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1134087048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eeff24cb28f5481fa3941ba399ce82ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap044ffaae-83", "ovs_interfaceid": "044ffaae-8351-4c7f-9b12-32ac7d4b3565", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 09:50:20 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-96afcc20-1665-4d70-9162-0e5e173fa6fe tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Converting VIF {"id": "044ffaae-8351-4c7f-9b12-32ac7d4b3565", "address": "fa:16:3e:e3:9d:f8", "network": {"id": "c2062f64-d925-42d2-9687-5d2511ef6697", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1134087048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.156", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eeff24cb28f5481fa3941ba399ce82ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap044ffaae-83", "ovs_interfaceid": "044ffaae-8351-4c7f-9b12-32ac7d4b3565", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 09:50:20 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-96afcc20-1665-4d70-9162-0e5e173fa6fe tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e3:9d:f8,bridge_name='br-int',has_traffic_filtering=True,id=044ffaae-8351-4c7f-9b12-32ac7d4b3565,network=Network(c2062f64-d925-42d2-9687-5d2511ef6697),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap044ffaae-83') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 09:50:20 user nova-compute[75122]: DEBUG os_vif [None req-96afcc20-1665-4d70-9162-0e5e173fa6fe tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e3:9d:f8,bridge_name='br-int',has_traffic_filtering=True,id=044ffaae-8351-4c7f-9b12-32ac7d4b3565,network=Network(c2062f64-d925-42d2-9687-5d2511ef6697),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap044ffaae-83') {{(pid=75122) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 09:50:20 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:50:20 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap044ffaae-83, bridge=br-int, if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:50:20 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:50:20 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:50:20 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:50:20 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d4f4fb59-ec65-4a72-9c0d-b37669786927) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:50:20 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:50:20 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:50:20 user nova-compute[75122]: INFO os_vif [None req-96afcc20-1665-4d70-9162-0e5e173fa6fe tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e3:9d:f8,bridge_name='br-int',has_traffic_filtering=True,id=044ffaae-8351-4c7f-9b12-32ac7d4b3565,network=Network(c2062f64-d925-42d2-9687-5d2511ef6697),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap044ffaae-83')
Nov 15 09:50:20 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-96afcc20-1665-4d70-9162-0e5e173fa6fe tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] [instance: 8271a429-e252-42bb-8717-e89dfd9739bf] Deleting instance files /opt/stack/data/nova/instances/8271a429-e252-42bb-8717-e89dfd9739bf_del
Nov 15 09:50:20 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-96afcc20-1665-4d70-9162-0e5e173fa6fe tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] [instance: 8271a429-e252-42bb-8717-e89dfd9739bf] Deletion of /opt/stack/data/nova/instances/8271a429-e252-42bb-8717-e89dfd9739bf_del complete
Nov 15 09:50:20 user nova-compute[75122]: INFO nova.compute.manager [None req-96afcc20-1665-4d70-9162-0e5e173fa6fe tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] [instance: 8271a429-e252-42bb-8717-e89dfd9739bf] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 15 09:50:20 user nova-compute[75122]: DEBUG oslo.service.loopingcall [None req-96afcc20-1665-4d70-9162-0e5e173fa6fe tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75122) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 09:50:20 user nova-compute[75122]: DEBUG nova.compute.manager [-] [instance: 8271a429-e252-42bb-8717-e89dfd9739bf] Deallocating network for instance {{(pid=75122) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 09:50:20 user nova-compute[75122]: DEBUG nova.network.neutron [-] [instance: 8271a429-e252-42bb-8717-e89dfd9739bf] deallocate_for_instance() {{(pid=75122) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 09:50:21 user nova-compute[75122]: DEBUG nova.network.neutron [-] [instance: 8271a429-e252-42bb-8717-e89dfd9739bf] Updating instance_info_cache with network_info: [] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:50:21 user nova-compute[75122]: INFO nova.compute.manager [-] [instance: 8271a429-e252-42bb-8717-e89dfd9739bf] Took 0.86 seconds to deallocate network for instance.
Nov 15 09:50:21 user nova-compute[75122]: DEBUG nova.compute.manager [req-fd800114-d44e-424c-ad2d-8f6a3e939efa req-a17c1e94-e8a7-42d6-b8e7-7cf667046c43 service nova] [instance: 8271a429-e252-42bb-8717-e89dfd9739bf] Received event network-vif-deleted-044ffaae-8351-4c7f-9b12-32ac7d4b3565 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:50:21 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:50:21 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-96afcc20-1665-4d70-9162-0e5e173fa6fe tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:50:21 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-96afcc20-1665-4d70-9162-0e5e173fa6fe tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:50:21 user nova-compute[75122]: DEBUG nova.compute.provider_tree [None req-96afcc20-1665-4d70-9162-0e5e173fa6fe tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Inventory has not changed in ProviderTree for provider: 69a3da65-47be-44c6-b67c-c692b58284ef {{(pid=75122) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 09:50:21 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-96afcc20-1665-4d70-9162-0e5e173fa6fe tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Inventory has not changed for provider 69a3da65-47be-44c6-b67c-c692b58284ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 09:50:21 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-96afcc20-1665-4d70-9162-0e5e173fa6fe tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.262s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:50:21 user nova-compute[75122]: INFO nova.scheduler.client.report [None req-96afcc20-1665-4d70-9162-0e5e173fa6fe tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Deleted allocations for instance 8271a429-e252-42bb-8717-e89dfd9739bf
Nov 15 09:50:21 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-96afcc20-1665-4d70-9162-0e5e173fa6fe tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Lock "8271a429-e252-42bb-8717-e89dfd9739bf" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.187s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:50:22 user nova-compute[75122]: DEBUG nova.compute.manager [req-4aa116a0-7b36-48c2-b044-2a5412750f08 req-86182eb3-78bf-485d-b4a9-6c484de747a2 service nova] [instance: 8271a429-e252-42bb-8717-e89dfd9739bf] Received event network-vif-plugged-044ffaae-8351-4c7f-9b12-32ac7d4b3565 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:50:22 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-4aa116a0-7b36-48c2-b044-2a5412750f08 req-86182eb3-78bf-485d-b4a9-6c484de747a2 service nova] Acquiring lock "8271a429-e252-42bb-8717-e89dfd9739bf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:50:22 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-4aa116a0-7b36-48c2-b044-2a5412750f08 req-86182eb3-78bf-485d-b4a9-6c484de747a2 service nova] Lock "8271a429-e252-42bb-8717-e89dfd9739bf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:50:22 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-4aa116a0-7b36-48c2-b044-2a5412750f08 req-86182eb3-78bf-485d-b4a9-6c484de747a2 service nova] Lock "8271a429-e252-42bb-8717-e89dfd9739bf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:50:22 user nova-compute[75122]: DEBUG nova.compute.manager [req-4aa116a0-7b36-48c2-b044-2a5412750f08 req-86182eb3-78bf-485d-b4a9-6c484de747a2 service nova] [instance: 8271a429-e252-42bb-8717-e89dfd9739bf] No waiting events found dispatching network-vif-plugged-044ffaae-8351-4c7f-9b12-32ac7d4b3565 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:50:22 user nova-compute[75122]: WARNING nova.compute.manager [req-4aa116a0-7b36-48c2-b044-2a5412750f08 req-86182eb3-78bf-485d-b4a9-6c484de747a2 service nova] [instance: 8271a429-e252-42bb-8717-e89dfd9739bf] Received unexpected event network-vif-plugged-044ffaae-8351-4c7f-9b12-32ac7d4b3565 for instance with vm_state deleted and task_state None.
Nov 15 09:50:23 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-822497ff-2afc-42d6-a53e-b7fe99eb67c2 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 3fbf220d-ad09-4436-8a0a-7a527dd00c6f is timed out.
Nov 15 09:50:23 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-822497ff-2afc-42d6-a53e-b7fe99eb67c2 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Successfully detached device vdb from instance 3fbf220d-ad09-4436-8a0a-7a527dd00c6f from the live domain config.
Nov 15 09:50:23 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-822497ff-2afc-42d6-a53e-b7fe99eb67c2 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] [instance: 3fbf220d-ad09-4436-8a0a-7a527dd00c6f] calling os-brick to detach iSCSI Volume {{(pid=75122) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 09:50:23 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-822497ff-2afc-42d6-a53e-b7fe99eb67c2 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffa04060b80>, {'target_iqn': 'iqn.2010-10.org.openstack:8d7a8c81-f259-4301-b461-d12ad0b05d67', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'amDCvTRj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 09:50:23 user nova-compute[75122]: WARNING os_brick.initiator.connectors.base [None req-822497ff-2afc-42d6-a53e-b7fe99eb67c2 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 09:50:23 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-822497ff-2afc-42d6-a53e-b7fe99eb67c2 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 09:50:23 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-822497ff-2afc-42d6-a53e-b7fe99eb67c2 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 09:50:23 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:50:23 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:50:23 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[6478d98e-e31e-4fc4-8f7e-06a8df4fe294]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8d7a8c81-f259-4301-b461-d12ad0b05d67\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:50:23 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-822497ff-2afc-42d6-a53e-b7fe99eb67c2 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 09:50:23 user nova-compute[75122]: No targets found.
Nov 15 09:50:23 user nova-compute[75122]: iSNS:
Nov 15 09:50:23 user nova-compute[75122]: No targets found.
Nov 15 09:50:23 user nova-compute[75122]: STATIC:
Nov 15 09:50:23 user nova-compute[75122]: Target: iqn.2010-10.org.openstack:8d7a8c81-f259-4301-b461-d12ad0b05d67
Nov 15 09:50:23 user nova-compute[75122]:         Portal: 172.16.0.220:3260,-1
Nov 15 09:50:23 user nova-compute[75122]:                 Iface Name: default
Nov 15 09:50:23 user nova-compute[75122]: FIRMWARE:
Nov 15 09:50:23 user nova-compute[75122]: No targets found.
Nov 15 09:50:23 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 09:50:23 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-822497ff-2afc-42d6-a53e-b7fe99eb67c2 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 09:50:23 user nova-compute[75122]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 09:50:23 user nova-compute[75122]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75122) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 09:50:23 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-822497ff-2afc-42d6-a53e-b7fe99eb67c2 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8d7a8c81-f259-4301-b461-d12ad0b05d67', 0)] {{(pid=75122) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 09:50:23 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:50:23 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:50:23 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[367692ab-7150-4dea-ac13-489b0b8aa37d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8d7a8c81-f259-4301-b461-d12ad0b05d67\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:50:23 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:50:23 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:50:23 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a24b050-a15d-44be-91c5-d91e3c4e7597]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d7a8c81-f259-4301-b461-d12ad0b05d67 (non-flash)\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:50:23 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-822497ff-2afc-42d6-a53e-b7fe99eb67c2 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d7a8c81-f259-4301-b461-d12ad0b05d67 (non-flash)
Nov 15 09:50:23 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 09:50:23 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-822497ff-2afc-42d6-a53e-b7fe99eb67c2 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d7a8c81-f259-4301-b461-d12ad0b05d67 (non-flash)
Nov 15 09:50:23 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 09:50:23 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-822497ff-2afc-42d6-a53e-b7fe99eb67c2 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff9e45a3a30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8d7a8c81-f259-4301-b461-d12ad0b05d67'): ({'sdb'}, set())}) {{(pid=75122) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 09:50:23 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-822497ff-2afc-42d6-a53e-b7fe99eb67c2 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Removing single pathed devices sdb {{(pid=75122) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 09:50:23 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:50:23 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:50:23 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[db2a2e57-1534-4e83-9ba0-a82b5d51db80]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:50:23 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:50:23 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:50:23 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fa232ca-41f4-494b-96b6-44141b18efed]: (4, ('ok\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:50:23 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-822497ff-2afc-42d6-a53e-b7fe99eb67c2 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Flushing IO for device /dev/sdb {{(pid=75122) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 09:50:23 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:50:23 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:50:23 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c6ab8a0-4ec3-4ac5-8ccd-519a5026df38]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:50:23 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-822497ff-2afc-42d6-a53e-b7fe99eb67c2 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75122) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 09:50:23 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:50:23 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:50:23 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c0f12d2-3541-44bd-b12c-c0ed5cee1c2a]: (4, ('1', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:50:23 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-822497ff-2afc-42d6-a53e-b7fe99eb67c2 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75122) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 09:50:23 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-822497ff-2afc-42d6-a53e-b7fe99eb67c2 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] SCSI volumes sdb have been removed. {{(pid=75122) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 09:50:23 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-822497ff-2afc-42d6-a53e-b7fe99eb67c2 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8d7a8c81-f259-4301-b461-d12ad0b05d67')] {{(pid=75122) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 09:50:23 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d7a8c81-f259-4301-b461-d12ad0b05d67 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:50:23 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d7a8c81-f259-4301-b461-d12ad0b05d67 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:50:23 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[84da3a98-7c44-4972-99fc-0699711f91cc]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:50:23 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-822497ff-2afc-42d6-a53e-b7fe99eb67c2 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:50:23 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d7a8c81-f259-4301-b461-d12ad0b05d67 -p 172.16.0.220:3260 --logout {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:50:23 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d7a8c81-f259-4301-b461-d12ad0b05d67 -p 172.16.0.220:3260 --logout" returned: 0 in 0.045s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:50:23 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[d24d0507-7a5d-4cdb-9dce-a85f2d05e1af]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:8d7a8c81-f259-4301-b461-d12ad0b05d67, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:8d7a8c81-f259-4301-b461-d12ad0b05d67, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:50:23 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-822497ff-2afc-42d6-a53e-b7fe99eb67c2 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:8d7a8c81-f259-4301-b461-d12ad0b05d67, portal: 172.16.0.220,3260]
Nov 15 09:50:23 user nova-compute[75122]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:8d7a8c81-f259-4301-b461-d12ad0b05d67, portal: 172.16.0.220,3260] successful.
Nov 15 09:50:23 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:50:23 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d7a8c81-f259-4301-b461-d12ad0b05d67 -p 172.16.0.220:3260 --op delete {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:50:23 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d7a8c81-f259-4301-b461-d12ad0b05d67 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:50:23 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1ff9101-0fee-4c12-84f5-c3eddb85ef4e]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:50:23 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-822497ff-2afc-42d6-a53e-b7fe99eb67c2 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:50:23 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-822497ff-2afc-42d6-a53e-b7fe99eb67c2 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.278s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 09:50:23 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-822497ff-2afc-42d6-a53e-b7fe99eb67c2 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] <== disconnect_volume: return (281ms) None {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 09:50:23 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-822497ff-2afc-42d6-a53e-b7fe99eb67c2 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] [instance: 3fbf220d-ad09-4436-8a0a-7a527dd00c6f] Disconnected iSCSI Volume {{(pid=75122) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 09:50:24 user nova-compute[75122]: DEBUG nova.objects.instance [None req-822497ff-2afc-42d6-a53e-b7fe99eb67c2 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Lazy-loading 'flavor' on Instance uuid 3fbf220d-ad09-4436-8a0a-7a527dd00c6f {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:50:24 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-822497ff-2afc-42d6-a53e-b7fe99eb67c2 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Lock "3fbf220d-ad09-4436-8a0a-7a527dd00c6f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.536s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:50:25 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:50:26 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:50:26 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Starting heal instance info cache {{(pid=75122) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 09:50:26 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "refresh_cache-49154de0-f941-4ae0-a7af-72e75a4d8040" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 09:50:26 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquired lock "refresh_cache-49154de0-f941-4ae0-a7af-72e75a4d8040" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 09:50:26 user nova-compute[75122]: DEBUG nova.network.neutron [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] [instance: 49154de0-f941-4ae0-a7af-72e75a4d8040] Forcefully refreshing network info cache for instance {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 09:50:26 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:50:26 user nova-compute[75122]: DEBUG nova.network.neutron [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] [instance: 49154de0-f941-4ae0-a7af-72e75a4d8040] Updating instance_info_cache with network_info: [{"id": "62759685-70a8-44fe-9a6c-36ec4cd002a2", "address": "fa:16:3e:9a:6e:b1", "network": {"id": "b5966731-865f-495c-9cea-07c563eb13a3", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-641799461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d6a287ccfe04bfebdf80d827d49ce51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62759685-70", "ovs_interfaceid": "62759685-70a8-44fe-9a6c-36ec4cd002a2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:50:26 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Releasing lock "refresh_cache-49154de0-f941-4ae0-a7af-72e75a4d8040" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 09:50:26 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] [instance: 49154de0-f941-4ae0-a7af-72e75a4d8040] Updated the network info_cache for instance {{(pid=75122) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 09:50:26 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:50:27 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:50:27 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:50:28 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:50:28 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:50:28 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:50:28 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:50:28 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:50:28 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:50:28 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75122) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 09:50:28 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd9d52bb-6248-48e6-a798-6dbdaaa68cbc/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:50:28 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd9d52bb-6248-48e6-a798-6dbdaaa68cbc/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:50:28 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd9d52bb-6248-48e6-a798-6dbdaaa68cbc/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:50:28 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd9d52bb-6248-48e6-a798-6dbdaaa68cbc/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:50:28 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49154de0-f941-4ae0-a7af-72e75a4d8040/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:50:28 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49154de0-f941-4ae0-a7af-72e75a4d8040/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:50:28 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49154de0-f941-4ae0-a7af-72e75a4d8040/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:50:29 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/49154de0-f941-4ae0-a7af-72e75a4d8040/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:50:29 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/001d589e-1bee-42da-8422-233ba796fbab/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:50:29 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/001d589e-1bee-42da-8422-233ba796fbab/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:50:29 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/001d589e-1bee-42da-8422-233ba796fbab/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:50:29 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/001d589e-1bee-42da-8422-233ba796fbab/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:50:29 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fbf220d-ad09-4436-8a0a-7a527dd00c6f/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:50:29 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fbf220d-ad09-4436-8a0a-7a527dd00c6f/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:50:29 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fbf220d-ad09-4436-8a0a-7a527dd00c6f/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:50:29 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fbf220d-ad09-4436-8a0a-7a527dd00c6f/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:50:29 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00270cc2-4f5b-4f64-8f88-31f21e3b3950/disk.rescue --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:50:30 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00270cc2-4f5b-4f64-8f88-31f21e3b3950/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:50:30 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00270cc2-4f5b-4f64-8f88-31f21e3b3950/disk.rescue --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:50:30 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00270cc2-4f5b-4f64-8f88-31f21e3b3950/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:50:30 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00270cc2-4f5b-4f64-8f88-31f21e3b3950/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:50:30 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00270cc2-4f5b-4f64-8f88-31f21e3b3950/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:50:30 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00270cc2-4f5b-4f64-8f88-31f21e3b3950/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:50:30 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:50:30 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00270cc2-4f5b-4f64-8f88-31f21e3b3950/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:50:30 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 09:50:30 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 09:50:30 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Hypervisor/Node resource view: name=user free_ram=8434MB free_disk=25.29216766357422GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75122) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 09:50:30 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:50:30 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:50:31 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance fd9d52bb-6248-48e6-a798-6dbdaaa68cbc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:50:31 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance 00270cc2-4f5b-4f64-8f88-31f21e3b3950 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:50:31 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance 49154de0-f941-4ae0-a7af-72e75a4d8040 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:50:31 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance 3fbf220d-ad09-4436-8a0a-7a527dd00c6f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:50:31 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance 001d589e-1bee-42da-8422-233ba796fbab actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:50:31 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=75122) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 09:50:31 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=75122) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 09:50:31 user nova-compute[75122]: DEBUG nova.compute.provider_tree [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Inventory has not changed in ProviderTree for provider: 69a3da65-47be-44c6-b67c-c692b58284ef {{(pid=75122) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 09:50:31 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Inventory has not changed for provider 69a3da65-47be-44c6-b67c-c692b58284ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 09:50:31 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Compute_service record updated for user:user {{(pid=75122) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 09:50:31 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.314s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:50:31 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:50:32 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:50:32 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:50:32 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75122) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 09:50:32 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-af48fa01-f8e3-4494-bd1f-7d5fcb63ac3c tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Acquiring lock "49154de0-f941-4ae0-a7af-72e75a4d8040" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:50:32 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-af48fa01-f8e3-4494-bd1f-7d5fcb63ac3c tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Lock "49154de0-f941-4ae0-a7af-72e75a4d8040" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:50:32 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-af48fa01-f8e3-4494-bd1f-7d5fcb63ac3c tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Acquiring lock "49154de0-f941-4ae0-a7af-72e75a4d8040-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:50:32 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-af48fa01-f8e3-4494-bd1f-7d5fcb63ac3c tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Lock "49154de0-f941-4ae0-a7af-72e75a4d8040-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:50:32 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-af48fa01-f8e3-4494-bd1f-7d5fcb63ac3c tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Lock "49154de0-f941-4ae0-a7af-72e75a4d8040-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:50:32 user nova-compute[75122]: INFO nova.compute.manager [None req-af48fa01-f8e3-4494-bd1f-7d5fcb63ac3c tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] [instance: 49154de0-f941-4ae0-a7af-72e75a4d8040] Terminating instance
Nov 15 09:50:32 user nova-compute[75122]: DEBUG nova.compute.manager [None req-af48fa01-f8e3-4494-bd1f-7d5fcb63ac3c tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] [instance: 49154de0-f941-4ae0-a7af-72e75a4d8040] Start destroying the instance on the hypervisor. {{(pid=75122) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 09:50:32 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:50:32 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-b6059a6d-e45e-4176-9c7c-275ba4dc0e85 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Acquiring lock "40f792bb-43a9-4011-aaba-f240f64e2757" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:50:32 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-b6059a6d-e45e-4176-9c7c-275ba4dc0e85 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Lock "40f792bb-43a9-4011-aaba-f240f64e2757" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:50:32 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:50:32 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:50:32 user nova-compute[75122]: DEBUG nova.compute.manager [None req-b6059a6d-e45e-4176-9c7c-275ba4dc0e85 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] [instance: 40f792bb-43a9-4011-aaba-f240f64e2757] Starting instance... {{(pid=75122) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 09:50:33 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:50:33 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-b6059a6d-e45e-4176-9c7c-275ba4dc0e85 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:50:33 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-b6059a6d-e45e-4176-9c7c-275ba4dc0e85 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:50:33 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-b6059a6d-e45e-4176-9c7c-275ba4dc0e85 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75122) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 09:50:33 user nova-compute[75122]: INFO nova.compute.claims [None req-b6059a6d-e45e-4176-9c7c-275ba4dc0e85 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] [instance: 40f792bb-43a9-4011-aaba-f240f64e2757] Claim successful on node user
Nov 15 09:50:33 user nova-compute[75122]: DEBUG nova.compute.provider_tree [None req-b6059a6d-e45e-4176-9c7c-275ba4dc0e85 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Inventory has not changed in ProviderTree for provider: 69a3da65-47be-44c6-b67c-c692b58284ef {{(pid=75122) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 09:50:33 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-b6059a6d-e45e-4176-9c7c-275ba4dc0e85 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Inventory has not changed for provider 69a3da65-47be-44c6-b67c-c692b58284ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 09:50:33 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-b6059a6d-e45e-4176-9c7c-275ba4dc0e85 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.306s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:50:33 user nova-compute[75122]: DEBUG nova.compute.manager [None req-b6059a6d-e45e-4176-9c7c-275ba4dc0e85 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] [instance: 40f792bb-43a9-4011-aaba-f240f64e2757] Start building networks asynchronously for instance. {{(pid=75122) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 09:50:33 user nova-compute[75122]: DEBUG nova.compute.manager [None req-b6059a6d-e45e-4176-9c7c-275ba4dc0e85 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] [instance: 40f792bb-43a9-4011-aaba-f240f64e2757] Allocating IP information in the background. {{(pid=75122) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 09:50:33 user nova-compute[75122]: DEBUG nova.network.neutron [None req-b6059a6d-e45e-4176-9c7c-275ba4dc0e85 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] [instance: 40f792bb-43a9-4011-aaba-f240f64e2757] allocate_for_instance() {{(pid=75122) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 09:50:33 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-b6059a6d-e45e-4176-9c7c-275ba4dc0e85 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] [instance: 40f792bb-43a9-4011-aaba-f240f64e2757] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 09:50:33 user nova-compute[75122]: DEBUG nova.compute.manager [req-89b26fad-5b08-4eaa-8d54-316c54d528ab req-fa0c8e22-e122-41d1-a067-8bf137bc4d79 service nova] [instance: 49154de0-f941-4ae0-a7af-72e75a4d8040] Received event network-vif-unplugged-62759685-70a8-44fe-9a6c-36ec4cd002a2 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:50:33 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-89b26fad-5b08-4eaa-8d54-316c54d528ab req-fa0c8e22-e122-41d1-a067-8bf137bc4d79 service nova] Acquiring lock "49154de0-f941-4ae0-a7af-72e75a4d8040-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:50:33 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-89b26fad-5b08-4eaa-8d54-316c54d528ab req-fa0c8e22-e122-41d1-a067-8bf137bc4d79 service nova] Lock "49154de0-f941-4ae0-a7af-72e75a4d8040-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:50:33 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-89b26fad-5b08-4eaa-8d54-316c54d528ab req-fa0c8e22-e122-41d1-a067-8bf137bc4d79 service nova] Lock "49154de0-f941-4ae0-a7af-72e75a4d8040-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:50:33 user nova-compute[75122]: DEBUG nova.compute.manager [req-89b26fad-5b08-4eaa-8d54-316c54d528ab req-fa0c8e22-e122-41d1-a067-8bf137bc4d79 service nova] [instance: 49154de0-f941-4ae0-a7af-72e75a4d8040] No waiting events found dispatching network-vif-unplugged-62759685-70a8-44fe-9a6c-36ec4cd002a2 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:50:33 user nova-compute[75122]: DEBUG nova.compute.manager [req-89b26fad-5b08-4eaa-8d54-316c54d528ab req-fa0c8e22-e122-41d1-a067-8bf137bc4d79 service nova] [instance: 49154de0-f941-4ae0-a7af-72e75a4d8040] Received event network-vif-unplugged-62759685-70a8-44fe-9a6c-36ec4cd002a2 for instance with task_state deleting. {{(pid=75122) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 09:50:33 user nova-compute[75122]: DEBUG nova.compute.manager [None req-b6059a6d-e45e-4176-9c7c-275ba4dc0e85 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] [instance: 40f792bb-43a9-4011-aaba-f240f64e2757] Start building block device mappings for instance. {{(pid=75122) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 09:50:33 user nova-compute[75122]: DEBUG nova.policy [None req-b6059a6d-e45e-4176-9c7c-275ba4dc0e85 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ad06186836ed40a49a05ef7cc9afd1bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '535c751b9e76421c9262e48fbab3fb6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75122) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 09:50:33 user nova-compute[75122]: INFO nova.virt.libvirt.driver [-] [instance: 49154de0-f941-4ae0-a7af-72e75a4d8040] Instance destroyed successfully.
Nov 15 09:50:33 user nova-compute[75122]: DEBUG nova.objects.instance [None req-af48fa01-f8e3-4494-bd1f-7d5fcb63ac3c tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Lazy-loading 'resources' on Instance uuid 49154de0-f941-4ae0-a7af-72e75a4d8040 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:50:33 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-af48fa01-f8e3-4494-bd1f-7d5fcb63ac3c tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T09:44:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-802765665',display_name='tempest-SnapshotDataIntegrityTests-server-802765665',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-802765665',id=31,image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDBws3y/Y+ZKzpTaU/1XgxasWjP4ywtJmaWbA4DcNGJF0dgszKP9QWfPd9yyGhz7pscnOnOlFJ99t3aPJUjLrqueGLy2tS0slfA/bB82t48OW8+GJhn7why+5POQJUupKA==',key_name='tempest-keypair-1296118645',keypairs=<?>,launch_index=0,launched_at=2023-11-15T09:44:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1d6a287ccfe04bfebdf80d827d49ce51',ramdisk_id='',reservation_id='r-edy0sb1p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1604224312',owner_user_name='tempest-SnapshotDataIntegrityTests-1604224312-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T09:44:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3fa3032cbc2a4908aa49e892902aea7d',uuid=49154de0-f941-4ae0-a7af-72e75a4d8040,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "62759685-70a8-44fe-9a6c-36ec4cd002a2", "address": "fa:16:3e:9a:6e:b1", "network": {"id": "b5966731-865f-495c-9cea-07c563eb13a3", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-641799461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d6a287ccfe04bfebdf80d827d49ce51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62759685-70", "ovs_interfaceid": "62759685-70a8-44fe-9a6c-36ec4cd002a2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 09:50:33 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-af48fa01-f8e3-4494-bd1f-7d5fcb63ac3c tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Converting VIF {"id": "62759685-70a8-44fe-9a6c-36ec4cd002a2", "address": "fa:16:3e:9a:6e:b1", "network": {"id": "b5966731-865f-495c-9cea-07c563eb13a3", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-641799461-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d6a287ccfe04bfebdf80d827d49ce51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62759685-70", "ovs_interfaceid": "62759685-70a8-44fe-9a6c-36ec4cd002a2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 09:50:33 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-af48fa01-f8e3-4494-bd1f-7d5fcb63ac3c tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9a:6e:b1,bridge_name='br-int',has_traffic_filtering=True,id=62759685-70a8-44fe-9a6c-36ec4cd002a2,network=Network(b5966731-865f-495c-9cea-07c563eb13a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62759685-70') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 09:50:33 user nova-compute[75122]: DEBUG os_vif [None req-af48fa01-f8e3-4494-bd1f-7d5fcb63ac3c tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9a:6e:b1,bridge_name='br-int',has_traffic_filtering=True,id=62759685-70a8-44fe-9a6c-36ec4cd002a2,network=Network(b5966731-865f-495c-9cea-07c563eb13a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62759685-70') {{(pid=75122) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 09:50:33 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:50:33 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap62759685-70, bridge=br-int, if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:50:33 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:50:33 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:50:33 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:50:33 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9978c1a6-9efb-4e16-9422-ff6e882e3726) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:50:33 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:50:33 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:50:33 user nova-compute[75122]: INFO os_vif [None req-af48fa01-f8e3-4494-bd1f-7d5fcb63ac3c tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9a:6e:b1,bridge_name='br-int',has_traffic_filtering=True,id=62759685-70a8-44fe-9a6c-36ec4cd002a2,network=Network(b5966731-865f-495c-9cea-07c563eb13a3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62759685-70')
Nov 15 09:50:33 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-af48fa01-f8e3-4494-bd1f-7d5fcb63ac3c tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] [instance: 49154de0-f941-4ae0-a7af-72e75a4d8040] Deleting instance files /opt/stack/data/nova/instances/49154de0-f941-4ae0-a7af-72e75a4d8040_del
Nov 15 09:50:33 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-af48fa01-f8e3-4494-bd1f-7d5fcb63ac3c tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] [instance: 49154de0-f941-4ae0-a7af-72e75a4d8040] Deletion of /opt/stack/data/nova/instances/49154de0-f941-4ae0-a7af-72e75a4d8040_del complete
Nov 15 09:50:33 user nova-compute[75122]: DEBUG nova.compute.manager [None req-b6059a6d-e45e-4176-9c7c-275ba4dc0e85 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] [instance: 40f792bb-43a9-4011-aaba-f240f64e2757] Start spawning the instance on the hypervisor. {{(pid=75122) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 09:50:33 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-b6059a6d-e45e-4176-9c7c-275ba4dc0e85 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] [instance: 40f792bb-43a9-4011-aaba-f240f64e2757] Creating instance directory {{(pid=75122) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 09:50:33 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-b6059a6d-e45e-4176-9c7c-275ba4dc0e85 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] [instance: 40f792bb-43a9-4011-aaba-f240f64e2757] Creating image(s)
Nov 15 09:50:33 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-b6059a6d-e45e-4176-9c7c-275ba4dc0e85 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Acquiring lock "/opt/stack/data/nova/instances/40f792bb-43a9-4011-aaba-f240f64e2757/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:50:33 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-b6059a6d-e45e-4176-9c7c-275ba4dc0e85 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Lock "/opt/stack/data/nova/instances/40f792bb-43a9-4011-aaba-f240f64e2757/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:50:33 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-b6059a6d-e45e-4176-9c7c-275ba4dc0e85 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Lock "/opt/stack/data/nova/instances/40f792bb-43a9-4011-aaba-f240f64e2757/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:50:33 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-b6059a6d-e45e-4176-9c7c-275ba4dc0e85 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:50:33 user nova-compute[75122]: INFO nova.compute.manager [None req-af48fa01-f8e3-4494-bd1f-7d5fcb63ac3c tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] [instance: 49154de0-f941-4ae0-a7af-72e75a4d8040] Took 0.90 seconds to destroy the instance on the hypervisor.
Nov 15 09:50:33 user nova-compute[75122]: DEBUG oslo.service.loopingcall [None req-af48fa01-f8e3-4494-bd1f-7d5fcb63ac3c tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75122) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 09:50:33 user nova-compute[75122]: DEBUG nova.compute.manager [-] [instance: 49154de0-f941-4ae0-a7af-72e75a4d8040] Deallocating network for instance {{(pid=75122) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 09:50:33 user nova-compute[75122]: DEBUG nova.network.neutron [-] [instance: 49154de0-f941-4ae0-a7af-72e75a4d8040] deallocate_for_instance() {{(pid=75122) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 09:50:33 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-b6059a6d-e45e-4176-9c7c-275ba4dc0e85 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json" returned: 0 in 0.196s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:50:33 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-b6059a6d-e45e-4176-9c7c-275ba4dc0e85 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Acquiring lock "95d6e29f74d5408f818e32f3bc29bc8270a4c665" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:50:33 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-b6059a6d-e45e-4176-9c7c-275ba4dc0e85 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Lock "95d6e29f74d5408f818e32f3bc29bc8270a4c665" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:50:33 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-b6059a6d-e45e-4176-9c7c-275ba4dc0e85 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:50:34 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-b6059a6d-e45e-4176-9c7c-275ba4dc0e85 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json" returned: 0 in 0.185s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:50:34 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-b6059a6d-e45e-4176-9c7c-275ba4dc0e85 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665,backing_fmt=raw /opt/stack/data/nova/instances/40f792bb-43a9-4011-aaba-f240f64e2757/disk 1073741824 {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:50:34 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-b6059a6d-e45e-4176-9c7c-275ba4dc0e85 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665,backing_fmt=raw /opt/stack/data/nova/instances/40f792bb-43a9-4011-aaba-f240f64e2757/disk 1073741824" returned: 0 in 0.050s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:50:34 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-b6059a6d-e45e-4176-9c7c-275ba4dc0e85 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Lock "95d6e29f74d5408f818e32f3bc29bc8270a4c665" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.243s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:50:34 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-b6059a6d-e45e-4176-9c7c-275ba4dc0e85 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:50:34 user nova-compute[75122]: DEBUG nova.network.neutron [None req-b6059a6d-e45e-4176-9c7c-275ba4dc0e85 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] [instance: 40f792bb-43a9-4011-aaba-f240f64e2757] Successfully created port: da514680-136e-49d6-aec0-9d4192081cec {{(pid=75122) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 09:50:34 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:50:34 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-b6059a6d-e45e-4176-9c7c-275ba4dc0e85 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json" returned: 0 in 0.195s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:50:34 user nova-compute[75122]: DEBUG nova.virt.disk.api [None req-b6059a6d-e45e-4176-9c7c-275ba4dc0e85 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Checking if we can resize image /opt/stack/data/nova/instances/40f792bb-43a9-4011-aaba-f240f64e2757/disk. size=1073741824 {{(pid=75122) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 09:50:34 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-b6059a6d-e45e-4176-9c7c-275ba4dc0e85 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40f792bb-43a9-4011-aaba-f240f64e2757/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:50:34 user nova-compute[75122]: DEBUG nova.network.neutron [-] [instance: 49154de0-f941-4ae0-a7af-72e75a4d8040] Updating instance_info_cache with network_info: [] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:50:34 user nova-compute[75122]: INFO nova.compute.manager [-] [instance: 49154de0-f941-4ae0-a7af-72e75a4d8040] Took 0.78 seconds to deallocate network for instance.
Nov 15 09:50:34 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-b6059a6d-e45e-4176-9c7c-275ba4dc0e85 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40f792bb-43a9-4011-aaba-f240f64e2757/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:50:34 user nova-compute[75122]: DEBUG nova.virt.disk.api [None req-b6059a6d-e45e-4176-9c7c-275ba4dc0e85 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Cannot resize image /opt/stack/data/nova/instances/40f792bb-43a9-4011-aaba-f240f64e2757/disk to a smaller size. {{(pid=75122) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 09:50:34 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-b6059a6d-e45e-4176-9c7c-275ba4dc0e85 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] [instance: 40f792bb-43a9-4011-aaba-f240f64e2757] Created local disks {{(pid=75122) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 09:50:34 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-b6059a6d-e45e-4176-9c7c-275ba4dc0e85 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] [instance: 40f792bb-43a9-4011-aaba-f240f64e2757] Ensure instance console log exists: /opt/stack/data/nova/instances/40f792bb-43a9-4011-aaba-f240f64e2757/console.log {{(pid=75122) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 09:50:34 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-b6059a6d-e45e-4176-9c7c-275ba4dc0e85 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:50:34 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-b6059a6d-e45e-4176-9c7c-275ba4dc0e85 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:50:34 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-b6059a6d-e45e-4176-9c7c-275ba4dc0e85 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:50:34 user nova-compute[75122]: DEBUG nova.compute.manager [req-2d17754d-c714-457f-8fa3-c41844fe2d42 req-adeee348-bcf9-42e7-909f-7b3c5b682906 service nova] [instance: 49154de0-f941-4ae0-a7af-72e75a4d8040] Received event network-vif-deleted-62759685-70a8-44fe-9a6c-36ec4cd002a2 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:50:34 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-af48fa01-f8e3-4494-bd1f-7d5fcb63ac3c tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:50:34 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-af48fa01-f8e3-4494-bd1f-7d5fcb63ac3c tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:50:34 user nova-compute[75122]: DEBUG nova.compute.provider_tree [None req-af48fa01-f8e3-4494-bd1f-7d5fcb63ac3c tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Inventory has not changed in ProviderTree for provider: 69a3da65-47be-44c6-b67c-c692b58284ef {{(pid=75122) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 09:50:34 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-af48fa01-f8e3-4494-bd1f-7d5fcb63ac3c tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Inventory has not changed for provider 69a3da65-47be-44c6-b67c-c692b58284ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 09:50:34 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-af48fa01-f8e3-4494-bd1f-7d5fcb63ac3c tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.242s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:50:34 user nova-compute[75122]: DEBUG nova.network.neutron [None req-b6059a6d-e45e-4176-9c7c-275ba4dc0e85 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] [instance: 40f792bb-43a9-4011-aaba-f240f64e2757] Successfully updated port: da514680-136e-49d6-aec0-9d4192081cec {{(pid=75122) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 09:50:34 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-b6059a6d-e45e-4176-9c7c-275ba4dc0e85 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Acquiring lock "refresh_cache-40f792bb-43a9-4011-aaba-f240f64e2757" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 09:50:34 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-b6059a6d-e45e-4176-9c7c-275ba4dc0e85 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Acquired lock "refresh_cache-40f792bb-43a9-4011-aaba-f240f64e2757" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 09:50:34 user nova-compute[75122]: DEBUG nova.network.neutron [None req-b6059a6d-e45e-4176-9c7c-275ba4dc0e85 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] [instance: 40f792bb-43a9-4011-aaba-f240f64e2757] Building network info cache for instance {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 09:50:34 user nova-compute[75122]: DEBUG nova.compute.manager [req-0137da8f-3c81-43cd-af00-ca9fb9e5e094 req-c2a86695-9219-4667-be6e-f36a1be8172f service nova] [instance: 40f792bb-43a9-4011-aaba-f240f64e2757] Received event network-changed-da514680-136e-49d6-aec0-9d4192081cec {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:50:34 user nova-compute[75122]: DEBUG nova.compute.manager [req-0137da8f-3c81-43cd-af00-ca9fb9e5e094 req-c2a86695-9219-4667-be6e-f36a1be8172f service nova] [instance: 40f792bb-43a9-4011-aaba-f240f64e2757] Refreshing instance network info cache due to event network-changed-da514680-136e-49d6-aec0-9d4192081cec. {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 09:50:34 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-0137da8f-3c81-43cd-af00-ca9fb9e5e094 req-c2a86695-9219-4667-be6e-f36a1be8172f service nova] Acquiring lock "refresh_cache-40f792bb-43a9-4011-aaba-f240f64e2757" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 09:50:34 user nova-compute[75122]: INFO nova.scheduler.client.report [None req-af48fa01-f8e3-4494-bd1f-7d5fcb63ac3c tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Deleted allocations for instance 49154de0-f941-4ae0-a7af-72e75a4d8040
Nov 15 09:50:34 user nova-compute[75122]: DEBUG nova.network.neutron [None req-b6059a6d-e45e-4176-9c7c-275ba4dc0e85 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] [instance: 40f792bb-43a9-4011-aaba-f240f64e2757] Instance cache missing network info. {{(pid=75122) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 09:50:35 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-af48fa01-f8e3-4494-bd1f-7d5fcb63ac3c tempest-SnapshotDataIntegrityTests-1604224312 tempest-SnapshotDataIntegrityTests-1604224312-project-member] Lock "49154de0-f941-4ae0-a7af-72e75a4d8040" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.201s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:50:35 user nova-compute[75122]: DEBUG nova.network.neutron [None req-b6059a6d-e45e-4176-9c7c-275ba4dc0e85 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] [instance: 40f792bb-43a9-4011-aaba-f240f64e2757] Updating instance_info_cache with network_info: [{"id": "da514680-136e-49d6-aec0-9d4192081cec", "address": "fa:16:3e:b0:8a:af", "network": {"id": "7ab99c1b-e670-416e-b5fe-e1337db6b28d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-487518933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "535c751b9e76421c9262e48fbab3fb6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda514680-13", "ovs_interfaceid": "da514680-136e-49d6-aec0-9d4192081cec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:50:35 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-b6059a6d-e45e-4176-9c7c-275ba4dc0e85 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Releasing lock "refresh_cache-40f792bb-43a9-4011-aaba-f240f64e2757" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 09:50:35 user nova-compute[75122]: DEBUG nova.compute.manager [None req-b6059a6d-e45e-4176-9c7c-275ba4dc0e85 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] [instance: 40f792bb-43a9-4011-aaba-f240f64e2757] Instance network_info: |[{"id": "da514680-136e-49d6-aec0-9d4192081cec", "address": "fa:16:3e:b0:8a:af", "network": {"id": "7ab99c1b-e670-416e-b5fe-e1337db6b28d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-487518933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "535c751b9e76421c9262e48fbab3fb6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda514680-13", "ovs_interfaceid": "da514680-136e-49d6-aec0-9d4192081cec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75122) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 09:50:35 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-0137da8f-3c81-43cd-af00-ca9fb9e5e094 req-c2a86695-9219-4667-be6e-f36a1be8172f service nova] Acquired lock "refresh_cache-40f792bb-43a9-4011-aaba-f240f64e2757" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 09:50:35 user nova-compute[75122]: DEBUG nova.network.neutron [req-0137da8f-3c81-43cd-af00-ca9fb9e5e094 req-c2a86695-9219-4667-be6e-f36a1be8172f service nova] [instance: 40f792bb-43a9-4011-aaba-f240f64e2757] Refreshing network info cache for port da514680-136e-49d6-aec0-9d4192081cec {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 09:50:35 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-b6059a6d-e45e-4176-9c7c-275ba4dc0e85 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] [instance: 40f792bb-43a9-4011-aaba-f240f64e2757] Start _get_guest_xml network_info=[{"id": "da514680-136e-49d6-aec0-9d4192081cec", "address": "fa:16:3e:b0:8a:af", "network": {"id": "7ab99c1b-e670-416e-b5fe-e1337db6b28d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-487518933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "535c751b9e76421c9262e48fbab3fb6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda514680-13", "ovs_interfaceid": "da514680-136e-49d6-aec0-9d4192081cec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T09:26:31Z,direct_url=<?>,disk_format='qcow2',id=5e862cfe-47b8-4725-8292-65761ee6d0f5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9c57733cb41847c0b4ad31519c382e5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T09:26:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '5e862cfe-47b8-4725-8292-65761ee6d0f5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75122) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 09:50:35 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-b6059a6d-e45e-4176-9c7c-275ba4dc0e85 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 09:50:35 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-b6059a6d-e45e-4176-9c7c-275ba4dc0e85 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 09:50:35 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-b6059a6d-e45e-4176-9c7c-275ba4dc0e85 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75122) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 09:50:35 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-b6059a6d-e45e-4176-9c7c-275ba4dc0e85 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] CPU controller missing on host. {{(pid=75122) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 09:50:35 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-b6059a6d-e45e-4176-9c7c-275ba4dc0e85 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75122) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 09:50:35 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-b6059a6d-e45e-4176-9c7c-275ba4dc0e85 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] CPU controller found on host. {{(pid=75122) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 09:50:35 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-b6059a6d-e45e-4176-9c7c-275ba4dc0e85 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75122) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 09:50:35 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-b6059a6d-e45e-4176-9c7c-275ba4dc0e85 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T09:26:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T09:26:31Z,direct_url=<?>,disk_format='qcow2',id=5e862cfe-47b8-4725-8292-65761ee6d0f5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9c57733cb41847c0b4ad31519c382e5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T09:26:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 09:50:35 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-b6059a6d-e45e-4176-9c7c-275ba4dc0e85 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Flavor limits 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 09:50:35 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-b6059a6d-e45e-4176-9c7c-275ba4dc0e85 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Image limits 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 09:50:35 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-b6059a6d-e45e-4176-9c7c-275ba4dc0e85 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Flavor pref 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 09:50:35 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-b6059a6d-e45e-4176-9c7c-275ba4dc0e85 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Image pref 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 09:50:35 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-b6059a6d-e45e-4176-9c7c-275ba4dc0e85 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 09:50:35 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-b6059a6d-e45e-4176-9c7c-275ba4dc0e85 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 09:50:35 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-b6059a6d-e45e-4176-9c7c-275ba4dc0e85 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75122) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 09:50:35 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-b6059a6d-e45e-4176-9c7c-275ba4dc0e85 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Got 1 possible topologies {{(pid=75122) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 09:50:35 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-b6059a6d-e45e-4176-9c7c-275ba4dc0e85 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 09:50:35 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-b6059a6d-e45e-4176-9c7c-275ba4dc0e85 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 09:50:35 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-b6059a6d-e45e-4176-9c7c-275ba4dc0e85 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T09:50:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1963643859',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1963643859',id=36,image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ+o1+VCoCl9aLUFla+CNAvrWecqtmJtkNMOXPbFgT/SGUDJQjE5J+p9LWhVFHo42hKlQB0Lpf11tT5e0MRK3x6CI//9ttDmkzl+cisBUmlwupwf667RZL6YbQ9nOc/Fow==',key_name='tempest-keypair-130968135',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='535c751b9e76421c9262e48fbab3fb6f',ramdisk_id='',reservation_id='r-y94lw7al',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1659813957',owner_user_name='tempest-AttachVolumeShelveTestJSON-1659813957-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T09:50:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad06186836ed40a49a05ef7cc9afd1bc',uuid=40f792bb-43a9-4011-aaba-f240f64e2757,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "da514680-136e-49d6-aec0-9d4192081cec", "address": "fa:16:3e:b0:8a:af", "network": {"id": "7ab99c1b-e670-416e-b5fe-e1337db6b28d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-487518933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "535c751b9e76421c9262e48fbab3fb6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda514680-13", "ovs_interfaceid": "da514680-136e-49d6-aec0-9d4192081cec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75122) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 09:50:35 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-b6059a6d-e45e-4176-9c7c-275ba4dc0e85 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Converting VIF {"id": "da514680-136e-49d6-aec0-9d4192081cec", "address": "fa:16:3e:b0:8a:af", "network": {"id": "7ab99c1b-e670-416e-b5fe-e1337db6b28d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-487518933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "535c751b9e76421c9262e48fbab3fb6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda514680-13", "ovs_interfaceid": "da514680-136e-49d6-aec0-9d4192081cec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 09:50:35 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-b6059a6d-e45e-4176-9c7c-275ba4dc0e85 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:8a:af,bridge_name='br-int',has_traffic_filtering=True,id=da514680-136e-49d6-aec0-9d4192081cec,network=Network(7ab99c1b-e670-416e-b5fe-e1337db6b28d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda514680-13') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 09:50:35 user nova-compute[75122]: DEBUG nova.objects.instance [None req-b6059a6d-e45e-4176-9c7c-275ba4dc0e85 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Lazy-loading 'pci_devices' on Instance uuid 40f792bb-43a9-4011-aaba-f240f64e2757 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:50:35 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-b6059a6d-e45e-4176-9c7c-275ba4dc0e85 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] [instance: 40f792bb-43a9-4011-aaba-f240f64e2757] End _get_guest_xml xml=<domain type="kvm">
Nov 15 09:50:35 user nova-compute[75122]:   <uuid>40f792bb-43a9-4011-aaba-f240f64e2757</uuid>
Nov 15 09:50:35 user nova-compute[75122]:   <name>instance-00000024</name>
Nov 15 09:50:35 user nova-compute[75122]:   <memory>524288</memory>
Nov 15 09:50:35 user nova-compute[75122]:   <vcpu>1</vcpu>
Nov 15 09:50:35 user nova-compute[75122]:   <metadata>
Nov 15 09:50:35 user nova-compute[75122]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 09:50:35 user nova-compute[75122]:       <nova:package version="0.0.0"/>
Nov 15 09:50:35 user nova-compute[75122]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1963643859</nova:name>
Nov 15 09:50:35 user nova-compute[75122]:       <nova:creationTime>2023-11-15 09:50:35</nova:creationTime>
Nov 15 09:50:35 user nova-compute[75122]:       <nova:flavor name="m1.tiny">
Nov 15 09:50:35 user nova-compute[75122]:         <nova:memory>512</nova:memory>
Nov 15 09:50:35 user nova-compute[75122]:         <nova:disk>1</nova:disk>
Nov 15 09:50:35 user nova-compute[75122]:         <nova:swap>0</nova:swap>
Nov 15 09:50:35 user nova-compute[75122]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 09:50:35 user nova-compute[75122]:         <nova:vcpus>1</nova:vcpus>
Nov 15 09:50:35 user nova-compute[75122]:       </nova:flavor>
Nov 15 09:50:35 user nova-compute[75122]:       <nova:owner>
Nov 15 09:50:35 user nova-compute[75122]:         <nova:user uuid="ad06186836ed40a49a05ef7cc9afd1bc">tempest-AttachVolumeShelveTestJSON-1659813957-project-member</nova:user>
Nov 15 09:50:35 user nova-compute[75122]:         <nova:project uuid="535c751b9e76421c9262e48fbab3fb6f">tempest-AttachVolumeShelveTestJSON-1659813957</nova:project>
Nov 15 09:50:35 user nova-compute[75122]:       </nova:owner>
Nov 15 09:50:35 user nova-compute[75122]:       <nova:root type="image" uuid="5e862cfe-47b8-4725-8292-65761ee6d0f5"/>
Nov 15 09:50:35 user nova-compute[75122]:       <nova:ports>
Nov 15 09:50:35 user nova-compute[75122]:         <nova:port uuid="da514680-136e-49d6-aec0-9d4192081cec">
Nov 15 09:50:35 user nova-compute[75122]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 15 09:50:35 user nova-compute[75122]:         </nova:port>
Nov 15 09:50:35 user nova-compute[75122]:       </nova:ports>
Nov 15 09:50:35 user nova-compute[75122]:     </nova:instance>
Nov 15 09:50:35 user nova-compute[75122]:   </metadata>
Nov 15 09:50:35 user nova-compute[75122]:   <sysinfo type="smbios">
Nov 15 09:50:35 user nova-compute[75122]:     <system>
Nov 15 09:50:35 user nova-compute[75122]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 09:50:35 user nova-compute[75122]:       <entry name="product">OpenStack Nova</entry>
Nov 15 09:50:35 user nova-compute[75122]:       <entry name="version">0.0.0</entry>
Nov 15 09:50:35 user nova-compute[75122]:       <entry name="serial">40f792bb-43a9-4011-aaba-f240f64e2757</entry>
Nov 15 09:50:35 user nova-compute[75122]:       <entry name="uuid">40f792bb-43a9-4011-aaba-f240f64e2757</entry>
Nov 15 09:50:35 user nova-compute[75122]:       <entry name="family">Virtual Machine</entry>
Nov 15 09:50:35 user nova-compute[75122]:     </system>
Nov 15 09:50:35 user nova-compute[75122]:   </sysinfo>
Nov 15 09:50:35 user nova-compute[75122]:   <os>
Nov 15 09:50:35 user nova-compute[75122]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 09:50:35 user nova-compute[75122]:     <boot dev="hd"/>
Nov 15 09:50:35 user nova-compute[75122]:     <smbios mode="sysinfo"/>
Nov 15 09:50:35 user nova-compute[75122]:   </os>
Nov 15 09:50:35 user nova-compute[75122]:   <features>
Nov 15 09:50:35 user nova-compute[75122]:     <acpi/>
Nov 15 09:50:35 user nova-compute[75122]:     <apic/>
Nov 15 09:50:35 user nova-compute[75122]:     <vmcoreinfo/>
Nov 15 09:50:35 user nova-compute[75122]:   </features>
Nov 15 09:50:35 user nova-compute[75122]:   <clock offset="utc">
Nov 15 09:50:35 user nova-compute[75122]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 09:50:35 user nova-compute[75122]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 09:50:35 user nova-compute[75122]:     <timer name="hpet" present="no"/>
Nov 15 09:50:35 user nova-compute[75122]:   </clock>
Nov 15 09:50:35 user nova-compute[75122]:   <cpu mode="custom" match="exact">
Nov 15 09:50:35 user nova-compute[75122]:     <model>Nehalem</model>
Nov 15 09:50:35 user nova-compute[75122]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 09:50:35 user nova-compute[75122]:   </cpu>
Nov 15 09:50:35 user nova-compute[75122]:   <devices>
Nov 15 09:50:35 user nova-compute[75122]:     <disk type="file" device="disk">
Nov 15 09:50:35 user nova-compute[75122]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 09:50:35 user nova-compute[75122]:       <source file="/opt/stack/data/nova/instances/40f792bb-43a9-4011-aaba-f240f64e2757/disk"/>
Nov 15 09:50:35 user nova-compute[75122]:       <target dev="vda" bus="virtio"/>
Nov 15 09:50:35 user nova-compute[75122]:     </disk>
Nov 15 09:50:35 user nova-compute[75122]:     <interface type="ethernet">
Nov 15 09:50:35 user nova-compute[75122]:       <mac address="fa:16:3e:b0:8a:af"/>
Nov 15 09:50:35 user nova-compute[75122]:       <model type="virtio"/>
Nov 15 09:50:35 user nova-compute[75122]:       <mtu size="1442"/>
Nov 15 09:50:35 user nova-compute[75122]:       <target dev="tapda514680-13"/>
Nov 15 09:50:35 user nova-compute[75122]:     </interface>
Nov 15 09:50:35 user nova-compute[75122]:     <serial type="pty">
Nov 15 09:50:35 user nova-compute[75122]:       <log file="/opt/stack/data/nova/instances/40f792bb-43a9-4011-aaba-f240f64e2757/console.log" append="off"/>
Nov 15 09:50:35 user nova-compute[75122]:     </serial>
Nov 15 09:50:35 user nova-compute[75122]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 09:50:35 user nova-compute[75122]:     <video>
Nov 15 09:50:35 user nova-compute[75122]:       <model type="virtio"/>
Nov 15 09:50:35 user nova-compute[75122]:     </video>
Nov 15 09:50:35 user nova-compute[75122]:     <rng model="virtio">
Nov 15 09:50:35 user nova-compute[75122]:       <backend model="random">/dev/urandom</backend>
Nov 15 09:50:35 user nova-compute[75122]:     </rng>
Nov 15 09:50:35 user nova-compute[75122]:     <controller type="usb" index="0" model="none"/>
Nov 15 09:50:35 user nova-compute[75122]:     <memballoon model="virtio">
Nov 15 09:50:35 user nova-compute[75122]:       <stats period="10"/>
Nov 15 09:50:35 user nova-compute[75122]:     </memballoon>
Nov 15 09:50:35 user nova-compute[75122]:   </devices>
Nov 15 09:50:35 user nova-compute[75122]: </domain>
Nov 15 09:50:35 user nova-compute[75122]:  {{(pid=75122) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 09:50:35 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-b6059a6d-e45e-4176-9c7c-275ba4dc0e85 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T09:50:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1963643859',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1963643859',id=36,image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ+o1+VCoCl9aLUFla+CNAvrWecqtmJtkNMOXPbFgT/SGUDJQjE5J+p9LWhVFHo42hKlQB0Lpf11tT5e0MRK3x6CI//9ttDmkzl+cisBUmlwupwf667RZL6YbQ9nOc/Fow==',key_name='tempest-keypair-130968135',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='535c751b9e76421c9262e48fbab3fb6f',ramdisk_id='',reservation_id='r-y94lw7al',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1659813957',owner_user_name='tempest-AttachVolumeShelveTestJSON-1659813957-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T09:50:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad06186836ed40a49a05ef7cc9afd1bc',uuid=40f792bb-43a9-4011-aaba-f240f64e2757,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "da514680-136e-49d6-aec0-9d4192081cec", "address": "fa:16:3e:b0:8a:af", "network": {"id": "7ab99c1b-e670-416e-b5fe-e1337db6b28d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-487518933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "535c751b9e76421c9262e48fbab3fb6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda514680-13", "ovs_interfaceid": "da514680-136e-49d6-aec0-9d4192081cec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 09:50:35 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-b6059a6d-e45e-4176-9c7c-275ba4dc0e85 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Converting VIF {"id": "da514680-136e-49d6-aec0-9d4192081cec", "address": "fa:16:3e:b0:8a:af", "network": {"id": "7ab99c1b-e670-416e-b5fe-e1337db6b28d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-487518933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "535c751b9e76421c9262e48fbab3fb6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda514680-13", "ovs_interfaceid": "da514680-136e-49d6-aec0-9d4192081cec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 09:50:35 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-b6059a6d-e45e-4176-9c7c-275ba4dc0e85 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:8a:af,bridge_name='br-int',has_traffic_filtering=True,id=da514680-136e-49d6-aec0-9d4192081cec,network=Network(7ab99c1b-e670-416e-b5fe-e1337db6b28d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda514680-13') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 09:50:35 user nova-compute[75122]: DEBUG os_vif [None req-b6059a6d-e45e-4176-9c7c-275ba4dc0e85 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:8a:af,bridge_name='br-int',has_traffic_filtering=True,id=da514680-136e-49d6-aec0-9d4192081cec,network=Network(7ab99c1b-e670-416e-b5fe-e1337db6b28d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda514680-13') {{(pid=75122) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 09:50:35 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:50:35 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:50:35 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 09:50:35 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:50:35 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4b2e6546-3724-5432-a48d-1a8851472e1b', '_type': 'linux-noop'}}, row=False) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:50:35 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:50:35 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:50:35 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:50:35 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapda514680-13, may_exist=True, interface_attrs={}) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:50:35 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapda514680-13, col_values=(('qos', UUID('eb7308b8-630f-422e-a60b-6d11aa28a596')),), if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:50:35 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapda514680-13, col_values=(('external_ids', {'iface-id': 'da514680-136e-49d6-aec0-9d4192081cec', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b0:8a:af', 'vm-uuid': '40f792bb-43a9-4011-aaba-f240f64e2757'}),), if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:50:35 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:50:35 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:50:35 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:50:35 user nova-compute[75122]: INFO os_vif [None req-b6059a6d-e45e-4176-9c7c-275ba4dc0e85 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:8a:af,bridge_name='br-int',has_traffic_filtering=True,id=da514680-136e-49d6-aec0-9d4192081cec,network=Network(7ab99c1b-e670-416e-b5fe-e1337db6b28d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda514680-13')
Nov 15 09:50:35 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-b6059a6d-e45e-4176-9c7c-275ba4dc0e85 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] No BDM found with device name vda, not building metadata. {{(pid=75122) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 09:50:35 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-b6059a6d-e45e-4176-9c7c-275ba4dc0e85 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] No VIF found with MAC fa:16:3e:b0:8a:af, not building metadata {{(pid=75122) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 09:50:35 user nova-compute[75122]: DEBUG nova.compute.manager [req-1d1a5e94-55da-48be-8a6c-6465810a25a7 req-092e07cc-c700-4705-9986-9a237cc8318b service nova] [instance: 49154de0-f941-4ae0-a7af-72e75a4d8040] Received event network-vif-plugged-62759685-70a8-44fe-9a6c-36ec4cd002a2 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:50:35 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-1d1a5e94-55da-48be-8a6c-6465810a25a7 req-092e07cc-c700-4705-9986-9a237cc8318b service nova] Acquiring lock "49154de0-f941-4ae0-a7af-72e75a4d8040-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:50:35 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-1d1a5e94-55da-48be-8a6c-6465810a25a7 req-092e07cc-c700-4705-9986-9a237cc8318b service nova] Lock "49154de0-f941-4ae0-a7af-72e75a4d8040-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:50:35 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-1d1a5e94-55da-48be-8a6c-6465810a25a7 req-092e07cc-c700-4705-9986-9a237cc8318b service nova] Lock "49154de0-f941-4ae0-a7af-72e75a4d8040-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:50:35 user nova-compute[75122]: DEBUG nova.compute.manager [req-1d1a5e94-55da-48be-8a6c-6465810a25a7 req-092e07cc-c700-4705-9986-9a237cc8318b service nova] [instance: 49154de0-f941-4ae0-a7af-72e75a4d8040] No waiting events found dispatching network-vif-plugged-62759685-70a8-44fe-9a6c-36ec4cd002a2 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:50:35 user nova-compute[75122]: WARNING nova.compute.manager [req-1d1a5e94-55da-48be-8a6c-6465810a25a7 req-092e07cc-c700-4705-9986-9a237cc8318b service nova] [instance: 49154de0-f941-4ae0-a7af-72e75a4d8040] Received unexpected event network-vif-plugged-62759685-70a8-44fe-9a6c-36ec4cd002a2 for instance with vm_state deleted and task_state None.
Nov 15 09:50:35 user nova-compute[75122]: DEBUG nova.network.neutron [req-0137da8f-3c81-43cd-af00-ca9fb9e5e094 req-c2a86695-9219-4667-be6e-f36a1be8172f service nova] [instance: 40f792bb-43a9-4011-aaba-f240f64e2757] Updated VIF entry in instance network info cache for port da514680-136e-49d6-aec0-9d4192081cec. {{(pid=75122) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 09:50:35 user nova-compute[75122]: DEBUG nova.network.neutron [req-0137da8f-3c81-43cd-af00-ca9fb9e5e094 req-c2a86695-9219-4667-be6e-f36a1be8172f service nova] [instance: 40f792bb-43a9-4011-aaba-f240f64e2757] Updating instance_info_cache with network_info: [{"id": "da514680-136e-49d6-aec0-9d4192081cec", "address": "fa:16:3e:b0:8a:af", "network": {"id": "7ab99c1b-e670-416e-b5fe-e1337db6b28d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-487518933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "535c751b9e76421c9262e48fbab3fb6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda514680-13", "ovs_interfaceid": "da514680-136e-49d6-aec0-9d4192081cec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:50:35 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-0137da8f-3c81-43cd-af00-ca9fb9e5e094 req-c2a86695-9219-4667-be6e-f36a1be8172f service nova] Releasing lock "refresh_cache-40f792bb-43a9-4011-aaba-f240f64e2757" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 09:50:36 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:50:36 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:50:36 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:50:36 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:50:36 user nova-compute[75122]: DEBUG nova.compute.manager [req-ba1476ff-ebac-4a01-8ba7-64d2ec324a87 req-1f0e33cf-7485-4df6-b25b-fc40f59b01a4 service nova] [instance: 40f792bb-43a9-4011-aaba-f240f64e2757] Received event network-vif-plugged-da514680-136e-49d6-aec0-9d4192081cec {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:50:36 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-ba1476ff-ebac-4a01-8ba7-64d2ec324a87 req-1f0e33cf-7485-4df6-b25b-fc40f59b01a4 service nova] Acquiring lock "40f792bb-43a9-4011-aaba-f240f64e2757-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:50:36 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-ba1476ff-ebac-4a01-8ba7-64d2ec324a87 req-1f0e33cf-7485-4df6-b25b-fc40f59b01a4 service nova] Lock "40f792bb-43a9-4011-aaba-f240f64e2757-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:50:36 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-ba1476ff-ebac-4a01-8ba7-64d2ec324a87 req-1f0e33cf-7485-4df6-b25b-fc40f59b01a4 service nova] Lock "40f792bb-43a9-4011-aaba-f240f64e2757-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:50:36 user nova-compute[75122]: DEBUG nova.compute.manager [req-ba1476ff-ebac-4a01-8ba7-64d2ec324a87 req-1f0e33cf-7485-4df6-b25b-fc40f59b01a4 service nova] [instance: 40f792bb-43a9-4011-aaba-f240f64e2757] No waiting events found dispatching network-vif-plugged-da514680-136e-49d6-aec0-9d4192081cec {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:50:36 user nova-compute[75122]: WARNING nova.compute.manager [req-ba1476ff-ebac-4a01-8ba7-64d2ec324a87 req-1f0e33cf-7485-4df6-b25b-fc40f59b01a4 service nova] [instance: 40f792bb-43a9-4011-aaba-f240f64e2757] Received unexpected event network-vif-plugged-da514680-136e-49d6-aec0-9d4192081cec for instance with vm_state building and task_state spawning.
Nov 15 09:50:37 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:50:37 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:50:37 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:50:37 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:50:38 user nova-compute[75122]: DEBUG nova.compute.manager [None req-b6059a6d-e45e-4176-9c7c-275ba4dc0e85 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] [instance: 40f792bb-43a9-4011-aaba-f240f64e2757] Instance event wait completed in 0 seconds for  {{(pid=75122) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 09:50:38 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-b6059a6d-e45e-4176-9c7c-275ba4dc0e85 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] [instance: 40f792bb-43a9-4011-aaba-f240f64e2757] Guest created on hypervisor {{(pid=75122) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 09:50:38 user nova-compute[75122]: INFO nova.virt.libvirt.driver [-] [instance: 40f792bb-43a9-4011-aaba-f240f64e2757] Instance spawned successfully.
Nov 15 09:50:38 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-b6059a6d-e45e-4176-9c7c-275ba4dc0e85 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] [instance: 40f792bb-43a9-4011-aaba-f240f64e2757] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 09:50:38 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-b6059a6d-e45e-4176-9c7c-275ba4dc0e85 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] [instance: 40f792bb-43a9-4011-aaba-f240f64e2757] Found default for hw_cdrom_bus of ide {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:50:38 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-b6059a6d-e45e-4176-9c7c-275ba4dc0e85 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] [instance: 40f792bb-43a9-4011-aaba-f240f64e2757] Found default for hw_disk_bus of virtio {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:50:38 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-b6059a6d-e45e-4176-9c7c-275ba4dc0e85 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] [instance: 40f792bb-43a9-4011-aaba-f240f64e2757] Found default for hw_input_bus of None {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:50:38 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-b6059a6d-e45e-4176-9c7c-275ba4dc0e85 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] [instance: 40f792bb-43a9-4011-aaba-f240f64e2757] Found default for hw_pointer_model of None {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:50:38 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-b6059a6d-e45e-4176-9c7c-275ba4dc0e85 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] [instance: 40f792bb-43a9-4011-aaba-f240f64e2757] Found default for hw_video_model of virtio {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:50:38 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-b6059a6d-e45e-4176-9c7c-275ba4dc0e85 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] [instance: 40f792bb-43a9-4011-aaba-f240f64e2757] Found default for hw_vif_model of virtio {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:50:38 user nova-compute[75122]: INFO nova.compute.manager [None req-b6059a6d-e45e-4176-9c7c-275ba4dc0e85 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] [instance: 40f792bb-43a9-4011-aaba-f240f64e2757] Took 5.18 seconds to spawn the instance on the hypervisor.
Nov 15 09:50:38 user nova-compute[75122]: DEBUG nova.compute.manager [None req-b6059a6d-e45e-4176-9c7c-275ba4dc0e85 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] [instance: 40f792bb-43a9-4011-aaba-f240f64e2757] Checking state {{(pid=75122) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 09:50:38 user nova-compute[75122]: INFO nova.compute.manager [None req-b6059a6d-e45e-4176-9c7c-275ba4dc0e85 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] [instance: 40f792bb-43a9-4011-aaba-f240f64e2757] Took 5.87 seconds to build instance.
Nov 15 09:50:38 user nova-compute[75122]: DEBUG nova.compute.manager [req-83f4a009-9699-49e9-a1af-a16fdfa95bb8 req-e3c8b274-6065-40ba-9954-52aa11965fc2 service nova] [instance: 40f792bb-43a9-4011-aaba-f240f64e2757] Received event network-vif-plugged-da514680-136e-49d6-aec0-9d4192081cec {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:50:38 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-83f4a009-9699-49e9-a1af-a16fdfa95bb8 req-e3c8b274-6065-40ba-9954-52aa11965fc2 service nova] Acquiring lock "40f792bb-43a9-4011-aaba-f240f64e2757-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:50:38 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-83f4a009-9699-49e9-a1af-a16fdfa95bb8 req-e3c8b274-6065-40ba-9954-52aa11965fc2 service nova] Lock "40f792bb-43a9-4011-aaba-f240f64e2757-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:50:38 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-83f4a009-9699-49e9-a1af-a16fdfa95bb8 req-e3c8b274-6065-40ba-9954-52aa11965fc2 service nova] Lock "40f792bb-43a9-4011-aaba-f240f64e2757-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:50:38 user nova-compute[75122]: DEBUG nova.compute.manager [req-83f4a009-9699-49e9-a1af-a16fdfa95bb8 req-e3c8b274-6065-40ba-9954-52aa11965fc2 service nova] [instance: 40f792bb-43a9-4011-aaba-f240f64e2757] No waiting events found dispatching network-vif-plugged-da514680-136e-49d6-aec0-9d4192081cec {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:50:38 user nova-compute[75122]: WARNING nova.compute.manager [req-83f4a009-9699-49e9-a1af-a16fdfa95bb8 req-e3c8b274-6065-40ba-9954-52aa11965fc2 service nova] [instance: 40f792bb-43a9-4011-aaba-f240f64e2757] Received unexpected event network-vif-plugged-da514680-136e-49d6-aec0-9d4192081cec for instance with vm_state active and task_state None.
Nov 15 09:50:38 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-b6059a6d-e45e-4176-9c7c-275ba4dc0e85 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Lock "40f792bb-43a9-4011-aaba-f240f64e2757" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.051s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:50:40 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:50:41 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:50:45 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:50:46 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:50:50 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:50:53 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-fd7ebe4e-81ad-4597-8cce-d45c7f32f863 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Acquiring lock "3fbf220d-ad09-4436-8a0a-7a527dd00c6f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:50:53 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-fd7ebe4e-81ad-4597-8cce-d45c7f32f863 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Lock "3fbf220d-ad09-4436-8a0a-7a527dd00c6f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:50:53 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-fd7ebe4e-81ad-4597-8cce-d45c7f32f863 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Acquiring lock "3fbf220d-ad09-4436-8a0a-7a527dd00c6f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:50:53 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-fd7ebe4e-81ad-4597-8cce-d45c7f32f863 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Lock "3fbf220d-ad09-4436-8a0a-7a527dd00c6f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:50:53 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-fd7ebe4e-81ad-4597-8cce-d45c7f32f863 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Lock "3fbf220d-ad09-4436-8a0a-7a527dd00c6f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:50:53 user nova-compute[75122]: INFO nova.compute.manager [None req-fd7ebe4e-81ad-4597-8cce-d45c7f32f863 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] [instance: 3fbf220d-ad09-4436-8a0a-7a527dd00c6f] Terminating instance
Nov 15 09:50:53 user nova-compute[75122]: DEBUG nova.compute.manager [None req-fd7ebe4e-81ad-4597-8cce-d45c7f32f863 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] [instance: 3fbf220d-ad09-4436-8a0a-7a527dd00c6f] Start destroying the instance on the hypervisor. {{(pid=75122) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 09:50:53 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:50:53 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:50:53 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:50:53 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:50:53 user nova-compute[75122]: DEBUG nova.compute.manager [req-d2736e76-cb22-4aea-9c45-fb769a6f4f71 req-10f094cd-0b05-44d3-9577-dd19f8d5a21f service nova] [instance: 3fbf220d-ad09-4436-8a0a-7a527dd00c6f] Received event network-vif-unplugged-e5cf676d-827d-4867-8846-b468acff8b6d {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:50:53 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-d2736e76-cb22-4aea-9c45-fb769a6f4f71 req-10f094cd-0b05-44d3-9577-dd19f8d5a21f service nova] Acquiring lock "3fbf220d-ad09-4436-8a0a-7a527dd00c6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:50:53 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-d2736e76-cb22-4aea-9c45-fb769a6f4f71 req-10f094cd-0b05-44d3-9577-dd19f8d5a21f service nova] Lock "3fbf220d-ad09-4436-8a0a-7a527dd00c6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:50:53 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-d2736e76-cb22-4aea-9c45-fb769a6f4f71 req-10f094cd-0b05-44d3-9577-dd19f8d5a21f service nova] Lock "3fbf220d-ad09-4436-8a0a-7a527dd00c6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:50:53 user nova-compute[75122]: DEBUG nova.compute.manager [req-d2736e76-cb22-4aea-9c45-fb769a6f4f71 req-10f094cd-0b05-44d3-9577-dd19f8d5a21f service nova] [instance: 3fbf220d-ad09-4436-8a0a-7a527dd00c6f] No waiting events found dispatching network-vif-unplugged-e5cf676d-827d-4867-8846-b468acff8b6d {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:50:53 user nova-compute[75122]: DEBUG nova.compute.manager [req-d2736e76-cb22-4aea-9c45-fb769a6f4f71 req-10f094cd-0b05-44d3-9577-dd19f8d5a21f service nova] [instance: 3fbf220d-ad09-4436-8a0a-7a527dd00c6f] Received event network-vif-unplugged-e5cf676d-827d-4867-8846-b468acff8b6d for instance with task_state deleting. {{(pid=75122) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 09:50:53 user nova-compute[75122]: INFO nova.virt.libvirt.driver [-] [instance: 3fbf220d-ad09-4436-8a0a-7a527dd00c6f] Instance destroyed successfully.
Nov 15 09:50:53 user nova-compute[75122]: DEBUG nova.objects.instance [None req-fd7ebe4e-81ad-4597-8cce-d45c7f32f863 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Lazy-loading 'resources' on Instance uuid 3fbf220d-ad09-4436-8a0a-7a527dd00c6f {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:50:53 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-fd7ebe4e-81ad-4597-8cce-d45c7f32f863 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T09:48:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1299938130',display_name='tempest-AttachVolumeNegativeTest-server-1299938130',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1299938130',id=34,image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDHQuMYCoBgGPXLQVY3CAXhR6ld1Z9VSBItS0SzOk1ECAAt/ZRyOoJvBsgIrm1QEmJf1OJy4Q/Bu3Celsv4mIYT16LyV2uiAQpdHfqudiapAh+IvxNi0aYAZAkH/Z5flAA==',key_name='tempest-keypair-549936525',keypairs=<?>,launch_index=0,launched_at=2023-11-15T09:48:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f29cd64a8a674d73936b8a0c90bf2d34',ramdisk_id='',reservation_id='r-62dzr9bk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-475232131',owner_user_name='tempest-AttachVolumeNegativeTest-475232131-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T09:48:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d52d39a644924944be943a3200bd5b33',uuid=3fbf220d-ad09-4436-8a0a-7a527dd00c6f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e5cf676d-827d-4867-8846-b468acff8b6d", "address": "fa:16:3e:7d:32:4e", "network": {"id": "cc80acf3-8a44-4d7e-aaa0-1214700564b3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1084984321-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f29cd64a8a674d73936b8a0c90bf2d34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5cf676d-82", "ovs_interfaceid": "e5cf676d-827d-4867-8846-b468acff8b6d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 09:50:53 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-fd7ebe4e-81ad-4597-8cce-d45c7f32f863 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Converting VIF {"id": "e5cf676d-827d-4867-8846-b468acff8b6d", "address": "fa:16:3e:7d:32:4e", "network": {"id": "cc80acf3-8a44-4d7e-aaa0-1214700564b3", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1084984321-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f29cd64a8a674d73936b8a0c90bf2d34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5cf676d-82", "ovs_interfaceid": "e5cf676d-827d-4867-8846-b468acff8b6d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 09:50:53 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-fd7ebe4e-81ad-4597-8cce-d45c7f32f863 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7d:32:4e,bridge_name='br-int',has_traffic_filtering=True,id=e5cf676d-827d-4867-8846-b468acff8b6d,network=Network(cc80acf3-8a44-4d7e-aaa0-1214700564b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5cf676d-82') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 09:50:53 user nova-compute[75122]: DEBUG os_vif [None req-fd7ebe4e-81ad-4597-8cce-d45c7f32f863 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7d:32:4e,bridge_name='br-int',has_traffic_filtering=True,id=e5cf676d-827d-4867-8846-b468acff8b6d,network=Network(cc80acf3-8a44-4d7e-aaa0-1214700564b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5cf676d-82') {{(pid=75122) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 09:50:53 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:50:53 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape5cf676d-82, bridge=br-int, if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:50:53 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:50:53 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:50:53 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:50:53 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b421f9c9-f0ef-4f1c-b387-8b8c6d522a87) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:50:53 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:50:53 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:50:53 user nova-compute[75122]: INFO os_vif [None req-fd7ebe4e-81ad-4597-8cce-d45c7f32f863 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7d:32:4e,bridge_name='br-int',has_traffic_filtering=True,id=e5cf676d-827d-4867-8846-b468acff8b6d,network=Network(cc80acf3-8a44-4d7e-aaa0-1214700564b3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5cf676d-82')
Nov 15 09:50:53 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-fd7ebe4e-81ad-4597-8cce-d45c7f32f863 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] [instance: 3fbf220d-ad09-4436-8a0a-7a527dd00c6f] Deleting instance files /opt/stack/data/nova/instances/3fbf220d-ad09-4436-8a0a-7a527dd00c6f_del
Nov 15 09:50:53 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-fd7ebe4e-81ad-4597-8cce-d45c7f32f863 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] [instance: 3fbf220d-ad09-4436-8a0a-7a527dd00c6f] Deletion of /opt/stack/data/nova/instances/3fbf220d-ad09-4436-8a0a-7a527dd00c6f_del complete
Nov 15 09:50:53 user nova-compute[75122]: INFO nova.compute.manager [None req-fd7ebe4e-81ad-4597-8cce-d45c7f32f863 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] [instance: 3fbf220d-ad09-4436-8a0a-7a527dd00c6f] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 15 09:50:53 user nova-compute[75122]: DEBUG oslo.service.loopingcall [None req-fd7ebe4e-81ad-4597-8cce-d45c7f32f863 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75122) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 09:50:53 user nova-compute[75122]: DEBUG nova.compute.manager [-] [instance: 3fbf220d-ad09-4436-8a0a-7a527dd00c6f] Deallocating network for instance {{(pid=75122) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 09:50:53 user nova-compute[75122]: DEBUG nova.network.neutron [-] [instance: 3fbf220d-ad09-4436-8a0a-7a527dd00c6f] deallocate_for_instance() {{(pid=75122) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 09:50:54 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:50:54 user nova-compute[75122]: DEBUG nova.network.neutron [-] [instance: 3fbf220d-ad09-4436-8a0a-7a527dd00c6f] Updating instance_info_cache with network_info: [] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:50:54 user nova-compute[75122]: INFO nova.compute.manager [-] [instance: 3fbf220d-ad09-4436-8a0a-7a527dd00c6f] Took 0.68 seconds to deallocate network for instance.
Nov 15 09:50:54 user nova-compute[75122]: DEBUG nova.compute.manager [req-b991b63b-8795-4b28-8e4c-9d8a119bfcc1 req-e1f7e7fa-7369-4753-be6a-6613115312a1 service nova] [instance: 3fbf220d-ad09-4436-8a0a-7a527dd00c6f] Received event network-vif-deleted-e5cf676d-827d-4867-8846-b468acff8b6d {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:50:54 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-fd7ebe4e-81ad-4597-8cce-d45c7f32f863 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:50:54 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-fd7ebe4e-81ad-4597-8cce-d45c7f32f863 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:50:54 user nova-compute[75122]: DEBUG nova.compute.provider_tree [None req-fd7ebe4e-81ad-4597-8cce-d45c7f32f863 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Inventory has not changed in ProviderTree for provider: 69a3da65-47be-44c6-b67c-c692b58284ef {{(pid=75122) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 09:50:54 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-fd7ebe4e-81ad-4597-8cce-d45c7f32f863 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Inventory has not changed for provider 69a3da65-47be-44c6-b67c-c692b58284ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 09:50:54 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-fd7ebe4e-81ad-4597-8cce-d45c7f32f863 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.192s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:50:54 user nova-compute[75122]: INFO nova.scheduler.client.report [None req-fd7ebe4e-81ad-4597-8cce-d45c7f32f863 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Deleted allocations for instance 3fbf220d-ad09-4436-8a0a-7a527dd00c6f
Nov 15 09:50:55 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-fd7ebe4e-81ad-4597-8cce-d45c7f32f863 tempest-AttachVolumeNegativeTest-475232131 tempest-AttachVolumeNegativeTest-475232131-project-member] Lock "3fbf220d-ad09-4436-8a0a-7a527dd00c6f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.936s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:50:55 user nova-compute[75122]: DEBUG nova.compute.manager [req-be859c82-bccc-41ba-8c7d-29feceffab5f req-c6427963-a327-4a13-81a8-86475907db1e service nova] [instance: 3fbf220d-ad09-4436-8a0a-7a527dd00c6f] Received event network-vif-plugged-e5cf676d-827d-4867-8846-b468acff8b6d {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:50:55 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-be859c82-bccc-41ba-8c7d-29feceffab5f req-c6427963-a327-4a13-81a8-86475907db1e service nova] Acquiring lock "3fbf220d-ad09-4436-8a0a-7a527dd00c6f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:50:55 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-be859c82-bccc-41ba-8c7d-29feceffab5f req-c6427963-a327-4a13-81a8-86475907db1e service nova] Lock "3fbf220d-ad09-4436-8a0a-7a527dd00c6f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:50:55 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-be859c82-bccc-41ba-8c7d-29feceffab5f req-c6427963-a327-4a13-81a8-86475907db1e service nova] Lock "3fbf220d-ad09-4436-8a0a-7a527dd00c6f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:50:55 user nova-compute[75122]: DEBUG nova.compute.manager [req-be859c82-bccc-41ba-8c7d-29feceffab5f req-c6427963-a327-4a13-81a8-86475907db1e service nova] [instance: 3fbf220d-ad09-4436-8a0a-7a527dd00c6f] No waiting events found dispatching network-vif-plugged-e5cf676d-827d-4867-8846-b468acff8b6d {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:50:55 user nova-compute[75122]: WARNING nova.compute.manager [req-be859c82-bccc-41ba-8c7d-29feceffab5f req-c6427963-a327-4a13-81a8-86475907db1e service nova] [instance: 3fbf220d-ad09-4436-8a0a-7a527dd00c6f] Received unexpected event network-vif-plugged-e5cf676d-827d-4867-8846-b468acff8b6d for instance with vm_state deleted and task_state None.
Nov 15 09:50:56 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:50:58 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:51:01 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:51:03 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:51:06 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:51:08 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:51:13 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:51:13 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:51:13 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75122) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 09:51:13 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75122) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 09:51:13 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75122) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 09:51:13 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:51:15 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-ee4a4a6a-87f8-4182-9620-b073e7abb1e1 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Acquiring lock "00270cc2-4f5b-4f64-8f88-31f21e3b3950" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:51:15 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-ee4a4a6a-87f8-4182-9620-b073e7abb1e1 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Lock "00270cc2-4f5b-4f64-8f88-31f21e3b3950" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:51:15 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-ee4a4a6a-87f8-4182-9620-b073e7abb1e1 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Acquiring lock "00270cc2-4f5b-4f64-8f88-31f21e3b3950-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:51:15 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-ee4a4a6a-87f8-4182-9620-b073e7abb1e1 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Lock "00270cc2-4f5b-4f64-8f88-31f21e3b3950-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:51:15 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-ee4a4a6a-87f8-4182-9620-b073e7abb1e1 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Lock "00270cc2-4f5b-4f64-8f88-31f21e3b3950-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:51:15 user nova-compute[75122]: INFO nova.compute.manager [None req-ee4a4a6a-87f8-4182-9620-b073e7abb1e1 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] [instance: 00270cc2-4f5b-4f64-8f88-31f21e3b3950] Terminating instance
Nov 15 09:51:15 user nova-compute[75122]: DEBUG nova.compute.manager [None req-ee4a4a6a-87f8-4182-9620-b073e7abb1e1 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] [instance: 00270cc2-4f5b-4f64-8f88-31f21e3b3950] Start destroying the instance on the hypervisor. {{(pid=75122) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 09:51:15 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:51:15 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:51:15 user nova-compute[75122]: DEBUG nova.compute.manager [req-c0db8ae9-1ebe-4dd8-bb45-68611ab14c7d req-8b31a16d-bc60-4d85-9cc0-4fecf281afa6 service nova] [instance: 00270cc2-4f5b-4f64-8f88-31f21e3b3950] Received event network-vif-unplugged-bb6552dc-ebef-427a-beea-b41083f05e70 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:51:15 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-c0db8ae9-1ebe-4dd8-bb45-68611ab14c7d req-8b31a16d-bc60-4d85-9cc0-4fecf281afa6 service nova] Acquiring lock "00270cc2-4f5b-4f64-8f88-31f21e3b3950-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:51:15 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-c0db8ae9-1ebe-4dd8-bb45-68611ab14c7d req-8b31a16d-bc60-4d85-9cc0-4fecf281afa6 service nova] Lock "00270cc2-4f5b-4f64-8f88-31f21e3b3950-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:51:15 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-c0db8ae9-1ebe-4dd8-bb45-68611ab14c7d req-8b31a16d-bc60-4d85-9cc0-4fecf281afa6 service nova] Lock "00270cc2-4f5b-4f64-8f88-31f21e3b3950-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:51:15 user nova-compute[75122]: DEBUG nova.compute.manager [req-c0db8ae9-1ebe-4dd8-bb45-68611ab14c7d req-8b31a16d-bc60-4d85-9cc0-4fecf281afa6 service nova] [instance: 00270cc2-4f5b-4f64-8f88-31f21e3b3950] No waiting events found dispatching network-vif-unplugged-bb6552dc-ebef-427a-beea-b41083f05e70 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:51:15 user nova-compute[75122]: DEBUG nova.compute.manager [req-c0db8ae9-1ebe-4dd8-bb45-68611ab14c7d req-8b31a16d-bc60-4d85-9cc0-4fecf281afa6 service nova] [instance: 00270cc2-4f5b-4f64-8f88-31f21e3b3950] Received event network-vif-unplugged-bb6552dc-ebef-427a-beea-b41083f05e70 for instance with task_state deleting. {{(pid=75122) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 09:51:15 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:51:15 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:51:16 user nova-compute[75122]: INFO nova.virt.libvirt.driver [-] [instance: 00270cc2-4f5b-4f64-8f88-31f21e3b3950] Instance destroyed successfully.
Nov 15 09:51:16 user nova-compute[75122]: DEBUG nova.objects.instance [None req-ee4a4a6a-87f8-4182-9620-b073e7abb1e1 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Lazy-loading 'resources' on Instance uuid 00270cc2-4f5b-4f64-8f88-31f21e3b3950 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:51:16 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-ee4a4a6a-87f8-4182-9620-b073e7abb1e1 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T09:35:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1776429290',display_name='tempest-ServerRescueNegativeTestJSON-server-1776429290',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1776429290',id=17,image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T09:37:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='eeff24cb28f5481fa3941ba399ce82ff',ramdisk_id='',reservation_id='r-rom8e8vs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-59965354',owner_user_name='tempest-ServerRescueNegativeTestJSON-59965354-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T09:37:11Z,user_data=None,user_id='d05ef35b07ba45afb142f406d418d8d4',uuid=00270cc2-4f5b-4f64-8f88-31f21e3b3950,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "bb6552dc-ebef-427a-beea-b41083f05e70", "address": "fa:16:3e:44:9c:f9", "network": {"id": "c2062f64-d925-42d2-9687-5d2511ef6697", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1134087048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eeff24cb28f5481fa3941ba399ce82ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb6552dc-eb", "ovs_interfaceid": "bb6552dc-ebef-427a-beea-b41083f05e70", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 09:51:16 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-ee4a4a6a-87f8-4182-9620-b073e7abb1e1 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Converting VIF {"id": "bb6552dc-ebef-427a-beea-b41083f05e70", "address": "fa:16:3e:44:9c:f9", "network": {"id": "c2062f64-d925-42d2-9687-5d2511ef6697", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1134087048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eeff24cb28f5481fa3941ba399ce82ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb6552dc-eb", "ovs_interfaceid": "bb6552dc-ebef-427a-beea-b41083f05e70", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 09:51:16 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-ee4a4a6a-87f8-4182-9620-b073e7abb1e1 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:44:9c:f9,bridge_name='br-int',has_traffic_filtering=True,id=bb6552dc-ebef-427a-beea-b41083f05e70,network=Network(c2062f64-d925-42d2-9687-5d2511ef6697),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb6552dc-eb') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 09:51:16 user nova-compute[75122]: DEBUG os_vif [None req-ee4a4a6a-87f8-4182-9620-b073e7abb1e1 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:44:9c:f9,bridge_name='br-int',has_traffic_filtering=True,id=bb6552dc-ebef-427a-beea-b41083f05e70,network=Network(c2062f64-d925-42d2-9687-5d2511ef6697),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb6552dc-eb') {{(pid=75122) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 09:51:16 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:51:16 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbb6552dc-eb, bridge=br-int, if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:51:16 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:51:16 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:51:16 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:51:16 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2540f2fe-70ec-4268-bd64-addcfa5b8f83) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:51:16 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:51:16 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:51:16 user nova-compute[75122]: INFO os_vif [None req-ee4a4a6a-87f8-4182-9620-b073e7abb1e1 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:44:9c:f9,bridge_name='br-int',has_traffic_filtering=True,id=bb6552dc-ebef-427a-beea-b41083f05e70,network=Network(c2062f64-d925-42d2-9687-5d2511ef6697),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb6552dc-eb')
Nov 15 09:51:16 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-ee4a4a6a-87f8-4182-9620-b073e7abb1e1 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] [instance: 00270cc2-4f5b-4f64-8f88-31f21e3b3950] Deleting instance files /opt/stack/data/nova/instances/00270cc2-4f5b-4f64-8f88-31f21e3b3950_del
Nov 15 09:51:16 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-ee4a4a6a-87f8-4182-9620-b073e7abb1e1 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] [instance: 00270cc2-4f5b-4f64-8f88-31f21e3b3950] Deletion of /opt/stack/data/nova/instances/00270cc2-4f5b-4f64-8f88-31f21e3b3950_del complete
Nov 15 09:51:16 user nova-compute[75122]: INFO nova.compute.manager [None req-ee4a4a6a-87f8-4182-9620-b073e7abb1e1 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] [instance: 00270cc2-4f5b-4f64-8f88-31f21e3b3950] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 15 09:51:16 user nova-compute[75122]: DEBUG oslo.service.loopingcall [None req-ee4a4a6a-87f8-4182-9620-b073e7abb1e1 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75122) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 09:51:16 user nova-compute[75122]: DEBUG nova.compute.manager [-] [instance: 00270cc2-4f5b-4f64-8f88-31f21e3b3950] Deallocating network for instance {{(pid=75122) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 09:51:16 user nova-compute[75122]: DEBUG nova.network.neutron [-] [instance: 00270cc2-4f5b-4f64-8f88-31f21e3b3950] deallocate_for_instance() {{(pid=75122) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 09:51:16 user nova-compute[75122]: DEBUG nova.network.neutron [-] [instance: 00270cc2-4f5b-4f64-8f88-31f21e3b3950] Updating instance_info_cache with network_info: [] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:51:16 user nova-compute[75122]: INFO nova.compute.manager [-] [instance: 00270cc2-4f5b-4f64-8f88-31f21e3b3950] Took 0.42 seconds to deallocate network for instance.
Nov 15 09:51:16 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-ee4a4a6a-87f8-4182-9620-b073e7abb1e1 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:51:16 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-ee4a4a6a-87f8-4182-9620-b073e7abb1e1 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:51:16 user nova-compute[75122]: DEBUG nova.compute.manager [req-3a381944-b41b-4050-9919-d47848e0c58f req-257f004c-d34a-445c-baea-aea58113dcab service nova] [instance: 00270cc2-4f5b-4f64-8f88-31f21e3b3950] Received event network-vif-deleted-bb6552dc-ebef-427a-beea-b41083f05e70 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:51:16 user nova-compute[75122]: DEBUG nova.compute.provider_tree [None req-ee4a4a6a-87f8-4182-9620-b073e7abb1e1 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Inventory has not changed in ProviderTree for provider: 69a3da65-47be-44c6-b67c-c692b58284ef {{(pid=75122) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 09:51:16 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-ee4a4a6a-87f8-4182-9620-b073e7abb1e1 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Inventory has not changed for provider 69a3da65-47be-44c6-b67c-c692b58284ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 09:51:16 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-ee4a4a6a-87f8-4182-9620-b073e7abb1e1 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.171s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:51:16 user nova-compute[75122]: INFO nova.scheduler.client.report [None req-ee4a4a6a-87f8-4182-9620-b073e7abb1e1 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Deleted allocations for instance 00270cc2-4f5b-4f64-8f88-31f21e3b3950
Nov 15 09:51:16 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-ee4a4a6a-87f8-4182-9620-b073e7abb1e1 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Lock "00270cc2-4f5b-4f64-8f88-31f21e3b3950" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.631s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:51:17 user nova-compute[75122]: DEBUG nova.compute.manager [req-d8e881ad-9282-46be-a492-f75162f0b60b req-9e4a0ebf-f46c-4098-b4c6-77c8b73ca047 service nova] [instance: 00270cc2-4f5b-4f64-8f88-31f21e3b3950] Received event network-vif-plugged-bb6552dc-ebef-427a-beea-b41083f05e70 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:51:17 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-d8e881ad-9282-46be-a492-f75162f0b60b req-9e4a0ebf-f46c-4098-b4c6-77c8b73ca047 service nova] Acquiring lock "00270cc2-4f5b-4f64-8f88-31f21e3b3950-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:51:17 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-d8e881ad-9282-46be-a492-f75162f0b60b req-9e4a0ebf-f46c-4098-b4c6-77c8b73ca047 service nova] Lock "00270cc2-4f5b-4f64-8f88-31f21e3b3950-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:51:17 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-d8e881ad-9282-46be-a492-f75162f0b60b req-9e4a0ebf-f46c-4098-b4c6-77c8b73ca047 service nova] Lock "00270cc2-4f5b-4f64-8f88-31f21e3b3950-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:51:17 user nova-compute[75122]: DEBUG nova.compute.manager [req-d8e881ad-9282-46be-a492-f75162f0b60b req-9e4a0ebf-f46c-4098-b4c6-77c8b73ca047 service nova] [instance: 00270cc2-4f5b-4f64-8f88-31f21e3b3950] No waiting events found dispatching network-vif-plugged-bb6552dc-ebef-427a-beea-b41083f05e70 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:51:17 user nova-compute[75122]: WARNING nova.compute.manager [req-d8e881ad-9282-46be-a492-f75162f0b60b req-9e4a0ebf-f46c-4098-b4c6-77c8b73ca047 service nova] [instance: 00270cc2-4f5b-4f64-8f88-31f21e3b3950] Received unexpected event network-vif-plugged-bb6552dc-ebef-427a-beea-b41083f05e70 for instance with vm_state deleted and task_state None.
Nov 15 09:51:19 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:51:19 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Cleaning up deleted instances {{(pid=75122) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 15 09:51:19 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] There are 0 instances to clean {{(pid=75122) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 15 09:51:21 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:51:26 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:51:26 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:51:26 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:51:27 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:51:28 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:51:28 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Starting heal instance info cache {{(pid=75122) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 09:51:28 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Didn't find any instances for network info cache update. {{(pid=75122) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 15 09:51:28 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:51:28 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:51:28 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:51:28 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:51:28 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75122) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 09:51:28 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40f792bb-43a9-4011-aaba-f240f64e2757/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:51:28 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40f792bb-43a9-4011-aaba-f240f64e2757/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:51:28 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40f792bb-43a9-4011-aaba-f240f64e2757/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:51:28 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40f792bb-43a9-4011-aaba-f240f64e2757/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:51:28 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/001d589e-1bee-42da-8422-233ba796fbab/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:51:28 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/001d589e-1bee-42da-8422-233ba796fbab/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:51:28 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/001d589e-1bee-42da-8422-233ba796fbab/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:51:29 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:51:29 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/001d589e-1bee-42da-8422-233ba796fbab/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:51:29 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd9d52bb-6248-48e6-a798-6dbdaaa68cbc/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:51:29 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd9d52bb-6248-48e6-a798-6dbdaaa68cbc/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:51:29 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd9d52bb-6248-48e6-a798-6dbdaaa68cbc/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:51:29 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fd9d52bb-6248-48e6-a798-6dbdaaa68cbc/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:51:29 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 09:51:29 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 09:51:29 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Hypervisor/Node resource view: name=user free_ram=8637MB free_disk=25.328304290771484GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75122) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 09:51:29 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:51:29 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:51:30 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance fd9d52bb-6248-48e6-a798-6dbdaaa68cbc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:51:30 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance 001d589e-1bee-42da-8422-233ba796fbab actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:51:30 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance 40f792bb-43a9-4011-aaba-f240f64e2757 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:51:30 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75122) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 09:51:30 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75122) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 09:51:30 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Refreshing inventories for resource provider 69a3da65-47be-44c6-b67c-c692b58284ef {{(pid=75122) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 15 09:51:30 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Updating ProviderTree inventory for provider 69a3da65-47be-44c6-b67c-c692b58284ef from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 15 09:51:30 user nova-compute[75122]: DEBUG nova.compute.provider_tree [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Updating inventory in ProviderTree for provider 69a3da65-47be-44c6-b67c-c692b58284ef with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 15 09:51:30 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Refreshing aggregate associations for resource provider 69a3da65-47be-44c6-b67c-c692b58284ef, aggregates: None {{(pid=75122) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 15 09:51:30 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Refreshing trait associations for resource provider 69a3da65-47be-44c6-b67c-c692b58284ef, traits: COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_RESCUE_BFV,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE,COMPUTE_NODE,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_ACCELERATORS,HW_CPU_X86_MMX {{(pid=75122) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 15 09:51:30 user nova-compute[75122]: DEBUG nova.compute.provider_tree [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Inventory has not changed in ProviderTree for provider: 69a3da65-47be-44c6-b67c-c692b58284ef {{(pid=75122) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 09:51:30 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Inventory has not changed for provider 69a3da65-47be-44c6-b67c-c692b58284ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 09:51:30 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Compute_service record updated for user:user {{(pid=75122) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 09:51:30 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.811s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:51:31 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:51:31 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:51:31 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:51:31 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:51:31 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:51:31 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75122) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 09:51:36 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:51:36 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:51:36 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:51:38 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:51:38 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75122) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 15 09:51:41 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:51:46 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:51:51 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:51:54 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:51:55 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:51:56 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:51:57 user nova-compute[75122]: DEBUG nova.compute.manager [None req-6bb2e94e-237b-4f16-9709-c97967d0e718 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: 001d589e-1bee-42da-8422-233ba796fbab] Checking state {{(pid=75122) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 09:51:57 user nova-compute[75122]: INFO nova.compute.manager [None req-6bb2e94e-237b-4f16-9709-c97967d0e718 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: 001d589e-1bee-42da-8422-233ba796fbab] instance snapshotting
Nov 15 09:51:57 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-6bb2e94e-237b-4f16-9709-c97967d0e718 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: 001d589e-1bee-42da-8422-233ba796fbab] Beginning live snapshot process
Nov 15 09:51:57 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-6bb2e94e-237b-4f16-9709-c97967d0e718 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/001d589e-1bee-42da-8422-233ba796fbab/disk --force-share --output=json -f qcow2 {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:51:57 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-6bb2e94e-237b-4f16-9709-c97967d0e718 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/001d589e-1bee-42da-8422-233ba796fbab/disk --force-share --output=json -f qcow2" returned: 0 in 0.181s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:51:57 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-6bb2e94e-237b-4f16-9709-c97967d0e718 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/001d589e-1bee-42da-8422-233ba796fbab/disk --force-share --output=json -f qcow2 {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:51:57 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-6bb2e94e-237b-4f16-9709-c97967d0e718 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/001d589e-1bee-42da-8422-233ba796fbab/disk --force-share --output=json -f qcow2" returned: 0 in 0.176s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:51:57 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-6bb2e94e-237b-4f16-9709-c97967d0e718 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:51:58 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-6bb2e94e-237b-4f16-9709-c97967d0e718 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json" returned: 0 in 0.170s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:51:58 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-6bb2e94e-237b-4f16-9709-c97967d0e718 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp373wukew/5842a8e6b70b4975946da523bee9e1f0.delta 1073741824 {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:51:58 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-6bb2e94e-237b-4f16-9709-c97967d0e718 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp373wukew/5842a8e6b70b4975946da523bee9e1f0.delta 1073741824" returned: 0 in 0.057s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:51:58 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-6bb2e94e-237b-4f16-9709-c97967d0e718 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: 001d589e-1bee-42da-8422-233ba796fbab] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 15 09:51:58 user nova-compute[75122]: DEBUG nova.virt.libvirt.guest [None req-6bb2e94e-237b-4f16-9709-c97967d0e718 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=75122) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 09:51:59 user nova-compute[75122]: DEBUG nova.virt.libvirt.guest [None req-6bb2e94e-237b-4f16-9709-c97967d0e718 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75122) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 09:51:59 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-6bb2e94e-237b-4f16-9709-c97967d0e718 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: 001d589e-1bee-42da-8422-233ba796fbab] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 15 09:51:59 user nova-compute[75122]: DEBUG nova.privsep.utils [None req-6bb2e94e-237b-4f16-9709-c97967d0e718 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75122) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 09:51:59 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-6bb2e94e-237b-4f16-9709-c97967d0e718 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp373wukew/5842a8e6b70b4975946da523bee9e1f0.delta /opt/stack/data/nova/instances/snapshots/tmp373wukew/5842a8e6b70b4975946da523bee9e1f0 {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:52:00 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-6bb2e94e-237b-4f16-9709-c97967d0e718 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp373wukew/5842a8e6b70b4975946da523bee9e1f0.delta /opt/stack/data/nova/instances/snapshots/tmp373wukew/5842a8e6b70b4975946da523bee9e1f0" returned: 0 in 0.646s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:52:00 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-6bb2e94e-237b-4f16-9709-c97967d0e718 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: 001d589e-1bee-42da-8422-233ba796fbab] Snapshot extracted, beginning image upload
Nov 15 09:52:01 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:52:02 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-6bb2e94e-237b-4f16-9709-c97967d0e718 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: 001d589e-1bee-42da-8422-233ba796fbab] Snapshot image upload complete
Nov 15 09:52:02 user nova-compute[75122]: INFO nova.compute.manager [None req-6bb2e94e-237b-4f16-9709-c97967d0e718 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: 001d589e-1bee-42da-8422-233ba796fbab] Took 5.22 seconds to snapshot the instance on the hypervisor.
Nov 15 09:52:05 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-19d39225-5fac-4683-a026-f2eb7361b526 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Acquiring lock "fd9d52bb-6248-48e6-a798-6dbdaaa68cbc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:52:05 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-19d39225-5fac-4683-a026-f2eb7361b526 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Lock "fd9d52bb-6248-48e6-a798-6dbdaaa68cbc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.004s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:52:05 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-19d39225-5fac-4683-a026-f2eb7361b526 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Acquiring lock "fd9d52bb-6248-48e6-a798-6dbdaaa68cbc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:52:05 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-19d39225-5fac-4683-a026-f2eb7361b526 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Lock "fd9d52bb-6248-48e6-a798-6dbdaaa68cbc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:52:05 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-19d39225-5fac-4683-a026-f2eb7361b526 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Lock "fd9d52bb-6248-48e6-a798-6dbdaaa68cbc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:52:05 user nova-compute[75122]: INFO nova.compute.manager [None req-19d39225-5fac-4683-a026-f2eb7361b526 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] [instance: fd9d52bb-6248-48e6-a798-6dbdaaa68cbc] Terminating instance
Nov 15 09:52:05 user nova-compute[75122]: DEBUG nova.compute.manager [None req-19d39225-5fac-4683-a026-f2eb7361b526 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] [instance: fd9d52bb-6248-48e6-a798-6dbdaaa68cbc] Start destroying the instance on the hypervisor. {{(pid=75122) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 09:52:06 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:52:06 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:52:06 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:52:06 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:52:06 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:52:06 user nova-compute[75122]: DEBUG nova.compute.manager [req-c6a23138-6369-480d-a6c8-4462684d9b17 req-e3913b5b-ab19-4f9c-a8c9-25938bad7606 service nova] [instance: fd9d52bb-6248-48e6-a798-6dbdaaa68cbc] Received event network-vif-unplugged-f6892701-aba2-4c9a-88bd-996d00963301 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:52:06 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-c6a23138-6369-480d-a6c8-4462684d9b17 req-e3913b5b-ab19-4f9c-a8c9-25938bad7606 service nova] Acquiring lock "fd9d52bb-6248-48e6-a798-6dbdaaa68cbc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:52:06 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-c6a23138-6369-480d-a6c8-4462684d9b17 req-e3913b5b-ab19-4f9c-a8c9-25938bad7606 service nova] Lock "fd9d52bb-6248-48e6-a798-6dbdaaa68cbc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:52:06 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-c6a23138-6369-480d-a6c8-4462684d9b17 req-e3913b5b-ab19-4f9c-a8c9-25938bad7606 service nova] Lock "fd9d52bb-6248-48e6-a798-6dbdaaa68cbc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:52:06 user nova-compute[75122]: DEBUG nova.compute.manager [req-c6a23138-6369-480d-a6c8-4462684d9b17 req-e3913b5b-ab19-4f9c-a8c9-25938bad7606 service nova] [instance: fd9d52bb-6248-48e6-a798-6dbdaaa68cbc] No waiting events found dispatching network-vif-unplugged-f6892701-aba2-4c9a-88bd-996d00963301 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:52:06 user nova-compute[75122]: DEBUG nova.compute.manager [req-c6a23138-6369-480d-a6c8-4462684d9b17 req-e3913b5b-ab19-4f9c-a8c9-25938bad7606 service nova] [instance: fd9d52bb-6248-48e6-a798-6dbdaaa68cbc] Received event network-vif-unplugged-f6892701-aba2-4c9a-88bd-996d00963301 for instance with task_state deleting. {{(pid=75122) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 09:52:06 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:52:06 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:52:06 user nova-compute[75122]: INFO nova.virt.libvirt.driver [-] [instance: fd9d52bb-6248-48e6-a798-6dbdaaa68cbc] Instance destroyed successfully.
Nov 15 09:52:06 user nova-compute[75122]: DEBUG nova.objects.instance [None req-19d39225-5fac-4683-a026-f2eb7361b526 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Lazy-loading 'resources' on Instance uuid fd9d52bb-6248-48e6-a798-6dbdaaa68cbc {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:52:06 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-19d39225-5fac-4683-a026-f2eb7361b526 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T09:35:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1046243250',display_name='tempest-ServerRescueNegativeTestJSON-server-1046243250',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1046243250',id=16,image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T09:40:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='eeff24cb28f5481fa3941ba399ce82ff',ramdisk_id='',reservation_id='r-wmbthb7r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-59965354',owner_user_name='tempest-ServerRescueNegativeTestJSON-59965354-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T09:41:55Z,user_data=None,user_id='d05ef35b07ba45afb142f406d418d8d4',uuid=fd9d52bb-6248-48e6-a798-6dbdaaa68cbc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f6892701-aba2-4c9a-88bd-996d00963301", "address": "fa:16:3e:a5:6f:a0", "network": {"id": "c2062f64-d925-42d2-9687-5d2511ef6697", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1134087048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eeff24cb28f5481fa3941ba399ce82ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6892701-ab", "ovs_interfaceid": "f6892701-aba2-4c9a-88bd-996d00963301", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 09:52:06 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-19d39225-5fac-4683-a026-f2eb7361b526 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Converting VIF {"id": "f6892701-aba2-4c9a-88bd-996d00963301", "address": "fa:16:3e:a5:6f:a0", "network": {"id": "c2062f64-d925-42d2-9687-5d2511ef6697", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1134087048-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eeff24cb28f5481fa3941ba399ce82ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6892701-ab", "ovs_interfaceid": "f6892701-aba2-4c9a-88bd-996d00963301", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 09:52:06 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-19d39225-5fac-4683-a026-f2eb7361b526 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a5:6f:a0,bridge_name='br-int',has_traffic_filtering=True,id=f6892701-aba2-4c9a-88bd-996d00963301,network=Network(c2062f64-d925-42d2-9687-5d2511ef6697),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6892701-ab') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 09:52:06 user nova-compute[75122]: DEBUG os_vif [None req-19d39225-5fac-4683-a026-f2eb7361b526 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a5:6f:a0,bridge_name='br-int',has_traffic_filtering=True,id=f6892701-aba2-4c9a-88bd-996d00963301,network=Network(c2062f64-d925-42d2-9687-5d2511ef6697),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6892701-ab') {{(pid=75122) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 09:52:06 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:52:06 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf6892701-ab, bridge=br-int, if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:52:06 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:52:06 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:52:06 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:52:06 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=249e9776-4657-40a2-aa3c-7ccbf5ef2566) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:52:06 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:52:06 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:52:06 user nova-compute[75122]: INFO os_vif [None req-19d39225-5fac-4683-a026-f2eb7361b526 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a5:6f:a0,bridge_name='br-int',has_traffic_filtering=True,id=f6892701-aba2-4c9a-88bd-996d00963301,network=Network(c2062f64-d925-42d2-9687-5d2511ef6697),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6892701-ab')
Nov 15 09:52:06 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-19d39225-5fac-4683-a026-f2eb7361b526 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] [instance: fd9d52bb-6248-48e6-a798-6dbdaaa68cbc] Deleting instance files /opt/stack/data/nova/instances/fd9d52bb-6248-48e6-a798-6dbdaaa68cbc_del
Nov 15 09:52:06 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-19d39225-5fac-4683-a026-f2eb7361b526 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] [instance: fd9d52bb-6248-48e6-a798-6dbdaaa68cbc] Deletion of /opt/stack/data/nova/instances/fd9d52bb-6248-48e6-a798-6dbdaaa68cbc_del complete
Nov 15 09:52:06 user nova-compute[75122]: INFO nova.compute.manager [None req-19d39225-5fac-4683-a026-f2eb7361b526 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] [instance: fd9d52bb-6248-48e6-a798-6dbdaaa68cbc] Took 0.68 seconds to destroy the instance on the hypervisor.
Nov 15 09:52:06 user nova-compute[75122]: DEBUG oslo.service.loopingcall [None req-19d39225-5fac-4683-a026-f2eb7361b526 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75122) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 09:52:06 user nova-compute[75122]: DEBUG nova.compute.manager [-] [instance: fd9d52bb-6248-48e6-a798-6dbdaaa68cbc] Deallocating network for instance {{(pid=75122) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 09:52:06 user nova-compute[75122]: DEBUG nova.network.neutron [-] [instance: fd9d52bb-6248-48e6-a798-6dbdaaa68cbc] deallocate_for_instance() {{(pid=75122) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 09:52:07 user nova-compute[75122]: DEBUG nova.network.neutron [-] [instance: fd9d52bb-6248-48e6-a798-6dbdaaa68cbc] Updating instance_info_cache with network_info: [] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:52:07 user nova-compute[75122]: INFO nova.compute.manager [-] [instance: fd9d52bb-6248-48e6-a798-6dbdaaa68cbc] Took 0.54 seconds to deallocate network for instance.
Nov 15 09:52:07 user nova-compute[75122]: DEBUG nova.compute.manager [req-e5ee4ed6-ca14-46f3-b33f-0d3ee258a73a req-d928314c-271c-4fd3-862b-99b43ef4cc22 service nova] [instance: fd9d52bb-6248-48e6-a798-6dbdaaa68cbc] Received event network-vif-deleted-f6892701-aba2-4c9a-88bd-996d00963301 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:52:07 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-19d39225-5fac-4683-a026-f2eb7361b526 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:52:07 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-19d39225-5fac-4683-a026-f2eb7361b526 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:52:07 user nova-compute[75122]: DEBUG nova.compute.provider_tree [None req-19d39225-5fac-4683-a026-f2eb7361b526 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Inventory has not changed in ProviderTree for provider: 69a3da65-47be-44c6-b67c-c692b58284ef {{(pid=75122) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 09:52:07 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-19d39225-5fac-4683-a026-f2eb7361b526 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Inventory has not changed for provider 69a3da65-47be-44c6-b67c-c692b58284ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 09:52:07 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-19d39225-5fac-4683-a026-f2eb7361b526 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.183s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:52:07 user nova-compute[75122]: INFO nova.scheduler.client.report [None req-19d39225-5fac-4683-a026-f2eb7361b526 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Deleted allocations for instance fd9d52bb-6248-48e6-a798-6dbdaaa68cbc
Nov 15 09:52:07 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-19d39225-5fac-4683-a026-f2eb7361b526 tempest-ServerRescueNegativeTestJSON-59965354 tempest-ServerRescueNegativeTestJSON-59965354-project-member] Lock "fd9d52bb-6248-48e6-a798-6dbdaaa68cbc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.590s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:52:08 user nova-compute[75122]: DEBUG nova.compute.manager [req-b29d40cc-ec2b-4679-9c13-90324e891e9e req-d45ffd48-3552-45dd-a75e-6e0aea092038 service nova] [instance: fd9d52bb-6248-48e6-a798-6dbdaaa68cbc] Received event network-vif-plugged-f6892701-aba2-4c9a-88bd-996d00963301 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:52:08 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-b29d40cc-ec2b-4679-9c13-90324e891e9e req-d45ffd48-3552-45dd-a75e-6e0aea092038 service nova] Acquiring lock "fd9d52bb-6248-48e6-a798-6dbdaaa68cbc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:52:08 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-b29d40cc-ec2b-4679-9c13-90324e891e9e req-d45ffd48-3552-45dd-a75e-6e0aea092038 service nova] Lock "fd9d52bb-6248-48e6-a798-6dbdaaa68cbc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:52:08 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-b29d40cc-ec2b-4679-9c13-90324e891e9e req-d45ffd48-3552-45dd-a75e-6e0aea092038 service nova] Lock "fd9d52bb-6248-48e6-a798-6dbdaaa68cbc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:52:08 user nova-compute[75122]: DEBUG nova.compute.manager [req-b29d40cc-ec2b-4679-9c13-90324e891e9e req-d45ffd48-3552-45dd-a75e-6e0aea092038 service nova] [instance: fd9d52bb-6248-48e6-a798-6dbdaaa68cbc] No waiting events found dispatching network-vif-plugged-f6892701-aba2-4c9a-88bd-996d00963301 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:52:08 user nova-compute[75122]: WARNING nova.compute.manager [req-b29d40cc-ec2b-4679-9c13-90324e891e9e req-d45ffd48-3552-45dd-a75e-6e0aea092038 service nova] [instance: fd9d52bb-6248-48e6-a798-6dbdaaa68cbc] Received unexpected event network-vif-plugged-f6892701-aba2-4c9a-88bd-996d00963301 for instance with vm_state deleted and task_state None.
Nov 15 09:52:11 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:52:11 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:52:13 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:52:16 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:52:16 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:52:16 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:52:18 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:52:21 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:52:21 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:52:21 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-dcb271aa-c44a-457c-9cca-061b4ec957c9 tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] Acquiring lock "718ca25b-c73d-4853-b674-fdaf3ed465c7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:52:21 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-dcb271aa-c44a-457c-9cca-061b4ec957c9 tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] Lock "718ca25b-c73d-4853-b674-fdaf3ed465c7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:52:21 user nova-compute[75122]: DEBUG nova.compute.manager [None req-dcb271aa-c44a-457c-9cca-061b4ec957c9 tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] [instance: 718ca25b-c73d-4853-b674-fdaf3ed465c7] Starting instance... {{(pid=75122) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 09:52:22 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-dcb271aa-c44a-457c-9cca-061b4ec957c9 tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:52:22 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-dcb271aa-c44a-457c-9cca-061b4ec957c9 tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:52:22 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-dcb271aa-c44a-457c-9cca-061b4ec957c9 tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75122) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 09:52:22 user nova-compute[75122]: INFO nova.compute.claims [None req-dcb271aa-c44a-457c-9cca-061b4ec957c9 tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] [instance: 718ca25b-c73d-4853-b674-fdaf3ed465c7] Claim successful on node user
Nov 15 09:52:22 user nova-compute[75122]: DEBUG nova.compute.provider_tree [None req-dcb271aa-c44a-457c-9cca-061b4ec957c9 tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] Inventory has not changed in ProviderTree for provider: 69a3da65-47be-44c6-b67c-c692b58284ef {{(pid=75122) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 09:52:22 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-dcb271aa-c44a-457c-9cca-061b4ec957c9 tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] Inventory has not changed for provider 69a3da65-47be-44c6-b67c-c692b58284ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 09:52:22 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-dcb271aa-c44a-457c-9cca-061b4ec957c9 tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.234s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:52:22 user nova-compute[75122]: DEBUG nova.compute.manager [None req-dcb271aa-c44a-457c-9cca-061b4ec957c9 tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] [instance: 718ca25b-c73d-4853-b674-fdaf3ed465c7] Start building networks asynchronously for instance. {{(pid=75122) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 09:52:22 user nova-compute[75122]: DEBUG nova.compute.manager [None req-dcb271aa-c44a-457c-9cca-061b4ec957c9 tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] [instance: 718ca25b-c73d-4853-b674-fdaf3ed465c7] Allocating IP information in the background. {{(pid=75122) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 09:52:22 user nova-compute[75122]: DEBUG nova.network.neutron [None req-dcb271aa-c44a-457c-9cca-061b4ec957c9 tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] [instance: 718ca25b-c73d-4853-b674-fdaf3ed465c7] allocate_for_instance() {{(pid=75122) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 09:52:22 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-dcb271aa-c44a-457c-9cca-061b4ec957c9 tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] [instance: 718ca25b-c73d-4853-b674-fdaf3ed465c7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 09:52:22 user nova-compute[75122]: DEBUG nova.compute.manager [None req-dcb271aa-c44a-457c-9cca-061b4ec957c9 tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] [instance: 718ca25b-c73d-4853-b674-fdaf3ed465c7] Start building block device mappings for instance. {{(pid=75122) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 09:52:22 user nova-compute[75122]: DEBUG nova.policy [None req-dcb271aa-c44a-457c-9cca-061b4ec957c9 tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '47df8a0972f24edcb3a59f2abb6a90d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '348514cfec2145f59bc0a7368b9557f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75122) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 09:52:22 user nova-compute[75122]: DEBUG nova.compute.manager [None req-dcb271aa-c44a-457c-9cca-061b4ec957c9 tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] [instance: 718ca25b-c73d-4853-b674-fdaf3ed465c7] Start spawning the instance on the hypervisor. {{(pid=75122) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 09:52:22 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-dcb271aa-c44a-457c-9cca-061b4ec957c9 tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] [instance: 718ca25b-c73d-4853-b674-fdaf3ed465c7] Creating instance directory {{(pid=75122) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 09:52:22 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-dcb271aa-c44a-457c-9cca-061b4ec957c9 tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] [instance: 718ca25b-c73d-4853-b674-fdaf3ed465c7] Creating image(s)
Nov 15 09:52:22 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-dcb271aa-c44a-457c-9cca-061b4ec957c9 tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] Acquiring lock "/opt/stack/data/nova/instances/718ca25b-c73d-4853-b674-fdaf3ed465c7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:52:22 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-dcb271aa-c44a-457c-9cca-061b4ec957c9 tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] Lock "/opt/stack/data/nova/instances/718ca25b-c73d-4853-b674-fdaf3ed465c7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:52:22 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-dcb271aa-c44a-457c-9cca-061b4ec957c9 tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] Lock "/opt/stack/data/nova/instances/718ca25b-c73d-4853-b674-fdaf3ed465c7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:52:22 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-dcb271aa-c44a-457c-9cca-061b4ec957c9 tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:52:22 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-dcb271aa-c44a-457c-9cca-061b4ec957c9 tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json" returned: 0 in 0.184s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:52:22 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-dcb271aa-c44a-457c-9cca-061b4ec957c9 tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] Acquiring lock "95d6e29f74d5408f818e32f3bc29bc8270a4c665" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:52:22 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-dcb271aa-c44a-457c-9cca-061b4ec957c9 tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] Lock "95d6e29f74d5408f818e32f3bc29bc8270a4c665" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:52:22 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-dcb271aa-c44a-457c-9cca-061b4ec957c9 tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:52:22 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-dcb271aa-c44a-457c-9cca-061b4ec957c9 tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json" returned: 0 in 0.175s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:52:22 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-dcb271aa-c44a-457c-9cca-061b4ec957c9 tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665,backing_fmt=raw /opt/stack/data/nova/instances/718ca25b-c73d-4853-b674-fdaf3ed465c7/disk 1073741824 {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:52:22 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-dcb271aa-c44a-457c-9cca-061b4ec957c9 tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665,backing_fmt=raw /opt/stack/data/nova/instances/718ca25b-c73d-4853-b674-fdaf3ed465c7/disk 1073741824" returned: 0 in 0.045s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:52:22 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-dcb271aa-c44a-457c-9cca-061b4ec957c9 tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] Lock "95d6e29f74d5408f818e32f3bc29bc8270a4c665" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.228s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:52:22 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-dcb271aa-c44a-457c-9cca-061b4ec957c9 tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:52:23 user nova-compute[75122]: DEBUG nova.network.neutron [None req-dcb271aa-c44a-457c-9cca-061b4ec957c9 tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] [instance: 718ca25b-c73d-4853-b674-fdaf3ed465c7] Successfully created port: 8691c10b-6a01-4e1f-884e-0aa0a4bd39c2 {{(pid=75122) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 09:52:23 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-dcb271aa-c44a-457c-9cca-061b4ec957c9 tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json" returned: 0 in 0.195s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:52:23 user nova-compute[75122]: DEBUG nova.virt.disk.api [None req-dcb271aa-c44a-457c-9cca-061b4ec957c9 tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] Checking if we can resize image /opt/stack/data/nova/instances/718ca25b-c73d-4853-b674-fdaf3ed465c7/disk. size=1073741824 {{(pid=75122) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 09:52:23 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-dcb271aa-c44a-457c-9cca-061b4ec957c9 tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/718ca25b-c73d-4853-b674-fdaf3ed465c7/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:52:23 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-dcb271aa-c44a-457c-9cca-061b4ec957c9 tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/718ca25b-c73d-4853-b674-fdaf3ed465c7/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:52:23 user nova-compute[75122]: DEBUG nova.virt.disk.api [None req-dcb271aa-c44a-457c-9cca-061b4ec957c9 tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] Cannot resize image /opt/stack/data/nova/instances/718ca25b-c73d-4853-b674-fdaf3ed465c7/disk to a smaller size. {{(pid=75122) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 09:52:23 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-dcb271aa-c44a-457c-9cca-061b4ec957c9 tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] [instance: 718ca25b-c73d-4853-b674-fdaf3ed465c7] Created local disks {{(pid=75122) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 09:52:23 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-dcb271aa-c44a-457c-9cca-061b4ec957c9 tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] [instance: 718ca25b-c73d-4853-b674-fdaf3ed465c7] Ensure instance console log exists: /opt/stack/data/nova/instances/718ca25b-c73d-4853-b674-fdaf3ed465c7/console.log {{(pid=75122) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 09:52:23 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-dcb271aa-c44a-457c-9cca-061b4ec957c9 tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:52:23 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-dcb271aa-c44a-457c-9cca-061b4ec957c9 tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:52:23 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-dcb271aa-c44a-457c-9cca-061b4ec957c9 tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:52:24 user nova-compute[75122]: DEBUG nova.compute.manager [req-9c509b75-2f66-471b-82df-cadbf0f3492f req-c3e59402-098a-49f2-a27a-e4441adb0f0a service nova] [instance: 40f792bb-43a9-4011-aaba-f240f64e2757] Received event network-changed-da514680-136e-49d6-aec0-9d4192081cec {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:52:24 user nova-compute[75122]: DEBUG nova.compute.manager [req-9c509b75-2f66-471b-82df-cadbf0f3492f req-c3e59402-098a-49f2-a27a-e4441adb0f0a service nova] [instance: 40f792bb-43a9-4011-aaba-f240f64e2757] Refreshing instance network info cache due to event network-changed-da514680-136e-49d6-aec0-9d4192081cec. {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 09:52:24 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-9c509b75-2f66-471b-82df-cadbf0f3492f req-c3e59402-098a-49f2-a27a-e4441adb0f0a service nova] Acquiring lock "refresh_cache-40f792bb-43a9-4011-aaba-f240f64e2757" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 09:52:24 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-9c509b75-2f66-471b-82df-cadbf0f3492f req-c3e59402-098a-49f2-a27a-e4441adb0f0a service nova] Acquired lock "refresh_cache-40f792bb-43a9-4011-aaba-f240f64e2757" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 09:52:24 user nova-compute[75122]: DEBUG nova.network.neutron [req-9c509b75-2f66-471b-82df-cadbf0f3492f req-c3e59402-098a-49f2-a27a-e4441adb0f0a service nova] [instance: 40f792bb-43a9-4011-aaba-f240f64e2757] Refreshing network info cache for port da514680-136e-49d6-aec0-9d4192081cec {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 09:52:24 user nova-compute[75122]: DEBUG nova.network.neutron [None req-dcb271aa-c44a-457c-9cca-061b4ec957c9 tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] [instance: 718ca25b-c73d-4853-b674-fdaf3ed465c7] Successfully updated port: 8691c10b-6a01-4e1f-884e-0aa0a4bd39c2 {{(pid=75122) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 09:52:24 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-dcb271aa-c44a-457c-9cca-061b4ec957c9 tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] Acquiring lock "refresh_cache-718ca25b-c73d-4853-b674-fdaf3ed465c7" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 09:52:24 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-dcb271aa-c44a-457c-9cca-061b4ec957c9 tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] Acquired lock "refresh_cache-718ca25b-c73d-4853-b674-fdaf3ed465c7" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 09:52:24 user nova-compute[75122]: DEBUG nova.network.neutron [None req-dcb271aa-c44a-457c-9cca-061b4ec957c9 tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] [instance: 718ca25b-c73d-4853-b674-fdaf3ed465c7] Building network info cache for instance {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 09:52:24 user nova-compute[75122]: DEBUG nova.network.neutron [None req-dcb271aa-c44a-457c-9cca-061b4ec957c9 tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] [instance: 718ca25b-c73d-4853-b674-fdaf3ed465c7] Instance cache missing network info. {{(pid=75122) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 09:52:24 user nova-compute[75122]: DEBUG nova.network.neutron [None req-dcb271aa-c44a-457c-9cca-061b4ec957c9 tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] [instance: 718ca25b-c73d-4853-b674-fdaf3ed465c7] Updating instance_info_cache with network_info: [{"id": "8691c10b-6a01-4e1f-884e-0aa0a4bd39c2", "address": "fa:16:3e:2a:93:fb", "network": {"id": "0e218464-b514-477f-8f50-93252bee51e8", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-575730542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "348514cfec2145f59bc0a7368b9557f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8691c10b-6a", "ovs_interfaceid": "8691c10b-6a01-4e1f-884e-0aa0a4bd39c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:52:24 user nova-compute[75122]: DEBUG nova.network.neutron [req-9c509b75-2f66-471b-82df-cadbf0f3492f req-c3e59402-098a-49f2-a27a-e4441adb0f0a service nova] [instance: 40f792bb-43a9-4011-aaba-f240f64e2757] Updated VIF entry in instance network info cache for port da514680-136e-49d6-aec0-9d4192081cec. {{(pid=75122) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 09:52:24 user nova-compute[75122]: DEBUG nova.network.neutron [req-9c509b75-2f66-471b-82df-cadbf0f3492f req-c3e59402-098a-49f2-a27a-e4441adb0f0a service nova] [instance: 40f792bb-43a9-4011-aaba-f240f64e2757] Updating instance_info_cache with network_info: [{"id": "da514680-136e-49d6-aec0-9d4192081cec", "address": "fa:16:3e:b0:8a:af", "network": {"id": "7ab99c1b-e670-416e-b5fe-e1337db6b28d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-487518933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "535c751b9e76421c9262e48fbab3fb6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda514680-13", "ovs_interfaceid": "da514680-136e-49d6-aec0-9d4192081cec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:52:24 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-dcb271aa-c44a-457c-9cca-061b4ec957c9 tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] Releasing lock "refresh_cache-718ca25b-c73d-4853-b674-fdaf3ed465c7" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 09:52:24 user nova-compute[75122]: DEBUG nova.compute.manager [None req-dcb271aa-c44a-457c-9cca-061b4ec957c9 tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] [instance: 718ca25b-c73d-4853-b674-fdaf3ed465c7] Instance network_info: |[{"id": "8691c10b-6a01-4e1f-884e-0aa0a4bd39c2", "address": "fa:16:3e:2a:93:fb", "network": {"id": "0e218464-b514-477f-8f50-93252bee51e8", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-575730542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "348514cfec2145f59bc0a7368b9557f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8691c10b-6a", "ovs_interfaceid": "8691c10b-6a01-4e1f-884e-0aa0a4bd39c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75122) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 09:52:24 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-dcb271aa-c44a-457c-9cca-061b4ec957c9 tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] [instance: 718ca25b-c73d-4853-b674-fdaf3ed465c7] Start _get_guest_xml network_info=[{"id": "8691c10b-6a01-4e1f-884e-0aa0a4bd39c2", "address": "fa:16:3e:2a:93:fb", "network": {"id": "0e218464-b514-477f-8f50-93252bee51e8", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-575730542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "348514cfec2145f59bc0a7368b9557f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8691c10b-6a", "ovs_interfaceid": "8691c10b-6a01-4e1f-884e-0aa0a4bd39c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T09:26:31Z,direct_url=<?>,disk_format='qcow2',id=5e862cfe-47b8-4725-8292-65761ee6d0f5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9c57733cb41847c0b4ad31519c382e5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T09:26:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '5e862cfe-47b8-4725-8292-65761ee6d0f5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75122) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 09:52:24 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-dcb271aa-c44a-457c-9cca-061b4ec957c9 tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 09:52:24 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-dcb271aa-c44a-457c-9cca-061b4ec957c9 tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 09:52:24 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-9c509b75-2f66-471b-82df-cadbf0f3492f req-c3e59402-098a-49f2-a27a-e4441adb0f0a service nova] Releasing lock "refresh_cache-40f792bb-43a9-4011-aaba-f240f64e2757" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 09:52:24 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-dcb271aa-c44a-457c-9cca-061b4ec957c9 tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75122) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 09:52:24 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-dcb271aa-c44a-457c-9cca-061b4ec957c9 tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] CPU controller missing on host. {{(pid=75122) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 09:52:24 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-dcb271aa-c44a-457c-9cca-061b4ec957c9 tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75122) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 09:52:24 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-dcb271aa-c44a-457c-9cca-061b4ec957c9 tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] CPU controller found on host. {{(pid=75122) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 09:52:24 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-dcb271aa-c44a-457c-9cca-061b4ec957c9 tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75122) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 09:52:24 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-dcb271aa-c44a-457c-9cca-061b4ec957c9 tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T09:26:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T09:26:31Z,direct_url=<?>,disk_format='qcow2',id=5e862cfe-47b8-4725-8292-65761ee6d0f5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9c57733cb41847c0b4ad31519c382e5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T09:26:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 09:52:24 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-dcb271aa-c44a-457c-9cca-061b4ec957c9 tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] Flavor limits 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 09:52:24 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-dcb271aa-c44a-457c-9cca-061b4ec957c9 tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] Image limits 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 09:52:24 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-dcb271aa-c44a-457c-9cca-061b4ec957c9 tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] Flavor pref 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 09:52:24 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-dcb271aa-c44a-457c-9cca-061b4ec957c9 tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] Image pref 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 09:52:24 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-dcb271aa-c44a-457c-9cca-061b4ec957c9 tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 09:52:24 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-dcb271aa-c44a-457c-9cca-061b4ec957c9 tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 09:52:24 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-dcb271aa-c44a-457c-9cca-061b4ec957c9 tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75122) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 09:52:24 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-dcb271aa-c44a-457c-9cca-061b4ec957c9 tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] Got 1 possible topologies {{(pid=75122) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 09:52:24 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-dcb271aa-c44a-457c-9cca-061b4ec957c9 tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 09:52:24 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-dcb271aa-c44a-457c-9cca-061b4ec957c9 tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 09:52:24 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-dcb271aa-c44a-457c-9cca-061b4ec957c9 tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T09:52:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1329324950',display_name='tempest-TestServerVolumeAttachmentScenario-server-1329324950',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1329324950',id=37,image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOMvGPj8euUTX1Sv5k4CFHUFpZRGqcMBY8TAr4b1+Sc+Lbt/Ga07Rc51kPkPpTBha7OVuAIyEQkvzu6UsjcJgmFKfAkmdnz6WfC6hlKTHamzdTU1EkQi2CImOT6kjczOvg==',key_name='tempest-keypair-352398611',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='348514cfec2145f59bc0a7368b9557f8',ramdisk_id='',reservation_id='r-54an7c0g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1023757833',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1023757833-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T09:52:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='47df8a0972f24edcb3a59f2abb6a90d4',uuid=718ca25b-c73d-4853-b674-fdaf3ed465c7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8691c10b-6a01-4e1f-884e-0aa0a4bd39c2", "address": "fa:16:3e:2a:93:fb", "network": {"id": "0e218464-b514-477f-8f50-93252bee51e8", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-575730542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "348514cfec2145f59bc0a7368b9557f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8691c10b-6a", "ovs_interfaceid": "8691c10b-6a01-4e1f-884e-0aa0a4bd39c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75122) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 09:52:24 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-dcb271aa-c44a-457c-9cca-061b4ec957c9 tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] Converting VIF {"id": "8691c10b-6a01-4e1f-884e-0aa0a4bd39c2", "address": "fa:16:3e:2a:93:fb", "network": {"id": "0e218464-b514-477f-8f50-93252bee51e8", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-575730542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "348514cfec2145f59bc0a7368b9557f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8691c10b-6a", "ovs_interfaceid": "8691c10b-6a01-4e1f-884e-0aa0a4bd39c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 09:52:24 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-dcb271aa-c44a-457c-9cca-061b4ec957c9 tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2a:93:fb,bridge_name='br-int',has_traffic_filtering=True,id=8691c10b-6a01-4e1f-884e-0aa0a4bd39c2,network=Network(0e218464-b514-477f-8f50-93252bee51e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8691c10b-6a') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 09:52:24 user nova-compute[75122]: DEBUG nova.objects.instance [None req-dcb271aa-c44a-457c-9cca-061b4ec957c9 tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] Lazy-loading 'pci_devices' on Instance uuid 718ca25b-c73d-4853-b674-fdaf3ed465c7 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:52:24 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-dcb271aa-c44a-457c-9cca-061b4ec957c9 tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] [instance: 718ca25b-c73d-4853-b674-fdaf3ed465c7] End _get_guest_xml xml=<domain type="kvm">
Nov 15 09:52:24 user nova-compute[75122]:   <uuid>718ca25b-c73d-4853-b674-fdaf3ed465c7</uuid>
Nov 15 09:52:24 user nova-compute[75122]:   <name>instance-00000025</name>
Nov 15 09:52:24 user nova-compute[75122]:   <memory>524288</memory>
Nov 15 09:52:24 user nova-compute[75122]:   <vcpu>1</vcpu>
Nov 15 09:52:24 user nova-compute[75122]:   <metadata>
Nov 15 09:52:24 user nova-compute[75122]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 09:52:24 user nova-compute[75122]:       <nova:package version="0.0.0"/>
Nov 15 09:52:24 user nova-compute[75122]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-1329324950</nova:name>
Nov 15 09:52:24 user nova-compute[75122]:       <nova:creationTime>2023-11-15 09:52:24</nova:creationTime>
Nov 15 09:52:24 user nova-compute[75122]:       <nova:flavor name="m1.tiny">
Nov 15 09:52:24 user nova-compute[75122]:         <nova:memory>512</nova:memory>
Nov 15 09:52:24 user nova-compute[75122]:         <nova:disk>1</nova:disk>
Nov 15 09:52:24 user nova-compute[75122]:         <nova:swap>0</nova:swap>
Nov 15 09:52:24 user nova-compute[75122]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 09:52:24 user nova-compute[75122]:         <nova:vcpus>1</nova:vcpus>
Nov 15 09:52:24 user nova-compute[75122]:       </nova:flavor>
Nov 15 09:52:24 user nova-compute[75122]:       <nova:owner>
Nov 15 09:52:24 user nova-compute[75122]:         <nova:user uuid="47df8a0972f24edcb3a59f2abb6a90d4">tempest-TestServerVolumeAttachmentScenario-1023757833-project-member</nova:user>
Nov 15 09:52:24 user nova-compute[75122]:         <nova:project uuid="348514cfec2145f59bc0a7368b9557f8">tempest-TestServerVolumeAttachmentScenario-1023757833</nova:project>
Nov 15 09:52:24 user nova-compute[75122]:       </nova:owner>
Nov 15 09:52:24 user nova-compute[75122]:       <nova:root type="image" uuid="5e862cfe-47b8-4725-8292-65761ee6d0f5"/>
Nov 15 09:52:24 user nova-compute[75122]:       <nova:ports>
Nov 15 09:52:24 user nova-compute[75122]:         <nova:port uuid="8691c10b-6a01-4e1f-884e-0aa0a4bd39c2">
Nov 15 09:52:24 user nova-compute[75122]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 15 09:52:24 user nova-compute[75122]:         </nova:port>
Nov 15 09:52:24 user nova-compute[75122]:       </nova:ports>
Nov 15 09:52:24 user nova-compute[75122]:     </nova:instance>
Nov 15 09:52:24 user nova-compute[75122]:   </metadata>
Nov 15 09:52:24 user nova-compute[75122]:   <sysinfo type="smbios">
Nov 15 09:52:24 user nova-compute[75122]:     <system>
Nov 15 09:52:24 user nova-compute[75122]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 09:52:24 user nova-compute[75122]:       <entry name="product">OpenStack Nova</entry>
Nov 15 09:52:24 user nova-compute[75122]:       <entry name="version">0.0.0</entry>
Nov 15 09:52:24 user nova-compute[75122]:       <entry name="serial">718ca25b-c73d-4853-b674-fdaf3ed465c7</entry>
Nov 15 09:52:24 user nova-compute[75122]:       <entry name="uuid">718ca25b-c73d-4853-b674-fdaf3ed465c7</entry>
Nov 15 09:52:24 user nova-compute[75122]:       <entry name="family">Virtual Machine</entry>
Nov 15 09:52:24 user nova-compute[75122]:     </system>
Nov 15 09:52:24 user nova-compute[75122]:   </sysinfo>
Nov 15 09:52:24 user nova-compute[75122]:   <os>
Nov 15 09:52:24 user nova-compute[75122]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 09:52:24 user nova-compute[75122]:     <boot dev="hd"/>
Nov 15 09:52:24 user nova-compute[75122]:     <smbios mode="sysinfo"/>
Nov 15 09:52:24 user nova-compute[75122]:   </os>
Nov 15 09:52:24 user nova-compute[75122]:   <features>
Nov 15 09:52:24 user nova-compute[75122]:     <acpi/>
Nov 15 09:52:24 user nova-compute[75122]:     <apic/>
Nov 15 09:52:24 user nova-compute[75122]:     <vmcoreinfo/>
Nov 15 09:52:24 user nova-compute[75122]:   </features>
Nov 15 09:52:24 user nova-compute[75122]:   <clock offset="utc">
Nov 15 09:52:24 user nova-compute[75122]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 09:52:24 user nova-compute[75122]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 09:52:24 user nova-compute[75122]:     <timer name="hpet" present="no"/>
Nov 15 09:52:24 user nova-compute[75122]:   </clock>
Nov 15 09:52:24 user nova-compute[75122]:   <cpu mode="custom" match="exact">
Nov 15 09:52:24 user nova-compute[75122]:     <model>Nehalem</model>
Nov 15 09:52:24 user nova-compute[75122]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 09:52:24 user nova-compute[75122]:   </cpu>
Nov 15 09:52:24 user nova-compute[75122]:   <devices>
Nov 15 09:52:24 user nova-compute[75122]:     <disk type="file" device="disk">
Nov 15 09:52:24 user nova-compute[75122]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 09:52:24 user nova-compute[75122]:       <source file="/opt/stack/data/nova/instances/718ca25b-c73d-4853-b674-fdaf3ed465c7/disk"/>
Nov 15 09:52:24 user nova-compute[75122]:       <target dev="vda" bus="virtio"/>
Nov 15 09:52:24 user nova-compute[75122]:     </disk>
Nov 15 09:52:24 user nova-compute[75122]:     <interface type="ethernet">
Nov 15 09:52:24 user nova-compute[75122]:       <mac address="fa:16:3e:2a:93:fb"/>
Nov 15 09:52:24 user nova-compute[75122]:       <model type="virtio"/>
Nov 15 09:52:24 user nova-compute[75122]:       <mtu size="1442"/>
Nov 15 09:52:24 user nova-compute[75122]:       <target dev="tap8691c10b-6a"/>
Nov 15 09:52:24 user nova-compute[75122]:     </interface>
Nov 15 09:52:24 user nova-compute[75122]:     <serial type="pty">
Nov 15 09:52:24 user nova-compute[75122]:       <log file="/opt/stack/data/nova/instances/718ca25b-c73d-4853-b674-fdaf3ed465c7/console.log" append="off"/>
Nov 15 09:52:24 user nova-compute[75122]:     </serial>
Nov 15 09:52:24 user nova-compute[75122]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 09:52:24 user nova-compute[75122]:     <video>
Nov 15 09:52:24 user nova-compute[75122]:       <model type="virtio"/>
Nov 15 09:52:24 user nova-compute[75122]:     </video>
Nov 15 09:52:24 user nova-compute[75122]:     <rng model="virtio">
Nov 15 09:52:24 user nova-compute[75122]:       <backend model="random">/dev/urandom</backend>
Nov 15 09:52:24 user nova-compute[75122]:     </rng>
Nov 15 09:52:24 user nova-compute[75122]:     <controller type="usb" index="0" model="none"/>
Nov 15 09:52:24 user nova-compute[75122]:     <memballoon model="virtio">
Nov 15 09:52:24 user nova-compute[75122]:       <stats period="10"/>
Nov 15 09:52:24 user nova-compute[75122]:     </memballoon>
Nov 15 09:52:24 user nova-compute[75122]:   </devices>
Nov 15 09:52:24 user nova-compute[75122]: </domain>
Nov 15 09:52:24 user nova-compute[75122]:  {{(pid=75122) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 09:52:24 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-dcb271aa-c44a-457c-9cca-061b4ec957c9 tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T09:52:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1329324950',display_name='tempest-TestServerVolumeAttachmentScenario-server-1329324950',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1329324950',id=37,image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOMvGPj8euUTX1Sv5k4CFHUFpZRGqcMBY8TAr4b1+Sc+Lbt/Ga07Rc51kPkPpTBha7OVuAIyEQkvzu6UsjcJgmFKfAkmdnz6WfC6hlKTHamzdTU1EkQi2CImOT6kjczOvg==',key_name='tempest-keypair-352398611',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='348514cfec2145f59bc0a7368b9557f8',ramdisk_id='',reservation_id='r-54an7c0g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1023757833',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1023757833-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T09:52:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='47df8a0972f24edcb3a59f2abb6a90d4',uuid=718ca25b-c73d-4853-b674-fdaf3ed465c7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8691c10b-6a01-4e1f-884e-0aa0a4bd39c2", "address": "fa:16:3e:2a:93:fb", "network": {"id": "0e218464-b514-477f-8f50-93252bee51e8", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-575730542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "348514cfec2145f59bc0a7368b9557f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8691c10b-6a", "ovs_interfaceid": "8691c10b-6a01-4e1f-884e-0aa0a4bd39c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 09:52:24 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-dcb271aa-c44a-457c-9cca-061b4ec957c9 tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] Converting VIF {"id": "8691c10b-6a01-4e1f-884e-0aa0a4bd39c2", "address": "fa:16:3e:2a:93:fb", "network": {"id": "0e218464-b514-477f-8f50-93252bee51e8", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-575730542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "348514cfec2145f59bc0a7368b9557f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8691c10b-6a", "ovs_interfaceid": "8691c10b-6a01-4e1f-884e-0aa0a4bd39c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 09:52:24 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-dcb271aa-c44a-457c-9cca-061b4ec957c9 tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2a:93:fb,bridge_name='br-int',has_traffic_filtering=True,id=8691c10b-6a01-4e1f-884e-0aa0a4bd39c2,network=Network(0e218464-b514-477f-8f50-93252bee51e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8691c10b-6a') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 09:52:24 user nova-compute[75122]: DEBUG os_vif [None req-dcb271aa-c44a-457c-9cca-061b4ec957c9 tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2a:93:fb,bridge_name='br-int',has_traffic_filtering=True,id=8691c10b-6a01-4e1f-884e-0aa0a4bd39c2,network=Network(0e218464-b514-477f-8f50-93252bee51e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8691c10b-6a') {{(pid=75122) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 09:52:24 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:52:24 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:52:24 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 09:52:24 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:52:24 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'dc2af5ae-c8a8-53d4-9e79-5b5ad240a183', '_type': 'linux-noop'}}, row=False) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:52:24 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:52:24 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:52:24 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:52:24 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8691c10b-6a, may_exist=True, interface_attrs={}) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:52:24 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8691c10b-6a, col_values=(('qos', UUID('e7575847-1814-4bb9-87b1-91effa835d52')),), if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:52:24 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8691c10b-6a, col_values=(('external_ids', {'iface-id': '8691c10b-6a01-4e1f-884e-0aa0a4bd39c2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2a:93:fb', 'vm-uuid': '718ca25b-c73d-4853-b674-fdaf3ed465c7'}),), if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:52:24 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:52:24 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:52:24 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:52:24 user nova-compute[75122]: INFO os_vif [None req-dcb271aa-c44a-457c-9cca-061b4ec957c9 tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2a:93:fb,bridge_name='br-int',has_traffic_filtering=True,id=8691c10b-6a01-4e1f-884e-0aa0a4bd39c2,network=Network(0e218464-b514-477f-8f50-93252bee51e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8691c10b-6a')
Nov 15 09:52:24 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-dcb271aa-c44a-457c-9cca-061b4ec957c9 tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] No BDM found with device name vda, not building metadata. {{(pid=75122) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 09:52:24 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-dcb271aa-c44a-457c-9cca-061b4ec957c9 tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] No VIF found with MAC fa:16:3e:2a:93:fb, not building metadata {{(pid=75122) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 09:52:25 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:52:26 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:52:26 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:52:26 user nova-compute[75122]: DEBUG nova.compute.manager [req-face34cb-db07-4ef9-82cf-76d1f457267a req-d532c125-2096-4ebe-b659-7cdc3bf4a2b9 service nova] [instance: 718ca25b-c73d-4853-b674-fdaf3ed465c7] Received event network-changed-8691c10b-6a01-4e1f-884e-0aa0a4bd39c2 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:52:26 user nova-compute[75122]: DEBUG nova.compute.manager [req-face34cb-db07-4ef9-82cf-76d1f457267a req-d532c125-2096-4ebe-b659-7cdc3bf4a2b9 service nova] [instance: 718ca25b-c73d-4853-b674-fdaf3ed465c7] Refreshing instance network info cache due to event network-changed-8691c10b-6a01-4e1f-884e-0aa0a4bd39c2. {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 09:52:26 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-face34cb-db07-4ef9-82cf-76d1f457267a req-d532c125-2096-4ebe-b659-7cdc3bf4a2b9 service nova] Acquiring lock "refresh_cache-718ca25b-c73d-4853-b674-fdaf3ed465c7" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 09:52:26 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-face34cb-db07-4ef9-82cf-76d1f457267a req-d532c125-2096-4ebe-b659-7cdc3bf4a2b9 service nova] Acquired lock "refresh_cache-718ca25b-c73d-4853-b674-fdaf3ed465c7" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 09:52:26 user nova-compute[75122]: DEBUG nova.network.neutron [req-face34cb-db07-4ef9-82cf-76d1f457267a req-d532c125-2096-4ebe-b659-7cdc3bf4a2b9 service nova] [instance: 718ca25b-c73d-4853-b674-fdaf3ed465c7] Refreshing network info cache for port 8691c10b-6a01-4e1f-884e-0aa0a4bd39c2 {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 09:52:26 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:52:26 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:52:26 user nova-compute[75122]: DEBUG nova.network.neutron [req-face34cb-db07-4ef9-82cf-76d1f457267a req-d532c125-2096-4ebe-b659-7cdc3bf4a2b9 service nova] [instance: 718ca25b-c73d-4853-b674-fdaf3ed465c7] Updated VIF entry in instance network info cache for port 8691c10b-6a01-4e1f-884e-0aa0a4bd39c2. {{(pid=75122) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 09:52:26 user nova-compute[75122]: DEBUG nova.network.neutron [req-face34cb-db07-4ef9-82cf-76d1f457267a req-d532c125-2096-4ebe-b659-7cdc3bf4a2b9 service nova] [instance: 718ca25b-c73d-4853-b674-fdaf3ed465c7] Updating instance_info_cache with network_info: [{"id": "8691c10b-6a01-4e1f-884e-0aa0a4bd39c2", "address": "fa:16:3e:2a:93:fb", "network": {"id": "0e218464-b514-477f-8f50-93252bee51e8", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-575730542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "348514cfec2145f59bc0a7368b9557f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8691c10b-6a", "ovs_interfaceid": "8691c10b-6a01-4e1f-884e-0aa0a4bd39c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:52:26 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:52:26 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-face34cb-db07-4ef9-82cf-76d1f457267a req-d532c125-2096-4ebe-b659-7cdc3bf4a2b9 service nova] Releasing lock "refresh_cache-718ca25b-c73d-4853-b674-fdaf3ed465c7" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 09:52:26 user nova-compute[75122]: DEBUG nova.compute.manager [req-face34cb-db07-4ef9-82cf-76d1f457267a req-d532c125-2096-4ebe-b659-7cdc3bf4a2b9 service nova] [instance: 718ca25b-c73d-4853-b674-fdaf3ed465c7] Received event network-vif-plugged-8691c10b-6a01-4e1f-884e-0aa0a4bd39c2 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:52:26 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-face34cb-db07-4ef9-82cf-76d1f457267a req-d532c125-2096-4ebe-b659-7cdc3bf4a2b9 service nova] Acquiring lock "718ca25b-c73d-4853-b674-fdaf3ed465c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:52:26 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-face34cb-db07-4ef9-82cf-76d1f457267a req-d532c125-2096-4ebe-b659-7cdc3bf4a2b9 service nova] Lock "718ca25b-c73d-4853-b674-fdaf3ed465c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:52:26 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-face34cb-db07-4ef9-82cf-76d1f457267a req-d532c125-2096-4ebe-b659-7cdc3bf4a2b9 service nova] Lock "718ca25b-c73d-4853-b674-fdaf3ed465c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:52:26 user nova-compute[75122]: DEBUG nova.compute.manager [req-face34cb-db07-4ef9-82cf-76d1f457267a req-d532c125-2096-4ebe-b659-7cdc3bf4a2b9 service nova] [instance: 718ca25b-c73d-4853-b674-fdaf3ed465c7] No waiting events found dispatching network-vif-plugged-8691c10b-6a01-4e1f-884e-0aa0a4bd39c2 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:52:26 user nova-compute[75122]: WARNING nova.compute.manager [req-face34cb-db07-4ef9-82cf-76d1f457267a req-d532c125-2096-4ebe-b659-7cdc3bf4a2b9 service nova] [instance: 718ca25b-c73d-4853-b674-fdaf3ed465c7] Received unexpected event network-vif-plugged-8691c10b-6a01-4e1f-884e-0aa0a4bd39c2 for instance with vm_state building and task_state spawning.
Nov 15 09:52:28 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-9e5444a1-0e40-4a1b-b54c-0d1b1fc89f4f tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Acquiring lock "40f792bb-43a9-4011-aaba-f240f64e2757" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:52:28 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-9e5444a1-0e40-4a1b-b54c-0d1b1fc89f4f tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Lock "40f792bb-43a9-4011-aaba-f240f64e2757" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:52:28 user nova-compute[75122]: INFO nova.compute.manager [None req-9e5444a1-0e40-4a1b-b54c-0d1b1fc89f4f tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] [instance: 40f792bb-43a9-4011-aaba-f240f64e2757] Shelving
Nov 15 09:52:28 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:52:28 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:52:28 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:52:28 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:52:28 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:52:28 user nova-compute[75122]: DEBUG nova.compute.manager [None req-dcb271aa-c44a-457c-9cca-061b4ec957c9 tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] [instance: 718ca25b-c73d-4853-b674-fdaf3ed465c7] Instance event wait completed in 0 seconds for  {{(pid=75122) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 09:52:28 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-dcb271aa-c44a-457c-9cca-061b4ec957c9 tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] [instance: 718ca25b-c73d-4853-b674-fdaf3ed465c7] Guest created on hypervisor {{(pid=75122) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 09:52:28 user nova-compute[75122]: INFO nova.virt.libvirt.driver [-] [instance: 718ca25b-c73d-4853-b674-fdaf3ed465c7] Instance spawned successfully.
Nov 15 09:52:28 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-dcb271aa-c44a-457c-9cca-061b4ec957c9 tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] [instance: 718ca25b-c73d-4853-b674-fdaf3ed465c7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 09:52:28 user nova-compute[75122]: DEBUG nova.compute.manager [req-6df4608b-4979-4b84-a2ec-14c5bc09fbda req-93e81d52-dc2b-4702-adb1-965911d36c0a service nova] [instance: 718ca25b-c73d-4853-b674-fdaf3ed465c7] Received event network-vif-plugged-8691c10b-6a01-4e1f-884e-0aa0a4bd39c2 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:52:28 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-6df4608b-4979-4b84-a2ec-14c5bc09fbda req-93e81d52-dc2b-4702-adb1-965911d36c0a service nova] Acquiring lock "718ca25b-c73d-4853-b674-fdaf3ed465c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:52:28 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-6df4608b-4979-4b84-a2ec-14c5bc09fbda req-93e81d52-dc2b-4702-adb1-965911d36c0a service nova] Lock "718ca25b-c73d-4853-b674-fdaf3ed465c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:52:28 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-6df4608b-4979-4b84-a2ec-14c5bc09fbda req-93e81d52-dc2b-4702-adb1-965911d36c0a service nova] Lock "718ca25b-c73d-4853-b674-fdaf3ed465c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:52:28 user nova-compute[75122]: DEBUG nova.compute.manager [req-6df4608b-4979-4b84-a2ec-14c5bc09fbda req-93e81d52-dc2b-4702-adb1-965911d36c0a service nova] [instance: 718ca25b-c73d-4853-b674-fdaf3ed465c7] No waiting events found dispatching network-vif-plugged-8691c10b-6a01-4e1f-884e-0aa0a4bd39c2 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:52:28 user nova-compute[75122]: WARNING nova.compute.manager [req-6df4608b-4979-4b84-a2ec-14c5bc09fbda req-93e81d52-dc2b-4702-adb1-965911d36c0a service nova] [instance: 718ca25b-c73d-4853-b674-fdaf3ed465c7] Received unexpected event network-vif-plugged-8691c10b-6a01-4e1f-884e-0aa0a4bd39c2 for instance with vm_state building and task_state spawning.
Nov 15 09:52:28 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-dcb271aa-c44a-457c-9cca-061b4ec957c9 tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] [instance: 718ca25b-c73d-4853-b674-fdaf3ed465c7] Found default for hw_cdrom_bus of ide {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:52:28 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-dcb271aa-c44a-457c-9cca-061b4ec957c9 tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] [instance: 718ca25b-c73d-4853-b674-fdaf3ed465c7] Found default for hw_disk_bus of virtio {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:52:28 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-dcb271aa-c44a-457c-9cca-061b4ec957c9 tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] [instance: 718ca25b-c73d-4853-b674-fdaf3ed465c7] Found default for hw_input_bus of None {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:52:28 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-dcb271aa-c44a-457c-9cca-061b4ec957c9 tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] [instance: 718ca25b-c73d-4853-b674-fdaf3ed465c7] Found default for hw_pointer_model of None {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:52:28 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-dcb271aa-c44a-457c-9cca-061b4ec957c9 tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] [instance: 718ca25b-c73d-4853-b674-fdaf3ed465c7] Found default for hw_video_model of virtio {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:52:28 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-dcb271aa-c44a-457c-9cca-061b4ec957c9 tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] [instance: 718ca25b-c73d-4853-b674-fdaf3ed465c7] Found default for hw_vif_model of virtio {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:52:28 user nova-compute[75122]: INFO nova.compute.manager [None req-dcb271aa-c44a-457c-9cca-061b4ec957c9 tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] [instance: 718ca25b-c73d-4853-b674-fdaf3ed465c7] Took 5.92 seconds to spawn the instance on the hypervisor.
Nov 15 09:52:28 user nova-compute[75122]: DEBUG nova.compute.manager [None req-dcb271aa-c44a-457c-9cca-061b4ec957c9 tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] [instance: 718ca25b-c73d-4853-b674-fdaf3ed465c7] Checking state {{(pid=75122) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 09:52:28 user nova-compute[75122]: INFO nova.compute.manager [None req-dcb271aa-c44a-457c-9cca-061b4ec957c9 tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] [instance: 718ca25b-c73d-4853-b674-fdaf3ed465c7] Took 6.46 seconds to build instance.
Nov 15 09:52:28 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-dcb271aa-c44a-457c-9cca-061b4ec957c9 tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] Lock "718ca25b-c73d-4853-b674-fdaf3ed465c7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.606s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:52:28 user nova-compute[75122]: INFO nova.virt.libvirt.driver [-] [instance: 40f792bb-43a9-4011-aaba-f240f64e2757] Instance destroyed successfully.
Nov 15 09:52:28 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-9e5444a1-0e40-4a1b-b54c-0d1b1fc89f4f tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] [instance: 40f792bb-43a9-4011-aaba-f240f64e2757] Beginning cold snapshot process
Nov 15 09:52:28 user nova-compute[75122]: DEBUG nova.privsep.utils [None req-9e5444a1-0e40-4a1b-b54c-0d1b1fc89f4f tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75122) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 09:52:28 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-9e5444a1-0e40-4a1b-b54c-0d1b1fc89f4f tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/40f792bb-43a9-4011-aaba-f240f64e2757/disk /opt/stack/data/nova/instances/snapshots/tmpg_xtsvek/9516958390b4460a8c4e87c4046ebad3 {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:52:29 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:52:29 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Starting heal instance info cache {{(pid=75122) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 09:52:29 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Rebuilding the list of instances to heal {{(pid=75122) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 09:52:29 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "refresh_cache-001d589e-1bee-42da-8422-233ba796fbab" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 09:52:29 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquired lock "refresh_cache-001d589e-1bee-42da-8422-233ba796fbab" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 09:52:29 user nova-compute[75122]: DEBUG nova.network.neutron [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] [instance: 001d589e-1bee-42da-8422-233ba796fbab] Forcefully refreshing network info cache for instance {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 09:52:29 user nova-compute[75122]: DEBUG nova.objects.instance [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lazy-loading 'info_cache' on Instance uuid 001d589e-1bee-42da-8422-233ba796fbab {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:52:29 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-9e5444a1-0e40-4a1b-b54c-0d1b1fc89f4f tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/40f792bb-43a9-4011-aaba-f240f64e2757/disk /opt/stack/data/nova/instances/snapshots/tmpg_xtsvek/9516958390b4460a8c4e87c4046ebad3" returned: 0 in 0.643s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:52:29 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-9e5444a1-0e40-4a1b-b54c-0d1b1fc89f4f tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] [instance: 40f792bb-43a9-4011-aaba-f240f64e2757] Snapshot extracted, beginning image upload
Nov 15 09:52:29 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:52:29 user nova-compute[75122]: DEBUG nova.network.neutron [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] [instance: 001d589e-1bee-42da-8422-233ba796fbab] Updating instance_info_cache with network_info: [{"id": "6a77f68d-d3da-47c6-a3de-09bd69399762", "address": "fa:16:3e:87:a0:de", "network": {"id": "b780d5c1-a549-4b49-a036-5a272697d4b6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-229344021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c046170a2ad44ebba5d2de236d940be0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a77f68d-d3", "ovs_interfaceid": "6a77f68d-d3da-47c6-a3de-09bd69399762", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:52:29 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Releasing lock "refresh_cache-001d589e-1bee-42da-8422-233ba796fbab" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 09:52:29 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] [instance: 001d589e-1bee-42da-8422-233ba796fbab] Updated the network info_cache for instance {{(pid=75122) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 09:52:29 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:52:29 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:52:29 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:52:29 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:52:29 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:52:29 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75122) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 09:52:30 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40f792bb-43a9-4011-aaba-f240f64e2757/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:52:30 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40f792bb-43a9-4011-aaba-f240f64e2757/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:52:30 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40f792bb-43a9-4011-aaba-f240f64e2757/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:52:30 user nova-compute[75122]: DEBUG nova.compute.manager [req-bd6f9658-6b33-4dfb-ae7f-6e58ac7cc759 req-d8232ec6-7206-4c0d-b1ba-0bce5d37a03f service nova] [instance: 40f792bb-43a9-4011-aaba-f240f64e2757] Received event network-vif-unplugged-da514680-136e-49d6-aec0-9d4192081cec {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:52:30 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-bd6f9658-6b33-4dfb-ae7f-6e58ac7cc759 req-d8232ec6-7206-4c0d-b1ba-0bce5d37a03f service nova] Acquiring lock "40f792bb-43a9-4011-aaba-f240f64e2757-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:52:30 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-bd6f9658-6b33-4dfb-ae7f-6e58ac7cc759 req-d8232ec6-7206-4c0d-b1ba-0bce5d37a03f service nova] Lock "40f792bb-43a9-4011-aaba-f240f64e2757-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:52:30 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-bd6f9658-6b33-4dfb-ae7f-6e58ac7cc759 req-d8232ec6-7206-4c0d-b1ba-0bce5d37a03f service nova] Lock "40f792bb-43a9-4011-aaba-f240f64e2757-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:52:30 user nova-compute[75122]: DEBUG nova.compute.manager [req-bd6f9658-6b33-4dfb-ae7f-6e58ac7cc759 req-d8232ec6-7206-4c0d-b1ba-0bce5d37a03f service nova] [instance: 40f792bb-43a9-4011-aaba-f240f64e2757] No waiting events found dispatching network-vif-unplugged-da514680-136e-49d6-aec0-9d4192081cec {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:52:30 user nova-compute[75122]: WARNING nova.compute.manager [req-bd6f9658-6b33-4dfb-ae7f-6e58ac7cc759 req-d8232ec6-7206-4c0d-b1ba-0bce5d37a03f service nova] [instance: 40f792bb-43a9-4011-aaba-f240f64e2757] Received unexpected event network-vif-unplugged-da514680-136e-49d6-aec0-9d4192081cec for instance with vm_state active and task_state shelving_image_uploading.
Nov 15 09:52:30 user nova-compute[75122]: DEBUG nova.compute.manager [req-bd6f9658-6b33-4dfb-ae7f-6e58ac7cc759 req-d8232ec6-7206-4c0d-b1ba-0bce5d37a03f service nova] [instance: 40f792bb-43a9-4011-aaba-f240f64e2757] Received event network-vif-plugged-da514680-136e-49d6-aec0-9d4192081cec {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:52:30 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-bd6f9658-6b33-4dfb-ae7f-6e58ac7cc759 req-d8232ec6-7206-4c0d-b1ba-0bce5d37a03f service nova] Acquiring lock "40f792bb-43a9-4011-aaba-f240f64e2757-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:52:30 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-bd6f9658-6b33-4dfb-ae7f-6e58ac7cc759 req-d8232ec6-7206-4c0d-b1ba-0bce5d37a03f service nova] Lock "40f792bb-43a9-4011-aaba-f240f64e2757-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:52:30 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-bd6f9658-6b33-4dfb-ae7f-6e58ac7cc759 req-d8232ec6-7206-4c0d-b1ba-0bce5d37a03f service nova] Lock "40f792bb-43a9-4011-aaba-f240f64e2757-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:52:30 user nova-compute[75122]: DEBUG nova.compute.manager [req-bd6f9658-6b33-4dfb-ae7f-6e58ac7cc759 req-d8232ec6-7206-4c0d-b1ba-0bce5d37a03f service nova] [instance: 40f792bb-43a9-4011-aaba-f240f64e2757] No waiting events found dispatching network-vif-plugged-da514680-136e-49d6-aec0-9d4192081cec {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:52:30 user nova-compute[75122]: WARNING nova.compute.manager [req-bd6f9658-6b33-4dfb-ae7f-6e58ac7cc759 req-d8232ec6-7206-4c0d-b1ba-0bce5d37a03f service nova] [instance: 40f792bb-43a9-4011-aaba-f240f64e2757] Received unexpected event network-vif-plugged-da514680-136e-49d6-aec0-9d4192081cec for instance with vm_state active and task_state shelving_image_uploading.
Nov 15 09:52:30 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40f792bb-43a9-4011-aaba-f240f64e2757/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:52:30 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/718ca25b-c73d-4853-b674-fdaf3ed465c7/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:52:30 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/718ca25b-c73d-4853-b674-fdaf3ed465c7/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:52:30 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/718ca25b-c73d-4853-b674-fdaf3ed465c7/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:52:30 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/718ca25b-c73d-4853-b674-fdaf3ed465c7/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:52:30 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/001d589e-1bee-42da-8422-233ba796fbab/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:52:31 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/001d589e-1bee-42da-8422-233ba796fbab/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:52:31 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/001d589e-1bee-42da-8422-233ba796fbab/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:52:31 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/001d589e-1bee-42da-8422-233ba796fbab/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:52:31 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:52:31 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 09:52:31 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 09:52:31 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Hypervisor/Node resource view: name=user free_ram=8845MB free_disk=25.254051208496094GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75122) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 09:52:31 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:52:31 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:52:31 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance 001d589e-1bee-42da-8422-233ba796fbab actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:52:31 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance 40f792bb-43a9-4011-aaba-f240f64e2757 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:52:31 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance 718ca25b-c73d-4853-b674-fdaf3ed465c7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:52:31 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75122) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 09:52:31 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75122) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 09:52:31 user nova-compute[75122]: DEBUG nova.compute.provider_tree [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Inventory has not changed in ProviderTree for provider: 69a3da65-47be-44c6-b67c-c692b58284ef {{(pid=75122) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 09:52:31 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Inventory has not changed for provider 69a3da65-47be-44c6-b67c-c692b58284ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 09:52:31 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Compute_service record updated for user:user {{(pid=75122) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 09:52:31 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.289s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:52:32 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:52:32 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:52:32 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:52:32 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:52:32 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75122) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 09:52:32 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:52:32 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-9e5444a1-0e40-4a1b-b54c-0d1b1fc89f4f tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] [instance: 40f792bb-43a9-4011-aaba-f240f64e2757] Snapshot image upload complete
Nov 15 09:52:32 user nova-compute[75122]: DEBUG nova.compute.manager [None req-9e5444a1-0e40-4a1b-b54c-0d1b1fc89f4f tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] [instance: 40f792bb-43a9-4011-aaba-f240f64e2757] Checking state {{(pid=75122) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 09:52:32 user nova-compute[75122]: INFO nova.compute.manager [None req-9e5444a1-0e40-4a1b-b54c-0d1b1fc89f4f tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] [instance: 40f792bb-43a9-4011-aaba-f240f64e2757] Shelve offloading
Nov 15 09:52:32 user nova-compute[75122]: INFO nova.virt.libvirt.driver [-] [instance: 40f792bb-43a9-4011-aaba-f240f64e2757] Instance destroyed successfully.
Nov 15 09:52:32 user nova-compute[75122]: DEBUG nova.compute.manager [None req-9e5444a1-0e40-4a1b-b54c-0d1b1fc89f4f tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] [instance: 40f792bb-43a9-4011-aaba-f240f64e2757] Checking state {{(pid=75122) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 09:52:32 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-9e5444a1-0e40-4a1b-b54c-0d1b1fc89f4f tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Acquiring lock "refresh_cache-40f792bb-43a9-4011-aaba-f240f64e2757" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 09:52:32 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-9e5444a1-0e40-4a1b-b54c-0d1b1fc89f4f tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Acquired lock "refresh_cache-40f792bb-43a9-4011-aaba-f240f64e2757" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 09:52:32 user nova-compute[75122]: DEBUG nova.network.neutron [None req-9e5444a1-0e40-4a1b-b54c-0d1b1fc89f4f tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] [instance: 40f792bb-43a9-4011-aaba-f240f64e2757] Building network info cache for instance {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 09:52:32 user nova-compute[75122]: DEBUG nova.network.neutron [None req-9e5444a1-0e40-4a1b-b54c-0d1b1fc89f4f tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] [instance: 40f792bb-43a9-4011-aaba-f240f64e2757] Updating instance_info_cache with network_info: [{"id": "da514680-136e-49d6-aec0-9d4192081cec", "address": "fa:16:3e:b0:8a:af", "network": {"id": "7ab99c1b-e670-416e-b5fe-e1337db6b28d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-487518933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "535c751b9e76421c9262e48fbab3fb6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda514680-13", "ovs_interfaceid": "da514680-136e-49d6-aec0-9d4192081cec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:52:32 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-9e5444a1-0e40-4a1b-b54c-0d1b1fc89f4f tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Releasing lock "refresh_cache-40f792bb-43a9-4011-aaba-f240f64e2757" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 09:52:33 user nova-compute[75122]: INFO nova.virt.libvirt.driver [-] [instance: 40f792bb-43a9-4011-aaba-f240f64e2757] Instance destroyed successfully.
Nov 15 09:52:33 user nova-compute[75122]: DEBUG nova.objects.instance [None req-9e5444a1-0e40-4a1b-b54c-0d1b1fc89f4f tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Lazy-loading 'resources' on Instance uuid 40f792bb-43a9-4011-aaba-f240f64e2757 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:52:33 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-9e5444a1-0e40-4a1b-b54c-0d1b1fc89f4f tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T09:50:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1963643859',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1963643859',id=36,image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ+o1+VCoCl9aLUFla+CNAvrWecqtmJtkNMOXPbFgT/SGUDJQjE5J+p9LWhVFHo42hKlQB0Lpf11tT5e0MRK3x6CI//9ttDmkzl+cisBUmlwupwf667RZL6YbQ9nOc/Fow==',key_name='tempest-keypair-130968135',keypairs=<?>,launch_index=0,launched_at=2023-11-15T09:50:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='535c751b9e76421c9262e48fbab3fb6f',ramdisk_id='',reservation_id='r-y94lw7al',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1659813957',owner_user_name='tempest-AttachVolumeShelveTestJSON-1659813957-project-member',shelved_at='2023-11-15T09:52:32.237478',shelved_host='user',shelved_image_id='0980f3c8-6daa-486a-a0fb-329e6e9e4c7b'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T09:52:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad06186836ed40a49a05ef7cc9afd1bc',uuid=40f792bb-43a9-4011-aaba-f240f64e2757,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "da514680-136e-49d6-aec0-9d4192081cec", "address": "fa:16:3e:b0:8a:af", "network": {"id": "7ab99c1b-e670-416e-b5fe-e1337db6b28d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-487518933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "535c751b9e76421c9262e48fbab3fb6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda514680-13", "ovs_interfaceid": "da514680-136e-49d6-aec0-9d4192081cec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 09:52:33 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-9e5444a1-0e40-4a1b-b54c-0d1b1fc89f4f tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Converting VIF {"id": "da514680-136e-49d6-aec0-9d4192081cec", "address": "fa:16:3e:b0:8a:af", "network": {"id": "7ab99c1b-e670-416e-b5fe-e1337db6b28d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-487518933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "535c751b9e76421c9262e48fbab3fb6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda514680-13", "ovs_interfaceid": "da514680-136e-49d6-aec0-9d4192081cec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 09:52:33 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-9e5444a1-0e40-4a1b-b54c-0d1b1fc89f4f tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:8a:af,bridge_name='br-int',has_traffic_filtering=True,id=da514680-136e-49d6-aec0-9d4192081cec,network=Network(7ab99c1b-e670-416e-b5fe-e1337db6b28d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda514680-13') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 09:52:33 user nova-compute[75122]: DEBUG os_vif [None req-9e5444a1-0e40-4a1b-b54c-0d1b1fc89f4f tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:8a:af,bridge_name='br-int',has_traffic_filtering=True,id=da514680-136e-49d6-aec0-9d4192081cec,network=Network(7ab99c1b-e670-416e-b5fe-e1337db6b28d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda514680-13') {{(pid=75122) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 09:52:33 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:52:33 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapda514680-13, bridge=br-int, if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:52:33 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:52:33 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:52:33 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:52:33 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=eb7308b8-630f-422e-a60b-6d11aa28a596) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:52:33 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:52:33 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:52:33 user nova-compute[75122]: DEBUG nova.compute.manager [req-8399f62d-00f7-4a55-b3e8-b18ccba3f219 req-a322ddad-f392-45c4-97e1-dd4bad240b45 service nova] [instance: 40f792bb-43a9-4011-aaba-f240f64e2757] Received event network-changed-da514680-136e-49d6-aec0-9d4192081cec {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:52:33 user nova-compute[75122]: DEBUG nova.compute.manager [req-8399f62d-00f7-4a55-b3e8-b18ccba3f219 req-a322ddad-f392-45c4-97e1-dd4bad240b45 service nova] [instance: 40f792bb-43a9-4011-aaba-f240f64e2757] Refreshing instance network info cache due to event network-changed-da514680-136e-49d6-aec0-9d4192081cec. {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 09:52:33 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-8399f62d-00f7-4a55-b3e8-b18ccba3f219 req-a322ddad-f392-45c4-97e1-dd4bad240b45 service nova] Acquiring lock "refresh_cache-40f792bb-43a9-4011-aaba-f240f64e2757" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 09:52:33 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-8399f62d-00f7-4a55-b3e8-b18ccba3f219 req-a322ddad-f392-45c4-97e1-dd4bad240b45 service nova] Acquired lock "refresh_cache-40f792bb-43a9-4011-aaba-f240f64e2757" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 09:52:33 user nova-compute[75122]: DEBUG nova.network.neutron [req-8399f62d-00f7-4a55-b3e8-b18ccba3f219 req-a322ddad-f392-45c4-97e1-dd4bad240b45 service nova] [instance: 40f792bb-43a9-4011-aaba-f240f64e2757] Refreshing network info cache for port da514680-136e-49d6-aec0-9d4192081cec {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 09:52:33 user nova-compute[75122]: INFO os_vif [None req-9e5444a1-0e40-4a1b-b54c-0d1b1fc89f4f tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:8a:af,bridge_name='br-int',has_traffic_filtering=True,id=da514680-136e-49d6-aec0-9d4192081cec,network=Network(7ab99c1b-e670-416e-b5fe-e1337db6b28d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda514680-13')
Nov 15 09:52:33 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-9e5444a1-0e40-4a1b-b54c-0d1b1fc89f4f tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] [instance: 40f792bb-43a9-4011-aaba-f240f64e2757] Deleting instance files /opt/stack/data/nova/instances/40f792bb-43a9-4011-aaba-f240f64e2757_del
Nov 15 09:52:33 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-9e5444a1-0e40-4a1b-b54c-0d1b1fc89f4f tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] [instance: 40f792bb-43a9-4011-aaba-f240f64e2757] Deletion of /opt/stack/data/nova/instances/40f792bb-43a9-4011-aaba-f240f64e2757_del complete
Nov 15 09:52:33 user nova-compute[75122]: INFO nova.scheduler.client.report [None req-9e5444a1-0e40-4a1b-b54c-0d1b1fc89f4f tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Deleted allocations for instance 40f792bb-43a9-4011-aaba-f240f64e2757
Nov 15 09:52:33 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-9e5444a1-0e40-4a1b-b54c-0d1b1fc89f4f tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:52:33 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-9e5444a1-0e40-4a1b-b54c-0d1b1fc89f4f tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:52:33 user nova-compute[75122]: DEBUG nova.objects.instance [None req-9e5444a1-0e40-4a1b-b54c-0d1b1fc89f4f tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Lazy-loading 'numa_topology' on Instance uuid 40f792bb-43a9-4011-aaba-f240f64e2757 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:52:33 user nova-compute[75122]: DEBUG nova.objects.base [None req-9e5444a1-0e40-4a1b-b54c-0d1b1fc89f4f tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Object Instance<40f792bb-43a9-4011-aaba-f240f64e2757> lazy-loaded attributes: resources,numa_topology {{(pid=75122) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 09:52:33 user nova-compute[75122]: DEBUG nova.compute.provider_tree [None req-9e5444a1-0e40-4a1b-b54c-0d1b1fc89f4f tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Inventory has not changed in ProviderTree for provider: 69a3da65-47be-44c6-b67c-c692b58284ef {{(pid=75122) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 09:52:33 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-9e5444a1-0e40-4a1b-b54c-0d1b1fc89f4f tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Inventory has not changed for provider 69a3da65-47be-44c6-b67c-c692b58284ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 09:52:33 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-9e5444a1-0e40-4a1b-b54c-0d1b1fc89f4f tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.147s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:52:33 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-9e5444a1-0e40-4a1b-b54c-0d1b1fc89f4f tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Lock "40f792bb-43a9-4011-aaba-f240f64e2757" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 5.588s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:52:33 user nova-compute[75122]: DEBUG nova.network.neutron [req-8399f62d-00f7-4a55-b3e8-b18ccba3f219 req-a322ddad-f392-45c4-97e1-dd4bad240b45 service nova] [instance: 40f792bb-43a9-4011-aaba-f240f64e2757] Updated VIF entry in instance network info cache for port da514680-136e-49d6-aec0-9d4192081cec. {{(pid=75122) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 09:52:33 user nova-compute[75122]: DEBUG nova.network.neutron [req-8399f62d-00f7-4a55-b3e8-b18ccba3f219 req-a322ddad-f392-45c4-97e1-dd4bad240b45 service nova] [instance: 40f792bb-43a9-4011-aaba-f240f64e2757] Updating instance_info_cache with network_info: [{"id": "da514680-136e-49d6-aec0-9d4192081cec", "address": "fa:16:3e:b0:8a:af", "network": {"id": "7ab99c1b-e670-416e-b5fe-e1337db6b28d", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-487518933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "535c751b9e76421c9262e48fbab3fb6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapda514680-13", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:52:33 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-8399f62d-00f7-4a55-b3e8-b18ccba3f219 req-a322ddad-f392-45c4-97e1-dd4bad240b45 service nova] Releasing lock "refresh_cache-40f792bb-43a9-4011-aaba-f240f64e2757" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 09:52:36 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:52:38 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:52:38 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:52:41 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:52:43 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:52:46 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:52:48 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:52:51 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:52:53 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:52:56 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:52:56 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:52:58 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:52:58 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:53:03 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:53:04 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:53:05 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-8d87a524-9428-4db8-a926-798eee36a3e1 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Acquiring lock "db848537-676f-464a-806d-febb14d920a6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:53:05 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-8d87a524-9428-4db8-a926-798eee36a3e1 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Lock "db848537-676f-464a-806d-febb14d920a6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:53:05 user nova-compute[75122]: DEBUG nova.compute.manager [None req-8d87a524-9428-4db8-a926-798eee36a3e1 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: db848537-676f-464a-806d-febb14d920a6] Starting instance... {{(pid=75122) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 09:53:05 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-8d87a524-9428-4db8-a926-798eee36a3e1 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:53:05 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-8d87a524-9428-4db8-a926-798eee36a3e1 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:53:05 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-8d87a524-9428-4db8-a926-798eee36a3e1 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75122) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 09:53:05 user nova-compute[75122]: INFO nova.compute.claims [None req-8d87a524-9428-4db8-a926-798eee36a3e1 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: db848537-676f-464a-806d-febb14d920a6] Claim successful on node user
Nov 15 09:53:05 user nova-compute[75122]: DEBUG nova.compute.provider_tree [None req-8d87a524-9428-4db8-a926-798eee36a3e1 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Inventory has not changed in ProviderTree for provider: 69a3da65-47be-44c6-b67c-c692b58284ef {{(pid=75122) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 09:53:05 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-8d87a524-9428-4db8-a926-798eee36a3e1 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Inventory has not changed for provider 69a3da65-47be-44c6-b67c-c692b58284ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 09:53:05 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-8d87a524-9428-4db8-a926-798eee36a3e1 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.255s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:53:05 user nova-compute[75122]: DEBUG nova.compute.manager [None req-8d87a524-9428-4db8-a926-798eee36a3e1 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: db848537-676f-464a-806d-febb14d920a6] Start building networks asynchronously for instance. {{(pid=75122) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 09:53:05 user nova-compute[75122]: DEBUG nova.compute.manager [None req-8d87a524-9428-4db8-a926-798eee36a3e1 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: db848537-676f-464a-806d-febb14d920a6] Allocating IP information in the background. {{(pid=75122) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 09:53:05 user nova-compute[75122]: DEBUG nova.network.neutron [None req-8d87a524-9428-4db8-a926-798eee36a3e1 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: db848537-676f-464a-806d-febb14d920a6] allocate_for_instance() {{(pid=75122) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 09:53:05 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-8d87a524-9428-4db8-a926-798eee36a3e1 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: db848537-676f-464a-806d-febb14d920a6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 09:53:05 user nova-compute[75122]: DEBUG nova.compute.manager [None req-8d87a524-9428-4db8-a926-798eee36a3e1 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: db848537-676f-464a-806d-febb14d920a6] Start building block device mappings for instance. {{(pid=75122) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 09:53:05 user nova-compute[75122]: DEBUG nova.policy [None req-8d87a524-9428-4db8-a926-798eee36a3e1 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '53d187e2a07b4437a02f65fb47a003ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c046170a2ad44ebba5d2de236d940be0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75122) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 09:53:05 user nova-compute[75122]: INFO nova.virt.block_device [None req-8d87a524-9428-4db8-a926-798eee36a3e1 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: db848537-676f-464a-806d-febb14d920a6] Booting with blank volume at /dev/vda
Nov 15 09:53:05 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:53:06 user nova-compute[75122]: DEBUG nova.network.neutron [None req-8d87a524-9428-4db8-a926-798eee36a3e1 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: db848537-676f-464a-806d-febb14d920a6] Successfully created port: 93bbff2d-1d5c-47db-b436-43796849be51 {{(pid=75122) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 09:53:06 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:53:06 user nova-compute[75122]: DEBUG nova.network.neutron [None req-8d87a524-9428-4db8-a926-798eee36a3e1 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: db848537-676f-464a-806d-febb14d920a6] Successfully updated port: 93bbff2d-1d5c-47db-b436-43796849be51 {{(pid=75122) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 09:53:06 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-8d87a524-9428-4db8-a926-798eee36a3e1 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Acquiring lock "refresh_cache-db848537-676f-464a-806d-febb14d920a6" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 09:53:06 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-8d87a524-9428-4db8-a926-798eee36a3e1 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Acquired lock "refresh_cache-db848537-676f-464a-806d-febb14d920a6" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 09:53:06 user nova-compute[75122]: DEBUG nova.network.neutron [None req-8d87a524-9428-4db8-a926-798eee36a3e1 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: db848537-676f-464a-806d-febb14d920a6] Building network info cache for instance {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 09:53:06 user nova-compute[75122]: DEBUG nova.compute.manager [req-d0d44adf-fe0a-48f2-9657-32415b323bbb req-581c1457-29d5-48a1-8648-fad9051ea3ac service nova] [instance: db848537-676f-464a-806d-febb14d920a6] Received event network-changed-93bbff2d-1d5c-47db-b436-43796849be51 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:53:06 user nova-compute[75122]: DEBUG nova.compute.manager [req-d0d44adf-fe0a-48f2-9657-32415b323bbb req-581c1457-29d5-48a1-8648-fad9051ea3ac service nova] [instance: db848537-676f-464a-806d-febb14d920a6] Refreshing instance network info cache due to event network-changed-93bbff2d-1d5c-47db-b436-43796849be51. {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 09:53:06 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-d0d44adf-fe0a-48f2-9657-32415b323bbb req-581c1457-29d5-48a1-8648-fad9051ea3ac service nova] Acquiring lock "refresh_cache-db848537-676f-464a-806d-febb14d920a6" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 09:53:07 user nova-compute[75122]: DEBUG nova.network.neutron [None req-8d87a524-9428-4db8-a926-798eee36a3e1 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: db848537-676f-464a-806d-febb14d920a6] Instance cache missing network info. {{(pid=75122) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 09:53:07 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-3caf35f1-6b5c-4707-b918-58fa19304bbb tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] Acquiring lock "be71985e-a370-43d9-adef-afb31d03e2fd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:53:07 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-3caf35f1-6b5c-4707-b918-58fa19304bbb tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] Lock "be71985e-a370-43d9-adef-afb31d03e2fd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:53:07 user nova-compute[75122]: DEBUG nova.compute.manager [None req-3caf35f1-6b5c-4707-b918-58fa19304bbb tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] [instance: be71985e-a370-43d9-adef-afb31d03e2fd] Starting instance... {{(pid=75122) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 09:53:07 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-3caf35f1-6b5c-4707-b918-58fa19304bbb tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:53:07 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-3caf35f1-6b5c-4707-b918-58fa19304bbb tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:53:07 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-3caf35f1-6b5c-4707-b918-58fa19304bbb tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75122) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 09:53:07 user nova-compute[75122]: INFO nova.compute.claims [None req-3caf35f1-6b5c-4707-b918-58fa19304bbb tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] [instance: be71985e-a370-43d9-adef-afb31d03e2fd] Claim successful on node user
Nov 15 09:53:07 user nova-compute[75122]: DEBUG nova.network.neutron [None req-8d87a524-9428-4db8-a926-798eee36a3e1 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: db848537-676f-464a-806d-febb14d920a6] Updating instance_info_cache with network_info: [{"id": "93bbff2d-1d5c-47db-b436-43796849be51", "address": "fa:16:3e:eb:e9:ca", "network": {"id": "b780d5c1-a549-4b49-a036-5a272697d4b6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-229344021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c046170a2ad44ebba5d2de236d940be0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93bbff2d-1d", "ovs_interfaceid": "93bbff2d-1d5c-47db-b436-43796849be51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:53:07 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-8d87a524-9428-4db8-a926-798eee36a3e1 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Releasing lock "refresh_cache-db848537-676f-464a-806d-febb14d920a6" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 09:53:07 user nova-compute[75122]: DEBUG nova.compute.manager [None req-8d87a524-9428-4db8-a926-798eee36a3e1 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: db848537-676f-464a-806d-febb14d920a6] Instance network_info: |[{"id": "93bbff2d-1d5c-47db-b436-43796849be51", "address": "fa:16:3e:eb:e9:ca", "network": {"id": "b780d5c1-a549-4b49-a036-5a272697d4b6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-229344021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c046170a2ad44ebba5d2de236d940be0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93bbff2d-1d", "ovs_interfaceid": "93bbff2d-1d5c-47db-b436-43796849be51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75122) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 09:53:07 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-d0d44adf-fe0a-48f2-9657-32415b323bbb req-581c1457-29d5-48a1-8648-fad9051ea3ac service nova] Acquired lock "refresh_cache-db848537-676f-464a-806d-febb14d920a6" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 09:53:07 user nova-compute[75122]: DEBUG nova.network.neutron [req-d0d44adf-fe0a-48f2-9657-32415b323bbb req-581c1457-29d5-48a1-8648-fad9051ea3ac service nova] [instance: db848537-676f-464a-806d-febb14d920a6] Refreshing network info cache for port 93bbff2d-1d5c-47db-b436-43796849be51 {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 09:53:07 user nova-compute[75122]: DEBUG nova.compute.provider_tree [None req-3caf35f1-6b5c-4707-b918-58fa19304bbb tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] Inventory has not changed in ProviderTree for provider: 69a3da65-47be-44c6-b67c-c692b58284ef {{(pid=75122) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 09:53:07 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-3caf35f1-6b5c-4707-b918-58fa19304bbb tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] Inventory has not changed for provider 69a3da65-47be-44c6-b67c-c692b58284ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 09:53:07 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-3caf35f1-6b5c-4707-b918-58fa19304bbb tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.265s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:53:07 user nova-compute[75122]: DEBUG nova.compute.manager [None req-3caf35f1-6b5c-4707-b918-58fa19304bbb tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] [instance: be71985e-a370-43d9-adef-afb31d03e2fd] Start building networks asynchronously for instance. {{(pid=75122) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 09:53:07 user nova-compute[75122]: DEBUG nova.compute.manager [None req-3caf35f1-6b5c-4707-b918-58fa19304bbb tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] [instance: be71985e-a370-43d9-adef-afb31d03e2fd] Allocating IP information in the background. {{(pid=75122) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 09:53:07 user nova-compute[75122]: DEBUG nova.network.neutron [None req-3caf35f1-6b5c-4707-b918-58fa19304bbb tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] [instance: be71985e-a370-43d9-adef-afb31d03e2fd] allocate_for_instance() {{(pid=75122) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 09:53:07 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-3caf35f1-6b5c-4707-b918-58fa19304bbb tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] [instance: be71985e-a370-43d9-adef-afb31d03e2fd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 09:53:07 user nova-compute[75122]: DEBUG nova.compute.manager [None req-3caf35f1-6b5c-4707-b918-58fa19304bbb tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] [instance: be71985e-a370-43d9-adef-afb31d03e2fd] Start building block device mappings for instance. {{(pid=75122) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 09:53:07 user nova-compute[75122]: DEBUG nova.network.neutron [req-d0d44adf-fe0a-48f2-9657-32415b323bbb req-581c1457-29d5-48a1-8648-fad9051ea3ac service nova] [instance: db848537-676f-464a-806d-febb14d920a6] Updated VIF entry in instance network info cache for port 93bbff2d-1d5c-47db-b436-43796849be51. {{(pid=75122) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 09:53:07 user nova-compute[75122]: DEBUG nova.network.neutron [req-d0d44adf-fe0a-48f2-9657-32415b323bbb req-581c1457-29d5-48a1-8648-fad9051ea3ac service nova] [instance: db848537-676f-464a-806d-febb14d920a6] Updating instance_info_cache with network_info: [{"id": "93bbff2d-1d5c-47db-b436-43796849be51", "address": "fa:16:3e:eb:e9:ca", "network": {"id": "b780d5c1-a549-4b49-a036-5a272697d4b6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-229344021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c046170a2ad44ebba5d2de236d940be0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93bbff2d-1d", "ovs_interfaceid": "93bbff2d-1d5c-47db-b436-43796849be51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:53:07 user nova-compute[75122]: DEBUG nova.policy [None req-3caf35f1-6b5c-4707-b918-58fa19304bbb tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '199452e19f8742ea810c917fbfa0581a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f16d3dc8434cb5ac78c8d2f51d305b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75122) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 09:53:07 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-d0d44adf-fe0a-48f2-9657-32415b323bbb req-581c1457-29d5-48a1-8648-fad9051ea3ac service nova] Releasing lock "refresh_cache-db848537-676f-464a-806d-febb14d920a6" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 09:53:07 user nova-compute[75122]: DEBUG nova.compute.manager [None req-3caf35f1-6b5c-4707-b918-58fa19304bbb tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] [instance: be71985e-a370-43d9-adef-afb31d03e2fd] Start spawning the instance on the hypervisor. {{(pid=75122) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 09:53:07 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-3caf35f1-6b5c-4707-b918-58fa19304bbb tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] [instance: be71985e-a370-43d9-adef-afb31d03e2fd] Creating instance directory {{(pid=75122) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 09:53:07 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-3caf35f1-6b5c-4707-b918-58fa19304bbb tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] [instance: be71985e-a370-43d9-adef-afb31d03e2fd] Creating image(s)
Nov 15 09:53:07 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-3caf35f1-6b5c-4707-b918-58fa19304bbb tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] Acquiring lock "/opt/stack/data/nova/instances/be71985e-a370-43d9-adef-afb31d03e2fd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:53:07 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-3caf35f1-6b5c-4707-b918-58fa19304bbb tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] Lock "/opt/stack/data/nova/instances/be71985e-a370-43d9-adef-afb31d03e2fd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:53:07 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-3caf35f1-6b5c-4707-b918-58fa19304bbb tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] Lock "/opt/stack/data/nova/instances/be71985e-a370-43d9-adef-afb31d03e2fd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:53:07 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-3caf35f1-6b5c-4707-b918-58fa19304bbb tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:53:07 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-3caf35f1-6b5c-4707-b918-58fa19304bbb tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json" returned: 0 in 0.170s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:53:07 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-3caf35f1-6b5c-4707-b918-58fa19304bbb tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] Acquiring lock "95d6e29f74d5408f818e32f3bc29bc8270a4c665" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:53:07 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-3caf35f1-6b5c-4707-b918-58fa19304bbb tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] Lock "95d6e29f74d5408f818e32f3bc29bc8270a4c665" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:53:07 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-3caf35f1-6b5c-4707-b918-58fa19304bbb tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:53:08 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-3caf35f1-6b5c-4707-b918-58fa19304bbb tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json" returned: 0 in 0.172s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:53:08 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-3caf35f1-6b5c-4707-b918-58fa19304bbb tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665,backing_fmt=raw /opt/stack/data/nova/instances/be71985e-a370-43d9-adef-afb31d03e2fd/disk 1073741824 {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:53:08 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-3caf35f1-6b5c-4707-b918-58fa19304bbb tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665,backing_fmt=raw /opt/stack/data/nova/instances/be71985e-a370-43d9-adef-afb31d03e2fd/disk 1073741824" returned: 0 in 0.056s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:53:08 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-3caf35f1-6b5c-4707-b918-58fa19304bbb tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] Lock "95d6e29f74d5408f818e32f3bc29bc8270a4c665" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.235s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:53:08 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-3caf35f1-6b5c-4707-b918-58fa19304bbb tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:53:08 user nova-compute[75122]: DEBUG nova.network.neutron [None req-3caf35f1-6b5c-4707-b918-58fa19304bbb tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] [instance: be71985e-a370-43d9-adef-afb31d03e2fd] Successfully created port: 4d28d025-0115-4813-b62a-a84ec8c47d58 {{(pid=75122) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 09:53:08 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:53:08 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-3caf35f1-6b5c-4707-b918-58fa19304bbb tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json" returned: 0 in 0.177s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:53:08 user nova-compute[75122]: DEBUG nova.virt.disk.api [None req-3caf35f1-6b5c-4707-b918-58fa19304bbb tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] Checking if we can resize image /opt/stack/data/nova/instances/be71985e-a370-43d9-adef-afb31d03e2fd/disk. size=1073741824 {{(pid=75122) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 09:53:08 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-3caf35f1-6b5c-4707-b918-58fa19304bbb tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be71985e-a370-43d9-adef-afb31d03e2fd/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:53:08 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-3caf35f1-6b5c-4707-b918-58fa19304bbb tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be71985e-a370-43d9-adef-afb31d03e2fd/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:53:08 user nova-compute[75122]: DEBUG nova.virt.disk.api [None req-3caf35f1-6b5c-4707-b918-58fa19304bbb tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] Cannot resize image /opt/stack/data/nova/instances/be71985e-a370-43d9-adef-afb31d03e2fd/disk to a smaller size. {{(pid=75122) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 09:53:08 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-3caf35f1-6b5c-4707-b918-58fa19304bbb tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] [instance: be71985e-a370-43d9-adef-afb31d03e2fd] Created local disks {{(pid=75122) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 09:53:08 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-3caf35f1-6b5c-4707-b918-58fa19304bbb tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] [instance: be71985e-a370-43d9-adef-afb31d03e2fd] Ensure instance console log exists: /opt/stack/data/nova/instances/be71985e-a370-43d9-adef-afb31d03e2fd/console.log {{(pid=75122) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 09:53:08 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-3caf35f1-6b5c-4707-b918-58fa19304bbb tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:53:08 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-3caf35f1-6b5c-4707-b918-58fa19304bbb tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:53:08 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-3caf35f1-6b5c-4707-b918-58fa19304bbb tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:53:08 user nova-compute[75122]: DEBUG nova.network.neutron [None req-3caf35f1-6b5c-4707-b918-58fa19304bbb tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] [instance: be71985e-a370-43d9-adef-afb31d03e2fd] Successfully updated port: 4d28d025-0115-4813-b62a-a84ec8c47d58 {{(pid=75122) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 09:53:08 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-3caf35f1-6b5c-4707-b918-58fa19304bbb tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] Acquiring lock "refresh_cache-be71985e-a370-43d9-adef-afb31d03e2fd" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 09:53:08 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-3caf35f1-6b5c-4707-b918-58fa19304bbb tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] Acquired lock "refresh_cache-be71985e-a370-43d9-adef-afb31d03e2fd" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 09:53:08 user nova-compute[75122]: DEBUG nova.network.neutron [None req-3caf35f1-6b5c-4707-b918-58fa19304bbb tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] [instance: be71985e-a370-43d9-adef-afb31d03e2fd] Building network info cache for instance {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 09:53:08 user nova-compute[75122]: DEBUG nova.compute.manager [req-9a8476f6-6108-4637-bb45-df1e74f366a8 req-4e68759e-8c1c-4ec2-85f7-709ac0407dd3 service nova] [instance: be71985e-a370-43d9-adef-afb31d03e2fd] Received event network-changed-4d28d025-0115-4813-b62a-a84ec8c47d58 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:53:08 user nova-compute[75122]: DEBUG nova.compute.manager [req-9a8476f6-6108-4637-bb45-df1e74f366a8 req-4e68759e-8c1c-4ec2-85f7-709ac0407dd3 service nova] [instance: be71985e-a370-43d9-adef-afb31d03e2fd] Refreshing instance network info cache due to event network-changed-4d28d025-0115-4813-b62a-a84ec8c47d58. {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 09:53:08 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-9a8476f6-6108-4637-bb45-df1e74f366a8 req-4e68759e-8c1c-4ec2-85f7-709ac0407dd3 service nova] Acquiring lock "refresh_cache-be71985e-a370-43d9-adef-afb31d03e2fd" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 09:53:09 user nova-compute[75122]: DEBUG nova.network.neutron [None req-3caf35f1-6b5c-4707-b918-58fa19304bbb tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] [instance: be71985e-a370-43d9-adef-afb31d03e2fd] Instance cache missing network info. {{(pid=75122) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 09:53:09 user nova-compute[75122]: DEBUG nova.network.neutron [None req-3caf35f1-6b5c-4707-b918-58fa19304bbb tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] [instance: be71985e-a370-43d9-adef-afb31d03e2fd] Updating instance_info_cache with network_info: [{"id": "4d28d025-0115-4813-b62a-a84ec8c47d58", "address": "fa:16:3e:fa:cb:ca", "network": {"id": "ca2dff40-00d3-46b0-b9e2-dca375439496", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1592022235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88f16d3dc8434cb5ac78c8d2f51d305b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d28d025-01", "ovs_interfaceid": "4d28d025-0115-4813-b62a-a84ec8c47d58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:53:09 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-3caf35f1-6b5c-4707-b918-58fa19304bbb tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] Releasing lock "refresh_cache-be71985e-a370-43d9-adef-afb31d03e2fd" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 09:53:09 user nova-compute[75122]: DEBUG nova.compute.manager [None req-3caf35f1-6b5c-4707-b918-58fa19304bbb tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] [instance: be71985e-a370-43d9-adef-afb31d03e2fd] Instance network_info: |[{"id": "4d28d025-0115-4813-b62a-a84ec8c47d58", "address": "fa:16:3e:fa:cb:ca", "network": {"id": "ca2dff40-00d3-46b0-b9e2-dca375439496", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1592022235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88f16d3dc8434cb5ac78c8d2f51d305b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d28d025-01", "ovs_interfaceid": "4d28d025-0115-4813-b62a-a84ec8c47d58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75122) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 09:53:09 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-9a8476f6-6108-4637-bb45-df1e74f366a8 req-4e68759e-8c1c-4ec2-85f7-709ac0407dd3 service nova] Acquired lock "refresh_cache-be71985e-a370-43d9-adef-afb31d03e2fd" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 09:53:09 user nova-compute[75122]: DEBUG nova.network.neutron [req-9a8476f6-6108-4637-bb45-df1e74f366a8 req-4e68759e-8c1c-4ec2-85f7-709ac0407dd3 service nova] [instance: be71985e-a370-43d9-adef-afb31d03e2fd] Refreshing network info cache for port 4d28d025-0115-4813-b62a-a84ec8c47d58 {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 09:53:09 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-3caf35f1-6b5c-4707-b918-58fa19304bbb tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] [instance: be71985e-a370-43d9-adef-afb31d03e2fd] Start _get_guest_xml network_info=[{"id": "4d28d025-0115-4813-b62a-a84ec8c47d58", "address": "fa:16:3e:fa:cb:ca", "network": {"id": "ca2dff40-00d3-46b0-b9e2-dca375439496", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1592022235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88f16d3dc8434cb5ac78c8d2f51d305b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d28d025-01", "ovs_interfaceid": "4d28d025-0115-4813-b62a-a84ec8c47d58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T09:26:31Z,direct_url=<?>,disk_format='qcow2',id=5e862cfe-47b8-4725-8292-65761ee6d0f5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9c57733cb41847c0b4ad31519c382e5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T09:26:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '5e862cfe-47b8-4725-8292-65761ee6d0f5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75122) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 09:53:09 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-3caf35f1-6b5c-4707-b918-58fa19304bbb tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 09:53:09 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-3caf35f1-6b5c-4707-b918-58fa19304bbb tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 09:53:09 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-3caf35f1-6b5c-4707-b918-58fa19304bbb tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75122) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 09:53:09 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-3caf35f1-6b5c-4707-b918-58fa19304bbb tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] CPU controller missing on host. {{(pid=75122) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 09:53:09 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-3caf35f1-6b5c-4707-b918-58fa19304bbb tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75122) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 09:53:09 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-3caf35f1-6b5c-4707-b918-58fa19304bbb tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] CPU controller found on host. {{(pid=75122) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 09:53:09 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-3caf35f1-6b5c-4707-b918-58fa19304bbb tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75122) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 09:53:09 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-3caf35f1-6b5c-4707-b918-58fa19304bbb tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T09:26:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T09:26:31Z,direct_url=<?>,disk_format='qcow2',id=5e862cfe-47b8-4725-8292-65761ee6d0f5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9c57733cb41847c0b4ad31519c382e5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T09:26:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 09:53:09 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-3caf35f1-6b5c-4707-b918-58fa19304bbb tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] Flavor limits 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 09:53:09 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-3caf35f1-6b5c-4707-b918-58fa19304bbb tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] Image limits 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 09:53:09 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-3caf35f1-6b5c-4707-b918-58fa19304bbb tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] Flavor pref 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 09:53:09 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-3caf35f1-6b5c-4707-b918-58fa19304bbb tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] Image pref 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 09:53:09 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-3caf35f1-6b5c-4707-b918-58fa19304bbb tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 09:53:09 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-3caf35f1-6b5c-4707-b918-58fa19304bbb tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 09:53:09 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-3caf35f1-6b5c-4707-b918-58fa19304bbb tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75122) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 09:53:09 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-3caf35f1-6b5c-4707-b918-58fa19304bbb tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] Got 1 possible topologies {{(pid=75122) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 09:53:09 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-3caf35f1-6b5c-4707-b918-58fa19304bbb tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 09:53:09 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-3caf35f1-6b5c-4707-b918-58fa19304bbb tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 09:53:09 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-3caf35f1-6b5c-4707-b918-58fa19304bbb tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T09:53:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1825073794',display_name='tempest-ServersNegativeTestJSON-server-1825073794',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1825073794',id=39,image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='88f16d3dc8434cb5ac78c8d2f51d305b',ramdisk_id='',reservation_id='r-qc02nu2a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1688784762',owner_user_name='tempest-ServersNegativeTestJSON-1688784762-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T09:53:08Z,user_data=None,user_id='199452e19f8742ea810c917fbfa0581a',uuid=be71985e-a370-43d9-adef-afb31d03e2fd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4d28d025-0115-4813-b62a-a84ec8c47d58", "address": "fa:16:3e:fa:cb:ca", "network": {"id": "ca2dff40-00d3-46b0-b9e2-dca375439496", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1592022235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88f16d3dc8434cb5ac78c8d2f51d305b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d28d025-01", "ovs_interfaceid": "4d28d025-0115-4813-b62a-a84ec8c47d58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75122) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 09:53:09 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-3caf35f1-6b5c-4707-b918-58fa19304bbb tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] Converting VIF {"id": "4d28d025-0115-4813-b62a-a84ec8c47d58", "address": "fa:16:3e:fa:cb:ca", "network": {"id": "ca2dff40-00d3-46b0-b9e2-dca375439496", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1592022235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88f16d3dc8434cb5ac78c8d2f51d305b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d28d025-01", "ovs_interfaceid": "4d28d025-0115-4813-b62a-a84ec8c47d58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 09:53:09 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-3caf35f1-6b5c-4707-b918-58fa19304bbb tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fa:cb:ca,bridge_name='br-int',has_traffic_filtering=True,id=4d28d025-0115-4813-b62a-a84ec8c47d58,network=Network(ca2dff40-00d3-46b0-b9e2-dca375439496),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d28d025-01') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 09:53:09 user nova-compute[75122]: DEBUG nova.objects.instance [None req-3caf35f1-6b5c-4707-b918-58fa19304bbb tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] Lazy-loading 'pci_devices' on Instance uuid be71985e-a370-43d9-adef-afb31d03e2fd {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:53:09 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-3caf35f1-6b5c-4707-b918-58fa19304bbb tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] [instance: be71985e-a370-43d9-adef-afb31d03e2fd] End _get_guest_xml xml=<domain type="kvm">
Nov 15 09:53:09 user nova-compute[75122]:   <uuid>be71985e-a370-43d9-adef-afb31d03e2fd</uuid>
Nov 15 09:53:09 user nova-compute[75122]:   <name>instance-00000027</name>
Nov 15 09:53:09 user nova-compute[75122]:   <memory>524288</memory>
Nov 15 09:53:09 user nova-compute[75122]:   <vcpu>1</vcpu>
Nov 15 09:53:09 user nova-compute[75122]:   <metadata>
Nov 15 09:53:09 user nova-compute[75122]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 09:53:09 user nova-compute[75122]:       <nova:package version="0.0.0"/>
Nov 15 09:53:09 user nova-compute[75122]:       <nova:name>tempest-ServersNegativeTestJSON-server-1825073794</nova:name>
Nov 15 09:53:09 user nova-compute[75122]:       <nova:creationTime>2023-11-15 09:53:09</nova:creationTime>
Nov 15 09:53:09 user nova-compute[75122]:       <nova:flavor name="m1.tiny">
Nov 15 09:53:09 user nova-compute[75122]:         <nova:memory>512</nova:memory>
Nov 15 09:53:09 user nova-compute[75122]:         <nova:disk>1</nova:disk>
Nov 15 09:53:09 user nova-compute[75122]:         <nova:swap>0</nova:swap>
Nov 15 09:53:09 user nova-compute[75122]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 09:53:09 user nova-compute[75122]:         <nova:vcpus>1</nova:vcpus>
Nov 15 09:53:09 user nova-compute[75122]:       </nova:flavor>
Nov 15 09:53:09 user nova-compute[75122]:       <nova:owner>
Nov 15 09:53:09 user nova-compute[75122]:         <nova:user uuid="199452e19f8742ea810c917fbfa0581a">tempest-ServersNegativeTestJSON-1688784762-project-member</nova:user>
Nov 15 09:53:09 user nova-compute[75122]:         <nova:project uuid="88f16d3dc8434cb5ac78c8d2f51d305b">tempest-ServersNegativeTestJSON-1688784762</nova:project>
Nov 15 09:53:09 user nova-compute[75122]:       </nova:owner>
Nov 15 09:53:09 user nova-compute[75122]:       <nova:root type="image" uuid="5e862cfe-47b8-4725-8292-65761ee6d0f5"/>
Nov 15 09:53:09 user nova-compute[75122]:       <nova:ports>
Nov 15 09:53:09 user nova-compute[75122]:         <nova:port uuid="4d28d025-0115-4813-b62a-a84ec8c47d58">
Nov 15 09:53:09 user nova-compute[75122]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 15 09:53:09 user nova-compute[75122]:         </nova:port>
Nov 15 09:53:09 user nova-compute[75122]:       </nova:ports>
Nov 15 09:53:09 user nova-compute[75122]:     </nova:instance>
Nov 15 09:53:09 user nova-compute[75122]:   </metadata>
Nov 15 09:53:09 user nova-compute[75122]:   <sysinfo type="smbios">
Nov 15 09:53:09 user nova-compute[75122]:     <system>
Nov 15 09:53:09 user nova-compute[75122]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 09:53:09 user nova-compute[75122]:       <entry name="product">OpenStack Nova</entry>
Nov 15 09:53:09 user nova-compute[75122]:       <entry name="version">0.0.0</entry>
Nov 15 09:53:09 user nova-compute[75122]:       <entry name="serial">be71985e-a370-43d9-adef-afb31d03e2fd</entry>
Nov 15 09:53:09 user nova-compute[75122]:       <entry name="uuid">be71985e-a370-43d9-adef-afb31d03e2fd</entry>
Nov 15 09:53:09 user nova-compute[75122]:       <entry name="family">Virtual Machine</entry>
Nov 15 09:53:09 user nova-compute[75122]:     </system>
Nov 15 09:53:09 user nova-compute[75122]:   </sysinfo>
Nov 15 09:53:09 user nova-compute[75122]:   <os>
Nov 15 09:53:09 user nova-compute[75122]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 09:53:09 user nova-compute[75122]:     <boot dev="hd"/>
Nov 15 09:53:09 user nova-compute[75122]:     <smbios mode="sysinfo"/>
Nov 15 09:53:09 user nova-compute[75122]:   </os>
Nov 15 09:53:09 user nova-compute[75122]:   <features>
Nov 15 09:53:09 user nova-compute[75122]:     <acpi/>
Nov 15 09:53:09 user nova-compute[75122]:     <apic/>
Nov 15 09:53:09 user nova-compute[75122]:     <vmcoreinfo/>
Nov 15 09:53:09 user nova-compute[75122]:   </features>
Nov 15 09:53:09 user nova-compute[75122]:   <clock offset="utc">
Nov 15 09:53:09 user nova-compute[75122]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 09:53:09 user nova-compute[75122]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 09:53:09 user nova-compute[75122]:     <timer name="hpet" present="no"/>
Nov 15 09:53:09 user nova-compute[75122]:   </clock>
Nov 15 09:53:09 user nova-compute[75122]:   <cpu mode="custom" match="exact">
Nov 15 09:53:09 user nova-compute[75122]:     <model>Nehalem</model>
Nov 15 09:53:09 user nova-compute[75122]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 09:53:09 user nova-compute[75122]:   </cpu>
Nov 15 09:53:09 user nova-compute[75122]:   <devices>
Nov 15 09:53:09 user nova-compute[75122]:     <disk type="file" device="disk">
Nov 15 09:53:09 user nova-compute[75122]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 09:53:09 user nova-compute[75122]:       <source file="/opt/stack/data/nova/instances/be71985e-a370-43d9-adef-afb31d03e2fd/disk"/>
Nov 15 09:53:09 user nova-compute[75122]:       <target dev="vda" bus="virtio"/>
Nov 15 09:53:09 user nova-compute[75122]:     </disk>
Nov 15 09:53:09 user nova-compute[75122]:     <interface type="ethernet">
Nov 15 09:53:09 user nova-compute[75122]:       <mac address="fa:16:3e:fa:cb:ca"/>
Nov 15 09:53:09 user nova-compute[75122]:       <model type="virtio"/>
Nov 15 09:53:09 user nova-compute[75122]:       <mtu size="1442"/>
Nov 15 09:53:09 user nova-compute[75122]:       <target dev="tap4d28d025-01"/>
Nov 15 09:53:09 user nova-compute[75122]:     </interface>
Nov 15 09:53:09 user nova-compute[75122]:     <serial type="pty">
Nov 15 09:53:09 user nova-compute[75122]:       <log file="/opt/stack/data/nova/instances/be71985e-a370-43d9-adef-afb31d03e2fd/console.log" append="off"/>
Nov 15 09:53:09 user nova-compute[75122]:     </serial>
Nov 15 09:53:09 user nova-compute[75122]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 09:53:09 user nova-compute[75122]:     <video>
Nov 15 09:53:09 user nova-compute[75122]:       <model type="virtio"/>
Nov 15 09:53:09 user nova-compute[75122]:     </video>
Nov 15 09:53:09 user nova-compute[75122]:     <rng model="virtio">
Nov 15 09:53:09 user nova-compute[75122]:       <backend model="random">/dev/urandom</backend>
Nov 15 09:53:09 user nova-compute[75122]:     </rng>
Nov 15 09:53:09 user nova-compute[75122]:     <controller type="usb" index="0" model="none"/>
Nov 15 09:53:09 user nova-compute[75122]:     <memballoon model="virtio">
Nov 15 09:53:09 user nova-compute[75122]:       <stats period="10"/>
Nov 15 09:53:09 user nova-compute[75122]:     </memballoon>
Nov 15 09:53:09 user nova-compute[75122]:   </devices>
Nov 15 09:53:09 user nova-compute[75122]: </domain>
Nov 15 09:53:09 user nova-compute[75122]:  {{(pid=75122) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 09:53:09 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-3caf35f1-6b5c-4707-b918-58fa19304bbb tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T09:53:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1825073794',display_name='tempest-ServersNegativeTestJSON-server-1825073794',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1825073794',id=39,image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='88f16d3dc8434cb5ac78c8d2f51d305b',ramdisk_id='',reservation_id='r-qc02nu2a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1688784762',owner_user_name='tempest-ServersNegativeTestJSON-1688784762-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T09:53:08Z,user_data=None,user_id='199452e19f8742ea810c917fbfa0581a',uuid=be71985e-a370-43d9-adef-afb31d03e2fd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4d28d025-0115-4813-b62a-a84ec8c47d58", "address": "fa:16:3e:fa:cb:ca", "network": {"id": "ca2dff40-00d3-46b0-b9e2-dca375439496", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1592022235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88f16d3dc8434cb5ac78c8d2f51d305b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d28d025-01", "ovs_interfaceid": "4d28d025-0115-4813-b62a-a84ec8c47d58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 09:53:09 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-3caf35f1-6b5c-4707-b918-58fa19304bbb tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] Converting VIF {"id": "4d28d025-0115-4813-b62a-a84ec8c47d58", "address": "fa:16:3e:fa:cb:ca", "network": {"id": "ca2dff40-00d3-46b0-b9e2-dca375439496", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1592022235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88f16d3dc8434cb5ac78c8d2f51d305b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d28d025-01", "ovs_interfaceid": "4d28d025-0115-4813-b62a-a84ec8c47d58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 09:53:09 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-3caf35f1-6b5c-4707-b918-58fa19304bbb tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fa:cb:ca,bridge_name='br-int',has_traffic_filtering=True,id=4d28d025-0115-4813-b62a-a84ec8c47d58,network=Network(ca2dff40-00d3-46b0-b9e2-dca375439496),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d28d025-01') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 09:53:09 user nova-compute[75122]: DEBUG os_vif [None req-3caf35f1-6b5c-4707-b918-58fa19304bbb tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fa:cb:ca,bridge_name='br-int',has_traffic_filtering=True,id=4d28d025-0115-4813-b62a-a84ec8c47d58,network=Network(ca2dff40-00d3-46b0-b9e2-dca375439496),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d28d025-01') {{(pid=75122) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 09:53:09 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:53:09 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:53:09 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 09:53:09 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:53:09 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e59dedbb-56a1-5985-8be7-172c53a6bcfd', '_type': 'linux-noop'}}, row=False) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:53:09 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:53:09 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:53:09 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:53:09 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4d28d025-01, may_exist=True, interface_attrs={}) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:53:09 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4d28d025-01, col_values=(('qos', UUID('258dea24-a594-40fd-8a1d-7cb4e88a1912')),), if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:53:09 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4d28d025-01, col_values=(('external_ids', {'iface-id': '4d28d025-0115-4813-b62a-a84ec8c47d58', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fa:cb:ca', 'vm-uuid': 'be71985e-a370-43d9-adef-afb31d03e2fd'}),), if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:53:09 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:53:09 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:53:09 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:53:09 user nova-compute[75122]: INFO os_vif [None req-3caf35f1-6b5c-4707-b918-58fa19304bbb tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fa:cb:ca,bridge_name='br-int',has_traffic_filtering=True,id=4d28d025-0115-4813-b62a-a84ec8c47d58,network=Network(ca2dff40-00d3-46b0-b9e2-dca375439496),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d28d025-01')
Nov 15 09:53:09 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-3caf35f1-6b5c-4707-b918-58fa19304bbb tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] No BDM found with device name vda, not building metadata. {{(pid=75122) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 09:53:09 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-3caf35f1-6b5c-4707-b918-58fa19304bbb tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] No VIF found with MAC fa:16:3e:fa:cb:ca, not building metadata {{(pid=75122) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 09:53:09 user nova-compute[75122]: DEBUG nova.network.neutron [req-9a8476f6-6108-4637-bb45-df1e74f366a8 req-4e68759e-8c1c-4ec2-85f7-709ac0407dd3 service nova] [instance: be71985e-a370-43d9-adef-afb31d03e2fd] Updated VIF entry in instance network info cache for port 4d28d025-0115-4813-b62a-a84ec8c47d58. {{(pid=75122) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 09:53:09 user nova-compute[75122]: DEBUG nova.network.neutron [req-9a8476f6-6108-4637-bb45-df1e74f366a8 req-4e68759e-8c1c-4ec2-85f7-709ac0407dd3 service nova] [instance: be71985e-a370-43d9-adef-afb31d03e2fd] Updating instance_info_cache with network_info: [{"id": "4d28d025-0115-4813-b62a-a84ec8c47d58", "address": "fa:16:3e:fa:cb:ca", "network": {"id": "ca2dff40-00d3-46b0-b9e2-dca375439496", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1592022235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88f16d3dc8434cb5ac78c8d2f51d305b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d28d025-01", "ovs_interfaceid": "4d28d025-0115-4813-b62a-a84ec8c47d58", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:53:09 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-9a8476f6-6108-4637-bb45-df1e74f366a8 req-4e68759e-8c1c-4ec2-85f7-709ac0407dd3 service nova] Releasing lock "refresh_cache-be71985e-a370-43d9-adef-afb31d03e2fd" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 09:53:10 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:53:10 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:53:10 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:53:10 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:53:10 user nova-compute[75122]: DEBUG nova.compute.manager [req-09b4641b-df7e-4ba0-afdf-bf641ba261d8 req-428c31b2-a869-4334-89b8-1db83d7c9f2a service nova] [instance: be71985e-a370-43d9-adef-afb31d03e2fd] Received event network-vif-plugged-4d28d025-0115-4813-b62a-a84ec8c47d58 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:53:10 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-09b4641b-df7e-4ba0-afdf-bf641ba261d8 req-428c31b2-a869-4334-89b8-1db83d7c9f2a service nova] Acquiring lock "be71985e-a370-43d9-adef-afb31d03e2fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:53:10 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-09b4641b-df7e-4ba0-afdf-bf641ba261d8 req-428c31b2-a869-4334-89b8-1db83d7c9f2a service nova] Lock "be71985e-a370-43d9-adef-afb31d03e2fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:53:10 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-09b4641b-df7e-4ba0-afdf-bf641ba261d8 req-428c31b2-a869-4334-89b8-1db83d7c9f2a service nova] Lock "be71985e-a370-43d9-adef-afb31d03e2fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:53:10 user nova-compute[75122]: DEBUG nova.compute.manager [req-09b4641b-df7e-4ba0-afdf-bf641ba261d8 req-428c31b2-a869-4334-89b8-1db83d7c9f2a service nova] [instance: be71985e-a370-43d9-adef-afb31d03e2fd] No waiting events found dispatching network-vif-plugged-4d28d025-0115-4813-b62a-a84ec8c47d58 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:53:10 user nova-compute[75122]: WARNING nova.compute.manager [req-09b4641b-df7e-4ba0-afdf-bf641ba261d8 req-428c31b2-a869-4334-89b8-1db83d7c9f2a service nova] [instance: be71985e-a370-43d9-adef-afb31d03e2fd] Received unexpected event network-vif-plugged-4d28d025-0115-4813-b62a-a84ec8c47d58 for instance with vm_state building and task_state spawning.
Nov 15 09:53:11 user nova-compute[75122]: DEBUG os_brick.utils [None req-8d87a524-9428-4db8-a926-798eee36a3e1 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 09:53:11 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:53:11 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:53:11 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7601ead-1ffd-4282-ae06-490964bfe458]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:742fb64b3587\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:53:11 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:53:11 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:53:11 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[55c10726-b01b-4e70-a3ae-be8ae7c38dc3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:53:11 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:53:11 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:53:11 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[27465297-a325-4f9e-bae0-30e0307ee43c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:53:11 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ed493be-8d88-40a3-821f-6d4a71b80463]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:53:11 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-8d87a524-9428-4db8-a926-798eee36a3e1 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Running cmd (subprocess): nvme version {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:53:11 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-8d87a524-9428-4db8-a926-798eee36a3e1 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] 'nvme version' failed. Not Retrying. {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 09:53:11 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:53:11 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8d87a524-9428-4db8-a926-798eee36a3e1 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] nvme not present on system {{(pid=75122) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 09:53:11 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:53:11 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 09:53:11 user nova-compute[75122]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 09:53:11 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1f3d310-4680-47f7-a25b-56857ff774a2]: (4, '') {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:53:11 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.lightos [None req-8d87a524-9428-4db8-a926-798eee36a3e1 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75122) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 09:53:11 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.lightos [None req-8d87a524-9428-4db8-a926-798eee36a3e1 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75122) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 09:53:11 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.lightos [None req-8d87a524-9428-4db8-a926-798eee36a3e1 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] LIGHTOS: no hostnqn found. {{(pid=75122) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 09:53:11 user nova-compute[75122]: DEBUG os_brick.utils [None req-8d87a524-9428-4db8-a926-798eee36a3e1 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:742fb64b3587', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 09:53:11 user nova-compute[75122]: DEBUG nova.virt.block_device [None req-8d87a524-9428-4db8-a926-798eee36a3e1 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: db848537-676f-464a-806d-febb14d920a6] Updating existing volume attachment record: 28d48839-78ea-444d-9bf0-69f76cd77a50 {{(pid=75122) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 09:53:11 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:53:12 user nova-compute[75122]: DEBUG nova.compute.manager [None req-3caf35f1-6b5c-4707-b918-58fa19304bbb tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] [instance: be71985e-a370-43d9-adef-afb31d03e2fd] Instance event wait completed in 0 seconds for  {{(pid=75122) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 09:53:12 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-3caf35f1-6b5c-4707-b918-58fa19304bbb tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] [instance: be71985e-a370-43d9-adef-afb31d03e2fd] Guest created on hypervisor {{(pid=75122) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 09:53:12 user nova-compute[75122]: INFO nova.virt.libvirt.driver [-] [instance: be71985e-a370-43d9-adef-afb31d03e2fd] Instance spawned successfully.
Nov 15 09:53:12 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-3caf35f1-6b5c-4707-b918-58fa19304bbb tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] [instance: be71985e-a370-43d9-adef-afb31d03e2fd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 09:53:12 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-3caf35f1-6b5c-4707-b918-58fa19304bbb tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] [instance: be71985e-a370-43d9-adef-afb31d03e2fd] Found default for hw_cdrom_bus of ide {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:53:12 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-3caf35f1-6b5c-4707-b918-58fa19304bbb tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] [instance: be71985e-a370-43d9-adef-afb31d03e2fd] Found default for hw_disk_bus of virtio {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:53:12 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-3caf35f1-6b5c-4707-b918-58fa19304bbb tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] [instance: be71985e-a370-43d9-adef-afb31d03e2fd] Found default for hw_input_bus of None {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:53:12 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-3caf35f1-6b5c-4707-b918-58fa19304bbb tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] [instance: be71985e-a370-43d9-adef-afb31d03e2fd] Found default for hw_pointer_model of None {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:53:12 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-3caf35f1-6b5c-4707-b918-58fa19304bbb tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] [instance: be71985e-a370-43d9-adef-afb31d03e2fd] Found default for hw_video_model of virtio {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:53:12 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-3caf35f1-6b5c-4707-b918-58fa19304bbb tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] [instance: be71985e-a370-43d9-adef-afb31d03e2fd] Found default for hw_vif_model of virtio {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:53:12 user nova-compute[75122]: DEBUG nova.compute.manager [req-a57dfea6-9875-4df0-9793-fa8697b7c9c5 req-e2a10780-74cd-4d64-82e8-1736427fb477 service nova] [instance: be71985e-a370-43d9-adef-afb31d03e2fd] Received event network-vif-plugged-4d28d025-0115-4813-b62a-a84ec8c47d58 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:53:12 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-a57dfea6-9875-4df0-9793-fa8697b7c9c5 req-e2a10780-74cd-4d64-82e8-1736427fb477 service nova] Acquiring lock "be71985e-a370-43d9-adef-afb31d03e2fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:53:12 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-a57dfea6-9875-4df0-9793-fa8697b7c9c5 req-e2a10780-74cd-4d64-82e8-1736427fb477 service nova] Lock "be71985e-a370-43d9-adef-afb31d03e2fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:53:12 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-a57dfea6-9875-4df0-9793-fa8697b7c9c5 req-e2a10780-74cd-4d64-82e8-1736427fb477 service nova] Lock "be71985e-a370-43d9-adef-afb31d03e2fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:53:12 user nova-compute[75122]: DEBUG nova.compute.manager [req-a57dfea6-9875-4df0-9793-fa8697b7c9c5 req-e2a10780-74cd-4d64-82e8-1736427fb477 service nova] [instance: be71985e-a370-43d9-adef-afb31d03e2fd] No waiting events found dispatching network-vif-plugged-4d28d025-0115-4813-b62a-a84ec8c47d58 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:53:12 user nova-compute[75122]: WARNING nova.compute.manager [req-a57dfea6-9875-4df0-9793-fa8697b7c9c5 req-e2a10780-74cd-4d64-82e8-1736427fb477 service nova] [instance: be71985e-a370-43d9-adef-afb31d03e2fd] Received unexpected event network-vif-plugged-4d28d025-0115-4813-b62a-a84ec8c47d58 for instance with vm_state building and task_state spawning.
Nov 15 09:53:12 user nova-compute[75122]: INFO nova.compute.manager [None req-3caf35f1-6b5c-4707-b918-58fa19304bbb tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] [instance: be71985e-a370-43d9-adef-afb31d03e2fd] Took 5.11 seconds to spawn the instance on the hypervisor.
Nov 15 09:53:12 user nova-compute[75122]: DEBUG nova.compute.manager [None req-3caf35f1-6b5c-4707-b918-58fa19304bbb tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] [instance: be71985e-a370-43d9-adef-afb31d03e2fd] Checking state {{(pid=75122) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 09:53:12 user nova-compute[75122]: INFO nova.compute.manager [None req-3caf35f1-6b5c-4707-b918-58fa19304bbb tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] [instance: be71985e-a370-43d9-adef-afb31d03e2fd] Took 5.69 seconds to build instance.
Nov 15 09:53:12 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-3caf35f1-6b5c-4707-b918-58fa19304bbb tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] Lock "be71985e-a370-43d9-adef-afb31d03e2fd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.812s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:53:14 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:53:16 user nova-compute[75122]: DEBUG nova.compute.manager [None req-8d87a524-9428-4db8-a926-798eee36a3e1 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: db848537-676f-464a-806d-febb14d920a6] Start spawning the instance on the hypervisor. {{(pid=75122) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 09:53:16 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-8d87a524-9428-4db8-a926-798eee36a3e1 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: db848537-676f-464a-806d-febb14d920a6] Creating instance directory {{(pid=75122) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 09:53:16 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-8d87a524-9428-4db8-a926-798eee36a3e1 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: db848537-676f-464a-806d-febb14d920a6] Creating image(s)
Nov 15 09:53:16 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-8d87a524-9428-4db8-a926-798eee36a3e1 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: db848537-676f-464a-806d-febb14d920a6] Did not create local disks {{(pid=75122) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 09:53:16 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-8d87a524-9428-4db8-a926-798eee36a3e1 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: db848537-676f-464a-806d-febb14d920a6] Ensure instance console log exists: /opt/stack/data/nova/instances/db848537-676f-464a-806d-febb14d920a6/console.log {{(pid=75122) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 09:53:16 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-8d87a524-9428-4db8-a926-798eee36a3e1 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:53:16 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-8d87a524-9428-4db8-a926-798eee36a3e1 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:53:16 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-8d87a524-9428-4db8-a926-798eee36a3e1 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:53:16 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-8d87a524-9428-4db8-a926-798eee36a3e1 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: db848537-676f-464a-806d-febb14d920a6] Start _get_guest_xml network_info=[{"id": "93bbff2d-1d5c-47db-b436-43796849be51", "address": "fa:16:3e:eb:e9:ca", "network": {"id": "b780d5c1-a549-4b49-a036-5a272697d4b6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-229344021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c046170a2ad44ebba5d2de236d940be0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93bbff2d-1d", "ovs_interfaceid": "93bbff2d-1d5c-47db-b436-43796849be51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T09:26:31Z,direct_url=<?>,disk_format='qcow2',id=5e862cfe-47b8-4725-8292-65761ee6d0f5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9c57733cb41847c0b4ad31519c382e5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T09:26:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:8ee79db2-27c2-4d0f-8ee6-5b03e05ebba5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RHSYjytT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'db848537-676f-464a-806d-febb14d920a6', 'attached_at': '', 'detached_at': '', 'volume_id': '8ee79db2-27c2-4d0f-8ee6-5b03e05ebba5', 'serial': '8ee79db2-27c2-4d0f-8ee6-5b03e05ebba5'}, 'guest_format': None, 'delete_on_termination': False, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vda', 'attachment_id': '28d48839-78ea-444d-9bf0-69f76cd77a50', 'volume_type': None} {{(pid=75122) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 09:53:16 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-8d87a524-9428-4db8-a926-798eee36a3e1 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 09:53:16 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-8d87a524-9428-4db8-a926-798eee36a3e1 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 09:53:16 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-8d87a524-9428-4db8-a926-798eee36a3e1 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75122) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 09:53:16 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-8d87a524-9428-4db8-a926-798eee36a3e1 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] CPU controller missing on host. {{(pid=75122) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 09:53:16 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-8d87a524-9428-4db8-a926-798eee36a3e1 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75122) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 09:53:16 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-8d87a524-9428-4db8-a926-798eee36a3e1 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] CPU controller found on host. {{(pid=75122) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 09:53:16 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-8d87a524-9428-4db8-a926-798eee36a3e1 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75122) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 09:53:16 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-8d87a524-9428-4db8-a926-798eee36a3e1 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T09:26:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T09:26:31Z,direct_url=<?>,disk_format='qcow2',id=5e862cfe-47b8-4725-8292-65761ee6d0f5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9c57733cb41847c0b4ad31519c382e5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T09:26:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 09:53:16 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-8d87a524-9428-4db8-a926-798eee36a3e1 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Flavor limits 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 09:53:16 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-8d87a524-9428-4db8-a926-798eee36a3e1 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Image limits 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 09:53:16 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-8d87a524-9428-4db8-a926-798eee36a3e1 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Flavor pref 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 09:53:16 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-8d87a524-9428-4db8-a926-798eee36a3e1 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Image pref 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 09:53:16 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-8d87a524-9428-4db8-a926-798eee36a3e1 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 09:53:16 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-8d87a524-9428-4db8-a926-798eee36a3e1 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 09:53:16 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-8d87a524-9428-4db8-a926-798eee36a3e1 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75122) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 09:53:16 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-8d87a524-9428-4db8-a926-798eee36a3e1 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Got 1 possible topologies {{(pid=75122) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 09:53:16 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-8d87a524-9428-4db8-a926-798eee36a3e1 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 09:53:16 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-8d87a524-9428-4db8-a926-798eee36a3e1 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 09:53:16 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8d87a524-9428-4db8-a926-798eee36a3e1 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: db848537-676f-464a-806d-febb14d920a6] Calling os-brick to attach iSCSI Volume {{(pid=75122) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 09:53:16 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d87a524-9428-4db8-a926-798eee36a3e1 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffa04060b80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8ee79db2-27c2-4d0f-8ee6-5b03e05ebba5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RHSYjytT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 09:53:16 user nova-compute[75122]: WARNING os_brick.initiator.connectors.base [None req-8d87a524-9428-4db8-a926-798eee36a3e1 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 09:53:16 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-8d87a524-9428-4db8-a926-798eee36a3e1 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 09:53:16 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-8d87a524-9428-4db8-a926-798eee36a3e1 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 09:53:16 user nova-compute[75122]: WARNING os_brick.initiator.connectors.base [None req-8d87a524-9428-4db8-a926-798eee36a3e1 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 09:53:16 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-8d87a524-9428-4db8-a926-798eee36a3e1 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8ee79db2-27c2-4d0f-8ee6-5b03e05ebba5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 09:53:16 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-8d87a524-9428-4db8-a926-798eee36a3e1 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8ee79db2-27c2-4d0f-8ee6-5b03e05ebba5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 09:53:16 user nova-compute[75122]: INFO os_brick.initiator.connectors.iscsi [None req-8d87a524-9428-4db8-a926-798eee36a3e1 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 09:53:16 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ee79db2-27c2-4d0f-8ee6-5b03e05ebba5 -p 172.16.0.220:3260 {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:53:16 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ee79db2-27c2-4d0f-8ee6-5b03e05ebba5 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:53:16 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[327d6dd1-cb06-45d2-ac8a-8aacd4e4b832]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:53:16 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d87a524-9428-4db8-a926-798eee36a3e1 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 09:53:16 user nova-compute[75122]:  {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:53:16 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ee79db2-27c2-4d0f-8ee6-5b03e05ebba5 -p 172.16.0.220:3260 --interface default --op new {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:53:16 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ee79db2-27c2-4d0f-8ee6-5b03e05ebba5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:53:16 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[139d670c-5e7d-471d-8635-271cf3ef53dc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8ee79db2-27c2-4d0f-8ee6-5b03e05ebba5] added\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:53:16 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d87a524-9428-4db8-a926-798eee36a3e1 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8ee79db2-27c2-4d0f-8ee6-5b03e05ebba5] added
Nov 15 09:53:16 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:53:16 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ee79db2-27c2-4d0f-8ee6-5b03e05ebba5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:53:16 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ee79db2-27c2-4d0f-8ee6-5b03e05ebba5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:53:16 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f513887-b0f9-48aa-aa65-aae3a2958562]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:53:16 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d87a524-9428-4db8-a926-798eee36a3e1 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:53:16 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ee79db2-27c2-4d0f-8ee6-5b03e05ebba5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:53:16 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ee79db2-27c2-4d0f-8ee6-5b03e05ebba5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:53:16 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e78ab24-2162-4230-bded-e1277cfbe77d]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:53:16 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d87a524-9428-4db8-a926-798eee36a3e1 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:53:16 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ee79db2-27c2-4d0f-8ee6-5b03e05ebba5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RHSYjytT {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:53:16 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ee79db2-27c2-4d0f-8ee6-5b03e05ebba5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RHSYjytT" returned: 0 in 0.019s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:53:16 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[2430679b-ae31-406f-808b-8a5ac66772cc]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:53:16 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d87a524-9428-4db8-a926-798eee36a3e1 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RHSYjytT'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:53:16 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ee79db2-27c2-4d0f-8ee6-5b03e05ebba5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:53:16 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ee79db2-27c2-4d0f-8ee6-5b03e05ebba5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:53:16 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[16bb1539-4064-452d-b63b-2f4082585cf4]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:53:16 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d87a524-9428-4db8-a926-798eee36a3e1 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:53:16 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:53:16 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:53:16 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[c64d8ddb-911a-4f76-b1e3-f52ef8af454b]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:53:16 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d87a524-9428-4db8-a926-798eee36a3e1 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 15 09:53:16 user nova-compute[75122]:  {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 09:53:16 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d87a524-9428-4db8-a926-798eee36a3e1 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 15 09:53:16 user nova-compute[75122]:  {{(pid=75122) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 09:53:16 user nova-compute[75122]: WARNING os_brick.initiator.connectors.iscsi [None req-8d87a524-9428-4db8-a926-798eee36a3e1 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 15 09:53:16 user nova-compute[75122]: 
Nov 15 09:53:16 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ee79db2-27c2-4d0f-8ee6-5b03e05ebba5 -p 172.16.0.220:3260 --login {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:53:16 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ee79db2-27c2-4d0f-8ee6-5b03e05ebba5 -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:53:16 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[934a75ca-eaea-4f49-9670-ba2d208fd08b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8ee79db2-27c2-4d0f-8ee6-5b03e05ebba5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8ee79db2-27c2-4d0f-8ee6-5b03e05ebba5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:53:16 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d87a524-9428-4db8-a926-798eee36a3e1 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8ee79db2-27c2-4d0f-8ee6-5b03e05ebba5, portal: 172.16.0.220,3260]
Nov 15 09:53:16 user nova-compute[75122]: Login to [iface: default, target: iqn.2010-10.org.openstack:8ee79db2-27c2-4d0f-8ee6-5b03e05ebba5, portal: 172.16.0.220,3260] successful.
Nov 15 09:53:16 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:53:16 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ee79db2-27c2-4d0f-8ee6-5b03e05ebba5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:53:16 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ee79db2-27c2-4d0f-8ee6-5b03e05ebba5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:53:16 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eb356ef-cac2-45ab-abb9-acddf60df79f]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:53:16 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d87a524-9428-4db8-a926-798eee36a3e1 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:53:16 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:53:16 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:53:16 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac433e8d-4c20-4924-a360-c630e2911f08]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee79db2-27c2-4d0f-8ee6-5b03e05ebba5 (non-flash)\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:53:16 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d87a524-9428-4db8-a926-798eee36a3e1 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee79db2-27c2-4d0f-8ee6-5b03e05ebba5 (non-flash)
Nov 15 09:53:16 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 09:53:16 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d87a524-9428-4db8-a926-798eee36a3e1 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee79db2-27c2-4d0f-8ee6-5b03e05ebba5 (non-flash)
Nov 15 09:53:16 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 09:53:16 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-8d87a524-9428-4db8-a926-798eee36a3e1 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8ee79db2-27c2-4d0f-8ee6-5b03e05ebba5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.246s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 09:53:16 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d87a524-9428-4db8-a926-798eee36a3e1 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Connected to 172.16.0.220:3260 {{(pid=75122) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 09:53:16 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-8d87a524-9428-4db8-a926-798eee36a3e1 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] HCTL ('33', '-', '-', 0) found on session 47 with lun 0 {{(pid=75122) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 09:53:16 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-8d87a524-9428-4db8-a926-798eee36a3e1 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75122) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 09:53:16 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:53:16 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:53:16 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb0ddd30-84fb-4951-bfec-8dbd8e67f139]: (4, ('- - 0', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:53:16 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-8d87a524-9428-4db8-a926-798eee36a3e1 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Searching for a device in session 47 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75122) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 09:53:16 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d87a524-9428-4db8-a926-798eee36a3e1 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:8ee79db2-27c2-4d0f-8ee6-5b03e05ebba5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RHSYjytT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75122) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 09:53:16 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:53:17 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-8d87a524-9428-4db8-a926-798eee36a3e1 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.277s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 09:53:17 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d87a524-9428-4db8-a926-798eee36a3e1 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] <== connect_volume: return (1278ms) {'type': 'block', 'scsi_wwn': '26638333934383834', 'path': '/dev/sdb'} {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 09:53:17 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8d87a524-9428-4db8-a926-798eee36a3e1 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: db848537-676f-464a-806d-febb14d920a6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26638333934383834', 'path': '/dev/sdb'} {{(pid=75122) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 09:53:17 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-8d87a524-9428-4db8-a926-798eee36a3e1 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T09:53:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2092457370',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2092457370',id=38,image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c046170a2ad44ebba5d2de236d940be0',ramdisk_id='',reservation_id='r-dk2qzsg4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1545444983',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T09:53:06Z,user_data=None,user_id='53d187e2a07b4437a02f65fb47a003ee',uuid=db848537-676f-464a-806d-febb14d920a6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "93bbff2d-1d5c-47db-b436-43796849be51", "address": "fa:16:3e:eb:e9:ca", "network": {"id": "b780d5c1-a549-4b49-a036-5a272697d4b6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-229344021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c046170a2ad44ebba5d2de236d940be0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93bbff2d-1d", "ovs_interfaceid": "93bbff2d-1d5c-47db-b436-43796849be51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75122) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 09:53:17 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-8d87a524-9428-4db8-a926-798eee36a3e1 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Converting VIF {"id": "93bbff2d-1d5c-47db-b436-43796849be51", "address": "fa:16:3e:eb:e9:ca", "network": {"id": "b780d5c1-a549-4b49-a036-5a272697d4b6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-229344021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c046170a2ad44ebba5d2de236d940be0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93bbff2d-1d", "ovs_interfaceid": "93bbff2d-1d5c-47db-b436-43796849be51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 09:53:17 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-8d87a524-9428-4db8-a926-798eee36a3e1 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:eb:e9:ca,bridge_name='br-int',has_traffic_filtering=True,id=93bbff2d-1d5c-47db-b436-43796849be51,network=Network(b780d5c1-a549-4b49-a036-5a272697d4b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93bbff2d-1d') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 09:53:17 user nova-compute[75122]: DEBUG nova.objects.instance [None req-8d87a524-9428-4db8-a926-798eee36a3e1 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Lazy-loading 'pci_devices' on Instance uuid db848537-676f-464a-806d-febb14d920a6 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:53:17 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-8d87a524-9428-4db8-a926-798eee36a3e1 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: db848537-676f-464a-806d-febb14d920a6] End _get_guest_xml xml=<domain type="kvm">
Nov 15 09:53:17 user nova-compute[75122]:   <uuid>db848537-676f-464a-806d-febb14d920a6</uuid>
Nov 15 09:53:17 user nova-compute[75122]:   <name>instance-00000026</name>
Nov 15 09:53:17 user nova-compute[75122]:   <memory>524288</memory>
Nov 15 09:53:17 user nova-compute[75122]:   <vcpu>1</vcpu>
Nov 15 09:53:17 user nova-compute[75122]:   <metadata>
Nov 15 09:53:17 user nova-compute[75122]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 09:53:17 user nova-compute[75122]:       <nova:package version="0.0.0"/>
Nov 15 09:53:17 user nova-compute[75122]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-2092457370</nova:name>
Nov 15 09:53:17 user nova-compute[75122]:       <nova:creationTime>2023-11-15 09:53:16</nova:creationTime>
Nov 15 09:53:17 user nova-compute[75122]:       <nova:flavor name="m1.tiny">
Nov 15 09:53:17 user nova-compute[75122]:         <nova:memory>512</nova:memory>
Nov 15 09:53:17 user nova-compute[75122]:         <nova:disk>1</nova:disk>
Nov 15 09:53:17 user nova-compute[75122]:         <nova:swap>0</nova:swap>
Nov 15 09:53:17 user nova-compute[75122]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 09:53:17 user nova-compute[75122]:         <nova:vcpus>1</nova:vcpus>
Nov 15 09:53:17 user nova-compute[75122]:       </nova:flavor>
Nov 15 09:53:17 user nova-compute[75122]:       <nova:owner>
Nov 15 09:53:17 user nova-compute[75122]:         <nova:user uuid="53d187e2a07b4437a02f65fb47a003ee">tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member</nova:user>
Nov 15 09:53:17 user nova-compute[75122]:         <nova:project uuid="c046170a2ad44ebba5d2de236d940be0">tempest-ServerBootFromVolumeStableRescueTest-1545444983</nova:project>
Nov 15 09:53:17 user nova-compute[75122]:       </nova:owner>
Nov 15 09:53:17 user nova-compute[75122]:       <nova:root type="image" uuid="5e862cfe-47b8-4725-8292-65761ee6d0f5"/>
Nov 15 09:53:17 user nova-compute[75122]:       <nova:ports>
Nov 15 09:53:17 user nova-compute[75122]:         <nova:port uuid="93bbff2d-1d5c-47db-b436-43796849be51">
Nov 15 09:53:17 user nova-compute[75122]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 15 09:53:17 user nova-compute[75122]:         </nova:port>
Nov 15 09:53:17 user nova-compute[75122]:       </nova:ports>
Nov 15 09:53:17 user nova-compute[75122]:     </nova:instance>
Nov 15 09:53:17 user nova-compute[75122]:   </metadata>
Nov 15 09:53:17 user nova-compute[75122]:   <sysinfo type="smbios">
Nov 15 09:53:17 user nova-compute[75122]:     <system>
Nov 15 09:53:17 user nova-compute[75122]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 09:53:17 user nova-compute[75122]:       <entry name="product">OpenStack Nova</entry>
Nov 15 09:53:17 user nova-compute[75122]:       <entry name="version">0.0.0</entry>
Nov 15 09:53:17 user nova-compute[75122]:       <entry name="serial">db848537-676f-464a-806d-febb14d920a6</entry>
Nov 15 09:53:17 user nova-compute[75122]:       <entry name="uuid">db848537-676f-464a-806d-febb14d920a6</entry>
Nov 15 09:53:17 user nova-compute[75122]:       <entry name="family">Virtual Machine</entry>
Nov 15 09:53:17 user nova-compute[75122]:     </system>
Nov 15 09:53:17 user nova-compute[75122]:   </sysinfo>
Nov 15 09:53:17 user nova-compute[75122]:   <os>
Nov 15 09:53:17 user nova-compute[75122]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 09:53:17 user nova-compute[75122]:     <boot dev="hd"/>
Nov 15 09:53:17 user nova-compute[75122]:     <smbios mode="sysinfo"/>
Nov 15 09:53:17 user nova-compute[75122]:   </os>
Nov 15 09:53:17 user nova-compute[75122]:   <features>
Nov 15 09:53:17 user nova-compute[75122]:     <acpi/>
Nov 15 09:53:17 user nova-compute[75122]:     <apic/>
Nov 15 09:53:17 user nova-compute[75122]:     <vmcoreinfo/>
Nov 15 09:53:17 user nova-compute[75122]:   </features>
Nov 15 09:53:17 user nova-compute[75122]:   <clock offset="utc">
Nov 15 09:53:17 user nova-compute[75122]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 09:53:17 user nova-compute[75122]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 09:53:17 user nova-compute[75122]:     <timer name="hpet" present="no"/>
Nov 15 09:53:17 user nova-compute[75122]:   </clock>
Nov 15 09:53:17 user nova-compute[75122]:   <cpu mode="custom" match="exact">
Nov 15 09:53:17 user nova-compute[75122]:     <model>Nehalem</model>
Nov 15 09:53:17 user nova-compute[75122]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 09:53:17 user nova-compute[75122]:   </cpu>
Nov 15 09:53:17 user nova-compute[75122]:   <devices>
Nov 15 09:53:17 user nova-compute[75122]:     <disk type="block" device="disk">
Nov 15 09:53:17 user nova-compute[75122]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 09:53:17 user nova-compute[75122]:       <source dev="/dev/sdb"/>
Nov 15 09:53:17 user nova-compute[75122]:       <target dev="vda" bus="virtio"/>
Nov 15 09:53:17 user nova-compute[75122]:       <serial>8ee79db2-27c2-4d0f-8ee6-5b03e05ebba5</serial>
Nov 15 09:53:17 user nova-compute[75122]:     </disk>
Nov 15 09:53:17 user nova-compute[75122]:     <interface type="ethernet">
Nov 15 09:53:17 user nova-compute[75122]:       <mac address="fa:16:3e:eb:e9:ca"/>
Nov 15 09:53:17 user nova-compute[75122]:       <model type="virtio"/>
Nov 15 09:53:17 user nova-compute[75122]:       <mtu size="1442"/>
Nov 15 09:53:17 user nova-compute[75122]:       <target dev="tap93bbff2d-1d"/>
Nov 15 09:53:17 user nova-compute[75122]:     </interface>
Nov 15 09:53:17 user nova-compute[75122]:     <serial type="pty">
Nov 15 09:53:17 user nova-compute[75122]:       <log file="/opt/stack/data/nova/instances/db848537-676f-464a-806d-febb14d920a6/console.log" append="off"/>
Nov 15 09:53:17 user nova-compute[75122]:     </serial>
Nov 15 09:53:17 user nova-compute[75122]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 09:53:17 user nova-compute[75122]:     <video>
Nov 15 09:53:17 user nova-compute[75122]:       <model type="virtio"/>
Nov 15 09:53:17 user nova-compute[75122]:     </video>
Nov 15 09:53:17 user nova-compute[75122]:     <rng model="virtio">
Nov 15 09:53:17 user nova-compute[75122]:       <backend model="random">/dev/urandom</backend>
Nov 15 09:53:17 user nova-compute[75122]:     </rng>
Nov 15 09:53:17 user nova-compute[75122]:     <controller type="usb" index="0" model="none"/>
Nov 15 09:53:17 user nova-compute[75122]:     <memballoon model="virtio">
Nov 15 09:53:17 user nova-compute[75122]:       <stats period="10"/>
Nov 15 09:53:17 user nova-compute[75122]:     </memballoon>
Nov 15 09:53:17 user nova-compute[75122]:   </devices>
Nov 15 09:53:17 user nova-compute[75122]: </domain>
Nov 15 09:53:17 user nova-compute[75122]:  {{(pid=75122) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 09:53:17 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-8d87a524-9428-4db8-a926-798eee36a3e1 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T09:53:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2092457370',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2092457370',id=38,image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c046170a2ad44ebba5d2de236d940be0',ramdisk_id='',reservation_id='r-dk2qzsg4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1545444983',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T09:53:06Z,user_data=None,user_id='53d187e2a07b4437a02f65fb47a003ee',uuid=db848537-676f-464a-806d-febb14d920a6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "93bbff2d-1d5c-47db-b436-43796849be51", "address": "fa:16:3e:eb:e9:ca", "network": {"id": "b780d5c1-a549-4b49-a036-5a272697d4b6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-229344021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c046170a2ad44ebba5d2de236d940be0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93bbff2d-1d", "ovs_interfaceid": "93bbff2d-1d5c-47db-b436-43796849be51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 09:53:17 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-8d87a524-9428-4db8-a926-798eee36a3e1 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Converting VIF {"id": "93bbff2d-1d5c-47db-b436-43796849be51", "address": "fa:16:3e:eb:e9:ca", "network": {"id": "b780d5c1-a549-4b49-a036-5a272697d4b6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-229344021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c046170a2ad44ebba5d2de236d940be0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93bbff2d-1d", "ovs_interfaceid": "93bbff2d-1d5c-47db-b436-43796849be51", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 09:53:17 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-8d87a524-9428-4db8-a926-798eee36a3e1 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:eb:e9:ca,bridge_name='br-int',has_traffic_filtering=True,id=93bbff2d-1d5c-47db-b436-43796849be51,network=Network(b780d5c1-a549-4b49-a036-5a272697d4b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93bbff2d-1d') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 09:53:17 user nova-compute[75122]: DEBUG os_vif [None req-8d87a524-9428-4db8-a926-798eee36a3e1 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:e9:ca,bridge_name='br-int',has_traffic_filtering=True,id=93bbff2d-1d5c-47db-b436-43796849be51,network=Network(b780d5c1-a549-4b49-a036-5a272697d4b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93bbff2d-1d') {{(pid=75122) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 09:53:17 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:53:17 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:53:17 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 09:53:17 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:53:17 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '520cef8f-d427-541f-b1b6-14d360158b17', '_type': 'linux-noop'}}, row=False) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:53:17 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:53:17 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:53:17 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:53:17 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap93bbff2d-1d, may_exist=True, interface_attrs={}) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:53:17 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap93bbff2d-1d, col_values=(('qos', UUID('ead01721-ae48-4e90-bade-0b30230f5585')),), if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:53:17 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap93bbff2d-1d, col_values=(('external_ids', {'iface-id': '93bbff2d-1d5c-47db-b436-43796849be51', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:eb:e9:ca', 'vm-uuid': 'db848537-676f-464a-806d-febb14d920a6'}),), if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:53:17 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:53:17 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:53:17 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:53:17 user nova-compute[75122]: INFO os_vif [None req-8d87a524-9428-4db8-a926-798eee36a3e1 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:e9:ca,bridge_name='br-int',has_traffic_filtering=True,id=93bbff2d-1d5c-47db-b436-43796849be51,network=Network(b780d5c1-a549-4b49-a036-5a272697d4b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93bbff2d-1d')
Nov 15 09:53:17 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-8d87a524-9428-4db8-a926-798eee36a3e1 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] No BDM found with device name vda, not building metadata. {{(pid=75122) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 09:53:17 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-8d87a524-9428-4db8-a926-798eee36a3e1 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] No VIF found with MAC fa:16:3e:eb:e9:ca, not building metadata {{(pid=75122) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 09:53:18 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:53:18 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:53:18 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:53:18 user nova-compute[75122]: DEBUG nova.compute.manager [req-3491f420-a40c-4608-b7e5-0c9b23e12003 req-cfb77569-962e-4b2b-ac01-6cfe1029879b service nova] [instance: db848537-676f-464a-806d-febb14d920a6] Received event network-vif-plugged-93bbff2d-1d5c-47db-b436-43796849be51 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:53:18 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-3491f420-a40c-4608-b7e5-0c9b23e12003 req-cfb77569-962e-4b2b-ac01-6cfe1029879b service nova] Acquiring lock "db848537-676f-464a-806d-febb14d920a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:53:18 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-3491f420-a40c-4608-b7e5-0c9b23e12003 req-cfb77569-962e-4b2b-ac01-6cfe1029879b service nova] Lock "db848537-676f-464a-806d-febb14d920a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:53:18 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-3491f420-a40c-4608-b7e5-0c9b23e12003 req-cfb77569-962e-4b2b-ac01-6cfe1029879b service nova] Lock "db848537-676f-464a-806d-febb14d920a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:53:18 user nova-compute[75122]: DEBUG nova.compute.manager [req-3491f420-a40c-4608-b7e5-0c9b23e12003 req-cfb77569-962e-4b2b-ac01-6cfe1029879b service nova] [instance: db848537-676f-464a-806d-febb14d920a6] No waiting events found dispatching network-vif-plugged-93bbff2d-1d5c-47db-b436-43796849be51 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:53:18 user nova-compute[75122]: WARNING nova.compute.manager [req-3491f420-a40c-4608-b7e5-0c9b23e12003 req-cfb77569-962e-4b2b-ac01-6cfe1029879b service nova] [instance: db848537-676f-464a-806d-febb14d920a6] Received unexpected event network-vif-plugged-93bbff2d-1d5c-47db-b436-43796849be51 for instance with vm_state building and task_state spawning.
Nov 15 09:53:19 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:53:19 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:53:20 user nova-compute[75122]: DEBUG nova.compute.manager [None req-8d87a524-9428-4db8-a926-798eee36a3e1 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: db848537-676f-464a-806d-febb14d920a6] Instance event wait completed in 0 seconds for  {{(pid=75122) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 09:53:20 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-8d87a524-9428-4db8-a926-798eee36a3e1 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: db848537-676f-464a-806d-febb14d920a6] Guest created on hypervisor {{(pid=75122) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 09:53:20 user nova-compute[75122]: INFO nova.virt.libvirt.driver [-] [instance: db848537-676f-464a-806d-febb14d920a6] Instance spawned successfully.
Nov 15 09:53:20 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-8d87a524-9428-4db8-a926-798eee36a3e1 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: db848537-676f-464a-806d-febb14d920a6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 09:53:20 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-8d87a524-9428-4db8-a926-798eee36a3e1 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: db848537-676f-464a-806d-febb14d920a6] Found default for hw_cdrom_bus of ide {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:53:20 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-8d87a524-9428-4db8-a926-798eee36a3e1 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: db848537-676f-464a-806d-febb14d920a6] Found default for hw_disk_bus of virtio {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:53:20 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-8d87a524-9428-4db8-a926-798eee36a3e1 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: db848537-676f-464a-806d-febb14d920a6] Found default for hw_input_bus of None {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:53:20 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-8d87a524-9428-4db8-a926-798eee36a3e1 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: db848537-676f-464a-806d-febb14d920a6] Found default for hw_pointer_model of None {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:53:20 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-8d87a524-9428-4db8-a926-798eee36a3e1 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: db848537-676f-464a-806d-febb14d920a6] Found default for hw_video_model of virtio {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:53:20 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-8d87a524-9428-4db8-a926-798eee36a3e1 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: db848537-676f-464a-806d-febb14d920a6] Found default for hw_vif_model of virtio {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:53:21 user nova-compute[75122]: DEBUG nova.compute.manager [req-05a05cd2-ba97-467c-8bb5-838cc2ae688d req-920750ee-97a5-4e67-90de-8191847cdd7d service nova] [instance: db848537-676f-464a-806d-febb14d920a6] Received event network-vif-plugged-93bbff2d-1d5c-47db-b436-43796849be51 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:53:21 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-05a05cd2-ba97-467c-8bb5-838cc2ae688d req-920750ee-97a5-4e67-90de-8191847cdd7d service nova] Acquiring lock "db848537-676f-464a-806d-febb14d920a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:53:21 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-05a05cd2-ba97-467c-8bb5-838cc2ae688d req-920750ee-97a5-4e67-90de-8191847cdd7d service nova] Lock "db848537-676f-464a-806d-febb14d920a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:53:21 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-05a05cd2-ba97-467c-8bb5-838cc2ae688d req-920750ee-97a5-4e67-90de-8191847cdd7d service nova] Lock "db848537-676f-464a-806d-febb14d920a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:53:21 user nova-compute[75122]: DEBUG nova.compute.manager [req-05a05cd2-ba97-467c-8bb5-838cc2ae688d req-920750ee-97a5-4e67-90de-8191847cdd7d service nova] [instance: db848537-676f-464a-806d-febb14d920a6] No waiting events found dispatching network-vif-plugged-93bbff2d-1d5c-47db-b436-43796849be51 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:53:21 user nova-compute[75122]: WARNING nova.compute.manager [req-05a05cd2-ba97-467c-8bb5-838cc2ae688d req-920750ee-97a5-4e67-90de-8191847cdd7d service nova] [instance: db848537-676f-464a-806d-febb14d920a6] Received unexpected event network-vif-plugged-93bbff2d-1d5c-47db-b436-43796849be51 for instance with vm_state building and task_state spawning.
Nov 15 09:53:21 user nova-compute[75122]: INFO nova.compute.manager [None req-8d87a524-9428-4db8-a926-798eee36a3e1 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: db848537-676f-464a-806d-febb14d920a6] Took 4.98 seconds to spawn the instance on the hypervisor.
Nov 15 09:53:21 user nova-compute[75122]: DEBUG nova.compute.manager [None req-8d87a524-9428-4db8-a926-798eee36a3e1 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: db848537-676f-464a-806d-febb14d920a6] Checking state {{(pid=75122) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 09:53:21 user nova-compute[75122]: INFO nova.compute.manager [None req-8d87a524-9428-4db8-a926-798eee36a3e1 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: db848537-676f-464a-806d-febb14d920a6] Took 15.97 seconds to build instance.
Nov 15 09:53:21 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-8d87a524-9428-4db8-a926-798eee36a3e1 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Lock "db848537-676f-464a-806d-febb14d920a6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.067s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:53:21 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:53:22 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:53:26 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:53:27 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:53:29 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:53:30 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:53:30 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:53:30 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:53:30 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:53:30 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:53:30 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75122) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 09:53:30 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/718ca25b-c73d-4853-b674-fdaf3ed465c7/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:53:30 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/718ca25b-c73d-4853-b674-fdaf3ed465c7/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:53:30 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/718ca25b-c73d-4853-b674-fdaf3ed465c7/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:53:30 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/718ca25b-c73d-4853-b674-fdaf3ed465c7/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:53:30 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/001d589e-1bee-42da-8422-233ba796fbab/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:53:30 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/001d589e-1bee-42da-8422-233ba796fbab/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:53:30 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/001d589e-1bee-42da-8422-233ba796fbab/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:53:31 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/001d589e-1bee-42da-8422-233ba796fbab/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:53:31 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be71985e-a370-43d9-adef-afb31d03e2fd/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:53:31 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be71985e-a370-43d9-adef-afb31d03e2fd/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:53:31 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be71985e-a370-43d9-adef-afb31d03e2fd/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:53:31 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be71985e-a370-43d9-adef-afb31d03e2fd/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:53:31 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75122) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 09:53:31 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:53:31 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 09:53:31 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 09:53:31 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Hypervisor/Node resource view: name=user free_ram=8657MB free_disk=25.216754913330078GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75122) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 09:53:31 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:53:31 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:53:31 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance 001d589e-1bee-42da-8422-233ba796fbab actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:53:31 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance 718ca25b-c73d-4853-b674-fdaf3ed465c7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:53:31 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance db848537-676f-464a-806d-febb14d920a6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:53:31 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance be71985e-a370-43d9-adef-afb31d03e2fd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:53:31 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75122) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 09:53:31 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75122) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 09:53:32 user nova-compute[75122]: DEBUG nova.compute.provider_tree [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Inventory has not changed in ProviderTree for provider: 69a3da65-47be-44c6-b67c-c692b58284ef {{(pid=75122) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 09:53:32 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Inventory has not changed for provider 69a3da65-47be-44c6-b67c-c692b58284ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 09:53:32 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Compute_service record updated for user:user {{(pid=75122) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 09:53:32 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.295s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:53:32 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:53:33 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:53:33 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Starting heal instance info cache {{(pid=75122) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 09:53:33 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] [instance: 40f792bb-43a9-4011-aaba-f240f64e2757] Skipping network cache update for instance because it has been migrated to another host. {{(pid=75122) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9966}}
Nov 15 09:53:33 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "refresh_cache-718ca25b-c73d-4853-b674-fdaf3ed465c7" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 09:53:33 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquired lock "refresh_cache-718ca25b-c73d-4853-b674-fdaf3ed465c7" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 09:53:33 user nova-compute[75122]: DEBUG nova.network.neutron [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] [instance: 718ca25b-c73d-4853-b674-fdaf3ed465c7] Forcefully refreshing network info cache for instance {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 09:53:33 user nova-compute[75122]: DEBUG nova.network.neutron [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] [instance: 718ca25b-c73d-4853-b674-fdaf3ed465c7] Updating instance_info_cache with network_info: [{"id": "8691c10b-6a01-4e1f-884e-0aa0a4bd39c2", "address": "fa:16:3e:2a:93:fb", "network": {"id": "0e218464-b514-477f-8f50-93252bee51e8", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-575730542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "348514cfec2145f59bc0a7368b9557f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8691c10b-6a", "ovs_interfaceid": "8691c10b-6a01-4e1f-884e-0aa0a4bd39c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:53:33 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Releasing lock "refresh_cache-718ca25b-c73d-4853-b674-fdaf3ed465c7" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 09:53:33 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] [instance: 718ca25b-c73d-4853-b674-fdaf3ed465c7] Updated the network info_cache for instance {{(pid=75122) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 09:53:33 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:53:33 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:53:33 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:53:33 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:53:33 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75122) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 09:53:36 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:53:37 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:53:38 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:53:41 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:53:42 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:53:46 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:53:47 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:53:52 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:53:57 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:54:02 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:54:07 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:54:12 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:54:12 user nova-compute[75122]: DEBUG nova.compute.manager [req-286891bf-8ad4-4362-b1a3-c156b5e34118 req-5e54224c-bdb6-473c-b0b1-c37a677abde3 service nova] [instance: 718ca25b-c73d-4853-b674-fdaf3ed465c7] Received event network-changed-8691c10b-6a01-4e1f-884e-0aa0a4bd39c2 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:54:12 user nova-compute[75122]: DEBUG nova.compute.manager [req-286891bf-8ad4-4362-b1a3-c156b5e34118 req-5e54224c-bdb6-473c-b0b1-c37a677abde3 service nova] [instance: 718ca25b-c73d-4853-b674-fdaf3ed465c7] Refreshing instance network info cache due to event network-changed-8691c10b-6a01-4e1f-884e-0aa0a4bd39c2. {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 09:54:12 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-286891bf-8ad4-4362-b1a3-c156b5e34118 req-5e54224c-bdb6-473c-b0b1-c37a677abde3 service nova] Acquiring lock "refresh_cache-718ca25b-c73d-4853-b674-fdaf3ed465c7" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 09:54:12 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-286891bf-8ad4-4362-b1a3-c156b5e34118 req-5e54224c-bdb6-473c-b0b1-c37a677abde3 service nova] Acquired lock "refresh_cache-718ca25b-c73d-4853-b674-fdaf3ed465c7" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 09:54:12 user nova-compute[75122]: DEBUG nova.network.neutron [req-286891bf-8ad4-4362-b1a3-c156b5e34118 req-5e54224c-bdb6-473c-b0b1-c37a677abde3 service nova] [instance: 718ca25b-c73d-4853-b674-fdaf3ed465c7] Refreshing network info cache for port 8691c10b-6a01-4e1f-884e-0aa0a4bd39c2 {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 09:54:13 user nova-compute[75122]: DEBUG nova.network.neutron [req-286891bf-8ad4-4362-b1a3-c156b5e34118 req-5e54224c-bdb6-473c-b0b1-c37a677abde3 service nova] [instance: 718ca25b-c73d-4853-b674-fdaf3ed465c7] Updated VIF entry in instance network info cache for port 8691c10b-6a01-4e1f-884e-0aa0a4bd39c2. {{(pid=75122) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 09:54:13 user nova-compute[75122]: DEBUG nova.network.neutron [req-286891bf-8ad4-4362-b1a3-c156b5e34118 req-5e54224c-bdb6-473c-b0b1-c37a677abde3 service nova] [instance: 718ca25b-c73d-4853-b674-fdaf3ed465c7] Updating instance_info_cache with network_info: [{"id": "8691c10b-6a01-4e1f-884e-0aa0a4bd39c2", "address": "fa:16:3e:2a:93:fb", "network": {"id": "0e218464-b514-477f-8f50-93252bee51e8", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-575730542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "348514cfec2145f59bc0a7368b9557f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8691c10b-6a", "ovs_interfaceid": "8691c10b-6a01-4e1f-884e-0aa0a4bd39c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:54:13 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-286891bf-8ad4-4362-b1a3-c156b5e34118 req-5e54224c-bdb6-473c-b0b1-c37a677abde3 service nova] Releasing lock "refresh_cache-718ca25b-c73d-4853-b674-fdaf3ed465c7" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 09:54:13 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-16b3ff84-4718-474a-a35c-c8b70165c83f tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] Acquiring lock "718ca25b-c73d-4853-b674-fdaf3ed465c7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:54:13 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-16b3ff84-4718-474a-a35c-c8b70165c83f tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] Lock "718ca25b-c73d-4853-b674-fdaf3ed465c7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:54:13 user nova-compute[75122]: DEBUG nova.objects.instance [None req-16b3ff84-4718-474a-a35c-c8b70165c83f tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] Lazy-loading 'flavor' on Instance uuid 718ca25b-c73d-4853-b674-fdaf3ed465c7 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:54:13 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-16b3ff84-4718-474a-a35c-c8b70165c83f tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] Lock "718ca25b-c73d-4853-b674-fdaf3ed465c7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.049s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:54:13 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-16b3ff84-4718-474a-a35c-c8b70165c83f tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] Acquiring lock "718ca25b-c73d-4853-b674-fdaf3ed465c7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:54:13 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-16b3ff84-4718-474a-a35c-c8b70165c83f tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] Lock "718ca25b-c73d-4853-b674-fdaf3ed465c7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:54:13 user nova-compute[75122]: INFO nova.compute.manager [None req-16b3ff84-4718-474a-a35c-c8b70165c83f tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] [instance: 718ca25b-c73d-4853-b674-fdaf3ed465c7] Attaching volume e5980f14-24f1-4673-9b31-ee87a0d26092 to /dev/vdb
Nov 15 09:54:13 user nova-compute[75122]: DEBUG os_brick.utils [None req-16b3ff84-4718-474a-a35c-c8b70165c83f tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 09:54:13 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:54:13 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:54:13 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[31e84f3b-e1f3-4ffa-942f-bcdd65473433]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:742fb64b3587\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:54:13 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:54:13 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:54:13 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[57e95aaf-d558-47a5-ac99-b60e17ee357e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:54:13 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:54:13 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:54:13 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[539f7bb6-dbbb-44d2-b988-fcb398c0050f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:54:13 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf39e833-309f-4f26-a9fe-42a99ae830e3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:54:13 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-16b3ff84-4718-474a-a35c-c8b70165c83f tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] Running cmd (subprocess): nvme version {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:54:14 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-16b3ff84-4718-474a-a35c-c8b70165c83f tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] 'nvme version' failed. Not Retrying. {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 09:54:14 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.nvmeof [None req-16b3ff84-4718-474a-a35c-c8b70165c83f tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] nvme not present on system {{(pid=75122) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 09:54:14 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:54:14 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 09:54:14 user nova-compute[75122]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 09:54:14 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[3706c0b8-e6b0-419c-8330-60a75dce52a1]: (4, '') {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:54:14 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.lightos [None req-16b3ff84-4718-474a-a35c-c8b70165c83f tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75122) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 09:54:14 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.lightos [None req-16b3ff84-4718-474a-a35c-c8b70165c83f tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75122) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 09:54:14 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.lightos [None req-16b3ff84-4718-474a-a35c-c8b70165c83f tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] LIGHTOS: no hostnqn found. {{(pid=75122) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 09:54:14 user nova-compute[75122]: DEBUG os_brick.utils [None req-16b3ff84-4718-474a-a35c-c8b70165c83f tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:742fb64b3587', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 09:54:14 user nova-compute[75122]: DEBUG nova.virt.block_device [None req-16b3ff84-4718-474a-a35c-c8b70165c83f tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] [instance: 718ca25b-c73d-4853-b674-fdaf3ed465c7] Updating existing volume attachment record: 6687fa01-a850-45c9-9544-ad10270b6288 {{(pid=75122) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 09:54:16 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:54:17 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:54:18 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-16b3ff84-4718-474a-a35c-c8b70165c83f tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] [instance: 718ca25b-c73d-4853-b674-fdaf3ed465c7] Calling os-brick to attach iSCSI Volume {{(pid=75122) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 09:54:18 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-16b3ff84-4718-474a-a35c-c8b70165c83f tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffa04060b80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e5980f14-24f1-4673-9b31-ee87a0d26092', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dtvTgiSy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 09:54:18 user nova-compute[75122]: WARNING os_brick.initiator.connectors.base [None req-16b3ff84-4718-474a-a35c-c8b70165c83f tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 09:54:18 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-16b3ff84-4718-474a-a35c-c8b70165c83f tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 09:54:18 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-16b3ff84-4718-474a-a35c-c8b70165c83f tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 09:54:18 user nova-compute[75122]: WARNING os_brick.initiator.connectors.base [None req-16b3ff84-4718-474a-a35c-c8b70165c83f tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 09:54:18 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-16b3ff84-4718-474a-a35c-c8b70165c83f tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e5980f14-24f1-4673-9b31-ee87a0d26092" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 09:54:18 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-16b3ff84-4718-474a-a35c-c8b70165c83f tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e5980f14-24f1-4673-9b31-ee87a0d26092" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 09:54:18 user nova-compute[75122]: INFO os_brick.initiator.connectors.iscsi [None req-16b3ff84-4718-474a-a35c-c8b70165c83f tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 09:54:18 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5980f14-24f1-4673-9b31-ee87a0d26092 -p 172.16.0.220:3260 {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:54:18 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5980f14-24f1-4673-9b31-ee87a0d26092 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:54:18 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e63c5a2-3f1b-4fab-a3aa-cfc72567e5b0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:54:18 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-16b3ff84-4718-474a-a35c-c8b70165c83f tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 09:54:18 user nova-compute[75122]:  {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:54:18 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5980f14-24f1-4673-9b31-ee87a0d26092 -p 172.16.0.220:3260 --interface default --op new {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:54:18 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5980f14-24f1-4673-9b31-ee87a0d26092 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:54:18 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[961cd84d-772b-40ca-99a9-4cba7225af41]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e5980f14-24f1-4673-9b31-ee87a0d26092] added\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:54:18 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-16b3ff84-4718-474a-a35c-c8b70165c83f tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e5980f14-24f1-4673-9b31-ee87a0d26092] added
Nov 15 09:54:18 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:54:18 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5980f14-24f1-4673-9b31-ee87a0d26092 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:54:18 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5980f14-24f1-4673-9b31-ee87a0d26092 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:54:18 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d0ec6c0-63b5-4ab6-8874-28970d07fbec]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:54:18 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-16b3ff84-4718-474a-a35c-c8b70165c83f tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:54:18 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5980f14-24f1-4673-9b31-ee87a0d26092 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:54:18 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5980f14-24f1-4673-9b31-ee87a0d26092 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:54:18 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b98ff46-7e2a-4ed5-9c94-cd35d33aa1ee]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:54:18 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-16b3ff84-4718-474a-a35c-c8b70165c83f tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:54:18 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5980f14-24f1-4673-9b31-ee87a0d26092 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dtvTgiSy {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:54:18 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5980f14-24f1-4673-9b31-ee87a0d26092 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dtvTgiSy" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:54:18 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2b9af0c-032d-42fa-8b77-4e4cf3393068]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:54:18 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-16b3ff84-4718-474a-a35c-c8b70165c83f tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dtvTgiSy'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:54:18 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5980f14-24f1-4673-9b31-ee87a0d26092 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:54:18 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5980f14-24f1-4673-9b31-ee87a0d26092 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:54:18 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ababd4e-a885-4a6c-8754-bba78bb13301]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:54:18 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-16b3ff84-4718-474a-a35c-c8b70165c83f tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:54:18 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:54:18 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:54:18 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[981ac7b8-d15d-442e-939c-48f33b64a852]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee79db2-27c2-4d0f-8ee6-5b03e05ebba5 (non-flash)\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:54:18 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-16b3ff84-4718-474a-a35c-c8b70165c83f tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee79db2-27c2-4d0f-8ee6-5b03e05ebba5 (non-flash)
Nov 15 09:54:18 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 09:54:18 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-16b3ff84-4718-474a-a35c-c8b70165c83f tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee79db2-27c2-4d0f-8ee6-5b03e05ebba5 (non-flash)
Nov 15 09:54:18 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 09:54:18 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5980f14-24f1-4673-9b31-ee87a0d26092 -p 172.16.0.220:3260 --login {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:54:18 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5980f14-24f1-4673-9b31-ee87a0d26092 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:54:18 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdf5e163-dd16-4f37-b787-ec5415df6bb4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e5980f14-24f1-4673-9b31-ee87a0d26092, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e5980f14-24f1-4673-9b31-ee87a0d26092, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:54:18 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-16b3ff84-4718-474a-a35c-c8b70165c83f tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e5980f14-24f1-4673-9b31-ee87a0d26092, portal: 172.16.0.220,3260]
Nov 15 09:54:18 user nova-compute[75122]: Login to [iface: default, target: iqn.2010-10.org.openstack:e5980f14-24f1-4673-9b31-ee87a0d26092, portal: 172.16.0.220,3260] successful.
Nov 15 09:54:18 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:54:18 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5980f14-24f1-4673-9b31-ee87a0d26092 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:54:18 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5980f14-24f1-4673-9b31-ee87a0d26092 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:54:18 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7d78fc2-6007-4552-90ab-6a472a5250ea]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:54:18 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-16b3ff84-4718-474a-a35c-c8b70165c83f tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:54:18 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:54:18 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:54:18 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[608a2fbf-b40b-4af3-929f-bd70ca7465ec]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee79db2-27c2-4d0f-8ee6-5b03e05ebba5 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5980f14-24f1-4673-9b31-ee87a0d26092 (non-flash)\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:54:18 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-16b3ff84-4718-474a-a35c-c8b70165c83f tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee79db2-27c2-4d0f-8ee6-5b03e05ebba5 (non-flash)
Nov 15 09:54:18 user nova-compute[75122]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5980f14-24f1-4673-9b31-ee87a0d26092 (non-flash)
Nov 15 09:54:18 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 09:54:18 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-16b3ff84-4718-474a-a35c-c8b70165c83f tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee79db2-27c2-4d0f-8ee6-5b03e05ebba5 (non-flash)
Nov 15 09:54:18 user nova-compute[75122]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5980f14-24f1-4673-9b31-ee87a0d26092 (non-flash)
Nov 15 09:54:18 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 09:54:18 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-16b3ff84-4718-474a-a35c-c8b70165c83f tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e5980f14-24f1-4673-9b31-ee87a0d26092" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.267s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 09:54:18 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-16b3ff84-4718-474a-a35c-c8b70165c83f tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] Connected to 172.16.0.220:3260 {{(pid=75122) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 09:54:18 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-16b3ff84-4718-474a-a35c-c8b70165c83f tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] HCTL ('34', '-', '-', 0) found on session 48 with lun 0 {{(pid=75122) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 09:54:18 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-16b3ff84-4718-474a-a35c-c8b70165c83f tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75122) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 09:54:18 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:54:18 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:54:18 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[751487be-2c04-404f-8f69-7113d016e275]: (4, ('- - 0', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:54:18 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-16b3ff84-4718-474a-a35c-c8b70165c83f tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] Searching for a device in session 48 and hctl ['34', '*', '*', 0] yield: None {{(pid=75122) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 09:54:19 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-16b3ff84-4718-474a-a35c-c8b70165c83f tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] Searching for a device in session 48 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75122) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 09:54:19 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-16b3ff84-4718-474a-a35c-c8b70165c83f tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:e5980f14-24f1-4673-9b31-ee87a0d26092', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dtvTgiSy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75122) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 09:54:19 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-16b3ff84-4718-474a-a35c-c8b70165c83f tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.296s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 09:54:19 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-16b3ff84-4718-474a-a35c-c8b70165c83f tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] <== connect_volume: return (1298ms) {'type': 'block', 'scsi_wwn': '26662393831376433', 'path': '/dev/sdc'} {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 09:54:19 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-16b3ff84-4718-474a-a35c-c8b70165c83f tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] [instance: 718ca25b-c73d-4853-b674-fdaf3ed465c7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26662393831376433', 'path': '/dev/sdc'} {{(pid=75122) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 09:54:19 user nova-compute[75122]: DEBUG nova.objects.instance [None req-16b3ff84-4718-474a-a35c-c8b70165c83f tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] Lazy-loading 'flavor' on Instance uuid 718ca25b-c73d-4853-b674-fdaf3ed465c7 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:54:19 user nova-compute[75122]: DEBUG nova.virt.libvirt.guest [None req-16b3ff84-4718-474a-a35c-c8b70165c83f tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 09:54:19 user nova-compute[75122]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 09:54:19 user nova-compute[75122]:   <source dev="/dev/sdc"/>
Nov 15 09:54:19 user nova-compute[75122]:   <target dev="vdb" bus="virtio"/>
Nov 15 09:54:19 user nova-compute[75122]:   <serial>e5980f14-24f1-4673-9b31-ee87a0d26092</serial>
Nov 15 09:54:19 user nova-compute[75122]: </disk>
Nov 15 09:54:19 user nova-compute[75122]:  {{(pid=75122) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 09:54:20 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-16b3ff84-4718-474a-a35c-c8b70165c83f tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] No BDM found with device name vda, not building metadata. {{(pid=75122) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 09:54:20 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-16b3ff84-4718-474a-a35c-c8b70165c83f tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75122) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 09:54:20 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-16b3ff84-4718-474a-a35c-c8b70165c83f tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] No VIF found with MAC fa:16:3e:2a:93:fb, not building metadata {{(pid=75122) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 09:54:20 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-16b3ff84-4718-474a-a35c-c8b70165c83f tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] Lock "718ca25b-c73d-4853-b674-fdaf3ed465c7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.439s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:54:20 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-2c91df7e-0b21-4605-92b2-c29f4aeae7c3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Acquiring lock "40f792bb-43a9-4011-aaba-f240f64e2757" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:54:20 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-2c91df7e-0b21-4605-92b2-c29f4aeae7c3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Lock "40f792bb-43a9-4011-aaba-f240f64e2757" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:54:20 user nova-compute[75122]: INFO nova.compute.manager [None req-2c91df7e-0b21-4605-92b2-c29f4aeae7c3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] [instance: 40f792bb-43a9-4011-aaba-f240f64e2757] Unshelving
Nov 15 09:54:20 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-2c91df7e-0b21-4605-92b2-c29f4aeae7c3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:54:20 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-2c91df7e-0b21-4605-92b2-c29f4aeae7c3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:54:20 user nova-compute[75122]: DEBUG nova.objects.instance [None req-2c91df7e-0b21-4605-92b2-c29f4aeae7c3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Lazy-loading 'pci_requests' on Instance uuid 40f792bb-43a9-4011-aaba-f240f64e2757 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:54:20 user nova-compute[75122]: DEBUG nova.objects.instance [None req-2c91df7e-0b21-4605-92b2-c29f4aeae7c3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Lazy-loading 'numa_topology' on Instance uuid 40f792bb-43a9-4011-aaba-f240f64e2757 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:54:20 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-2c91df7e-0b21-4605-92b2-c29f4aeae7c3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75122) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 09:54:20 user nova-compute[75122]: INFO nova.compute.claims [None req-2c91df7e-0b21-4605-92b2-c29f4aeae7c3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] [instance: 40f792bb-43a9-4011-aaba-f240f64e2757] Claim successful on node user
Nov 15 09:54:21 user nova-compute[75122]: DEBUG nova.compute.provider_tree [None req-2c91df7e-0b21-4605-92b2-c29f4aeae7c3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Inventory has not changed in ProviderTree for provider: 69a3da65-47be-44c6-b67c-c692b58284ef {{(pid=75122) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 09:54:21 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-2c91df7e-0b21-4605-92b2-c29f4aeae7c3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Inventory has not changed for provider 69a3da65-47be-44c6-b67c-c692b58284ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 09:54:21 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-2c91df7e-0b21-4605-92b2-c29f4aeae7c3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.326s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:54:21 user nova-compute[75122]: INFO nova.network.neutron [None req-2c91df7e-0b21-4605-92b2-c29f4aeae7c3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] [instance: 40f792bb-43a9-4011-aaba-f240f64e2757] Updating port da514680-136e-49d6-aec0-9d4192081cec with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 15 09:54:21 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:54:21 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:54:21 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-2c91df7e-0b21-4605-92b2-c29f4aeae7c3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Acquiring lock "refresh_cache-40f792bb-43a9-4011-aaba-f240f64e2757" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 09:54:21 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-2c91df7e-0b21-4605-92b2-c29f4aeae7c3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Acquired lock "refresh_cache-40f792bb-43a9-4011-aaba-f240f64e2757" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 09:54:21 user nova-compute[75122]: DEBUG nova.network.neutron [None req-2c91df7e-0b21-4605-92b2-c29f4aeae7c3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] [instance: 40f792bb-43a9-4011-aaba-f240f64e2757] Building network info cache for instance {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 09:54:21 user nova-compute[75122]: DEBUG nova.compute.manager [req-ee132ef9-598d-4ce1-bc92-4b1448242d7e req-c02c2892-5f95-44fb-a864-4f7ca2b3d64b service nova] [instance: 40f792bb-43a9-4011-aaba-f240f64e2757] Received event network-changed-da514680-136e-49d6-aec0-9d4192081cec {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:54:21 user nova-compute[75122]: DEBUG nova.compute.manager [req-ee132ef9-598d-4ce1-bc92-4b1448242d7e req-c02c2892-5f95-44fb-a864-4f7ca2b3d64b service nova] [instance: 40f792bb-43a9-4011-aaba-f240f64e2757] Refreshing instance network info cache due to event network-changed-da514680-136e-49d6-aec0-9d4192081cec. {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 09:54:21 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-ee132ef9-598d-4ce1-bc92-4b1448242d7e req-c02c2892-5f95-44fb-a864-4f7ca2b3d64b service nova] Acquiring lock "refresh_cache-40f792bb-43a9-4011-aaba-f240f64e2757" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 09:54:22 user nova-compute[75122]: DEBUG nova.network.neutron [None req-2c91df7e-0b21-4605-92b2-c29f4aeae7c3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] [instance: 40f792bb-43a9-4011-aaba-f240f64e2757] Updating instance_info_cache with network_info: [{"id": "da514680-136e-49d6-aec0-9d4192081cec", "address": "fa:16:3e:b0:8a:af", "network": {"id": "7ab99c1b-e670-416e-b5fe-e1337db6b28d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-487518933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "535c751b9e76421c9262e48fbab3fb6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda514680-13", "ovs_interfaceid": "da514680-136e-49d6-aec0-9d4192081cec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:54:22 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-2c91df7e-0b21-4605-92b2-c29f4aeae7c3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Releasing lock "refresh_cache-40f792bb-43a9-4011-aaba-f240f64e2757" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 09:54:22 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-2c91df7e-0b21-4605-92b2-c29f4aeae7c3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] [instance: 40f792bb-43a9-4011-aaba-f240f64e2757] Creating instance directory {{(pid=75122) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 09:54:22 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-2c91df7e-0b21-4605-92b2-c29f4aeae7c3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] [instance: 40f792bb-43a9-4011-aaba-f240f64e2757] Creating image(s)
Nov 15 09:54:22 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-2c91df7e-0b21-4605-92b2-c29f4aeae7c3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Acquiring lock "/opt/stack/data/nova/instances/40f792bb-43a9-4011-aaba-f240f64e2757/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:54:22 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-2c91df7e-0b21-4605-92b2-c29f4aeae7c3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Lock "/opt/stack/data/nova/instances/40f792bb-43a9-4011-aaba-f240f64e2757/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:54:22 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-2c91df7e-0b21-4605-92b2-c29f4aeae7c3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Lock "/opt/stack/data/nova/instances/40f792bb-43a9-4011-aaba-f240f64e2757/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.018s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:54:22 user nova-compute[75122]: DEBUG nova.objects.instance [None req-2c91df7e-0b21-4605-92b2-c29f4aeae7c3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Lazy-loading 'trusted_certs' on Instance uuid 40f792bb-43a9-4011-aaba-f240f64e2757 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:54:22 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-ee132ef9-598d-4ce1-bc92-4b1448242d7e req-c02c2892-5f95-44fb-a864-4f7ca2b3d64b service nova] Acquired lock "refresh_cache-40f792bb-43a9-4011-aaba-f240f64e2757" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 09:54:22 user nova-compute[75122]: DEBUG nova.network.neutron [req-ee132ef9-598d-4ce1-bc92-4b1448242d7e req-c02c2892-5f95-44fb-a864-4f7ca2b3d64b service nova] [instance: 40f792bb-43a9-4011-aaba-f240f64e2757] Refreshing network info cache for port da514680-136e-49d6-aec0-9d4192081cec {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 09:54:22 user nova-compute[75122]: DEBUG nova.objects.base [None req-2c91df7e-0b21-4605-92b2-c29f4aeae7c3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Object Instance<40f792bb-43a9-4011-aaba-f240f64e2757> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=75122) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 09:54:22 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-2c91df7e-0b21-4605-92b2-c29f4aeae7c3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Acquiring lock "c64d264fe623cc813627b08607eea20c64f5f0cc" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:54:22 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-2c91df7e-0b21-4605-92b2-c29f4aeae7c3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Lock "c64d264fe623cc813627b08607eea20c64f5f0cc" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:54:23 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-2c91df7e-0b21-4605-92b2-c29f4aeae7c3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c64d264fe623cc813627b08607eea20c64f5f0cc.part --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:54:23 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:54:23 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-ae447d5a-6d77-4d23-a449-dd7b1a2e65b7 tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] Acquiring lock "718ca25b-c73d-4853-b674-fdaf3ed465c7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:54:23 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-ae447d5a-6d77-4d23-a449-dd7b1a2e65b7 tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] Lock "718ca25b-c73d-4853-b674-fdaf3ed465c7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:54:23 user nova-compute[75122]: DEBUG nova.objects.instance [None req-ae447d5a-6d77-4d23-a449-dd7b1a2e65b7 tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] Lazy-loading 'flavor' on Instance uuid 718ca25b-c73d-4853-b674-fdaf3ed465c7 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:54:23 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-ae447d5a-6d77-4d23-a449-dd7b1a2e65b7 tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] Lock "718ca25b-c73d-4853-b674-fdaf3ed465c7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:54:23 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-2c91df7e-0b21-4605-92b2-c29f4aeae7c3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c64d264fe623cc813627b08607eea20c64f5f0cc.part --force-share --output=json" returned: 0 in 0.182s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:54:23 user nova-compute[75122]: DEBUG nova.virt.images [None req-2c91df7e-0b21-4605-92b2-c29f4aeae7c3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] 0980f3c8-6daa-486a-a0fb-329e6e9e4c7b was qcow2, converting to raw {{(pid=75122) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 15 09:54:23 user nova-compute[75122]: DEBUG nova.privsep.utils [None req-2c91df7e-0b21-4605-92b2-c29f4aeae7c3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75122) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 09:54:23 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-2c91df7e-0b21-4605-92b2-c29f4aeae7c3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c64d264fe623cc813627b08607eea20c64f5f0cc.part /opt/stack/data/nova/instances/_base/c64d264fe623cc813627b08607eea20c64f5f0cc.converted {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:54:23 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-ae447d5a-6d77-4d23-a449-dd7b1a2e65b7 tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] Acquiring lock "718ca25b-c73d-4853-b674-fdaf3ed465c7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:54:23 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-ae447d5a-6d77-4d23-a449-dd7b1a2e65b7 tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] Lock "718ca25b-c73d-4853-b674-fdaf3ed465c7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:54:23 user nova-compute[75122]: INFO nova.compute.manager [None req-ae447d5a-6d77-4d23-a449-dd7b1a2e65b7 tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] [instance: 718ca25b-c73d-4853-b674-fdaf3ed465c7] Attaching volume 84aa4121-0a2f-4a82-ad90-d2818b6cdcbb to /dev/vdc
Nov 15 09:54:23 user nova-compute[75122]: DEBUG nova.network.neutron [req-ee132ef9-598d-4ce1-bc92-4b1448242d7e req-c02c2892-5f95-44fb-a864-4f7ca2b3d64b service nova] [instance: 40f792bb-43a9-4011-aaba-f240f64e2757] Updated VIF entry in instance network info cache for port da514680-136e-49d6-aec0-9d4192081cec. {{(pid=75122) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 09:54:23 user nova-compute[75122]: DEBUG nova.network.neutron [req-ee132ef9-598d-4ce1-bc92-4b1448242d7e req-c02c2892-5f95-44fb-a864-4f7ca2b3d64b service nova] [instance: 40f792bb-43a9-4011-aaba-f240f64e2757] Updating instance_info_cache with network_info: [{"id": "da514680-136e-49d6-aec0-9d4192081cec", "address": "fa:16:3e:b0:8a:af", "network": {"id": "7ab99c1b-e670-416e-b5fe-e1337db6b28d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-487518933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "535c751b9e76421c9262e48fbab3fb6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda514680-13", "ovs_interfaceid": "da514680-136e-49d6-aec0-9d4192081cec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:54:23 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-ee132ef9-598d-4ce1-bc92-4b1448242d7e req-c02c2892-5f95-44fb-a864-4f7ca2b3d64b service nova] Releasing lock "refresh_cache-40f792bb-43a9-4011-aaba-f240f64e2757" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 09:54:23 user nova-compute[75122]: DEBUG os_brick.utils [None req-ae447d5a-6d77-4d23-a449-dd7b1a2e65b7 tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 09:54:23 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:54:23 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:54:23 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[015e5a00-c1cb-46d1-8a62-eaa4f5a8904d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:742fb64b3587\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:54:23 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:54:23 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:54:23 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[be6135b6-7975-4631-88c1-c13ef2618403]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:54:23 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:54:23 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:54:23 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[775a3f80-b5c2-4194-b525-2cb3b16f52f8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:54:23 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[41ff30ab-b3b1-407e-93f8-5680cec24713]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:54:23 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-ae447d5a-6d77-4d23-a449-dd7b1a2e65b7 tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] Running cmd (subprocess): nvme version {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:54:23 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-ae447d5a-6d77-4d23-a449-dd7b1a2e65b7 tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] 'nvme version' failed. Not Retrying. {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 09:54:23 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ae447d5a-6d77-4d23-a449-dd7b1a2e65b7 tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] nvme not present on system {{(pid=75122) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 09:54:23 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:54:23 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 09:54:23 user nova-compute[75122]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 09:54:23 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fd92a66-44fd-4fb0-a4de-6684ab2b5682]: (4, '') {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:54:23 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.lightos [None req-ae447d5a-6d77-4d23-a449-dd7b1a2e65b7 tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75122) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 09:54:23 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.lightos [None req-ae447d5a-6d77-4d23-a449-dd7b1a2e65b7 tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75122) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 09:54:23 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.lightos [None req-ae447d5a-6d77-4d23-a449-dd7b1a2e65b7 tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] LIGHTOS: no hostnqn found. {{(pid=75122) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 09:54:23 user nova-compute[75122]: DEBUG os_brick.utils [None req-ae447d5a-6d77-4d23-a449-dd7b1a2e65b7 tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:742fb64b3587', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 09:54:23 user nova-compute[75122]: DEBUG nova.virt.block_device [None req-ae447d5a-6d77-4d23-a449-dd7b1a2e65b7 tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] [instance: 718ca25b-c73d-4853-b674-fdaf3ed465c7] Updating existing volume attachment record: e1ebdc45-f9ee-47e7-ae71-802e1c3286b8 {{(pid=75122) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 09:54:23 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-2c91df7e-0b21-4605-92b2-c29f4aeae7c3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c64d264fe623cc813627b08607eea20c64f5f0cc.part /opt/stack/data/nova/instances/_base/c64d264fe623cc813627b08607eea20c64f5f0cc.converted" returned: 0 in 0.326s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:54:23 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-2c91df7e-0b21-4605-92b2-c29f4aeae7c3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c64d264fe623cc813627b08607eea20c64f5f0cc.converted --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:54:23 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-2c91df7e-0b21-4605-92b2-c29f4aeae7c3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c64d264fe623cc813627b08607eea20c64f5f0cc.converted --force-share --output=json" returned: 0 in 0.175s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:54:23 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-2c91df7e-0b21-4605-92b2-c29f4aeae7c3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Lock "c64d264fe623cc813627b08607eea20c64f5f0cc" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.673s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:54:23 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-2c91df7e-0b21-4605-92b2-c29f4aeae7c3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c64d264fe623cc813627b08607eea20c64f5f0cc --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:54:24 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-2c91df7e-0b21-4605-92b2-c29f4aeae7c3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c64d264fe623cc813627b08607eea20c64f5f0cc --force-share --output=json" returned: 0 in 0.176s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:54:24 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-2c91df7e-0b21-4605-92b2-c29f4aeae7c3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Acquiring lock "c64d264fe623cc813627b08607eea20c64f5f0cc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:54:24 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-2c91df7e-0b21-4605-92b2-c29f4aeae7c3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Lock "c64d264fe623cc813627b08607eea20c64f5f0cc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:54:24 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-2c91df7e-0b21-4605-92b2-c29f4aeae7c3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c64d264fe623cc813627b08607eea20c64f5f0cc --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:54:24 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-2c91df7e-0b21-4605-92b2-c29f4aeae7c3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c64d264fe623cc813627b08607eea20c64f5f0cc --force-share --output=json" returned: 0 in 0.176s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:54:24 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-2c91df7e-0b21-4605-92b2-c29f4aeae7c3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c64d264fe623cc813627b08607eea20c64f5f0cc,backing_fmt=raw /opt/stack/data/nova/instances/40f792bb-43a9-4011-aaba-f240f64e2757/disk 1073741824 {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:54:24 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-2c91df7e-0b21-4605-92b2-c29f4aeae7c3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c64d264fe623cc813627b08607eea20c64f5f0cc,backing_fmt=raw /opt/stack/data/nova/instances/40f792bb-43a9-4011-aaba-f240f64e2757/disk 1073741824" returned: 0 in 0.047s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:54:24 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-2c91df7e-0b21-4605-92b2-c29f4aeae7c3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Lock "c64d264fe623cc813627b08607eea20c64f5f0cc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.231s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:54:24 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-2c91df7e-0b21-4605-92b2-c29f4aeae7c3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c64d264fe623cc813627b08607eea20c64f5f0cc --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:54:24 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-2c91df7e-0b21-4605-92b2-c29f4aeae7c3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c64d264fe623cc813627b08607eea20c64f5f0cc --force-share --output=json" returned: 0 in 0.179s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:54:24 user nova-compute[75122]: DEBUG nova.objects.instance [None req-2c91df7e-0b21-4605-92b2-c29f4aeae7c3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Lazy-loading 'migration_context' on Instance uuid 40f792bb-43a9-4011-aaba-f240f64e2757 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:54:24 user nova-compute[75122]: DEBUG nova.objects.base [None req-2c91df7e-0b21-4605-92b2-c29f4aeae7c3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Object Instance<40f792bb-43a9-4011-aaba-f240f64e2757> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=75122) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 09:54:24 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-2c91df7e-0b21-4605-92b2-c29f4aeae7c3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] [instance: 40f792bb-43a9-4011-aaba-f240f64e2757] Rebasing disk image.
Nov 15 09:54:24 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-2c91df7e-0b21-4605-92b2-c29f4aeae7c3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:54:24 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-2c91df7e-0b21-4605-92b2-c29f4aeae7c3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json" returned: 0 in 0.176s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:54:24 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-2c91df7e-0b21-4605-92b2-c29f4aeae7c3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 -F raw /opt/stack/data/nova/instances/40f792bb-43a9-4011-aaba-f240f64e2757/disk {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:54:26 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-2c91df7e-0b21-4605-92b2-c29f4aeae7c3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 -F raw /opt/stack/data/nova/instances/40f792bb-43a9-4011-aaba-f240f64e2757/disk" returned: 0 in 1.951s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:54:26 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-2c91df7e-0b21-4605-92b2-c29f4aeae7c3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] [instance: 40f792bb-43a9-4011-aaba-f240f64e2757] Created local disks {{(pid=75122) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 09:54:26 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-2c91df7e-0b21-4605-92b2-c29f4aeae7c3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] [instance: 40f792bb-43a9-4011-aaba-f240f64e2757] Ensure instance console log exists: /opt/stack/data/nova/instances/40f792bb-43a9-4011-aaba-f240f64e2757/console.log {{(pid=75122) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 09:54:26 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-2c91df7e-0b21-4605-92b2-c29f4aeae7c3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:54:26 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-2c91df7e-0b21-4605-92b2-c29f4aeae7c3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:54:26 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-2c91df7e-0b21-4605-92b2-c29f4aeae7c3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:54:26 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-2c91df7e-0b21-4605-92b2-c29f4aeae7c3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] [instance: 40f792bb-43a9-4011-aaba-f240f64e2757] Start _get_guest_xml network_info=[{"id": "da514680-136e-49d6-aec0-9d4192081cec", "address": "fa:16:3e:b0:8a:af", "network": {"id": "7ab99c1b-e670-416e-b5fe-e1337db6b28d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-487518933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "535c751b9e76421c9262e48fbab3fb6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda514680-13", "ovs_interfaceid": "da514680-136e-49d6-aec0-9d4192081cec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='0f6abaf9a917426be2d3936942b05dce',container_format='bare',created_at=2023-11-15T09:52:28Z,direct_url=<?>,disk_format='qcow2',id=0980f3c8-6daa-486a-a0fb-329e6e9e4c7b,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1963643859-shelved',owner='535c751b9e76421c9262e48fbab3fb6f',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-15T09:52:32Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '5e862cfe-47b8-4725-8292-65761ee6d0f5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75122) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 09:54:26 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-2c91df7e-0b21-4605-92b2-c29f4aeae7c3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 09:54:26 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-2c91df7e-0b21-4605-92b2-c29f4aeae7c3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 09:54:26 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-2c91df7e-0b21-4605-92b2-c29f4aeae7c3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75122) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 09:54:26 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-2c91df7e-0b21-4605-92b2-c29f4aeae7c3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] CPU controller missing on host. {{(pid=75122) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 09:54:26 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-2c91df7e-0b21-4605-92b2-c29f4aeae7c3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75122) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 09:54:26 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-2c91df7e-0b21-4605-92b2-c29f4aeae7c3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] CPU controller found on host. {{(pid=75122) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 09:54:26 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-2c91df7e-0b21-4605-92b2-c29f4aeae7c3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75122) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 09:54:26 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-2c91df7e-0b21-4605-92b2-c29f4aeae7c3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T09:26:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='0f6abaf9a917426be2d3936942b05dce',container_format='bare',created_at=2023-11-15T09:52:28Z,direct_url=<?>,disk_format='qcow2',id=0980f3c8-6daa-486a-a0fb-329e6e9e4c7b,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1963643859-shelved',owner='535c751b9e76421c9262e48fbab3fb6f',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-15T09:52:32Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 09:54:26 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-2c91df7e-0b21-4605-92b2-c29f4aeae7c3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Flavor limits 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 09:54:26 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-2c91df7e-0b21-4605-92b2-c29f4aeae7c3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Image limits 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 09:54:26 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-2c91df7e-0b21-4605-92b2-c29f4aeae7c3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Flavor pref 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 09:54:26 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-2c91df7e-0b21-4605-92b2-c29f4aeae7c3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Image pref 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 09:54:26 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-2c91df7e-0b21-4605-92b2-c29f4aeae7c3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 09:54:26 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-2c91df7e-0b21-4605-92b2-c29f4aeae7c3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 09:54:26 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-2c91df7e-0b21-4605-92b2-c29f4aeae7c3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75122) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 09:54:26 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-2c91df7e-0b21-4605-92b2-c29f4aeae7c3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Got 1 possible topologies {{(pid=75122) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 09:54:26 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-2c91df7e-0b21-4605-92b2-c29f4aeae7c3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 09:54:26 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-2c91df7e-0b21-4605-92b2-c29f4aeae7c3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 09:54:26 user nova-compute[75122]: DEBUG nova.objects.instance [None req-2c91df7e-0b21-4605-92b2-c29f4aeae7c3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Lazy-loading 'vcpu_model' on Instance uuid 40f792bb-43a9-4011-aaba-f240f64e2757 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:54:26 user nova-compute[75122]: DEBUG nova.objects.base [None req-2c91df7e-0b21-4605-92b2-c29f4aeae7c3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Object Instance<40f792bb-43a9-4011-aaba-f240f64e2757> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=75122) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 09:54:26 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-2c91df7e-0b21-4605-92b2-c29f4aeae7c3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-15T09:50:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1963643859',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1963643859',id=36,image_ref='0980f3c8-6daa-486a-a0fb-329e6e9e4c7b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-130968135',keypairs=<?>,launch_index=0,launched_at=2023-11-15T09:50:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='535c751b9e76421c9262e48fbab3fb6f',ramdisk_id='',reservation_id='r-y94lw7al',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1659813957',owner_user_name='tempest-AttachVolumeShelveTestJSON-1659813957-project-member',shelved_at='2023-11-15T09:52:32.237478',shelved_host='user',shelved_image_id='0980f3c8-6daa-486a-a0fb-329e6e9e4c7b'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T09:54:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad06186836ed40a49a05ef7cc9afd1bc',uuid=40f792bb-43a9-4011-aaba-f240f64e2757,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "da514680-136e-49d6-aec0-9d4192081cec", "address": "fa:16:3e:b0:8a:af", "network": {"id": "7ab99c1b-e670-416e-b5fe-e1337db6b28d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-487518933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "535c751b9e76421c9262e48fbab3fb6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda514680-13", "ovs_interfaceid": "da514680-136e-49d6-aec0-9d4192081cec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75122) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 09:54:26 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-2c91df7e-0b21-4605-92b2-c29f4aeae7c3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Converting VIF {"id": "da514680-136e-49d6-aec0-9d4192081cec", "address": "fa:16:3e:b0:8a:af", "network": {"id": "7ab99c1b-e670-416e-b5fe-e1337db6b28d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-487518933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "535c751b9e76421c9262e48fbab3fb6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda514680-13", "ovs_interfaceid": "da514680-136e-49d6-aec0-9d4192081cec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 09:54:26 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-2c91df7e-0b21-4605-92b2-c29f4aeae7c3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:8a:af,bridge_name='br-int',has_traffic_filtering=True,id=da514680-136e-49d6-aec0-9d4192081cec,network=Network(7ab99c1b-e670-416e-b5fe-e1337db6b28d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda514680-13') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 09:54:26 user nova-compute[75122]: DEBUG nova.objects.instance [None req-2c91df7e-0b21-4605-92b2-c29f4aeae7c3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Lazy-loading 'pci_devices' on Instance uuid 40f792bb-43a9-4011-aaba-f240f64e2757 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:54:26 user nova-compute[75122]: DEBUG nova.objects.base [None req-2c91df7e-0b21-4605-92b2-c29f4aeae7c3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Object Instance<40f792bb-43a9-4011-aaba-f240f64e2757> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=75122) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 09:54:26 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-2c91df7e-0b21-4605-92b2-c29f4aeae7c3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] [instance: 40f792bb-43a9-4011-aaba-f240f64e2757] End _get_guest_xml xml=<domain type="kvm">
Nov 15 09:54:26 user nova-compute[75122]:   <uuid>40f792bb-43a9-4011-aaba-f240f64e2757</uuid>
Nov 15 09:54:26 user nova-compute[75122]:   <name>instance-00000024</name>
Nov 15 09:54:26 user nova-compute[75122]:   <memory>524288</memory>
Nov 15 09:54:26 user nova-compute[75122]:   <vcpu>1</vcpu>
Nov 15 09:54:26 user nova-compute[75122]:   <metadata>
Nov 15 09:54:26 user nova-compute[75122]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 09:54:26 user nova-compute[75122]:       <nova:package version="0.0.0"/>
Nov 15 09:54:26 user nova-compute[75122]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1963643859</nova:name>
Nov 15 09:54:26 user nova-compute[75122]:       <nova:creationTime>2023-11-15 09:54:26</nova:creationTime>
Nov 15 09:54:26 user nova-compute[75122]:       <nova:flavor name="m1.tiny">
Nov 15 09:54:26 user nova-compute[75122]:         <nova:memory>512</nova:memory>
Nov 15 09:54:26 user nova-compute[75122]:         <nova:disk>1</nova:disk>
Nov 15 09:54:26 user nova-compute[75122]:         <nova:swap>0</nova:swap>
Nov 15 09:54:26 user nova-compute[75122]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 09:54:26 user nova-compute[75122]:         <nova:vcpus>1</nova:vcpus>
Nov 15 09:54:26 user nova-compute[75122]:       </nova:flavor>
Nov 15 09:54:26 user nova-compute[75122]:       <nova:owner>
Nov 15 09:54:26 user nova-compute[75122]:         <nova:user uuid="ad06186836ed40a49a05ef7cc9afd1bc">tempest-AttachVolumeShelveTestJSON-1659813957-project-member</nova:user>
Nov 15 09:54:26 user nova-compute[75122]:         <nova:project uuid="535c751b9e76421c9262e48fbab3fb6f">tempest-AttachVolumeShelveTestJSON-1659813957</nova:project>
Nov 15 09:54:26 user nova-compute[75122]:       </nova:owner>
Nov 15 09:54:26 user nova-compute[75122]:       <nova:root type="image" uuid="0980f3c8-6daa-486a-a0fb-329e6e9e4c7b"/>
Nov 15 09:54:26 user nova-compute[75122]:       <nova:ports>
Nov 15 09:54:26 user nova-compute[75122]:         <nova:port uuid="da514680-136e-49d6-aec0-9d4192081cec">
Nov 15 09:54:26 user nova-compute[75122]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 15 09:54:26 user nova-compute[75122]:         </nova:port>
Nov 15 09:54:26 user nova-compute[75122]:       </nova:ports>
Nov 15 09:54:26 user nova-compute[75122]:     </nova:instance>
Nov 15 09:54:26 user nova-compute[75122]:   </metadata>
Nov 15 09:54:26 user nova-compute[75122]:   <sysinfo type="smbios">
Nov 15 09:54:26 user nova-compute[75122]:     <system>
Nov 15 09:54:26 user nova-compute[75122]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 09:54:26 user nova-compute[75122]:       <entry name="product">OpenStack Nova</entry>
Nov 15 09:54:26 user nova-compute[75122]:       <entry name="version">0.0.0</entry>
Nov 15 09:54:26 user nova-compute[75122]:       <entry name="serial">40f792bb-43a9-4011-aaba-f240f64e2757</entry>
Nov 15 09:54:26 user nova-compute[75122]:       <entry name="uuid">40f792bb-43a9-4011-aaba-f240f64e2757</entry>
Nov 15 09:54:26 user nova-compute[75122]:       <entry name="family">Virtual Machine</entry>
Nov 15 09:54:26 user nova-compute[75122]:     </system>
Nov 15 09:54:26 user nova-compute[75122]:   </sysinfo>
Nov 15 09:54:26 user nova-compute[75122]:   <os>
Nov 15 09:54:26 user nova-compute[75122]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 09:54:26 user nova-compute[75122]:     <boot dev="hd"/>
Nov 15 09:54:26 user nova-compute[75122]:     <smbios mode="sysinfo"/>
Nov 15 09:54:26 user nova-compute[75122]:   </os>
Nov 15 09:54:26 user nova-compute[75122]:   <features>
Nov 15 09:54:26 user nova-compute[75122]:     <acpi/>
Nov 15 09:54:26 user nova-compute[75122]:     <apic/>
Nov 15 09:54:26 user nova-compute[75122]:     <vmcoreinfo/>
Nov 15 09:54:26 user nova-compute[75122]:   </features>
Nov 15 09:54:26 user nova-compute[75122]:   <clock offset="utc">
Nov 15 09:54:26 user nova-compute[75122]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 09:54:26 user nova-compute[75122]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 09:54:26 user nova-compute[75122]:     <timer name="hpet" present="no"/>
Nov 15 09:54:26 user nova-compute[75122]:   </clock>
Nov 15 09:54:26 user nova-compute[75122]:   <cpu mode="custom" match="exact">
Nov 15 09:54:26 user nova-compute[75122]:     <model>Nehalem</model>
Nov 15 09:54:26 user nova-compute[75122]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 09:54:26 user nova-compute[75122]:   </cpu>
Nov 15 09:54:26 user nova-compute[75122]:   <devices>
Nov 15 09:54:26 user nova-compute[75122]:     <disk type="file" device="disk">
Nov 15 09:54:26 user nova-compute[75122]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 09:54:26 user nova-compute[75122]:       <source file="/opt/stack/data/nova/instances/40f792bb-43a9-4011-aaba-f240f64e2757/disk"/>
Nov 15 09:54:26 user nova-compute[75122]:       <target dev="vda" bus="virtio"/>
Nov 15 09:54:26 user nova-compute[75122]:     </disk>
Nov 15 09:54:26 user nova-compute[75122]:     <interface type="ethernet">
Nov 15 09:54:26 user nova-compute[75122]:       <mac address="fa:16:3e:b0:8a:af"/>
Nov 15 09:54:26 user nova-compute[75122]:       <model type="virtio"/>
Nov 15 09:54:26 user nova-compute[75122]:       <mtu size="1442"/>
Nov 15 09:54:26 user nova-compute[75122]:       <target dev="tapda514680-13"/>
Nov 15 09:54:26 user nova-compute[75122]:     </interface>
Nov 15 09:54:26 user nova-compute[75122]:     <serial type="pty">
Nov 15 09:54:26 user nova-compute[75122]:       <log file="/opt/stack/data/nova/instances/40f792bb-43a9-4011-aaba-f240f64e2757/console.log" append="off"/>
Nov 15 09:54:26 user nova-compute[75122]:     </serial>
Nov 15 09:54:26 user nova-compute[75122]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 09:54:26 user nova-compute[75122]:     <video>
Nov 15 09:54:26 user nova-compute[75122]:       <model type="virtio"/>
Nov 15 09:54:26 user nova-compute[75122]:     </video>
Nov 15 09:54:26 user nova-compute[75122]:     <rng model="virtio">
Nov 15 09:54:26 user nova-compute[75122]:       <backend model="random">/dev/urandom</backend>
Nov 15 09:54:26 user nova-compute[75122]:     </rng>
Nov 15 09:54:26 user nova-compute[75122]:     <controller type="usb" index="0" model="none"/>
Nov 15 09:54:26 user nova-compute[75122]:     <memballoon model="virtio">
Nov 15 09:54:26 user nova-compute[75122]:       <stats period="10"/>
Nov 15 09:54:26 user nova-compute[75122]:     </memballoon>
Nov 15 09:54:26 user nova-compute[75122]:   </devices>
Nov 15 09:54:26 user nova-compute[75122]: </domain>
Nov 15 09:54:26 user nova-compute[75122]:  {{(pid=75122) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 09:54:26 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-2c91df7e-0b21-4605-92b2-c29f4aeae7c3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-15T09:50:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1963643859',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1963643859',id=36,image_ref='0980f3c8-6daa-486a-a0fb-329e6e9e4c7b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-130968135',keypairs=<?>,launch_index=0,launched_at=2023-11-15T09:50:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='535c751b9e76421c9262e48fbab3fb6f',ramdisk_id='',reservation_id='r-y94lw7al',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1659813957',owner_user_name='tempest-AttachVolumeShelveTestJSON-1659813957-project-member',shelved_at='2023-11-15T09:52:32.237478',shelved_host='user',shelved_image_id='0980f3c8-6daa-486a-a0fb-329e6e9e4c7b'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T09:54:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad06186836ed40a49a05ef7cc9afd1bc',uuid=40f792bb-43a9-4011-aaba-f240f64e2757,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "da514680-136e-49d6-aec0-9d4192081cec", "address": "fa:16:3e:b0:8a:af", "network": {"id": "7ab99c1b-e670-416e-b5fe-e1337db6b28d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-487518933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "535c751b9e76421c9262e48fbab3fb6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda514680-13", "ovs_interfaceid": "da514680-136e-49d6-aec0-9d4192081cec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 09:54:26 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-2c91df7e-0b21-4605-92b2-c29f4aeae7c3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Converting VIF {"id": "da514680-136e-49d6-aec0-9d4192081cec", "address": "fa:16:3e:b0:8a:af", "network": {"id": "7ab99c1b-e670-416e-b5fe-e1337db6b28d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-487518933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "535c751b9e76421c9262e48fbab3fb6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda514680-13", "ovs_interfaceid": "da514680-136e-49d6-aec0-9d4192081cec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 09:54:26 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-2c91df7e-0b21-4605-92b2-c29f4aeae7c3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:8a:af,bridge_name='br-int',has_traffic_filtering=True,id=da514680-136e-49d6-aec0-9d4192081cec,network=Network(7ab99c1b-e670-416e-b5fe-e1337db6b28d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda514680-13') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 09:54:26 user nova-compute[75122]: DEBUG os_vif [None req-2c91df7e-0b21-4605-92b2-c29f4aeae7c3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:8a:af,bridge_name='br-int',has_traffic_filtering=True,id=da514680-136e-49d6-aec0-9d4192081cec,network=Network(7ab99c1b-e670-416e-b5fe-e1337db6b28d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda514680-13') {{(pid=75122) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 09:54:26 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:54:26 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:54:26 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 09:54:26 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:54:26 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4b2e6546-3724-5432-a48d-1a8851472e1b', '_type': 'linux-noop'}}, row=False) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:54:26 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:54:26 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:54:26 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:54:26 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapda514680-13, may_exist=True, interface_attrs={}) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:54:26 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapda514680-13, col_values=(('qos', UUID('41e77c96-418a-4c8a-8f87-eb539d9195e9')),), if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:54:26 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapda514680-13, col_values=(('external_ids', {'iface-id': 'da514680-136e-49d6-aec0-9d4192081cec', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b0:8a:af', 'vm-uuid': '40f792bb-43a9-4011-aaba-f240f64e2757'}),), if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:54:26 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:54:26 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:54:26 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:54:26 user nova-compute[75122]: INFO os_vif [None req-2c91df7e-0b21-4605-92b2-c29f4aeae7c3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:8a:af,bridge_name='br-int',has_traffic_filtering=True,id=da514680-136e-49d6-aec0-9d4192081cec,network=Network(7ab99c1b-e670-416e-b5fe-e1337db6b28d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda514680-13')
Nov 15 09:54:26 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-2c91df7e-0b21-4605-92b2-c29f4aeae7c3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] No BDM found with device name vda, not building metadata. {{(pid=75122) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 09:54:26 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-2c91df7e-0b21-4605-92b2-c29f4aeae7c3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] No VIF found with MAC fa:16:3e:b0:8a:af, not building metadata {{(pid=75122) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 09:54:28 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:54:28 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:54:28 user nova-compute[75122]: DEBUG nova.compute.manager [req-114736ed-a73a-4737-9e57-700ad6af46f7 req-2ba90740-7b2a-4aba-8001-506eb8c0d1e4 service nova] [instance: 40f792bb-43a9-4011-aaba-f240f64e2757] Received event network-vif-plugged-da514680-136e-49d6-aec0-9d4192081cec {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:54:28 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-114736ed-a73a-4737-9e57-700ad6af46f7 req-2ba90740-7b2a-4aba-8001-506eb8c0d1e4 service nova] Acquiring lock "40f792bb-43a9-4011-aaba-f240f64e2757-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:54:28 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-114736ed-a73a-4737-9e57-700ad6af46f7 req-2ba90740-7b2a-4aba-8001-506eb8c0d1e4 service nova] Lock "40f792bb-43a9-4011-aaba-f240f64e2757-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:54:28 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-114736ed-a73a-4737-9e57-700ad6af46f7 req-2ba90740-7b2a-4aba-8001-506eb8c0d1e4 service nova] Lock "40f792bb-43a9-4011-aaba-f240f64e2757-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:54:28 user nova-compute[75122]: DEBUG nova.compute.manager [req-114736ed-a73a-4737-9e57-700ad6af46f7 req-2ba90740-7b2a-4aba-8001-506eb8c0d1e4 service nova] [instance: 40f792bb-43a9-4011-aaba-f240f64e2757] No waiting events found dispatching network-vif-plugged-da514680-136e-49d6-aec0-9d4192081cec {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:54:28 user nova-compute[75122]: WARNING nova.compute.manager [req-114736ed-a73a-4737-9e57-700ad6af46f7 req-2ba90740-7b2a-4aba-8001-506eb8c0d1e4 service nova] [instance: 40f792bb-43a9-4011-aaba-f240f64e2757] Received unexpected event network-vif-plugged-da514680-136e-49d6-aec0-9d4192081cec for instance with vm_state shelved_offloaded and task_state spawning.
Nov 15 09:54:28 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ae447d5a-6d77-4d23-a449-dd7b1a2e65b7 tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] [instance: 718ca25b-c73d-4853-b674-fdaf3ed465c7] Calling os-brick to attach iSCSI Volume {{(pid=75122) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 09:54:28 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae447d5a-6d77-4d23-a449-dd7b1a2e65b7 tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffa04060b80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:84aa4121-0a2f-4a82-ad90-d2818b6cdcbb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pVabULzE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 09:54:28 user nova-compute[75122]: WARNING os_brick.initiator.connectors.base [None req-ae447d5a-6d77-4d23-a449-dd7b1a2e65b7 tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 09:54:28 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-ae447d5a-6d77-4d23-a449-dd7b1a2e65b7 tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 09:54:28 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-ae447d5a-6d77-4d23-a449-dd7b1a2e65b7 tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 09:54:28 user nova-compute[75122]: WARNING os_brick.initiator.connectors.base [None req-ae447d5a-6d77-4d23-a449-dd7b1a2e65b7 tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 09:54:28 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-ae447d5a-6d77-4d23-a449-dd7b1a2e65b7 tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:84aa4121-0a2f-4a82-ad90-d2818b6cdcbb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 09:54:28 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-ae447d5a-6d77-4d23-a449-dd7b1a2e65b7 tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:84aa4121-0a2f-4a82-ad90-d2818b6cdcbb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 09:54:28 user nova-compute[75122]: INFO os_brick.initiator.connectors.iscsi [None req-ae447d5a-6d77-4d23-a449-dd7b1a2e65b7 tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 09:54:28 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84aa4121-0a2f-4a82-ad90-d2818b6cdcbb -p 172.16.0.220:3260 {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:54:28 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84aa4121-0a2f-4a82-ad90-d2818b6cdcbb -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:54:28 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[c11a2ba8-9686-4410-8826-d7098b0c4ffb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:54:28 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae447d5a-6d77-4d23-a449-dd7b1a2e65b7 tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 09:54:28 user nova-compute[75122]:  {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:54:28 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84aa4121-0a2f-4a82-ad90-d2818b6cdcbb -p 172.16.0.220:3260 --interface default --op new {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:54:28 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84aa4121-0a2f-4a82-ad90-d2818b6cdcbb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:54:28 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4bd6b7b-a18b-4b13-bf3a-db68a27c7df0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:84aa4121-0a2f-4a82-ad90-d2818b6cdcbb] added\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:54:28 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae447d5a-6d77-4d23-a449-dd7b1a2e65b7 tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:84aa4121-0a2f-4a82-ad90-d2818b6cdcbb] added
Nov 15 09:54:28 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:54:28 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84aa4121-0a2f-4a82-ad90-d2818b6cdcbb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:54:28 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84aa4121-0a2f-4a82-ad90-d2818b6cdcbb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:54:28 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[7479c3e4-e0b4-44f0-b34b-832afa1675e8]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:54:28 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae447d5a-6d77-4d23-a449-dd7b1a2e65b7 tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:54:28 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84aa4121-0a2f-4a82-ad90-d2818b6cdcbb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:54:28 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84aa4121-0a2f-4a82-ad90-d2818b6cdcbb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:54:28 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[efcb1c81-98db-4f33-a029-578faad9de98]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:54:28 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae447d5a-6d77-4d23-a449-dd7b1a2e65b7 tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:54:28 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:54:28 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84aa4121-0a2f-4a82-ad90-d2818b6cdcbb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pVabULzE {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:54:28 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:54:28 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:54:28 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84aa4121-0a2f-4a82-ad90-d2818b6cdcbb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pVabULzE" returned: 0 in 0.019s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:54:28 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfb36ded-480e-4f77-8002-8af5b4ea3d7e]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:54:28 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae447d5a-6d77-4d23-a449-dd7b1a2e65b7 tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pVabULzE'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:54:28 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84aa4121-0a2f-4a82-ad90-d2818b6cdcbb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:54:28 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:54:28 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84aa4121-0a2f-4a82-ad90-d2818b6cdcbb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.032s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:54:28 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd8b7040-62d5-4c4d-a1e3-33bc43722074]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:54:28 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae447d5a-6d77-4d23-a449-dd7b1a2e65b7 tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:54:28 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:54:29 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:54:29 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[f76376c9-b655-4425-9614-911b524993b8]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee79db2-27c2-4d0f-8ee6-5b03e05ebba5 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5980f14-24f1-4673-9b31-ee87a0d26092 (non-flash)\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:54:29 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae447d5a-6d77-4d23-a449-dd7b1a2e65b7 tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee79db2-27c2-4d0f-8ee6-5b03e05ebba5 (non-flash)
Nov 15 09:54:29 user nova-compute[75122]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5980f14-24f1-4673-9b31-ee87a0d26092 (non-flash)
Nov 15 09:54:29 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 09:54:29 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae447d5a-6d77-4d23-a449-dd7b1a2e65b7 tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee79db2-27c2-4d0f-8ee6-5b03e05ebba5 (non-flash)
Nov 15 09:54:29 user nova-compute[75122]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5980f14-24f1-4673-9b31-ee87a0d26092 (non-flash)
Nov 15 09:54:29 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 09:54:29 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84aa4121-0a2f-4a82-ad90-d2818b6cdcbb -p 172.16.0.220:3260 --login {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:54:29 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84aa4121-0a2f-4a82-ad90-d2818b6cdcbb -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:54:29 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e7a9179-036d-4346-9636-2c4971e00597]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:84aa4121-0a2f-4a82-ad90-d2818b6cdcbb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:84aa4121-0a2f-4a82-ad90-d2818b6cdcbb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:54:29 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae447d5a-6d77-4d23-a449-dd7b1a2e65b7 tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:84aa4121-0a2f-4a82-ad90-d2818b6cdcbb, portal: 172.16.0.220,3260]
Nov 15 09:54:29 user nova-compute[75122]: Login to [iface: default, target: iqn.2010-10.org.openstack:84aa4121-0a2f-4a82-ad90-d2818b6cdcbb, portal: 172.16.0.220,3260] successful.
Nov 15 09:54:29 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:54:29 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84aa4121-0a2f-4a82-ad90-d2818b6cdcbb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:54:29 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84aa4121-0a2f-4a82-ad90-d2818b6cdcbb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.052s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:54:29 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a83b23a-f12d-4eeb-ab74-837a403e139a]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:54:29 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae447d5a-6d77-4d23-a449-dd7b1a2e65b7 tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:54:29 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:54:29 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:54:29 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[834952c4-40e9-4667-8adb-4a606cb3a621]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee79db2-27c2-4d0f-8ee6-5b03e05ebba5 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5980f14-24f1-4673-9b31-ee87a0d26092 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84aa4121-0a2f-4a82-ad90-d2818b6cdcbb (non-flash)\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:54:29 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae447d5a-6d77-4d23-a449-dd7b1a2e65b7 tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee79db2-27c2-4d0f-8ee6-5b03e05ebba5 (non-flash)
Nov 15 09:54:29 user nova-compute[75122]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5980f14-24f1-4673-9b31-ee87a0d26092 (non-flash)
Nov 15 09:54:29 user nova-compute[75122]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84aa4121-0a2f-4a82-ad90-d2818b6cdcbb (non-flash)
Nov 15 09:54:29 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 09:54:29 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae447d5a-6d77-4d23-a449-dd7b1a2e65b7 tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee79db2-27c2-4d0f-8ee6-5b03e05ebba5 (non-flash)
Nov 15 09:54:29 user nova-compute[75122]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5980f14-24f1-4673-9b31-ee87a0d26092 (non-flash)
Nov 15 09:54:29 user nova-compute[75122]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84aa4121-0a2f-4a82-ad90-d2818b6cdcbb (non-flash)
Nov 15 09:54:29 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 09:54:29 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-ae447d5a-6d77-4d23-a449-dd7b1a2e65b7 tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:84aa4121-0a2f-4a82-ad90-d2818b6cdcbb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.313s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 09:54:29 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae447d5a-6d77-4d23-a449-dd7b1a2e65b7 tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] Connected to 172.16.0.220:3260 {{(pid=75122) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 09:54:29 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-ae447d5a-6d77-4d23-a449-dd7b1a2e65b7 tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] HCTL ('35', '-', '-', 0) found on session 49 with lun 0 {{(pid=75122) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 09:54:29 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-ae447d5a-6d77-4d23-a449-dd7b1a2e65b7 tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75122) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 09:54:29 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:54:29 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:54:29 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[947cfc7a-0048-4876-9614-d3796c8b1906]: (4, ('- - 0', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:54:29 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-ae447d5a-6d77-4d23-a449-dd7b1a2e65b7 tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] Searching for a device in session 49 and hctl ['35', '*', '*', 0] yield: None {{(pid=75122) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 09:54:30 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-ae447d5a-6d77-4d23-a449-dd7b1a2e65b7 tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] Searching for a device in session 49 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75122) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 09:54:30 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae447d5a-6d77-4d23-a449-dd7b1a2e65b7 tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:84aa4121-0a2f-4a82-ad90-d2818b6cdcbb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pVabULzE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75122) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 09:54:30 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-ae447d5a-6d77-4d23-a449-dd7b1a2e65b7 tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.343s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 09:54:30 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae447d5a-6d77-4d23-a449-dd7b1a2e65b7 tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] <== connect_volume: return (1345ms) {'type': 'block', 'scsi_wwn': '23662626533383566', 'path': '/dev/sdd'} {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 09:54:30 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ae447d5a-6d77-4d23-a449-dd7b1a2e65b7 tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] [instance: 718ca25b-c73d-4853-b674-fdaf3ed465c7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23662626533383566', 'path': '/dev/sdd'} {{(pid=75122) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 09:54:30 user nova-compute[75122]: DEBUG nova.objects.instance [None req-ae447d5a-6d77-4d23-a449-dd7b1a2e65b7 tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] Lazy-loading 'flavor' on Instance uuid 718ca25b-c73d-4853-b674-fdaf3ed465c7 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:54:30 user nova-compute[75122]: DEBUG nova.virt.libvirt.guest [None req-ae447d5a-6d77-4d23-a449-dd7b1a2e65b7 tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 09:54:30 user nova-compute[75122]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 09:54:30 user nova-compute[75122]:   <source dev="/dev/sdd"/>
Nov 15 09:54:30 user nova-compute[75122]:   <target dev="vdc" bus="virtio"/>
Nov 15 09:54:30 user nova-compute[75122]:   <serial>84aa4121-0a2f-4a82-ad90-d2818b6cdcbb</serial>
Nov 15 09:54:30 user nova-compute[75122]: </disk>
Nov 15 09:54:30 user nova-compute[75122]:  {{(pid=75122) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 09:54:30 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-ae447d5a-6d77-4d23-a449-dd7b1a2e65b7 tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] No BDM found with device name vda, not building metadata. {{(pid=75122) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 09:54:30 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-ae447d5a-6d77-4d23-a449-dd7b1a2e65b7 tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75122) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 09:54:30 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-ae447d5a-6d77-4d23-a449-dd7b1a2e65b7 tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75122) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 09:54:30 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-ae447d5a-6d77-4d23-a449-dd7b1a2e65b7 tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] No VIF found with MAC fa:16:3e:2a:93:fb, not building metadata {{(pid=75122) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 09:54:30 user nova-compute[75122]: DEBUG nova.compute.manager [req-3e2e9e9d-82ca-4250-8255-b3d076dcf522 req-5f748632-0cea-44b8-ba29-2a2da5787330 service nova] [instance: 40f792bb-43a9-4011-aaba-f240f64e2757] Received event network-vif-plugged-da514680-136e-49d6-aec0-9d4192081cec {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:54:30 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-3e2e9e9d-82ca-4250-8255-b3d076dcf522 req-5f748632-0cea-44b8-ba29-2a2da5787330 service nova] Acquiring lock "40f792bb-43a9-4011-aaba-f240f64e2757-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:54:30 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-3e2e9e9d-82ca-4250-8255-b3d076dcf522 req-5f748632-0cea-44b8-ba29-2a2da5787330 service nova] Lock "40f792bb-43a9-4011-aaba-f240f64e2757-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:54:30 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-3e2e9e9d-82ca-4250-8255-b3d076dcf522 req-5f748632-0cea-44b8-ba29-2a2da5787330 service nova] Lock "40f792bb-43a9-4011-aaba-f240f64e2757-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:54:30 user nova-compute[75122]: DEBUG nova.compute.manager [req-3e2e9e9d-82ca-4250-8255-b3d076dcf522 req-5f748632-0cea-44b8-ba29-2a2da5787330 service nova] [instance: 40f792bb-43a9-4011-aaba-f240f64e2757] No waiting events found dispatching network-vif-plugged-da514680-136e-49d6-aec0-9d4192081cec {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:54:30 user nova-compute[75122]: WARNING nova.compute.manager [req-3e2e9e9d-82ca-4250-8255-b3d076dcf522 req-5f748632-0cea-44b8-ba29-2a2da5787330 service nova] [instance: 40f792bb-43a9-4011-aaba-f240f64e2757] Received unexpected event network-vif-plugged-da514680-136e-49d6-aec0-9d4192081cec for instance with vm_state shelved_offloaded and task_state spawning.
Nov 15 09:54:30 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-ae447d5a-6d77-4d23-a449-dd7b1a2e65b7 tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] Lock "718ca25b-c73d-4853-b674-fdaf3ed465c7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.238s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:54:30 user nova-compute[75122]: DEBUG nova.compute.manager [None req-2c91df7e-0b21-4605-92b2-c29f4aeae7c3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] [instance: 40f792bb-43a9-4011-aaba-f240f64e2757] Instance event wait completed in 0 seconds for  {{(pid=75122) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 09:54:30 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-2c91df7e-0b21-4605-92b2-c29f4aeae7c3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] [instance: 40f792bb-43a9-4011-aaba-f240f64e2757] Guest created on hypervisor {{(pid=75122) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 09:54:30 user nova-compute[75122]: INFO nova.virt.libvirt.driver [-] [instance: 40f792bb-43a9-4011-aaba-f240f64e2757] Instance spawned successfully.
Nov 15 09:54:31 user nova-compute[75122]: DEBUG nova.compute.manager [None req-2c91df7e-0b21-4605-92b2-c29f4aeae7c3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] [instance: 40f792bb-43a9-4011-aaba-f240f64e2757] Checking state {{(pid=75122) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 09:54:31 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:54:31 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:54:31 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:54:31 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-2c91df7e-0b21-4605-92b2-c29f4aeae7c3 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Lock "40f792bb-43a9-4011-aaba-f240f64e2757" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 10.523s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:54:31 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:54:31 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:54:31 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:54:31 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75122) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 09:54:31 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-7a117aaf-08c7-41b4-9cd8-5d5b0e4bbdae tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] Acquiring lock "718ca25b-c73d-4853-b674-fdaf3ed465c7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:54:31 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-7a117aaf-08c7-41b4-9cd8-5d5b0e4bbdae tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] Lock "718ca25b-c73d-4853-b674-fdaf3ed465c7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:54:31 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40f792bb-43a9-4011-aaba-f240f64e2757/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:54:31 user nova-compute[75122]: INFO nova.compute.manager [None req-7a117aaf-08c7-41b4-9cd8-5d5b0e4bbdae tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] [instance: 718ca25b-c73d-4853-b674-fdaf3ed465c7] Detaching volume 84aa4121-0a2f-4a82-ad90-d2818b6cdcbb
Nov 15 09:54:31 user nova-compute[75122]: INFO nova.virt.block_device [None req-7a117aaf-08c7-41b4-9cd8-5d5b0e4bbdae tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] [instance: 718ca25b-c73d-4853-b674-fdaf3ed465c7] Attempting to driver detach volume 84aa4121-0a2f-4a82-ad90-d2818b6cdcbb from mountpoint /dev/vdc
Nov 15 09:54:31 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-7a117aaf-08c7-41b4-9cd8-5d5b0e4bbdae tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] Attempting to detach device vdc from instance 718ca25b-c73d-4853-b674-fdaf3ed465c7 from the persistent domain config. {{(pid=75122) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 09:54:31 user nova-compute[75122]: DEBUG nova.virt.libvirt.guest [None req-7a117aaf-08c7-41b4-9cd8-5d5b0e4bbdae tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 09:54:31 user nova-compute[75122]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 09:54:31 user nova-compute[75122]:   <source dev="/dev/sdd"/>
Nov 15 09:54:31 user nova-compute[75122]:   <target dev="vdc" bus="virtio"/>
Nov 15 09:54:31 user nova-compute[75122]:   <serial>84aa4121-0a2f-4a82-ad90-d2818b6cdcbb</serial>
Nov 15 09:54:31 user nova-compute[75122]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 15 09:54:31 user nova-compute[75122]: </disk>
Nov 15 09:54:31 user nova-compute[75122]:  {{(pid=75122) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 09:54:31 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-7a117aaf-08c7-41b4-9cd8-5d5b0e4bbdae tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] Successfully detached device vdc from instance 718ca25b-c73d-4853-b674-fdaf3ed465c7 from the persistent domain config.
Nov 15 09:54:31 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-7a117aaf-08c7-41b4-9cd8-5d5b0e4bbdae tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 718ca25b-c73d-4853-b674-fdaf3ed465c7 from the live domain config. {{(pid=75122) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 09:54:31 user nova-compute[75122]: DEBUG nova.virt.libvirt.guest [None req-7a117aaf-08c7-41b4-9cd8-5d5b0e4bbdae tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 09:54:31 user nova-compute[75122]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 09:54:31 user nova-compute[75122]:   <source dev="/dev/sdd"/>
Nov 15 09:54:31 user nova-compute[75122]:   <target dev="vdc" bus="virtio"/>
Nov 15 09:54:31 user nova-compute[75122]:   <serial>84aa4121-0a2f-4a82-ad90-d2818b6cdcbb</serial>
Nov 15 09:54:31 user nova-compute[75122]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 15 09:54:31 user nova-compute[75122]: </disk>
Nov 15 09:54:31 user nova-compute[75122]:  {{(pid=75122) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 09:54:31 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:54:31 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40f792bb-43a9-4011-aaba-f240f64e2757/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:54:31 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40f792bb-43a9-4011-aaba-f240f64e2757/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:54:31 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40f792bb-43a9-4011-aaba-f240f64e2757/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:54:31 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:54:31 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-7a117aaf-08c7-41b4-9cd8-5d5b0e4bbdae tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 718ca25b-c73d-4853-b674-fdaf3ed465c7 {{(pid=75122) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 09:54:31 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/718ca25b-c73d-4853-b674-fdaf3ed465c7/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:54:32 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/718ca25b-c73d-4853-b674-fdaf3ed465c7/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:54:32 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/718ca25b-c73d-4853-b674-fdaf3ed465c7/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:54:32 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/718ca25b-c73d-4853-b674-fdaf3ed465c7/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:54:32 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75122) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 09:54:32 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/001d589e-1bee-42da-8422-233ba796fbab/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:54:32 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/001d589e-1bee-42da-8422-233ba796fbab/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:54:32 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/001d589e-1bee-42da-8422-233ba796fbab/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:54:32 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/001d589e-1bee-42da-8422-233ba796fbab/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:54:32 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be71985e-a370-43d9-adef-afb31d03e2fd/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:54:32 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be71985e-a370-43d9-adef-afb31d03e2fd/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:54:32 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be71985e-a370-43d9-adef-afb31d03e2fd/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:54:33 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be71985e-a370-43d9-adef-afb31d03e2fd/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:54:33 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75122) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 09:54:33 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 09:54:33 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 09:54:33 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Hypervisor/Node resource view: name=user free_ram=8635MB free_disk=25.188060760498047GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75122) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 09:54:33 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:54:33 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:54:33 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance 001d589e-1bee-42da-8422-233ba796fbab actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:54:33 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance 718ca25b-c73d-4853-b674-fdaf3ed465c7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:54:33 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance db848537-676f-464a-806d-febb14d920a6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:54:33 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance be71985e-a370-43d9-adef-afb31d03e2fd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:54:33 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance 40f792bb-43a9-4011-aaba-f240f64e2757 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:54:33 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=75122) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 09:54:33 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=75122) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 09:54:33 user nova-compute[75122]: DEBUG nova.compute.provider_tree [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Inventory has not changed in ProviderTree for provider: 69a3da65-47be-44c6-b67c-c692b58284ef {{(pid=75122) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 09:54:33 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Inventory has not changed for provider 69a3da65-47be-44c6-b67c-c692b58284ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 09:54:33 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Compute_service record updated for user:user {{(pid=75122) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 09:54:33 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.348s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:54:34 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:54:34 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Starting heal instance info cache {{(pid=75122) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 09:54:34 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Rebuilding the list of instances to heal {{(pid=75122) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 09:54:34 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "refresh_cache-001d589e-1bee-42da-8422-233ba796fbab" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 09:54:34 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquired lock "refresh_cache-001d589e-1bee-42da-8422-233ba796fbab" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 09:54:34 user nova-compute[75122]: DEBUG nova.network.neutron [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] [instance: 001d589e-1bee-42da-8422-233ba796fbab] Forcefully refreshing network info cache for instance {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 09:54:34 user nova-compute[75122]: DEBUG nova.objects.instance [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lazy-loading 'info_cache' on Instance uuid 001d589e-1bee-42da-8422-233ba796fbab {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:54:35 user nova-compute[75122]: DEBUG nova.network.neutron [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] [instance: 001d589e-1bee-42da-8422-233ba796fbab] Updating instance_info_cache with network_info: [{"id": "6a77f68d-d3da-47c6-a3de-09bd69399762", "address": "fa:16:3e:87:a0:de", "network": {"id": "b780d5c1-a549-4b49-a036-5a272697d4b6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-229344021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c046170a2ad44ebba5d2de236d940be0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a77f68d-d3", "ovs_interfaceid": "6a77f68d-d3da-47c6-a3de-09bd69399762", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:54:35 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Releasing lock "refresh_cache-001d589e-1bee-42da-8422-233ba796fbab" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 09:54:35 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] [instance: 001d589e-1bee-42da-8422-233ba796fbab] Updated the network info_cache for instance {{(pid=75122) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 09:54:35 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:54:35 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:54:35 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:54:35 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:54:35 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75122) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 09:54:36 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:54:37 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:54:38 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:54:41 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:54:46 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:54:46 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:54:51 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:54:51 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:54:51 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-7a117aaf-08c7-41b4-9cd8-5d5b0e4bbdae tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 718ca25b-c73d-4853-b674-fdaf3ed465c7 is timed out.
Nov 15 09:54:51 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-7a117aaf-08c7-41b4-9cd8-5d5b0e4bbdae tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] Successfully detached device vdc from instance 718ca25b-c73d-4853-b674-fdaf3ed465c7 from the live domain config.
Nov 15 09:54:51 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7a117aaf-08c7-41b4-9cd8-5d5b0e4bbdae tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] [instance: 718ca25b-c73d-4853-b674-fdaf3ed465c7] calling os-brick to detach iSCSI Volume {{(pid=75122) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 09:54:51 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a117aaf-08c7-41b4-9cd8-5d5b0e4bbdae tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffa04060b80>, {'target_iqn': 'iqn.2010-10.org.openstack:84aa4121-0a2f-4a82-ad90-d2818b6cdcbb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pVabULzE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 09:54:51 user nova-compute[75122]: WARNING os_brick.initiator.connectors.base [None req-7a117aaf-08c7-41b4-9cd8-5d5b0e4bbdae tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 09:54:51 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-7a117aaf-08c7-41b4-9cd8-5d5b0e4bbdae tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 09:54:51 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-7a117aaf-08c7-41b4-9cd8-5d5b0e4bbdae tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 09:54:51 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:54:52 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:54:52 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[097dbbf7-230e-47e3-896a-65a30e3d9648]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:84aa4121-0a2f-4a82-ad90-d2818b6cdcbb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e5980f14-24f1-4673-9b31-ee87a0d26092\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8ee79db2-27c2-4d0f-8ee6-5b03e05ebba5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:54:52 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a117aaf-08c7-41b4-9cd8-5d5b0e4bbdae tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 09:54:52 user nova-compute[75122]: No targets found.
Nov 15 09:54:52 user nova-compute[75122]: iSNS:
Nov 15 09:54:52 user nova-compute[75122]: No targets found.
Nov 15 09:54:52 user nova-compute[75122]: STATIC:
Nov 15 09:54:52 user nova-compute[75122]: Target: iqn.2010-10.org.openstack:84aa4121-0a2f-4a82-ad90-d2818b6cdcbb
Nov 15 09:54:52 user nova-compute[75122]:         Portal: 172.16.0.220:3260,-1
Nov 15 09:54:52 user nova-compute[75122]:                 Iface Name: default
Nov 15 09:54:52 user nova-compute[75122]: Target: iqn.2010-10.org.openstack:e5980f14-24f1-4673-9b31-ee87a0d26092
Nov 15 09:54:52 user nova-compute[75122]:         Portal: 172.16.0.220:3260,-1
Nov 15 09:54:52 user nova-compute[75122]:                 Iface Name: default
Nov 15 09:54:52 user nova-compute[75122]: Target: iqn.2010-10.org.openstack:8ee79db2-27c2-4d0f-8ee6-5b03e05ebba5
Nov 15 09:54:52 user nova-compute[75122]:         Portal: 172.16.0.220:3260,-1
Nov 15 09:54:52 user nova-compute[75122]:                 Iface Name: default
Nov 15 09:54:52 user nova-compute[75122]: FIRMWARE:
Nov 15 09:54:52 user nova-compute[75122]: No targets found.
Nov 15 09:54:52 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 09:54:52 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a117aaf-08c7-41b4-9cd8-5d5b0e4bbdae tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 09:54:52 user nova-compute[75122]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 09:54:52 user nova-compute[75122]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75122) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 09:54:52 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a117aaf-08c7-41b4-9cd8-5d5b0e4bbdae tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:84aa4121-0a2f-4a82-ad90-d2818b6cdcbb', 0)] {{(pid=75122) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 09:54:52 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:54:52 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:54:52 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[85865469-3afb-4478-9092-837d77483875]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:84aa4121-0a2f-4a82-ad90-d2818b6cdcbb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8ee79db2-27c2-4d0f-8ee6-5b03e05ebba5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e5980f14-24f1-4673-9b31-ee87a0d26092\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:54:52 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:54:52 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:54:52 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[13aa3c44-5a72-4d05-be21-9197c870a5ba]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee79db2-27c2-4d0f-8ee6-5b03e05ebba5 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5980f14-24f1-4673-9b31-ee87a0d26092 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84aa4121-0a2f-4a82-ad90-d2818b6cdcbb (non-flash)\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:54:52 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a117aaf-08c7-41b4-9cd8-5d5b0e4bbdae tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee79db2-27c2-4d0f-8ee6-5b03e05ebba5 (non-flash)
Nov 15 09:54:52 user nova-compute[75122]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5980f14-24f1-4673-9b31-ee87a0d26092 (non-flash)
Nov 15 09:54:52 user nova-compute[75122]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84aa4121-0a2f-4a82-ad90-d2818b6cdcbb (non-flash)
Nov 15 09:54:52 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 09:54:52 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a117aaf-08c7-41b4-9cd8-5d5b0e4bbdae tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee79db2-27c2-4d0f-8ee6-5b03e05ebba5 (non-flash)
Nov 15 09:54:52 user nova-compute[75122]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5980f14-24f1-4673-9b31-ee87a0d26092 (non-flash)
Nov 15 09:54:52 user nova-compute[75122]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84aa4121-0a2f-4a82-ad90-d2818b6cdcbb (non-flash)
Nov 15 09:54:52 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 09:54:52 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a117aaf-08c7-41b4-9cd8-5d5b0e4bbdae tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ffa040908b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:84aa4121-0a2f-4a82-ad90-d2818b6cdcbb'): ({'sdd'}, set())}) {{(pid=75122) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 09:54:52 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-7a117aaf-08c7-41b4-9cd8-5d5b0e4bbdae tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] Removing single pathed devices sdd {{(pid=75122) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 09:54:52 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:54:52 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:54:52 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[607ac8b1-c27d-4d5f-9a96-7b0960c6ccc1]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:54:52 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:54:52 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.017s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:54:52 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2d5b74c-2034-4106-9fb9-714537214f0e]: (4, ('ok\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:54:52 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-7a117aaf-08c7-41b4-9cd8-5d5b0e4bbdae tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] Flushing IO for device /dev/sdd {{(pid=75122) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 09:54:52 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:54:52 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:54:52 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bb45018-97de-4ca9-aeb6-e9b170265638]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:54:52 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-7a117aaf-08c7-41b4-9cd8-5d5b0e4bbdae tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75122) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 09:54:52 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:54:52 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.046s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:54:52 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[43b678f0-c082-47d2-b1ba-b5ac6218d152]: (4, ('1', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:54:52 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-7a117aaf-08c7-41b4-9cd8-5d5b0e4bbdae tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75122) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 09:54:52 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-7a117aaf-08c7-41b4-9cd8-5d5b0e4bbdae tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] SCSI volumes sdd have been removed. {{(pid=75122) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 09:54:52 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a117aaf-08c7-41b4-9cd8-5d5b0e4bbdae tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:84aa4121-0a2f-4a82-ad90-d2818b6cdcbb')] {{(pid=75122) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 09:54:52 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84aa4121-0a2f-4a82-ad90-d2818b6cdcbb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:54:52 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84aa4121-0a2f-4a82-ad90-d2818b6cdcbb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:54:52 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[3631c990-c164-49ee-847b-eb666f964275]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:54:52 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a117aaf-08c7-41b4-9cd8-5d5b0e4bbdae tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:54:52 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84aa4121-0a2f-4a82-ad90-d2818b6cdcbb -p 172.16.0.220:3260 --logout {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:54:52 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84aa4121-0a2f-4a82-ad90-d2818b6cdcbb -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:54:52 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cd29d05-57d1-46bf-92cf-c96e7d602c88]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:84aa4121-0a2f-4a82-ad90-d2818b6cdcbb, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:84aa4121-0a2f-4a82-ad90-d2818b6cdcbb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:54:52 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a117aaf-08c7-41b4-9cd8-5d5b0e4bbdae tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:84aa4121-0a2f-4a82-ad90-d2818b6cdcbb, portal: 172.16.0.220,3260]
Nov 15 09:54:52 user nova-compute[75122]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:84aa4121-0a2f-4a82-ad90-d2818b6cdcbb, portal: 172.16.0.220,3260] successful.
Nov 15 09:54:52 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:54:52 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84aa4121-0a2f-4a82-ad90-d2818b6cdcbb -p 172.16.0.220:3260 --op delete {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:54:52 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84aa4121-0a2f-4a82-ad90-d2818b6cdcbb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:54:52 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5bf2861-38f9-472f-a381-1525b3accb25]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:54:52 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a117aaf-08c7-41b4-9cd8-5d5b0e4bbdae tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:54:52 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-7a117aaf-08c7-41b4-9cd8-5d5b0e4bbdae tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.315s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 09:54:52 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a117aaf-08c7-41b4-9cd8-5d5b0e4bbdae tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] <== disconnect_volume: return (316ms) None {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 09:54:52 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7a117aaf-08c7-41b4-9cd8-5d5b0e4bbdae tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] [instance: 718ca25b-c73d-4853-b674-fdaf3ed465c7] Disconnected iSCSI Volume {{(pid=75122) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 09:54:53 user nova-compute[75122]: DEBUG nova.objects.instance [None req-7a117aaf-08c7-41b4-9cd8-5d5b0e4bbdae tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] Lazy-loading 'flavor' on Instance uuid 718ca25b-c73d-4853-b674-fdaf3ed465c7 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:54:53 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-7a117aaf-08c7-41b4-9cd8-5d5b0e4bbdae tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] Lock "718ca25b-c73d-4853-b674-fdaf3ed465c7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.770s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:54:56 user nova-compute[75122]: INFO nova.compute.manager [None req-e0a6c3f9-c37e-497c-9bbc-f14ab6f4e407 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: db848537-676f-464a-806d-febb14d920a6] Rescuing
Nov 15 09:54:56 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-e0a6c3f9-c37e-497c-9bbc-f14ab6f4e407 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Acquiring lock "refresh_cache-db848537-676f-464a-806d-febb14d920a6" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 09:54:56 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-e0a6c3f9-c37e-497c-9bbc-f14ab6f4e407 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Acquired lock "refresh_cache-db848537-676f-464a-806d-febb14d920a6" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 09:54:56 user nova-compute[75122]: DEBUG nova.network.neutron [None req-e0a6c3f9-c37e-497c-9bbc-f14ab6f4e407 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: db848537-676f-464a-806d-febb14d920a6] Building network info cache for instance {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 09:54:56 user nova-compute[75122]: DEBUG nova.network.neutron [None req-e0a6c3f9-c37e-497c-9bbc-f14ab6f4e407 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: db848537-676f-464a-806d-febb14d920a6] Updating instance_info_cache with network_info: [{"id": "93bbff2d-1d5c-47db-b436-43796849be51", "address": "fa:16:3e:eb:e9:ca", "network": {"id": "b780d5c1-a549-4b49-a036-5a272697d4b6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-229344021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c046170a2ad44ebba5d2de236d940be0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93bbff2d-1d", "ovs_interfaceid": "93bbff2d-1d5c-47db-b436-43796849be51", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:54:56 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-e0a6c3f9-c37e-497c-9bbc-f14ab6f4e407 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Releasing lock "refresh_cache-db848537-676f-464a-806d-febb14d920a6" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 09:54:56 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:54:56 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:54:56 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:54:56 user nova-compute[75122]: DEBUG nova.compute.manager [req-2cd78c71-3ed0-4645-aa78-b97771742d99 req-683a414c-6225-4d6d-b49e-ec4e4539e6bd service nova] [instance: db848537-676f-464a-806d-febb14d920a6] Received event network-vif-unplugged-93bbff2d-1d5c-47db-b436-43796849be51 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:54:56 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-2cd78c71-3ed0-4645-aa78-b97771742d99 req-683a414c-6225-4d6d-b49e-ec4e4539e6bd service nova] Acquiring lock "db848537-676f-464a-806d-febb14d920a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:54:56 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-2cd78c71-3ed0-4645-aa78-b97771742d99 req-683a414c-6225-4d6d-b49e-ec4e4539e6bd service nova] Lock "db848537-676f-464a-806d-febb14d920a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:54:56 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-2cd78c71-3ed0-4645-aa78-b97771742d99 req-683a414c-6225-4d6d-b49e-ec4e4539e6bd service nova] Lock "db848537-676f-464a-806d-febb14d920a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:54:56 user nova-compute[75122]: DEBUG nova.compute.manager [req-2cd78c71-3ed0-4645-aa78-b97771742d99 req-683a414c-6225-4d6d-b49e-ec4e4539e6bd service nova] [instance: db848537-676f-464a-806d-febb14d920a6] No waiting events found dispatching network-vif-unplugged-93bbff2d-1d5c-47db-b436-43796849be51 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:54:56 user nova-compute[75122]: WARNING nova.compute.manager [req-2cd78c71-3ed0-4645-aa78-b97771742d99 req-683a414c-6225-4d6d-b49e-ec4e4539e6bd service nova] [instance: db848537-676f-464a-806d-febb14d920a6] Received unexpected event network-vif-unplugged-93bbff2d-1d5c-47db-b436-43796849be51 for instance with vm_state active and task_state rescuing.
Nov 15 09:54:56 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:54:56 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:54:56 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:54:57 user nova-compute[75122]: INFO nova.virt.libvirt.driver [-] [instance: db848537-676f-464a-806d-febb14d920a6] Instance destroyed successfully.
Nov 15 09:54:57 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-e0a6c3f9-c37e-497c-9bbc-f14ab6f4e407 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: db848537-676f-464a-806d-febb14d920a6] Attempting a stable device rescue
Nov 15 09:54:57 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-e0a6c3f9-c37e-497c-9bbc-f14ab6f4e407 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75122) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 15 09:54:57 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-e0a6c3f9-c37e-497c-9bbc-f14ab6f4e407 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: db848537-676f-464a-806d-febb14d920a6] Instance directory exists: not creating {{(pid=75122) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 15 09:54:57 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-e0a6c3f9-c37e-497c-9bbc-f14ab6f4e407 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: db848537-676f-464a-806d-febb14d920a6] Creating image(s)
Nov 15 09:54:57 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-e0a6c3f9-c37e-497c-9bbc-f14ab6f4e407 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Acquiring lock "/opt/stack/data/nova/instances/db848537-676f-464a-806d-febb14d920a6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:54:57 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-e0a6c3f9-c37e-497c-9bbc-f14ab6f4e407 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Lock "/opt/stack/data/nova/instances/db848537-676f-464a-806d-febb14d920a6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:54:57 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-e0a6c3f9-c37e-497c-9bbc-f14ab6f4e407 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Lock "/opt/stack/data/nova/instances/db848537-676f-464a-806d-febb14d920a6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:54:57 user nova-compute[75122]: DEBUG nova.objects.instance [None req-e0a6c3f9-c37e-497c-9bbc-f14ab6f4e407 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Lazy-loading 'trusted_certs' on Instance uuid db848537-676f-464a-806d-febb14d920a6 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:54:57 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-e0a6c3f9-c37e-497c-9bbc-f14ab6f4e407 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Acquiring lock "c477712bb5f1028349d55ba6416b688cbe21f00e" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:54:57 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-e0a6c3f9-c37e-497c-9bbc-f14ab6f4e407 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Lock "c477712bb5f1028349d55ba6416b688cbe21f00e" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:54:58 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-e0a6c3f9-c37e-497c-9bbc-f14ab6f4e407 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c477712bb5f1028349d55ba6416b688cbe21f00e.part --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:54:58 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-bd240bea-9129-4f5d-a5f3-001aed1133bf tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] Acquiring lock "57dff82c-f7f3-45a7-b645-3cf72a1266ce" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:54:58 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-bd240bea-9129-4f5d-a5f3-001aed1133bf tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] Lock "57dff82c-f7f3-45a7-b645-3cf72a1266ce" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:54:58 user nova-compute[75122]: DEBUG nova.compute.manager [None req-bd240bea-9129-4f5d-a5f3-001aed1133bf tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] [instance: 57dff82c-f7f3-45a7-b645-3cf72a1266ce] Starting instance... {{(pid=75122) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 09:54:58 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-bd240bea-9129-4f5d-a5f3-001aed1133bf tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:54:58 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-bd240bea-9129-4f5d-a5f3-001aed1133bf tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:54:58 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-e0a6c3f9-c37e-497c-9bbc-f14ab6f4e407 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c477712bb5f1028349d55ba6416b688cbe21f00e.part --force-share --output=json" returned: 0 in 0.184s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:54:58 user nova-compute[75122]: DEBUG nova.virt.images [None req-e0a6c3f9-c37e-497c-9bbc-f14ab6f4e407 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] da3f1319-28a7-4021-9aa6-9787ce9ee334 was qcow2, converting to raw {{(pid=75122) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 15 09:54:58 user nova-compute[75122]: DEBUG nova.privsep.utils [None req-e0a6c3f9-c37e-497c-9bbc-f14ab6f4e407 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75122) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 09:54:58 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-e0a6c3f9-c37e-497c-9bbc-f14ab6f4e407 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c477712bb5f1028349d55ba6416b688cbe21f00e.part /opt/stack/data/nova/instances/_base/c477712bb5f1028349d55ba6416b688cbe21f00e.converted {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:54:58 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-bd240bea-9129-4f5d-a5f3-001aed1133bf tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75122) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 09:54:58 user nova-compute[75122]: INFO nova.compute.claims [None req-bd240bea-9129-4f5d-a5f3-001aed1133bf tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] [instance: 57dff82c-f7f3-45a7-b645-3cf72a1266ce] Claim successful on node user
Nov 15 09:54:58 user nova-compute[75122]: DEBUG nova.compute.manager [req-163afe14-027e-4a48-8e65-81bbf353ad1a req-bd470b3e-8f57-4d4e-84ad-e1f8c80d45e4 service nova] [instance: db848537-676f-464a-806d-febb14d920a6] Received event network-vif-plugged-93bbff2d-1d5c-47db-b436-43796849be51 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:54:58 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-163afe14-027e-4a48-8e65-81bbf353ad1a req-bd470b3e-8f57-4d4e-84ad-e1f8c80d45e4 service nova] Acquiring lock "db848537-676f-464a-806d-febb14d920a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:54:58 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-163afe14-027e-4a48-8e65-81bbf353ad1a req-bd470b3e-8f57-4d4e-84ad-e1f8c80d45e4 service nova] Lock "db848537-676f-464a-806d-febb14d920a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:54:58 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-163afe14-027e-4a48-8e65-81bbf353ad1a req-bd470b3e-8f57-4d4e-84ad-e1f8c80d45e4 service nova] Lock "db848537-676f-464a-806d-febb14d920a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:54:58 user nova-compute[75122]: DEBUG nova.compute.manager [req-163afe14-027e-4a48-8e65-81bbf353ad1a req-bd470b3e-8f57-4d4e-84ad-e1f8c80d45e4 service nova] [instance: db848537-676f-464a-806d-febb14d920a6] No waiting events found dispatching network-vif-plugged-93bbff2d-1d5c-47db-b436-43796849be51 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:54:58 user nova-compute[75122]: WARNING nova.compute.manager [req-163afe14-027e-4a48-8e65-81bbf353ad1a req-bd470b3e-8f57-4d4e-84ad-e1f8c80d45e4 service nova] [instance: db848537-676f-464a-806d-febb14d920a6] Received unexpected event network-vif-plugged-93bbff2d-1d5c-47db-b436-43796849be51 for instance with vm_state active and task_state rescuing.
Nov 15 09:54:59 user nova-compute[75122]: DEBUG nova.compute.provider_tree [None req-bd240bea-9129-4f5d-a5f3-001aed1133bf tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] Inventory has not changed in ProviderTree for provider: 69a3da65-47be-44c6-b67c-c692b58284ef {{(pid=75122) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 09:54:59 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-bd240bea-9129-4f5d-a5f3-001aed1133bf tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] Inventory has not changed for provider 69a3da65-47be-44c6-b67c-c692b58284ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 09:54:59 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-bd240bea-9129-4f5d-a5f3-001aed1133bf tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.500s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:54:59 user nova-compute[75122]: DEBUG nova.compute.manager [None req-bd240bea-9129-4f5d-a5f3-001aed1133bf tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] [instance: 57dff82c-f7f3-45a7-b645-3cf72a1266ce] Start building networks asynchronously for instance. {{(pid=75122) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 09:54:59 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-e0a6c3f9-c37e-497c-9bbc-f14ab6f4e407 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c477712bb5f1028349d55ba6416b688cbe21f00e.part /opt/stack/data/nova/instances/_base/c477712bb5f1028349d55ba6416b688cbe21f00e.converted" returned: 0 in 0.513s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:54:59 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-e0a6c3f9-c37e-497c-9bbc-f14ab6f4e407 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c477712bb5f1028349d55ba6416b688cbe21f00e.converted --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:54:59 user nova-compute[75122]: DEBUG nova.compute.manager [None req-bd240bea-9129-4f5d-a5f3-001aed1133bf tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] [instance: 57dff82c-f7f3-45a7-b645-3cf72a1266ce] Allocating IP information in the background. {{(pid=75122) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 09:54:59 user nova-compute[75122]: DEBUG nova.network.neutron [None req-bd240bea-9129-4f5d-a5f3-001aed1133bf tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] [instance: 57dff82c-f7f3-45a7-b645-3cf72a1266ce] allocate_for_instance() {{(pid=75122) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 09:54:59 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-bd240bea-9129-4f5d-a5f3-001aed1133bf tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] [instance: 57dff82c-f7f3-45a7-b645-3cf72a1266ce] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 09:54:59 user nova-compute[75122]: DEBUG nova.compute.manager [None req-bd240bea-9129-4f5d-a5f3-001aed1133bf tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] [instance: 57dff82c-f7f3-45a7-b645-3cf72a1266ce] Start building block device mappings for instance. {{(pid=75122) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 09:54:59 user nova-compute[75122]: DEBUG nova.policy [None req-bd240bea-9129-4f5d-a5f3-001aed1133bf tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '199452e19f8742ea810c917fbfa0581a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88f16d3dc8434cb5ac78c8d2f51d305b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75122) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 09:54:59 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-e0a6c3f9-c37e-497c-9bbc-f14ab6f4e407 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c477712bb5f1028349d55ba6416b688cbe21f00e.converted --force-share --output=json" returned: 0 in 0.179s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:54:59 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-e0a6c3f9-c37e-497c-9bbc-f14ab6f4e407 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Lock "c477712bb5f1028349d55ba6416b688cbe21f00e" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.935s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:54:59 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-e0a6c3f9-c37e-497c-9bbc-f14ab6f4e407 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Acquiring lock "c477712bb5f1028349d55ba6416b688cbe21f00e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:54:59 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-e0a6c3f9-c37e-497c-9bbc-f14ab6f4e407 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Lock "c477712bb5f1028349d55ba6416b688cbe21f00e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:54:59 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-e0a6c3f9-c37e-497c-9bbc-f14ab6f4e407 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c477712bb5f1028349d55ba6416b688cbe21f00e --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:54:59 user nova-compute[75122]: DEBUG nova.compute.manager [None req-bd240bea-9129-4f5d-a5f3-001aed1133bf tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] [instance: 57dff82c-f7f3-45a7-b645-3cf72a1266ce] Start spawning the instance on the hypervisor. {{(pid=75122) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 09:54:59 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-bd240bea-9129-4f5d-a5f3-001aed1133bf tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] [instance: 57dff82c-f7f3-45a7-b645-3cf72a1266ce] Creating instance directory {{(pid=75122) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 09:54:59 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-bd240bea-9129-4f5d-a5f3-001aed1133bf tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] [instance: 57dff82c-f7f3-45a7-b645-3cf72a1266ce] Creating image(s)
Nov 15 09:54:59 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-bd240bea-9129-4f5d-a5f3-001aed1133bf tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] Acquiring lock "/opt/stack/data/nova/instances/57dff82c-f7f3-45a7-b645-3cf72a1266ce/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:54:59 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-bd240bea-9129-4f5d-a5f3-001aed1133bf tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] Lock "/opt/stack/data/nova/instances/57dff82c-f7f3-45a7-b645-3cf72a1266ce/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:54:59 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-bd240bea-9129-4f5d-a5f3-001aed1133bf tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] Lock "/opt/stack/data/nova/instances/57dff82c-f7f3-45a7-b645-3cf72a1266ce/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:54:59 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-bd240bea-9129-4f5d-a5f3-001aed1133bf tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:54:59 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-e0a6c3f9-c37e-497c-9bbc-f14ab6f4e407 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c477712bb5f1028349d55ba6416b688cbe21f00e --force-share --output=json" returned: 0 in 0.171s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:54:59 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-e0a6c3f9-c37e-497c-9bbc-f14ab6f4e407 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c477712bb5f1028349d55ba6416b688cbe21f00e,backing_fmt=raw /opt/stack/data/nova/instances/db848537-676f-464a-806d-febb14d920a6/disk.rescue {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:54:59 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-e0a6c3f9-c37e-497c-9bbc-f14ab6f4e407 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c477712bb5f1028349d55ba6416b688cbe21f00e,backing_fmt=raw /opt/stack/data/nova/instances/db848537-676f-464a-806d-febb14d920a6/disk.rescue" returned: 0 in 0.049s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:54:59 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-e0a6c3f9-c37e-497c-9bbc-f14ab6f4e407 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Lock "c477712bb5f1028349d55ba6416b688cbe21f00e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.227s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:54:59 user nova-compute[75122]: DEBUG nova.objects.instance [None req-e0a6c3f9-c37e-497c-9bbc-f14ab6f4e407 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Lazy-loading 'migration_context' on Instance uuid db848537-676f-464a-806d-febb14d920a6 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:54:59 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-bd240bea-9129-4f5d-a5f3-001aed1133bf tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json" returned: 0 in 0.178s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:54:59 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-bd240bea-9129-4f5d-a5f3-001aed1133bf tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] Acquiring lock "95d6e29f74d5408f818e32f3bc29bc8270a4c665" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:54:59 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-bd240bea-9129-4f5d-a5f3-001aed1133bf tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] Lock "95d6e29f74d5408f818e32f3bc29bc8270a4c665" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:54:59 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-bd240bea-9129-4f5d-a5f3-001aed1133bf tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:54:59 user nova-compute[75122]: DEBUG nova.objects.base [None req-e0a6c3f9-c37e-497c-9bbc-f14ab6f4e407 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Object Instance<db848537-676f-464a-806d-febb14d920a6> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75122) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 09:54:59 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-e0a6c3f9-c37e-497c-9bbc-f14ab6f4e407 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: db848537-676f-464a-806d-febb14d920a6] Created local disks {{(pid=75122) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 09:54:59 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-e0a6c3f9-c37e-497c-9bbc-f14ab6f4e407 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: db848537-676f-464a-806d-febb14d920a6] Start _get_guest_xml network_info=[{"id": "93bbff2d-1d5c-47db-b436-43796849be51", "address": "fa:16:3e:eb:e9:ca", "network": {"id": "b780d5c1-a549-4b49-a036-5a272697d4b6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-229344021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-229344021-network", "vif_mac": "fa:16:3e:eb:e9:ca"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c046170a2ad44ebba5d2de236d940be0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93bbff2d-1d", "ovs_interfaceid": "93bbff2d-1d5c-47db-b436-43796849be51", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T09:26:31Z,direct_url=<?>,disk_format='qcow2',id=5e862cfe-47b8-4725-8292-65761ee6d0f5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9c57733cb41847c0b4ad31519c382e5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T09:26:33Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'da3f1319-28a7-4021-9aa6-9787ce9ee334', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:8ee79db2-27c2-4d0f-8ee6-5b03e05ebba5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RHSYjytT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'db848537-676f-464a-806d-febb14d920a6', 'attached_at': '', 'detached_at': '', 'volume_id': '8ee79db2-27c2-4d0f-8ee6-5b03e05ebba5', 'serial': '8ee79db2-27c2-4d0f-8ee6-5b03e05ebba5'}, 'guest_format': None, 'delete_on_termination': False, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vda', 'attachment_id': '28d48839-78ea-444d-9bf0-69f76cd77a50', 'volume_type': None} {{(pid=75122) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 09:54:59 user nova-compute[75122]: DEBUG nova.objects.instance [None req-e0a6c3f9-c37e-497c-9bbc-f14ab6f4e407 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Lazy-loading 'resources' on Instance uuid db848537-676f-464a-806d-febb14d920a6 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:54:59 user nova-compute[75122]: DEBUG nova.objects.base [None req-e0a6c3f9-c37e-497c-9bbc-f14ab6f4e407 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Object Instance<db848537-676f-464a-806d-febb14d920a6> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75122) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 09:54:59 user nova-compute[75122]: DEBUG nova.objects.instance [None req-e0a6c3f9-c37e-497c-9bbc-f14ab6f4e407 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Lazy-loading 'numa_topology' on Instance uuid db848537-676f-464a-806d-febb14d920a6 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:54:59 user nova-compute[75122]: DEBUG nova.objects.base [None req-e0a6c3f9-c37e-497c-9bbc-f14ab6f4e407 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Object Instance<db848537-676f-464a-806d-febb14d920a6> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75122) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 09:54:59 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-e0a6c3f9-c37e-497c-9bbc-f14ab6f4e407 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 09:54:59 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-e0a6c3f9-c37e-497c-9bbc-f14ab6f4e407 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 09:54:59 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-e0a6c3f9-c37e-497c-9bbc-f14ab6f4e407 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75122) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 09:54:59 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-e0a6c3f9-c37e-497c-9bbc-f14ab6f4e407 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] CPU controller missing on host. {{(pid=75122) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 09:54:59 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-e0a6c3f9-c37e-497c-9bbc-f14ab6f4e407 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75122) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 09:54:59 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-e0a6c3f9-c37e-497c-9bbc-f14ab6f4e407 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] CPU controller found on host. {{(pid=75122) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 09:54:59 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-e0a6c3f9-c37e-497c-9bbc-f14ab6f4e407 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75122) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 09:54:59 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-e0a6c3f9-c37e-497c-9bbc-f14ab6f4e407 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T09:26:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T09:26:31Z,direct_url=<?>,disk_format='qcow2',id=5e862cfe-47b8-4725-8292-65761ee6d0f5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9c57733cb41847c0b4ad31519c382e5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T09:26:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 09:54:59 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-e0a6c3f9-c37e-497c-9bbc-f14ab6f4e407 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Flavor limits 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 09:54:59 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-e0a6c3f9-c37e-497c-9bbc-f14ab6f4e407 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Image limits 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 09:54:59 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-e0a6c3f9-c37e-497c-9bbc-f14ab6f4e407 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Flavor pref 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 09:54:59 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-e0a6c3f9-c37e-497c-9bbc-f14ab6f4e407 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Image pref 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 09:54:59 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-e0a6c3f9-c37e-497c-9bbc-f14ab6f4e407 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 09:54:59 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-e0a6c3f9-c37e-497c-9bbc-f14ab6f4e407 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 09:54:59 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-e0a6c3f9-c37e-497c-9bbc-f14ab6f4e407 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75122) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 09:54:59 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-e0a6c3f9-c37e-497c-9bbc-f14ab6f4e407 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Got 1 possible topologies {{(pid=75122) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 09:54:59 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-e0a6c3f9-c37e-497c-9bbc-f14ab6f4e407 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 09:54:59 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-e0a6c3f9-c37e-497c-9bbc-f14ab6f4e407 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 09:54:59 user nova-compute[75122]: DEBUG nova.objects.instance [None req-e0a6c3f9-c37e-497c-9bbc-f14ab6f4e407 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Lazy-loading 'vcpu_model' on Instance uuid db848537-676f-464a-806d-febb14d920a6 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:54:59 user nova-compute[75122]: DEBUG nova.objects.base [None req-e0a6c3f9-c37e-497c-9bbc-f14ab6f4e407 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Object Instance<db848537-676f-464a-806d-febb14d920a6> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75122) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 09:54:59 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e0a6c3f9-c37e-497c-9bbc-f14ab6f4e407 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: db848537-676f-464a-806d-febb14d920a6] Calling os-brick to attach iSCSI Volume {{(pid=75122) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 09:54:59 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0a6c3f9-c37e-497c-9bbc-f14ab6f4e407 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffa04060b80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8ee79db2-27c2-4d0f-8ee6-5b03e05ebba5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RHSYjytT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 09:54:59 user nova-compute[75122]: WARNING os_brick.initiator.connectors.base [None req-e0a6c3f9-c37e-497c-9bbc-f14ab6f4e407 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 09:54:59 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-e0a6c3f9-c37e-497c-9bbc-f14ab6f4e407 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 09:54:59 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-e0a6c3f9-c37e-497c-9bbc-f14ab6f4e407 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 09:54:59 user nova-compute[75122]: WARNING os_brick.initiator.connectors.base [None req-e0a6c3f9-c37e-497c-9bbc-f14ab6f4e407 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 09:54:59 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-e0a6c3f9-c37e-497c-9bbc-f14ab6f4e407 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8ee79db2-27c2-4d0f-8ee6-5b03e05ebba5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 09:54:59 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-e0a6c3f9-c37e-497c-9bbc-f14ab6f4e407 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8ee79db2-27c2-4d0f-8ee6-5b03e05ebba5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 09:54:59 user nova-compute[75122]: INFO os_brick.initiator.connectors.iscsi [None req-e0a6c3f9-c37e-497c-9bbc-f14ab6f4e407 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 09:54:59 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ee79db2-27c2-4d0f-8ee6-5b03e05ebba5 -p 172.16.0.220:3260 {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:54:59 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-bd240bea-9129-4f5d-a5f3-001aed1133bf tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json" returned: 0 in 0.170s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:54:59 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-bd240bea-9129-4f5d-a5f3-001aed1133bf tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665,backing_fmt=raw /opt/stack/data/nova/instances/57dff82c-f7f3-45a7-b645-3cf72a1266ce/disk 1073741824 {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:54:59 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ee79db2-27c2-4d0f-8ee6-5b03e05ebba5 -p 172.16.0.220:3260" returned: 0 in 0.017s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:54:59 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[efb44da6-7b14-4192-abd3-b627e46cb506]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:8ee79db2-27c2-4d0f-8ee6-5b03e05ebba5\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = RHSYjytT\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:54:59 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0a6c3f9-c37e-497c-9bbc-f14ab6f4e407 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 15 09:54:59 user nova-compute[75122]: node.name = iqn.2010-10.org.openstack:8ee79db2-27c2-4d0f-8ee6-5b03e05ebba5
Nov 15 09:54:59 user nova-compute[75122]: node.tpgt = -1
Nov 15 09:54:59 user nova-compute[75122]: node.startup = automatic
Nov 15 09:54:59 user nova-compute[75122]: node.leading_login = No
Nov 15 09:54:59 user nova-compute[75122]: iface.iscsi_ifacename = default
Nov 15 09:54:59 user nova-compute[75122]: iface.net_ifacename = <empty>
Nov 15 09:54:59 user nova-compute[75122]: iface.ipaddress = <empty>
Nov 15 09:54:59 user nova-compute[75122]: iface.prefix_len = 0
Nov 15 09:54:59 user nova-compute[75122]: iface.hwaddress = <empty>
Nov 15 09:54:59 user nova-compute[75122]: iface.transport_name = tcp
Nov 15 09:54:59 user nova-compute[75122]: iface.initiatorname = <empty>
Nov 15 09:54:59 user nova-compute[75122]: iface.state = <empty>
Nov 15 09:54:59 user nova-compute[75122]: iface.vlan_id = 0
Nov 15 09:54:59 user nova-compute[75122]: iface.vlan_priority = 0
Nov 15 09:54:59 user nova-compute[75122]: iface.vlan_state = <empty>
Nov 15 09:54:59 user nova-compute[75122]: iface.iface_num = 0
Nov 15 09:54:59 user nova-compute[75122]: iface.mtu = 0
Nov 15 09:54:59 user nova-compute[75122]: iface.port = 0
Nov 15 09:54:59 user nova-compute[75122]: iface.bootproto = <empty>
Nov 15 09:54:59 user nova-compute[75122]: iface.subnet_mask = <empty>
Nov 15 09:54:59 user nova-compute[75122]: iface.gateway = <empty>
Nov 15 09:54:59 user nova-compute[75122]: iface.dhcp_alt_client_id_state = <empty>
Nov 15 09:54:59 user nova-compute[75122]: iface.dhcp_alt_client_id = <empty>
Nov 15 09:54:59 user nova-compute[75122]: iface.dhcp_dns = <empty>
Nov 15 09:54:59 user nova-compute[75122]: iface.dhcp_learn_iqn = <empty>
Nov 15 09:54:59 user nova-compute[75122]: iface.dhcp_req_vendor_id_state = <empty>
Nov 15 09:54:59 user nova-compute[75122]: iface.dhcp_vendor_id_state = <empty>
Nov 15 09:54:59 user nova-compute[75122]: iface.dhcp_vendor_id = <empty>
Nov 15 09:54:59 user nova-compute[75122]: iface.dhcp_slp_da = <empty>
Nov 15 09:54:59 user nova-compute[75122]: iface.fragmentation = <empty>
Nov 15 09:54:59 user nova-compute[75122]: iface.gratuitous_arp = <empty>
Nov 15 09:54:59 user nova-compute[75122]: iface.incoming_forwarding = <empty>
Nov 15 09:54:59 user nova-compute[75122]: iface.tos_state = <empty>
Nov 15 09:54:59 user nova-compute[75122]: iface.tos = 0
Nov 15 09:54:59 user nova-compute[75122]: iface.ttl = 0
Nov 15 09:54:59 user nova-compute[75122]: iface.delayed_ack = <empty>
Nov 15 09:54:59 user nova-compute[75122]: iface.tcp_nagle = <empty>
Nov 15 09:54:59 user nova-compute[75122]: iface.tcp_wsf_state = <empty>
Nov 15 09:54:59 user nova-compute[75122]: iface.tcp_wsf = 0
Nov 15 09:54:59 user nova-compute[75122]: iface.tcp_timer_scale = 0
Nov 15 09:54:59 user nova-compute[75122]: iface.tcp_timestamp = <empty>
Nov 15 09:54:59 user nova-compute[75122]: iface.redirect = <empty>
Nov 15 09:54:59 user nova-compute[75122]: iface.def_task_mgmt_timeout = 0
Nov 15 09:54:59 user nova-compute[75122]: iface.header_digest = <empty>
Nov 15 09:54:59 user nova-compute[75122]: iface.data_digest = <empty>
Nov 15 09:54:59 user nova-compute[75122]: iface.immediate_data = <empty>
Nov 15 09:54:59 user nova-compute[75122]: iface.initial_r2t = <empty>
Nov 15 09:54:59 user nova-compute[75122]: iface.data_seq_inorder = <empty>
Nov 15 09:54:59 user nova-compute[75122]: iface.data_pdu_inorder = <empty>
Nov 15 09:54:59 user nova-compute[75122]: iface.erl = 0
Nov 15 09:54:59 user nova-compute[75122]: iface.max_receive_data_len = 0
Nov 15 09:54:59 user nova-compute[75122]: iface.first_burst_len = 0
Nov 15 09:54:59 user nova-compute[75122]: iface.max_outstanding_r2t = 0
Nov 15 09:54:59 user nova-compute[75122]: iface.max_burst_len = 0
Nov 15 09:54:59 user nova-compute[75122]: iface.chap_auth = <empty>
Nov 15 09:54:59 user nova-compute[75122]: iface.bidi_chap = <empty>
Nov 15 09:54:59 user nova-compute[75122]: iface.strict_login_compliance = <empty>
Nov 15 09:54:59 user nova-compute[75122]: iface.discovery_auth = <empty>
Nov 15 09:54:59 user nova-compute[75122]: iface.discovery_logout = <empty>
Nov 15 09:54:59 user nova-compute[75122]: node.discovery_address = <empty>
Nov 15 09:54:59 user nova-compute[75122]: node.discovery_port = 0
Nov 15 09:54:59 user nova-compute[75122]: node.discovery_type = static
Nov 15 09:54:59 user nova-compute[75122]: node.session.initial_cmdsn = 0
Nov 15 09:54:59 user nova-compute[75122]: node.session.initial_login_retry_max = 8
Nov 15 09:54:59 user nova-compute[75122]: node.session.xmit_thread_priority = -20
Nov 15 09:54:59 user nova-compute[75122]: node.session.cmds_max = 128
Nov 15 09:54:59 user nova-compute[75122]: node.session.queue_depth = 32
Nov 15 09:54:59 user nova-compute[75122]: node.session.nr_sessions = 1
Nov 15 09:54:59 user nova-compute[75122]: node.session.auth.authmethod = CHAP
Nov 15 09:54:59 user nova-compute[75122]: node.session.auth.username = RHSYjytT
Nov 15 09:54:59 user nova-compute[75122]: node.session.auth.password = ***
Nov 15 09:54:59 user nova-compute[75122]: node.session.auth.username_in = <empty>
Nov 15 09:54:59 user nova-compute[75122]: node.session.auth.password_in = <empty>
Nov 15 09:54:59 user nova-compute[75122]: node.session.auth.chap_algs = MD5
Nov 15 09:54:59 user nova-compute[75122]: node.session.timeo.replacement_timeout = 120
Nov 15 09:54:59 user nova-compute[75122]: node.session.err_timeo.abort_timeout = 15
Nov 15 09:54:59 user nova-compute[75122]: node.session.err_timeo.lu_reset_timeout = 30
Nov 15 09:54:59 user nova-compute[75122]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 15 09:54:59 user nova-compute[75122]: node.session.err_timeo.host_reset_timeout = 60
Nov 15 09:54:59 user nova-compute[75122]: node.session.iscsi.FastAbort = Yes
Nov 15 09:54:59 user nova-compute[75122]: node.session.iscsi.InitialR2T = No
Nov 15 09:54:59 user nova-compute[75122]: node.session.iscsi.ImmediateData = Yes
Nov 15 09:54:59 user nova-compute[75122]: node.session.iscsi.FirstBurstLength = 262144
Nov 15 09:54:59 user nova-compute[75122]: node.session.iscsi.MaxBurstLength = 16776192
Nov 15 09:54:59 user nova-compute[75122]: node.session.iscsi.DefaultTime2Retain = 0
Nov 15 09:54:59 user nova-compute[75122]: node.session.iscsi.DefaultTime2Wait = 2
Nov 15 09:54:59 user nova-compute[75122]: node.session.iscsi.MaxConnections = 1
Nov 15 09:54:59 user nova-compute[75122]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 15 09:54:59 user nova-compute[75122]: node.session.iscsi.ERL = 0
Nov 15 09:54:59 user nova-compute[75122]: node.session.scan = manual
Nov 15 09:54:59 user nova-compute[75122]: node.session.reopen_max = 0
Nov 15 09:54:59 user nova-compute[75122]: node.conn[0].address = 172.16.0.220
Nov 15 09:54:59 user nova-compute[75122]: node.conn[0].port = 3260
Nov 15 09:54:59 user nova-compute[75122]: node.conn[0].startup = manual
Nov 15 09:54:59 user nova-compute[75122]: node.conn[0].tcp.window_size = 524288
Nov 15 09:54:59 user nova-compute[75122]: node.conn[0].tcp.type_of_service = 0
Nov 15 09:54:59 user nova-compute[75122]: node.conn[0].timeo.logout_timeout = 15
Nov 15 09:54:59 user nova-compute[75122]: node.conn[0].timeo.login_timeout = 15
Nov 15 09:54:59 user nova-compute[75122]: node.conn[0].timeo.auth_timeout = 45
Nov 15 09:54:59 user nova-compute[75122]: node.conn[0].timeo.noop_out_interval = 5
Nov 15 09:54:59 user nova-compute[75122]: node.conn[0].timeo.noop_out_timeout = 5
Nov 15 09:54:59 user nova-compute[75122]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 15 09:54:59 user nova-compute[75122]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 15 09:54:59 user nova-compute[75122]: node.conn[0].iscsi.HeaderDigest = None
Nov 15 09:54:59 user nova-compute[75122]: node.conn[0].iscsi.DataDigest = None
Nov 15 09:54:59 user nova-compute[75122]: node.conn[0].iscsi.IFMarker = No
Nov 15 09:54:59 user nova-compute[75122]: node.conn[0].iscsi.OFMarker = No
Nov 15 09:54:59 user nova-compute[75122]: # END RECORD
Nov 15 09:54:59 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:54:59 user nova-compute[75122]: DEBUG nova.network.neutron [None req-bd240bea-9129-4f5d-a5f3-001aed1133bf tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] [instance: 57dff82c-f7f3-45a7-b645-3cf72a1266ce] Successfully created port: 4fd42a2e-6ccb-4865-8cce-ac346aece548 {{(pid=75122) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 09:54:59 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ee79db2-27c2-4d0f-8ee6-5b03e05ebba5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:54:59 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-bd240bea-9129-4f5d-a5f3-001aed1133bf tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665,backing_fmt=raw /opt/stack/data/nova/instances/57dff82c-f7f3-45a7-b645-3cf72a1266ce/disk 1073741824" returned: 0 in 0.058s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:54:59 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-bd240bea-9129-4f5d-a5f3-001aed1133bf tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] Lock "95d6e29f74d5408f818e32f3bc29bc8270a4c665" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.231s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:54:59 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-bd240bea-9129-4f5d-a5f3-001aed1133bf tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:54:59 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ee79db2-27c2-4d0f-8ee6-5b03e05ebba5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:54:59 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[861d43e9-eea3-4a13-b479-f56b9d5cdd01]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:54:59 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0a6c3f9-c37e-497c-9bbc-f14ab6f4e407 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:54:59 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ee79db2-27c2-4d0f-8ee6-5b03e05ebba5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:54:59 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ee79db2-27c2-4d0f-8ee6-5b03e05ebba5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:54:59 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[237473a7-bb8c-43f9-b6cf-382baab06a47]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:54:59 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0a6c3f9-c37e-497c-9bbc-f14ab6f4e407 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:54:59 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ee79db2-27c2-4d0f-8ee6-5b03e05ebba5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RHSYjytT {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:54:59 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ee79db2-27c2-4d0f-8ee6-5b03e05ebba5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RHSYjytT" returned: 0 in 0.017s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:54:59 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[238796d4-bfa8-4518-bcc5-7fd6d5356b99]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:54:59 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0a6c3f9-c37e-497c-9bbc-f14ab6f4e407 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RHSYjytT'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:54:59 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ee79db2-27c2-4d0f-8ee6-5b03e05ebba5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:54:59 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ee79db2-27c2-4d0f-8ee6-5b03e05ebba5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:54:59 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ad49e2b-d667-42e3-ab48-b02eed75471b]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:54:59 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0a6c3f9-c37e-497c-9bbc-f14ab6f4e407 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:54:59 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:54:59 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:54:59 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c47600a-91e6-443b-9505-a3e5e897d199]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee79db2-27c2-4d0f-8ee6-5b03e05ebba5 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5980f14-24f1-4673-9b31-ee87a0d26092 (non-flash)\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:54:59 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0a6c3f9-c37e-497c-9bbc-f14ab6f4e407 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee79db2-27c2-4d0f-8ee6-5b03e05ebba5 (non-flash)
Nov 15 09:54:59 user nova-compute[75122]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5980f14-24f1-4673-9b31-ee87a0d26092 (non-flash)
Nov 15 09:54:59 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 09:54:59 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0a6c3f9-c37e-497c-9bbc-f14ab6f4e407 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee79db2-27c2-4d0f-8ee6-5b03e05ebba5 (non-flash)
Nov 15 09:54:59 user nova-compute[75122]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5980f14-24f1-4673-9b31-ee87a0d26092 (non-flash)
Nov 15 09:54:59 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 09:54:59 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-e0a6c3f9-c37e-497c-9bbc-f14ab6f4e407 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8ee79db2-27c2-4d0f-8ee6-5b03e05ebba5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.207s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 09:54:59 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0a6c3f9-c37e-497c-9bbc-f14ab6f4e407 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Connected to 172.16.0.220:3260 {{(pid=75122) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 09:54:59 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-e0a6c3f9-c37e-497c-9bbc-f14ab6f4e407 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] HCTL ('33', '0', '0', 0) found on session 47 with lun 0 {{(pid=75122) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 09:54:59 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-e0a6c3f9-c37e-497c-9bbc-f14ab6f4e407 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=75122) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 09:54:59 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:54:59 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.012s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:54:59 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[42add2f8-ed48-43a3-8ac8-a6b5e93ea7fc]: (4, ('0 0 0', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:54:59 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-e0a6c3f9-c37e-497c-9bbc-f14ab6f4e407 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Searching for a device in session 47 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=75122) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 09:54:59 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0a6c3f9-c37e-497c-9bbc-f14ab6f4e407 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:8ee79db2-27c2-4d0f-8ee6-5b03e05ebba5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RHSYjytT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75122) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 09:54:59 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-e0a6c3f9-c37e-497c-9bbc-f14ab6f4e407 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.231s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 09:54:59 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0a6c3f9-c37e-497c-9bbc-f14ab6f4e407 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] <== connect_volume: return (233ms) {'type': 'block', 'scsi_wwn': '26638333934383834', 'path': '/dev/sdb'} {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 09:54:59 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e0a6c3f9-c37e-497c-9bbc-f14ab6f4e407 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: db848537-676f-464a-806d-febb14d920a6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26638333934383834', 'path': '/dev/sdb'} {{(pid=75122) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 09:54:59 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-bd240bea-9129-4f5d-a5f3-001aed1133bf tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json" returned: 0 in 0.180s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:54:59 user nova-compute[75122]: DEBUG nova.virt.disk.api [None req-bd240bea-9129-4f5d-a5f3-001aed1133bf tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] Checking if we can resize image /opt/stack/data/nova/instances/57dff82c-f7f3-45a7-b645-3cf72a1266ce/disk. size=1073741824 {{(pid=75122) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 09:54:59 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-bd240bea-9129-4f5d-a5f3-001aed1133bf tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57dff82c-f7f3-45a7-b645-3cf72a1266ce/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:55:00 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-e0a6c3f9-c37e-497c-9bbc-f14ab6f4e407 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T09:53:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2092457370',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2092457370',id=38,image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T09:53:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c046170a2ad44ebba5d2de236d940be0',ramdisk_id='',reservation_id='r-dk2qzsg4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1545444983',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T09:53:21Z,user_data=None,user_id='53d187e2a07b4437a02f65fb47a003ee',uuid=db848537-676f-464a-806d-febb14d920a6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "93bbff2d-1d5c-47db-b436-43796849be51", "address": "fa:16:3e:eb:e9:ca", "network": {"id": "b780d5c1-a549-4b49-a036-5a272697d4b6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-229344021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-229344021-network", "vif_mac": "fa:16:3e:eb:e9:ca"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c046170a2ad44ebba5d2de236d940be0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93bbff2d-1d", "ovs_interfaceid": "93bbff2d-1d5c-47db-b436-43796849be51", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75122) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 09:55:00 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-e0a6c3f9-c37e-497c-9bbc-f14ab6f4e407 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Converting VIF {"id": "93bbff2d-1d5c-47db-b436-43796849be51", "address": "fa:16:3e:eb:e9:ca", "network": {"id": "b780d5c1-a549-4b49-a036-5a272697d4b6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-229344021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-229344021-network", "vif_mac": "fa:16:3e:eb:e9:ca"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c046170a2ad44ebba5d2de236d940be0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93bbff2d-1d", "ovs_interfaceid": "93bbff2d-1d5c-47db-b436-43796849be51", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 09:55:00 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-e0a6c3f9-c37e-497c-9bbc-f14ab6f4e407 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:eb:e9:ca,bridge_name='br-int',has_traffic_filtering=True,id=93bbff2d-1d5c-47db-b436-43796849be51,network=Network(b780d5c1-a549-4b49-a036-5a272697d4b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93bbff2d-1d') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 09:55:00 user nova-compute[75122]: DEBUG nova.objects.instance [None req-e0a6c3f9-c37e-497c-9bbc-f14ab6f4e407 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Lazy-loading 'pci_devices' on Instance uuid db848537-676f-464a-806d-febb14d920a6 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:55:00 user nova-compute[75122]: DEBUG nova.objects.base [None req-e0a6c3f9-c37e-497c-9bbc-f14ab6f4e407 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Object Instance<db848537-676f-464a-806d-febb14d920a6> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75122) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 09:55:00 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-e0a6c3f9-c37e-497c-9bbc-f14ab6f4e407 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: db848537-676f-464a-806d-febb14d920a6] End _get_guest_xml xml=<domain type="kvm">
Nov 15 09:55:00 user nova-compute[75122]:   <uuid>db848537-676f-464a-806d-febb14d920a6</uuid>
Nov 15 09:55:00 user nova-compute[75122]:   <name>instance-00000026</name>
Nov 15 09:55:00 user nova-compute[75122]:   <memory>524288</memory>
Nov 15 09:55:00 user nova-compute[75122]:   <vcpu>1</vcpu>
Nov 15 09:55:00 user nova-compute[75122]:   <metadata>
Nov 15 09:55:00 user nova-compute[75122]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 09:55:00 user nova-compute[75122]:       <nova:package version="0.0.0"/>
Nov 15 09:55:00 user nova-compute[75122]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-2092457370</nova:name>
Nov 15 09:55:00 user nova-compute[75122]:       <nova:creationTime>2023-11-15 09:54:59</nova:creationTime>
Nov 15 09:55:00 user nova-compute[75122]:       <nova:flavor name="m1.tiny">
Nov 15 09:55:00 user nova-compute[75122]:         <nova:memory>512</nova:memory>
Nov 15 09:55:00 user nova-compute[75122]:         <nova:disk>1</nova:disk>
Nov 15 09:55:00 user nova-compute[75122]:         <nova:swap>0</nova:swap>
Nov 15 09:55:00 user nova-compute[75122]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 09:55:00 user nova-compute[75122]:         <nova:vcpus>1</nova:vcpus>
Nov 15 09:55:00 user nova-compute[75122]:       </nova:flavor>
Nov 15 09:55:00 user nova-compute[75122]:       <nova:owner>
Nov 15 09:55:00 user nova-compute[75122]:         <nova:user uuid="53d187e2a07b4437a02f65fb47a003ee">tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member</nova:user>
Nov 15 09:55:00 user nova-compute[75122]:         <nova:project uuid="c046170a2ad44ebba5d2de236d940be0">tempest-ServerBootFromVolumeStableRescueTest-1545444983</nova:project>
Nov 15 09:55:00 user nova-compute[75122]:       </nova:owner>
Nov 15 09:55:00 user nova-compute[75122]:       <nova:root type="image" uuid="5e862cfe-47b8-4725-8292-65761ee6d0f5"/>
Nov 15 09:55:00 user nova-compute[75122]:       <nova:ports>
Nov 15 09:55:00 user nova-compute[75122]:         <nova:port uuid="93bbff2d-1d5c-47db-b436-43796849be51">
Nov 15 09:55:00 user nova-compute[75122]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 15 09:55:00 user nova-compute[75122]:         </nova:port>
Nov 15 09:55:00 user nova-compute[75122]:       </nova:ports>
Nov 15 09:55:00 user nova-compute[75122]:     </nova:instance>
Nov 15 09:55:00 user nova-compute[75122]:   </metadata>
Nov 15 09:55:00 user nova-compute[75122]:   <sysinfo type="smbios">
Nov 15 09:55:00 user nova-compute[75122]:     <system>
Nov 15 09:55:00 user nova-compute[75122]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 09:55:00 user nova-compute[75122]:       <entry name="product">OpenStack Nova</entry>
Nov 15 09:55:00 user nova-compute[75122]:       <entry name="version">0.0.0</entry>
Nov 15 09:55:00 user nova-compute[75122]:       <entry name="serial">db848537-676f-464a-806d-febb14d920a6</entry>
Nov 15 09:55:00 user nova-compute[75122]:       <entry name="uuid">db848537-676f-464a-806d-febb14d920a6</entry>
Nov 15 09:55:00 user nova-compute[75122]:       <entry name="family">Virtual Machine</entry>
Nov 15 09:55:00 user nova-compute[75122]:     </system>
Nov 15 09:55:00 user nova-compute[75122]:   </sysinfo>
Nov 15 09:55:00 user nova-compute[75122]:   <os>
Nov 15 09:55:00 user nova-compute[75122]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 09:55:00 user nova-compute[75122]:     <smbios mode="sysinfo"/>
Nov 15 09:55:00 user nova-compute[75122]:   </os>
Nov 15 09:55:00 user nova-compute[75122]:   <features>
Nov 15 09:55:00 user nova-compute[75122]:     <acpi/>
Nov 15 09:55:00 user nova-compute[75122]:     <apic/>
Nov 15 09:55:00 user nova-compute[75122]:     <vmcoreinfo/>
Nov 15 09:55:00 user nova-compute[75122]:   </features>
Nov 15 09:55:00 user nova-compute[75122]:   <clock offset="utc">
Nov 15 09:55:00 user nova-compute[75122]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 09:55:00 user nova-compute[75122]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 09:55:00 user nova-compute[75122]:     <timer name="hpet" present="no"/>
Nov 15 09:55:00 user nova-compute[75122]:   </clock>
Nov 15 09:55:00 user nova-compute[75122]:   <cpu mode="custom" match="exact">
Nov 15 09:55:00 user nova-compute[75122]:     <model>Nehalem</model>
Nov 15 09:55:00 user nova-compute[75122]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 09:55:00 user nova-compute[75122]:   </cpu>
Nov 15 09:55:00 user nova-compute[75122]:   <devices>
Nov 15 09:55:00 user nova-compute[75122]:     <disk type="block" device="disk">
Nov 15 09:55:00 user nova-compute[75122]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 09:55:00 user nova-compute[75122]:       <source dev="/dev/sdb"/>
Nov 15 09:55:00 user nova-compute[75122]:       <target dev="vda" bus="virtio"/>
Nov 15 09:55:00 user nova-compute[75122]:       <serial>8ee79db2-27c2-4d0f-8ee6-5b03e05ebba5</serial>
Nov 15 09:55:00 user nova-compute[75122]:     </disk>
Nov 15 09:55:00 user nova-compute[75122]:     <disk type="file" device="disk">
Nov 15 09:55:00 user nova-compute[75122]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 09:55:00 user nova-compute[75122]:       <source file="/opt/stack/data/nova/instances/db848537-676f-464a-806d-febb14d920a6/disk.rescue"/>
Nov 15 09:55:00 user nova-compute[75122]:       <target dev="vdb" bus="virtio"/>
Nov 15 09:55:00 user nova-compute[75122]:       <boot order="1"/>
Nov 15 09:55:00 user nova-compute[75122]:     </disk>
Nov 15 09:55:00 user nova-compute[75122]:     <interface type="ethernet">
Nov 15 09:55:00 user nova-compute[75122]:       <mac address="fa:16:3e:eb:e9:ca"/>
Nov 15 09:55:00 user nova-compute[75122]:       <model type="virtio"/>
Nov 15 09:55:00 user nova-compute[75122]:       <mtu size="1442"/>
Nov 15 09:55:00 user nova-compute[75122]:       <target dev="tap93bbff2d-1d"/>
Nov 15 09:55:00 user nova-compute[75122]:     </interface>
Nov 15 09:55:00 user nova-compute[75122]:     <serial type="pty">
Nov 15 09:55:00 user nova-compute[75122]:       <log file="/opt/stack/data/nova/instances/db848537-676f-464a-806d-febb14d920a6/console.log" append="off"/>
Nov 15 09:55:00 user nova-compute[75122]:     </serial>
Nov 15 09:55:00 user nova-compute[75122]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 09:55:00 user nova-compute[75122]:     <video>
Nov 15 09:55:00 user nova-compute[75122]:       <model type="virtio"/>
Nov 15 09:55:00 user nova-compute[75122]:     </video>
Nov 15 09:55:00 user nova-compute[75122]:     <rng model="virtio">
Nov 15 09:55:00 user nova-compute[75122]:       <backend model="random">/dev/urandom</backend>
Nov 15 09:55:00 user nova-compute[75122]:     </rng>
Nov 15 09:55:00 user nova-compute[75122]:     <controller type="usb" index="0" model="none"/>
Nov 15 09:55:00 user nova-compute[75122]:     <memballoon model="virtio">
Nov 15 09:55:00 user nova-compute[75122]:       <stats period="10"/>
Nov 15 09:55:00 user nova-compute[75122]:     </memballoon>
Nov 15 09:55:00 user nova-compute[75122]:   </devices>
Nov 15 09:55:00 user nova-compute[75122]: </domain>
Nov 15 09:55:00 user nova-compute[75122]:  {{(pid=75122) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 09:55:00 user nova-compute[75122]: INFO nova.virt.libvirt.driver [-] [instance: db848537-676f-464a-806d-febb14d920a6] Instance destroyed successfully.
Nov 15 09:55:00 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-e0a6c3f9-c37e-497c-9bbc-f14ab6f4e407 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] No BDM found with device name vda, not building metadata. {{(pid=75122) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 09:55:00 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-e0a6c3f9-c37e-497c-9bbc-f14ab6f4e407 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75122) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 09:55:00 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-e0a6c3f9-c37e-497c-9bbc-f14ab6f4e407 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] No VIF found with MAC fa:16:3e:eb:e9:ca, not building metadata {{(pid=75122) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 09:55:00 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-bd240bea-9129-4f5d-a5f3-001aed1133bf tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57dff82c-f7f3-45a7-b645-3cf72a1266ce/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:55:00 user nova-compute[75122]: DEBUG nova.virt.disk.api [None req-bd240bea-9129-4f5d-a5f3-001aed1133bf tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] Cannot resize image /opt/stack/data/nova/instances/57dff82c-f7f3-45a7-b645-3cf72a1266ce/disk to a smaller size. {{(pid=75122) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 09:55:00 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-bd240bea-9129-4f5d-a5f3-001aed1133bf tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] [instance: 57dff82c-f7f3-45a7-b645-3cf72a1266ce] Created local disks {{(pid=75122) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 09:55:00 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-bd240bea-9129-4f5d-a5f3-001aed1133bf tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] [instance: 57dff82c-f7f3-45a7-b645-3cf72a1266ce] Ensure instance console log exists: /opt/stack/data/nova/instances/57dff82c-f7f3-45a7-b645-3cf72a1266ce/console.log {{(pid=75122) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 09:55:00 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-bd240bea-9129-4f5d-a5f3-001aed1133bf tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:55:00 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-bd240bea-9129-4f5d-a5f3-001aed1133bf tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:55:00 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-bd240bea-9129-4f5d-a5f3-001aed1133bf tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:55:00 user nova-compute[75122]: DEBUG nova.network.neutron [None req-bd240bea-9129-4f5d-a5f3-001aed1133bf tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] [instance: 57dff82c-f7f3-45a7-b645-3cf72a1266ce] Successfully updated port: 4fd42a2e-6ccb-4865-8cce-ac346aece548 {{(pid=75122) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 09:55:00 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-bd240bea-9129-4f5d-a5f3-001aed1133bf tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] Acquiring lock "refresh_cache-57dff82c-f7f3-45a7-b645-3cf72a1266ce" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 09:55:00 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-bd240bea-9129-4f5d-a5f3-001aed1133bf tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] Acquired lock "refresh_cache-57dff82c-f7f3-45a7-b645-3cf72a1266ce" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 09:55:00 user nova-compute[75122]: DEBUG nova.network.neutron [None req-bd240bea-9129-4f5d-a5f3-001aed1133bf tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] [instance: 57dff82c-f7f3-45a7-b645-3cf72a1266ce] Building network info cache for instance {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 09:55:00 user nova-compute[75122]: DEBUG nova.network.neutron [None req-bd240bea-9129-4f5d-a5f3-001aed1133bf tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] [instance: 57dff82c-f7f3-45a7-b645-3cf72a1266ce] Instance cache missing network info. {{(pid=75122) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 09:55:00 user nova-compute[75122]: DEBUG nova.network.neutron [None req-bd240bea-9129-4f5d-a5f3-001aed1133bf tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] [instance: 57dff82c-f7f3-45a7-b645-3cf72a1266ce] Updating instance_info_cache with network_info: [{"id": "4fd42a2e-6ccb-4865-8cce-ac346aece548", "address": "fa:16:3e:68:37:a5", "network": {"id": "ca2dff40-00d3-46b0-b9e2-dca375439496", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1592022235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88f16d3dc8434cb5ac78c8d2f51d305b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fd42a2e-6c", "ovs_interfaceid": "4fd42a2e-6ccb-4865-8cce-ac346aece548", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:55:00 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-bd240bea-9129-4f5d-a5f3-001aed1133bf tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] Releasing lock "refresh_cache-57dff82c-f7f3-45a7-b645-3cf72a1266ce" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 09:55:00 user nova-compute[75122]: DEBUG nova.compute.manager [None req-bd240bea-9129-4f5d-a5f3-001aed1133bf tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] [instance: 57dff82c-f7f3-45a7-b645-3cf72a1266ce] Instance network_info: |[{"id": "4fd42a2e-6ccb-4865-8cce-ac346aece548", "address": "fa:16:3e:68:37:a5", "network": {"id": "ca2dff40-00d3-46b0-b9e2-dca375439496", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1592022235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88f16d3dc8434cb5ac78c8d2f51d305b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fd42a2e-6c", "ovs_interfaceid": "4fd42a2e-6ccb-4865-8cce-ac346aece548", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75122) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 09:55:00 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-bd240bea-9129-4f5d-a5f3-001aed1133bf tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] [instance: 57dff82c-f7f3-45a7-b645-3cf72a1266ce] Start _get_guest_xml network_info=[{"id": "4fd42a2e-6ccb-4865-8cce-ac346aece548", "address": "fa:16:3e:68:37:a5", "network": {"id": "ca2dff40-00d3-46b0-b9e2-dca375439496", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1592022235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88f16d3dc8434cb5ac78c8d2f51d305b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fd42a2e-6c", "ovs_interfaceid": "4fd42a2e-6ccb-4865-8cce-ac346aece548", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T09:26:31Z,direct_url=<?>,disk_format='qcow2',id=5e862cfe-47b8-4725-8292-65761ee6d0f5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9c57733cb41847c0b4ad31519c382e5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T09:26:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '5e862cfe-47b8-4725-8292-65761ee6d0f5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75122) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 09:55:00 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-bd240bea-9129-4f5d-a5f3-001aed1133bf tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 09:55:00 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-bd240bea-9129-4f5d-a5f3-001aed1133bf tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 09:55:00 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-bd240bea-9129-4f5d-a5f3-001aed1133bf tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75122) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 09:55:00 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-bd240bea-9129-4f5d-a5f3-001aed1133bf tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] CPU controller missing on host. {{(pid=75122) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 09:55:00 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-bd240bea-9129-4f5d-a5f3-001aed1133bf tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75122) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 09:55:00 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-bd240bea-9129-4f5d-a5f3-001aed1133bf tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] CPU controller found on host. {{(pid=75122) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 09:55:00 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-bd240bea-9129-4f5d-a5f3-001aed1133bf tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75122) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 09:55:00 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-bd240bea-9129-4f5d-a5f3-001aed1133bf tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T09:26:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T09:26:31Z,direct_url=<?>,disk_format='qcow2',id=5e862cfe-47b8-4725-8292-65761ee6d0f5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9c57733cb41847c0b4ad31519c382e5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T09:26:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 09:55:00 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-bd240bea-9129-4f5d-a5f3-001aed1133bf tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] Flavor limits 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 09:55:00 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-bd240bea-9129-4f5d-a5f3-001aed1133bf tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] Image limits 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 09:55:00 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-bd240bea-9129-4f5d-a5f3-001aed1133bf tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] Flavor pref 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 09:55:00 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-bd240bea-9129-4f5d-a5f3-001aed1133bf tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] Image pref 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 09:55:00 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-bd240bea-9129-4f5d-a5f3-001aed1133bf tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 09:55:00 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-bd240bea-9129-4f5d-a5f3-001aed1133bf tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 09:55:00 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-bd240bea-9129-4f5d-a5f3-001aed1133bf tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75122) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 09:55:00 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-bd240bea-9129-4f5d-a5f3-001aed1133bf tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] Got 1 possible topologies {{(pid=75122) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 09:55:00 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-bd240bea-9129-4f5d-a5f3-001aed1133bf tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 09:55:00 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-bd240bea-9129-4f5d-a5f3-001aed1133bf tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 09:55:00 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-bd240bea-9129-4f5d-a5f3-001aed1133bf tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T09:54:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-955762148',display_name='tempest-ServersNegativeTestJSON-server-955762148',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-955762148',id=40,image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='88f16d3dc8434cb5ac78c8d2f51d305b',ramdisk_id='',reservation_id='r-brt029up',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1688784762',owner_user_name='tempest-ServersNegativeTestJSON-1688784762-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T09:54:59Z,user_data=None,user_id='199452e19f8742ea810c917fbfa0581a',uuid=57dff82c-f7f3-45a7-b645-3cf72a1266ce,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4fd42a2e-6ccb-4865-8cce-ac346aece548", "address": "fa:16:3e:68:37:a5", "network": {"id": "ca2dff40-00d3-46b0-b9e2-dca375439496", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1592022235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88f16d3dc8434cb5ac78c8d2f51d305b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fd42a2e-6c", "ovs_interfaceid": "4fd42a2e-6ccb-4865-8cce-ac346aece548", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75122) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 09:55:00 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-bd240bea-9129-4f5d-a5f3-001aed1133bf tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] Converting VIF {"id": "4fd42a2e-6ccb-4865-8cce-ac346aece548", "address": "fa:16:3e:68:37:a5", "network": {"id": "ca2dff40-00d3-46b0-b9e2-dca375439496", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1592022235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88f16d3dc8434cb5ac78c8d2f51d305b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fd42a2e-6c", "ovs_interfaceid": "4fd42a2e-6ccb-4865-8cce-ac346aece548", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 09:55:00 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-bd240bea-9129-4f5d-a5f3-001aed1133bf tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:37:a5,bridge_name='br-int',has_traffic_filtering=True,id=4fd42a2e-6ccb-4865-8cce-ac346aece548,network=Network(ca2dff40-00d3-46b0-b9e2-dca375439496),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fd42a2e-6c') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 09:55:00 user nova-compute[75122]: DEBUG nova.objects.instance [None req-bd240bea-9129-4f5d-a5f3-001aed1133bf tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] Lazy-loading 'pci_devices' on Instance uuid 57dff82c-f7f3-45a7-b645-3cf72a1266ce {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:55:00 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-bd240bea-9129-4f5d-a5f3-001aed1133bf tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] [instance: 57dff82c-f7f3-45a7-b645-3cf72a1266ce] End _get_guest_xml xml=<domain type="kvm">
Nov 15 09:55:00 user nova-compute[75122]:   <uuid>57dff82c-f7f3-45a7-b645-3cf72a1266ce</uuid>
Nov 15 09:55:00 user nova-compute[75122]:   <name>instance-00000028</name>
Nov 15 09:55:00 user nova-compute[75122]:   <memory>524288</memory>
Nov 15 09:55:00 user nova-compute[75122]:   <vcpu>1</vcpu>
Nov 15 09:55:00 user nova-compute[75122]:   <metadata>
Nov 15 09:55:00 user nova-compute[75122]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 09:55:00 user nova-compute[75122]:       <nova:package version="0.0.0"/>
Nov 15 09:55:00 user nova-compute[75122]:       <nova:name>tempest-ServersNegativeTestJSON-server-955762148</nova:name>
Nov 15 09:55:00 user nova-compute[75122]:       <nova:creationTime>2023-11-15 09:55:00</nova:creationTime>
Nov 15 09:55:00 user nova-compute[75122]:       <nova:flavor name="m1.tiny">
Nov 15 09:55:00 user nova-compute[75122]:         <nova:memory>512</nova:memory>
Nov 15 09:55:00 user nova-compute[75122]:         <nova:disk>1</nova:disk>
Nov 15 09:55:00 user nova-compute[75122]:         <nova:swap>0</nova:swap>
Nov 15 09:55:00 user nova-compute[75122]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 09:55:00 user nova-compute[75122]:         <nova:vcpus>1</nova:vcpus>
Nov 15 09:55:00 user nova-compute[75122]:       </nova:flavor>
Nov 15 09:55:00 user nova-compute[75122]:       <nova:owner>
Nov 15 09:55:00 user nova-compute[75122]:         <nova:user uuid="199452e19f8742ea810c917fbfa0581a">tempest-ServersNegativeTestJSON-1688784762-project-member</nova:user>
Nov 15 09:55:00 user nova-compute[75122]:         <nova:project uuid="88f16d3dc8434cb5ac78c8d2f51d305b">tempest-ServersNegativeTestJSON-1688784762</nova:project>
Nov 15 09:55:00 user nova-compute[75122]:       </nova:owner>
Nov 15 09:55:00 user nova-compute[75122]:       <nova:root type="image" uuid="5e862cfe-47b8-4725-8292-65761ee6d0f5"/>
Nov 15 09:55:00 user nova-compute[75122]:       <nova:ports>
Nov 15 09:55:00 user nova-compute[75122]:         <nova:port uuid="4fd42a2e-6ccb-4865-8cce-ac346aece548">
Nov 15 09:55:00 user nova-compute[75122]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 15 09:55:00 user nova-compute[75122]:         </nova:port>
Nov 15 09:55:00 user nova-compute[75122]:       </nova:ports>
Nov 15 09:55:00 user nova-compute[75122]:     </nova:instance>
Nov 15 09:55:00 user nova-compute[75122]:   </metadata>
Nov 15 09:55:00 user nova-compute[75122]:   <sysinfo type="smbios">
Nov 15 09:55:00 user nova-compute[75122]:     <system>
Nov 15 09:55:00 user nova-compute[75122]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 09:55:00 user nova-compute[75122]:       <entry name="product">OpenStack Nova</entry>
Nov 15 09:55:00 user nova-compute[75122]:       <entry name="version">0.0.0</entry>
Nov 15 09:55:00 user nova-compute[75122]:       <entry name="serial">57dff82c-f7f3-45a7-b645-3cf72a1266ce</entry>
Nov 15 09:55:00 user nova-compute[75122]:       <entry name="uuid">57dff82c-f7f3-45a7-b645-3cf72a1266ce</entry>
Nov 15 09:55:00 user nova-compute[75122]:       <entry name="family">Virtual Machine</entry>
Nov 15 09:55:00 user nova-compute[75122]:     </system>
Nov 15 09:55:00 user nova-compute[75122]:   </sysinfo>
Nov 15 09:55:00 user nova-compute[75122]:   <os>
Nov 15 09:55:00 user nova-compute[75122]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 09:55:00 user nova-compute[75122]:     <boot dev="hd"/>
Nov 15 09:55:00 user nova-compute[75122]:     <smbios mode="sysinfo"/>
Nov 15 09:55:00 user nova-compute[75122]:   </os>
Nov 15 09:55:00 user nova-compute[75122]:   <features>
Nov 15 09:55:00 user nova-compute[75122]:     <acpi/>
Nov 15 09:55:00 user nova-compute[75122]:     <apic/>
Nov 15 09:55:00 user nova-compute[75122]:     <vmcoreinfo/>
Nov 15 09:55:00 user nova-compute[75122]:   </features>
Nov 15 09:55:00 user nova-compute[75122]:   <clock offset="utc">
Nov 15 09:55:00 user nova-compute[75122]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 09:55:00 user nova-compute[75122]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 09:55:00 user nova-compute[75122]:     <timer name="hpet" present="no"/>
Nov 15 09:55:00 user nova-compute[75122]:   </clock>
Nov 15 09:55:00 user nova-compute[75122]:   <cpu mode="custom" match="exact">
Nov 15 09:55:00 user nova-compute[75122]:     <model>Nehalem</model>
Nov 15 09:55:00 user nova-compute[75122]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 09:55:00 user nova-compute[75122]:   </cpu>
Nov 15 09:55:00 user nova-compute[75122]:   <devices>
Nov 15 09:55:00 user nova-compute[75122]:     <disk type="file" device="disk">
Nov 15 09:55:00 user nova-compute[75122]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 09:55:00 user nova-compute[75122]:       <source file="/opt/stack/data/nova/instances/57dff82c-f7f3-45a7-b645-3cf72a1266ce/disk"/>
Nov 15 09:55:00 user nova-compute[75122]:       <target dev="vda" bus="virtio"/>
Nov 15 09:55:00 user nova-compute[75122]:     </disk>
Nov 15 09:55:00 user nova-compute[75122]:     <interface type="ethernet">
Nov 15 09:55:00 user nova-compute[75122]:       <mac address="fa:16:3e:68:37:a5"/>
Nov 15 09:55:00 user nova-compute[75122]:       <model type="virtio"/>
Nov 15 09:55:00 user nova-compute[75122]:       <mtu size="1442"/>
Nov 15 09:55:00 user nova-compute[75122]:       <target dev="tap4fd42a2e-6c"/>
Nov 15 09:55:00 user nova-compute[75122]:     </interface>
Nov 15 09:55:00 user nova-compute[75122]:     <serial type="pty">
Nov 15 09:55:00 user nova-compute[75122]:       <log file="/opt/stack/data/nova/instances/57dff82c-f7f3-45a7-b645-3cf72a1266ce/console.log" append="off"/>
Nov 15 09:55:00 user nova-compute[75122]:     </serial>
Nov 15 09:55:00 user nova-compute[75122]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 09:55:00 user nova-compute[75122]:     <video>
Nov 15 09:55:00 user nova-compute[75122]:       <model type="virtio"/>
Nov 15 09:55:00 user nova-compute[75122]:     </video>
Nov 15 09:55:00 user nova-compute[75122]:     <rng model="virtio">
Nov 15 09:55:00 user nova-compute[75122]:       <backend model="random">/dev/urandom</backend>
Nov 15 09:55:00 user nova-compute[75122]:     </rng>
Nov 15 09:55:00 user nova-compute[75122]:     <controller type="usb" index="0" model="none"/>
Nov 15 09:55:00 user nova-compute[75122]:     <memballoon model="virtio">
Nov 15 09:55:00 user nova-compute[75122]:       <stats period="10"/>
Nov 15 09:55:00 user nova-compute[75122]:     </memballoon>
Nov 15 09:55:00 user nova-compute[75122]:   </devices>
Nov 15 09:55:00 user nova-compute[75122]: </domain>
Nov 15 09:55:00 user nova-compute[75122]:  {{(pid=75122) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 09:55:00 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-bd240bea-9129-4f5d-a5f3-001aed1133bf tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T09:54:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-955762148',display_name='tempest-ServersNegativeTestJSON-server-955762148',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-955762148',id=40,image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='88f16d3dc8434cb5ac78c8d2f51d305b',ramdisk_id='',reservation_id='r-brt029up',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1688784762',owner_user_name='tempest-ServersNegativeTestJSON-1688784762-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T09:54:59Z,user_data=None,user_id='199452e19f8742ea810c917fbfa0581a',uuid=57dff82c-f7f3-45a7-b645-3cf72a1266ce,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4fd42a2e-6ccb-4865-8cce-ac346aece548", "address": "fa:16:3e:68:37:a5", "network": {"id": "ca2dff40-00d3-46b0-b9e2-dca375439496", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1592022235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88f16d3dc8434cb5ac78c8d2f51d305b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fd42a2e-6c", "ovs_interfaceid": "4fd42a2e-6ccb-4865-8cce-ac346aece548", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 09:55:00 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-bd240bea-9129-4f5d-a5f3-001aed1133bf tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] Converting VIF {"id": "4fd42a2e-6ccb-4865-8cce-ac346aece548", "address": "fa:16:3e:68:37:a5", "network": {"id": "ca2dff40-00d3-46b0-b9e2-dca375439496", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1592022235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88f16d3dc8434cb5ac78c8d2f51d305b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fd42a2e-6c", "ovs_interfaceid": "4fd42a2e-6ccb-4865-8cce-ac346aece548", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 09:55:00 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-bd240bea-9129-4f5d-a5f3-001aed1133bf tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:37:a5,bridge_name='br-int',has_traffic_filtering=True,id=4fd42a2e-6ccb-4865-8cce-ac346aece548,network=Network(ca2dff40-00d3-46b0-b9e2-dca375439496),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fd42a2e-6c') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 09:55:00 user nova-compute[75122]: DEBUG os_vif [None req-bd240bea-9129-4f5d-a5f3-001aed1133bf tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:37:a5,bridge_name='br-int',has_traffic_filtering=True,id=4fd42a2e-6ccb-4865-8cce-ac346aece548,network=Network(ca2dff40-00d3-46b0-b9e2-dca375439496),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fd42a2e-6c') {{(pid=75122) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 09:55:00 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:55:00 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:55:00 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 09:55:00 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:55:00 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '038034d9-3f26-5427-9531-96c2a6194c09', '_type': 'linux-noop'}}, row=False) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:55:00 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:55:00 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:55:00 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:55:00 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:55:00 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4fd42a2e-6c, may_exist=True, interface_attrs={}) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:55:00 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4fd42a2e-6c, col_values=(('qos', UUID('21ad6d80-7ebb-403b-876c-032fabbf9407')),), if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:55:00 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4fd42a2e-6c, col_values=(('external_ids', {'iface-id': '4fd42a2e-6ccb-4865-8cce-ac346aece548', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:68:37:a5', 'vm-uuid': '57dff82c-f7f3-45a7-b645-3cf72a1266ce'}),), if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:55:00 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:55:00 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:55:00 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:55:00 user nova-compute[75122]: INFO os_vif [None req-bd240bea-9129-4f5d-a5f3-001aed1133bf tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:37:a5,bridge_name='br-int',has_traffic_filtering=True,id=4fd42a2e-6ccb-4865-8cce-ac346aece548,network=Network(ca2dff40-00d3-46b0-b9e2-dca375439496),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fd42a2e-6c')
Nov 15 09:55:00 user nova-compute[75122]: DEBUG nova.compute.manager [req-9885495f-2e4f-4450-8025-0eb30dffb34a req-94f003e1-2ef8-4f35-bf18-f9df26a9e63d service nova] [instance: 57dff82c-f7f3-45a7-b645-3cf72a1266ce] Received event network-changed-4fd42a2e-6ccb-4865-8cce-ac346aece548 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:55:00 user nova-compute[75122]: DEBUG nova.compute.manager [req-9885495f-2e4f-4450-8025-0eb30dffb34a req-94f003e1-2ef8-4f35-bf18-f9df26a9e63d service nova] [instance: 57dff82c-f7f3-45a7-b645-3cf72a1266ce] Refreshing instance network info cache due to event network-changed-4fd42a2e-6ccb-4865-8cce-ac346aece548. {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 09:55:00 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-9885495f-2e4f-4450-8025-0eb30dffb34a req-94f003e1-2ef8-4f35-bf18-f9df26a9e63d service nova] Acquiring lock "refresh_cache-57dff82c-f7f3-45a7-b645-3cf72a1266ce" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 09:55:00 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-9885495f-2e4f-4450-8025-0eb30dffb34a req-94f003e1-2ef8-4f35-bf18-f9df26a9e63d service nova] Acquired lock "refresh_cache-57dff82c-f7f3-45a7-b645-3cf72a1266ce" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 09:55:00 user nova-compute[75122]: DEBUG nova.network.neutron [req-9885495f-2e4f-4450-8025-0eb30dffb34a req-94f003e1-2ef8-4f35-bf18-f9df26a9e63d service nova] [instance: 57dff82c-f7f3-45a7-b645-3cf72a1266ce] Refreshing network info cache for port 4fd42a2e-6ccb-4865-8cce-ac346aece548 {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 09:55:00 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-bd240bea-9129-4f5d-a5f3-001aed1133bf tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] No BDM found with device name vda, not building metadata. {{(pid=75122) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 09:55:00 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-bd240bea-9129-4f5d-a5f3-001aed1133bf tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] No VIF found with MAC fa:16:3e:68:37:a5, not building metadata {{(pid=75122) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 09:55:01 user nova-compute[75122]: DEBUG nova.network.neutron [req-9885495f-2e4f-4450-8025-0eb30dffb34a req-94f003e1-2ef8-4f35-bf18-f9df26a9e63d service nova] [instance: 57dff82c-f7f3-45a7-b645-3cf72a1266ce] Updated VIF entry in instance network info cache for port 4fd42a2e-6ccb-4865-8cce-ac346aece548. {{(pid=75122) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 09:55:01 user nova-compute[75122]: DEBUG nova.network.neutron [req-9885495f-2e4f-4450-8025-0eb30dffb34a req-94f003e1-2ef8-4f35-bf18-f9df26a9e63d service nova] [instance: 57dff82c-f7f3-45a7-b645-3cf72a1266ce] Updating instance_info_cache with network_info: [{"id": "4fd42a2e-6ccb-4865-8cce-ac346aece548", "address": "fa:16:3e:68:37:a5", "network": {"id": "ca2dff40-00d3-46b0-b9e2-dca375439496", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1592022235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88f16d3dc8434cb5ac78c8d2f51d305b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fd42a2e-6c", "ovs_interfaceid": "4fd42a2e-6ccb-4865-8cce-ac346aece548", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:55:01 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-9885495f-2e4f-4450-8025-0eb30dffb34a req-94f003e1-2ef8-4f35-bf18-f9df26a9e63d service nova] Releasing lock "refresh_cache-57dff82c-f7f3-45a7-b645-3cf72a1266ce" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 09:55:01 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:55:01 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:55:01 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:55:01 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:55:01 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:55:01 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:55:02 user nova-compute[75122]: DEBUG nova.compute.manager [req-76311bc2-06fb-4287-a4be-222642dab296 req-05937d83-b386-4b22-836f-289096c9f303 service nova] [instance: db848537-676f-464a-806d-febb14d920a6] Received event network-vif-plugged-93bbff2d-1d5c-47db-b436-43796849be51 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:55:02 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-76311bc2-06fb-4287-a4be-222642dab296 req-05937d83-b386-4b22-836f-289096c9f303 service nova] Acquiring lock "db848537-676f-464a-806d-febb14d920a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:55:02 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-76311bc2-06fb-4287-a4be-222642dab296 req-05937d83-b386-4b22-836f-289096c9f303 service nova] Lock "db848537-676f-464a-806d-febb14d920a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:55:02 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-76311bc2-06fb-4287-a4be-222642dab296 req-05937d83-b386-4b22-836f-289096c9f303 service nova] Lock "db848537-676f-464a-806d-febb14d920a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:55:02 user nova-compute[75122]: DEBUG nova.compute.manager [req-76311bc2-06fb-4287-a4be-222642dab296 req-05937d83-b386-4b22-836f-289096c9f303 service nova] [instance: db848537-676f-464a-806d-febb14d920a6] No waiting events found dispatching network-vif-plugged-93bbff2d-1d5c-47db-b436-43796849be51 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:55:02 user nova-compute[75122]: WARNING nova.compute.manager [req-76311bc2-06fb-4287-a4be-222642dab296 req-05937d83-b386-4b22-836f-289096c9f303 service nova] [instance: db848537-676f-464a-806d-febb14d920a6] Received unexpected event network-vif-plugged-93bbff2d-1d5c-47db-b436-43796849be51 for instance with vm_state active and task_state rescuing.
Nov 15 09:55:02 user nova-compute[75122]: DEBUG nova.compute.manager [req-76311bc2-06fb-4287-a4be-222642dab296 req-05937d83-b386-4b22-836f-289096c9f303 service nova] [instance: db848537-676f-464a-806d-febb14d920a6] Received event network-vif-plugged-93bbff2d-1d5c-47db-b436-43796849be51 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:55:02 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-76311bc2-06fb-4287-a4be-222642dab296 req-05937d83-b386-4b22-836f-289096c9f303 service nova] Acquiring lock "db848537-676f-464a-806d-febb14d920a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:55:02 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-76311bc2-06fb-4287-a4be-222642dab296 req-05937d83-b386-4b22-836f-289096c9f303 service nova] Lock "db848537-676f-464a-806d-febb14d920a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:55:02 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-76311bc2-06fb-4287-a4be-222642dab296 req-05937d83-b386-4b22-836f-289096c9f303 service nova] Lock "db848537-676f-464a-806d-febb14d920a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:55:02 user nova-compute[75122]: DEBUG nova.compute.manager [req-76311bc2-06fb-4287-a4be-222642dab296 req-05937d83-b386-4b22-836f-289096c9f303 service nova] [instance: db848537-676f-464a-806d-febb14d920a6] No waiting events found dispatching network-vif-plugged-93bbff2d-1d5c-47db-b436-43796849be51 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:55:02 user nova-compute[75122]: WARNING nova.compute.manager [req-76311bc2-06fb-4287-a4be-222642dab296 req-05937d83-b386-4b22-836f-289096c9f303 service nova] [instance: db848537-676f-464a-806d-febb14d920a6] Received unexpected event network-vif-plugged-93bbff2d-1d5c-47db-b436-43796849be51 for instance with vm_state active and task_state rescuing.
Nov 15 09:55:02 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:55:02 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:55:02 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:55:03 user nova-compute[75122]: DEBUG nova.compute.manager [req-fba9cee0-f66d-49d6-8a6e-b82fb3720b99 req-d82fcdba-a35c-4575-99e2-c805f31cc669 service nova] [instance: 57dff82c-f7f3-45a7-b645-3cf72a1266ce] Received event network-vif-plugged-4fd42a2e-6ccb-4865-8cce-ac346aece548 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:55:03 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-fba9cee0-f66d-49d6-8a6e-b82fb3720b99 req-d82fcdba-a35c-4575-99e2-c805f31cc669 service nova] Acquiring lock "57dff82c-f7f3-45a7-b645-3cf72a1266ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:55:03 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-fba9cee0-f66d-49d6-8a6e-b82fb3720b99 req-d82fcdba-a35c-4575-99e2-c805f31cc669 service nova] Lock "57dff82c-f7f3-45a7-b645-3cf72a1266ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:55:03 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-fba9cee0-f66d-49d6-8a6e-b82fb3720b99 req-d82fcdba-a35c-4575-99e2-c805f31cc669 service nova] Lock "57dff82c-f7f3-45a7-b645-3cf72a1266ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:55:03 user nova-compute[75122]: DEBUG nova.compute.manager [req-fba9cee0-f66d-49d6-8a6e-b82fb3720b99 req-d82fcdba-a35c-4575-99e2-c805f31cc669 service nova] [instance: 57dff82c-f7f3-45a7-b645-3cf72a1266ce] No waiting events found dispatching network-vif-plugged-4fd42a2e-6ccb-4865-8cce-ac346aece548 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:55:03 user nova-compute[75122]: WARNING nova.compute.manager [req-fba9cee0-f66d-49d6-8a6e-b82fb3720b99 req-d82fcdba-a35c-4575-99e2-c805f31cc669 service nova] [instance: 57dff82c-f7f3-45a7-b645-3cf72a1266ce] Received unexpected event network-vif-plugged-4fd42a2e-6ccb-4865-8cce-ac346aece548 for instance with vm_state building and task_state spawning.
Nov 15 09:55:03 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:55:03 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:55:04 user nova-compute[75122]: DEBUG nova.compute.manager [None req-e0a6c3f9-c37e-497c-9bbc-f14ab6f4e407 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: db848537-676f-464a-806d-febb14d920a6] Checking state {{(pid=75122) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 09:55:05 user nova-compute[75122]: DEBUG nova.compute.manager [None req-bd240bea-9129-4f5d-a5f3-001aed1133bf tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] [instance: 57dff82c-f7f3-45a7-b645-3cf72a1266ce] Instance event wait completed in 0 seconds for  {{(pid=75122) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 09:55:05 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-bd240bea-9129-4f5d-a5f3-001aed1133bf tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] [instance: 57dff82c-f7f3-45a7-b645-3cf72a1266ce] Guest created on hypervisor {{(pid=75122) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 09:55:05 user nova-compute[75122]: INFO nova.virt.libvirt.driver [-] [instance: 57dff82c-f7f3-45a7-b645-3cf72a1266ce] Instance spawned successfully.
Nov 15 09:55:05 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-bd240bea-9129-4f5d-a5f3-001aed1133bf tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] [instance: 57dff82c-f7f3-45a7-b645-3cf72a1266ce] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 09:55:05 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-bd240bea-9129-4f5d-a5f3-001aed1133bf tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] [instance: 57dff82c-f7f3-45a7-b645-3cf72a1266ce] Found default for hw_cdrom_bus of ide {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:55:05 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-bd240bea-9129-4f5d-a5f3-001aed1133bf tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] [instance: 57dff82c-f7f3-45a7-b645-3cf72a1266ce] Found default for hw_disk_bus of virtio {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:55:05 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-bd240bea-9129-4f5d-a5f3-001aed1133bf tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] [instance: 57dff82c-f7f3-45a7-b645-3cf72a1266ce] Found default for hw_input_bus of None {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:55:05 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-bd240bea-9129-4f5d-a5f3-001aed1133bf tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] [instance: 57dff82c-f7f3-45a7-b645-3cf72a1266ce] Found default for hw_pointer_model of None {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:55:05 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-bd240bea-9129-4f5d-a5f3-001aed1133bf tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] [instance: 57dff82c-f7f3-45a7-b645-3cf72a1266ce] Found default for hw_video_model of virtio {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:55:05 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-bd240bea-9129-4f5d-a5f3-001aed1133bf tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] [instance: 57dff82c-f7f3-45a7-b645-3cf72a1266ce] Found default for hw_vif_model of virtio {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:55:05 user nova-compute[75122]: DEBUG nova.compute.manager [req-99a7b671-5ec9-4607-a66c-a4788a3f75df req-2dcb72f1-811a-4e67-b81e-609cd93d4384 service nova] [instance: 57dff82c-f7f3-45a7-b645-3cf72a1266ce] Received event network-vif-plugged-4fd42a2e-6ccb-4865-8cce-ac346aece548 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:55:05 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-99a7b671-5ec9-4607-a66c-a4788a3f75df req-2dcb72f1-811a-4e67-b81e-609cd93d4384 service nova] Acquiring lock "57dff82c-f7f3-45a7-b645-3cf72a1266ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:55:05 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-99a7b671-5ec9-4607-a66c-a4788a3f75df req-2dcb72f1-811a-4e67-b81e-609cd93d4384 service nova] Lock "57dff82c-f7f3-45a7-b645-3cf72a1266ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:55:05 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-99a7b671-5ec9-4607-a66c-a4788a3f75df req-2dcb72f1-811a-4e67-b81e-609cd93d4384 service nova] Lock "57dff82c-f7f3-45a7-b645-3cf72a1266ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:55:05 user nova-compute[75122]: DEBUG nova.compute.manager [req-99a7b671-5ec9-4607-a66c-a4788a3f75df req-2dcb72f1-811a-4e67-b81e-609cd93d4384 service nova] [instance: 57dff82c-f7f3-45a7-b645-3cf72a1266ce] No waiting events found dispatching network-vif-plugged-4fd42a2e-6ccb-4865-8cce-ac346aece548 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:55:05 user nova-compute[75122]: WARNING nova.compute.manager [req-99a7b671-5ec9-4607-a66c-a4788a3f75df req-2dcb72f1-811a-4e67-b81e-609cd93d4384 service nova] [instance: 57dff82c-f7f3-45a7-b645-3cf72a1266ce] Received unexpected event network-vif-plugged-4fd42a2e-6ccb-4865-8cce-ac346aece548 for instance with vm_state building and task_state spawning.
Nov 15 09:55:05 user nova-compute[75122]: INFO nova.compute.manager [None req-bd240bea-9129-4f5d-a5f3-001aed1133bf tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] [instance: 57dff82c-f7f3-45a7-b645-3cf72a1266ce] Took 5.90 seconds to spawn the instance on the hypervisor.
Nov 15 09:55:05 user nova-compute[75122]: DEBUG nova.compute.manager [None req-bd240bea-9129-4f5d-a5f3-001aed1133bf tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] [instance: 57dff82c-f7f3-45a7-b645-3cf72a1266ce] Checking state {{(pid=75122) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 09:55:05 user nova-compute[75122]: INFO nova.compute.manager [None req-bd240bea-9129-4f5d-a5f3-001aed1133bf tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] [instance: 57dff82c-f7f3-45a7-b645-3cf72a1266ce] Took 6.79 seconds to build instance.
Nov 15 09:55:05 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-bd240bea-9129-4f5d-a5f3-001aed1133bf tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] Lock "57dff82c-f7f3-45a7-b645-3cf72a1266ce" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.887s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:55:05 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:55:06 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:55:10 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:55:15 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:55:20 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:55:20 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:55:20 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75122) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 09:55:20 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75122) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 09:55:20 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75122) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 09:55:20 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:55:21 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:55:21 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-8835993d-d4fa-42da-818c-634c87ab6d89 tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] Acquiring lock "718ca25b-c73d-4853-b674-fdaf3ed465c7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:55:21 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-8835993d-d4fa-42da-818c-634c87ab6d89 tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] Lock "718ca25b-c73d-4853-b674-fdaf3ed465c7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:55:21 user nova-compute[75122]: INFO nova.compute.manager [None req-8835993d-d4fa-42da-818c-634c87ab6d89 tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] [instance: 718ca25b-c73d-4853-b674-fdaf3ed465c7] Detaching volume e5980f14-24f1-4673-9b31-ee87a0d26092
Nov 15 09:55:21 user nova-compute[75122]: INFO nova.virt.block_device [None req-8835993d-d4fa-42da-818c-634c87ab6d89 tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] [instance: 718ca25b-c73d-4853-b674-fdaf3ed465c7] Attempting to driver detach volume e5980f14-24f1-4673-9b31-ee87a0d26092 from mountpoint /dev/vdb
Nov 15 09:55:21 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-8835993d-d4fa-42da-818c-634c87ab6d89 tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] Attempting to detach device vdb from instance 718ca25b-c73d-4853-b674-fdaf3ed465c7 from the persistent domain config. {{(pid=75122) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 09:55:21 user nova-compute[75122]: DEBUG nova.virt.libvirt.guest [None req-8835993d-d4fa-42da-818c-634c87ab6d89 tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 09:55:21 user nova-compute[75122]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 09:55:21 user nova-compute[75122]:   <source dev="/dev/sdc"/>
Nov 15 09:55:21 user nova-compute[75122]:   <target dev="vdb" bus="virtio"/>
Nov 15 09:55:21 user nova-compute[75122]:   <serial>e5980f14-24f1-4673-9b31-ee87a0d26092</serial>
Nov 15 09:55:21 user nova-compute[75122]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 09:55:21 user nova-compute[75122]: </disk>
Nov 15 09:55:21 user nova-compute[75122]:  {{(pid=75122) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 09:55:21 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-8835993d-d4fa-42da-818c-634c87ab6d89 tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] Successfully detached device vdb from instance 718ca25b-c73d-4853-b674-fdaf3ed465c7 from the persistent domain config.
Nov 15 09:55:21 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-8835993d-d4fa-42da-818c-634c87ab6d89 tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 718ca25b-c73d-4853-b674-fdaf3ed465c7 from the live domain config. {{(pid=75122) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 09:55:21 user nova-compute[75122]: DEBUG nova.virt.libvirt.guest [None req-8835993d-d4fa-42da-818c-634c87ab6d89 tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 09:55:21 user nova-compute[75122]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 09:55:21 user nova-compute[75122]:   <source dev="/dev/sdc"/>
Nov 15 09:55:21 user nova-compute[75122]:   <target dev="vdb" bus="virtio"/>
Nov 15 09:55:21 user nova-compute[75122]:   <serial>e5980f14-24f1-4673-9b31-ee87a0d26092</serial>
Nov 15 09:55:21 user nova-compute[75122]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 09:55:21 user nova-compute[75122]: </disk>
Nov 15 09:55:21 user nova-compute[75122]:  {{(pid=75122) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 09:55:22 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-8835993d-d4fa-42da-818c-634c87ab6d89 tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 718ca25b-c73d-4853-b674-fdaf3ed465c7 {{(pid=75122) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 09:55:25 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:55:26 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:55:30 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:55:31 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:55:31 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:55:31 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:55:31 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:55:31 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:55:31 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75122) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 09:55:31 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40f792bb-43a9-4011-aaba-f240f64e2757/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:55:31 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40f792bb-43a9-4011-aaba-f240f64e2757/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:55:31 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40f792bb-43a9-4011-aaba-f240f64e2757/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:55:31 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:55:31 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40f792bb-43a9-4011-aaba-f240f64e2757/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:55:31 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/718ca25b-c73d-4853-b674-fdaf3ed465c7/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:55:31 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/718ca25b-c73d-4853-b674-fdaf3ed465c7/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:55:31 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/718ca25b-c73d-4853-b674-fdaf3ed465c7/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:55:32 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/718ca25b-c73d-4853-b674-fdaf3ed465c7/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:55:32 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/001d589e-1bee-42da-8422-233ba796fbab/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:55:32 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/001d589e-1bee-42da-8422-233ba796fbab/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:55:32 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/001d589e-1bee-42da-8422-233ba796fbab/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:55:32 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/001d589e-1bee-42da-8422-233ba796fbab/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:55:32 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be71985e-a370-43d9-adef-afb31d03e2fd/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:55:32 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be71985e-a370-43d9-adef-afb31d03e2fd/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:55:32 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be71985e-a370-43d9-adef-afb31d03e2fd/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:55:32 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be71985e-a370-43d9-adef-afb31d03e2fd/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:55:32 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75122) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 09:55:32 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db848537-676f-464a-806d-febb14d920a6/disk.rescue --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:55:32 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db848537-676f-464a-806d-febb14d920a6/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:55:32 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db848537-676f-464a-806d-febb14d920a6/disk.rescue --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:55:33 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db848537-676f-464a-806d-febb14d920a6/disk.rescue --force-share --output=json" returned: 0 in 0.166s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:55:33 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57dff82c-f7f3-45a7-b645-3cf72a1266ce/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:55:33 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57dff82c-f7f3-45a7-b645-3cf72a1266ce/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:55:33 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57dff82c-f7f3-45a7-b645-3cf72a1266ce/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:55:33 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57dff82c-f7f3-45a7-b645-3cf72a1266ce/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:55:33 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 09:55:33 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 09:55:33 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Hypervisor/Node resource view: name=user free_ram=8308MB free_disk=25.062332153320312GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75122) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 09:55:33 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:55:33 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:55:34 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance 001d589e-1bee-42da-8422-233ba796fbab actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:55:34 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance 718ca25b-c73d-4853-b674-fdaf3ed465c7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:55:34 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance db848537-676f-464a-806d-febb14d920a6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:55:34 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance be71985e-a370-43d9-adef-afb31d03e2fd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:55:34 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance 40f792bb-43a9-4011-aaba-f240f64e2757 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:55:34 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance 57dff82c-f7f3-45a7-b645-3cf72a1266ce actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:55:34 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=75122) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 09:55:34 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=75122) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 09:55:34 user nova-compute[75122]: DEBUG nova.compute.provider_tree [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Inventory has not changed in ProviderTree for provider: 69a3da65-47be-44c6-b67c-c692b58284ef {{(pid=75122) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 09:55:34 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Inventory has not changed for provider 69a3da65-47be-44c6-b67c-c692b58284ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 09:55:34 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Compute_service record updated for user:user {{(pid=75122) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 09:55:34 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.361s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:55:35 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:55:35 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Starting heal instance info cache {{(pid=75122) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 09:55:35 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "refresh_cache-718ca25b-c73d-4853-b674-fdaf3ed465c7" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 09:55:35 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquired lock "refresh_cache-718ca25b-c73d-4853-b674-fdaf3ed465c7" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 09:55:35 user nova-compute[75122]: DEBUG nova.network.neutron [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] [instance: 718ca25b-c73d-4853-b674-fdaf3ed465c7] Forcefully refreshing network info cache for instance {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 09:55:35 user nova-compute[75122]: DEBUG nova.network.neutron [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] [instance: 718ca25b-c73d-4853-b674-fdaf3ed465c7] Updating instance_info_cache with network_info: [{"id": "8691c10b-6a01-4e1f-884e-0aa0a4bd39c2", "address": "fa:16:3e:2a:93:fb", "network": {"id": "0e218464-b514-477f-8f50-93252bee51e8", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-575730542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "348514cfec2145f59bc0a7368b9557f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8691c10b-6a", "ovs_interfaceid": "8691c10b-6a01-4e1f-884e-0aa0a4bd39c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:55:35 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Releasing lock "refresh_cache-718ca25b-c73d-4853-b674-fdaf3ed465c7" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 09:55:35 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] [instance: 718ca25b-c73d-4853-b674-fdaf3ed465c7] Updated the network info_cache for instance {{(pid=75122) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 09:55:35 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:55:35 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:55:35 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:55:35 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:55:35 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:55:35 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75122) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 09:55:35 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:55:36 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:55:39 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:55:40 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:55:41 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:55:42 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-8835993d-d4fa-42da-818c-634c87ab6d89 tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 718ca25b-c73d-4853-b674-fdaf3ed465c7 is timed out.
Nov 15 09:55:42 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-8835993d-d4fa-42da-818c-634c87ab6d89 tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] Successfully detached device vdb from instance 718ca25b-c73d-4853-b674-fdaf3ed465c7 from the live domain config.
Nov 15 09:55:42 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8835993d-d4fa-42da-818c-634c87ab6d89 tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] [instance: 718ca25b-c73d-4853-b674-fdaf3ed465c7] calling os-brick to detach iSCSI Volume {{(pid=75122) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 09:55:42 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-8835993d-d4fa-42da-818c-634c87ab6d89 tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffa04060b80>, {'target_iqn': 'iqn.2010-10.org.openstack:e5980f14-24f1-4673-9b31-ee87a0d26092', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dtvTgiSy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 09:55:42 user nova-compute[75122]: WARNING os_brick.initiator.connectors.base [None req-8835993d-d4fa-42da-818c-634c87ab6d89 tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 09:55:42 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-8835993d-d4fa-42da-818c-634c87ab6d89 tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 09:55:42 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-8835993d-d4fa-42da-818c-634c87ab6d89 tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 09:55:42 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:55:42 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:55:42 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[00372148-348a-458c-9ee3-41f71cdcea4d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e5980f14-24f1-4673-9b31-ee87a0d26092\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8ee79db2-27c2-4d0f-8ee6-5b03e05ebba5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:55:42 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-8835993d-d4fa-42da-818c-634c87ab6d89 tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 09:55:42 user nova-compute[75122]: No targets found.
Nov 15 09:55:42 user nova-compute[75122]: iSNS:
Nov 15 09:55:42 user nova-compute[75122]: No targets found.
Nov 15 09:55:42 user nova-compute[75122]: STATIC:
Nov 15 09:55:42 user nova-compute[75122]: Target: iqn.2010-10.org.openstack:e5980f14-24f1-4673-9b31-ee87a0d26092
Nov 15 09:55:42 user nova-compute[75122]:         Portal: 172.16.0.220:3260,-1
Nov 15 09:55:42 user nova-compute[75122]:                 Iface Name: default
Nov 15 09:55:42 user nova-compute[75122]: Target: iqn.2010-10.org.openstack:8ee79db2-27c2-4d0f-8ee6-5b03e05ebba5
Nov 15 09:55:42 user nova-compute[75122]:         Portal: 172.16.0.220:3260,-1
Nov 15 09:55:42 user nova-compute[75122]:                 Iface Name: default
Nov 15 09:55:42 user nova-compute[75122]: FIRMWARE:
Nov 15 09:55:42 user nova-compute[75122]: No targets found.
Nov 15 09:55:42 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 09:55:42 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-8835993d-d4fa-42da-818c-634c87ab6d89 tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 09:55:42 user nova-compute[75122]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 09:55:42 user nova-compute[75122]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75122) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 09:55:42 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-8835993d-d4fa-42da-818c-634c87ab6d89 tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e5980f14-24f1-4673-9b31-ee87a0d26092', 0)] {{(pid=75122) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 09:55:42 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:55:42 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:55:42 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[8777dd87-87d0-4a7d-97de-c70bcee26fd6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8ee79db2-27c2-4d0f-8ee6-5b03e05ebba5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e5980f14-24f1-4673-9b31-ee87a0d26092\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:55:42 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:55:42 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:55:42 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba1b042d-a4cc-4538-a6a6-3cf75d2b4453]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee79db2-27c2-4d0f-8ee6-5b03e05ebba5 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5980f14-24f1-4673-9b31-ee87a0d26092 (non-flash)\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:55:42 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-8835993d-d4fa-42da-818c-634c87ab6d89 tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee79db2-27c2-4d0f-8ee6-5b03e05ebba5 (non-flash)
Nov 15 09:55:42 user nova-compute[75122]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5980f14-24f1-4673-9b31-ee87a0d26092 (non-flash)
Nov 15 09:55:42 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 09:55:42 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-8835993d-d4fa-42da-818c-634c87ab6d89 tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee79db2-27c2-4d0f-8ee6-5b03e05ebba5 (non-flash)
Nov 15 09:55:42 user nova-compute[75122]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5980f14-24f1-4673-9b31-ee87a0d26092 (non-flash)
Nov 15 09:55:42 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 09:55:42 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-8835993d-d4fa-42da-818c-634c87ab6d89 tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ffa041b9240>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e5980f14-24f1-4673-9b31-ee87a0d26092'): ({'sdc'}, set())}) {{(pid=75122) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 09:55:42 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-8835993d-d4fa-42da-818c-634c87ab6d89 tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] Removing single pathed devices sdc {{(pid=75122) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 09:55:42 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:55:42 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:55:42 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[94677e6b-9760-480d-a82b-a12dca3949e7]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:55:42 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:55:42 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.017s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:55:42 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ed9d111-c92d-45d7-8e39-d14f1ec77ce1]: (4, ('ok\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:55:42 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-8835993d-d4fa-42da-818c-634c87ab6d89 tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] Flushing IO for device /dev/sdc {{(pid=75122) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 09:55:42 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:55:42 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:55:42 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[baee0c33-fe8e-45d4-bfdd-fd6e48cc8dec]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:55:42 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-8835993d-d4fa-42da-818c-634c87ab6d89 tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75122) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 09:55:42 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:55:42 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.033s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:55:42 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a42d379-5da6-4318-aad7-74a8faeb4428]: (4, ('1', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:55:42 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-8835993d-d4fa-42da-818c-634c87ab6d89 tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75122) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 09:55:42 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-8835993d-d4fa-42da-818c-634c87ab6d89 tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] SCSI volumes sdc have been removed. {{(pid=75122) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 09:55:42 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-8835993d-d4fa-42da-818c-634c87ab6d89 tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e5980f14-24f1-4673-9b31-ee87a0d26092')] {{(pid=75122) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 09:55:42 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5980f14-24f1-4673-9b31-ee87a0d26092 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:55:42 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5980f14-24f1-4673-9b31-ee87a0d26092 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:55:42 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc8aef08-b225-4dee-98a1-056d9a331a6e]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:55:42 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-8835993d-d4fa-42da-818c-634c87ab6d89 tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:55:42 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5980f14-24f1-4673-9b31-ee87a0d26092 -p 172.16.0.220:3260 --logout {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:55:42 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5980f14-24f1-4673-9b31-ee87a0d26092 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:55:42 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[547473a7-a46f-47ef-86ec-51e76b75db94]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:e5980f14-24f1-4673-9b31-ee87a0d26092, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:e5980f14-24f1-4673-9b31-ee87a0d26092, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:55:42 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-8835993d-d4fa-42da-818c-634c87ab6d89 tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:e5980f14-24f1-4673-9b31-ee87a0d26092, portal: 172.16.0.220,3260]
Nov 15 09:55:42 user nova-compute[75122]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:e5980f14-24f1-4673-9b31-ee87a0d26092, portal: 172.16.0.220,3260] successful.
Nov 15 09:55:42 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:55:42 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5980f14-24f1-4673-9b31-ee87a0d26092 -p 172.16.0.220:3260 --op delete {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:55:42 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5980f14-24f1-4673-9b31-ee87a0d26092 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:55:42 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[4264ebf9-f04c-461f-a876-5d8b9f910209]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:55:42 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-8835993d-d4fa-42da-818c-634c87ab6d89 tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:55:42 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-8835993d-d4fa-42da-818c-634c87ab6d89 tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.299s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 09:55:42 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-8835993d-d4fa-42da-818c-634c87ab6d89 tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] <== disconnect_volume: return (301ms) None {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 09:55:42 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8835993d-d4fa-42da-818c-634c87ab6d89 tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] [instance: 718ca25b-c73d-4853-b674-fdaf3ed465c7] Disconnected iSCSI Volume {{(pid=75122) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 09:55:43 user nova-compute[75122]: DEBUG nova.objects.instance [None req-8835993d-d4fa-42da-818c-634c87ab6d89 tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] Lazy-loading 'flavor' on Instance uuid 718ca25b-c73d-4853-b674-fdaf3ed465c7 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:55:43 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-8835993d-d4fa-42da-818c-634c87ab6d89 tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] Lock "718ca25b-c73d-4853-b674-fdaf3ed465c7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.699s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:55:45 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:55:50 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:55:50 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:55:50 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75122) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 09:55:50 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75122) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 09:55:50 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75122) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 09:55:50 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:55:55 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:55:55 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:55:55 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75122) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 09:55:55 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75122) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 09:55:55 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75122) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 09:55:55 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:56:00 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:56:00 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:56:00 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75122) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 09:56:00 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75122) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 09:56:00 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75122) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 09:56:00 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:56:05 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:56:10 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-6ae6a8ec-c253-4b81-95f9-0e655b12a5f8 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Acquiring lock "40f792bb-43a9-4011-aaba-f240f64e2757" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:56:10 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-6ae6a8ec-c253-4b81-95f9-0e655b12a5f8 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Lock "40f792bb-43a9-4011-aaba-f240f64e2757" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:56:10 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-6ae6a8ec-c253-4b81-95f9-0e655b12a5f8 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Acquiring lock "40f792bb-43a9-4011-aaba-f240f64e2757-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:56:10 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-6ae6a8ec-c253-4b81-95f9-0e655b12a5f8 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Lock "40f792bb-43a9-4011-aaba-f240f64e2757-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:56:10 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-6ae6a8ec-c253-4b81-95f9-0e655b12a5f8 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Lock "40f792bb-43a9-4011-aaba-f240f64e2757-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:56:10 user nova-compute[75122]: INFO nova.compute.manager [None req-6ae6a8ec-c253-4b81-95f9-0e655b12a5f8 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] [instance: 40f792bb-43a9-4011-aaba-f240f64e2757] Terminating instance
Nov 15 09:56:10 user nova-compute[75122]: DEBUG nova.compute.manager [None req-6ae6a8ec-c253-4b81-95f9-0e655b12a5f8 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] [instance: 40f792bb-43a9-4011-aaba-f240f64e2757] Start destroying the instance on the hypervisor. {{(pid=75122) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 09:56:11 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:56:11 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:56:11 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:56:11 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:56:11 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:56:11 user nova-compute[75122]: DEBUG nova.compute.manager [req-c689c802-2fb5-4f34-b66f-a89380978bab req-849a6f89-c3ee-4b0f-bac1-fd7824951e4f service nova] [instance: 40f792bb-43a9-4011-aaba-f240f64e2757] Received event network-vif-unplugged-da514680-136e-49d6-aec0-9d4192081cec {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:56:11 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-c689c802-2fb5-4f34-b66f-a89380978bab req-849a6f89-c3ee-4b0f-bac1-fd7824951e4f service nova] Acquiring lock "40f792bb-43a9-4011-aaba-f240f64e2757-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:56:11 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-c689c802-2fb5-4f34-b66f-a89380978bab req-849a6f89-c3ee-4b0f-bac1-fd7824951e4f service nova] Lock "40f792bb-43a9-4011-aaba-f240f64e2757-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:56:11 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-c689c802-2fb5-4f34-b66f-a89380978bab req-849a6f89-c3ee-4b0f-bac1-fd7824951e4f service nova] Lock "40f792bb-43a9-4011-aaba-f240f64e2757-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:56:11 user nova-compute[75122]: DEBUG nova.compute.manager [req-c689c802-2fb5-4f34-b66f-a89380978bab req-849a6f89-c3ee-4b0f-bac1-fd7824951e4f service nova] [instance: 40f792bb-43a9-4011-aaba-f240f64e2757] No waiting events found dispatching network-vif-unplugged-da514680-136e-49d6-aec0-9d4192081cec {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:56:11 user nova-compute[75122]: DEBUG nova.compute.manager [req-c689c802-2fb5-4f34-b66f-a89380978bab req-849a6f89-c3ee-4b0f-bac1-fd7824951e4f service nova] [instance: 40f792bb-43a9-4011-aaba-f240f64e2757] Received event network-vif-unplugged-da514680-136e-49d6-aec0-9d4192081cec for instance with task_state deleting. {{(pid=75122) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 09:56:11 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:56:11 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:56:11 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:56:11 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:56:11 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:56:11 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:56:11 user nova-compute[75122]: INFO nova.virt.libvirt.driver [-] [instance: 40f792bb-43a9-4011-aaba-f240f64e2757] Instance destroyed successfully.
Nov 15 09:56:11 user nova-compute[75122]: DEBUG nova.objects.instance [None req-6ae6a8ec-c253-4b81-95f9-0e655b12a5f8 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Lazy-loading 'resources' on Instance uuid 40f792bb-43a9-4011-aaba-f240f64e2757 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:56:11 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-6ae6a8ec-c253-4b81-95f9-0e655b12a5f8 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-15T09:50:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1963643859',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1963643859',id=36,image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ+o1+VCoCl9aLUFla+CNAvrWecqtmJtkNMOXPbFgT/SGUDJQjE5J+p9LWhVFHo42hKlQB0Lpf11tT5e0MRK3x6CI//9ttDmkzl+cisBUmlwupwf667RZL6YbQ9nOc/Fow==',key_name='tempest-keypair-130968135',keypairs=<?>,launch_index=0,launched_at=2023-11-15T09:54:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='535c751b9e76421c9262e48fbab3fb6f',ramdisk_id='',reservation_id='r-y94lw7al',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1659813957',owner_user_name='tempest-AttachVolumeShelveTestJSON-1659813957-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T09:54:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad06186836ed40a49a05ef7cc9afd1bc',uuid=40f792bb-43a9-4011-aaba-f240f64e2757,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "da514680-136e-49d6-aec0-9d4192081cec", "address": "fa:16:3e:b0:8a:af", "network": {"id": "7ab99c1b-e670-416e-b5fe-e1337db6b28d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-487518933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "535c751b9e76421c9262e48fbab3fb6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda514680-13", "ovs_interfaceid": "da514680-136e-49d6-aec0-9d4192081cec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 09:56:11 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-6ae6a8ec-c253-4b81-95f9-0e655b12a5f8 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Converting VIF {"id": "da514680-136e-49d6-aec0-9d4192081cec", "address": "fa:16:3e:b0:8a:af", "network": {"id": "7ab99c1b-e670-416e-b5fe-e1337db6b28d", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-487518933-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "535c751b9e76421c9262e48fbab3fb6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda514680-13", "ovs_interfaceid": "da514680-136e-49d6-aec0-9d4192081cec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 09:56:11 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-6ae6a8ec-c253-4b81-95f9-0e655b12a5f8 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:8a:af,bridge_name='br-int',has_traffic_filtering=True,id=da514680-136e-49d6-aec0-9d4192081cec,network=Network(7ab99c1b-e670-416e-b5fe-e1337db6b28d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda514680-13') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 09:56:11 user nova-compute[75122]: DEBUG os_vif [None req-6ae6a8ec-c253-4b81-95f9-0e655b12a5f8 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:8a:af,bridge_name='br-int',has_traffic_filtering=True,id=da514680-136e-49d6-aec0-9d4192081cec,network=Network(7ab99c1b-e670-416e-b5fe-e1337db6b28d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda514680-13') {{(pid=75122) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 09:56:11 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:56:11 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapda514680-13, bridge=br-int, if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:56:11 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:56:11 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:56:11 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:56:11 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:56:11 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=41e77c96-418a-4c8a-8f87-eb539d9195e9) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:56:11 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:56:11 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:56:11 user nova-compute[75122]: INFO os_vif [None req-6ae6a8ec-c253-4b81-95f9-0e655b12a5f8 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:8a:af,bridge_name='br-int',has_traffic_filtering=True,id=da514680-136e-49d6-aec0-9d4192081cec,network=Network(7ab99c1b-e670-416e-b5fe-e1337db6b28d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda514680-13')
Nov 15 09:56:11 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-6ae6a8ec-c253-4b81-95f9-0e655b12a5f8 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] [instance: 40f792bb-43a9-4011-aaba-f240f64e2757] Deleting instance files /opt/stack/data/nova/instances/40f792bb-43a9-4011-aaba-f240f64e2757_del
Nov 15 09:56:11 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-6ae6a8ec-c253-4b81-95f9-0e655b12a5f8 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] [instance: 40f792bb-43a9-4011-aaba-f240f64e2757] Deletion of /opt/stack/data/nova/instances/40f792bb-43a9-4011-aaba-f240f64e2757_del complete
Nov 15 09:56:11 user nova-compute[75122]: INFO nova.compute.manager [None req-6ae6a8ec-c253-4b81-95f9-0e655b12a5f8 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] [instance: 40f792bb-43a9-4011-aaba-f240f64e2757] Took 0.93 seconds to destroy the instance on the hypervisor.
Nov 15 09:56:11 user nova-compute[75122]: DEBUG oslo.service.loopingcall [None req-6ae6a8ec-c253-4b81-95f9-0e655b12a5f8 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75122) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 09:56:11 user nova-compute[75122]: DEBUG nova.compute.manager [-] [instance: 40f792bb-43a9-4011-aaba-f240f64e2757] Deallocating network for instance {{(pid=75122) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 09:56:11 user nova-compute[75122]: DEBUG nova.network.neutron [-] [instance: 40f792bb-43a9-4011-aaba-f240f64e2757] deallocate_for_instance() {{(pid=75122) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 09:56:12 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0646b49d-c8fb-47a2-b38c-a654637c16ca tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] Acquiring lock "718ca25b-c73d-4853-b674-fdaf3ed465c7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:56:12 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0646b49d-c8fb-47a2-b38c-a654637c16ca tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] Lock "718ca25b-c73d-4853-b674-fdaf3ed465c7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:56:12 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0646b49d-c8fb-47a2-b38c-a654637c16ca tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] Acquiring lock "718ca25b-c73d-4853-b674-fdaf3ed465c7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:56:12 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0646b49d-c8fb-47a2-b38c-a654637c16ca tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] Lock "718ca25b-c73d-4853-b674-fdaf3ed465c7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:56:12 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0646b49d-c8fb-47a2-b38c-a654637c16ca tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] Lock "718ca25b-c73d-4853-b674-fdaf3ed465c7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:56:12 user nova-compute[75122]: INFO nova.compute.manager [None req-0646b49d-c8fb-47a2-b38c-a654637c16ca tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] [instance: 718ca25b-c73d-4853-b674-fdaf3ed465c7] Terminating instance
Nov 15 09:56:12 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0646b49d-c8fb-47a2-b38c-a654637c16ca tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] [instance: 718ca25b-c73d-4853-b674-fdaf3ed465c7] Start destroying the instance on the hypervisor. {{(pid=75122) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 09:56:12 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:56:12 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:56:12 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:56:12 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:56:12 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:56:12 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:56:12 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:56:12 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:56:12 user nova-compute[75122]: INFO nova.virt.libvirt.driver [-] [instance: 718ca25b-c73d-4853-b674-fdaf3ed465c7] Instance destroyed successfully.
Nov 15 09:56:12 user nova-compute[75122]: DEBUG nova.objects.instance [None req-0646b49d-c8fb-47a2-b38c-a654637c16ca tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] Lazy-loading 'resources' on Instance uuid 718ca25b-c73d-4853-b674-fdaf3ed465c7 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:56:12 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-0646b49d-c8fb-47a2-b38c-a654637c16ca tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T09:52:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1329324950',display_name='tempest-TestServerVolumeAttachmentScenario-server-1329324950',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1329324950',id=37,image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOMvGPj8euUTX1Sv5k4CFHUFpZRGqcMBY8TAr4b1+Sc+Lbt/Ga07Rc51kPkPpTBha7OVuAIyEQkvzu6UsjcJgmFKfAkmdnz6WfC6hlKTHamzdTU1EkQi2CImOT6kjczOvg==',key_name='tempest-keypair-352398611',keypairs=<?>,launch_index=0,launched_at=2023-11-15T09:52:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='348514cfec2145f59bc0a7368b9557f8',ramdisk_id='',reservation_id='r-54an7c0g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1023757833',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1023757833-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T09:52:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='47df8a0972f24edcb3a59f2abb6a90d4',uuid=718ca25b-c73d-4853-b674-fdaf3ed465c7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8691c10b-6a01-4e1f-884e-0aa0a4bd39c2", "address": "fa:16:3e:2a:93:fb", "network": {"id": "0e218464-b514-477f-8f50-93252bee51e8", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-575730542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "348514cfec2145f59bc0a7368b9557f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8691c10b-6a", "ovs_interfaceid": "8691c10b-6a01-4e1f-884e-0aa0a4bd39c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 09:56:12 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-0646b49d-c8fb-47a2-b38c-a654637c16ca tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] Converting VIF {"id": "8691c10b-6a01-4e1f-884e-0aa0a4bd39c2", "address": "fa:16:3e:2a:93:fb", "network": {"id": "0e218464-b514-477f-8f50-93252bee51e8", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-575730542-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "348514cfec2145f59bc0a7368b9557f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8691c10b-6a", "ovs_interfaceid": "8691c10b-6a01-4e1f-884e-0aa0a4bd39c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 09:56:12 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-0646b49d-c8fb-47a2-b38c-a654637c16ca tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2a:93:fb,bridge_name='br-int',has_traffic_filtering=True,id=8691c10b-6a01-4e1f-884e-0aa0a4bd39c2,network=Network(0e218464-b514-477f-8f50-93252bee51e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8691c10b-6a') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 09:56:12 user nova-compute[75122]: DEBUG os_vif [None req-0646b49d-c8fb-47a2-b38c-a654637c16ca tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2a:93:fb,bridge_name='br-int',has_traffic_filtering=True,id=8691c10b-6a01-4e1f-884e-0aa0a4bd39c2,network=Network(0e218464-b514-477f-8f50-93252bee51e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8691c10b-6a') {{(pid=75122) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 09:56:12 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:56:12 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8691c10b-6a, bridge=br-int, if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:56:12 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:56:12 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:56:12 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:56:12 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e7575847-1814-4bb9-87b1-91effa835d52) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:56:12 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:56:12 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:56:13 user nova-compute[75122]: INFO os_vif [None req-0646b49d-c8fb-47a2-b38c-a654637c16ca tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2a:93:fb,bridge_name='br-int',has_traffic_filtering=True,id=8691c10b-6a01-4e1f-884e-0aa0a4bd39c2,network=Network(0e218464-b514-477f-8f50-93252bee51e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8691c10b-6a')
Nov 15 09:56:13 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-0646b49d-c8fb-47a2-b38c-a654637c16ca tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] [instance: 718ca25b-c73d-4853-b674-fdaf3ed465c7] Deleting instance files /opt/stack/data/nova/instances/718ca25b-c73d-4853-b674-fdaf3ed465c7_del
Nov 15 09:56:13 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-0646b49d-c8fb-47a2-b38c-a654637c16ca tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] [instance: 718ca25b-c73d-4853-b674-fdaf3ed465c7] Deletion of /opt/stack/data/nova/instances/718ca25b-c73d-4853-b674-fdaf3ed465c7_del complete
Nov 15 09:56:13 user nova-compute[75122]: INFO nova.compute.manager [None req-0646b49d-c8fb-47a2-b38c-a654637c16ca tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] [instance: 718ca25b-c73d-4853-b674-fdaf3ed465c7] Took 0.90 seconds to destroy the instance on the hypervisor.
Nov 15 09:56:13 user nova-compute[75122]: DEBUG oslo.service.loopingcall [None req-0646b49d-c8fb-47a2-b38c-a654637c16ca tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75122) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 09:56:13 user nova-compute[75122]: DEBUG nova.compute.manager [-] [instance: 718ca25b-c73d-4853-b674-fdaf3ed465c7] Deallocating network for instance {{(pid=75122) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 09:56:13 user nova-compute[75122]: DEBUG nova.network.neutron [-] [instance: 718ca25b-c73d-4853-b674-fdaf3ed465c7] deallocate_for_instance() {{(pid=75122) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 09:56:13 user nova-compute[75122]: DEBUG nova.network.neutron [-] [instance: 40f792bb-43a9-4011-aaba-f240f64e2757] Updating instance_info_cache with network_info: [] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:56:13 user nova-compute[75122]: INFO nova.compute.manager [-] [instance: 40f792bb-43a9-4011-aaba-f240f64e2757] Took 1.37 seconds to deallocate network for instance.
Nov 15 09:56:13 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-6ae6a8ec-c253-4b81-95f9-0e655b12a5f8 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:56:13 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-6ae6a8ec-c253-4b81-95f9-0e655b12a5f8 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:56:13 user nova-compute[75122]: DEBUG nova.compute.manager [req-7dd18d96-054b-4fa7-9be5-7c082db84ea5 req-e007789d-7ba4-48e6-b2f4-c147bd14ef91 service nova] [instance: 40f792bb-43a9-4011-aaba-f240f64e2757] Received event network-vif-plugged-da514680-136e-49d6-aec0-9d4192081cec {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:56:13 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-7dd18d96-054b-4fa7-9be5-7c082db84ea5 req-e007789d-7ba4-48e6-b2f4-c147bd14ef91 service nova] Acquiring lock "40f792bb-43a9-4011-aaba-f240f64e2757-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:56:13 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-7dd18d96-054b-4fa7-9be5-7c082db84ea5 req-e007789d-7ba4-48e6-b2f4-c147bd14ef91 service nova] Lock "40f792bb-43a9-4011-aaba-f240f64e2757-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:56:13 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-7dd18d96-054b-4fa7-9be5-7c082db84ea5 req-e007789d-7ba4-48e6-b2f4-c147bd14ef91 service nova] Lock "40f792bb-43a9-4011-aaba-f240f64e2757-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:56:13 user nova-compute[75122]: DEBUG nova.compute.manager [req-7dd18d96-054b-4fa7-9be5-7c082db84ea5 req-e007789d-7ba4-48e6-b2f4-c147bd14ef91 service nova] [instance: 40f792bb-43a9-4011-aaba-f240f64e2757] No waiting events found dispatching network-vif-plugged-da514680-136e-49d6-aec0-9d4192081cec {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:56:13 user nova-compute[75122]: WARNING nova.compute.manager [req-7dd18d96-054b-4fa7-9be5-7c082db84ea5 req-e007789d-7ba4-48e6-b2f4-c147bd14ef91 service nova] [instance: 40f792bb-43a9-4011-aaba-f240f64e2757] Received unexpected event network-vif-plugged-da514680-136e-49d6-aec0-9d4192081cec for instance with vm_state deleted and task_state None.
Nov 15 09:56:13 user nova-compute[75122]: DEBUG nova.compute.manager [req-7dd18d96-054b-4fa7-9be5-7c082db84ea5 req-e007789d-7ba4-48e6-b2f4-c147bd14ef91 service nova] [instance: 40f792bb-43a9-4011-aaba-f240f64e2757] Received event network-vif-plugged-da514680-136e-49d6-aec0-9d4192081cec {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:56:13 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-7dd18d96-054b-4fa7-9be5-7c082db84ea5 req-e007789d-7ba4-48e6-b2f4-c147bd14ef91 service nova] Acquiring lock "40f792bb-43a9-4011-aaba-f240f64e2757-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:56:13 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-7dd18d96-054b-4fa7-9be5-7c082db84ea5 req-e007789d-7ba4-48e6-b2f4-c147bd14ef91 service nova] Lock "40f792bb-43a9-4011-aaba-f240f64e2757-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:56:13 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-7dd18d96-054b-4fa7-9be5-7c082db84ea5 req-e007789d-7ba4-48e6-b2f4-c147bd14ef91 service nova] Lock "40f792bb-43a9-4011-aaba-f240f64e2757-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:56:13 user nova-compute[75122]: DEBUG nova.compute.manager [req-7dd18d96-054b-4fa7-9be5-7c082db84ea5 req-e007789d-7ba4-48e6-b2f4-c147bd14ef91 service nova] [instance: 40f792bb-43a9-4011-aaba-f240f64e2757] No waiting events found dispatching network-vif-plugged-da514680-136e-49d6-aec0-9d4192081cec {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:56:13 user nova-compute[75122]: WARNING nova.compute.manager [req-7dd18d96-054b-4fa7-9be5-7c082db84ea5 req-e007789d-7ba4-48e6-b2f4-c147bd14ef91 service nova] [instance: 40f792bb-43a9-4011-aaba-f240f64e2757] Received unexpected event network-vif-plugged-da514680-136e-49d6-aec0-9d4192081cec for instance with vm_state deleted and task_state None.
Nov 15 09:56:13 user nova-compute[75122]: DEBUG nova.compute.manager [req-7dd18d96-054b-4fa7-9be5-7c082db84ea5 req-e007789d-7ba4-48e6-b2f4-c147bd14ef91 service nova] [instance: 40f792bb-43a9-4011-aaba-f240f64e2757] Received event network-vif-plugged-da514680-136e-49d6-aec0-9d4192081cec {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:56:13 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-7dd18d96-054b-4fa7-9be5-7c082db84ea5 req-e007789d-7ba4-48e6-b2f4-c147bd14ef91 service nova] Acquiring lock "40f792bb-43a9-4011-aaba-f240f64e2757-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:56:13 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-7dd18d96-054b-4fa7-9be5-7c082db84ea5 req-e007789d-7ba4-48e6-b2f4-c147bd14ef91 service nova] Lock "40f792bb-43a9-4011-aaba-f240f64e2757-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:56:13 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-7dd18d96-054b-4fa7-9be5-7c082db84ea5 req-e007789d-7ba4-48e6-b2f4-c147bd14ef91 service nova] Lock "40f792bb-43a9-4011-aaba-f240f64e2757-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:56:13 user nova-compute[75122]: DEBUG nova.compute.manager [req-7dd18d96-054b-4fa7-9be5-7c082db84ea5 req-e007789d-7ba4-48e6-b2f4-c147bd14ef91 service nova] [instance: 40f792bb-43a9-4011-aaba-f240f64e2757] No waiting events found dispatching network-vif-plugged-da514680-136e-49d6-aec0-9d4192081cec {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:56:13 user nova-compute[75122]: WARNING nova.compute.manager [req-7dd18d96-054b-4fa7-9be5-7c082db84ea5 req-e007789d-7ba4-48e6-b2f4-c147bd14ef91 service nova] [instance: 40f792bb-43a9-4011-aaba-f240f64e2757] Received unexpected event network-vif-plugged-da514680-136e-49d6-aec0-9d4192081cec for instance with vm_state deleted and task_state None.
Nov 15 09:56:13 user nova-compute[75122]: DEBUG nova.compute.manager [req-7dd18d96-054b-4fa7-9be5-7c082db84ea5 req-e007789d-7ba4-48e6-b2f4-c147bd14ef91 service nova] [instance: 40f792bb-43a9-4011-aaba-f240f64e2757] Received event network-vif-unplugged-da514680-136e-49d6-aec0-9d4192081cec {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:56:13 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-7dd18d96-054b-4fa7-9be5-7c082db84ea5 req-e007789d-7ba4-48e6-b2f4-c147bd14ef91 service nova] Acquiring lock "40f792bb-43a9-4011-aaba-f240f64e2757-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:56:13 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-7dd18d96-054b-4fa7-9be5-7c082db84ea5 req-e007789d-7ba4-48e6-b2f4-c147bd14ef91 service nova] Lock "40f792bb-43a9-4011-aaba-f240f64e2757-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:56:13 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-7dd18d96-054b-4fa7-9be5-7c082db84ea5 req-e007789d-7ba4-48e6-b2f4-c147bd14ef91 service nova] Lock "40f792bb-43a9-4011-aaba-f240f64e2757-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:56:13 user nova-compute[75122]: DEBUG nova.compute.manager [req-7dd18d96-054b-4fa7-9be5-7c082db84ea5 req-e007789d-7ba4-48e6-b2f4-c147bd14ef91 service nova] [instance: 40f792bb-43a9-4011-aaba-f240f64e2757] No waiting events found dispatching network-vif-unplugged-da514680-136e-49d6-aec0-9d4192081cec {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:56:13 user nova-compute[75122]: WARNING nova.compute.manager [req-7dd18d96-054b-4fa7-9be5-7c082db84ea5 req-e007789d-7ba4-48e6-b2f4-c147bd14ef91 service nova] [instance: 40f792bb-43a9-4011-aaba-f240f64e2757] Received unexpected event network-vif-unplugged-da514680-136e-49d6-aec0-9d4192081cec for instance with vm_state deleted and task_state None.
Nov 15 09:56:13 user nova-compute[75122]: DEBUG nova.compute.manager [req-7dd18d96-054b-4fa7-9be5-7c082db84ea5 req-e007789d-7ba4-48e6-b2f4-c147bd14ef91 service nova] [instance: 40f792bb-43a9-4011-aaba-f240f64e2757] Received event network-vif-plugged-da514680-136e-49d6-aec0-9d4192081cec {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:56:13 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-7dd18d96-054b-4fa7-9be5-7c082db84ea5 req-e007789d-7ba4-48e6-b2f4-c147bd14ef91 service nova] Acquiring lock "40f792bb-43a9-4011-aaba-f240f64e2757-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:56:13 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-7dd18d96-054b-4fa7-9be5-7c082db84ea5 req-e007789d-7ba4-48e6-b2f4-c147bd14ef91 service nova] Lock "40f792bb-43a9-4011-aaba-f240f64e2757-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:56:13 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-7dd18d96-054b-4fa7-9be5-7c082db84ea5 req-e007789d-7ba4-48e6-b2f4-c147bd14ef91 service nova] Lock "40f792bb-43a9-4011-aaba-f240f64e2757-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:56:13 user nova-compute[75122]: DEBUG nova.compute.manager [req-7dd18d96-054b-4fa7-9be5-7c082db84ea5 req-e007789d-7ba4-48e6-b2f4-c147bd14ef91 service nova] [instance: 40f792bb-43a9-4011-aaba-f240f64e2757] No waiting events found dispatching network-vif-plugged-da514680-136e-49d6-aec0-9d4192081cec {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:56:13 user nova-compute[75122]: WARNING nova.compute.manager [req-7dd18d96-054b-4fa7-9be5-7c082db84ea5 req-e007789d-7ba4-48e6-b2f4-c147bd14ef91 service nova] [instance: 40f792bb-43a9-4011-aaba-f240f64e2757] Received unexpected event network-vif-plugged-da514680-136e-49d6-aec0-9d4192081cec for instance with vm_state deleted and task_state None.
Nov 15 09:56:13 user nova-compute[75122]: DEBUG nova.compute.manager [req-7dd18d96-054b-4fa7-9be5-7c082db84ea5 req-e007789d-7ba4-48e6-b2f4-c147bd14ef91 service nova] [instance: 718ca25b-c73d-4853-b674-fdaf3ed465c7] Received event network-vif-unplugged-8691c10b-6a01-4e1f-884e-0aa0a4bd39c2 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:56:13 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-7dd18d96-054b-4fa7-9be5-7c082db84ea5 req-e007789d-7ba4-48e6-b2f4-c147bd14ef91 service nova] Acquiring lock "718ca25b-c73d-4853-b674-fdaf3ed465c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:56:13 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-7dd18d96-054b-4fa7-9be5-7c082db84ea5 req-e007789d-7ba4-48e6-b2f4-c147bd14ef91 service nova] Lock "718ca25b-c73d-4853-b674-fdaf3ed465c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:56:13 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-7dd18d96-054b-4fa7-9be5-7c082db84ea5 req-e007789d-7ba4-48e6-b2f4-c147bd14ef91 service nova] Lock "718ca25b-c73d-4853-b674-fdaf3ed465c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:56:13 user nova-compute[75122]: DEBUG nova.compute.manager [req-7dd18d96-054b-4fa7-9be5-7c082db84ea5 req-e007789d-7ba4-48e6-b2f4-c147bd14ef91 service nova] [instance: 718ca25b-c73d-4853-b674-fdaf3ed465c7] No waiting events found dispatching network-vif-unplugged-8691c10b-6a01-4e1f-884e-0aa0a4bd39c2 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:56:13 user nova-compute[75122]: DEBUG nova.compute.manager [req-7dd18d96-054b-4fa7-9be5-7c082db84ea5 req-e007789d-7ba4-48e6-b2f4-c147bd14ef91 service nova] [instance: 718ca25b-c73d-4853-b674-fdaf3ed465c7] Received event network-vif-unplugged-8691c10b-6a01-4e1f-884e-0aa0a4bd39c2 for instance with task_state deleting. {{(pid=75122) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 09:56:13 user nova-compute[75122]: DEBUG nova.compute.manager [req-7dd18d96-054b-4fa7-9be5-7c082db84ea5 req-e007789d-7ba4-48e6-b2f4-c147bd14ef91 service nova] [instance: 40f792bb-43a9-4011-aaba-f240f64e2757] Received event network-vif-deleted-da514680-136e-49d6-aec0-9d4192081cec {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:56:13 user nova-compute[75122]: DEBUG nova.compute.provider_tree [None req-6ae6a8ec-c253-4b81-95f9-0e655b12a5f8 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Inventory has not changed in ProviderTree for provider: 69a3da65-47be-44c6-b67c-c692b58284ef {{(pid=75122) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 09:56:13 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-6ae6a8ec-c253-4b81-95f9-0e655b12a5f8 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Inventory has not changed for provider 69a3da65-47be-44c6-b67c-c692b58284ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 09:56:13 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-6ae6a8ec-c253-4b81-95f9-0e655b12a5f8 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.236s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:56:13 user nova-compute[75122]: INFO nova.scheduler.client.report [None req-6ae6a8ec-c253-4b81-95f9-0e655b12a5f8 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Deleted allocations for instance 40f792bb-43a9-4011-aaba-f240f64e2757
Nov 15 09:56:13 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-6ae6a8ec-c253-4b81-95f9-0e655b12a5f8 tempest-AttachVolumeShelveTestJSON-1659813957 tempest-AttachVolumeShelveTestJSON-1659813957-project-member] Lock "40f792bb-43a9-4011-aaba-f240f64e2757" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.729s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:56:13 user nova-compute[75122]: DEBUG nova.network.neutron [-] [instance: 718ca25b-c73d-4853-b674-fdaf3ed465c7] Updating instance_info_cache with network_info: [] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:56:13 user nova-compute[75122]: INFO nova.compute.manager [-] [instance: 718ca25b-c73d-4853-b674-fdaf3ed465c7] Took 0.69 seconds to deallocate network for instance.
Nov 15 09:56:13 user nova-compute[75122]: DEBUG nova.compute.manager [req-87620b65-06c7-48e3-8d1c-f718a64313b4 req-afb075a0-4024-4980-a20d-a50b8787f285 service nova] [instance: 718ca25b-c73d-4853-b674-fdaf3ed465c7] Received event network-vif-deleted-8691c10b-6a01-4e1f-884e-0aa0a4bd39c2 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:56:13 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0646b49d-c8fb-47a2-b38c-a654637c16ca tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:56:13 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0646b49d-c8fb-47a2-b38c-a654637c16ca tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:56:14 user nova-compute[75122]: DEBUG nova.compute.provider_tree [None req-0646b49d-c8fb-47a2-b38c-a654637c16ca tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] Inventory has not changed in ProviderTree for provider: 69a3da65-47be-44c6-b67c-c692b58284ef {{(pid=75122) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 09:56:14 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-0646b49d-c8fb-47a2-b38c-a654637c16ca tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] Inventory has not changed for provider 69a3da65-47be-44c6-b67c-c692b58284ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 09:56:14 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0646b49d-c8fb-47a2-b38c-a654637c16ca tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.282s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:56:14 user nova-compute[75122]: INFO nova.scheduler.client.report [None req-0646b49d-c8fb-47a2-b38c-a654637c16ca tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] Deleted allocations for instance 718ca25b-c73d-4853-b674-fdaf3ed465c7
Nov 15 09:56:14 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0646b49d-c8fb-47a2-b38c-a654637c16ca tempest-TestServerVolumeAttachmentScenario-1023757833 tempest-TestServerVolumeAttachmentScenario-1023757833-project-member] Lock "718ca25b-c73d-4853-b674-fdaf3ed465c7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.090s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:56:15 user nova-compute[75122]: DEBUG nova.compute.manager [req-7f64f2e8-9b26-4cb5-b191-fd292ad694bc req-df6e1c7e-83b3-4057-af35-5bb944661eac service nova] [instance: 718ca25b-c73d-4853-b674-fdaf3ed465c7] Received event network-vif-plugged-8691c10b-6a01-4e1f-884e-0aa0a4bd39c2 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:56:15 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-7f64f2e8-9b26-4cb5-b191-fd292ad694bc req-df6e1c7e-83b3-4057-af35-5bb944661eac service nova] Acquiring lock "718ca25b-c73d-4853-b674-fdaf3ed465c7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:56:15 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-7f64f2e8-9b26-4cb5-b191-fd292ad694bc req-df6e1c7e-83b3-4057-af35-5bb944661eac service nova] Lock "718ca25b-c73d-4853-b674-fdaf3ed465c7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:56:15 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-7f64f2e8-9b26-4cb5-b191-fd292ad694bc req-df6e1c7e-83b3-4057-af35-5bb944661eac service nova] Lock "718ca25b-c73d-4853-b674-fdaf3ed465c7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:56:15 user nova-compute[75122]: DEBUG nova.compute.manager [req-7f64f2e8-9b26-4cb5-b191-fd292ad694bc req-df6e1c7e-83b3-4057-af35-5bb944661eac service nova] [instance: 718ca25b-c73d-4853-b674-fdaf3ed465c7] No waiting events found dispatching network-vif-plugged-8691c10b-6a01-4e1f-884e-0aa0a4bd39c2 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:56:15 user nova-compute[75122]: WARNING nova.compute.manager [req-7f64f2e8-9b26-4cb5-b191-fd292ad694bc req-df6e1c7e-83b3-4057-af35-5bb944661eac service nova] [instance: 718ca25b-c73d-4853-b674-fdaf3ed465c7] Received unexpected event network-vif-plugged-8691c10b-6a01-4e1f-884e-0aa0a4bd39c2 for instance with vm_state deleted and task_state None.
Nov 15 09:56:18 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:56:22 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:56:27 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:56:30 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:56:30 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Cleaning up deleted instances {{(pid=75122) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 15 09:56:30 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] There are 0 instances to clean {{(pid=75122) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 15 09:56:31 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:56:31 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:56:31 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:56:31 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:56:31 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:56:31 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75122) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 09:56:31 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/001d589e-1bee-42da-8422-233ba796fbab/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:56:31 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/001d589e-1bee-42da-8422-233ba796fbab/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:56:31 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/001d589e-1bee-42da-8422-233ba796fbab/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:56:31 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/001d589e-1bee-42da-8422-233ba796fbab/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:56:31 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be71985e-a370-43d9-adef-afb31d03e2fd/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:56:31 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be71985e-a370-43d9-adef-afb31d03e2fd/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:56:31 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be71985e-a370-43d9-adef-afb31d03e2fd/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:56:32 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be71985e-a370-43d9-adef-afb31d03e2fd/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:56:32 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75122) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 09:56:32 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db848537-676f-464a-806d-febb14d920a6/disk.rescue --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:56:32 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db848537-676f-464a-806d-febb14d920a6/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:56:32 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db848537-676f-464a-806d-febb14d920a6/disk.rescue --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:56:32 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db848537-676f-464a-806d-febb14d920a6/disk.rescue --force-share --output=json" returned: 0 in 0.200s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:56:32 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57dff82c-f7f3-45a7-b645-3cf72a1266ce/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:56:32 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57dff82c-f7f3-45a7-b645-3cf72a1266ce/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:56:32 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57dff82c-f7f3-45a7-b645-3cf72a1266ce/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:56:32 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/57dff82c-f7f3-45a7-b645-3cf72a1266ce/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:56:33 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:56:33 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 09:56:33 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 09:56:33 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Hypervisor/Node resource view: name=user free_ram=8526MB free_disk=25.116592407226562GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75122) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 09:56:33 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:56:33 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:56:33 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance 001d589e-1bee-42da-8422-233ba796fbab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:56:33 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance db848537-676f-464a-806d-febb14d920a6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:56:33 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance be71985e-a370-43d9-adef-afb31d03e2fd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:56:33 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance 57dff82c-f7f3-45a7-b645-3cf72a1266ce actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:56:33 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75122) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 09:56:33 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75122) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 09:56:33 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Refreshing inventories for resource provider 69a3da65-47be-44c6-b67c-c692b58284ef {{(pid=75122) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 15 09:56:33 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Updating ProviderTree inventory for provider 69a3da65-47be-44c6-b67c-c692b58284ef from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 15 09:56:33 user nova-compute[75122]: DEBUG nova.compute.provider_tree [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Updating inventory in ProviderTree for provider 69a3da65-47be-44c6-b67c-c692b58284ef with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 15 09:56:33 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Refreshing aggregate associations for resource provider 69a3da65-47be-44c6-b67c-c692b58284ef, aggregates: None {{(pid=75122) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 15 09:56:33 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Refreshing trait associations for resource provider 69a3da65-47be-44c6-b67c-c692b58284ef, traits: COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_RESCUE_BFV,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE,COMPUTE_NODE,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_ACCELERATORS,HW_CPU_X86_MMX {{(pid=75122) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 15 09:56:33 user nova-compute[75122]: DEBUG nova.compute.provider_tree [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Inventory has not changed in ProviderTree for provider: 69a3da65-47be-44c6-b67c-c692b58284ef {{(pid=75122) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 09:56:33 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Inventory has not changed for provider 69a3da65-47be-44c6-b67c-c692b58284ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 09:56:33 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Compute_service record updated for user:user {{(pid=75122) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 09:56:33 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.454s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:56:33 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:56:35 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:56:35 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Starting heal instance info cache {{(pid=75122) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 09:56:35 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "refresh_cache-db848537-676f-464a-806d-febb14d920a6" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 09:56:35 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquired lock "refresh_cache-db848537-676f-464a-806d-febb14d920a6" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 09:56:35 user nova-compute[75122]: DEBUG nova.network.neutron [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] [instance: db848537-676f-464a-806d-febb14d920a6] Forcefully refreshing network info cache for instance {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 09:56:36 user nova-compute[75122]: DEBUG nova.network.neutron [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] [instance: db848537-676f-464a-806d-febb14d920a6] Updating instance_info_cache with network_info: [{"id": "93bbff2d-1d5c-47db-b436-43796849be51", "address": "fa:16:3e:eb:e9:ca", "network": {"id": "b780d5c1-a549-4b49-a036-5a272697d4b6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-229344021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c046170a2ad44ebba5d2de236d940be0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93bbff2d-1d", "ovs_interfaceid": "93bbff2d-1d5c-47db-b436-43796849be51", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:56:36 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Releasing lock "refresh_cache-db848537-676f-464a-806d-febb14d920a6" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 09:56:36 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] [instance: db848537-676f-464a-806d-febb14d920a6] Updated the network info_cache for instance {{(pid=75122) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 09:56:36 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:56:36 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:56:36 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:56:36 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:56:36 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75122) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 09:56:36 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:56:36 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:56:38 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:56:38 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:56:39 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:56:43 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:56:46 user nova-compute[75122]: INFO nova.compute.manager [None req-1f389f9c-7d13-4495-a164-6699da33dbd1 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: db848537-676f-464a-806d-febb14d920a6] Unrescuing
Nov 15 09:56:46 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-1f389f9c-7d13-4495-a164-6699da33dbd1 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Acquiring lock "refresh_cache-db848537-676f-464a-806d-febb14d920a6" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 09:56:46 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-1f389f9c-7d13-4495-a164-6699da33dbd1 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Acquired lock "refresh_cache-db848537-676f-464a-806d-febb14d920a6" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 09:56:46 user nova-compute[75122]: DEBUG nova.network.neutron [None req-1f389f9c-7d13-4495-a164-6699da33dbd1 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: db848537-676f-464a-806d-febb14d920a6] Building network info cache for instance {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 09:56:47 user nova-compute[75122]: DEBUG nova.network.neutron [None req-1f389f9c-7d13-4495-a164-6699da33dbd1 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: db848537-676f-464a-806d-febb14d920a6] Updating instance_info_cache with network_info: [{"id": "93bbff2d-1d5c-47db-b436-43796849be51", "address": "fa:16:3e:eb:e9:ca", "network": {"id": "b780d5c1-a549-4b49-a036-5a272697d4b6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-229344021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c046170a2ad44ebba5d2de236d940be0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93bbff2d-1d", "ovs_interfaceid": "93bbff2d-1d5c-47db-b436-43796849be51", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:56:47 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-1f389f9c-7d13-4495-a164-6699da33dbd1 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Releasing lock "refresh_cache-db848537-676f-464a-806d-febb14d920a6" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 09:56:47 user nova-compute[75122]: DEBUG nova.objects.instance [None req-1f389f9c-7d13-4495-a164-6699da33dbd1 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Lazy-loading 'flavor' on Instance uuid db848537-676f-464a-806d-febb14d920a6 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:56:47 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:56:47 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:56:47 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:56:47 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:56:47 user nova-compute[75122]: DEBUG nova.compute.manager [req-c36f1bd5-59ab-4602-94c2-87c75584716a req-92536799-b903-4210-9f49-748ddf39f0e0 service nova] [instance: db848537-676f-464a-806d-febb14d920a6] Received event network-vif-unplugged-93bbff2d-1d5c-47db-b436-43796849be51 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:56:47 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-c36f1bd5-59ab-4602-94c2-87c75584716a req-92536799-b903-4210-9f49-748ddf39f0e0 service nova] Acquiring lock "db848537-676f-464a-806d-febb14d920a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:56:47 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-c36f1bd5-59ab-4602-94c2-87c75584716a req-92536799-b903-4210-9f49-748ddf39f0e0 service nova] Lock "db848537-676f-464a-806d-febb14d920a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:56:47 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-c36f1bd5-59ab-4602-94c2-87c75584716a req-92536799-b903-4210-9f49-748ddf39f0e0 service nova] Lock "db848537-676f-464a-806d-febb14d920a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:56:47 user nova-compute[75122]: DEBUG nova.compute.manager [req-c36f1bd5-59ab-4602-94c2-87c75584716a req-92536799-b903-4210-9f49-748ddf39f0e0 service nova] [instance: db848537-676f-464a-806d-febb14d920a6] No waiting events found dispatching network-vif-unplugged-93bbff2d-1d5c-47db-b436-43796849be51 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:56:47 user nova-compute[75122]: WARNING nova.compute.manager [req-c36f1bd5-59ab-4602-94c2-87c75584716a req-92536799-b903-4210-9f49-748ddf39f0e0 service nova] [instance: db848537-676f-464a-806d-febb14d920a6] Received unexpected event network-vif-unplugged-93bbff2d-1d5c-47db-b436-43796849be51 for instance with vm_state rescued and task_state unrescuing.
Nov 15 09:56:48 user nova-compute[75122]: INFO nova.virt.libvirt.driver [-] [instance: db848537-676f-464a-806d-febb14d920a6] Instance destroyed successfully.
Nov 15 09:56:48 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:56:48 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-ee401d22-5592-4ef4-8f21-22116d812d33 tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] Acquiring lock "57dff82c-f7f3-45a7-b645-3cf72a1266ce" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:56:48 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-ee401d22-5592-4ef4-8f21-22116d812d33 tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] Lock "57dff82c-f7f3-45a7-b645-3cf72a1266ce" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:56:48 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-ee401d22-5592-4ef4-8f21-22116d812d33 tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] Acquiring lock "57dff82c-f7f3-45a7-b645-3cf72a1266ce-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:56:48 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-ee401d22-5592-4ef4-8f21-22116d812d33 tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] Lock "57dff82c-f7f3-45a7-b645-3cf72a1266ce-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:56:48 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-ee401d22-5592-4ef4-8f21-22116d812d33 tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] Lock "57dff82c-f7f3-45a7-b645-3cf72a1266ce-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:56:48 user nova-compute[75122]: INFO nova.compute.manager [None req-ee401d22-5592-4ef4-8f21-22116d812d33 tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] [instance: 57dff82c-f7f3-45a7-b645-3cf72a1266ce] Terminating instance
Nov 15 09:56:48 user nova-compute[75122]: DEBUG nova.compute.manager [None req-ee401d22-5592-4ef4-8f21-22116d812d33 tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] [instance: 57dff82c-f7f3-45a7-b645-3cf72a1266ce] Start destroying the instance on the hypervisor. {{(pid=75122) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 09:56:48 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:56:48 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:56:48 user nova-compute[75122]: DEBUG nova.compute.manager [req-f051d0c1-4bfb-4c8b-b556-04a5a4073d29 req-eeb50ccb-3189-4aa1-9e86-6cb717e2c8de service nova] [instance: 57dff82c-f7f3-45a7-b645-3cf72a1266ce] Received event network-vif-unplugged-4fd42a2e-6ccb-4865-8cce-ac346aece548 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:56:48 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-f051d0c1-4bfb-4c8b-b556-04a5a4073d29 req-eeb50ccb-3189-4aa1-9e86-6cb717e2c8de service nova] Acquiring lock "57dff82c-f7f3-45a7-b645-3cf72a1266ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:56:48 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-f051d0c1-4bfb-4c8b-b556-04a5a4073d29 req-eeb50ccb-3189-4aa1-9e86-6cb717e2c8de service nova] Lock "57dff82c-f7f3-45a7-b645-3cf72a1266ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:56:48 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-f051d0c1-4bfb-4c8b-b556-04a5a4073d29 req-eeb50ccb-3189-4aa1-9e86-6cb717e2c8de service nova] Lock "57dff82c-f7f3-45a7-b645-3cf72a1266ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:56:48 user nova-compute[75122]: DEBUG nova.compute.manager [req-f051d0c1-4bfb-4c8b-b556-04a5a4073d29 req-eeb50ccb-3189-4aa1-9e86-6cb717e2c8de service nova] [instance: 57dff82c-f7f3-45a7-b645-3cf72a1266ce] No waiting events found dispatching network-vif-unplugged-4fd42a2e-6ccb-4865-8cce-ac346aece548 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:56:48 user nova-compute[75122]: DEBUG nova.compute.manager [req-f051d0c1-4bfb-4c8b-b556-04a5a4073d29 req-eeb50ccb-3189-4aa1-9e86-6cb717e2c8de service nova] [instance: 57dff82c-f7f3-45a7-b645-3cf72a1266ce] Received event network-vif-unplugged-4fd42a2e-6ccb-4865-8cce-ac346aece548 for instance with task_state deleting. {{(pid=75122) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 09:56:48 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:56:48 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:56:49 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:56:49 user nova-compute[75122]: INFO nova.virt.libvirt.driver [-] [instance: 57dff82c-f7f3-45a7-b645-3cf72a1266ce] Instance destroyed successfully.
Nov 15 09:56:49 user nova-compute[75122]: DEBUG nova.objects.instance [None req-ee401d22-5592-4ef4-8f21-22116d812d33 tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] Lazy-loading 'resources' on Instance uuid 57dff82c-f7f3-45a7-b645-3cf72a1266ce {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:56:49 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-ee401d22-5592-4ef4-8f21-22116d812d33 tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T09:54:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-955762148',display_name='tempest-ServersNegativeTestJSON-server-955762148',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-955762148',id=40,image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T09:55:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='88f16d3dc8434cb5ac78c8d2f51d305b',ramdisk_id='',reservation_id='r-brt029up',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1688784762',owner_user_name='tempest-ServersNegativeTestJSON-1688784762-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T09:55:05Z,user_data=None,user_id='199452e19f8742ea810c917fbfa0581a',uuid=57dff82c-f7f3-45a7-b645-3cf72a1266ce,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4fd42a2e-6ccb-4865-8cce-ac346aece548", "address": "fa:16:3e:68:37:a5", "network": {"id": "ca2dff40-00d3-46b0-b9e2-dca375439496", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1592022235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88f16d3dc8434cb5ac78c8d2f51d305b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fd42a2e-6c", "ovs_interfaceid": "4fd42a2e-6ccb-4865-8cce-ac346aece548", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 09:56:49 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-ee401d22-5592-4ef4-8f21-22116d812d33 tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] Converting VIF {"id": "4fd42a2e-6ccb-4865-8cce-ac346aece548", "address": "fa:16:3e:68:37:a5", "network": {"id": "ca2dff40-00d3-46b0-b9e2-dca375439496", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1592022235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88f16d3dc8434cb5ac78c8d2f51d305b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fd42a2e-6c", "ovs_interfaceid": "4fd42a2e-6ccb-4865-8cce-ac346aece548", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 09:56:49 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-ee401d22-5592-4ef4-8f21-22116d812d33 tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:37:a5,bridge_name='br-int',has_traffic_filtering=True,id=4fd42a2e-6ccb-4865-8cce-ac346aece548,network=Network(ca2dff40-00d3-46b0-b9e2-dca375439496),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fd42a2e-6c') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 09:56:49 user nova-compute[75122]: DEBUG os_vif [None req-ee401d22-5592-4ef4-8f21-22116d812d33 tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:37:a5,bridge_name='br-int',has_traffic_filtering=True,id=4fd42a2e-6ccb-4865-8cce-ac346aece548,network=Network(ca2dff40-00d3-46b0-b9e2-dca375439496),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fd42a2e-6c') {{(pid=75122) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 09:56:49 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:56:49 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4fd42a2e-6c, bridge=br-int, if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:56:49 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:56:49 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:56:49 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:56:49 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=21ad6d80-7ebb-403b-876c-032fabbf9407) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:56:49 user nova-compute[75122]: DEBUG nova.compute.manager [req-79a23e2d-baa4-4355-89df-ad598c044e5d req-a63beb20-e45f-486f-a993-c93a311d5980 service nova] [instance: db848537-676f-464a-806d-febb14d920a6] Received event network-vif-plugged-93bbff2d-1d5c-47db-b436-43796849be51 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:56:49 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-79a23e2d-baa4-4355-89df-ad598c044e5d req-a63beb20-e45f-486f-a993-c93a311d5980 service nova] Acquiring lock "db848537-676f-464a-806d-febb14d920a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:56:49 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-79a23e2d-baa4-4355-89df-ad598c044e5d req-a63beb20-e45f-486f-a993-c93a311d5980 service nova] Lock "db848537-676f-464a-806d-febb14d920a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:56:49 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-79a23e2d-baa4-4355-89df-ad598c044e5d req-a63beb20-e45f-486f-a993-c93a311d5980 service nova] Lock "db848537-676f-464a-806d-febb14d920a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:56:49 user nova-compute[75122]: DEBUG nova.compute.manager [req-79a23e2d-baa4-4355-89df-ad598c044e5d req-a63beb20-e45f-486f-a993-c93a311d5980 service nova] [instance: db848537-676f-464a-806d-febb14d920a6] No waiting events found dispatching network-vif-plugged-93bbff2d-1d5c-47db-b436-43796849be51 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:56:49 user nova-compute[75122]: WARNING nova.compute.manager [req-79a23e2d-baa4-4355-89df-ad598c044e5d req-a63beb20-e45f-486f-a993-c93a311d5980 service nova] [instance: db848537-676f-464a-806d-febb14d920a6] Received unexpected event network-vif-plugged-93bbff2d-1d5c-47db-b436-43796849be51 for instance with vm_state rescued and task_state unrescuing.
Nov 15 09:56:49 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:56:49 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:56:49 user nova-compute[75122]: INFO os_vif [None req-ee401d22-5592-4ef4-8f21-22116d812d33 tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:37:a5,bridge_name='br-int',has_traffic_filtering=True,id=4fd42a2e-6ccb-4865-8cce-ac346aece548,network=Network(ca2dff40-00d3-46b0-b9e2-dca375439496),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fd42a2e-6c')
Nov 15 09:56:49 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-ee401d22-5592-4ef4-8f21-22116d812d33 tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] [instance: 57dff82c-f7f3-45a7-b645-3cf72a1266ce] Deleting instance files /opt/stack/data/nova/instances/57dff82c-f7f3-45a7-b645-3cf72a1266ce_del
Nov 15 09:56:49 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-ee401d22-5592-4ef4-8f21-22116d812d33 tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] [instance: 57dff82c-f7f3-45a7-b645-3cf72a1266ce] Deletion of /opt/stack/data/nova/instances/57dff82c-f7f3-45a7-b645-3cf72a1266ce_del complete
Nov 15 09:56:49 user nova-compute[75122]: INFO nova.compute.manager [None req-ee401d22-5592-4ef4-8f21-22116d812d33 tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] [instance: 57dff82c-f7f3-45a7-b645-3cf72a1266ce] Took 1.29 seconds to destroy the instance on the hypervisor.
Nov 15 09:56:49 user nova-compute[75122]: DEBUG oslo.service.loopingcall [None req-ee401d22-5592-4ef4-8f21-22116d812d33 tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75122) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 09:56:49 user nova-compute[75122]: DEBUG nova.compute.manager [-] [instance: 57dff82c-f7f3-45a7-b645-3cf72a1266ce] Deallocating network for instance {{(pid=75122) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 09:56:49 user nova-compute[75122]: DEBUG nova.network.neutron [-] [instance: 57dff82c-f7f3-45a7-b645-3cf72a1266ce] deallocate_for_instance() {{(pid=75122) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 09:56:50 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:56:50 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:56:50 user nova-compute[75122]: DEBUG nova.network.neutron [-] [instance: 57dff82c-f7f3-45a7-b645-3cf72a1266ce] Updating instance_info_cache with network_info: [] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:56:50 user nova-compute[75122]: INFO nova.compute.manager [-] [instance: 57dff82c-f7f3-45a7-b645-3cf72a1266ce] Took 0.40 seconds to deallocate network for instance.
Nov 15 09:56:50 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-ee401d22-5592-4ef4-8f21-22116d812d33 tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:56:50 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-ee401d22-5592-4ef4-8f21-22116d812d33 tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:56:50 user nova-compute[75122]: DEBUG nova.compute.provider_tree [None req-ee401d22-5592-4ef4-8f21-22116d812d33 tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] Inventory has not changed in ProviderTree for provider: 69a3da65-47be-44c6-b67c-c692b58284ef {{(pid=75122) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 09:56:50 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-ee401d22-5592-4ef4-8f21-22116d812d33 tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] Inventory has not changed for provider 69a3da65-47be-44c6-b67c-c692b58284ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 09:56:50 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-ee401d22-5592-4ef4-8f21-22116d812d33 tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.193s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:56:50 user nova-compute[75122]: INFO nova.scheduler.client.report [None req-ee401d22-5592-4ef4-8f21-22116d812d33 tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] Deleted allocations for instance 57dff82c-f7f3-45a7-b645-3cf72a1266ce
Nov 15 09:56:50 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-ee401d22-5592-4ef4-8f21-22116d812d33 tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] Lock "57dff82c-f7f3-45a7-b645-3cf72a1266ce" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.049s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:56:50 user nova-compute[75122]: DEBUG nova.compute.manager [req-cab6c703-eb97-4aa0-a296-be570cdf2367 req-86a0d317-c71a-44bf-bd92-893d314cdf8d service nova] [instance: 57dff82c-f7f3-45a7-b645-3cf72a1266ce] Received event network-vif-plugged-4fd42a2e-6ccb-4865-8cce-ac346aece548 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:56:50 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-cab6c703-eb97-4aa0-a296-be570cdf2367 req-86a0d317-c71a-44bf-bd92-893d314cdf8d service nova] Acquiring lock "57dff82c-f7f3-45a7-b645-3cf72a1266ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:56:50 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-cab6c703-eb97-4aa0-a296-be570cdf2367 req-86a0d317-c71a-44bf-bd92-893d314cdf8d service nova] Lock "57dff82c-f7f3-45a7-b645-3cf72a1266ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:56:50 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-cab6c703-eb97-4aa0-a296-be570cdf2367 req-86a0d317-c71a-44bf-bd92-893d314cdf8d service nova] Lock "57dff82c-f7f3-45a7-b645-3cf72a1266ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:56:50 user nova-compute[75122]: DEBUG nova.compute.manager [req-cab6c703-eb97-4aa0-a296-be570cdf2367 req-86a0d317-c71a-44bf-bd92-893d314cdf8d service nova] [instance: 57dff82c-f7f3-45a7-b645-3cf72a1266ce] No waiting events found dispatching network-vif-plugged-4fd42a2e-6ccb-4865-8cce-ac346aece548 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:56:50 user nova-compute[75122]: WARNING nova.compute.manager [req-cab6c703-eb97-4aa0-a296-be570cdf2367 req-86a0d317-c71a-44bf-bd92-893d314cdf8d service nova] [instance: 57dff82c-f7f3-45a7-b645-3cf72a1266ce] Received unexpected event network-vif-plugged-4fd42a2e-6ccb-4865-8cce-ac346aece548 for instance with vm_state deleted and task_state None.
Nov 15 09:56:50 user nova-compute[75122]: DEBUG nova.compute.manager [req-cab6c703-eb97-4aa0-a296-be570cdf2367 req-86a0d317-c71a-44bf-bd92-893d314cdf8d service nova] [instance: 57dff82c-f7f3-45a7-b645-3cf72a1266ce] Received event network-vif-deleted-4fd42a2e-6ccb-4865-8cce-ac346aece548 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:56:51 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:56:51 user nova-compute[75122]: DEBUG nova.compute.manager [None req-1f389f9c-7d13-4495-a164-6699da33dbd1 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: db848537-676f-464a-806d-febb14d920a6] Checking state {{(pid=75122) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 09:56:51 user nova-compute[75122]: DEBUG nova.compute.manager [req-bfac580d-b52d-499b-9dbf-b1845bec7b24 req-f84eb2ff-0bb6-4501-8596-47be2bc7ee6c service nova] [instance: db848537-676f-464a-806d-febb14d920a6] Received event network-vif-plugged-93bbff2d-1d5c-47db-b436-43796849be51 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:56:51 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-bfac580d-b52d-499b-9dbf-b1845bec7b24 req-f84eb2ff-0bb6-4501-8596-47be2bc7ee6c service nova] Acquiring lock "db848537-676f-464a-806d-febb14d920a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:56:51 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-bfac580d-b52d-499b-9dbf-b1845bec7b24 req-f84eb2ff-0bb6-4501-8596-47be2bc7ee6c service nova] Lock "db848537-676f-464a-806d-febb14d920a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:56:51 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-bfac580d-b52d-499b-9dbf-b1845bec7b24 req-f84eb2ff-0bb6-4501-8596-47be2bc7ee6c service nova] Lock "db848537-676f-464a-806d-febb14d920a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:56:51 user nova-compute[75122]: DEBUG nova.compute.manager [req-bfac580d-b52d-499b-9dbf-b1845bec7b24 req-f84eb2ff-0bb6-4501-8596-47be2bc7ee6c service nova] [instance: db848537-676f-464a-806d-febb14d920a6] No waiting events found dispatching network-vif-plugged-93bbff2d-1d5c-47db-b436-43796849be51 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:56:51 user nova-compute[75122]: WARNING nova.compute.manager [req-bfac580d-b52d-499b-9dbf-b1845bec7b24 req-f84eb2ff-0bb6-4501-8596-47be2bc7ee6c service nova] [instance: db848537-676f-464a-806d-febb14d920a6] Received unexpected event network-vif-plugged-93bbff2d-1d5c-47db-b436-43796849be51 for instance with vm_state rescued and task_state unrescuing.
Nov 15 09:56:51 user nova-compute[75122]: DEBUG nova.compute.manager [req-bfac580d-b52d-499b-9dbf-b1845bec7b24 req-f84eb2ff-0bb6-4501-8596-47be2bc7ee6c service nova] [instance: db848537-676f-464a-806d-febb14d920a6] Received event network-vif-plugged-93bbff2d-1d5c-47db-b436-43796849be51 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:56:51 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-bfac580d-b52d-499b-9dbf-b1845bec7b24 req-f84eb2ff-0bb6-4501-8596-47be2bc7ee6c service nova] Acquiring lock "db848537-676f-464a-806d-febb14d920a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:56:51 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-bfac580d-b52d-499b-9dbf-b1845bec7b24 req-f84eb2ff-0bb6-4501-8596-47be2bc7ee6c service nova] Lock "db848537-676f-464a-806d-febb14d920a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:56:51 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-bfac580d-b52d-499b-9dbf-b1845bec7b24 req-f84eb2ff-0bb6-4501-8596-47be2bc7ee6c service nova] Lock "db848537-676f-464a-806d-febb14d920a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:56:51 user nova-compute[75122]: DEBUG nova.compute.manager [req-bfac580d-b52d-499b-9dbf-b1845bec7b24 req-f84eb2ff-0bb6-4501-8596-47be2bc7ee6c service nova] [instance: db848537-676f-464a-806d-febb14d920a6] No waiting events found dispatching network-vif-plugged-93bbff2d-1d5c-47db-b436-43796849be51 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:56:51 user nova-compute[75122]: WARNING nova.compute.manager [req-bfac580d-b52d-499b-9dbf-b1845bec7b24 req-f84eb2ff-0bb6-4501-8596-47be2bc7ee6c service nova] [instance: db848537-676f-464a-806d-febb14d920a6] Received unexpected event network-vif-plugged-93bbff2d-1d5c-47db-b436-43796849be51 for instance with vm_state rescued and task_state unrescuing.
Nov 15 09:56:52 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:56:52 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75122) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 15 09:56:54 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:56:59 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:57:04 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:57:09 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:57:09 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:57:09 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:57:11 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:57:14 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:57:14 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:57:15 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:57:16 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:57:17 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:57:19 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:57:20 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-8d5ca216-6e28-48ad-a0f0-352a988c72f7 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Acquiring lock "9ad77a91-bc65-44a8-8ced-fd2ad9237946" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:57:20 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-8d5ca216-6e28-48ad-a0f0-352a988c72f7 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Lock "9ad77a91-bc65-44a8-8ced-fd2ad9237946" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:57:20 user nova-compute[75122]: DEBUG nova.compute.manager [None req-8d5ca216-6e28-48ad-a0f0-352a988c72f7 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] [instance: 9ad77a91-bc65-44a8-8ced-fd2ad9237946] Starting instance... {{(pid=75122) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 09:57:20 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-8d5ca216-6e28-48ad-a0f0-352a988c72f7 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:57:20 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-8d5ca216-6e28-48ad-a0f0-352a988c72f7 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:57:20 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-8d5ca216-6e28-48ad-a0f0-352a988c72f7 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75122) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 09:57:20 user nova-compute[75122]: INFO nova.compute.claims [None req-8d5ca216-6e28-48ad-a0f0-352a988c72f7 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] [instance: 9ad77a91-bc65-44a8-8ced-fd2ad9237946] Claim successful on node user
Nov 15 09:57:20 user nova-compute[75122]: DEBUG nova.compute.provider_tree [None req-8d5ca216-6e28-48ad-a0f0-352a988c72f7 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Inventory has not changed in ProviderTree for provider: 69a3da65-47be-44c6-b67c-c692b58284ef {{(pid=75122) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 09:57:20 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-8d5ca216-6e28-48ad-a0f0-352a988c72f7 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Inventory has not changed for provider 69a3da65-47be-44c6-b67c-c692b58284ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 09:57:20 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-8d5ca216-6e28-48ad-a0f0-352a988c72f7 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.275s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:57:20 user nova-compute[75122]: DEBUG nova.compute.manager [None req-8d5ca216-6e28-48ad-a0f0-352a988c72f7 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] [instance: 9ad77a91-bc65-44a8-8ced-fd2ad9237946] Start building networks asynchronously for instance. {{(pid=75122) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 09:57:20 user nova-compute[75122]: DEBUG nova.compute.manager [None req-8d5ca216-6e28-48ad-a0f0-352a988c72f7 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] [instance: 9ad77a91-bc65-44a8-8ced-fd2ad9237946] Allocating IP information in the background. {{(pid=75122) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 09:57:20 user nova-compute[75122]: DEBUG nova.network.neutron [None req-8d5ca216-6e28-48ad-a0f0-352a988c72f7 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] [instance: 9ad77a91-bc65-44a8-8ced-fd2ad9237946] allocate_for_instance() {{(pid=75122) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 09:57:20 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-8d5ca216-6e28-48ad-a0f0-352a988c72f7 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] [instance: 9ad77a91-bc65-44a8-8ced-fd2ad9237946] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 09:57:20 user nova-compute[75122]: DEBUG nova.compute.manager [None req-8d5ca216-6e28-48ad-a0f0-352a988c72f7 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] [instance: 9ad77a91-bc65-44a8-8ced-fd2ad9237946] Start building block device mappings for instance. {{(pid=75122) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 09:57:20 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:57:20 user nova-compute[75122]: DEBUG nova.policy [None req-8d5ca216-6e28-48ad-a0f0-352a988c72f7 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f18eb706375c4b2e9e7de793cd2950ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab6afbe7809a4ad3921cbc18145d1816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75122) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 09:57:20 user nova-compute[75122]: DEBUG nova.compute.manager [None req-8d5ca216-6e28-48ad-a0f0-352a988c72f7 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] [instance: 9ad77a91-bc65-44a8-8ced-fd2ad9237946] Start spawning the instance on the hypervisor. {{(pid=75122) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 09:57:20 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-8d5ca216-6e28-48ad-a0f0-352a988c72f7 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] [instance: 9ad77a91-bc65-44a8-8ced-fd2ad9237946] Creating instance directory {{(pid=75122) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 09:57:20 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-8d5ca216-6e28-48ad-a0f0-352a988c72f7 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] [instance: 9ad77a91-bc65-44a8-8ced-fd2ad9237946] Creating image(s)
Nov 15 09:57:20 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-8d5ca216-6e28-48ad-a0f0-352a988c72f7 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Acquiring lock "/opt/stack/data/nova/instances/9ad77a91-bc65-44a8-8ced-fd2ad9237946/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:57:20 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-8d5ca216-6e28-48ad-a0f0-352a988c72f7 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Lock "/opt/stack/data/nova/instances/9ad77a91-bc65-44a8-8ced-fd2ad9237946/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:57:20 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-8d5ca216-6e28-48ad-a0f0-352a988c72f7 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Lock "/opt/stack/data/nova/instances/9ad77a91-bc65-44a8-8ced-fd2ad9237946/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:57:20 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-8d5ca216-6e28-48ad-a0f0-352a988c72f7 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:57:21 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-8d5ca216-6e28-48ad-a0f0-352a988c72f7 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json" returned: 0 in 0.181s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:57:21 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-8d5ca216-6e28-48ad-a0f0-352a988c72f7 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Acquiring lock "95d6e29f74d5408f818e32f3bc29bc8270a4c665" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:57:21 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-8d5ca216-6e28-48ad-a0f0-352a988c72f7 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Lock "95d6e29f74d5408f818e32f3bc29bc8270a4c665" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:57:21 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-8d5ca216-6e28-48ad-a0f0-352a988c72f7 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:57:21 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-8d5ca216-6e28-48ad-a0f0-352a988c72f7 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json" returned: 0 in 0.186s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:57:21 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-8d5ca216-6e28-48ad-a0f0-352a988c72f7 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665,backing_fmt=raw /opt/stack/data/nova/instances/9ad77a91-bc65-44a8-8ced-fd2ad9237946/disk 1073741824 {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:57:21 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-8d5ca216-6e28-48ad-a0f0-352a988c72f7 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665,backing_fmt=raw /opt/stack/data/nova/instances/9ad77a91-bc65-44a8-8ced-fd2ad9237946/disk 1073741824" returned: 0 in 0.047s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:57:21 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-8d5ca216-6e28-48ad-a0f0-352a988c72f7 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Lock "95d6e29f74d5408f818e32f3bc29bc8270a4c665" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.239s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:57:21 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-8d5ca216-6e28-48ad-a0f0-352a988c72f7 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:57:21 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-8d5ca216-6e28-48ad-a0f0-352a988c72f7 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json" returned: 0 in 0.168s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:57:21 user nova-compute[75122]: DEBUG nova.virt.disk.api [None req-8d5ca216-6e28-48ad-a0f0-352a988c72f7 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9ad77a91-bc65-44a8-8ced-fd2ad9237946/disk. size=1073741824 {{(pid=75122) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 09:57:21 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-8d5ca216-6e28-48ad-a0f0-352a988c72f7 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ad77a91-bc65-44a8-8ced-fd2ad9237946/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:57:21 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:57:21 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-8d5ca216-6e28-48ad-a0f0-352a988c72f7 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ad77a91-bc65-44a8-8ced-fd2ad9237946/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:57:21 user nova-compute[75122]: DEBUG nova.virt.disk.api [None req-8d5ca216-6e28-48ad-a0f0-352a988c72f7 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Cannot resize image /opt/stack/data/nova/instances/9ad77a91-bc65-44a8-8ced-fd2ad9237946/disk to a smaller size. {{(pid=75122) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 09:57:21 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-8d5ca216-6e28-48ad-a0f0-352a988c72f7 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] [instance: 9ad77a91-bc65-44a8-8ced-fd2ad9237946] Created local disks {{(pid=75122) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 09:57:21 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-8d5ca216-6e28-48ad-a0f0-352a988c72f7 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] [instance: 9ad77a91-bc65-44a8-8ced-fd2ad9237946] Ensure instance console log exists: /opt/stack/data/nova/instances/9ad77a91-bc65-44a8-8ced-fd2ad9237946/console.log {{(pid=75122) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 09:57:21 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-8d5ca216-6e28-48ad-a0f0-352a988c72f7 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:57:21 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-8d5ca216-6e28-48ad-a0f0-352a988c72f7 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:57:21 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-8d5ca216-6e28-48ad-a0f0-352a988c72f7 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:57:22 user nova-compute[75122]: DEBUG nova.network.neutron [None req-8d5ca216-6e28-48ad-a0f0-352a988c72f7 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] [instance: 9ad77a91-bc65-44a8-8ced-fd2ad9237946] Successfully created port: e348b3b5-1fc0-4c27-98e7-41a152a67610 {{(pid=75122) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 09:57:23 user nova-compute[75122]: DEBUG nova.network.neutron [None req-8d5ca216-6e28-48ad-a0f0-352a988c72f7 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] [instance: 9ad77a91-bc65-44a8-8ced-fd2ad9237946] Successfully updated port: e348b3b5-1fc0-4c27-98e7-41a152a67610 {{(pid=75122) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 09:57:23 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-8d5ca216-6e28-48ad-a0f0-352a988c72f7 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Acquiring lock "refresh_cache-9ad77a91-bc65-44a8-8ced-fd2ad9237946" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 09:57:23 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-8d5ca216-6e28-48ad-a0f0-352a988c72f7 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Acquired lock "refresh_cache-9ad77a91-bc65-44a8-8ced-fd2ad9237946" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 09:57:23 user nova-compute[75122]: DEBUG nova.network.neutron [None req-8d5ca216-6e28-48ad-a0f0-352a988c72f7 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] [instance: 9ad77a91-bc65-44a8-8ced-fd2ad9237946] Building network info cache for instance {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 09:57:23 user nova-compute[75122]: DEBUG nova.compute.manager [req-701141e2-559a-4ee3-8954-aa0f4a93d348 req-ebc0dee1-e187-475e-8b42-19397bfd220c service nova] [instance: 9ad77a91-bc65-44a8-8ced-fd2ad9237946] Received event network-changed-e348b3b5-1fc0-4c27-98e7-41a152a67610 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:57:23 user nova-compute[75122]: DEBUG nova.compute.manager [req-701141e2-559a-4ee3-8954-aa0f4a93d348 req-ebc0dee1-e187-475e-8b42-19397bfd220c service nova] [instance: 9ad77a91-bc65-44a8-8ced-fd2ad9237946] Refreshing instance network info cache due to event network-changed-e348b3b5-1fc0-4c27-98e7-41a152a67610. {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 09:57:23 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-701141e2-559a-4ee3-8954-aa0f4a93d348 req-ebc0dee1-e187-475e-8b42-19397bfd220c service nova] Acquiring lock "refresh_cache-9ad77a91-bc65-44a8-8ced-fd2ad9237946" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 09:57:23 user nova-compute[75122]: DEBUG nova.network.neutron [None req-8d5ca216-6e28-48ad-a0f0-352a988c72f7 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] [instance: 9ad77a91-bc65-44a8-8ced-fd2ad9237946] Instance cache missing network info. {{(pid=75122) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 09:57:23 user nova-compute[75122]: DEBUG nova.network.neutron [None req-8d5ca216-6e28-48ad-a0f0-352a988c72f7 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] [instance: 9ad77a91-bc65-44a8-8ced-fd2ad9237946] Updating instance_info_cache with network_info: [{"id": "e348b3b5-1fc0-4c27-98e7-41a152a67610", "address": "fa:16:3e:d3:b1:38", "network": {"id": "8c1491a5-d5c6-4a22-84fd-bdeca00bbaad", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1848328203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab6afbe7809a4ad3921cbc18145d1816", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape348b3b5-1f", "ovs_interfaceid": "e348b3b5-1fc0-4c27-98e7-41a152a67610", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:57:23 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-8d5ca216-6e28-48ad-a0f0-352a988c72f7 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Releasing lock "refresh_cache-9ad77a91-bc65-44a8-8ced-fd2ad9237946" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 09:57:23 user nova-compute[75122]: DEBUG nova.compute.manager [None req-8d5ca216-6e28-48ad-a0f0-352a988c72f7 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] [instance: 9ad77a91-bc65-44a8-8ced-fd2ad9237946] Instance network_info: |[{"id": "e348b3b5-1fc0-4c27-98e7-41a152a67610", "address": "fa:16:3e:d3:b1:38", "network": {"id": "8c1491a5-d5c6-4a22-84fd-bdeca00bbaad", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1848328203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab6afbe7809a4ad3921cbc18145d1816", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape348b3b5-1f", "ovs_interfaceid": "e348b3b5-1fc0-4c27-98e7-41a152a67610", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75122) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 09:57:23 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-701141e2-559a-4ee3-8954-aa0f4a93d348 req-ebc0dee1-e187-475e-8b42-19397bfd220c service nova] Acquired lock "refresh_cache-9ad77a91-bc65-44a8-8ced-fd2ad9237946" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 09:57:23 user nova-compute[75122]: DEBUG nova.network.neutron [req-701141e2-559a-4ee3-8954-aa0f4a93d348 req-ebc0dee1-e187-475e-8b42-19397bfd220c service nova] [instance: 9ad77a91-bc65-44a8-8ced-fd2ad9237946] Refreshing network info cache for port e348b3b5-1fc0-4c27-98e7-41a152a67610 {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 09:57:23 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-8d5ca216-6e28-48ad-a0f0-352a988c72f7 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] [instance: 9ad77a91-bc65-44a8-8ced-fd2ad9237946] Start _get_guest_xml network_info=[{"id": "e348b3b5-1fc0-4c27-98e7-41a152a67610", "address": "fa:16:3e:d3:b1:38", "network": {"id": "8c1491a5-d5c6-4a22-84fd-bdeca00bbaad", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1848328203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab6afbe7809a4ad3921cbc18145d1816", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape348b3b5-1f", "ovs_interfaceid": "e348b3b5-1fc0-4c27-98e7-41a152a67610", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T09:26:31Z,direct_url=<?>,disk_format='qcow2',id=5e862cfe-47b8-4725-8292-65761ee6d0f5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9c57733cb41847c0b4ad31519c382e5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T09:26:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '5e862cfe-47b8-4725-8292-65761ee6d0f5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75122) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 09:57:23 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-8d5ca216-6e28-48ad-a0f0-352a988c72f7 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 09:57:23 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-8d5ca216-6e28-48ad-a0f0-352a988c72f7 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 09:57:23 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-8d5ca216-6e28-48ad-a0f0-352a988c72f7 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75122) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 09:57:23 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-8d5ca216-6e28-48ad-a0f0-352a988c72f7 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] CPU controller missing on host. {{(pid=75122) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 09:57:23 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-8d5ca216-6e28-48ad-a0f0-352a988c72f7 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75122) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 09:57:23 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-8d5ca216-6e28-48ad-a0f0-352a988c72f7 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] CPU controller found on host. {{(pid=75122) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 09:57:23 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-8d5ca216-6e28-48ad-a0f0-352a988c72f7 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75122) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 09:57:23 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-8d5ca216-6e28-48ad-a0f0-352a988c72f7 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T09:26:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T09:26:31Z,direct_url=<?>,disk_format='qcow2',id=5e862cfe-47b8-4725-8292-65761ee6d0f5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9c57733cb41847c0b4ad31519c382e5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T09:26:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 09:57:23 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-8d5ca216-6e28-48ad-a0f0-352a988c72f7 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Flavor limits 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 09:57:23 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-8d5ca216-6e28-48ad-a0f0-352a988c72f7 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Image limits 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 09:57:23 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-8d5ca216-6e28-48ad-a0f0-352a988c72f7 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Flavor pref 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 09:57:23 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-8d5ca216-6e28-48ad-a0f0-352a988c72f7 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Image pref 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 09:57:23 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-8d5ca216-6e28-48ad-a0f0-352a988c72f7 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 09:57:23 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-8d5ca216-6e28-48ad-a0f0-352a988c72f7 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 09:57:23 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-8d5ca216-6e28-48ad-a0f0-352a988c72f7 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75122) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 09:57:23 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-8d5ca216-6e28-48ad-a0f0-352a988c72f7 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Got 1 possible topologies {{(pid=75122) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 09:57:23 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-8d5ca216-6e28-48ad-a0f0-352a988c72f7 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 09:57:23 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-8d5ca216-6e28-48ad-a0f0-352a988c72f7 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 09:57:23 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-8d5ca216-6e28-48ad-a0f0-352a988c72f7 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T09:57:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-803179351',display_name='tempest-AttachVolumeTestJSON-server-803179351',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-803179351',id=41,image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOazdcLoty/Tvb58dOdgjYRlbmZHLxyOye3e81xDJ6xblOKkjaBcaTxCMTaYL2kE3EQ/2KT89+o54kjCi92RXyGz9Fa5Z/xA8RuG+orKH3o1/047NRIGM2FIaGKSP1LaWg==',key_name='tempest-keypair-269122459',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ab6afbe7809a4ad3921cbc18145d1816',ramdisk_id='',reservation_id='r-3ag6vy4w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-970815916',owner_user_name='tempest-AttachVolumeTestJSON-970815916-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T09:57:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f18eb706375c4b2e9e7de793cd2950ad',uuid=9ad77a91-bc65-44a8-8ced-fd2ad9237946,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e348b3b5-1fc0-4c27-98e7-41a152a67610", "address": "fa:16:3e:d3:b1:38", "network": {"id": "8c1491a5-d5c6-4a22-84fd-bdeca00bbaad", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1848328203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab6afbe7809a4ad3921cbc18145d1816", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape348b3b5-1f", "ovs_interfaceid": "e348b3b5-1fc0-4c27-98e7-41a152a67610", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75122) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 09:57:23 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-8d5ca216-6e28-48ad-a0f0-352a988c72f7 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Converting VIF {"id": "e348b3b5-1fc0-4c27-98e7-41a152a67610", "address": "fa:16:3e:d3:b1:38", "network": {"id": "8c1491a5-d5c6-4a22-84fd-bdeca00bbaad", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1848328203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab6afbe7809a4ad3921cbc18145d1816", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape348b3b5-1f", "ovs_interfaceid": "e348b3b5-1fc0-4c27-98e7-41a152a67610", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 09:57:23 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-8d5ca216-6e28-48ad-a0f0-352a988c72f7 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:b1:38,bridge_name='br-int',has_traffic_filtering=True,id=e348b3b5-1fc0-4c27-98e7-41a152a67610,network=Network(8c1491a5-d5c6-4a22-84fd-bdeca00bbaad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape348b3b5-1f') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 09:57:23 user nova-compute[75122]: DEBUG nova.objects.instance [None req-8d5ca216-6e28-48ad-a0f0-352a988c72f7 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Lazy-loading 'pci_devices' on Instance uuid 9ad77a91-bc65-44a8-8ced-fd2ad9237946 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:57:23 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-8d5ca216-6e28-48ad-a0f0-352a988c72f7 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] [instance: 9ad77a91-bc65-44a8-8ced-fd2ad9237946] End _get_guest_xml xml=<domain type="kvm">
Nov 15 09:57:23 user nova-compute[75122]:   <uuid>9ad77a91-bc65-44a8-8ced-fd2ad9237946</uuid>
Nov 15 09:57:23 user nova-compute[75122]:   <name>instance-00000029</name>
Nov 15 09:57:23 user nova-compute[75122]:   <memory>524288</memory>
Nov 15 09:57:23 user nova-compute[75122]:   <vcpu>1</vcpu>
Nov 15 09:57:23 user nova-compute[75122]:   <metadata>
Nov 15 09:57:23 user nova-compute[75122]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 09:57:23 user nova-compute[75122]:       <nova:package version="0.0.0"/>
Nov 15 09:57:23 user nova-compute[75122]:       <nova:name>tempest-AttachVolumeTestJSON-server-803179351</nova:name>
Nov 15 09:57:23 user nova-compute[75122]:       <nova:creationTime>2023-11-15 09:57:23</nova:creationTime>
Nov 15 09:57:23 user nova-compute[75122]:       <nova:flavor name="m1.tiny">
Nov 15 09:57:23 user nova-compute[75122]:         <nova:memory>512</nova:memory>
Nov 15 09:57:23 user nova-compute[75122]:         <nova:disk>1</nova:disk>
Nov 15 09:57:23 user nova-compute[75122]:         <nova:swap>0</nova:swap>
Nov 15 09:57:23 user nova-compute[75122]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 09:57:23 user nova-compute[75122]:         <nova:vcpus>1</nova:vcpus>
Nov 15 09:57:23 user nova-compute[75122]:       </nova:flavor>
Nov 15 09:57:23 user nova-compute[75122]:       <nova:owner>
Nov 15 09:57:23 user nova-compute[75122]:         <nova:user uuid="f18eb706375c4b2e9e7de793cd2950ad">tempest-AttachVolumeTestJSON-970815916-project-member</nova:user>
Nov 15 09:57:23 user nova-compute[75122]:         <nova:project uuid="ab6afbe7809a4ad3921cbc18145d1816">tempest-AttachVolumeTestJSON-970815916</nova:project>
Nov 15 09:57:23 user nova-compute[75122]:       </nova:owner>
Nov 15 09:57:23 user nova-compute[75122]:       <nova:root type="image" uuid="5e862cfe-47b8-4725-8292-65761ee6d0f5"/>
Nov 15 09:57:23 user nova-compute[75122]:       <nova:ports>
Nov 15 09:57:23 user nova-compute[75122]:         <nova:port uuid="e348b3b5-1fc0-4c27-98e7-41a152a67610">
Nov 15 09:57:23 user nova-compute[75122]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 15 09:57:23 user nova-compute[75122]:         </nova:port>
Nov 15 09:57:23 user nova-compute[75122]:       </nova:ports>
Nov 15 09:57:23 user nova-compute[75122]:     </nova:instance>
Nov 15 09:57:23 user nova-compute[75122]:   </metadata>
Nov 15 09:57:23 user nova-compute[75122]:   <sysinfo type="smbios">
Nov 15 09:57:23 user nova-compute[75122]:     <system>
Nov 15 09:57:23 user nova-compute[75122]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 09:57:23 user nova-compute[75122]:       <entry name="product">OpenStack Nova</entry>
Nov 15 09:57:23 user nova-compute[75122]:       <entry name="version">0.0.0</entry>
Nov 15 09:57:23 user nova-compute[75122]:       <entry name="serial">9ad77a91-bc65-44a8-8ced-fd2ad9237946</entry>
Nov 15 09:57:23 user nova-compute[75122]:       <entry name="uuid">9ad77a91-bc65-44a8-8ced-fd2ad9237946</entry>
Nov 15 09:57:23 user nova-compute[75122]:       <entry name="family">Virtual Machine</entry>
Nov 15 09:57:23 user nova-compute[75122]:     </system>
Nov 15 09:57:23 user nova-compute[75122]:   </sysinfo>
Nov 15 09:57:23 user nova-compute[75122]:   <os>
Nov 15 09:57:23 user nova-compute[75122]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 09:57:23 user nova-compute[75122]:     <boot dev="hd"/>
Nov 15 09:57:23 user nova-compute[75122]:     <smbios mode="sysinfo"/>
Nov 15 09:57:23 user nova-compute[75122]:   </os>
Nov 15 09:57:23 user nova-compute[75122]:   <features>
Nov 15 09:57:23 user nova-compute[75122]:     <acpi/>
Nov 15 09:57:23 user nova-compute[75122]:     <apic/>
Nov 15 09:57:23 user nova-compute[75122]:     <vmcoreinfo/>
Nov 15 09:57:23 user nova-compute[75122]:   </features>
Nov 15 09:57:23 user nova-compute[75122]:   <clock offset="utc">
Nov 15 09:57:23 user nova-compute[75122]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 09:57:23 user nova-compute[75122]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 09:57:23 user nova-compute[75122]:     <timer name="hpet" present="no"/>
Nov 15 09:57:23 user nova-compute[75122]:   </clock>
Nov 15 09:57:23 user nova-compute[75122]:   <cpu mode="custom" match="exact">
Nov 15 09:57:23 user nova-compute[75122]:     <model>Nehalem</model>
Nov 15 09:57:23 user nova-compute[75122]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 09:57:23 user nova-compute[75122]:   </cpu>
Nov 15 09:57:23 user nova-compute[75122]:   <devices>
Nov 15 09:57:23 user nova-compute[75122]:     <disk type="file" device="disk">
Nov 15 09:57:23 user nova-compute[75122]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 09:57:23 user nova-compute[75122]:       <source file="/opt/stack/data/nova/instances/9ad77a91-bc65-44a8-8ced-fd2ad9237946/disk"/>
Nov 15 09:57:23 user nova-compute[75122]:       <target dev="vda" bus="virtio"/>
Nov 15 09:57:23 user nova-compute[75122]:     </disk>
Nov 15 09:57:23 user nova-compute[75122]:     <interface type="ethernet">
Nov 15 09:57:23 user nova-compute[75122]:       <mac address="fa:16:3e:d3:b1:38"/>
Nov 15 09:57:23 user nova-compute[75122]:       <model type="virtio"/>
Nov 15 09:57:23 user nova-compute[75122]:       <mtu size="1442"/>
Nov 15 09:57:23 user nova-compute[75122]:       <target dev="tape348b3b5-1f"/>
Nov 15 09:57:23 user nova-compute[75122]:     </interface>
Nov 15 09:57:23 user nova-compute[75122]:     <serial type="pty">
Nov 15 09:57:23 user nova-compute[75122]:       <log file="/opt/stack/data/nova/instances/9ad77a91-bc65-44a8-8ced-fd2ad9237946/console.log" append="off"/>
Nov 15 09:57:23 user nova-compute[75122]:     </serial>
Nov 15 09:57:23 user nova-compute[75122]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 09:57:23 user nova-compute[75122]:     <video>
Nov 15 09:57:23 user nova-compute[75122]:       <model type="virtio"/>
Nov 15 09:57:23 user nova-compute[75122]:     </video>
Nov 15 09:57:23 user nova-compute[75122]:     <rng model="virtio">
Nov 15 09:57:23 user nova-compute[75122]:       <backend model="random">/dev/urandom</backend>
Nov 15 09:57:23 user nova-compute[75122]:     </rng>
Nov 15 09:57:23 user nova-compute[75122]:     <controller type="usb" index="0" model="none"/>
Nov 15 09:57:23 user nova-compute[75122]:     <memballoon model="virtio">
Nov 15 09:57:23 user nova-compute[75122]:       <stats period="10"/>
Nov 15 09:57:23 user nova-compute[75122]:     </memballoon>
Nov 15 09:57:23 user nova-compute[75122]:   </devices>
Nov 15 09:57:23 user nova-compute[75122]: </domain>
Nov 15 09:57:23 user nova-compute[75122]:  {{(pid=75122) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 09:57:23 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-8d5ca216-6e28-48ad-a0f0-352a988c72f7 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T09:57:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-803179351',display_name='tempest-AttachVolumeTestJSON-server-803179351',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-803179351',id=41,image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOazdcLoty/Tvb58dOdgjYRlbmZHLxyOye3e81xDJ6xblOKkjaBcaTxCMTaYL2kE3EQ/2KT89+o54kjCi92RXyGz9Fa5Z/xA8RuG+orKH3o1/047NRIGM2FIaGKSP1LaWg==',key_name='tempest-keypair-269122459',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ab6afbe7809a4ad3921cbc18145d1816',ramdisk_id='',reservation_id='r-3ag6vy4w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-970815916',owner_user_name='tempest-AttachVolumeTestJSON-970815916-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T09:57:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f18eb706375c4b2e9e7de793cd2950ad',uuid=9ad77a91-bc65-44a8-8ced-fd2ad9237946,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e348b3b5-1fc0-4c27-98e7-41a152a67610", "address": "fa:16:3e:d3:b1:38", "network": {"id": "8c1491a5-d5c6-4a22-84fd-bdeca00bbaad", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1848328203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab6afbe7809a4ad3921cbc18145d1816", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape348b3b5-1f", "ovs_interfaceid": "e348b3b5-1fc0-4c27-98e7-41a152a67610", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 09:57:23 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-8d5ca216-6e28-48ad-a0f0-352a988c72f7 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Converting VIF {"id": "e348b3b5-1fc0-4c27-98e7-41a152a67610", "address": "fa:16:3e:d3:b1:38", "network": {"id": "8c1491a5-d5c6-4a22-84fd-bdeca00bbaad", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1848328203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab6afbe7809a4ad3921cbc18145d1816", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape348b3b5-1f", "ovs_interfaceid": "e348b3b5-1fc0-4c27-98e7-41a152a67610", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 09:57:23 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-8d5ca216-6e28-48ad-a0f0-352a988c72f7 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:b1:38,bridge_name='br-int',has_traffic_filtering=True,id=e348b3b5-1fc0-4c27-98e7-41a152a67610,network=Network(8c1491a5-d5c6-4a22-84fd-bdeca00bbaad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape348b3b5-1f') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 09:57:23 user nova-compute[75122]: DEBUG os_vif [None req-8d5ca216-6e28-48ad-a0f0-352a988c72f7 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:b1:38,bridge_name='br-int',has_traffic_filtering=True,id=e348b3b5-1fc0-4c27-98e7-41a152a67610,network=Network(8c1491a5-d5c6-4a22-84fd-bdeca00bbaad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape348b3b5-1f') {{(pid=75122) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 09:57:23 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:57:23 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:57:23 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 09:57:23 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:57:23 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '623692db-914d-5664-8c44-2a29b0e02627', '_type': 'linux-noop'}}, row=False) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:57:23 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:57:23 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:57:23 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:57:23 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:57:23 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:57:23 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape348b3b5-1f, may_exist=True, interface_attrs={}) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:57:23 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape348b3b5-1f, col_values=(('qos', UUID('ca76349c-ce00-45ad-80e8-44c8937e0c3b')),), if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:57:23 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape348b3b5-1f, col_values=(('external_ids', {'iface-id': 'e348b3b5-1fc0-4c27-98e7-41a152a67610', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d3:b1:38', 'vm-uuid': '9ad77a91-bc65-44a8-8ced-fd2ad9237946'}),), if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:57:23 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:57:23 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:57:23 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:57:23 user nova-compute[75122]: INFO os_vif [None req-8d5ca216-6e28-48ad-a0f0-352a988c72f7 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:b1:38,bridge_name='br-int',has_traffic_filtering=True,id=e348b3b5-1fc0-4c27-98e7-41a152a67610,network=Network(8c1491a5-d5c6-4a22-84fd-bdeca00bbaad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape348b3b5-1f')
Nov 15 09:57:23 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-8d5ca216-6e28-48ad-a0f0-352a988c72f7 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] No BDM found with device name vda, not building metadata. {{(pid=75122) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 09:57:23 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-8d5ca216-6e28-48ad-a0f0-352a988c72f7 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] No VIF found with MAC fa:16:3e:d3:b1:38, not building metadata {{(pid=75122) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 09:57:24 user nova-compute[75122]: DEBUG nova.network.neutron [req-701141e2-559a-4ee3-8954-aa0f4a93d348 req-ebc0dee1-e187-475e-8b42-19397bfd220c service nova] [instance: 9ad77a91-bc65-44a8-8ced-fd2ad9237946] Updated VIF entry in instance network info cache for port e348b3b5-1fc0-4c27-98e7-41a152a67610. {{(pid=75122) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 09:57:24 user nova-compute[75122]: DEBUG nova.network.neutron [req-701141e2-559a-4ee3-8954-aa0f4a93d348 req-ebc0dee1-e187-475e-8b42-19397bfd220c service nova] [instance: 9ad77a91-bc65-44a8-8ced-fd2ad9237946] Updating instance_info_cache with network_info: [{"id": "e348b3b5-1fc0-4c27-98e7-41a152a67610", "address": "fa:16:3e:d3:b1:38", "network": {"id": "8c1491a5-d5c6-4a22-84fd-bdeca00bbaad", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1848328203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab6afbe7809a4ad3921cbc18145d1816", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape348b3b5-1f", "ovs_interfaceid": "e348b3b5-1fc0-4c27-98e7-41a152a67610", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:57:24 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-701141e2-559a-4ee3-8954-aa0f4a93d348 req-ebc0dee1-e187-475e-8b42-19397bfd220c service nova] Releasing lock "refresh_cache-9ad77a91-bc65-44a8-8ced-fd2ad9237946" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 09:57:25 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:57:25 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:57:25 user nova-compute[75122]: DEBUG nova.compute.manager [req-14c86d62-117e-4bd2-9e31-c77044a6dbae req-ea7d0717-bcb7-465a-aeed-d9e20fab8c21 service nova] [instance: 9ad77a91-bc65-44a8-8ced-fd2ad9237946] Received event network-vif-plugged-e348b3b5-1fc0-4c27-98e7-41a152a67610 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:57:25 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-14c86d62-117e-4bd2-9e31-c77044a6dbae req-ea7d0717-bcb7-465a-aeed-d9e20fab8c21 service nova] Acquiring lock "9ad77a91-bc65-44a8-8ced-fd2ad9237946-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:57:25 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-14c86d62-117e-4bd2-9e31-c77044a6dbae req-ea7d0717-bcb7-465a-aeed-d9e20fab8c21 service nova] Lock "9ad77a91-bc65-44a8-8ced-fd2ad9237946-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:57:25 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-14c86d62-117e-4bd2-9e31-c77044a6dbae req-ea7d0717-bcb7-465a-aeed-d9e20fab8c21 service nova] Lock "9ad77a91-bc65-44a8-8ced-fd2ad9237946-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:57:25 user nova-compute[75122]: DEBUG nova.compute.manager [req-14c86d62-117e-4bd2-9e31-c77044a6dbae req-ea7d0717-bcb7-465a-aeed-d9e20fab8c21 service nova] [instance: 9ad77a91-bc65-44a8-8ced-fd2ad9237946] No waiting events found dispatching network-vif-plugged-e348b3b5-1fc0-4c27-98e7-41a152a67610 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:57:25 user nova-compute[75122]: WARNING nova.compute.manager [req-14c86d62-117e-4bd2-9e31-c77044a6dbae req-ea7d0717-bcb7-465a-aeed-d9e20fab8c21 service nova] [instance: 9ad77a91-bc65-44a8-8ced-fd2ad9237946] Received unexpected event network-vif-plugged-e348b3b5-1fc0-4c27-98e7-41a152a67610 for instance with vm_state building and task_state spawning.
Nov 15 09:57:25 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:57:25 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:57:25 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:57:26 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:57:26 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Triggering sync for uuid 001d589e-1bee-42da-8422-233ba796fbab {{(pid=75122) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 09:57:26 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Triggering sync for uuid db848537-676f-464a-806d-febb14d920a6 {{(pid=75122) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 09:57:26 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Triggering sync for uuid be71985e-a370-43d9-adef-afb31d03e2fd {{(pid=75122) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 09:57:26 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Triggering sync for uuid 9ad77a91-bc65-44a8-8ced-fd2ad9237946 {{(pid=75122) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 09:57:26 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "001d589e-1bee-42da-8422-233ba796fbab" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:57:26 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "001d589e-1bee-42da-8422-233ba796fbab" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:57:26 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "db848537-676f-464a-806d-febb14d920a6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:57:26 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "db848537-676f-464a-806d-febb14d920a6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.003s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:57:26 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "be71985e-a370-43d9-adef-afb31d03e2fd" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:57:26 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "be71985e-a370-43d9-adef-afb31d03e2fd" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:57:26 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "9ad77a91-bc65-44a8-8ced-fd2ad9237946" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:57:26 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "db848537-676f-464a-806d-febb14d920a6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.030s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:57:26 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "001d589e-1bee-42da-8422-233ba796fbab" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.035s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:57:26 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "be71985e-a370-43d9-adef-afb31d03e2fd" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.034s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:57:26 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:57:27 user nova-compute[75122]: DEBUG nova.compute.manager [None req-8d5ca216-6e28-48ad-a0f0-352a988c72f7 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] [instance: 9ad77a91-bc65-44a8-8ced-fd2ad9237946] Instance event wait completed in 0 seconds for  {{(pid=75122) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 09:57:27 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-8d5ca216-6e28-48ad-a0f0-352a988c72f7 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] [instance: 9ad77a91-bc65-44a8-8ced-fd2ad9237946] Guest created on hypervisor {{(pid=75122) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 09:57:27 user nova-compute[75122]: INFO nova.virt.libvirt.driver [-] [instance: 9ad77a91-bc65-44a8-8ced-fd2ad9237946] Instance spawned successfully.
Nov 15 09:57:27 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-8d5ca216-6e28-48ad-a0f0-352a988c72f7 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] [instance: 9ad77a91-bc65-44a8-8ced-fd2ad9237946] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 09:57:27 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-8d5ca216-6e28-48ad-a0f0-352a988c72f7 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] [instance: 9ad77a91-bc65-44a8-8ced-fd2ad9237946] Found default for hw_cdrom_bus of ide {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:57:27 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-8d5ca216-6e28-48ad-a0f0-352a988c72f7 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] [instance: 9ad77a91-bc65-44a8-8ced-fd2ad9237946] Found default for hw_disk_bus of virtio {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:57:27 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-8d5ca216-6e28-48ad-a0f0-352a988c72f7 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] [instance: 9ad77a91-bc65-44a8-8ced-fd2ad9237946] Found default for hw_input_bus of None {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:57:27 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-8d5ca216-6e28-48ad-a0f0-352a988c72f7 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] [instance: 9ad77a91-bc65-44a8-8ced-fd2ad9237946] Found default for hw_pointer_model of None {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:57:27 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-8d5ca216-6e28-48ad-a0f0-352a988c72f7 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] [instance: 9ad77a91-bc65-44a8-8ced-fd2ad9237946] Found default for hw_video_model of virtio {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:57:27 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-8d5ca216-6e28-48ad-a0f0-352a988c72f7 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] [instance: 9ad77a91-bc65-44a8-8ced-fd2ad9237946] Found default for hw_vif_model of virtio {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:57:27 user nova-compute[75122]: INFO nova.compute.manager [None req-8d5ca216-6e28-48ad-a0f0-352a988c72f7 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] [instance: 9ad77a91-bc65-44a8-8ced-fd2ad9237946] Took 6.65 seconds to spawn the instance on the hypervisor.
Nov 15 09:57:27 user nova-compute[75122]: DEBUG nova.compute.manager [None req-8d5ca216-6e28-48ad-a0f0-352a988c72f7 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] [instance: 9ad77a91-bc65-44a8-8ced-fd2ad9237946] Checking state {{(pid=75122) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 09:57:27 user nova-compute[75122]: DEBUG nova.compute.manager [req-ea8ab8e5-d3e1-4b0e-ace7-7f0c45716c91 req-c929bfaa-cf77-4e03-97fc-305d24af9d76 service nova] [instance: 9ad77a91-bc65-44a8-8ced-fd2ad9237946] Received event network-vif-plugged-e348b3b5-1fc0-4c27-98e7-41a152a67610 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:57:27 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-ea8ab8e5-d3e1-4b0e-ace7-7f0c45716c91 req-c929bfaa-cf77-4e03-97fc-305d24af9d76 service nova] Acquiring lock "9ad77a91-bc65-44a8-8ced-fd2ad9237946-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:57:27 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-ea8ab8e5-d3e1-4b0e-ace7-7f0c45716c91 req-c929bfaa-cf77-4e03-97fc-305d24af9d76 service nova] Lock "9ad77a91-bc65-44a8-8ced-fd2ad9237946-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:57:27 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-ea8ab8e5-d3e1-4b0e-ace7-7f0c45716c91 req-c929bfaa-cf77-4e03-97fc-305d24af9d76 service nova] Lock "9ad77a91-bc65-44a8-8ced-fd2ad9237946-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:57:27 user nova-compute[75122]: DEBUG nova.compute.manager [req-ea8ab8e5-d3e1-4b0e-ace7-7f0c45716c91 req-c929bfaa-cf77-4e03-97fc-305d24af9d76 service nova] [instance: 9ad77a91-bc65-44a8-8ced-fd2ad9237946] No waiting events found dispatching network-vif-plugged-e348b3b5-1fc0-4c27-98e7-41a152a67610 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:57:27 user nova-compute[75122]: WARNING nova.compute.manager [req-ea8ab8e5-d3e1-4b0e-ace7-7f0c45716c91 req-c929bfaa-cf77-4e03-97fc-305d24af9d76 service nova] [instance: 9ad77a91-bc65-44a8-8ced-fd2ad9237946] Received unexpected event network-vif-plugged-e348b3b5-1fc0-4c27-98e7-41a152a67610 for instance with vm_state active and task_state None.
Nov 15 09:57:27 user nova-compute[75122]: INFO nova.compute.manager [None req-8d5ca216-6e28-48ad-a0f0-352a988c72f7 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] [instance: 9ad77a91-bc65-44a8-8ced-fd2ad9237946] Took 7.28 seconds to build instance.
Nov 15 09:57:27 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-8d5ca216-6e28-48ad-a0f0-352a988c72f7 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Lock "9ad77a91-bc65-44a8-8ced-fd2ad9237946" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.388s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:57:27 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "9ad77a91-bc65-44a8-8ced-fd2ad9237946" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 1.421s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:57:27 user nova-compute[75122]: INFO nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] [instance: 9ad77a91-bc65-44a8-8ced-fd2ad9237946] During sync_power_state the instance has a pending task (spawning). Skip.
Nov 15 09:57:27 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "9ad77a91-bc65-44a8-8ced-fd2ad9237946" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:57:28 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:57:28 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:57:30 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:57:31 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:57:32 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:57:32 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:57:32 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:57:32 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:57:32 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:57:32 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75122) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 09:57:32 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/001d589e-1bee-42da-8422-233ba796fbab/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:57:32 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/001d589e-1bee-42da-8422-233ba796fbab/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:57:32 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/001d589e-1bee-42da-8422-233ba796fbab/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:57:32 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/001d589e-1bee-42da-8422-233ba796fbab/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:57:32 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be71985e-a370-43d9-adef-afb31d03e2fd/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:57:32 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be71985e-a370-43d9-adef-afb31d03e2fd/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:57:32 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be71985e-a370-43d9-adef-afb31d03e2fd/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:57:33 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be71985e-a370-43d9-adef-afb31d03e2fd/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:57:33 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75122) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 09:57:33 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ad77a91-bc65-44a8-8ced-fd2ad9237946/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:57:33 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ad77a91-bc65-44a8-8ced-fd2ad9237946/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:57:33 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ad77a91-bc65-44a8-8ced-fd2ad9237946/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:57:33 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ad77a91-bc65-44a8-8ced-fd2ad9237946/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:57:33 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:57:33 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 09:57:33 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 09:57:33 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Hypervisor/Node resource view: name=user free_ram=8716MB free_disk=25.133201599121094GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75122) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 09:57:33 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:57:33 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:57:33 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance 001d589e-1bee-42da-8422-233ba796fbab actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:57:33 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance db848537-676f-464a-806d-febb14d920a6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:57:33 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance be71985e-a370-43d9-adef-afb31d03e2fd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:57:33 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance 9ad77a91-bc65-44a8-8ced-fd2ad9237946 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:57:33 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75122) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 09:57:33 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75122) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 09:57:34 user nova-compute[75122]: DEBUG nova.compute.provider_tree [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Inventory has not changed in ProviderTree for provider: 69a3da65-47be-44c6-b67c-c692b58284ef {{(pid=75122) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 09:57:34 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Inventory has not changed for provider 69a3da65-47be-44c6-b67c-c692b58284ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 09:57:34 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Compute_service record updated for user:user {{(pid=75122) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 09:57:34 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.285s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:57:35 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-fd73dbe0-b688-4862-ab24-62a57510042c tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Acquiring lock "7bc0fb79-8bfe-42ed-92db-883a1289ec3f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:57:35 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-fd73dbe0-b688-4862-ab24-62a57510042c tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Lock "7bc0fb79-8bfe-42ed-92db-883a1289ec3f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:57:35 user nova-compute[75122]: DEBUG nova.compute.manager [None req-fd73dbe0-b688-4862-ab24-62a57510042c tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 7bc0fb79-8bfe-42ed-92db-883a1289ec3f] Starting instance... {{(pid=75122) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 09:57:35 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-fd73dbe0-b688-4862-ab24-62a57510042c tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:57:35 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-fd73dbe0-b688-4862-ab24-62a57510042c tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:57:35 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-fd73dbe0-b688-4862-ab24-62a57510042c tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75122) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 09:57:35 user nova-compute[75122]: INFO nova.compute.claims [None req-fd73dbe0-b688-4862-ab24-62a57510042c tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 7bc0fb79-8bfe-42ed-92db-883a1289ec3f] Claim successful on node user
Nov 15 09:57:36 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:57:36 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:57:36 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:57:36 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Starting heal instance info cache {{(pid=75122) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 09:57:36 user nova-compute[75122]: DEBUG nova.compute.provider_tree [None req-fd73dbe0-b688-4862-ab24-62a57510042c tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Inventory has not changed in ProviderTree for provider: 69a3da65-47be-44c6-b67c-c692b58284ef {{(pid=75122) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 09:57:36 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-fd73dbe0-b688-4862-ab24-62a57510042c tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Inventory has not changed for provider 69a3da65-47be-44c6-b67c-c692b58284ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 09:57:36 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-fd73dbe0-b688-4862-ab24-62a57510042c tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.311s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:57:36 user nova-compute[75122]: DEBUG nova.compute.manager [None req-fd73dbe0-b688-4862-ab24-62a57510042c tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 7bc0fb79-8bfe-42ed-92db-883a1289ec3f] Start building networks asynchronously for instance. {{(pid=75122) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 09:57:36 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "refresh_cache-be71985e-a370-43d9-adef-afb31d03e2fd" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 09:57:36 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquired lock "refresh_cache-be71985e-a370-43d9-adef-afb31d03e2fd" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 09:57:36 user nova-compute[75122]: DEBUG nova.network.neutron [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] [instance: be71985e-a370-43d9-adef-afb31d03e2fd] Forcefully refreshing network info cache for instance {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 09:57:36 user nova-compute[75122]: DEBUG nova.compute.manager [None req-fd73dbe0-b688-4862-ab24-62a57510042c tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 7bc0fb79-8bfe-42ed-92db-883a1289ec3f] Allocating IP information in the background. {{(pid=75122) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 09:57:36 user nova-compute[75122]: DEBUG nova.network.neutron [None req-fd73dbe0-b688-4862-ab24-62a57510042c tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 7bc0fb79-8bfe-42ed-92db-883a1289ec3f] allocate_for_instance() {{(pid=75122) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 09:57:36 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-fd73dbe0-b688-4862-ab24-62a57510042c tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 7bc0fb79-8bfe-42ed-92db-883a1289ec3f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 09:57:36 user nova-compute[75122]: DEBUG nova.compute.manager [None req-fd73dbe0-b688-4862-ab24-62a57510042c tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 7bc0fb79-8bfe-42ed-92db-883a1289ec3f] Start building block device mappings for instance. {{(pid=75122) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 09:57:36 user nova-compute[75122]: DEBUG nova.policy [None req-fd73dbe0-b688-4862-ab24-62a57510042c tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '00f5cc88e43c434c8a061dcec472a16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7941f36c30b49408ae5709a1b75346d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75122) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 09:57:36 user nova-compute[75122]: INFO nova.virt.block_device [None req-fd73dbe0-b688-4862-ab24-62a57510042c tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 7bc0fb79-8bfe-42ed-92db-883a1289ec3f] Booting with volume snapshot 37acffaa-8bd3-4b26-954f-a2d45dd85e16 at /dev/vda
Nov 15 09:57:36 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:57:36 user nova-compute[75122]: DEBUG nova.network.neutron [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] [instance: be71985e-a370-43d9-adef-afb31d03e2fd] Updating instance_info_cache with network_info: [{"id": "4d28d025-0115-4813-b62a-a84ec8c47d58", "address": "fa:16:3e:fa:cb:ca", "network": {"id": "ca2dff40-00d3-46b0-b9e2-dca375439496", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1592022235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88f16d3dc8434cb5ac78c8d2f51d305b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d28d025-01", "ovs_interfaceid": "4d28d025-0115-4813-b62a-a84ec8c47d58", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:57:36 user nova-compute[75122]: DEBUG nova.network.neutron [None req-fd73dbe0-b688-4862-ab24-62a57510042c tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 7bc0fb79-8bfe-42ed-92db-883a1289ec3f] Successfully created port: 69368d12-8ba8-494f-8555-af1ae6ef1443 {{(pid=75122) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 09:57:37 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Releasing lock "refresh_cache-be71985e-a370-43d9-adef-afb31d03e2fd" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 09:57:37 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] [instance: be71985e-a370-43d9-adef-afb31d03e2fd] Updated the network info_cache for instance {{(pid=75122) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 09:57:37 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:57:37 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75122) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 09:57:37 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:57:37 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:57:38 user nova-compute[75122]: DEBUG nova.network.neutron [None req-fd73dbe0-b688-4862-ab24-62a57510042c tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 7bc0fb79-8bfe-42ed-92db-883a1289ec3f] Successfully updated port: 69368d12-8ba8-494f-8555-af1ae6ef1443 {{(pid=75122) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 09:57:38 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-fd73dbe0-b688-4862-ab24-62a57510042c tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Acquiring lock "refresh_cache-7bc0fb79-8bfe-42ed-92db-883a1289ec3f" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 09:57:38 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-fd73dbe0-b688-4862-ab24-62a57510042c tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Acquired lock "refresh_cache-7bc0fb79-8bfe-42ed-92db-883a1289ec3f" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 09:57:38 user nova-compute[75122]: DEBUG nova.network.neutron [None req-fd73dbe0-b688-4862-ab24-62a57510042c tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 7bc0fb79-8bfe-42ed-92db-883a1289ec3f] Building network info cache for instance {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 09:57:38 user nova-compute[75122]: DEBUG nova.compute.manager [req-82b1adca-9491-4275-b034-cb216ab0478d req-0ab0a1aa-0c07-4106-b96d-29a54514c9d7 service nova] [instance: 7bc0fb79-8bfe-42ed-92db-883a1289ec3f] Received event network-changed-69368d12-8ba8-494f-8555-af1ae6ef1443 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:57:38 user nova-compute[75122]: DEBUG nova.compute.manager [req-82b1adca-9491-4275-b034-cb216ab0478d req-0ab0a1aa-0c07-4106-b96d-29a54514c9d7 service nova] [instance: 7bc0fb79-8bfe-42ed-92db-883a1289ec3f] Refreshing instance network info cache due to event network-changed-69368d12-8ba8-494f-8555-af1ae6ef1443. {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 09:57:38 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-82b1adca-9491-4275-b034-cb216ab0478d req-0ab0a1aa-0c07-4106-b96d-29a54514c9d7 service nova] Acquiring lock "refresh_cache-7bc0fb79-8bfe-42ed-92db-883a1289ec3f" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 09:57:38 user nova-compute[75122]: DEBUG nova.network.neutron [None req-fd73dbe0-b688-4862-ab24-62a57510042c tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 7bc0fb79-8bfe-42ed-92db-883a1289ec3f] Instance cache missing network info. {{(pid=75122) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 09:57:38 user nova-compute[75122]: DEBUG nova.network.neutron [None req-fd73dbe0-b688-4862-ab24-62a57510042c tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 7bc0fb79-8bfe-42ed-92db-883a1289ec3f] Updating instance_info_cache with network_info: [{"id": "69368d12-8ba8-494f-8555-af1ae6ef1443", "address": "fa:16:3e:07:31:b5", "network": {"id": "03073971-5253-4f06-a46a-94840841fd6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2056706757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7941f36c30b49408ae5709a1b75346d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69368d12-8b", "ovs_interfaceid": "69368d12-8ba8-494f-8555-af1ae6ef1443", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:57:38 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-fd73dbe0-b688-4862-ab24-62a57510042c tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Releasing lock "refresh_cache-7bc0fb79-8bfe-42ed-92db-883a1289ec3f" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 09:57:38 user nova-compute[75122]: DEBUG nova.compute.manager [None req-fd73dbe0-b688-4862-ab24-62a57510042c tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 7bc0fb79-8bfe-42ed-92db-883a1289ec3f] Instance network_info: |[{"id": "69368d12-8ba8-494f-8555-af1ae6ef1443", "address": "fa:16:3e:07:31:b5", "network": {"id": "03073971-5253-4f06-a46a-94840841fd6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2056706757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7941f36c30b49408ae5709a1b75346d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69368d12-8b", "ovs_interfaceid": "69368d12-8ba8-494f-8555-af1ae6ef1443", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75122) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 09:57:38 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-82b1adca-9491-4275-b034-cb216ab0478d req-0ab0a1aa-0c07-4106-b96d-29a54514c9d7 service nova] Acquired lock "refresh_cache-7bc0fb79-8bfe-42ed-92db-883a1289ec3f" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 09:57:38 user nova-compute[75122]: DEBUG nova.network.neutron [req-82b1adca-9491-4275-b034-cb216ab0478d req-0ab0a1aa-0c07-4106-b96d-29a54514c9d7 service nova] [instance: 7bc0fb79-8bfe-42ed-92db-883a1289ec3f] Refreshing network info cache for port 69368d12-8ba8-494f-8555-af1ae6ef1443 {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 09:57:38 user nova-compute[75122]: DEBUG nova.network.neutron [req-82b1adca-9491-4275-b034-cb216ab0478d req-0ab0a1aa-0c07-4106-b96d-29a54514c9d7 service nova] [instance: 7bc0fb79-8bfe-42ed-92db-883a1289ec3f] Updated VIF entry in instance network info cache for port 69368d12-8ba8-494f-8555-af1ae6ef1443. {{(pid=75122) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 09:57:38 user nova-compute[75122]: DEBUG nova.network.neutron [req-82b1adca-9491-4275-b034-cb216ab0478d req-0ab0a1aa-0c07-4106-b96d-29a54514c9d7 service nova] [instance: 7bc0fb79-8bfe-42ed-92db-883a1289ec3f] Updating instance_info_cache with network_info: [{"id": "69368d12-8ba8-494f-8555-af1ae6ef1443", "address": "fa:16:3e:07:31:b5", "network": {"id": "03073971-5253-4f06-a46a-94840841fd6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2056706757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7941f36c30b49408ae5709a1b75346d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69368d12-8b", "ovs_interfaceid": "69368d12-8ba8-494f-8555-af1ae6ef1443", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:57:38 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-82b1adca-9491-4275-b034-cb216ab0478d req-0ab0a1aa-0c07-4106-b96d-29a54514c9d7 service nova] Releasing lock "refresh_cache-7bc0fb79-8bfe-42ed-92db-883a1289ec3f" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 09:57:38 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:57:40 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:57:42 user nova-compute[75122]: DEBUG os_brick.utils [None req-fd73dbe0-b688-4862-ab24-62a57510042c tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 09:57:42 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:57:42 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:57:42 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[9326d2ff-f20a-4e65-b7d3-6ac3e16f9d0c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:742fb64b3587\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:57:42 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:57:42 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:57:42 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d77cfe4-ee88-4c1d-b574-2c7087acc34d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:57:42 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:57:42 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:57:42 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[76ceca7d-95fe-4729-ad6d-bd25753142bd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:57:42 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f040afd-b6fe-4f6c-920d-176886d68aa4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:57:42 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-fd73dbe0-b688-4862-ab24-62a57510042c tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Running cmd (subprocess): nvme version {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:57:42 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-fd73dbe0-b688-4862-ab24-62a57510042c tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] 'nvme version' failed. Not Retrying. {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 09:57:42 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fd73dbe0-b688-4862-ab24-62a57510042c tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] nvme not present on system {{(pid=75122) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 09:57:42 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:57:42 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 09:57:42 user nova-compute[75122]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 09:57:42 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5867594-d0f7-4189-8fc8-91c0a0b9aa47]: (4, '') {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:57:42 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.lightos [None req-fd73dbe0-b688-4862-ab24-62a57510042c tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75122) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 09:57:42 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.lightos [None req-fd73dbe0-b688-4862-ab24-62a57510042c tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75122) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 09:57:42 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.lightos [None req-fd73dbe0-b688-4862-ab24-62a57510042c tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] LIGHTOS: no hostnqn found. {{(pid=75122) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 09:57:42 user nova-compute[75122]: DEBUG os_brick.utils [None req-fd73dbe0-b688-4862-ab24-62a57510042c tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] <== get_connector_properties: return (112ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:742fb64b3587', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 09:57:42 user nova-compute[75122]: DEBUG nova.virt.block_device [None req-fd73dbe0-b688-4862-ab24-62a57510042c tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 7bc0fb79-8bfe-42ed-92db-883a1289ec3f] Updating existing volume attachment record: 3d8b6644-1943-4c7f-97e7-72f28322fbfa {{(pid=75122) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 09:57:43 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:57:43 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:57:43 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=75122) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 09:57:43 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75122) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 09:57:43 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75122) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 09:57:43 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:57:46 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:57:46 user nova-compute[75122]: DEBUG nova.compute.manager [None req-fd73dbe0-b688-4862-ab24-62a57510042c tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 7bc0fb79-8bfe-42ed-92db-883a1289ec3f] Start spawning the instance on the hypervisor. {{(pid=75122) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 09:57:46 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-fd73dbe0-b688-4862-ab24-62a57510042c tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 7bc0fb79-8bfe-42ed-92db-883a1289ec3f] Creating instance directory {{(pid=75122) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 09:57:46 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-fd73dbe0-b688-4862-ab24-62a57510042c tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 7bc0fb79-8bfe-42ed-92db-883a1289ec3f] Creating image(s)
Nov 15 09:57:46 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-fd73dbe0-b688-4862-ab24-62a57510042c tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 7bc0fb79-8bfe-42ed-92db-883a1289ec3f] Did not create local disks {{(pid=75122) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 09:57:46 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-fd73dbe0-b688-4862-ab24-62a57510042c tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 7bc0fb79-8bfe-42ed-92db-883a1289ec3f] Ensure instance console log exists: /opt/stack/data/nova/instances/7bc0fb79-8bfe-42ed-92db-883a1289ec3f/console.log {{(pid=75122) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 09:57:46 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-fd73dbe0-b688-4862-ab24-62a57510042c tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:57:46 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-fd73dbe0-b688-4862-ab24-62a57510042c tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:57:46 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-fd73dbe0-b688-4862-ab24-62a57510042c tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:57:46 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-fd73dbe0-b688-4862-ab24-62a57510042c tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 7bc0fb79-8bfe-42ed-92db-883a1289ec3f] Start _get_guest_xml network_info=[{"id": "69368d12-8ba8-494f-8555-af1ae6ef1443", "address": "fa:16:3e:07:31:b5", "network": {"id": "03073971-5253-4f06-a46a-94840841fd6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2056706757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7941f36c30b49408ae5709a1b75346d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69368d12-8b", "ovs_interfaceid": "69368d12-8ba8-494f-8555-af1ae6ef1443", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:13b49fe7-db68-4986-845e-9745703d33c8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FtKygZhM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '7bc0fb79-8bfe-42ed-92db-883a1289ec3f', 'attached_at': '', 'detached_at': '', 'volume_id': '13b49fe7-db68-4986-845e-9745703d33c8', 'serial': '13b49fe7-db68-4986-845e-9745703d33c8'}, 'guest_format': None, 'delete_on_termination': True, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vda', 'attachment_id': '3d8b6644-1943-4c7f-97e7-72f28322fbfa', 'volume_type': None} {{(pid=75122) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 09:57:46 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-fd73dbe0-b688-4862-ab24-62a57510042c tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 09:57:46 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-fd73dbe0-b688-4862-ab24-62a57510042c tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 09:57:46 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-fd73dbe0-b688-4862-ab24-62a57510042c tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75122) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 09:57:46 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-fd73dbe0-b688-4862-ab24-62a57510042c tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] CPU controller missing on host. {{(pid=75122) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 09:57:46 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-fd73dbe0-b688-4862-ab24-62a57510042c tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75122) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 09:57:46 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-fd73dbe0-b688-4862-ab24-62a57510042c tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] CPU controller found on host. {{(pid=75122) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 09:57:46 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-fd73dbe0-b688-4862-ab24-62a57510042c tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75122) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 09:57:46 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-fd73dbe0-b688-4862-ab24-62a57510042c tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T09:26:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 09:57:46 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-fd73dbe0-b688-4862-ab24-62a57510042c tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Flavor limits 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 09:57:46 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-fd73dbe0-b688-4862-ab24-62a57510042c tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Image limits 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 09:57:46 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-fd73dbe0-b688-4862-ab24-62a57510042c tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Flavor pref 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 09:57:46 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-fd73dbe0-b688-4862-ab24-62a57510042c tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Image pref 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 09:57:46 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-fd73dbe0-b688-4862-ab24-62a57510042c tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 09:57:46 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-fd73dbe0-b688-4862-ab24-62a57510042c tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 09:57:46 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-fd73dbe0-b688-4862-ab24-62a57510042c tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75122) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 09:57:46 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-fd73dbe0-b688-4862-ab24-62a57510042c tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Got 1 possible topologies {{(pid=75122) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 09:57:46 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-fd73dbe0-b688-4862-ab24-62a57510042c tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 09:57:46 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-fd73dbe0-b688-4862-ab24-62a57510042c tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 09:57:46 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fd73dbe0-b688-4862-ab24-62a57510042c tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 7bc0fb79-8bfe-42ed-92db-883a1289ec3f] Calling os-brick to attach iSCSI Volume {{(pid=75122) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 09:57:46 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd73dbe0-b688-4862-ab24-62a57510042c tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffa04060b80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:13b49fe7-db68-4986-845e-9745703d33c8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FtKygZhM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 09:57:46 user nova-compute[75122]: WARNING os_brick.initiator.connectors.base [None req-fd73dbe0-b688-4862-ab24-62a57510042c tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 09:57:46 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-fd73dbe0-b688-4862-ab24-62a57510042c tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 09:57:46 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-fd73dbe0-b688-4862-ab24-62a57510042c tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 09:57:46 user nova-compute[75122]: WARNING os_brick.initiator.connectors.base [None req-fd73dbe0-b688-4862-ab24-62a57510042c tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 09:57:46 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-fd73dbe0-b688-4862-ab24-62a57510042c tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:13b49fe7-db68-4986-845e-9745703d33c8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 09:57:46 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-fd73dbe0-b688-4862-ab24-62a57510042c tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:13b49fe7-db68-4986-845e-9745703d33c8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 09:57:46 user nova-compute[75122]: INFO os_brick.initiator.connectors.iscsi [None req-fd73dbe0-b688-4862-ab24-62a57510042c tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 09:57:46 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13b49fe7-db68-4986-845e-9745703d33c8 -p 172.16.0.220:3260 {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:57:46 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13b49fe7-db68-4986-845e-9745703d33c8 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:57:46 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[e043c273-d416-4c8b-b187-78c626e305a4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:57:46 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd73dbe0-b688-4862-ab24-62a57510042c tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 09:57:46 user nova-compute[75122]:  {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:57:46 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13b49fe7-db68-4986-845e-9745703d33c8 -p 172.16.0.220:3260 --interface default --op new {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:57:46 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13b49fe7-db68-4986-845e-9745703d33c8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:57:46 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[afb77824-e43d-42d2-ae22-1000c3b9b5b3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:13b49fe7-db68-4986-845e-9745703d33c8] added\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:57:46 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd73dbe0-b688-4862-ab24-62a57510042c tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:13b49fe7-db68-4986-845e-9745703d33c8] added
Nov 15 09:57:46 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:57:46 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13b49fe7-db68-4986-845e-9745703d33c8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:57:46 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13b49fe7-db68-4986-845e-9745703d33c8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:57:46 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceed8017-fc1c-498e-8b27-76892ca53f60]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:57:46 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd73dbe0-b688-4862-ab24-62a57510042c tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:57:46 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13b49fe7-db68-4986-845e-9745703d33c8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:57:46 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13b49fe7-db68-4986-845e-9745703d33c8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:57:46 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[7702c35a-fed4-41b1-a29a-f0b77c586759]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:57:46 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd73dbe0-b688-4862-ab24-62a57510042c tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:57:46 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13b49fe7-db68-4986-845e-9745703d33c8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FtKygZhM {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:57:46 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13b49fe7-db68-4986-845e-9745703d33c8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FtKygZhM" returned: 0 in 0.016s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:57:46 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b5209d7-d781-46e1-a1a7-4a2092f81d5d]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:57:46 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd73dbe0-b688-4862-ab24-62a57510042c tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FtKygZhM'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:57:46 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13b49fe7-db68-4986-845e-9745703d33c8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:57:46 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13b49fe7-db68-4986-845e-9745703d33c8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:57:46 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eb6b380-42c7-44c6-a0cd-6dbc1f5f3ae0]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:57:46 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd73dbe0-b688-4862-ab24-62a57510042c tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:57:46 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:57:46 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:57:46 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[3510f7c0-bae4-4d99-9bca-54eaacea0d62]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee79db2-27c2-4d0f-8ee6-5b03e05ebba5 (non-flash)\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:57:46 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd73dbe0-b688-4862-ab24-62a57510042c tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee79db2-27c2-4d0f-8ee6-5b03e05ebba5 (non-flash)
Nov 15 09:57:46 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 09:57:46 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd73dbe0-b688-4862-ab24-62a57510042c tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee79db2-27c2-4d0f-8ee6-5b03e05ebba5 (non-flash)
Nov 15 09:57:46 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 09:57:46 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13b49fe7-db68-4986-845e-9745703d33c8 -p 172.16.0.220:3260 --login {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:57:46 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13b49fe7-db68-4986-845e-9745703d33c8 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:57:46 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f8145a3-48f2-4d70-b6db-fb8146b682dd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:13b49fe7-db68-4986-845e-9745703d33c8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:13b49fe7-db68-4986-845e-9745703d33c8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:57:46 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd73dbe0-b688-4862-ab24-62a57510042c tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:13b49fe7-db68-4986-845e-9745703d33c8, portal: 172.16.0.220,3260]
Nov 15 09:57:46 user nova-compute[75122]: Login to [iface: default, target: iqn.2010-10.org.openstack:13b49fe7-db68-4986-845e-9745703d33c8, portal: 172.16.0.220,3260] successful.
Nov 15 09:57:46 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:57:46 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13b49fe7-db68-4986-845e-9745703d33c8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:57:46 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13b49fe7-db68-4986-845e-9745703d33c8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:57:46 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[b08d9dd9-532e-4576-96da-d073c91e535f]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:57:46 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd73dbe0-b688-4862-ab24-62a57510042c tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:57:46 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:57:47 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:57:47 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[9139768f-2de3-43b1-9042-23edf8979d84]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee79db2-27c2-4d0f-8ee6-5b03e05ebba5 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13b49fe7-db68-4986-845e-9745703d33c8 (non-flash)\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:57:47 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd73dbe0-b688-4862-ab24-62a57510042c tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee79db2-27c2-4d0f-8ee6-5b03e05ebba5 (non-flash)
Nov 15 09:57:47 user nova-compute[75122]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13b49fe7-db68-4986-845e-9745703d33c8 (non-flash)
Nov 15 09:57:47 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 09:57:47 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd73dbe0-b688-4862-ab24-62a57510042c tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee79db2-27c2-4d0f-8ee6-5b03e05ebba5 (non-flash)
Nov 15 09:57:47 user nova-compute[75122]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13b49fe7-db68-4986-845e-9745703d33c8 (non-flash)
Nov 15 09:57:47 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 09:57:47 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-fd73dbe0-b688-4862-ab24-62a57510042c tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:13b49fe7-db68-4986-845e-9745703d33c8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.236s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 09:57:47 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd73dbe0-b688-4862-ab24-62a57510042c tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Connected to 172.16.0.220:3260 {{(pid=75122) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 09:57:47 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-fd73dbe0-b688-4862-ab24-62a57510042c tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] HCTL ('34', '-', '-', 0) found on session 50 with lun 0 {{(pid=75122) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 09:57:47 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-fd73dbe0-b688-4862-ab24-62a57510042c tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75122) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 09:57:47 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:57:47 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:57:47 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c682235-54c7-4ded-bfe2-f6565a9391f7]: (4, ('- - 0', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:57:47 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-fd73dbe0-b688-4862-ab24-62a57510042c tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Searching for a device in session 50 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75122) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 09:57:47 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd73dbe0-b688-4862-ab24-62a57510042c tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:13b49fe7-db68-4986-845e-9745703d33c8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FtKygZhM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75122) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 09:57:48 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-fd73dbe0-b688-4862-ab24-62a57510042c tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.266s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 09:57:48 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd73dbe0-b688-4862-ab24-62a57510042c tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] <== connect_volume: return (1267ms) {'type': 'block', 'scsi_wwn': '26638373365336630', 'path': '/dev/sdc'} {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 09:57:48 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fd73dbe0-b688-4862-ab24-62a57510042c tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 7bc0fb79-8bfe-42ed-92db-883a1289ec3f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26638373365336630', 'path': '/dev/sdc'} {{(pid=75122) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 09:57:48 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-fd73dbe0-b688-4862-ab24-62a57510042c tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T09:57:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1569894911',display_name='tempest-TestVolumeBootPattern-server-1569894911',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1569894911',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c7941f36c30b49408ae5709a1b75346d',ramdisk_id='',reservation_id='r-0pd4gd81',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-296749341',owner_user_name='tempest-TestVolumeBootPattern-296749341-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T09:57:36Z,user_data=None,user_id='00f5cc88e43c434c8a061dcec472a16b',uuid=7bc0fb79-8bfe-42ed-92db-883a1289ec3f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "69368d12-8ba8-494f-8555-af1ae6ef1443", "address": "fa:16:3e:07:31:b5", "network": {"id": "03073971-5253-4f06-a46a-94840841fd6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2056706757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7941f36c30b49408ae5709a1b75346d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69368d12-8b", "ovs_interfaceid": "69368d12-8ba8-494f-8555-af1ae6ef1443", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75122) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 09:57:48 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-fd73dbe0-b688-4862-ab24-62a57510042c tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Converting VIF {"id": "69368d12-8ba8-494f-8555-af1ae6ef1443", "address": "fa:16:3e:07:31:b5", "network": {"id": "03073971-5253-4f06-a46a-94840841fd6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2056706757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7941f36c30b49408ae5709a1b75346d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69368d12-8b", "ovs_interfaceid": "69368d12-8ba8-494f-8555-af1ae6ef1443", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 09:57:48 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-fd73dbe0-b688-4862-ab24-62a57510042c tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:31:b5,bridge_name='br-int',has_traffic_filtering=True,id=69368d12-8ba8-494f-8555-af1ae6ef1443,network=Network(03073971-5253-4f06-a46a-94840841fd6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69368d12-8b') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 09:57:48 user nova-compute[75122]: DEBUG nova.objects.instance [None req-fd73dbe0-b688-4862-ab24-62a57510042c tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Lazy-loading 'pci_devices' on Instance uuid 7bc0fb79-8bfe-42ed-92db-883a1289ec3f {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:57:48 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-fd73dbe0-b688-4862-ab24-62a57510042c tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 7bc0fb79-8bfe-42ed-92db-883a1289ec3f] End _get_guest_xml xml=<domain type="kvm">
Nov 15 09:57:48 user nova-compute[75122]:   <uuid>7bc0fb79-8bfe-42ed-92db-883a1289ec3f</uuid>
Nov 15 09:57:48 user nova-compute[75122]:   <name>instance-0000002a</name>
Nov 15 09:57:48 user nova-compute[75122]:   <memory>524288</memory>
Nov 15 09:57:48 user nova-compute[75122]:   <vcpu>1</vcpu>
Nov 15 09:57:48 user nova-compute[75122]:   <metadata>
Nov 15 09:57:48 user nova-compute[75122]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 09:57:48 user nova-compute[75122]:       <nova:package version="0.0.0"/>
Nov 15 09:57:48 user nova-compute[75122]:       <nova:name>tempest-TestVolumeBootPattern-server-1569894911</nova:name>
Nov 15 09:57:48 user nova-compute[75122]:       <nova:creationTime>2023-11-15 09:57:46</nova:creationTime>
Nov 15 09:57:48 user nova-compute[75122]:       <nova:flavor name="m1.tiny">
Nov 15 09:57:48 user nova-compute[75122]:         <nova:memory>512</nova:memory>
Nov 15 09:57:48 user nova-compute[75122]:         <nova:disk>1</nova:disk>
Nov 15 09:57:48 user nova-compute[75122]:         <nova:swap>0</nova:swap>
Nov 15 09:57:48 user nova-compute[75122]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 09:57:48 user nova-compute[75122]:         <nova:vcpus>1</nova:vcpus>
Nov 15 09:57:48 user nova-compute[75122]:       </nova:flavor>
Nov 15 09:57:48 user nova-compute[75122]:       <nova:owner>
Nov 15 09:57:48 user nova-compute[75122]:         <nova:user uuid="00f5cc88e43c434c8a061dcec472a16b">tempest-TestVolumeBootPattern-296749341-project-member</nova:user>
Nov 15 09:57:48 user nova-compute[75122]:         <nova:project uuid="c7941f36c30b49408ae5709a1b75346d">tempest-TestVolumeBootPattern-296749341</nova:project>
Nov 15 09:57:48 user nova-compute[75122]:       </nova:owner>
Nov 15 09:57:48 user nova-compute[75122]:       <nova:ports>
Nov 15 09:57:48 user nova-compute[75122]:         <nova:port uuid="69368d12-8ba8-494f-8555-af1ae6ef1443">
Nov 15 09:57:48 user nova-compute[75122]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 15 09:57:48 user nova-compute[75122]:         </nova:port>
Nov 15 09:57:48 user nova-compute[75122]:       </nova:ports>
Nov 15 09:57:48 user nova-compute[75122]:     </nova:instance>
Nov 15 09:57:48 user nova-compute[75122]:   </metadata>
Nov 15 09:57:48 user nova-compute[75122]:   <sysinfo type="smbios">
Nov 15 09:57:48 user nova-compute[75122]:     <system>
Nov 15 09:57:48 user nova-compute[75122]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 09:57:48 user nova-compute[75122]:       <entry name="product">OpenStack Nova</entry>
Nov 15 09:57:48 user nova-compute[75122]:       <entry name="version">0.0.0</entry>
Nov 15 09:57:48 user nova-compute[75122]:       <entry name="serial">7bc0fb79-8bfe-42ed-92db-883a1289ec3f</entry>
Nov 15 09:57:48 user nova-compute[75122]:       <entry name="uuid">7bc0fb79-8bfe-42ed-92db-883a1289ec3f</entry>
Nov 15 09:57:48 user nova-compute[75122]:       <entry name="family">Virtual Machine</entry>
Nov 15 09:57:48 user nova-compute[75122]:     </system>
Nov 15 09:57:48 user nova-compute[75122]:   </sysinfo>
Nov 15 09:57:48 user nova-compute[75122]:   <os>
Nov 15 09:57:48 user nova-compute[75122]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 09:57:48 user nova-compute[75122]:     <boot dev="hd"/>
Nov 15 09:57:48 user nova-compute[75122]:     <smbios mode="sysinfo"/>
Nov 15 09:57:48 user nova-compute[75122]:   </os>
Nov 15 09:57:48 user nova-compute[75122]:   <features>
Nov 15 09:57:48 user nova-compute[75122]:     <acpi/>
Nov 15 09:57:48 user nova-compute[75122]:     <apic/>
Nov 15 09:57:48 user nova-compute[75122]:     <vmcoreinfo/>
Nov 15 09:57:48 user nova-compute[75122]:   </features>
Nov 15 09:57:48 user nova-compute[75122]:   <clock offset="utc">
Nov 15 09:57:48 user nova-compute[75122]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 09:57:48 user nova-compute[75122]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 09:57:48 user nova-compute[75122]:     <timer name="hpet" present="no"/>
Nov 15 09:57:48 user nova-compute[75122]:   </clock>
Nov 15 09:57:48 user nova-compute[75122]:   <cpu mode="custom" match="exact">
Nov 15 09:57:48 user nova-compute[75122]:     <model>Nehalem</model>
Nov 15 09:57:48 user nova-compute[75122]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 09:57:48 user nova-compute[75122]:   </cpu>
Nov 15 09:57:48 user nova-compute[75122]:   <devices>
Nov 15 09:57:48 user nova-compute[75122]:     <disk type="block" device="disk">
Nov 15 09:57:48 user nova-compute[75122]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 09:57:48 user nova-compute[75122]:       <source dev="/dev/sdc"/>
Nov 15 09:57:48 user nova-compute[75122]:       <target dev="vda" bus="virtio"/>
Nov 15 09:57:48 user nova-compute[75122]:       <serial>13b49fe7-db68-4986-845e-9745703d33c8</serial>
Nov 15 09:57:48 user nova-compute[75122]:     </disk>
Nov 15 09:57:48 user nova-compute[75122]:     <interface type="ethernet">
Nov 15 09:57:48 user nova-compute[75122]:       <mac address="fa:16:3e:07:31:b5"/>
Nov 15 09:57:48 user nova-compute[75122]:       <model type="virtio"/>
Nov 15 09:57:48 user nova-compute[75122]:       <mtu size="1442"/>
Nov 15 09:57:48 user nova-compute[75122]:       <target dev="tap69368d12-8b"/>
Nov 15 09:57:48 user nova-compute[75122]:     </interface>
Nov 15 09:57:48 user nova-compute[75122]:     <serial type="pty">
Nov 15 09:57:48 user nova-compute[75122]:       <log file="/opt/stack/data/nova/instances/7bc0fb79-8bfe-42ed-92db-883a1289ec3f/console.log" append="off"/>
Nov 15 09:57:48 user nova-compute[75122]:     </serial>
Nov 15 09:57:48 user nova-compute[75122]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 09:57:48 user nova-compute[75122]:     <video>
Nov 15 09:57:48 user nova-compute[75122]:       <model type="virtio"/>
Nov 15 09:57:48 user nova-compute[75122]:     </video>
Nov 15 09:57:48 user nova-compute[75122]:     <rng model="virtio">
Nov 15 09:57:48 user nova-compute[75122]:       <backend model="random">/dev/urandom</backend>
Nov 15 09:57:48 user nova-compute[75122]:     </rng>
Nov 15 09:57:48 user nova-compute[75122]:     <controller type="usb" index="0" model="none"/>
Nov 15 09:57:48 user nova-compute[75122]:     <memballoon model="virtio">
Nov 15 09:57:48 user nova-compute[75122]:       <stats period="10"/>
Nov 15 09:57:48 user nova-compute[75122]:     </memballoon>
Nov 15 09:57:48 user nova-compute[75122]:   </devices>
Nov 15 09:57:48 user nova-compute[75122]: </domain>
Nov 15 09:57:48 user nova-compute[75122]:  {{(pid=75122) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 09:57:48 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-fd73dbe0-b688-4862-ab24-62a57510042c tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T09:57:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1569894911',display_name='tempest-TestVolumeBootPattern-server-1569894911',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1569894911',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c7941f36c30b49408ae5709a1b75346d',ramdisk_id='',reservation_id='r-0pd4gd81',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-296749341',owner_user_name='tempest-TestVolumeBootPattern-296749341-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T09:57:36Z,user_data=None,user_id='00f5cc88e43c434c8a061dcec472a16b',uuid=7bc0fb79-8bfe-42ed-92db-883a1289ec3f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "69368d12-8ba8-494f-8555-af1ae6ef1443", "address": "fa:16:3e:07:31:b5", "network": {"id": "03073971-5253-4f06-a46a-94840841fd6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2056706757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7941f36c30b49408ae5709a1b75346d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69368d12-8b", "ovs_interfaceid": "69368d12-8ba8-494f-8555-af1ae6ef1443", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 09:57:48 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-fd73dbe0-b688-4862-ab24-62a57510042c tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Converting VIF {"id": "69368d12-8ba8-494f-8555-af1ae6ef1443", "address": "fa:16:3e:07:31:b5", "network": {"id": "03073971-5253-4f06-a46a-94840841fd6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2056706757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7941f36c30b49408ae5709a1b75346d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69368d12-8b", "ovs_interfaceid": "69368d12-8ba8-494f-8555-af1ae6ef1443", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 09:57:48 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-fd73dbe0-b688-4862-ab24-62a57510042c tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:31:b5,bridge_name='br-int',has_traffic_filtering=True,id=69368d12-8ba8-494f-8555-af1ae6ef1443,network=Network(03073971-5253-4f06-a46a-94840841fd6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69368d12-8b') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 09:57:48 user nova-compute[75122]: DEBUG os_vif [None req-fd73dbe0-b688-4862-ab24-62a57510042c tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:31:b5,bridge_name='br-int',has_traffic_filtering=True,id=69368d12-8ba8-494f-8555-af1ae6ef1443,network=Network(03073971-5253-4f06-a46a-94840841fd6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69368d12-8b') {{(pid=75122) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 09:57:48 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:57:48 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:57:48 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 09:57:48 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:57:48 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c769dd34-bb79-529b-addb-d5c6447a6317', '_type': 'linux-noop'}}, row=False) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:57:48 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:57:48 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:57:48 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:57:48 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap69368d12-8b, may_exist=True, interface_attrs={}) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:57:48 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap69368d12-8b, col_values=(('qos', UUID('ef27e872-bf64-4de0-bc9a-a5da08a46eea')),), if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:57:48 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap69368d12-8b, col_values=(('external_ids', {'iface-id': '69368d12-8ba8-494f-8555-af1ae6ef1443', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:07:31:b5', 'vm-uuid': '7bc0fb79-8bfe-42ed-92db-883a1289ec3f'}),), if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:57:48 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:57:48 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:57:48 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:57:48 user nova-compute[75122]: INFO os_vif [None req-fd73dbe0-b688-4862-ab24-62a57510042c tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:31:b5,bridge_name='br-int',has_traffic_filtering=True,id=69368d12-8ba8-494f-8555-af1ae6ef1443,network=Network(03073971-5253-4f06-a46a-94840841fd6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69368d12-8b')
Nov 15 09:57:48 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-fd73dbe0-b688-4862-ab24-62a57510042c tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] No BDM found with device name vda, not building metadata. {{(pid=75122) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 09:57:48 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-fd73dbe0-b688-4862-ab24-62a57510042c tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] No VIF found with MAC fa:16:3e:07:31:b5, not building metadata {{(pid=75122) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 09:57:49 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:57:49 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:57:49 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:57:49 user nova-compute[75122]: DEBUG nova.compute.manager [req-a2384f45-27e4-4558-8f45-8ff5bf209aee req-81a80857-3b49-4de4-905f-a309e4211c16 service nova] [instance: 7bc0fb79-8bfe-42ed-92db-883a1289ec3f] Received event network-vif-plugged-69368d12-8ba8-494f-8555-af1ae6ef1443 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:57:49 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-a2384f45-27e4-4558-8f45-8ff5bf209aee req-81a80857-3b49-4de4-905f-a309e4211c16 service nova] Acquiring lock "7bc0fb79-8bfe-42ed-92db-883a1289ec3f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:57:49 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-a2384f45-27e4-4558-8f45-8ff5bf209aee req-81a80857-3b49-4de4-905f-a309e4211c16 service nova] Lock "7bc0fb79-8bfe-42ed-92db-883a1289ec3f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:57:49 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-a2384f45-27e4-4558-8f45-8ff5bf209aee req-81a80857-3b49-4de4-905f-a309e4211c16 service nova] Lock "7bc0fb79-8bfe-42ed-92db-883a1289ec3f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:57:49 user nova-compute[75122]: DEBUG nova.compute.manager [req-a2384f45-27e4-4558-8f45-8ff5bf209aee req-81a80857-3b49-4de4-905f-a309e4211c16 service nova] [instance: 7bc0fb79-8bfe-42ed-92db-883a1289ec3f] No waiting events found dispatching network-vif-plugged-69368d12-8ba8-494f-8555-af1ae6ef1443 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:57:49 user nova-compute[75122]: WARNING nova.compute.manager [req-a2384f45-27e4-4558-8f45-8ff5bf209aee req-81a80857-3b49-4de4-905f-a309e4211c16 service nova] [instance: 7bc0fb79-8bfe-42ed-92db-883a1289ec3f] Received unexpected event network-vif-plugged-69368d12-8ba8-494f-8555-af1ae6ef1443 for instance with vm_state building and task_state spawning.
Nov 15 09:57:49 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:57:49 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:57:49 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:57:51 user nova-compute[75122]: DEBUG nova.compute.manager [None req-fd73dbe0-b688-4862-ab24-62a57510042c tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 7bc0fb79-8bfe-42ed-92db-883a1289ec3f] Instance event wait completed in 0 seconds for  {{(pid=75122) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 09:57:51 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-fd73dbe0-b688-4862-ab24-62a57510042c tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 7bc0fb79-8bfe-42ed-92db-883a1289ec3f] Guest created on hypervisor {{(pid=75122) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 09:57:51 user nova-compute[75122]: INFO nova.virt.libvirt.driver [-] [instance: 7bc0fb79-8bfe-42ed-92db-883a1289ec3f] Instance spawned successfully.
Nov 15 09:57:51 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-fd73dbe0-b688-4862-ab24-62a57510042c tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 7bc0fb79-8bfe-42ed-92db-883a1289ec3f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 09:57:51 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-fd73dbe0-b688-4862-ab24-62a57510042c tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 7bc0fb79-8bfe-42ed-92db-883a1289ec3f] Found default for hw_cdrom_bus of ide {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:57:51 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-fd73dbe0-b688-4862-ab24-62a57510042c tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 7bc0fb79-8bfe-42ed-92db-883a1289ec3f] Found default for hw_disk_bus of virtio {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:57:51 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-fd73dbe0-b688-4862-ab24-62a57510042c tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 7bc0fb79-8bfe-42ed-92db-883a1289ec3f] Found default for hw_input_bus of None {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:57:51 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-fd73dbe0-b688-4862-ab24-62a57510042c tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 7bc0fb79-8bfe-42ed-92db-883a1289ec3f] Found default for hw_pointer_model of None {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:57:51 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-fd73dbe0-b688-4862-ab24-62a57510042c tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 7bc0fb79-8bfe-42ed-92db-883a1289ec3f] Found default for hw_video_model of virtio {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:57:51 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-fd73dbe0-b688-4862-ab24-62a57510042c tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 7bc0fb79-8bfe-42ed-92db-883a1289ec3f] Found default for hw_vif_model of virtio {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:57:51 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:57:51 user nova-compute[75122]: INFO nova.compute.manager [None req-fd73dbe0-b688-4862-ab24-62a57510042c tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 7bc0fb79-8bfe-42ed-92db-883a1289ec3f] Took 4.90 seconds to spawn the instance on the hypervisor.
Nov 15 09:57:51 user nova-compute[75122]: DEBUG nova.compute.manager [None req-fd73dbe0-b688-4862-ab24-62a57510042c tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 7bc0fb79-8bfe-42ed-92db-883a1289ec3f] Checking state {{(pid=75122) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 09:57:51 user nova-compute[75122]: INFO nova.compute.manager [None req-fd73dbe0-b688-4862-ab24-62a57510042c tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 7bc0fb79-8bfe-42ed-92db-883a1289ec3f] Took 15.79 seconds to build instance.
Nov 15 09:57:51 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-fd73dbe0-b688-4862-ab24-62a57510042c tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Lock "7bc0fb79-8bfe-42ed-92db-883a1289ec3f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.896s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:57:51 user nova-compute[75122]: DEBUG nova.compute.manager [req-914daad7-dd19-447e-8106-e5965a099d74 req-1b143e27-43af-43ed-93f6-787dcd56c805 service nova] [instance: 7bc0fb79-8bfe-42ed-92db-883a1289ec3f] Received event network-vif-plugged-69368d12-8ba8-494f-8555-af1ae6ef1443 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:57:51 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-914daad7-dd19-447e-8106-e5965a099d74 req-1b143e27-43af-43ed-93f6-787dcd56c805 service nova] Acquiring lock "7bc0fb79-8bfe-42ed-92db-883a1289ec3f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:57:51 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-914daad7-dd19-447e-8106-e5965a099d74 req-1b143e27-43af-43ed-93f6-787dcd56c805 service nova] Lock "7bc0fb79-8bfe-42ed-92db-883a1289ec3f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:57:51 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-914daad7-dd19-447e-8106-e5965a099d74 req-1b143e27-43af-43ed-93f6-787dcd56c805 service nova] Lock "7bc0fb79-8bfe-42ed-92db-883a1289ec3f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:57:51 user nova-compute[75122]: DEBUG nova.compute.manager [req-914daad7-dd19-447e-8106-e5965a099d74 req-1b143e27-43af-43ed-93f6-787dcd56c805 service nova] [instance: 7bc0fb79-8bfe-42ed-92db-883a1289ec3f] No waiting events found dispatching network-vif-plugged-69368d12-8ba8-494f-8555-af1ae6ef1443 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:57:51 user nova-compute[75122]: WARNING nova.compute.manager [req-914daad7-dd19-447e-8106-e5965a099d74 req-1b143e27-43af-43ed-93f6-787dcd56c805 service nova] [instance: 7bc0fb79-8bfe-42ed-92db-883a1289ec3f] Received unexpected event network-vif-plugged-69368d12-8ba8-494f-8555-af1ae6ef1443 for instance with vm_state active and task_state None.
Nov 15 09:57:53 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:57:56 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:57:58 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:58:01 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:58:03 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:58:06 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:58:08 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:58:11 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:58:13 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:58:16 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:58:18 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:58:21 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:58:23 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:58:26 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:58:28 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:58:32 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:58:32 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:58:32 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:58:32 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:58:32 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:58:32 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75122) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 09:58:32 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75122) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 09:58:32 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/001d589e-1bee-42da-8422-233ba796fbab/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:58:32 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/001d589e-1bee-42da-8422-233ba796fbab/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:58:32 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/001d589e-1bee-42da-8422-233ba796fbab/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:58:32 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/001d589e-1bee-42da-8422-233ba796fbab/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:58:32 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be71985e-a370-43d9-adef-afb31d03e2fd/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:58:32 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be71985e-a370-43d9-adef-afb31d03e2fd/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:58:32 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be71985e-a370-43d9-adef-afb31d03e2fd/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:58:33 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be71985e-a370-43d9-adef-afb31d03e2fd/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:58:33 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75122) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 09:58:33 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ad77a91-bc65-44a8-8ced-fd2ad9237946/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:58:33 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:58:33 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ad77a91-bc65-44a8-8ced-fd2ad9237946/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:58:33 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ad77a91-bc65-44a8-8ced-fd2ad9237946/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:58:33 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ad77a91-bc65-44a8-8ced-fd2ad9237946/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:58:33 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 09:58:33 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 09:58:33 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Hypervisor/Node resource view: name=user free_ram=8592MB free_disk=25.10350799560547GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75122) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 09:58:33 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:58:33 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:58:33 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance 001d589e-1bee-42da-8422-233ba796fbab actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:58:33 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance db848537-676f-464a-806d-febb14d920a6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:58:33 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance be71985e-a370-43d9-adef-afb31d03e2fd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:58:33 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance 9ad77a91-bc65-44a8-8ced-fd2ad9237946 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:58:33 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance 7bc0fb79-8bfe-42ed-92db-883a1289ec3f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:58:33 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=75122) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 09:58:33 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=75122) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 09:58:34 user nova-compute[75122]: DEBUG nova.compute.provider_tree [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Inventory has not changed in ProviderTree for provider: 69a3da65-47be-44c6-b67c-c692b58284ef {{(pid=75122) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 09:58:34 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Inventory has not changed for provider 69a3da65-47be-44c6-b67c-c692b58284ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 09:58:34 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Compute_service record updated for user:user {{(pid=75122) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 09:58:34 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.312s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:58:37 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:58:37 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:58:37 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:58:38 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:58:38 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:58:38 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Starting heal instance info cache {{(pid=75122) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 09:58:38 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Didn't find any instances for network info cache update. {{(pid=75122) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 15 09:58:38 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:58:38 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75122) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 09:58:38 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-35caeac7-50d8-481d-b266-bf405dd8c368 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Acquiring lock "4c8b3a13-761f-4491-a367-64e74f038629" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:58:38 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-35caeac7-50d8-481d-b266-bf405dd8c368 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Lock "4c8b3a13-761f-4491-a367-64e74f038629" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:58:38 user nova-compute[75122]: DEBUG nova.compute.manager [None req-35caeac7-50d8-481d-b266-bf405dd8c368 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: 4c8b3a13-761f-4491-a367-64e74f038629] Starting instance... {{(pid=75122) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 09:58:38 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-35caeac7-50d8-481d-b266-bf405dd8c368 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:58:38 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-35caeac7-50d8-481d-b266-bf405dd8c368 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:58:38 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-35caeac7-50d8-481d-b266-bf405dd8c368 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75122) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 09:58:38 user nova-compute[75122]: INFO nova.compute.claims [None req-35caeac7-50d8-481d-b266-bf405dd8c368 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: 4c8b3a13-761f-4491-a367-64e74f038629] Claim successful on node user
Nov 15 09:58:39 user nova-compute[75122]: DEBUG nova.compute.provider_tree [None req-35caeac7-50d8-481d-b266-bf405dd8c368 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Inventory has not changed in ProviderTree for provider: 69a3da65-47be-44c6-b67c-c692b58284ef {{(pid=75122) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 09:58:39 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:58:39 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:58:39 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-35caeac7-50d8-481d-b266-bf405dd8c368 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Inventory has not changed for provider 69a3da65-47be-44c6-b67c-c692b58284ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 09:58:39 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-35caeac7-50d8-481d-b266-bf405dd8c368 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.363s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:58:39 user nova-compute[75122]: DEBUG nova.compute.manager [None req-35caeac7-50d8-481d-b266-bf405dd8c368 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: 4c8b3a13-761f-4491-a367-64e74f038629] Start building networks asynchronously for instance. {{(pid=75122) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 09:58:39 user nova-compute[75122]: DEBUG nova.compute.manager [None req-35caeac7-50d8-481d-b266-bf405dd8c368 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: 4c8b3a13-761f-4491-a367-64e74f038629] Allocating IP information in the background. {{(pid=75122) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 09:58:39 user nova-compute[75122]: DEBUG nova.network.neutron [None req-35caeac7-50d8-481d-b266-bf405dd8c368 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: 4c8b3a13-761f-4491-a367-64e74f038629] allocate_for_instance() {{(pid=75122) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 09:58:39 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-35caeac7-50d8-481d-b266-bf405dd8c368 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: 4c8b3a13-761f-4491-a367-64e74f038629] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 09:58:39 user nova-compute[75122]: DEBUG nova.compute.manager [None req-35caeac7-50d8-481d-b266-bf405dd8c368 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: 4c8b3a13-761f-4491-a367-64e74f038629] Start building block device mappings for instance. {{(pid=75122) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 09:58:39 user nova-compute[75122]: DEBUG nova.policy [None req-35caeac7-50d8-481d-b266-bf405dd8c368 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '53d187e2a07b4437a02f65fb47a003ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c046170a2ad44ebba5d2de236d940be0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75122) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 09:58:39 user nova-compute[75122]: DEBUG nova.compute.manager [None req-35caeac7-50d8-481d-b266-bf405dd8c368 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: 4c8b3a13-761f-4491-a367-64e74f038629] Start spawning the instance on the hypervisor. {{(pid=75122) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 09:58:39 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-35caeac7-50d8-481d-b266-bf405dd8c368 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: 4c8b3a13-761f-4491-a367-64e74f038629] Creating instance directory {{(pid=75122) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 09:58:39 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-35caeac7-50d8-481d-b266-bf405dd8c368 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: 4c8b3a13-761f-4491-a367-64e74f038629] Creating image(s)
Nov 15 09:58:39 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-35caeac7-50d8-481d-b266-bf405dd8c368 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Acquiring lock "/opt/stack/data/nova/instances/4c8b3a13-761f-4491-a367-64e74f038629/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:58:39 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-35caeac7-50d8-481d-b266-bf405dd8c368 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Lock "/opt/stack/data/nova/instances/4c8b3a13-761f-4491-a367-64e74f038629/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:58:39 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-35caeac7-50d8-481d-b266-bf405dd8c368 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Lock "/opt/stack/data/nova/instances/4c8b3a13-761f-4491-a367-64e74f038629/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:58:39 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-35caeac7-50d8-481d-b266-bf405dd8c368 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:58:39 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-35caeac7-50d8-481d-b266-bf405dd8c368 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json" returned: 0 in 0.173s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:58:39 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-35caeac7-50d8-481d-b266-bf405dd8c368 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Acquiring lock "95d6e29f74d5408f818e32f3bc29bc8270a4c665" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:58:39 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-35caeac7-50d8-481d-b266-bf405dd8c368 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Lock "95d6e29f74d5408f818e32f3bc29bc8270a4c665" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:58:39 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-35caeac7-50d8-481d-b266-bf405dd8c368 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:58:39 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-35caeac7-50d8-481d-b266-bf405dd8c368 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json" returned: 0 in 0.183s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:58:39 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-35caeac7-50d8-481d-b266-bf405dd8c368 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665,backing_fmt=raw /opt/stack/data/nova/instances/4c8b3a13-761f-4491-a367-64e74f038629/disk 1073741824 {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:58:39 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-35caeac7-50d8-481d-b266-bf405dd8c368 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665,backing_fmt=raw /opt/stack/data/nova/instances/4c8b3a13-761f-4491-a367-64e74f038629/disk 1073741824" returned: 0 in 0.047s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:58:39 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-35caeac7-50d8-481d-b266-bf405dd8c368 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Lock "95d6e29f74d5408f818e32f3bc29bc8270a4c665" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.236s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:58:39 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-35caeac7-50d8-481d-b266-bf405dd8c368 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:58:39 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:58:40 user nova-compute[75122]: DEBUG nova.network.neutron [None req-35caeac7-50d8-481d-b266-bf405dd8c368 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: 4c8b3a13-761f-4491-a367-64e74f038629] Successfully created port: e514c549-93ff-4c5e-88ef-2b3301f91069 {{(pid=75122) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 09:58:40 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-35caeac7-50d8-481d-b266-bf405dd8c368 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json" returned: 0 in 0.188s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:58:40 user nova-compute[75122]: DEBUG nova.virt.disk.api [None req-35caeac7-50d8-481d-b266-bf405dd8c368 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4c8b3a13-761f-4491-a367-64e74f038629/disk. size=1073741824 {{(pid=75122) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 09:58:40 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-35caeac7-50d8-481d-b266-bf405dd8c368 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c8b3a13-761f-4491-a367-64e74f038629/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:58:40 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-35caeac7-50d8-481d-b266-bf405dd8c368 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c8b3a13-761f-4491-a367-64e74f038629/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:58:40 user nova-compute[75122]: DEBUG nova.virt.disk.api [None req-35caeac7-50d8-481d-b266-bf405dd8c368 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Cannot resize image /opt/stack/data/nova/instances/4c8b3a13-761f-4491-a367-64e74f038629/disk to a smaller size. {{(pid=75122) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 09:58:40 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-35caeac7-50d8-481d-b266-bf405dd8c368 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: 4c8b3a13-761f-4491-a367-64e74f038629] Created local disks {{(pid=75122) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 09:58:40 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-35caeac7-50d8-481d-b266-bf405dd8c368 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: 4c8b3a13-761f-4491-a367-64e74f038629] Ensure instance console log exists: /opt/stack/data/nova/instances/4c8b3a13-761f-4491-a367-64e74f038629/console.log {{(pid=75122) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 09:58:40 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-35caeac7-50d8-481d-b266-bf405dd8c368 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:58:40 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-35caeac7-50d8-481d-b266-bf405dd8c368 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:58:40 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-35caeac7-50d8-481d-b266-bf405dd8c368 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:58:40 user nova-compute[75122]: DEBUG nova.network.neutron [None req-35caeac7-50d8-481d-b266-bf405dd8c368 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: 4c8b3a13-761f-4491-a367-64e74f038629] Successfully updated port: e514c549-93ff-4c5e-88ef-2b3301f91069 {{(pid=75122) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 09:58:40 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-35caeac7-50d8-481d-b266-bf405dd8c368 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Acquiring lock "refresh_cache-4c8b3a13-761f-4491-a367-64e74f038629" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 09:58:40 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-35caeac7-50d8-481d-b266-bf405dd8c368 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Acquired lock "refresh_cache-4c8b3a13-761f-4491-a367-64e74f038629" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 09:58:40 user nova-compute[75122]: DEBUG nova.network.neutron [None req-35caeac7-50d8-481d-b266-bf405dd8c368 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: 4c8b3a13-761f-4491-a367-64e74f038629] Building network info cache for instance {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 09:58:40 user nova-compute[75122]: DEBUG nova.compute.manager [req-8cc8a1b1-08c9-4ccf-a93c-d985da109fe3 req-e4af2755-67e0-4d29-803e-ca4c1070a6de service nova] [instance: 4c8b3a13-761f-4491-a367-64e74f038629] Received event network-changed-e514c549-93ff-4c5e-88ef-2b3301f91069 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:58:40 user nova-compute[75122]: DEBUG nova.compute.manager [req-8cc8a1b1-08c9-4ccf-a93c-d985da109fe3 req-e4af2755-67e0-4d29-803e-ca4c1070a6de service nova] [instance: 4c8b3a13-761f-4491-a367-64e74f038629] Refreshing instance network info cache due to event network-changed-e514c549-93ff-4c5e-88ef-2b3301f91069. {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 09:58:40 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-8cc8a1b1-08c9-4ccf-a93c-d985da109fe3 req-e4af2755-67e0-4d29-803e-ca4c1070a6de service nova] Acquiring lock "refresh_cache-4c8b3a13-761f-4491-a367-64e74f038629" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 09:58:40 user nova-compute[75122]: DEBUG nova.network.neutron [None req-35caeac7-50d8-481d-b266-bf405dd8c368 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: 4c8b3a13-761f-4491-a367-64e74f038629] Instance cache missing network info. {{(pid=75122) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 09:58:40 user nova-compute[75122]: DEBUG nova.network.neutron [None req-35caeac7-50d8-481d-b266-bf405dd8c368 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: 4c8b3a13-761f-4491-a367-64e74f038629] Updating instance_info_cache with network_info: [{"id": "e514c549-93ff-4c5e-88ef-2b3301f91069", "address": "fa:16:3e:75:23:6d", "network": {"id": "b780d5c1-a549-4b49-a036-5a272697d4b6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-229344021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c046170a2ad44ebba5d2de236d940be0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape514c549-93", "ovs_interfaceid": "e514c549-93ff-4c5e-88ef-2b3301f91069", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:58:40 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-35caeac7-50d8-481d-b266-bf405dd8c368 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Releasing lock "refresh_cache-4c8b3a13-761f-4491-a367-64e74f038629" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 09:58:40 user nova-compute[75122]: DEBUG nova.compute.manager [None req-35caeac7-50d8-481d-b266-bf405dd8c368 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: 4c8b3a13-761f-4491-a367-64e74f038629] Instance network_info: |[{"id": "e514c549-93ff-4c5e-88ef-2b3301f91069", "address": "fa:16:3e:75:23:6d", "network": {"id": "b780d5c1-a549-4b49-a036-5a272697d4b6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-229344021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c046170a2ad44ebba5d2de236d940be0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape514c549-93", "ovs_interfaceid": "e514c549-93ff-4c5e-88ef-2b3301f91069", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75122) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 09:58:40 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-8cc8a1b1-08c9-4ccf-a93c-d985da109fe3 req-e4af2755-67e0-4d29-803e-ca4c1070a6de service nova] Acquired lock "refresh_cache-4c8b3a13-761f-4491-a367-64e74f038629" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 09:58:40 user nova-compute[75122]: DEBUG nova.network.neutron [req-8cc8a1b1-08c9-4ccf-a93c-d985da109fe3 req-e4af2755-67e0-4d29-803e-ca4c1070a6de service nova] [instance: 4c8b3a13-761f-4491-a367-64e74f038629] Refreshing network info cache for port e514c549-93ff-4c5e-88ef-2b3301f91069 {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 09:58:40 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-35caeac7-50d8-481d-b266-bf405dd8c368 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: 4c8b3a13-761f-4491-a367-64e74f038629] Start _get_guest_xml network_info=[{"id": "e514c549-93ff-4c5e-88ef-2b3301f91069", "address": "fa:16:3e:75:23:6d", "network": {"id": "b780d5c1-a549-4b49-a036-5a272697d4b6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-229344021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c046170a2ad44ebba5d2de236d940be0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape514c549-93", "ovs_interfaceid": "e514c549-93ff-4c5e-88ef-2b3301f91069", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T09:26:31Z,direct_url=<?>,disk_format='qcow2',id=5e862cfe-47b8-4725-8292-65761ee6d0f5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9c57733cb41847c0b4ad31519c382e5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T09:26:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '5e862cfe-47b8-4725-8292-65761ee6d0f5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75122) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 09:58:41 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-35caeac7-50d8-481d-b266-bf405dd8c368 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 09:58:41 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-35caeac7-50d8-481d-b266-bf405dd8c368 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 09:58:41 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-35caeac7-50d8-481d-b266-bf405dd8c368 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75122) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 09:58:41 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-35caeac7-50d8-481d-b266-bf405dd8c368 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] CPU controller missing on host. {{(pid=75122) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 09:58:41 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-35caeac7-50d8-481d-b266-bf405dd8c368 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75122) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 09:58:41 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-35caeac7-50d8-481d-b266-bf405dd8c368 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] CPU controller found on host. {{(pid=75122) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 09:58:41 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-35caeac7-50d8-481d-b266-bf405dd8c368 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75122) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 09:58:41 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-35caeac7-50d8-481d-b266-bf405dd8c368 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T09:26:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T09:26:31Z,direct_url=<?>,disk_format='qcow2',id=5e862cfe-47b8-4725-8292-65761ee6d0f5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9c57733cb41847c0b4ad31519c382e5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T09:26:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 09:58:41 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-35caeac7-50d8-481d-b266-bf405dd8c368 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Flavor limits 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 09:58:41 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-35caeac7-50d8-481d-b266-bf405dd8c368 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Image limits 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 09:58:41 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-35caeac7-50d8-481d-b266-bf405dd8c368 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Flavor pref 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 09:58:41 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-35caeac7-50d8-481d-b266-bf405dd8c368 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Image pref 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 09:58:41 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-35caeac7-50d8-481d-b266-bf405dd8c368 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 09:58:41 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-35caeac7-50d8-481d-b266-bf405dd8c368 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 09:58:41 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-35caeac7-50d8-481d-b266-bf405dd8c368 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75122) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 09:58:41 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-35caeac7-50d8-481d-b266-bf405dd8c368 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Got 1 possible topologies {{(pid=75122) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 09:58:41 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-35caeac7-50d8-481d-b266-bf405dd8c368 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 09:58:41 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-35caeac7-50d8-481d-b266-bf405dd8c368 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 09:58:41 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-35caeac7-50d8-481d-b266-bf405dd8c368 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T09:58:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1482513896',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1482513896',id=43,image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c046170a2ad44ebba5d2de236d940be0',ramdisk_id='',reservation_id='r-544eo77i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1545444983',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T09:58:39Z,user_data=None,user_id='53d187e2a07b4437a02f65fb47a003ee',uuid=4c8b3a13-761f-4491-a367-64e74f038629,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e514c549-93ff-4c5e-88ef-2b3301f91069", "address": "fa:16:3e:75:23:6d", "network": {"id": "b780d5c1-a549-4b49-a036-5a272697d4b6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-229344021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c046170a2ad44ebba5d2de236d940be0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape514c549-93", "ovs_interfaceid": "e514c549-93ff-4c5e-88ef-2b3301f91069", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75122) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 09:58:41 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-35caeac7-50d8-481d-b266-bf405dd8c368 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Converting VIF {"id": "e514c549-93ff-4c5e-88ef-2b3301f91069", "address": "fa:16:3e:75:23:6d", "network": {"id": "b780d5c1-a549-4b49-a036-5a272697d4b6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-229344021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c046170a2ad44ebba5d2de236d940be0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape514c549-93", "ovs_interfaceid": "e514c549-93ff-4c5e-88ef-2b3301f91069", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 09:58:41 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-35caeac7-50d8-481d-b266-bf405dd8c368 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:23:6d,bridge_name='br-int',has_traffic_filtering=True,id=e514c549-93ff-4c5e-88ef-2b3301f91069,network=Network(b780d5c1-a549-4b49-a036-5a272697d4b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape514c549-93') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 09:58:41 user nova-compute[75122]: DEBUG nova.objects.instance [None req-35caeac7-50d8-481d-b266-bf405dd8c368 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Lazy-loading 'pci_devices' on Instance uuid 4c8b3a13-761f-4491-a367-64e74f038629 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:58:41 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-35caeac7-50d8-481d-b266-bf405dd8c368 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: 4c8b3a13-761f-4491-a367-64e74f038629] End _get_guest_xml xml=<domain type="kvm">
Nov 15 09:58:41 user nova-compute[75122]:   <uuid>4c8b3a13-761f-4491-a367-64e74f038629</uuid>
Nov 15 09:58:41 user nova-compute[75122]:   <name>instance-0000002b</name>
Nov 15 09:58:41 user nova-compute[75122]:   <memory>524288</memory>
Nov 15 09:58:41 user nova-compute[75122]:   <vcpu>1</vcpu>
Nov 15 09:58:41 user nova-compute[75122]:   <metadata>
Nov 15 09:58:41 user nova-compute[75122]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 09:58:41 user nova-compute[75122]:       <nova:package version="0.0.0"/>
Nov 15 09:58:41 user nova-compute[75122]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1482513896</nova:name>
Nov 15 09:58:41 user nova-compute[75122]:       <nova:creationTime>2023-11-15 09:58:41</nova:creationTime>
Nov 15 09:58:41 user nova-compute[75122]:       <nova:flavor name="m1.tiny">
Nov 15 09:58:41 user nova-compute[75122]:         <nova:memory>512</nova:memory>
Nov 15 09:58:41 user nova-compute[75122]:         <nova:disk>1</nova:disk>
Nov 15 09:58:41 user nova-compute[75122]:         <nova:swap>0</nova:swap>
Nov 15 09:58:41 user nova-compute[75122]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 09:58:41 user nova-compute[75122]:         <nova:vcpus>1</nova:vcpus>
Nov 15 09:58:41 user nova-compute[75122]:       </nova:flavor>
Nov 15 09:58:41 user nova-compute[75122]:       <nova:owner>
Nov 15 09:58:41 user nova-compute[75122]:         <nova:user uuid="53d187e2a07b4437a02f65fb47a003ee">tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member</nova:user>
Nov 15 09:58:41 user nova-compute[75122]:         <nova:project uuid="c046170a2ad44ebba5d2de236d940be0">tempest-ServerBootFromVolumeStableRescueTest-1545444983</nova:project>
Nov 15 09:58:41 user nova-compute[75122]:       </nova:owner>
Nov 15 09:58:41 user nova-compute[75122]:       <nova:root type="image" uuid="5e862cfe-47b8-4725-8292-65761ee6d0f5"/>
Nov 15 09:58:41 user nova-compute[75122]:       <nova:ports>
Nov 15 09:58:41 user nova-compute[75122]:         <nova:port uuid="e514c549-93ff-4c5e-88ef-2b3301f91069">
Nov 15 09:58:41 user nova-compute[75122]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 15 09:58:41 user nova-compute[75122]:         </nova:port>
Nov 15 09:58:41 user nova-compute[75122]:       </nova:ports>
Nov 15 09:58:41 user nova-compute[75122]:     </nova:instance>
Nov 15 09:58:41 user nova-compute[75122]:   </metadata>
Nov 15 09:58:41 user nova-compute[75122]:   <sysinfo type="smbios">
Nov 15 09:58:41 user nova-compute[75122]:     <system>
Nov 15 09:58:41 user nova-compute[75122]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 09:58:41 user nova-compute[75122]:       <entry name="product">OpenStack Nova</entry>
Nov 15 09:58:41 user nova-compute[75122]:       <entry name="version">0.0.0</entry>
Nov 15 09:58:41 user nova-compute[75122]:       <entry name="serial">4c8b3a13-761f-4491-a367-64e74f038629</entry>
Nov 15 09:58:41 user nova-compute[75122]:       <entry name="uuid">4c8b3a13-761f-4491-a367-64e74f038629</entry>
Nov 15 09:58:41 user nova-compute[75122]:       <entry name="family">Virtual Machine</entry>
Nov 15 09:58:41 user nova-compute[75122]:     </system>
Nov 15 09:58:41 user nova-compute[75122]:   </sysinfo>
Nov 15 09:58:41 user nova-compute[75122]:   <os>
Nov 15 09:58:41 user nova-compute[75122]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 09:58:41 user nova-compute[75122]:     <boot dev="hd"/>
Nov 15 09:58:41 user nova-compute[75122]:     <smbios mode="sysinfo"/>
Nov 15 09:58:41 user nova-compute[75122]:   </os>
Nov 15 09:58:41 user nova-compute[75122]:   <features>
Nov 15 09:58:41 user nova-compute[75122]:     <acpi/>
Nov 15 09:58:41 user nova-compute[75122]:     <apic/>
Nov 15 09:58:41 user nova-compute[75122]:     <vmcoreinfo/>
Nov 15 09:58:41 user nova-compute[75122]:   </features>
Nov 15 09:58:41 user nova-compute[75122]:   <clock offset="utc">
Nov 15 09:58:41 user nova-compute[75122]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 09:58:41 user nova-compute[75122]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 09:58:41 user nova-compute[75122]:     <timer name="hpet" present="no"/>
Nov 15 09:58:41 user nova-compute[75122]:   </clock>
Nov 15 09:58:41 user nova-compute[75122]:   <cpu mode="custom" match="exact">
Nov 15 09:58:41 user nova-compute[75122]:     <model>Nehalem</model>
Nov 15 09:58:41 user nova-compute[75122]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 09:58:41 user nova-compute[75122]:   </cpu>
Nov 15 09:58:41 user nova-compute[75122]:   <devices>
Nov 15 09:58:41 user nova-compute[75122]:     <disk type="file" device="disk">
Nov 15 09:58:41 user nova-compute[75122]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 09:58:41 user nova-compute[75122]:       <source file="/opt/stack/data/nova/instances/4c8b3a13-761f-4491-a367-64e74f038629/disk"/>
Nov 15 09:58:41 user nova-compute[75122]:       <target dev="vda" bus="virtio"/>
Nov 15 09:58:41 user nova-compute[75122]:     </disk>
Nov 15 09:58:41 user nova-compute[75122]:     <interface type="ethernet">
Nov 15 09:58:41 user nova-compute[75122]:       <mac address="fa:16:3e:75:23:6d"/>
Nov 15 09:58:41 user nova-compute[75122]:       <model type="virtio"/>
Nov 15 09:58:41 user nova-compute[75122]:       <mtu size="1442"/>
Nov 15 09:58:41 user nova-compute[75122]:       <target dev="tape514c549-93"/>
Nov 15 09:58:41 user nova-compute[75122]:     </interface>
Nov 15 09:58:41 user nova-compute[75122]:     <serial type="pty">
Nov 15 09:58:41 user nova-compute[75122]:       <log file="/opt/stack/data/nova/instances/4c8b3a13-761f-4491-a367-64e74f038629/console.log" append="off"/>
Nov 15 09:58:41 user nova-compute[75122]:     </serial>
Nov 15 09:58:41 user nova-compute[75122]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 09:58:41 user nova-compute[75122]:     <video>
Nov 15 09:58:41 user nova-compute[75122]:       <model type="virtio"/>
Nov 15 09:58:41 user nova-compute[75122]:     </video>
Nov 15 09:58:41 user nova-compute[75122]:     <rng model="virtio">
Nov 15 09:58:41 user nova-compute[75122]:       <backend model="random">/dev/urandom</backend>
Nov 15 09:58:41 user nova-compute[75122]:     </rng>
Nov 15 09:58:41 user nova-compute[75122]:     <controller type="usb" index="0" model="none"/>
Nov 15 09:58:41 user nova-compute[75122]:     <memballoon model="virtio">
Nov 15 09:58:41 user nova-compute[75122]:       <stats period="10"/>
Nov 15 09:58:41 user nova-compute[75122]:     </memballoon>
Nov 15 09:58:41 user nova-compute[75122]:   </devices>
Nov 15 09:58:41 user nova-compute[75122]: </domain>
Nov 15 09:58:41 user nova-compute[75122]:  {{(pid=75122) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 09:58:41 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-35caeac7-50d8-481d-b266-bf405dd8c368 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T09:58:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1482513896',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1482513896',id=43,image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c046170a2ad44ebba5d2de236d940be0',ramdisk_id='',reservation_id='r-544eo77i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1545444983',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T09:58:39Z,user_data=None,user_id='53d187e2a07b4437a02f65fb47a003ee',uuid=4c8b3a13-761f-4491-a367-64e74f038629,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e514c549-93ff-4c5e-88ef-2b3301f91069", "address": "fa:16:3e:75:23:6d", "network": {"id": "b780d5c1-a549-4b49-a036-5a272697d4b6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-229344021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c046170a2ad44ebba5d2de236d940be0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape514c549-93", "ovs_interfaceid": "e514c549-93ff-4c5e-88ef-2b3301f91069", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 09:58:41 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-35caeac7-50d8-481d-b266-bf405dd8c368 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Converting VIF {"id": "e514c549-93ff-4c5e-88ef-2b3301f91069", "address": "fa:16:3e:75:23:6d", "network": {"id": "b780d5c1-a549-4b49-a036-5a272697d4b6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-229344021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c046170a2ad44ebba5d2de236d940be0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape514c549-93", "ovs_interfaceid": "e514c549-93ff-4c5e-88ef-2b3301f91069", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 09:58:41 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-35caeac7-50d8-481d-b266-bf405dd8c368 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:23:6d,bridge_name='br-int',has_traffic_filtering=True,id=e514c549-93ff-4c5e-88ef-2b3301f91069,network=Network(b780d5c1-a549-4b49-a036-5a272697d4b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape514c549-93') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 09:58:41 user nova-compute[75122]: DEBUG os_vif [None req-35caeac7-50d8-481d-b266-bf405dd8c368 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:23:6d,bridge_name='br-int',has_traffic_filtering=True,id=e514c549-93ff-4c5e-88ef-2b3301f91069,network=Network(b780d5c1-a549-4b49-a036-5a272697d4b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape514c549-93') {{(pid=75122) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 09:58:41 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:58:41 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:58:41 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 09:58:41 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:58:41 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '00be0b5d-2d5a-59ae-9b12-42aa11ac47f4', '_type': 'linux-noop'}}, row=False) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:58:41 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:58:41 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:58:41 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:58:41 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape514c549-93, may_exist=True, interface_attrs={}) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:58:41 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape514c549-93, col_values=(('qos', UUID('66275f32-699f-4c42-bbbd-7c7265e70800')),), if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:58:41 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape514c549-93, col_values=(('external_ids', {'iface-id': 'e514c549-93ff-4c5e-88ef-2b3301f91069', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:75:23:6d', 'vm-uuid': '4c8b3a13-761f-4491-a367-64e74f038629'}),), if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:58:41 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:58:41 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:58:41 user nova-compute[75122]: INFO os_vif [None req-35caeac7-50d8-481d-b266-bf405dd8c368 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:23:6d,bridge_name='br-int',has_traffic_filtering=True,id=e514c549-93ff-4c5e-88ef-2b3301f91069,network=Network(b780d5c1-a549-4b49-a036-5a272697d4b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape514c549-93')
Nov 15 09:58:41 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:58:41 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-35caeac7-50d8-481d-b266-bf405dd8c368 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] No BDM found with device name vda, not building metadata. {{(pid=75122) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 09:58:41 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-35caeac7-50d8-481d-b266-bf405dd8c368 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] No VIF found with MAC fa:16:3e:75:23:6d, not building metadata {{(pid=75122) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 09:58:41 user nova-compute[75122]: DEBUG nova.network.neutron [req-8cc8a1b1-08c9-4ccf-a93c-d985da109fe3 req-e4af2755-67e0-4d29-803e-ca4c1070a6de service nova] [instance: 4c8b3a13-761f-4491-a367-64e74f038629] Updated VIF entry in instance network info cache for port e514c549-93ff-4c5e-88ef-2b3301f91069. {{(pid=75122) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 09:58:41 user nova-compute[75122]: DEBUG nova.network.neutron [req-8cc8a1b1-08c9-4ccf-a93c-d985da109fe3 req-e4af2755-67e0-4d29-803e-ca4c1070a6de service nova] [instance: 4c8b3a13-761f-4491-a367-64e74f038629] Updating instance_info_cache with network_info: [{"id": "e514c549-93ff-4c5e-88ef-2b3301f91069", "address": "fa:16:3e:75:23:6d", "network": {"id": "b780d5c1-a549-4b49-a036-5a272697d4b6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-229344021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c046170a2ad44ebba5d2de236d940be0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape514c549-93", "ovs_interfaceid": "e514c549-93ff-4c5e-88ef-2b3301f91069", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:58:41 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-8cc8a1b1-08c9-4ccf-a93c-d985da109fe3 req-e4af2755-67e0-4d29-803e-ca4c1070a6de service nova] Releasing lock "refresh_cache-4c8b3a13-761f-4491-a367-64e74f038629" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 09:58:42 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:58:42 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:58:42 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:58:42 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:58:42 user nova-compute[75122]: DEBUG nova.compute.manager [req-28c9f467-593c-4265-8a57-e036801d3d82 req-2b77b77b-d465-411f-9f07-eb4f9b863952 service nova] [instance: 4c8b3a13-761f-4491-a367-64e74f038629] Received event network-vif-plugged-e514c549-93ff-4c5e-88ef-2b3301f91069 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:58:42 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-28c9f467-593c-4265-8a57-e036801d3d82 req-2b77b77b-d465-411f-9f07-eb4f9b863952 service nova] Acquiring lock "4c8b3a13-761f-4491-a367-64e74f038629-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:58:42 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-28c9f467-593c-4265-8a57-e036801d3d82 req-2b77b77b-d465-411f-9f07-eb4f9b863952 service nova] Lock "4c8b3a13-761f-4491-a367-64e74f038629-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:58:42 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-28c9f467-593c-4265-8a57-e036801d3d82 req-2b77b77b-d465-411f-9f07-eb4f9b863952 service nova] Lock "4c8b3a13-761f-4491-a367-64e74f038629-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:58:42 user nova-compute[75122]: DEBUG nova.compute.manager [req-28c9f467-593c-4265-8a57-e036801d3d82 req-2b77b77b-d465-411f-9f07-eb4f9b863952 service nova] [instance: 4c8b3a13-761f-4491-a367-64e74f038629] No waiting events found dispatching network-vif-plugged-e514c549-93ff-4c5e-88ef-2b3301f91069 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:58:42 user nova-compute[75122]: WARNING nova.compute.manager [req-28c9f467-593c-4265-8a57-e036801d3d82 req-2b77b77b-d465-411f-9f07-eb4f9b863952 service nova] [instance: 4c8b3a13-761f-4491-a367-64e74f038629] Received unexpected event network-vif-plugged-e514c549-93ff-4c5e-88ef-2b3301f91069 for instance with vm_state building and task_state spawning.
Nov 15 09:58:42 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:58:44 user nova-compute[75122]: DEBUG nova.compute.manager [req-37f3e97f-dd76-475a-a3b4-9009dcfb5a57 req-94653455-c50b-4aa4-a42b-92a1e94d0ef4 service nova] [instance: 4c8b3a13-761f-4491-a367-64e74f038629] Received event network-vif-plugged-e514c549-93ff-4c5e-88ef-2b3301f91069 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:58:44 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-37f3e97f-dd76-475a-a3b4-9009dcfb5a57 req-94653455-c50b-4aa4-a42b-92a1e94d0ef4 service nova] Acquiring lock "4c8b3a13-761f-4491-a367-64e74f038629-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:58:44 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-37f3e97f-dd76-475a-a3b4-9009dcfb5a57 req-94653455-c50b-4aa4-a42b-92a1e94d0ef4 service nova] Lock "4c8b3a13-761f-4491-a367-64e74f038629-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:58:44 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-37f3e97f-dd76-475a-a3b4-9009dcfb5a57 req-94653455-c50b-4aa4-a42b-92a1e94d0ef4 service nova] Lock "4c8b3a13-761f-4491-a367-64e74f038629-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:58:44 user nova-compute[75122]: DEBUG nova.compute.manager [req-37f3e97f-dd76-475a-a3b4-9009dcfb5a57 req-94653455-c50b-4aa4-a42b-92a1e94d0ef4 service nova] [instance: 4c8b3a13-761f-4491-a367-64e74f038629] No waiting events found dispatching network-vif-plugged-e514c549-93ff-4c5e-88ef-2b3301f91069 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:58:44 user nova-compute[75122]: WARNING nova.compute.manager [req-37f3e97f-dd76-475a-a3b4-9009dcfb5a57 req-94653455-c50b-4aa4-a42b-92a1e94d0ef4 service nova] [instance: 4c8b3a13-761f-4491-a367-64e74f038629] Received unexpected event network-vif-plugged-e514c549-93ff-4c5e-88ef-2b3301f91069 for instance with vm_state building and task_state spawning.
Nov 15 09:58:44 user nova-compute[75122]: DEBUG nova.compute.manager [None req-35caeac7-50d8-481d-b266-bf405dd8c368 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: 4c8b3a13-761f-4491-a367-64e74f038629] Instance event wait completed in 0 seconds for  {{(pid=75122) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 09:58:44 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-35caeac7-50d8-481d-b266-bf405dd8c368 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: 4c8b3a13-761f-4491-a367-64e74f038629] Guest created on hypervisor {{(pid=75122) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 09:58:44 user nova-compute[75122]: INFO nova.virt.libvirt.driver [-] [instance: 4c8b3a13-761f-4491-a367-64e74f038629] Instance spawned successfully.
Nov 15 09:58:44 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-35caeac7-50d8-481d-b266-bf405dd8c368 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: 4c8b3a13-761f-4491-a367-64e74f038629] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 09:58:44 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-35caeac7-50d8-481d-b266-bf405dd8c368 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: 4c8b3a13-761f-4491-a367-64e74f038629] Found default for hw_cdrom_bus of ide {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:58:44 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-35caeac7-50d8-481d-b266-bf405dd8c368 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: 4c8b3a13-761f-4491-a367-64e74f038629] Found default for hw_disk_bus of virtio {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:58:44 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-35caeac7-50d8-481d-b266-bf405dd8c368 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: 4c8b3a13-761f-4491-a367-64e74f038629] Found default for hw_input_bus of None {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:58:44 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-35caeac7-50d8-481d-b266-bf405dd8c368 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: 4c8b3a13-761f-4491-a367-64e74f038629] Found default for hw_pointer_model of None {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:58:44 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-35caeac7-50d8-481d-b266-bf405dd8c368 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: 4c8b3a13-761f-4491-a367-64e74f038629] Found default for hw_video_model of virtio {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:58:44 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-35caeac7-50d8-481d-b266-bf405dd8c368 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: 4c8b3a13-761f-4491-a367-64e74f038629] Found default for hw_vif_model of virtio {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 09:58:45 user nova-compute[75122]: INFO nova.compute.manager [None req-35caeac7-50d8-481d-b266-bf405dd8c368 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: 4c8b3a13-761f-4491-a367-64e74f038629] Took 5.59 seconds to spawn the instance on the hypervisor.
Nov 15 09:58:45 user nova-compute[75122]: DEBUG nova.compute.manager [None req-35caeac7-50d8-481d-b266-bf405dd8c368 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: 4c8b3a13-761f-4491-a367-64e74f038629] Checking state {{(pid=75122) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 09:58:45 user nova-compute[75122]: INFO nova.compute.manager [None req-35caeac7-50d8-481d-b266-bf405dd8c368 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: 4c8b3a13-761f-4491-a367-64e74f038629] Took 6.27 seconds to build instance.
Nov 15 09:58:45 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-35caeac7-50d8-481d-b266-bf405dd8c368 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Lock "4c8b3a13-761f-4491-a367-64e74f038629" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.367s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:58:46 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:58:46 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:58:51 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:58:56 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:59:01 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:59:01 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:59:06 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:59:06 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:59:11 user nova-compute[75122]: DEBUG nova.compute.manager [req-93ef3219-8153-484a-9372-cb1259f3e2d8 req-e05187bf-51e5-40c1-870d-b660411d8623 service nova] [instance: 9ad77a91-bc65-44a8-8ced-fd2ad9237946] Received event network-changed-e348b3b5-1fc0-4c27-98e7-41a152a67610 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:59:11 user nova-compute[75122]: DEBUG nova.compute.manager [req-93ef3219-8153-484a-9372-cb1259f3e2d8 req-e05187bf-51e5-40c1-870d-b660411d8623 service nova] [instance: 9ad77a91-bc65-44a8-8ced-fd2ad9237946] Refreshing instance network info cache due to event network-changed-e348b3b5-1fc0-4c27-98e7-41a152a67610. {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 09:59:11 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-93ef3219-8153-484a-9372-cb1259f3e2d8 req-e05187bf-51e5-40c1-870d-b660411d8623 service nova] Acquiring lock "refresh_cache-9ad77a91-bc65-44a8-8ced-fd2ad9237946" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 09:59:11 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-93ef3219-8153-484a-9372-cb1259f3e2d8 req-e05187bf-51e5-40c1-870d-b660411d8623 service nova] Acquired lock "refresh_cache-9ad77a91-bc65-44a8-8ced-fd2ad9237946" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 09:59:11 user nova-compute[75122]: DEBUG nova.network.neutron [req-93ef3219-8153-484a-9372-cb1259f3e2d8 req-e05187bf-51e5-40c1-870d-b660411d8623 service nova] [instance: 9ad77a91-bc65-44a8-8ced-fd2ad9237946] Refreshing network info cache for port e348b3b5-1fc0-4c27-98e7-41a152a67610 {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 09:59:11 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:59:11 user nova-compute[75122]: DEBUG nova.network.neutron [req-93ef3219-8153-484a-9372-cb1259f3e2d8 req-e05187bf-51e5-40c1-870d-b660411d8623 service nova] [instance: 9ad77a91-bc65-44a8-8ced-fd2ad9237946] Updated VIF entry in instance network info cache for port e348b3b5-1fc0-4c27-98e7-41a152a67610. {{(pid=75122) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 09:59:11 user nova-compute[75122]: DEBUG nova.network.neutron [req-93ef3219-8153-484a-9372-cb1259f3e2d8 req-e05187bf-51e5-40c1-870d-b660411d8623 service nova] [instance: 9ad77a91-bc65-44a8-8ced-fd2ad9237946] Updating instance_info_cache with network_info: [{"id": "e348b3b5-1fc0-4c27-98e7-41a152a67610", "address": "fa:16:3e:d3:b1:38", "network": {"id": "8c1491a5-d5c6-4a22-84fd-bdeca00bbaad", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1848328203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab6afbe7809a4ad3921cbc18145d1816", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape348b3b5-1f", "ovs_interfaceid": "e348b3b5-1fc0-4c27-98e7-41a152a67610", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:59:11 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-93ef3219-8153-484a-9372-cb1259f3e2d8 req-e05187bf-51e5-40c1-870d-b660411d8623 service nova] Releasing lock "refresh_cache-9ad77a91-bc65-44a8-8ced-fd2ad9237946" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 09:59:11 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:59:13 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-2ff16ce1-7aeb-4098-b328-252e36889e4d tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Acquiring lock "9ad77a91-bc65-44a8-8ced-fd2ad9237946" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:59:13 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-2ff16ce1-7aeb-4098-b328-252e36889e4d tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Lock "9ad77a91-bc65-44a8-8ced-fd2ad9237946" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:59:13 user nova-compute[75122]: DEBUG nova.objects.instance [None req-2ff16ce1-7aeb-4098-b328-252e36889e4d tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Lazy-loading 'flavor' on Instance uuid 9ad77a91-bc65-44a8-8ced-fd2ad9237946 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:59:13 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-2ff16ce1-7aeb-4098-b328-252e36889e4d tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Lock "9ad77a91-bc65-44a8-8ced-fd2ad9237946" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:59:14 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-2ff16ce1-7aeb-4098-b328-252e36889e4d tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Acquiring lock "9ad77a91-bc65-44a8-8ced-fd2ad9237946" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:59:14 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-2ff16ce1-7aeb-4098-b328-252e36889e4d tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Lock "9ad77a91-bc65-44a8-8ced-fd2ad9237946" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:59:14 user nova-compute[75122]: INFO nova.compute.manager [None req-2ff16ce1-7aeb-4098-b328-252e36889e4d tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] [instance: 9ad77a91-bc65-44a8-8ced-fd2ad9237946] Attaching volume d42739d6-477a-4322-ad52-6491b80a4a48 to /dev/vdb
Nov 15 09:59:14 user nova-compute[75122]: DEBUG os_brick.utils [None req-2ff16ce1-7aeb-4098-b328-252e36889e4d tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 09:59:14 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:59:14 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:59:14 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd8d3364-bebc-48c4-b615-b1eb8278be22]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:742fb64b3587\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:59:14 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:59:14 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:59:14 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce061f21-acb9-4fcc-a582-3ae5e6509a80]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:59:14 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:59:14 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:59:14 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ae814c7-1a5b-4348-bacc-f007858d8c0b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:59:14 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[40d5d4b5-88e5-400a-8816-b21905a0ad72]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:59:14 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-2ff16ce1-7aeb-4098-b328-252e36889e4d tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Running cmd (subprocess): nvme version {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:59:14 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-2ff16ce1-7aeb-4098-b328-252e36889e4d tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] 'nvme version' failed. Not Retrying. {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 09:59:14 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2ff16ce1-7aeb-4098-b328-252e36889e4d tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] nvme not present on system {{(pid=75122) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 09:59:14 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:59:14 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 09:59:14 user nova-compute[75122]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 09:59:14 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[012b8d25-3eb2-4362-a383-70391d6e6f2c]: (4, '') {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:59:14 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.lightos [None req-2ff16ce1-7aeb-4098-b328-252e36889e4d tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75122) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 09:59:14 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.lightos [None req-2ff16ce1-7aeb-4098-b328-252e36889e4d tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75122) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 09:59:14 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.lightos [None req-2ff16ce1-7aeb-4098-b328-252e36889e4d tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] LIGHTOS: no hostnqn found. {{(pid=75122) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 09:59:14 user nova-compute[75122]: DEBUG os_brick.utils [None req-2ff16ce1-7aeb-4098-b328-252e36889e4d tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:742fb64b3587', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 09:59:14 user nova-compute[75122]: DEBUG nova.virt.block_device [None req-2ff16ce1-7aeb-4098-b328-252e36889e4d tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] [instance: 9ad77a91-bc65-44a8-8ced-fd2ad9237946] Updating existing volume attachment record: f3194202-5be7-4375-a4e6-b98450c611da {{(pid=75122) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 09:59:16 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:59:16 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:59:18 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2ff16ce1-7aeb-4098-b328-252e36889e4d tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] [instance: 9ad77a91-bc65-44a8-8ced-fd2ad9237946] Calling os-brick to attach iSCSI Volume {{(pid=75122) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 09:59:18 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ff16ce1-7aeb-4098-b328-252e36889e4d tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffa04060b80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d42739d6-477a-4322-ad52-6491b80a4a48', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CInMWrXi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 09:59:18 user nova-compute[75122]: WARNING os_brick.initiator.connectors.base [None req-2ff16ce1-7aeb-4098-b328-252e36889e4d tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 09:59:18 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-2ff16ce1-7aeb-4098-b328-252e36889e4d tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 09:59:18 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-2ff16ce1-7aeb-4098-b328-252e36889e4d tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 09:59:18 user nova-compute[75122]: WARNING os_brick.initiator.connectors.base [None req-2ff16ce1-7aeb-4098-b328-252e36889e4d tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 09:59:18 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-2ff16ce1-7aeb-4098-b328-252e36889e4d tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d42739d6-477a-4322-ad52-6491b80a4a48" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 09:59:18 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-2ff16ce1-7aeb-4098-b328-252e36889e4d tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d42739d6-477a-4322-ad52-6491b80a4a48" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 09:59:18 user nova-compute[75122]: INFO os_brick.initiator.connectors.iscsi [None req-2ff16ce1-7aeb-4098-b328-252e36889e4d tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 09:59:18 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d42739d6-477a-4322-ad52-6491b80a4a48 -p 172.16.0.220:3260 {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:59:18 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d42739d6-477a-4322-ad52-6491b80a4a48 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:59:18 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7e6898f-0bbc-4184-89c1-8fd6a791208b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:59:18 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ff16ce1-7aeb-4098-b328-252e36889e4d tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 09:59:18 user nova-compute[75122]:  {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:59:18 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d42739d6-477a-4322-ad52-6491b80a4a48 -p 172.16.0.220:3260 --interface default --op new {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:59:18 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d42739d6-477a-4322-ad52-6491b80a4a48 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:59:18 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[49594512-372c-40b5-be6a-df6a982ccc8c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d42739d6-477a-4322-ad52-6491b80a4a48] added\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:59:18 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ff16ce1-7aeb-4098-b328-252e36889e4d tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d42739d6-477a-4322-ad52-6491b80a4a48] added
Nov 15 09:59:18 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:59:18 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d42739d6-477a-4322-ad52-6491b80a4a48 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:59:18 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d42739d6-477a-4322-ad52-6491b80a4a48 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:59:18 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[801c453b-e9ce-4e1b-a5e2-88fe0fa1e57f]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:59:18 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ff16ce1-7aeb-4098-b328-252e36889e4d tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:59:18 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d42739d6-477a-4322-ad52-6491b80a4a48 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:59:18 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d42739d6-477a-4322-ad52-6491b80a4a48 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:59:18 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3664447-1ebd-4eb4-9dce-a0b80d0c691c]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:59:18 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ff16ce1-7aeb-4098-b328-252e36889e4d tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:59:18 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d42739d6-477a-4322-ad52-6491b80a4a48 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CInMWrXi {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:59:18 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d42739d6-477a-4322-ad52-6491b80a4a48 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CInMWrXi" returned: 0 in 0.019s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:59:18 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f39a756-3684-4586-ae23-f45482a1adf4]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:59:18 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ff16ce1-7aeb-4098-b328-252e36889e4d tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CInMWrXi'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:59:18 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d42739d6-477a-4322-ad52-6491b80a4a48 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:59:18 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d42739d6-477a-4322-ad52-6491b80a4a48 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:59:18 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b3b50b2-5baa-43b1-96b7-f890cca40f41]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:59:18 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ff16ce1-7aeb-4098-b328-252e36889e4d tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:59:18 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:59:18 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:59:18 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f6311d1-46d2-43b3-8cac-0802f7655389]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee79db2-27c2-4d0f-8ee6-5b03e05ebba5 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13b49fe7-db68-4986-845e-9745703d33c8 (non-flash)\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:59:18 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ff16ce1-7aeb-4098-b328-252e36889e4d tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee79db2-27c2-4d0f-8ee6-5b03e05ebba5 (non-flash)
Nov 15 09:59:18 user nova-compute[75122]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13b49fe7-db68-4986-845e-9745703d33c8 (non-flash)
Nov 15 09:59:18 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 09:59:18 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ff16ce1-7aeb-4098-b328-252e36889e4d tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee79db2-27c2-4d0f-8ee6-5b03e05ebba5 (non-flash)
Nov 15 09:59:18 user nova-compute[75122]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13b49fe7-db68-4986-845e-9745703d33c8 (non-flash)
Nov 15 09:59:18 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 09:59:18 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d42739d6-477a-4322-ad52-6491b80a4a48 -p 172.16.0.220:3260 --login {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:59:18 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d42739d6-477a-4322-ad52-6491b80a4a48 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:59:18 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[eccc294d-5ca5-492f-9a83-7d0fbc594ec2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d42739d6-477a-4322-ad52-6491b80a4a48, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d42739d6-477a-4322-ad52-6491b80a4a48, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:59:18 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ff16ce1-7aeb-4098-b328-252e36889e4d tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d42739d6-477a-4322-ad52-6491b80a4a48, portal: 172.16.0.220,3260]
Nov 15 09:59:18 user nova-compute[75122]: Login to [iface: default, target: iqn.2010-10.org.openstack:d42739d6-477a-4322-ad52-6491b80a4a48, portal: 172.16.0.220,3260] successful.
Nov 15 09:59:18 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:59:18 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d42739d6-477a-4322-ad52-6491b80a4a48 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:59:18 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d42739d6-477a-4322-ad52-6491b80a4a48 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:59:18 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[395b734a-361b-4303-9501-342a22705e0d]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:59:18 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ff16ce1-7aeb-4098-b328-252e36889e4d tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:59:18 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:59:18 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:59:18 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[61593703-bfde-436c-9993-39f2a1bba563]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee79db2-27c2-4d0f-8ee6-5b03e05ebba5 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13b49fe7-db68-4986-845e-9745703d33c8 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d42739d6-477a-4322-ad52-6491b80a4a48 (non-flash)\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:59:18 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ff16ce1-7aeb-4098-b328-252e36889e4d tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee79db2-27c2-4d0f-8ee6-5b03e05ebba5 (non-flash)
Nov 15 09:59:18 user nova-compute[75122]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13b49fe7-db68-4986-845e-9745703d33c8 (non-flash)
Nov 15 09:59:18 user nova-compute[75122]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d42739d6-477a-4322-ad52-6491b80a4a48 (non-flash)
Nov 15 09:59:18 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 09:59:18 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ff16ce1-7aeb-4098-b328-252e36889e4d tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee79db2-27c2-4d0f-8ee6-5b03e05ebba5 (non-flash)
Nov 15 09:59:18 user nova-compute[75122]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13b49fe7-db68-4986-845e-9745703d33c8 (non-flash)
Nov 15 09:59:18 user nova-compute[75122]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d42739d6-477a-4322-ad52-6491b80a4a48 (non-flash)
Nov 15 09:59:18 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 09:59:18 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-2ff16ce1-7aeb-4098-b328-252e36889e4d tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d42739d6-477a-4322-ad52-6491b80a4a48" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.289s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 09:59:18 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ff16ce1-7aeb-4098-b328-252e36889e4d tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Connected to 172.16.0.220:3260 {{(pid=75122) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 09:59:18 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-2ff16ce1-7aeb-4098-b328-252e36889e4d tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] HCTL ('35', '-', '-', 0) found on session 51 with lun 0 {{(pid=75122) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 09:59:18 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-2ff16ce1-7aeb-4098-b328-252e36889e4d tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75122) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 09:59:18 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:59:19 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:59:19 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8165cb4-2136-4f7c-843e-865edec784d1]: (4, ('- - 0', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:59:19 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-2ff16ce1-7aeb-4098-b328-252e36889e4d tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Searching for a device in session 51 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75122) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 09:59:19 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ff16ce1-7aeb-4098-b328-252e36889e4d tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:d42739d6-477a-4322-ad52-6491b80a4a48', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CInMWrXi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75122) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 09:59:20 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-2ff16ce1-7aeb-4098-b328-252e36889e4d tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.323s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 09:59:20 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ff16ce1-7aeb-4098-b328-252e36889e4d tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] <== connect_volume: return (1325ms) {'type': 'block', 'scsi_wwn': '23030353032623361', 'path': '/dev/sdd'} {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 09:59:20 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2ff16ce1-7aeb-4098-b328-252e36889e4d tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] [instance: 9ad77a91-bc65-44a8-8ced-fd2ad9237946] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23030353032623361', 'path': '/dev/sdd'} {{(pid=75122) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 09:59:20 user nova-compute[75122]: DEBUG nova.objects.instance [None req-2ff16ce1-7aeb-4098-b328-252e36889e4d tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Lazy-loading 'flavor' on Instance uuid 9ad77a91-bc65-44a8-8ced-fd2ad9237946 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:59:20 user nova-compute[75122]: DEBUG nova.virt.libvirt.guest [None req-2ff16ce1-7aeb-4098-b328-252e36889e4d tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 09:59:20 user nova-compute[75122]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 09:59:20 user nova-compute[75122]:   <source dev="/dev/sdd"/>
Nov 15 09:59:20 user nova-compute[75122]:   <target dev="vdb" bus="virtio"/>
Nov 15 09:59:20 user nova-compute[75122]:   <serial>d42739d6-477a-4322-ad52-6491b80a4a48</serial>
Nov 15 09:59:20 user nova-compute[75122]: </disk>
Nov 15 09:59:20 user nova-compute[75122]:  {{(pid=75122) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 09:59:20 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-2ff16ce1-7aeb-4098-b328-252e36889e4d tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] No BDM found with device name vda, not building metadata. {{(pid=75122) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 09:59:20 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-2ff16ce1-7aeb-4098-b328-252e36889e4d tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75122) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 09:59:20 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-2ff16ce1-7aeb-4098-b328-252e36889e4d tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] No VIF found with MAC fa:16:3e:d3:b1:38, not building metadata {{(pid=75122) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 09:59:20 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-2ff16ce1-7aeb-4098-b328-252e36889e4d tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Lock "9ad77a91-bc65-44a8-8ced-fd2ad9237946" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.590s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:59:21 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:59:21 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:59:21 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-c131abcf-d507-40f0-a920-9c88d6789e30 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Acquiring lock "9ad77a91-bc65-44a8-8ced-fd2ad9237946" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:59:21 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-c131abcf-d507-40f0-a920-9c88d6789e30 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Lock "9ad77a91-bc65-44a8-8ced-fd2ad9237946" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:59:21 user nova-compute[75122]: DEBUG nova.compute.manager [None req-c131abcf-d507-40f0-a920-9c88d6789e30 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] [instance: 9ad77a91-bc65-44a8-8ced-fd2ad9237946] Checking state {{(pid=75122) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 09:59:21 user nova-compute[75122]: DEBUG nova.compute.manager [None req-c131abcf-d507-40f0-a920-9c88d6789e30 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] [instance: 9ad77a91-bc65-44a8-8ced-fd2ad9237946] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=75122) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 15 09:59:21 user nova-compute[75122]: DEBUG nova.objects.instance [None req-c131abcf-d507-40f0-a920-9c88d6789e30 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Lazy-loading 'flavor' on Instance uuid 9ad77a91-bc65-44a8-8ced-fd2ad9237946 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:59:21 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:59:21 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:59:21 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:59:21 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:59:22 user nova-compute[75122]: DEBUG nova.compute.manager [req-1d49ac5b-cfb6-405e-9f64-177f48683529 req-17ddb444-82aa-42e2-a16f-b75c6774a880 service nova] [instance: 9ad77a91-bc65-44a8-8ced-fd2ad9237946] Received event network-vif-unplugged-e348b3b5-1fc0-4c27-98e7-41a152a67610 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:59:22 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-1d49ac5b-cfb6-405e-9f64-177f48683529 req-17ddb444-82aa-42e2-a16f-b75c6774a880 service nova] Acquiring lock "9ad77a91-bc65-44a8-8ced-fd2ad9237946-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:59:22 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-1d49ac5b-cfb6-405e-9f64-177f48683529 req-17ddb444-82aa-42e2-a16f-b75c6774a880 service nova] Lock "9ad77a91-bc65-44a8-8ced-fd2ad9237946-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:59:22 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-1d49ac5b-cfb6-405e-9f64-177f48683529 req-17ddb444-82aa-42e2-a16f-b75c6774a880 service nova] Lock "9ad77a91-bc65-44a8-8ced-fd2ad9237946-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:59:22 user nova-compute[75122]: DEBUG nova.compute.manager [req-1d49ac5b-cfb6-405e-9f64-177f48683529 req-17ddb444-82aa-42e2-a16f-b75c6774a880 service nova] [instance: 9ad77a91-bc65-44a8-8ced-fd2ad9237946] No waiting events found dispatching network-vif-unplugged-e348b3b5-1fc0-4c27-98e7-41a152a67610 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:59:22 user nova-compute[75122]: WARNING nova.compute.manager [req-1d49ac5b-cfb6-405e-9f64-177f48683529 req-17ddb444-82aa-42e2-a16f-b75c6774a880 service nova] [instance: 9ad77a91-bc65-44a8-8ced-fd2ad9237946] Received unexpected event network-vif-unplugged-e348b3b5-1fc0-4c27-98e7-41a152a67610 for instance with vm_state active and task_state powering-off.
Nov 15 09:59:22 user nova-compute[75122]: INFO nova.virt.libvirt.driver [-] [instance: 9ad77a91-bc65-44a8-8ced-fd2ad9237946] Instance destroyed successfully.
Nov 15 09:59:22 user nova-compute[75122]: DEBUG nova.compute.manager [None req-c131abcf-d507-40f0-a920-9c88d6789e30 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] [instance: 9ad77a91-bc65-44a8-8ced-fd2ad9237946] Checking state {{(pid=75122) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 09:59:22 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-c131abcf-d507-40f0-a920-9c88d6789e30 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Lock "9ad77a91-bc65-44a8-8ced-fd2ad9237946" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.853s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:59:24 user nova-compute[75122]: DEBUG nova.compute.manager [req-01fa063f-b58c-4574-bdbe-f3c1ba6f417e req-a0558951-49e7-45fc-86fd-8f24eb3b2355 service nova] [instance: 9ad77a91-bc65-44a8-8ced-fd2ad9237946] Received event network-vif-plugged-e348b3b5-1fc0-4c27-98e7-41a152a67610 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:59:24 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-01fa063f-b58c-4574-bdbe-f3c1ba6f417e req-a0558951-49e7-45fc-86fd-8f24eb3b2355 service nova] Acquiring lock "9ad77a91-bc65-44a8-8ced-fd2ad9237946-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:59:24 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-01fa063f-b58c-4574-bdbe-f3c1ba6f417e req-a0558951-49e7-45fc-86fd-8f24eb3b2355 service nova] Lock "9ad77a91-bc65-44a8-8ced-fd2ad9237946-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:59:24 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-01fa063f-b58c-4574-bdbe-f3c1ba6f417e req-a0558951-49e7-45fc-86fd-8f24eb3b2355 service nova] Lock "9ad77a91-bc65-44a8-8ced-fd2ad9237946-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:59:24 user nova-compute[75122]: DEBUG nova.compute.manager [req-01fa063f-b58c-4574-bdbe-f3c1ba6f417e req-a0558951-49e7-45fc-86fd-8f24eb3b2355 service nova] [instance: 9ad77a91-bc65-44a8-8ced-fd2ad9237946] No waiting events found dispatching network-vif-plugged-e348b3b5-1fc0-4c27-98e7-41a152a67610 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:59:24 user nova-compute[75122]: WARNING nova.compute.manager [req-01fa063f-b58c-4574-bdbe-f3c1ba6f417e req-a0558951-49e7-45fc-86fd-8f24eb3b2355 service nova] [instance: 9ad77a91-bc65-44a8-8ced-fd2ad9237946] Received unexpected event network-vif-plugged-e348b3b5-1fc0-4c27-98e7-41a152a67610 for instance with vm_state stopped and task_state None.
Nov 15 09:59:26 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:59:26 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-613a7c8f-435e-43cc-8685-c536290c6cb0 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Acquiring lock "7bc0fb79-8bfe-42ed-92db-883a1289ec3f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:59:26 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-613a7c8f-435e-43cc-8685-c536290c6cb0 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Lock "7bc0fb79-8bfe-42ed-92db-883a1289ec3f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:59:26 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-613a7c8f-435e-43cc-8685-c536290c6cb0 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Acquiring lock "7bc0fb79-8bfe-42ed-92db-883a1289ec3f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:59:26 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-613a7c8f-435e-43cc-8685-c536290c6cb0 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Lock "7bc0fb79-8bfe-42ed-92db-883a1289ec3f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:59:26 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-613a7c8f-435e-43cc-8685-c536290c6cb0 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Lock "7bc0fb79-8bfe-42ed-92db-883a1289ec3f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:59:26 user nova-compute[75122]: INFO nova.compute.manager [None req-613a7c8f-435e-43cc-8685-c536290c6cb0 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 7bc0fb79-8bfe-42ed-92db-883a1289ec3f] Terminating instance
Nov 15 09:59:26 user nova-compute[75122]: DEBUG nova.compute.manager [None req-613a7c8f-435e-43cc-8685-c536290c6cb0 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 7bc0fb79-8bfe-42ed-92db-883a1289ec3f] Start destroying the instance on the hypervisor. {{(pid=75122) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 09:59:26 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:59:26 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:59:26 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:59:26 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:59:26 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:59:26 user nova-compute[75122]: DEBUG nova.compute.manager [req-f6c8f325-f5ae-4542-943c-6c0029ccd4c9 req-e0f9c9d5-725d-485b-999e-b95fe2eb9486 service nova] [instance: 7bc0fb79-8bfe-42ed-92db-883a1289ec3f] Received event network-vif-unplugged-69368d12-8ba8-494f-8555-af1ae6ef1443 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:59:26 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-f6c8f325-f5ae-4542-943c-6c0029ccd4c9 req-e0f9c9d5-725d-485b-999e-b95fe2eb9486 service nova] Acquiring lock "7bc0fb79-8bfe-42ed-92db-883a1289ec3f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:59:26 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-f6c8f325-f5ae-4542-943c-6c0029ccd4c9 req-e0f9c9d5-725d-485b-999e-b95fe2eb9486 service nova] Lock "7bc0fb79-8bfe-42ed-92db-883a1289ec3f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:59:26 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-f6c8f325-f5ae-4542-943c-6c0029ccd4c9 req-e0f9c9d5-725d-485b-999e-b95fe2eb9486 service nova] Lock "7bc0fb79-8bfe-42ed-92db-883a1289ec3f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:59:26 user nova-compute[75122]: DEBUG nova.compute.manager [req-f6c8f325-f5ae-4542-943c-6c0029ccd4c9 req-e0f9c9d5-725d-485b-999e-b95fe2eb9486 service nova] [instance: 7bc0fb79-8bfe-42ed-92db-883a1289ec3f] No waiting events found dispatching network-vif-unplugged-69368d12-8ba8-494f-8555-af1ae6ef1443 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:59:26 user nova-compute[75122]: DEBUG nova.compute.manager [req-f6c8f325-f5ae-4542-943c-6c0029ccd4c9 req-e0f9c9d5-725d-485b-999e-b95fe2eb9486 service nova] [instance: 7bc0fb79-8bfe-42ed-92db-883a1289ec3f] Received event network-vif-unplugged-69368d12-8ba8-494f-8555-af1ae6ef1443 for instance with task_state deleting. {{(pid=75122) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 09:59:27 user nova-compute[75122]: INFO nova.virt.libvirt.driver [-] [instance: 7bc0fb79-8bfe-42ed-92db-883a1289ec3f] Instance destroyed successfully.
Nov 15 09:59:27 user nova-compute[75122]: DEBUG nova.objects.instance [None req-613a7c8f-435e-43cc-8685-c536290c6cb0 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Lazy-loading 'resources' on Instance uuid 7bc0fb79-8bfe-42ed-92db-883a1289ec3f {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:59:27 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-613a7c8f-435e-43cc-8685-c536290c6cb0 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T09:57:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1569894911',display_name='tempest-TestVolumeBootPattern-server-1569894911',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1569894911',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T09:57:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c7941f36c30b49408ae5709a1b75346d',ramdisk_id='',reservation_id='r-0pd4gd81',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-296749341',owner_user_name='tempest-TestVolumeBootPattern-296749341-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T09:57:52Z,user_data=None,user_id='00f5cc88e43c434c8a061dcec472a16b',uuid=7bc0fb79-8bfe-42ed-92db-883a1289ec3f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "69368d12-8ba8-494f-8555-af1ae6ef1443", "address": "fa:16:3e:07:31:b5", "network": {"id": "03073971-5253-4f06-a46a-94840841fd6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2056706757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7941f36c30b49408ae5709a1b75346d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69368d12-8b", "ovs_interfaceid": "69368d12-8ba8-494f-8555-af1ae6ef1443", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 09:59:27 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-613a7c8f-435e-43cc-8685-c536290c6cb0 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Converting VIF {"id": "69368d12-8ba8-494f-8555-af1ae6ef1443", "address": "fa:16:3e:07:31:b5", "network": {"id": "03073971-5253-4f06-a46a-94840841fd6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2056706757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7941f36c30b49408ae5709a1b75346d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69368d12-8b", "ovs_interfaceid": "69368d12-8ba8-494f-8555-af1ae6ef1443", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 09:59:27 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-613a7c8f-435e-43cc-8685-c536290c6cb0 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:31:b5,bridge_name='br-int',has_traffic_filtering=True,id=69368d12-8ba8-494f-8555-af1ae6ef1443,network=Network(03073971-5253-4f06-a46a-94840841fd6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69368d12-8b') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 09:59:27 user nova-compute[75122]: DEBUG os_vif [None req-613a7c8f-435e-43cc-8685-c536290c6cb0 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:31:b5,bridge_name='br-int',has_traffic_filtering=True,id=69368d12-8ba8-494f-8555-af1ae6ef1443,network=Network(03073971-5253-4f06-a46a-94840841fd6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69368d12-8b') {{(pid=75122) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 09:59:27 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:59:27 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap69368d12-8b, bridge=br-int, if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:59:27 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:59:27 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:59:27 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:59:27 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:59:27 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ef27e872-bf64-4de0-bc9a-a5da08a46eea) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 09:59:27 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:59:27 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:59:27 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:59:27 user nova-compute[75122]: INFO os_vif [None req-613a7c8f-435e-43cc-8685-c536290c6cb0 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:31:b5,bridge_name='br-int',has_traffic_filtering=True,id=69368d12-8ba8-494f-8555-af1ae6ef1443,network=Network(03073971-5253-4f06-a46a-94840841fd6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69368d12-8b')
Nov 15 09:59:27 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-613a7c8f-435e-43cc-8685-c536290c6cb0 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 7bc0fb79-8bfe-42ed-92db-883a1289ec3f] calling os-brick to detach iSCSI Volume {{(pid=75122) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 09:59:27 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-613a7c8f-435e-43cc-8685-c536290c6cb0 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffa04060b80>, {'target_iqn': 'iqn.2010-10.org.openstack:13b49fe7-db68-4986-845e-9745703d33c8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FtKygZhM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 09:59:27 user nova-compute[75122]: WARNING os_brick.initiator.connectors.base [None req-613a7c8f-435e-43cc-8685-c536290c6cb0 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 09:59:27 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-613a7c8f-435e-43cc-8685-c536290c6cb0 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 09:59:27 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-613a7c8f-435e-43cc-8685-c536290c6cb0 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 09:59:27 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:59:27 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:59:27 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[4db14e7f-1ada-4391-b457-b17a36637105]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:13b49fe7-db68-4986-845e-9745703d33c8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d42739d6-477a-4322-ad52-6491b80a4a48\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8ee79db2-27c2-4d0f-8ee6-5b03e05ebba5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:59:27 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-613a7c8f-435e-43cc-8685-c536290c6cb0 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 09:59:27 user nova-compute[75122]: No targets found.
Nov 15 09:59:27 user nova-compute[75122]: iSNS:
Nov 15 09:59:27 user nova-compute[75122]: No targets found.
Nov 15 09:59:27 user nova-compute[75122]: STATIC:
Nov 15 09:59:27 user nova-compute[75122]: Target: iqn.2010-10.org.openstack:13b49fe7-db68-4986-845e-9745703d33c8
Nov 15 09:59:27 user nova-compute[75122]:         Portal: 172.16.0.220:3260,-1
Nov 15 09:59:27 user nova-compute[75122]:                 Iface Name: default
Nov 15 09:59:27 user nova-compute[75122]: Target: iqn.2010-10.org.openstack:d42739d6-477a-4322-ad52-6491b80a4a48
Nov 15 09:59:27 user nova-compute[75122]:         Portal: 172.16.0.220:3260,-1
Nov 15 09:59:27 user nova-compute[75122]:                 Iface Name: default
Nov 15 09:59:27 user nova-compute[75122]: Target: iqn.2010-10.org.openstack:8ee79db2-27c2-4d0f-8ee6-5b03e05ebba5
Nov 15 09:59:27 user nova-compute[75122]:         Portal: 172.16.0.220:3260,-1
Nov 15 09:59:27 user nova-compute[75122]:                 Iface Name: default
Nov 15 09:59:27 user nova-compute[75122]: FIRMWARE:
Nov 15 09:59:27 user nova-compute[75122]: No targets found.
Nov 15 09:59:27 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 09:59:27 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-613a7c8f-435e-43cc-8685-c536290c6cb0 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 09:59:27 user nova-compute[75122]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 09:59:27 user nova-compute[75122]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75122) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 09:59:27 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-613a7c8f-435e-43cc-8685-c536290c6cb0 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:13b49fe7-db68-4986-845e-9745703d33c8', 0)] {{(pid=75122) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 09:59:27 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:59:27 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:59:27 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e087824-3356-494a-adee-76fe35e0b2be]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:13b49fe7-db68-4986-845e-9745703d33c8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8ee79db2-27c2-4d0f-8ee6-5b03e05ebba5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d42739d6-477a-4322-ad52-6491b80a4a48\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:59:27 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:59:27 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:59:27 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[05e4ab2d-9756-41d8-88e5-503ec5229f0b]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee79db2-27c2-4d0f-8ee6-5b03e05ebba5 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13b49fe7-db68-4986-845e-9745703d33c8 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d42739d6-477a-4322-ad52-6491b80a4a48 (non-flash)\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:59:27 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-613a7c8f-435e-43cc-8685-c536290c6cb0 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee79db2-27c2-4d0f-8ee6-5b03e05ebba5 (non-flash)
Nov 15 09:59:27 user nova-compute[75122]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13b49fe7-db68-4986-845e-9745703d33c8 (non-flash)
Nov 15 09:59:27 user nova-compute[75122]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d42739d6-477a-4322-ad52-6491b80a4a48 (non-flash)
Nov 15 09:59:27 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 09:59:27 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-613a7c8f-435e-43cc-8685-c536290c6cb0 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee79db2-27c2-4d0f-8ee6-5b03e05ebba5 (non-flash)
Nov 15 09:59:27 user nova-compute[75122]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:13b49fe7-db68-4986-845e-9745703d33c8 (non-flash)
Nov 15 09:59:27 user nova-compute[75122]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d42739d6-477a-4322-ad52-6491b80a4a48 (non-flash)
Nov 15 09:59:27 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 09:59:27 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-613a7c8f-435e-43cc-8685-c536290c6cb0 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff9e4214940>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:13b49fe7-db68-4986-845e-9745703d33c8'): ({'sdc'}, set())}) {{(pid=75122) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 09:59:27 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-613a7c8f-435e-43cc-8685-c536290c6cb0 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Removing single pathed devices sdc {{(pid=75122) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 09:59:27 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:59:27 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:59:27 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7b49f32-d92c-43e1-b8c4-d8f60605682b]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:59:27 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:59:27 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.024s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:59:27 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[afb13ef3-5b3c-4273-b010-6502e8a01e70]: (4, ('ok\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:59:27 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-613a7c8f-435e-43cc-8685-c536290c6cb0 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Flushing IO for device /dev/sdc {{(pid=75122) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 09:59:27 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:59:27 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:59:27 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[dad2c714-520c-49c9-946f-5de7f2a230aa]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:59:27 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-613a7c8f-435e-43cc-8685-c536290c6cb0 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75122) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 09:59:27 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:59:27 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.059s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:59:27 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[c458ec14-9b24-4802-92ed-0a4496b71c66]: (4, ('1', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:59:27 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-613a7c8f-435e-43cc-8685-c536290c6cb0 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75122) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 09:59:27 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-613a7c8f-435e-43cc-8685-c536290c6cb0 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] SCSI volumes sdc have been removed. {{(pid=75122) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 09:59:27 user nova-compute[75122]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_8c77b70d', '/dev/disk/by-id/scsi-1SCST_BIO8c77b70d-f873e3f0efba3996', '/dev/disk/by-id/scsi-26638373365336630') {{(pid=85998) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 15 09:59:27 user nova-compute[75122]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_8c77b70d
Nov 15 09:59:27 user nova-compute[75122]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIO8c77b70d-f873e3f0efba3996
Nov 15 09:59:27 user nova-compute[75122]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-26638373365336630
Nov 15 09:59:27 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[331effe7-2b55-48ce-8e1b-ddac7ce8f6c7]: (4, None) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:59:27 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-613a7c8f-435e-43cc-8685-c536290c6cb0 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:13b49fe7-db68-4986-845e-9745703d33c8')] {{(pid=75122) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 09:59:27 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13b49fe7-db68-4986-845e-9745703d33c8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:59:27 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13b49fe7-db68-4986-845e-9745703d33c8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:59:27 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc0609c8-c822-43dd-ba61-cb19c1088ca3]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:59:27 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-613a7c8f-435e-43cc-8685-c536290c6cb0 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:59:27 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13b49fe7-db68-4986-845e-9745703d33c8 -p 172.16.0.220:3260 --logout {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:59:27 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13b49fe7-db68-4986-845e-9745703d33c8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:59:27 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eca887b-54f4-4334-b3c7-10c9945e2efa]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:13b49fe7-db68-4986-845e-9745703d33c8, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:13b49fe7-db68-4986-845e-9745703d33c8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:59:27 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-613a7c8f-435e-43cc-8685-c536290c6cb0 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:13b49fe7-db68-4986-845e-9745703d33c8, portal: 172.16.0.220,3260]
Nov 15 09:59:27 user nova-compute[75122]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:13b49fe7-db68-4986-845e-9745703d33c8, portal: 172.16.0.220,3260] successful.
Nov 15 09:59:27 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:59:27 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:13b49fe7-db68-4986-845e-9745703d33c8 -p 172.16.0.220:3260 --op delete {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:59:27 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:13b49fe7-db68-4986-845e-9745703d33c8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:59:27 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[aad6bb4f-87de-4732-be6c-f313e8ded504]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 09:59:27 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-613a7c8f-435e-43cc-8685-c536290c6cb0 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 09:59:27 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-613a7c8f-435e-43cc-8685-c536290c6cb0 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.384s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 09:59:27 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-613a7c8f-435e-43cc-8685-c536290c6cb0 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] <== disconnect_volume: return (386ms) None {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 09:59:27 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-613a7c8f-435e-43cc-8685-c536290c6cb0 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 7bc0fb79-8bfe-42ed-92db-883a1289ec3f] Disconnected iSCSI Volume {{(pid=75122) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 09:59:27 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-613a7c8f-435e-43cc-8685-c536290c6cb0 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 7bc0fb79-8bfe-42ed-92db-883a1289ec3f] Deleting instance files /opt/stack/data/nova/instances/7bc0fb79-8bfe-42ed-92db-883a1289ec3f_del
Nov 15 09:59:27 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-613a7c8f-435e-43cc-8685-c536290c6cb0 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 7bc0fb79-8bfe-42ed-92db-883a1289ec3f] Deletion of /opt/stack/data/nova/instances/7bc0fb79-8bfe-42ed-92db-883a1289ec3f_del complete
Nov 15 09:59:27 user nova-compute[75122]: INFO nova.compute.manager [None req-613a7c8f-435e-43cc-8685-c536290c6cb0 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 7bc0fb79-8bfe-42ed-92db-883a1289ec3f] Took 1.29 seconds to destroy the instance on the hypervisor.
Nov 15 09:59:27 user nova-compute[75122]: DEBUG oslo.service.loopingcall [None req-613a7c8f-435e-43cc-8685-c536290c6cb0 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75122) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 09:59:27 user nova-compute[75122]: DEBUG nova.compute.manager [-] [instance: 7bc0fb79-8bfe-42ed-92db-883a1289ec3f] Deallocating network for instance {{(pid=75122) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 09:59:27 user nova-compute[75122]: DEBUG nova.network.neutron [-] [instance: 7bc0fb79-8bfe-42ed-92db-883a1289ec3f] deallocate_for_instance() {{(pid=75122) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 09:59:28 user nova-compute[75122]: DEBUG nova.network.neutron [-] [instance: 7bc0fb79-8bfe-42ed-92db-883a1289ec3f] Updating instance_info_cache with network_info: [] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:59:28 user nova-compute[75122]: INFO nova.compute.manager [-] [instance: 7bc0fb79-8bfe-42ed-92db-883a1289ec3f] Took 0.48 seconds to deallocate network for instance.
Nov 15 09:59:28 user nova-compute[75122]: DEBUG nova.compute.manager [req-f46f1530-c764-4154-825b-4531305aca1c req-9a759d0b-e471-4015-8f1c-30fd768e5b58 service nova] [instance: 7bc0fb79-8bfe-42ed-92db-883a1289ec3f] Received event network-vif-deleted-69368d12-8ba8-494f-8555-af1ae6ef1443 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:59:28 user nova-compute[75122]: INFO nova.compute.manager [req-f46f1530-c764-4154-825b-4531305aca1c req-9a759d0b-e471-4015-8f1c-30fd768e5b58 service nova] [instance: 7bc0fb79-8bfe-42ed-92db-883a1289ec3f] Neutron deleted interface 69368d12-8ba8-494f-8555-af1ae6ef1443; detaching it from the instance and deleting it from the info cache
Nov 15 09:59:28 user nova-compute[75122]: DEBUG nova.network.neutron [req-f46f1530-c764-4154-825b-4531305aca1c req-9a759d0b-e471-4015-8f1c-30fd768e5b58 service nova] [instance: 7bc0fb79-8bfe-42ed-92db-883a1289ec3f] Updating instance_info_cache with network_info: [] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:59:28 user nova-compute[75122]: DEBUG nova.compute.manager [req-f46f1530-c764-4154-825b-4531305aca1c req-9a759d0b-e471-4015-8f1c-30fd768e5b58 service nova] [instance: 7bc0fb79-8bfe-42ed-92db-883a1289ec3f] Detach interface failed, port_id=69368d12-8ba8-494f-8555-af1ae6ef1443, reason: Instance 7bc0fb79-8bfe-42ed-92db-883a1289ec3f could not be found. {{(pid=75122) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 09:59:28 user nova-compute[75122]: DEBUG nova.compute.manager [req-11cc602c-3277-4605-9675-96ac49396b67 req-bf5d6fbc-2ae2-46c1-983e-7f38bee2faa4 service nova] [instance: 7bc0fb79-8bfe-42ed-92db-883a1289ec3f] Received event network-vif-plugged-69368d12-8ba8-494f-8555-af1ae6ef1443 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 09:59:28 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-11cc602c-3277-4605-9675-96ac49396b67 req-bf5d6fbc-2ae2-46c1-983e-7f38bee2faa4 service nova] Acquiring lock "7bc0fb79-8bfe-42ed-92db-883a1289ec3f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:59:28 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-11cc602c-3277-4605-9675-96ac49396b67 req-bf5d6fbc-2ae2-46c1-983e-7f38bee2faa4 service nova] Lock "7bc0fb79-8bfe-42ed-92db-883a1289ec3f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:59:28 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-11cc602c-3277-4605-9675-96ac49396b67 req-bf5d6fbc-2ae2-46c1-983e-7f38bee2faa4 service nova] Lock "7bc0fb79-8bfe-42ed-92db-883a1289ec3f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:59:28 user nova-compute[75122]: DEBUG nova.compute.manager [req-11cc602c-3277-4605-9675-96ac49396b67 req-bf5d6fbc-2ae2-46c1-983e-7f38bee2faa4 service nova] [instance: 7bc0fb79-8bfe-42ed-92db-883a1289ec3f] No waiting events found dispatching network-vif-plugged-69368d12-8ba8-494f-8555-af1ae6ef1443 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 09:59:28 user nova-compute[75122]: WARNING nova.compute.manager [req-11cc602c-3277-4605-9675-96ac49396b67 req-bf5d6fbc-2ae2-46c1-983e-7f38bee2faa4 service nova] [instance: 7bc0fb79-8bfe-42ed-92db-883a1289ec3f] Received unexpected event network-vif-plugged-69368d12-8ba8-494f-8555-af1ae6ef1443 for instance with vm_state active and task_state deleting.
Nov 15 09:59:28 user nova-compute[75122]: INFO nova.compute.manager [None req-613a7c8f-435e-43cc-8685-c536290c6cb0 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 7bc0fb79-8bfe-42ed-92db-883a1289ec3f] Took 0.75 seconds to detach 1 volumes for instance.
Nov 15 09:59:28 user nova-compute[75122]: DEBUG nova.compute.manager [None req-613a7c8f-435e-43cc-8685-c536290c6cb0 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 7bc0fb79-8bfe-42ed-92db-883a1289ec3f] Deleting volume: 13b49fe7-db68-4986-845e-9745703d33c8 {{(pid=75122) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 15 09:59:29 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-613a7c8f-435e-43cc-8685-c536290c6cb0 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:59:29 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-613a7c8f-435e-43cc-8685-c536290c6cb0 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:59:29 user nova-compute[75122]: DEBUG nova.compute.provider_tree [None req-613a7c8f-435e-43cc-8685-c536290c6cb0 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Inventory has not changed in ProviderTree for provider: 69a3da65-47be-44c6-b67c-c692b58284ef {{(pid=75122) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 09:59:29 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-613a7c8f-435e-43cc-8685-c536290c6cb0 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Inventory has not changed for provider 69a3da65-47be-44c6-b67c-c692b58284ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 09:59:29 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-613a7c8f-435e-43cc-8685-c536290c6cb0 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.242s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:59:29 user nova-compute[75122]: INFO nova.scheduler.client.report [None req-613a7c8f-435e-43cc-8685-c536290c6cb0 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Deleted allocations for instance 7bc0fb79-8bfe-42ed-92db-883a1289ec3f
Nov 15 09:59:29 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-613a7c8f-435e-43cc-8685-c536290c6cb0 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Lock "7bc0fb79-8bfe-42ed-92db-883a1289ec3f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.077s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:59:32 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:59:32 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:59:32 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:59:32 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:59:32 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:59:32 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75122) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 09:59:32 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:59:32 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c8b3a13-761f-4491-a367-64e74f038629/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:59:32 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c8b3a13-761f-4491-a367-64e74f038629/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:59:32 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c8b3a13-761f-4491-a367-64e74f038629/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:59:32 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c8b3a13-761f-4491-a367-64e74f038629/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:59:32 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/001d589e-1bee-42da-8422-233ba796fbab/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:59:32 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/001d589e-1bee-42da-8422-233ba796fbab/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:59:32 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/001d589e-1bee-42da-8422-233ba796fbab/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:59:33 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/001d589e-1bee-42da-8422-233ba796fbab/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:59:33 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be71985e-a370-43d9-adef-afb31d03e2fd/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:59:33 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be71985e-a370-43d9-adef-afb31d03e2fd/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:59:33 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be71985e-a370-43d9-adef-afb31d03e2fd/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:59:33 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be71985e-a370-43d9-adef-afb31d03e2fd/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:59:33 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75122) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 09:59:33 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ad77a91-bc65-44a8-8ced-fd2ad9237946/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:59:33 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ad77a91-bc65-44a8-8ced-fd2ad9237946/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:59:33 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ad77a91-bc65-44a8-8ced-fd2ad9237946/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 09:59:33 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ad77a91-bc65-44a8-8ced-fd2ad9237946/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 09:59:33 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75122) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 09:59:34 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 09:59:34 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 09:59:34 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Hypervisor/Node resource view: name=user free_ram=8615MB free_disk=25.073223114013672GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75122) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 09:59:34 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 09:59:34 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 09:59:34 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance 001d589e-1bee-42da-8422-233ba796fbab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:59:34 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance db848537-676f-464a-806d-febb14d920a6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:59:34 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance be71985e-a370-43d9-adef-afb31d03e2fd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:59:34 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance 9ad77a91-bc65-44a8-8ced-fd2ad9237946 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:59:34 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance 4c8b3a13-761f-4491-a367-64e74f038629 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 09:59:34 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=75122) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 09:59:34 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=75122) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 09:59:34 user nova-compute[75122]: DEBUG nova.compute.provider_tree [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Inventory has not changed in ProviderTree for provider: 69a3da65-47be-44c6-b67c-c692b58284ef {{(pid=75122) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 09:59:34 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Inventory has not changed for provider 69a3da65-47be-44c6-b67c-c692b58284ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 09:59:34 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Compute_service record updated for user:user {{(pid=75122) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 09:59:34 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.288s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 09:59:37 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:59:38 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:59:38 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:59:39 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:59:39 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:59:40 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:59:40 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Starting heal instance info cache {{(pid=75122) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 09:59:40 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Rebuilding the list of instances to heal {{(pid=75122) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 09:59:40 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "refresh_cache-001d589e-1bee-42da-8422-233ba796fbab" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 09:59:40 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquired lock "refresh_cache-001d589e-1bee-42da-8422-233ba796fbab" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 09:59:40 user nova-compute[75122]: DEBUG nova.network.neutron [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] [instance: 001d589e-1bee-42da-8422-233ba796fbab] Forcefully refreshing network info cache for instance {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 09:59:40 user nova-compute[75122]: DEBUG nova.objects.instance [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lazy-loading 'info_cache' on Instance uuid 001d589e-1bee-42da-8422-233ba796fbab {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 09:59:40 user nova-compute[75122]: DEBUG nova.network.neutron [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] [instance: 001d589e-1bee-42da-8422-233ba796fbab] Updating instance_info_cache with network_info: [{"id": "6a77f68d-d3da-47c6-a3de-09bd69399762", "address": "fa:16:3e:87:a0:de", "network": {"id": "b780d5c1-a549-4b49-a036-5a272697d4b6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-229344021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c046170a2ad44ebba5d2de236d940be0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a77f68d-d3", "ovs_interfaceid": "6a77f68d-d3da-47c6-a3de-09bd69399762", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 09:59:40 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Releasing lock "refresh_cache-001d589e-1bee-42da-8422-233ba796fbab" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 09:59:40 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] [instance: 001d589e-1bee-42da-8422-233ba796fbab] Updated the network info_cache for instance {{(pid=75122) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 09:59:40 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:59:40 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75122) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 09:59:42 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:59:42 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:59:42 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75122) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 09:59:42 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75122) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 09:59:42 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75122) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 09:59:42 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:59:43 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 09:59:46 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:59:47 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 09:59:52 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 09:59:57 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:00:02 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:00:07 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:00:12 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:00:17 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:00:17 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:00:17 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75122) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 10:00:17 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75122) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 10:00:17 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75122) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 10:00:17 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:00:22 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:00:24 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:00:26 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-d0a8c34c-19af-4754-a232-09be743b9f22 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Acquiring lock "1f426091-b78a-4d40-bff4-a5c23f155e54" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:00:26 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-d0a8c34c-19af-4754-a232-09be743b9f22 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Lock "1f426091-b78a-4d40-bff4-a5c23f155e54" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:00:26 user nova-compute[75122]: DEBUG nova.compute.manager [None req-d0a8c34c-19af-4754-a232-09be743b9f22 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 1f426091-b78a-4d40-bff4-a5c23f155e54] Starting instance... {{(pid=75122) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 10:00:26 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-d0a8c34c-19af-4754-a232-09be743b9f22 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:00:26 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-d0a8c34c-19af-4754-a232-09be743b9f22 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:00:26 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-d0a8c34c-19af-4754-a232-09be743b9f22 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75122) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 10:00:26 user nova-compute[75122]: INFO nova.compute.claims [None req-d0a8c34c-19af-4754-a232-09be743b9f22 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 1f426091-b78a-4d40-bff4-a5c23f155e54] Claim successful on node user
Nov 15 10:00:26 user nova-compute[75122]: DEBUG nova.compute.provider_tree [None req-d0a8c34c-19af-4754-a232-09be743b9f22 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Inventory has not changed in ProviderTree for provider: 69a3da65-47be-44c6-b67c-c692b58284ef {{(pid=75122) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 10:00:26 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-d0a8c34c-19af-4754-a232-09be743b9f22 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Inventory has not changed for provider 69a3da65-47be-44c6-b67c-c692b58284ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 10:00:26 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-d0a8c34c-19af-4754-a232-09be743b9f22 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.322s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:00:26 user nova-compute[75122]: DEBUG nova.compute.manager [None req-d0a8c34c-19af-4754-a232-09be743b9f22 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 1f426091-b78a-4d40-bff4-a5c23f155e54] Start building networks asynchronously for instance. {{(pid=75122) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 10:00:27 user nova-compute[75122]: DEBUG nova.compute.manager [None req-d0a8c34c-19af-4754-a232-09be743b9f22 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 1f426091-b78a-4d40-bff4-a5c23f155e54] Allocating IP information in the background. {{(pid=75122) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 10:00:27 user nova-compute[75122]: DEBUG nova.network.neutron [None req-d0a8c34c-19af-4754-a232-09be743b9f22 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 1f426091-b78a-4d40-bff4-a5c23f155e54] allocate_for_instance() {{(pid=75122) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 10:00:27 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-d0a8c34c-19af-4754-a232-09be743b9f22 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 1f426091-b78a-4d40-bff4-a5c23f155e54] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 10:00:27 user nova-compute[75122]: DEBUG nova.compute.manager [None req-d0a8c34c-19af-4754-a232-09be743b9f22 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 1f426091-b78a-4d40-bff4-a5c23f155e54] Start building block device mappings for instance. {{(pid=75122) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 10:00:27 user nova-compute[75122]: INFO nova.virt.block_device [None req-d0a8c34c-19af-4754-a232-09be743b9f22 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 1f426091-b78a-4d40-bff4-a5c23f155e54] Booting with volume 2d703360-7eee-4b0b-9b1d-a42e2170de6c at /dev/vda
Nov 15 10:00:27 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:00:27 user nova-compute[75122]: DEBUG nova.policy [None req-d0a8c34c-19af-4754-a232-09be743b9f22 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '00f5cc88e43c434c8a061dcec472a16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7941f36c30b49408ae5709a1b75346d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75122) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 10:00:27 user nova-compute[75122]: DEBUG os_brick.utils [None req-d0a8c34c-19af-4754-a232-09be743b9f22 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 10:00:27 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:00:27 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:00:27 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ef6e147-6368-4a59-afd1-44460328013a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:742fb64b3587\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:00:27 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:00:27 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:00:27 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2acd6fa-7c1c-4844-945f-2924dc94679e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:00:27 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:00:27 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:00:27 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbd2d1dd-8424-42de-b4a3-2bbb606ec782]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:00:27 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[7211e2ce-4311-4e0c-ba8b-01b0eb5747e3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:00:27 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-d0a8c34c-19af-4754-a232-09be743b9f22 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Running cmd (subprocess): nvme version {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:00:27 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-d0a8c34c-19af-4754-a232-09be743b9f22 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] 'nvme version' failed. Not Retrying. {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 10:00:27 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d0a8c34c-19af-4754-a232-09be743b9f22 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] nvme not present on system {{(pid=75122) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 10:00:27 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:00:27 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 10:00:27 user nova-compute[75122]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 10:00:27 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fe62daf-d037-4c55-97ab-303d0f20384d]: (4, '') {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:00:27 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.lightos [None req-d0a8c34c-19af-4754-a232-09be743b9f22 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75122) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 10:00:27 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.lightos [None req-d0a8c34c-19af-4754-a232-09be743b9f22 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75122) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 10:00:27 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.lightos [None req-d0a8c34c-19af-4754-a232-09be743b9f22 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] LIGHTOS: no hostnqn found. {{(pid=75122) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 10:00:27 user nova-compute[75122]: DEBUG os_brick.utils [None req-d0a8c34c-19af-4754-a232-09be743b9f22 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] <== get_connector_properties: return (151ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:742fb64b3587', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 10:00:27 user nova-compute[75122]: DEBUG nova.virt.block_device [None req-d0a8c34c-19af-4754-a232-09be743b9f22 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 1f426091-b78a-4d40-bff4-a5c23f155e54] Updating existing volume attachment record: 2383bf77-0f35-48d0-9f6d-18142368d4ef {{(pid=75122) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 10:00:28 user nova-compute[75122]: DEBUG nova.network.neutron [None req-d0a8c34c-19af-4754-a232-09be743b9f22 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 1f426091-b78a-4d40-bff4-a5c23f155e54] Successfully created port: f096e3d4-b769-4e60-a355-52e3765faeb9 {{(pid=75122) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 10:00:28 user nova-compute[75122]: DEBUG nova.network.neutron [None req-d0a8c34c-19af-4754-a232-09be743b9f22 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 1f426091-b78a-4d40-bff4-a5c23f155e54] Successfully updated port: f096e3d4-b769-4e60-a355-52e3765faeb9 {{(pid=75122) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 10:00:28 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-d0a8c34c-19af-4754-a232-09be743b9f22 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Acquiring lock "refresh_cache-1f426091-b78a-4d40-bff4-a5c23f155e54" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 10:00:28 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-d0a8c34c-19af-4754-a232-09be743b9f22 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Acquired lock "refresh_cache-1f426091-b78a-4d40-bff4-a5c23f155e54" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 10:00:28 user nova-compute[75122]: DEBUG nova.network.neutron [None req-d0a8c34c-19af-4754-a232-09be743b9f22 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 1f426091-b78a-4d40-bff4-a5c23f155e54] Building network info cache for instance {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 10:00:28 user nova-compute[75122]: DEBUG nova.compute.manager [req-96058f56-f07d-46a5-a3ff-93b10fc6ea3b req-9c8584e8-eb60-4878-8125-be8746b87a0c service nova] [instance: 1f426091-b78a-4d40-bff4-a5c23f155e54] Received event network-changed-f096e3d4-b769-4e60-a355-52e3765faeb9 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 10:00:28 user nova-compute[75122]: DEBUG nova.compute.manager [req-96058f56-f07d-46a5-a3ff-93b10fc6ea3b req-9c8584e8-eb60-4878-8125-be8746b87a0c service nova] [instance: 1f426091-b78a-4d40-bff4-a5c23f155e54] Refreshing instance network info cache due to event network-changed-f096e3d4-b769-4e60-a355-52e3765faeb9. {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 10:00:28 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-96058f56-f07d-46a5-a3ff-93b10fc6ea3b req-9c8584e8-eb60-4878-8125-be8746b87a0c service nova] Acquiring lock "refresh_cache-1f426091-b78a-4d40-bff4-a5c23f155e54" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 10:00:28 user nova-compute[75122]: DEBUG nova.network.neutron [None req-d0a8c34c-19af-4754-a232-09be743b9f22 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 1f426091-b78a-4d40-bff4-a5c23f155e54] Instance cache missing network info. {{(pid=75122) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 10:00:29 user nova-compute[75122]: DEBUG nova.network.neutron [None req-d0a8c34c-19af-4754-a232-09be743b9f22 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 1f426091-b78a-4d40-bff4-a5c23f155e54] Updating instance_info_cache with network_info: [{"id": "f096e3d4-b769-4e60-a355-52e3765faeb9", "address": "fa:16:3e:cc:76:68", "network": {"id": "03073971-5253-4f06-a46a-94840841fd6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2056706757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7941f36c30b49408ae5709a1b75346d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf096e3d4-b7", "ovs_interfaceid": "f096e3d4-b769-4e60-a355-52e3765faeb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 10:00:29 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-d0a8c34c-19af-4754-a232-09be743b9f22 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Releasing lock "refresh_cache-1f426091-b78a-4d40-bff4-a5c23f155e54" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 10:00:29 user nova-compute[75122]: DEBUG nova.compute.manager [None req-d0a8c34c-19af-4754-a232-09be743b9f22 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 1f426091-b78a-4d40-bff4-a5c23f155e54] Instance network_info: |[{"id": "f096e3d4-b769-4e60-a355-52e3765faeb9", "address": "fa:16:3e:cc:76:68", "network": {"id": "03073971-5253-4f06-a46a-94840841fd6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2056706757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7941f36c30b49408ae5709a1b75346d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf096e3d4-b7", "ovs_interfaceid": "f096e3d4-b769-4e60-a355-52e3765faeb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75122) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 10:00:29 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-96058f56-f07d-46a5-a3ff-93b10fc6ea3b req-9c8584e8-eb60-4878-8125-be8746b87a0c service nova] Acquired lock "refresh_cache-1f426091-b78a-4d40-bff4-a5c23f155e54" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 10:00:29 user nova-compute[75122]: DEBUG nova.network.neutron [req-96058f56-f07d-46a5-a3ff-93b10fc6ea3b req-9c8584e8-eb60-4878-8125-be8746b87a0c service nova] [instance: 1f426091-b78a-4d40-bff4-a5c23f155e54] Refreshing network info cache for port f096e3d4-b769-4e60-a355-52e3765faeb9 {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 10:00:29 user nova-compute[75122]: DEBUG nova.network.neutron [req-96058f56-f07d-46a5-a3ff-93b10fc6ea3b req-9c8584e8-eb60-4878-8125-be8746b87a0c service nova] [instance: 1f426091-b78a-4d40-bff4-a5c23f155e54] Updated VIF entry in instance network info cache for port f096e3d4-b769-4e60-a355-52e3765faeb9. {{(pid=75122) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 10:00:29 user nova-compute[75122]: DEBUG nova.network.neutron [req-96058f56-f07d-46a5-a3ff-93b10fc6ea3b req-9c8584e8-eb60-4878-8125-be8746b87a0c service nova] [instance: 1f426091-b78a-4d40-bff4-a5c23f155e54] Updating instance_info_cache with network_info: [{"id": "f096e3d4-b769-4e60-a355-52e3765faeb9", "address": "fa:16:3e:cc:76:68", "network": {"id": "03073971-5253-4f06-a46a-94840841fd6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2056706757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7941f36c30b49408ae5709a1b75346d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf096e3d4-b7", "ovs_interfaceid": "f096e3d4-b769-4e60-a355-52e3765faeb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 10:00:29 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-96058f56-f07d-46a5-a3ff-93b10fc6ea3b req-9c8584e8-eb60-4878-8125-be8746b87a0c service nova] Releasing lock "refresh_cache-1f426091-b78a-4d40-bff4-a5c23f155e54" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 10:00:29 user nova-compute[75122]: DEBUG nova.compute.manager [None req-6c76eb02-da38-435f-abc5-ccec718c1da5 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: 4c8b3a13-761f-4491-a367-64e74f038629] Checking state {{(pid=75122) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 10:00:29 user nova-compute[75122]: INFO nova.compute.manager [None req-6c76eb02-da38-435f-abc5-ccec718c1da5 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: 4c8b3a13-761f-4491-a367-64e74f038629] instance snapshotting
Nov 15 10:00:29 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-6c76eb02-da38-435f-abc5-ccec718c1da5 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: 4c8b3a13-761f-4491-a367-64e74f038629] Beginning live snapshot process
Nov 15 10:00:30 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-6c76eb02-da38-435f-abc5-ccec718c1da5 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c8b3a13-761f-4491-a367-64e74f038629/disk --force-share --output=json -f qcow2 {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:00:30 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-6c76eb02-da38-435f-abc5-ccec718c1da5 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c8b3a13-761f-4491-a367-64e74f038629/disk --force-share --output=json -f qcow2" returned: 0 in 0.168s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:00:30 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-6c76eb02-da38-435f-abc5-ccec718c1da5 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c8b3a13-761f-4491-a367-64e74f038629/disk --force-share --output=json -f qcow2 {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:00:30 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-6c76eb02-da38-435f-abc5-ccec718c1da5 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c8b3a13-761f-4491-a367-64e74f038629/disk --force-share --output=json -f qcow2" returned: 0 in 0.172s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:00:30 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-6c76eb02-da38-435f-abc5-ccec718c1da5 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:00:30 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-6c76eb02-da38-435f-abc5-ccec718c1da5 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json" returned: 0 in 0.174s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:00:30 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-6c76eb02-da38-435f-abc5-ccec718c1da5 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpqvyfma90/ff4456393ba94732bc3345b1c65f41db.delta 1073741824 {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:00:30 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-6c76eb02-da38-435f-abc5-ccec718c1da5 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpqvyfma90/ff4456393ba94732bc3345b1c65f41db.delta 1073741824" returned: 0 in 0.053s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:00:30 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-6c76eb02-da38-435f-abc5-ccec718c1da5 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: 4c8b3a13-761f-4491-a367-64e74f038629] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 15 10:00:31 user nova-compute[75122]: DEBUG nova.virt.libvirt.guest [None req-6c76eb02-da38-435f-abc5-ccec718c1da5 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=75122) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 10:00:32 user nova-compute[75122]: DEBUG nova.virt.libvirt.guest [None req-6c76eb02-da38-435f-abc5-ccec718c1da5 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75122) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 10:00:32 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-6c76eb02-da38-435f-abc5-ccec718c1da5 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: 4c8b3a13-761f-4491-a367-64e74f038629] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 15 10:00:32 user nova-compute[75122]: DEBUG nova.privsep.utils [None req-6c76eb02-da38-435f-abc5-ccec718c1da5 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75122) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 10:00:32 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-6c76eb02-da38-435f-abc5-ccec718c1da5 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpqvyfma90/ff4456393ba94732bc3345b1c65f41db.delta /opt/stack/data/nova/instances/snapshots/tmpqvyfma90/ff4456393ba94732bc3345b1c65f41db {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:00:32 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:00:32 user nova-compute[75122]: DEBUG nova.compute.manager [None req-d0a8c34c-19af-4754-a232-09be743b9f22 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 1f426091-b78a-4d40-bff4-a5c23f155e54] Start spawning the instance on the hypervisor. {{(pid=75122) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 10:00:32 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-d0a8c34c-19af-4754-a232-09be743b9f22 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 1f426091-b78a-4d40-bff4-a5c23f155e54] Creating instance directory {{(pid=75122) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 10:00:32 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-d0a8c34c-19af-4754-a232-09be743b9f22 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 1f426091-b78a-4d40-bff4-a5c23f155e54] Creating image(s)
Nov 15 10:00:32 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-d0a8c34c-19af-4754-a232-09be743b9f22 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 1f426091-b78a-4d40-bff4-a5c23f155e54] Did not create local disks {{(pid=75122) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 10:00:32 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-d0a8c34c-19af-4754-a232-09be743b9f22 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 1f426091-b78a-4d40-bff4-a5c23f155e54] Ensure instance console log exists: /opt/stack/data/nova/instances/1f426091-b78a-4d40-bff4-a5c23f155e54/console.log {{(pid=75122) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 10:00:32 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-d0a8c34c-19af-4754-a232-09be743b9f22 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:00:32 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-d0a8c34c-19af-4754-a232-09be743b9f22 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:00:32 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-d0a8c34c-19af-4754-a232-09be743b9f22 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:00:32 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-d0a8c34c-19af-4754-a232-09be743b9f22 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 1f426091-b78a-4d40-bff4-a5c23f155e54] Start _get_guest_xml network_info=[{"id": "f096e3d4-b769-4e60-a355-52e3765faeb9", "address": "fa:16:3e:cc:76:68", "network": {"id": "03073971-5253-4f06-a46a-94840841fd6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2056706757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7941f36c30b49408ae5709a1b75346d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf096e3d4-b7", "ovs_interfaceid": "f096e3d4-b769-4e60-a355-52e3765faeb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2d703360-7eee-4b0b-9b1d-a42e2170de6c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PbeLrWDj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '1f426091-b78a-4d40-bff4-a5c23f155e54', 'attached_at': '', 'detached_at': '', 'volume_id': '2d703360-7eee-4b0b-9b1d-a42e2170de6c', 'serial': '2d703360-7eee-4b0b-9b1d-a42e2170de6c'}, 'guest_format': None, 'delete_on_termination': True, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vda', 'attachment_id': '2383bf77-0f35-48d0-9f6d-18142368d4ef', 'volume_type': None} {{(pid=75122) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 10:00:32 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-d0a8c34c-19af-4754-a232-09be743b9f22 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 10:00:32 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-d0a8c34c-19af-4754-a232-09be743b9f22 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 10:00:32 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-d0a8c34c-19af-4754-a232-09be743b9f22 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75122) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 10:00:32 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-d0a8c34c-19af-4754-a232-09be743b9f22 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] CPU controller missing on host. {{(pid=75122) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 10:00:32 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-d0a8c34c-19af-4754-a232-09be743b9f22 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75122) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 10:00:32 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-d0a8c34c-19af-4754-a232-09be743b9f22 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] CPU controller found on host. {{(pid=75122) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 10:00:32 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-d0a8c34c-19af-4754-a232-09be743b9f22 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75122) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 10:00:32 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-d0a8c34c-19af-4754-a232-09be743b9f22 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T09:26:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 10:00:32 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-d0a8c34c-19af-4754-a232-09be743b9f22 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Flavor limits 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 10:00:32 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-d0a8c34c-19af-4754-a232-09be743b9f22 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Image limits 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 10:00:32 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-d0a8c34c-19af-4754-a232-09be743b9f22 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Flavor pref 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 10:00:32 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-d0a8c34c-19af-4754-a232-09be743b9f22 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Image pref 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 10:00:32 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-d0a8c34c-19af-4754-a232-09be743b9f22 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 10:00:32 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-d0a8c34c-19af-4754-a232-09be743b9f22 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 10:00:32 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-d0a8c34c-19af-4754-a232-09be743b9f22 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75122) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 10:00:32 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-d0a8c34c-19af-4754-a232-09be743b9f22 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Got 1 possible topologies {{(pid=75122) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 10:00:32 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-d0a8c34c-19af-4754-a232-09be743b9f22 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 10:00:32 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-d0a8c34c-19af-4754-a232-09be743b9f22 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 10:00:32 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d0a8c34c-19af-4754-a232-09be743b9f22 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 1f426091-b78a-4d40-bff4-a5c23f155e54] Calling os-brick to attach iSCSI Volume {{(pid=75122) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 10:00:32 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0a8c34c-19af-4754-a232-09be743b9f22 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffa04060b80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2d703360-7eee-4b0b-9b1d-a42e2170de6c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PbeLrWDj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 10:00:32 user nova-compute[75122]: WARNING os_brick.initiator.connectors.base [None req-d0a8c34c-19af-4754-a232-09be743b9f22 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 10:00:32 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-d0a8c34c-19af-4754-a232-09be743b9f22 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 10:00:32 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-d0a8c34c-19af-4754-a232-09be743b9f22 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 10:00:32 user nova-compute[75122]: WARNING os_brick.initiator.connectors.base [None req-d0a8c34c-19af-4754-a232-09be743b9f22 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 10:00:32 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-d0a8c34c-19af-4754-a232-09be743b9f22 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2d703360-7eee-4b0b-9b1d-a42e2170de6c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 10:00:32 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-d0a8c34c-19af-4754-a232-09be743b9f22 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2d703360-7eee-4b0b-9b1d-a42e2170de6c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 10:00:32 user nova-compute[75122]: INFO os_brick.initiator.connectors.iscsi [None req-d0a8c34c-19af-4754-a232-09be743b9f22 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 10:00:32 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d703360-7eee-4b0b-9b1d-a42e2170de6c -p 172.16.0.220:3260 {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:00:32 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d703360-7eee-4b0b-9b1d-a42e2170de6c -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:00:32 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d1d9f8d-9f09-4bd3-804b-566cdbffef95]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:00:32 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0a8c34c-19af-4754-a232-09be743b9f22 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 10:00:32 user nova-compute[75122]:  {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 10:00:32 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d703360-7eee-4b0b-9b1d-a42e2170de6c -p 172.16.0.220:3260 --interface default --op new {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:00:32 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d703360-7eee-4b0b-9b1d-a42e2170de6c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:00:32 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[997ffb13-b1a5-4e5c-b789-73f90a3e9bd1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2d703360-7eee-4b0b-9b1d-a42e2170de6c] added\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:00:32 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0a8c34c-19af-4754-a232-09be743b9f22 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2d703360-7eee-4b0b-9b1d-a42e2170de6c] added
Nov 15 10:00:32 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 10:00:32 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d703360-7eee-4b0b-9b1d-a42e2170de6c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:00:32 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-6c76eb02-da38-435f-abc5-ccec718c1da5 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpqvyfma90/ff4456393ba94732bc3345b1c65f41db.delta /opt/stack/data/nova/instances/snapshots/tmpqvyfma90/ff4456393ba94732bc3345b1c65f41db" returned: 0 in 0.538s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:00:32 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-6c76eb02-da38-435f-abc5-ccec718c1da5 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: 4c8b3a13-761f-4491-a367-64e74f038629] Snapshot extracted, beginning image upload
Nov 15 10:00:32 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d703360-7eee-4b0b-9b1d-a42e2170de6c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:00:32 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[cadd9fe9-8594-4ba5-b7c4-dee5913db5e6]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:00:32 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0a8c34c-19af-4754-a232-09be743b9f22 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 10:00:32 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d703360-7eee-4b0b-9b1d-a42e2170de6c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:00:32 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d703360-7eee-4b0b-9b1d-a42e2170de6c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:00:32 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[665f06d0-41ae-45ba-b77c-d32bd41da4f5]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:00:32 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0a8c34c-19af-4754-a232-09be743b9f22 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 10:00:32 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d703360-7eee-4b0b-9b1d-a42e2170de6c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PbeLrWDj {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:00:32 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d703360-7eee-4b0b-9b1d-a42e2170de6c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PbeLrWDj" returned: 0 in 0.019s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:00:32 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d81b321-cd6c-425a-b5c3-6aed52b60aa8]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:00:32 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0a8c34c-19af-4754-a232-09be743b9f22 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PbeLrWDj'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 10:00:32 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d703360-7eee-4b0b-9b1d-a42e2170de6c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:00:32 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d703360-7eee-4b0b-9b1d-a42e2170de6c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:00:32 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fa4dcbf-a45d-4869-8156-0719729bed4f]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:00:32 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0a8c34c-19af-4754-a232-09be743b9f22 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 10:00:32 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:00:32 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:00:32 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcab428e-ef1e-45b4-8da0-3b384a1a93b0]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee79db2-27c2-4d0f-8ee6-5b03e05ebba5 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d42739d6-477a-4322-ad52-6491b80a4a48 (non-flash)\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:00:32 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0a8c34c-19af-4754-a232-09be743b9f22 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee79db2-27c2-4d0f-8ee6-5b03e05ebba5 (non-flash)
Nov 15 10:00:32 user nova-compute[75122]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d42739d6-477a-4322-ad52-6491b80a4a48 (non-flash)
Nov 15 10:00:32 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 10:00:32 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0a8c34c-19af-4754-a232-09be743b9f22 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee79db2-27c2-4d0f-8ee6-5b03e05ebba5 (non-flash)
Nov 15 10:00:32 user nova-compute[75122]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d42739d6-477a-4322-ad52-6491b80a4a48 (non-flash)
Nov 15 10:00:32 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 10:00:32 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d703360-7eee-4b0b-9b1d-a42e2170de6c -p 172.16.0.220:3260 --login {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:00:32 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d703360-7eee-4b0b-9b1d-a42e2170de6c -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:00:32 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[4476de00-4d76-426f-83ba-cfc4f9bc44c7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2d703360-7eee-4b0b-9b1d-a42e2170de6c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2d703360-7eee-4b0b-9b1d-a42e2170de6c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:00:32 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0a8c34c-19af-4754-a232-09be743b9f22 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2d703360-7eee-4b0b-9b1d-a42e2170de6c, portal: 172.16.0.220,3260]
Nov 15 10:00:32 user nova-compute[75122]: Login to [iface: default, target: iqn.2010-10.org.openstack:2d703360-7eee-4b0b-9b1d-a42e2170de6c, portal: 172.16.0.220,3260] successful.
Nov 15 10:00:32 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 10:00:32 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d703360-7eee-4b0b-9b1d-a42e2170de6c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:00:32 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d703360-7eee-4b0b-9b1d-a42e2170de6c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:00:32 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac5061d4-2735-4a83-8060-e4caee8163e1]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:00:32 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0a8c34c-19af-4754-a232-09be743b9f22 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 10:00:32 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:00:32 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:00:32 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[c274007d-0b8c-4893-9ed4-8e9041d74086]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee79db2-27c2-4d0f-8ee6-5b03e05ebba5 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d42739d6-477a-4322-ad52-6491b80a4a48 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d703360-7eee-4b0b-9b1d-a42e2170de6c (non-flash)\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:00:32 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0a8c34c-19af-4754-a232-09be743b9f22 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee79db2-27c2-4d0f-8ee6-5b03e05ebba5 (non-flash)
Nov 15 10:00:32 user nova-compute[75122]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d42739d6-477a-4322-ad52-6491b80a4a48 (non-flash)
Nov 15 10:00:32 user nova-compute[75122]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d703360-7eee-4b0b-9b1d-a42e2170de6c (non-flash)
Nov 15 10:00:32 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 10:00:32 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0a8c34c-19af-4754-a232-09be743b9f22 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee79db2-27c2-4d0f-8ee6-5b03e05ebba5 (non-flash)
Nov 15 10:00:32 user nova-compute[75122]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d42739d6-477a-4322-ad52-6491b80a4a48 (non-flash)
Nov 15 10:00:32 user nova-compute[75122]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d703360-7eee-4b0b-9b1d-a42e2170de6c (non-flash)
Nov 15 10:00:32 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 10:00:32 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-d0a8c34c-19af-4754-a232-09be743b9f22 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2d703360-7eee-4b0b-9b1d-a42e2170de6c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.334s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 10:00:32 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0a8c34c-19af-4754-a232-09be743b9f22 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Connected to 172.16.0.220:3260 {{(pid=75122) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 10:00:32 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-d0a8c34c-19af-4754-a232-09be743b9f22 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] HCTL ('34', '-', '-', 0) found on session 52 with lun 0 {{(pid=75122) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 10:00:32 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-d0a8c34c-19af-4754-a232-09be743b9f22 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75122) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 10:00:32 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:00:32 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:00:32 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd97918f-8870-49cd-bd70-3ff11138ce23]: (4, ('- - 0', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:00:32 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-d0a8c34c-19af-4754-a232-09be743b9f22 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Searching for a device in session 52 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75122) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 10:00:32 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0a8c34c-19af-4754-a232-09be743b9f22 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:2d703360-7eee-4b0b-9b1d-a42e2170de6c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PbeLrWDj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75122) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 10:00:33 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-d0a8c34c-19af-4754-a232-09be743b9f22 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.365s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 10:00:33 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0a8c34c-19af-4754-a232-09be743b9f22 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] <== connect_volume: return (1366ms) {'type': 'block', 'scsi_wwn': '26331316464623261', 'path': '/dev/sdc'} {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 10:00:33 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d0a8c34c-19af-4754-a232-09be743b9f22 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 1f426091-b78a-4d40-bff4-a5c23f155e54] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26331316464623261', 'path': '/dev/sdc'} {{(pid=75122) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 10:00:33 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-d0a8c34c-19af-4754-a232-09be743b9f22 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T10:00:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1834533455',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1834533455',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1834533455',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFv9ey23GI3cfdrs8WtI+94p+2HeOim4GqGQ2CzDpuC8PZXSPGarxzIQdboWmdQjsPVPOShvpZrEssd9J05BIqWp+W2XIB0KG00TY9OfBaGF5DpizQ83Pnp6p2L5Cj2Wpw==',key_name='tempest-keypair-146489',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c7941f36c30b49408ae5709a1b75346d',ramdisk_id='',reservation_id='r-y6i6a02s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-296749341',owner_user_name='tempest-TestVolumeBootPattern-296749341-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T10:00:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='00f5cc88e43c434c8a061dcec472a16b',uuid=1f426091-b78a-4d40-bff4-a5c23f155e54,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f096e3d4-b769-4e60-a355-52e3765faeb9", "address": "fa:16:3e:cc:76:68", "network": {"id": "03073971-5253-4f06-a46a-94840841fd6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2056706757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7941f36c30b49408ae5709a1b75346d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf096e3d4-b7", "ovs_interfaceid": "f096e3d4-b769-4e60-a355-52e3765faeb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75122) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 10:00:33 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-d0a8c34c-19af-4754-a232-09be743b9f22 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Converting VIF {"id": "f096e3d4-b769-4e60-a355-52e3765faeb9", "address": "fa:16:3e:cc:76:68", "network": {"id": "03073971-5253-4f06-a46a-94840841fd6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2056706757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7941f36c30b49408ae5709a1b75346d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf096e3d4-b7", "ovs_interfaceid": "f096e3d4-b769-4e60-a355-52e3765faeb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 10:00:33 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-d0a8c34c-19af-4754-a232-09be743b9f22 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:76:68,bridge_name='br-int',has_traffic_filtering=True,id=f096e3d4-b769-4e60-a355-52e3765faeb9,network=Network(03073971-5253-4f06-a46a-94840841fd6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf096e3d4-b7') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 10:00:33 user nova-compute[75122]: DEBUG nova.objects.instance [None req-d0a8c34c-19af-4754-a232-09be743b9f22 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Lazy-loading 'pci_devices' on Instance uuid 1f426091-b78a-4d40-bff4-a5c23f155e54 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 10:00:34 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-d0a8c34c-19af-4754-a232-09be743b9f22 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 1f426091-b78a-4d40-bff4-a5c23f155e54] End _get_guest_xml xml=<domain type="kvm">
Nov 15 10:00:34 user nova-compute[75122]:   <uuid>1f426091-b78a-4d40-bff4-a5c23f155e54</uuid>
Nov 15 10:00:34 user nova-compute[75122]:   <name>instance-0000002c</name>
Nov 15 10:00:34 user nova-compute[75122]:   <memory>524288</memory>
Nov 15 10:00:34 user nova-compute[75122]:   <vcpu>1</vcpu>
Nov 15 10:00:34 user nova-compute[75122]:   <metadata>
Nov 15 10:00:34 user nova-compute[75122]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 10:00:34 user nova-compute[75122]:       <nova:package version="0.0.0"/>
Nov 15 10:00:34 user nova-compute[75122]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-1834533455</nova:name>
Nov 15 10:00:34 user nova-compute[75122]:       <nova:creationTime>2023-11-15 10:00:32</nova:creationTime>
Nov 15 10:00:34 user nova-compute[75122]:       <nova:flavor name="m1.tiny">
Nov 15 10:00:34 user nova-compute[75122]:         <nova:memory>512</nova:memory>
Nov 15 10:00:34 user nova-compute[75122]:         <nova:disk>1</nova:disk>
Nov 15 10:00:34 user nova-compute[75122]:         <nova:swap>0</nova:swap>
Nov 15 10:00:34 user nova-compute[75122]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 10:00:34 user nova-compute[75122]:         <nova:vcpus>1</nova:vcpus>
Nov 15 10:00:34 user nova-compute[75122]:       </nova:flavor>
Nov 15 10:00:34 user nova-compute[75122]:       <nova:owner>
Nov 15 10:00:34 user nova-compute[75122]:         <nova:user uuid="00f5cc88e43c434c8a061dcec472a16b">tempest-TestVolumeBootPattern-296749341-project-member</nova:user>
Nov 15 10:00:34 user nova-compute[75122]:         <nova:project uuid="c7941f36c30b49408ae5709a1b75346d">tempest-TestVolumeBootPattern-296749341</nova:project>
Nov 15 10:00:34 user nova-compute[75122]:       </nova:owner>
Nov 15 10:00:34 user nova-compute[75122]:       <nova:ports>
Nov 15 10:00:34 user nova-compute[75122]:         <nova:port uuid="f096e3d4-b769-4e60-a355-52e3765faeb9">
Nov 15 10:00:34 user nova-compute[75122]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 15 10:00:34 user nova-compute[75122]:         </nova:port>
Nov 15 10:00:34 user nova-compute[75122]:       </nova:ports>
Nov 15 10:00:34 user nova-compute[75122]:     </nova:instance>
Nov 15 10:00:34 user nova-compute[75122]:   </metadata>
Nov 15 10:00:34 user nova-compute[75122]:   <sysinfo type="smbios">
Nov 15 10:00:34 user nova-compute[75122]:     <system>
Nov 15 10:00:34 user nova-compute[75122]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 10:00:34 user nova-compute[75122]:       <entry name="product">OpenStack Nova</entry>
Nov 15 10:00:34 user nova-compute[75122]:       <entry name="version">0.0.0</entry>
Nov 15 10:00:34 user nova-compute[75122]:       <entry name="serial">1f426091-b78a-4d40-bff4-a5c23f155e54</entry>
Nov 15 10:00:34 user nova-compute[75122]:       <entry name="uuid">1f426091-b78a-4d40-bff4-a5c23f155e54</entry>
Nov 15 10:00:34 user nova-compute[75122]:       <entry name="family">Virtual Machine</entry>
Nov 15 10:00:34 user nova-compute[75122]:     </system>
Nov 15 10:00:34 user nova-compute[75122]:   </sysinfo>
Nov 15 10:00:34 user nova-compute[75122]:   <os>
Nov 15 10:00:34 user nova-compute[75122]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 10:00:34 user nova-compute[75122]:     <boot dev="hd"/>
Nov 15 10:00:34 user nova-compute[75122]:     <smbios mode="sysinfo"/>
Nov 15 10:00:34 user nova-compute[75122]:   </os>
Nov 15 10:00:34 user nova-compute[75122]:   <features>
Nov 15 10:00:34 user nova-compute[75122]:     <acpi/>
Nov 15 10:00:34 user nova-compute[75122]:     <apic/>
Nov 15 10:00:34 user nova-compute[75122]:     <vmcoreinfo/>
Nov 15 10:00:34 user nova-compute[75122]:   </features>
Nov 15 10:00:34 user nova-compute[75122]:   <clock offset="utc">
Nov 15 10:00:34 user nova-compute[75122]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 10:00:34 user nova-compute[75122]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 10:00:34 user nova-compute[75122]:     <timer name="hpet" present="no"/>
Nov 15 10:00:34 user nova-compute[75122]:   </clock>
Nov 15 10:00:34 user nova-compute[75122]:   <cpu mode="custom" match="exact">
Nov 15 10:00:34 user nova-compute[75122]:     <model>Nehalem</model>
Nov 15 10:00:34 user nova-compute[75122]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 10:00:34 user nova-compute[75122]:   </cpu>
Nov 15 10:00:34 user nova-compute[75122]:   <devices>
Nov 15 10:00:34 user nova-compute[75122]:     <disk type="block" device="disk">
Nov 15 10:00:34 user nova-compute[75122]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 10:00:34 user nova-compute[75122]:       <source dev="/dev/sdc"/>
Nov 15 10:00:34 user nova-compute[75122]:       <target dev="vda" bus="virtio"/>
Nov 15 10:00:34 user nova-compute[75122]:       <serial>2d703360-7eee-4b0b-9b1d-a42e2170de6c</serial>
Nov 15 10:00:34 user nova-compute[75122]:     </disk>
Nov 15 10:00:34 user nova-compute[75122]:     <interface type="ethernet">
Nov 15 10:00:34 user nova-compute[75122]:       <mac address="fa:16:3e:cc:76:68"/>
Nov 15 10:00:34 user nova-compute[75122]:       <model type="virtio"/>
Nov 15 10:00:34 user nova-compute[75122]:       <mtu size="1442"/>
Nov 15 10:00:34 user nova-compute[75122]:       <target dev="tapf096e3d4-b7"/>
Nov 15 10:00:34 user nova-compute[75122]:     </interface>
Nov 15 10:00:34 user nova-compute[75122]:     <serial type="pty">
Nov 15 10:00:34 user nova-compute[75122]:       <log file="/opt/stack/data/nova/instances/1f426091-b78a-4d40-bff4-a5c23f155e54/console.log" append="off"/>
Nov 15 10:00:34 user nova-compute[75122]:     </serial>
Nov 15 10:00:34 user nova-compute[75122]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 10:00:34 user nova-compute[75122]:     <video>
Nov 15 10:00:34 user nova-compute[75122]:       <model type="virtio"/>
Nov 15 10:00:34 user nova-compute[75122]:     </video>
Nov 15 10:00:34 user nova-compute[75122]:     <rng model="virtio">
Nov 15 10:00:34 user nova-compute[75122]:       <backend model="random">/dev/urandom</backend>
Nov 15 10:00:34 user nova-compute[75122]:     </rng>
Nov 15 10:00:34 user nova-compute[75122]:     <controller type="usb" index="0" model="none"/>
Nov 15 10:00:34 user nova-compute[75122]:     <memballoon model="virtio">
Nov 15 10:00:34 user nova-compute[75122]:       <stats period="10"/>
Nov 15 10:00:34 user nova-compute[75122]:     </memballoon>
Nov 15 10:00:34 user nova-compute[75122]:   </devices>
Nov 15 10:00:34 user nova-compute[75122]: </domain>
Nov 15 10:00:34 user nova-compute[75122]:  {{(pid=75122) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 10:00:34 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-d0a8c34c-19af-4754-a232-09be743b9f22 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T10:00:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1834533455',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1834533455',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1834533455',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFv9ey23GI3cfdrs8WtI+94p+2HeOim4GqGQ2CzDpuC8PZXSPGarxzIQdboWmdQjsPVPOShvpZrEssd9J05BIqWp+W2XIB0KG00TY9OfBaGF5DpizQ83Pnp6p2L5Cj2Wpw==',key_name='tempest-keypair-146489',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c7941f36c30b49408ae5709a1b75346d',ramdisk_id='',reservation_id='r-y6i6a02s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-296749341',owner_user_name='tempest-TestVolumeBootPattern-296749341-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T10:00:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='00f5cc88e43c434c8a061dcec472a16b',uuid=1f426091-b78a-4d40-bff4-a5c23f155e54,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f096e3d4-b769-4e60-a355-52e3765faeb9", "address": "fa:16:3e:cc:76:68", "network": {"id": "03073971-5253-4f06-a46a-94840841fd6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2056706757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7941f36c30b49408ae5709a1b75346d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf096e3d4-b7", "ovs_interfaceid": "f096e3d4-b769-4e60-a355-52e3765faeb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 10:00:34 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-d0a8c34c-19af-4754-a232-09be743b9f22 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Converting VIF {"id": "f096e3d4-b769-4e60-a355-52e3765faeb9", "address": "fa:16:3e:cc:76:68", "network": {"id": "03073971-5253-4f06-a46a-94840841fd6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2056706757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7941f36c30b49408ae5709a1b75346d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf096e3d4-b7", "ovs_interfaceid": "f096e3d4-b769-4e60-a355-52e3765faeb9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 10:00:34 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-d0a8c34c-19af-4754-a232-09be743b9f22 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:76:68,bridge_name='br-int',has_traffic_filtering=True,id=f096e3d4-b769-4e60-a355-52e3765faeb9,network=Network(03073971-5253-4f06-a46a-94840841fd6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf096e3d4-b7') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 10:00:34 user nova-compute[75122]: DEBUG os_vif [None req-d0a8c34c-19af-4754-a232-09be743b9f22 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:76:68,bridge_name='br-int',has_traffic_filtering=True,id=f096e3d4-b769-4e60-a355-52e3765faeb9,network=Network(03073971-5253-4f06-a46a-94840841fd6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf096e3d4-b7') {{(pid=75122) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 10:00:34 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:00:34 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:00:34 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 10:00:34 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 10:00:34 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:00:34 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:00:34 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '97ab5163-5978-5707-bce2-05a30f944d6f', '_type': 'linux-noop'}}, row=False) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 10:00:34 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:00:34 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:00:34 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:00:34 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:00:34 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf096e3d4-b7, may_exist=True, interface_attrs={}) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 10:00:34 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf096e3d4-b7, col_values=(('qos', UUID('e1563e57-6b58-4a8f-a7b2-cdb0dce1d901')),), if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 10:00:34 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf096e3d4-b7, col_values=(('external_ids', {'iface-id': 'f096e3d4-b769-4e60-a355-52e3765faeb9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cc:76:68', 'vm-uuid': '1f426091-b78a-4d40-bff4-a5c23f155e54'}),), if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 10:00:34 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:00:34 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:00:34 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:00:34 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75122) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 10:00:34 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:00:34 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:00:34 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:00:34 user nova-compute[75122]: INFO os_vif [None req-d0a8c34c-19af-4754-a232-09be743b9f22 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:76:68,bridge_name='br-int',has_traffic_filtering=True,id=f096e3d4-b769-4e60-a355-52e3765faeb9,network=Network(03073971-5253-4f06-a46a-94840841fd6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf096e3d4-b7')
Nov 15 10:00:34 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-d0a8c34c-19af-4754-a232-09be743b9f22 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] No BDM found with device name vda, not building metadata. {{(pid=75122) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 10:00:34 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-d0a8c34c-19af-4754-a232-09be743b9f22 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] No VIF found with MAC fa:16:3e:cc:76:68, not building metadata {{(pid=75122) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 10:00:34 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c8b3a13-761f-4491-a367-64e74f038629/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:00:34 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c8b3a13-761f-4491-a367-64e74f038629/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:00:34 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c8b3a13-761f-4491-a367-64e74f038629/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:00:34 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c8b3a13-761f-4491-a367-64e74f038629/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:00:35 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-6c76eb02-da38-435f-abc5-ccec718c1da5 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: 4c8b3a13-761f-4491-a367-64e74f038629] Snapshot image upload complete
Nov 15 10:00:35 user nova-compute[75122]: INFO nova.compute.manager [None req-6c76eb02-da38-435f-abc5-ccec718c1da5 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: 4c8b3a13-761f-4491-a367-64e74f038629] Took 5.62 seconds to snapshot the instance on the hypervisor.
Nov 15 10:00:35 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:00:35 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:00:35 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:00:35 user nova-compute[75122]: DEBUG nova.compute.manager [req-ff8742b4-fdd1-4e38-8f22-7ef33a3bfe52 req-769398e6-693c-4099-bc1f-88eaeca52332 service nova] [instance: 1f426091-b78a-4d40-bff4-a5c23f155e54] Received event network-vif-plugged-f096e3d4-b769-4e60-a355-52e3765faeb9 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 10:00:35 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-ff8742b4-fdd1-4e38-8f22-7ef33a3bfe52 req-769398e6-693c-4099-bc1f-88eaeca52332 service nova] Acquiring lock "1f426091-b78a-4d40-bff4-a5c23f155e54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:00:35 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-ff8742b4-fdd1-4e38-8f22-7ef33a3bfe52 req-769398e6-693c-4099-bc1f-88eaeca52332 service nova] Lock "1f426091-b78a-4d40-bff4-a5c23f155e54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:00:35 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-ff8742b4-fdd1-4e38-8f22-7ef33a3bfe52 req-769398e6-693c-4099-bc1f-88eaeca52332 service nova] Lock "1f426091-b78a-4d40-bff4-a5c23f155e54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:00:35 user nova-compute[75122]: DEBUG nova.compute.manager [req-ff8742b4-fdd1-4e38-8f22-7ef33a3bfe52 req-769398e6-693c-4099-bc1f-88eaeca52332 service nova] [instance: 1f426091-b78a-4d40-bff4-a5c23f155e54] No waiting events found dispatching network-vif-plugged-f096e3d4-b769-4e60-a355-52e3765faeb9 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 10:00:35 user nova-compute[75122]: WARNING nova.compute.manager [req-ff8742b4-fdd1-4e38-8f22-7ef33a3bfe52 req-769398e6-693c-4099-bc1f-88eaeca52332 service nova] [instance: 1f426091-b78a-4d40-bff4-a5c23f155e54] Received unexpected event network-vif-plugged-f096e3d4-b769-4e60-a355-52e3765faeb9 for instance with vm_state building and task_state spawning.
Nov 15 10:00:36 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75122) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 10:00:36 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/001d589e-1bee-42da-8422-233ba796fbab/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:00:36 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:00:36 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/001d589e-1bee-42da-8422-233ba796fbab/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:00:36 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/001d589e-1bee-42da-8422-233ba796fbab/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:00:36 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:00:36 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:00:36 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/001d589e-1bee-42da-8422-233ba796fbab/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:00:36 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be71985e-a370-43d9-adef-afb31d03e2fd/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:00:36 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be71985e-a370-43d9-adef-afb31d03e2fd/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:00:36 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be71985e-a370-43d9-adef-afb31d03e2fd/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:00:36 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:00:36 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be71985e-a370-43d9-adef-afb31d03e2fd/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:00:36 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75122) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 10:00:36 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ad77a91-bc65-44a8-8ced-fd2ad9237946/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:00:36 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ad77a91-bc65-44a8-8ced-fd2ad9237946/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:00:36 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ad77a91-bc65-44a8-8ced-fd2ad9237946/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:00:37 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ad77a91-bc65-44a8-8ced-fd2ad9237946/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:00:37 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75122) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 10:00:37 user nova-compute[75122]: DEBUG nova.compute.manager [req-69d5fdf7-a70c-4fa9-8fe3-2e60aeade40c req-1bcd238b-88ab-4161-ad43-7bf3cd98c678 service nova] [instance: 1f426091-b78a-4d40-bff4-a5c23f155e54] Received event network-vif-plugged-f096e3d4-b769-4e60-a355-52e3765faeb9 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 10:00:37 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-69d5fdf7-a70c-4fa9-8fe3-2e60aeade40c req-1bcd238b-88ab-4161-ad43-7bf3cd98c678 service nova] Acquiring lock "1f426091-b78a-4d40-bff4-a5c23f155e54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:00:37 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-69d5fdf7-a70c-4fa9-8fe3-2e60aeade40c req-1bcd238b-88ab-4161-ad43-7bf3cd98c678 service nova] Lock "1f426091-b78a-4d40-bff4-a5c23f155e54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:00:37 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-69d5fdf7-a70c-4fa9-8fe3-2e60aeade40c req-1bcd238b-88ab-4161-ad43-7bf3cd98c678 service nova] Lock "1f426091-b78a-4d40-bff4-a5c23f155e54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:00:37 user nova-compute[75122]: DEBUG nova.compute.manager [req-69d5fdf7-a70c-4fa9-8fe3-2e60aeade40c req-1bcd238b-88ab-4161-ad43-7bf3cd98c678 service nova] [instance: 1f426091-b78a-4d40-bff4-a5c23f155e54] No waiting events found dispatching network-vif-plugged-f096e3d4-b769-4e60-a355-52e3765faeb9 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 10:00:37 user nova-compute[75122]: WARNING nova.compute.manager [req-69d5fdf7-a70c-4fa9-8fe3-2e60aeade40c req-1bcd238b-88ab-4161-ad43-7bf3cd98c678 service nova] [instance: 1f426091-b78a-4d40-bff4-a5c23f155e54] Received unexpected event network-vif-plugged-f096e3d4-b769-4e60-a355-52e3765faeb9 for instance with vm_state building and task_state spawning.
Nov 15 10:00:37 user nova-compute[75122]: DEBUG nova.compute.manager [None req-d0a8c34c-19af-4754-a232-09be743b9f22 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 1f426091-b78a-4d40-bff4-a5c23f155e54] Instance event wait completed in 0 seconds for  {{(pid=75122) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 10:00:37 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-d0a8c34c-19af-4754-a232-09be743b9f22 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 1f426091-b78a-4d40-bff4-a5c23f155e54] Guest created on hypervisor {{(pid=75122) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 10:00:37 user nova-compute[75122]: INFO nova.virt.libvirt.driver [-] [instance: 1f426091-b78a-4d40-bff4-a5c23f155e54] Instance spawned successfully.
Nov 15 10:00:37 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 10:00:37 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 10:00:37 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Hypervisor/Node resource view: name=user free_ram=8681MB free_disk=25.022830963134766GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75122) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 10:00:37 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:00:37 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:00:37 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-d0a8c34c-19af-4754-a232-09be743b9f22 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 1f426091-b78a-4d40-bff4-a5c23f155e54] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 10:00:37 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-d0a8c34c-19af-4754-a232-09be743b9f22 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 1f426091-b78a-4d40-bff4-a5c23f155e54] Found default for hw_cdrom_bus of ide {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 10:00:37 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-d0a8c34c-19af-4754-a232-09be743b9f22 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 1f426091-b78a-4d40-bff4-a5c23f155e54] Found default for hw_disk_bus of virtio {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 10:00:37 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-d0a8c34c-19af-4754-a232-09be743b9f22 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 1f426091-b78a-4d40-bff4-a5c23f155e54] Found default for hw_input_bus of None {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 10:00:37 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-d0a8c34c-19af-4754-a232-09be743b9f22 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 1f426091-b78a-4d40-bff4-a5c23f155e54] Found default for hw_pointer_model of None {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 10:00:37 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-d0a8c34c-19af-4754-a232-09be743b9f22 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 1f426091-b78a-4d40-bff4-a5c23f155e54] Found default for hw_video_model of virtio {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 10:00:37 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-d0a8c34c-19af-4754-a232-09be743b9f22 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 1f426091-b78a-4d40-bff4-a5c23f155e54] Found default for hw_vif_model of virtio {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 10:00:38 user nova-compute[75122]: INFO nova.compute.manager [None req-d0a8c34c-19af-4754-a232-09be743b9f22 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 1f426091-b78a-4d40-bff4-a5c23f155e54] Took 5.60 seconds to spawn the instance on the hypervisor.
Nov 15 10:00:38 user nova-compute[75122]: DEBUG nova.compute.manager [None req-d0a8c34c-19af-4754-a232-09be743b9f22 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 1f426091-b78a-4d40-bff4-a5c23f155e54] Checking state {{(pid=75122) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 10:00:38 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance 001d589e-1bee-42da-8422-233ba796fbab actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 10:00:38 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance db848537-676f-464a-806d-febb14d920a6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 10:00:38 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance be71985e-a370-43d9-adef-afb31d03e2fd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 10:00:38 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance 9ad77a91-bc65-44a8-8ced-fd2ad9237946 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 10:00:38 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance 4c8b3a13-761f-4491-a367-64e74f038629 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 10:00:38 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance 1f426091-b78a-4d40-bff4-a5c23f155e54 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 10:00:38 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=75122) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 10:00:38 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=75122) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 10:00:38 user nova-compute[75122]: INFO nova.compute.manager [None req-d0a8c34c-19af-4754-a232-09be743b9f22 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 1f426091-b78a-4d40-bff4-a5c23f155e54] Took 11.56 seconds to build instance.
Nov 15 10:00:38 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-d0a8c34c-19af-4754-a232-09be743b9f22 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Lock "1f426091-b78a-4d40-bff4-a5c23f155e54" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.661s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:00:38 user nova-compute[75122]: DEBUG nova.compute.provider_tree [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Inventory has not changed in ProviderTree for provider: 69a3da65-47be-44c6-b67c-c692b58284ef {{(pid=75122) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 10:00:38 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Inventory has not changed for provider 69a3da65-47be-44c6-b67c-c692b58284ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 10:00:38 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Compute_service record updated for user:user {{(pid=75122) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 10:00:38 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.356s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:00:39 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:00:41 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:00:41 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:00:41 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:00:41 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:00:41 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:00:41 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:00:41 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75122) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 10:00:41 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:00:42 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:00:42 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Starting heal instance info cache {{(pid=75122) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 10:00:42 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "refresh_cache-db848537-676f-464a-806d-febb14d920a6" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 10:00:42 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquired lock "refresh_cache-db848537-676f-464a-806d-febb14d920a6" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 10:00:42 user nova-compute[75122]: DEBUG nova.network.neutron [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] [instance: db848537-676f-464a-806d-febb14d920a6] Forcefully refreshing network info cache for instance {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 10:00:42 user nova-compute[75122]: DEBUG nova.network.neutron [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] [instance: db848537-676f-464a-806d-febb14d920a6] Updating instance_info_cache with network_info: [{"id": "93bbff2d-1d5c-47db-b436-43796849be51", "address": "fa:16:3e:eb:e9:ca", "network": {"id": "b780d5c1-a549-4b49-a036-5a272697d4b6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-229344021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c046170a2ad44ebba5d2de236d940be0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93bbff2d-1d", "ovs_interfaceid": "93bbff2d-1d5c-47db-b436-43796849be51", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 10:00:42 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Releasing lock "refresh_cache-db848537-676f-464a-806d-febb14d920a6" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 10:00:42 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] [instance: db848537-676f-464a-806d-febb14d920a6] Updated the network info_cache for instance {{(pid=75122) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 10:00:44 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:00:45 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:00:49 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:00:54 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:00:56 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:00:59 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:01:01 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:01:04 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:01:06 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:01:09 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:01:12 user nova-compute[75122]: DEBUG nova.objects.instance [None req-c36abbf4-8ca8-40ee-8535-08b00d6a91f1 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Lazy-loading 'flavor' on Instance uuid 9ad77a91-bc65-44a8-8ced-fd2ad9237946 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 10:01:12 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-c36abbf4-8ca8-40ee-8535-08b00d6a91f1 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Acquiring lock "refresh_cache-9ad77a91-bc65-44a8-8ced-fd2ad9237946" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 10:01:12 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-c36abbf4-8ca8-40ee-8535-08b00d6a91f1 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Acquired lock "refresh_cache-9ad77a91-bc65-44a8-8ced-fd2ad9237946" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 10:01:12 user nova-compute[75122]: DEBUG nova.network.neutron [None req-c36abbf4-8ca8-40ee-8535-08b00d6a91f1 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] [instance: 9ad77a91-bc65-44a8-8ced-fd2ad9237946] Building network info cache for instance {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 10:01:12 user nova-compute[75122]: DEBUG nova.objects.instance [None req-c36abbf4-8ca8-40ee-8535-08b00d6a91f1 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Lazy-loading 'info_cache' on Instance uuid 9ad77a91-bc65-44a8-8ced-fd2ad9237946 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 10:01:12 user nova-compute[75122]: DEBUG nova.objects.base [None req-c36abbf4-8ca8-40ee-8535-08b00d6a91f1 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Object Instance<9ad77a91-bc65-44a8-8ced-fd2ad9237946> lazy-loaded attributes: flavor,info_cache {{(pid=75122) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 10:01:12 user nova-compute[75122]: DEBUG nova.network.neutron [None req-c36abbf4-8ca8-40ee-8535-08b00d6a91f1 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] [instance: 9ad77a91-bc65-44a8-8ced-fd2ad9237946] Updating instance_info_cache with network_info: [{"id": "e348b3b5-1fc0-4c27-98e7-41a152a67610", "address": "fa:16:3e:d3:b1:38", "network": {"id": "8c1491a5-d5c6-4a22-84fd-bdeca00bbaad", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1848328203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab6afbe7809a4ad3921cbc18145d1816", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape348b3b5-1f", "ovs_interfaceid": "e348b3b5-1fc0-4c27-98e7-41a152a67610", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 10:01:12 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-c36abbf4-8ca8-40ee-8535-08b00d6a91f1 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Releasing lock "refresh_cache-9ad77a91-bc65-44a8-8ced-fd2ad9237946" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 10:01:12 user nova-compute[75122]: INFO nova.virt.libvirt.driver [-] [instance: 9ad77a91-bc65-44a8-8ced-fd2ad9237946] Instance destroyed successfully.
Nov 15 10:01:12 user nova-compute[75122]: DEBUG nova.objects.instance [None req-c36abbf4-8ca8-40ee-8535-08b00d6a91f1 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Lazy-loading 'resources' on Instance uuid 9ad77a91-bc65-44a8-8ced-fd2ad9237946 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 10:01:12 user nova-compute[75122]: DEBUG nova.objects.base [None req-c36abbf4-8ca8-40ee-8535-08b00d6a91f1 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Object Instance<9ad77a91-bc65-44a8-8ced-fd2ad9237946> lazy-loaded attributes: flavor,info_cache,resources {{(pid=75122) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 10:01:12 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-c36abbf4-8ca8-40ee-8535-08b00d6a91f1 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T09:57:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-803179351',display_name='tempest-AttachVolumeTestJSON-server-803179351',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-803179351',id=41,image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOazdcLoty/Tvb58dOdgjYRlbmZHLxyOye3e81xDJ6xblOKkjaBcaTxCMTaYL2kE3EQ/2KT89+o54kjCi92RXyGz9Fa5Z/xA8RuG+orKH3o1/047NRIGM2FIaGKSP1LaWg==',key_name='tempest-keypair-269122459',keypairs=<?>,launch_index=0,launched_at=2023-11-15T09:57:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='ab6afbe7809a4ad3921cbc18145d1816',ramdisk_id='',reservation_id='r-3ag6vy4w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-970815916',owner_user_name='tempest-AttachVolumeTestJSON-970815916-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T09:59:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f18eb706375c4b2e9e7de793cd2950ad',uuid=9ad77a91-bc65-44a8-8ced-fd2ad9237946,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "e348b3b5-1fc0-4c27-98e7-41a152a67610", "address": "fa:16:3e:d3:b1:38", "network": {"id": "8c1491a5-d5c6-4a22-84fd-bdeca00bbaad", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1848328203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab6afbe7809a4ad3921cbc18145d1816", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape348b3b5-1f", "ovs_interfaceid": "e348b3b5-1fc0-4c27-98e7-41a152a67610", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 10:01:12 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-c36abbf4-8ca8-40ee-8535-08b00d6a91f1 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Converting VIF {"id": "e348b3b5-1fc0-4c27-98e7-41a152a67610", "address": "fa:16:3e:d3:b1:38", "network": {"id": "8c1491a5-d5c6-4a22-84fd-bdeca00bbaad", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1848328203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab6afbe7809a4ad3921cbc18145d1816", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape348b3b5-1f", "ovs_interfaceid": "e348b3b5-1fc0-4c27-98e7-41a152a67610", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 10:01:12 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-c36abbf4-8ca8-40ee-8535-08b00d6a91f1 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:b1:38,bridge_name='br-int',has_traffic_filtering=True,id=e348b3b5-1fc0-4c27-98e7-41a152a67610,network=Network(8c1491a5-d5c6-4a22-84fd-bdeca00bbaad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape348b3b5-1f') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 10:01:12 user nova-compute[75122]: DEBUG os_vif [None req-c36abbf4-8ca8-40ee-8535-08b00d6a91f1 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:b1:38,bridge_name='br-int',has_traffic_filtering=True,id=e348b3b5-1fc0-4c27-98e7-41a152a67610,network=Network(8c1491a5-d5c6-4a22-84fd-bdeca00bbaad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape348b3b5-1f') {{(pid=75122) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 10:01:12 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:01:12 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape348b3b5-1f, bridge=br-int, if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 10:01:12 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:01:12 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:01:13 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:01:13 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ca76349c-ce00-45ad-80e8-44c8937e0c3b) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 10:01:13 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:01:13 user nova-compute[75122]: INFO os_vif [None req-c36abbf4-8ca8-40ee-8535-08b00d6a91f1 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:b1:38,bridge_name='br-int',has_traffic_filtering=True,id=e348b3b5-1fc0-4c27-98e7-41a152a67610,network=Network(8c1491a5-d5c6-4a22-84fd-bdeca00bbaad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape348b3b5-1f')
Nov 15 10:01:13 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c36abbf4-8ca8-40ee-8535-08b00d6a91f1 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] [instance: 9ad77a91-bc65-44a8-8ced-fd2ad9237946] calling os-brick to detach iSCSI Volume {{(pid=75122) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 10:01:13 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-c36abbf4-8ca8-40ee-8535-08b00d6a91f1 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffa04060b80>, {'target_iqn': 'iqn.2010-10.org.openstack:d42739d6-477a-4322-ad52-6491b80a4a48', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CInMWrXi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 10:01:13 user nova-compute[75122]: WARNING os_brick.initiator.connectors.base [None req-c36abbf4-8ca8-40ee-8535-08b00d6a91f1 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 10:01:13 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-c36abbf4-8ca8-40ee-8535-08b00d6a91f1 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 10:01:13 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-c36abbf4-8ca8-40ee-8535-08b00d6a91f1 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 10:01:13 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:01:13 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:01:13 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[79150874-6b6a-499e-8122-aec07fde9fcf]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2d703360-7eee-4b0b-9b1d-a42e2170de6c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d42739d6-477a-4322-ad52-6491b80a4a48\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8ee79db2-27c2-4d0f-8ee6-5b03e05ebba5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:01:13 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-c36abbf4-8ca8-40ee-8535-08b00d6a91f1 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 10:01:13 user nova-compute[75122]: No targets found.
Nov 15 10:01:13 user nova-compute[75122]: iSNS:
Nov 15 10:01:13 user nova-compute[75122]: No targets found.
Nov 15 10:01:13 user nova-compute[75122]: STATIC:
Nov 15 10:01:13 user nova-compute[75122]: Target: iqn.2010-10.org.openstack:2d703360-7eee-4b0b-9b1d-a42e2170de6c
Nov 15 10:01:13 user nova-compute[75122]:         Portal: 172.16.0.220:3260,-1
Nov 15 10:01:13 user nova-compute[75122]:                 Iface Name: default
Nov 15 10:01:13 user nova-compute[75122]: Target: iqn.2010-10.org.openstack:d42739d6-477a-4322-ad52-6491b80a4a48
Nov 15 10:01:13 user nova-compute[75122]:         Portal: 172.16.0.220:3260,-1
Nov 15 10:01:13 user nova-compute[75122]:                 Iface Name: default
Nov 15 10:01:13 user nova-compute[75122]: Target: iqn.2010-10.org.openstack:8ee79db2-27c2-4d0f-8ee6-5b03e05ebba5
Nov 15 10:01:13 user nova-compute[75122]:         Portal: 172.16.0.220:3260,-1
Nov 15 10:01:13 user nova-compute[75122]:                 Iface Name: default
Nov 15 10:01:13 user nova-compute[75122]: FIRMWARE:
Nov 15 10:01:13 user nova-compute[75122]: No targets found.
Nov 15 10:01:13 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 10:01:13 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-c36abbf4-8ca8-40ee-8535-08b00d6a91f1 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 10:01:13 user nova-compute[75122]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 10:01:13 user nova-compute[75122]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75122) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 10:01:13 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-c36abbf4-8ca8-40ee-8535-08b00d6a91f1 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d42739d6-477a-4322-ad52-6491b80a4a48', 0)] {{(pid=75122) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 10:01:13 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:01:13 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:01:13 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[e14ce308-a3dd-4ae2-ac0b-a13a4c98f520]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2d703360-7eee-4b0b-9b1d-a42e2170de6c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8ee79db2-27c2-4d0f-8ee6-5b03e05ebba5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d42739d6-477a-4322-ad52-6491b80a4a48\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:01:13 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:01:13 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:01:13 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[b30f634f-e94e-484e-a5a6-3dba67501c38]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee79db2-27c2-4d0f-8ee6-5b03e05ebba5 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d42739d6-477a-4322-ad52-6491b80a4a48 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d703360-7eee-4b0b-9b1d-a42e2170de6c (non-flash)\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:01:13 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-c36abbf4-8ca8-40ee-8535-08b00d6a91f1 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee79db2-27c2-4d0f-8ee6-5b03e05ebba5 (non-flash)
Nov 15 10:01:13 user nova-compute[75122]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d42739d6-477a-4322-ad52-6491b80a4a48 (non-flash)
Nov 15 10:01:13 user nova-compute[75122]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d703360-7eee-4b0b-9b1d-a42e2170de6c (non-flash)
Nov 15 10:01:13 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 10:01:13 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-c36abbf4-8ca8-40ee-8535-08b00d6a91f1 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee79db2-27c2-4d0f-8ee6-5b03e05ebba5 (non-flash)
Nov 15 10:01:13 user nova-compute[75122]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d42739d6-477a-4322-ad52-6491b80a4a48 (non-flash)
Nov 15 10:01:13 user nova-compute[75122]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d703360-7eee-4b0b-9b1d-a42e2170de6c (non-flash)
Nov 15 10:01:13 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 10:01:13 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-c36abbf4-8ca8-40ee-8535-08b00d6a91f1 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff9e42168c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d42739d6-477a-4322-ad52-6491b80a4a48'): ({'sdd'}, set())}) {{(pid=75122) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 10:01:13 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-c36abbf4-8ca8-40ee-8535-08b00d6a91f1 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Removing single pathed devices sdd {{(pid=75122) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 10:01:13 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:01:13 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:01:13 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbb111d8-7100-4bb6-8c93-3bfe9715b4ad]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:01:13 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:01:13 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:01:13 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bb186dd-a5e5-42af-9e23-5f50fdcc9ccf]: (4, ('ok\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:01:13 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-c36abbf4-8ca8-40ee-8535-08b00d6a91f1 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Flushing IO for device /dev/sdd {{(pid=75122) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 10:01:13 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:01:13 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:01:13 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[72a1e449-7999-404c-ad4e-5ca97151c115]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:01:13 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-c36abbf4-8ca8-40ee-8535-08b00d6a91f1 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75122) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 10:01:13 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:01:13 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.048s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:01:13 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[b910e762-5667-4602-9ee3-5a432012f42e]: (4, ('1', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:01:13 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-c36abbf4-8ca8-40ee-8535-08b00d6a91f1 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75122) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 10:01:13 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-c36abbf4-8ca8-40ee-8535-08b00d6a91f1 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] SCSI volumes sdd have been removed. {{(pid=75122) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 10:01:13 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-c36abbf4-8ca8-40ee-8535-08b00d6a91f1 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d42739d6-477a-4322-ad52-6491b80a4a48')] {{(pid=75122) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 10:01:13 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d42739d6-477a-4322-ad52-6491b80a4a48 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:01:13 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d42739d6-477a-4322-ad52-6491b80a4a48 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:01:13 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[f684c598-c4c6-45b9-bd57-6f7c8cfac665]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:01:13 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-c36abbf4-8ca8-40ee-8535-08b00d6a91f1 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 10:01:13 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d42739d6-477a-4322-ad52-6491b80a4a48 -p 172.16.0.220:3260 --logout {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:01:13 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d42739d6-477a-4322-ad52-6491b80a4a48 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:01:13 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[8573c9ac-ac1d-4a1b-a336-2e9ba4017206]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:d42739d6-477a-4322-ad52-6491b80a4a48, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:d42739d6-477a-4322-ad52-6491b80a4a48, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:01:13 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-c36abbf4-8ca8-40ee-8535-08b00d6a91f1 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:d42739d6-477a-4322-ad52-6491b80a4a48, portal: 172.16.0.220,3260]
Nov 15 10:01:13 user nova-compute[75122]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:d42739d6-477a-4322-ad52-6491b80a4a48, portal: 172.16.0.220,3260] successful.
Nov 15 10:01:13 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 10:01:13 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d42739d6-477a-4322-ad52-6491b80a4a48 -p 172.16.0.220:3260 --op delete {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:01:13 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d42739d6-477a-4322-ad52-6491b80a4a48 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:01:13 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[71071dc2-2355-4a7c-90ce-4b367030f798]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:01:13 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-c36abbf4-8ca8-40ee-8535-08b00d6a91f1 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 10:01:13 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-c36abbf4-8ca8-40ee-8535-08b00d6a91f1 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.296s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 10:01:13 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-c36abbf4-8ca8-40ee-8535-08b00d6a91f1 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] <== disconnect_volume: return (297ms) None {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 10:01:13 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c36abbf4-8ca8-40ee-8535-08b00d6a91f1 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] [instance: 9ad77a91-bc65-44a8-8ced-fd2ad9237946] Disconnected iSCSI Volume {{(pid=75122) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 10:01:13 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-c36abbf4-8ca8-40ee-8535-08b00d6a91f1 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] [instance: 9ad77a91-bc65-44a8-8ced-fd2ad9237946] Start _get_guest_xml network_info=[{"id": "e348b3b5-1fc0-4c27-98e7-41a152a67610", "address": "fa:16:3e:d3:b1:38", "network": {"id": "8c1491a5-d5c6-4a22-84fd-bdeca00bbaad", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1848328203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab6afbe7809a4ad3921cbc18145d1816", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape348b3b5-1f", "ovs_interfaceid": "e348b3b5-1fc0-4c27-98e7-41a152a67610", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=5e862cfe-47b8-4725-8292-65761ee6d0f5,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '5e862cfe-47b8-4725-8292-65761ee6d0f5'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d42739d6-477a-4322-ad52-6491b80a4a48', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CInMWrXi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': '9ad77a91-bc65-44a8-8ced-fd2ad9237946', 'attached_at': '', 'detached_at': '', 'volume_id': 'd42739d6-477a-4322-ad52-6491b80a4a48', 'serial': 'd42739d6-477a-4322-ad52-6491b80a4a48'}, 'guest_format': None, 'delete_on_termination': False, 'boot_index': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vdb', 'attachment_id': 'f3194202-5be7-4375-a4e6-b98450c611da', 'volume_type': None} {{(pid=75122) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 10:01:13 user nova-compute[75122]: DEBUG nova.objects.instance [None req-c36abbf4-8ca8-40ee-8535-08b00d6a91f1 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Lazy-loading 'numa_topology' on Instance uuid 9ad77a91-bc65-44a8-8ced-fd2ad9237946 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 10:01:13 user nova-compute[75122]: DEBUG nova.objects.base [None req-c36abbf4-8ca8-40ee-8535-08b00d6a91f1 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Object Instance<9ad77a91-bc65-44a8-8ced-fd2ad9237946> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=75122) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 10:01:13 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-c36abbf4-8ca8-40ee-8535-08b00d6a91f1 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 10:01:13 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-c36abbf4-8ca8-40ee-8535-08b00d6a91f1 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 10:01:13 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-c36abbf4-8ca8-40ee-8535-08b00d6a91f1 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75122) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 10:01:13 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-c36abbf4-8ca8-40ee-8535-08b00d6a91f1 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] CPU controller missing on host. {{(pid=75122) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 10:01:13 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-c36abbf4-8ca8-40ee-8535-08b00d6a91f1 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75122) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 10:01:13 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-c36abbf4-8ca8-40ee-8535-08b00d6a91f1 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] CPU controller found on host. {{(pid=75122) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 10:01:13 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-c36abbf4-8ca8-40ee-8535-08b00d6a91f1 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75122) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 10:01:13 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-c36abbf4-8ca8-40ee-8535-08b00d6a91f1 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T09:26:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=5e862cfe-47b8-4725-8292-65761ee6d0f5,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 10:01:13 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-c36abbf4-8ca8-40ee-8535-08b00d6a91f1 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Flavor limits 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 10:01:13 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-c36abbf4-8ca8-40ee-8535-08b00d6a91f1 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Image limits 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 10:01:13 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-c36abbf4-8ca8-40ee-8535-08b00d6a91f1 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Flavor pref 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 10:01:13 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-c36abbf4-8ca8-40ee-8535-08b00d6a91f1 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Image pref 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 10:01:13 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-c36abbf4-8ca8-40ee-8535-08b00d6a91f1 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 10:01:13 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-c36abbf4-8ca8-40ee-8535-08b00d6a91f1 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 10:01:13 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-c36abbf4-8ca8-40ee-8535-08b00d6a91f1 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75122) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 10:01:13 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-c36abbf4-8ca8-40ee-8535-08b00d6a91f1 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Got 1 possible topologies {{(pid=75122) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 10:01:13 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-c36abbf4-8ca8-40ee-8535-08b00d6a91f1 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 10:01:13 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-c36abbf4-8ca8-40ee-8535-08b00d6a91f1 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 10:01:13 user nova-compute[75122]: DEBUG nova.objects.instance [None req-c36abbf4-8ca8-40ee-8535-08b00d6a91f1 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Lazy-loading 'vcpu_model' on Instance uuid 9ad77a91-bc65-44a8-8ced-fd2ad9237946 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 10:01:13 user nova-compute[75122]: DEBUG nova.objects.base [None req-c36abbf4-8ca8-40ee-8535-08b00d6a91f1 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Object Instance<9ad77a91-bc65-44a8-8ced-fd2ad9237946> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=75122) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 10:01:13 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c36abbf4-8ca8-40ee-8535-08b00d6a91f1 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] [instance: 9ad77a91-bc65-44a8-8ced-fd2ad9237946] Calling os-brick to attach iSCSI Volume {{(pid=75122) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 10:01:13 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-c36abbf4-8ca8-40ee-8535-08b00d6a91f1 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffa04060b80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d42739d6-477a-4322-ad52-6491b80a4a48', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CInMWrXi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 10:01:13 user nova-compute[75122]: WARNING os_brick.initiator.connectors.base [None req-c36abbf4-8ca8-40ee-8535-08b00d6a91f1 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 10:01:13 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-c36abbf4-8ca8-40ee-8535-08b00d6a91f1 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 10:01:13 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-c36abbf4-8ca8-40ee-8535-08b00d6a91f1 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 10:01:13 user nova-compute[75122]: WARNING os_brick.initiator.connectors.base [None req-c36abbf4-8ca8-40ee-8535-08b00d6a91f1 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 10:01:13 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-c36abbf4-8ca8-40ee-8535-08b00d6a91f1 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d42739d6-477a-4322-ad52-6491b80a4a48" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 10:01:13 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-c36abbf4-8ca8-40ee-8535-08b00d6a91f1 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d42739d6-477a-4322-ad52-6491b80a4a48" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 10:01:13 user nova-compute[75122]: INFO os_brick.initiator.connectors.iscsi [None req-c36abbf4-8ca8-40ee-8535-08b00d6a91f1 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 10:01:13 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d42739d6-477a-4322-ad52-6491b80a4a48 -p 172.16.0.220:3260 {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:01:13 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d42739d6-477a-4322-ad52-6491b80a4a48 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:01:13 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[81f4306b-f4ad-41fd-93a4-59829696e086]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:01:13 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-c36abbf4-8ca8-40ee-8535-08b00d6a91f1 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 10:01:13 user nova-compute[75122]:  {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 10:01:13 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d42739d6-477a-4322-ad52-6491b80a4a48 -p 172.16.0.220:3260 --interface default --op new {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:01:13 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d42739d6-477a-4322-ad52-6491b80a4a48 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:01:13 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7ce146f-952f-4dc8-ba59-f65653fea1c6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d42739d6-477a-4322-ad52-6491b80a4a48] added\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:01:13 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-c36abbf4-8ca8-40ee-8535-08b00d6a91f1 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d42739d6-477a-4322-ad52-6491b80a4a48] added
Nov 15 10:01:13 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 10:01:13 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d42739d6-477a-4322-ad52-6491b80a4a48 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:01:13 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d42739d6-477a-4322-ad52-6491b80a4a48 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:01:13 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0d77fa8-7772-42e6-8152-f564f00d4f86]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:01:13 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-c36abbf4-8ca8-40ee-8535-08b00d6a91f1 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 10:01:13 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d42739d6-477a-4322-ad52-6491b80a4a48 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:01:13 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d42739d6-477a-4322-ad52-6491b80a4a48 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:01:13 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[6db07803-4a6d-4b5a-9695-aeb2a5111b8d]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:01:13 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-c36abbf4-8ca8-40ee-8535-08b00d6a91f1 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 10:01:13 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d42739d6-477a-4322-ad52-6491b80a4a48 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CInMWrXi {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:01:13 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d42739d6-477a-4322-ad52-6491b80a4a48 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CInMWrXi" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:01:13 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[40625167-7628-4e33-9efd-b28fb06fe25b]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:01:13 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-c36abbf4-8ca8-40ee-8535-08b00d6a91f1 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CInMWrXi'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 10:01:13 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d42739d6-477a-4322-ad52-6491b80a4a48 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:01:13 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d42739d6-477a-4322-ad52-6491b80a4a48 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:01:13 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[4680a3ce-8441-40ac-943c-69130c7be7b9]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:01:13 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-c36abbf4-8ca8-40ee-8535-08b00d6a91f1 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 10:01:13 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:01:13 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:01:13 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[943c0df1-c9e6-4646-ae39-44217870cc9a]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee79db2-27c2-4d0f-8ee6-5b03e05ebba5 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d703360-7eee-4b0b-9b1d-a42e2170de6c (non-flash)\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:01:13 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-c36abbf4-8ca8-40ee-8535-08b00d6a91f1 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee79db2-27c2-4d0f-8ee6-5b03e05ebba5 (non-flash)
Nov 15 10:01:13 user nova-compute[75122]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d703360-7eee-4b0b-9b1d-a42e2170de6c (non-flash)
Nov 15 10:01:13 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 10:01:13 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-c36abbf4-8ca8-40ee-8535-08b00d6a91f1 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee79db2-27c2-4d0f-8ee6-5b03e05ebba5 (non-flash)
Nov 15 10:01:13 user nova-compute[75122]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d703360-7eee-4b0b-9b1d-a42e2170de6c (non-flash)
Nov 15 10:01:13 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 10:01:13 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d42739d6-477a-4322-ad52-6491b80a4a48 -p 172.16.0.220:3260 --login {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:01:13 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d42739d6-477a-4322-ad52-6491b80a4a48 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:01:13 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aca7370-8266-45a0-8e77-9f2b60a2ebbc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d42739d6-477a-4322-ad52-6491b80a4a48, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d42739d6-477a-4322-ad52-6491b80a4a48, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:01:13 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-c36abbf4-8ca8-40ee-8535-08b00d6a91f1 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d42739d6-477a-4322-ad52-6491b80a4a48, portal: 172.16.0.220,3260]
Nov 15 10:01:13 user nova-compute[75122]: Login to [iface: default, target: iqn.2010-10.org.openstack:d42739d6-477a-4322-ad52-6491b80a4a48, portal: 172.16.0.220,3260] successful.
Nov 15 10:01:13 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 10:01:13 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d42739d6-477a-4322-ad52-6491b80a4a48 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:01:13 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d42739d6-477a-4322-ad52-6491b80a4a48 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:01:13 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[944f7a18-84f4-4c87-ac98-f07c9da7ce44]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:01:13 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-c36abbf4-8ca8-40ee-8535-08b00d6a91f1 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 10:01:13 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:01:13 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:01:13 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[8da0ff4c-4c89-461e-b8fb-12d030f86001]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee79db2-27c2-4d0f-8ee6-5b03e05ebba5 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d703360-7eee-4b0b-9b1d-a42e2170de6c (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d42739d6-477a-4322-ad52-6491b80a4a48 (non-flash)\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:01:13 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-c36abbf4-8ca8-40ee-8535-08b00d6a91f1 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee79db2-27c2-4d0f-8ee6-5b03e05ebba5 (non-flash)
Nov 15 10:01:13 user nova-compute[75122]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d703360-7eee-4b0b-9b1d-a42e2170de6c (non-flash)
Nov 15 10:01:13 user nova-compute[75122]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d42739d6-477a-4322-ad52-6491b80a4a48 (non-flash)
Nov 15 10:01:13 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 10:01:13 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-c36abbf4-8ca8-40ee-8535-08b00d6a91f1 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee79db2-27c2-4d0f-8ee6-5b03e05ebba5 (non-flash)
Nov 15 10:01:13 user nova-compute[75122]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d703360-7eee-4b0b-9b1d-a42e2170de6c (non-flash)
Nov 15 10:01:13 user nova-compute[75122]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d42739d6-477a-4322-ad52-6491b80a4a48 (non-flash)
Nov 15 10:01:13 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 10:01:13 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-c36abbf4-8ca8-40ee-8535-08b00d6a91f1 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d42739d6-477a-4322-ad52-6491b80a4a48" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.259s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 10:01:13 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-c36abbf4-8ca8-40ee-8535-08b00d6a91f1 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Connected to 172.16.0.220:3260 {{(pid=75122) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 10:01:13 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-c36abbf4-8ca8-40ee-8535-08b00d6a91f1 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] HCTL ('35', '-', '-', 0) found on session 53 with lun 0 {{(pid=75122) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 10:01:13 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-c36abbf4-8ca8-40ee-8535-08b00d6a91f1 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75122) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 10:01:13 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:01:13 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:01:13 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5b4e614-00e9-4449-a044-76643626fc84]: (4, ('- - 0', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:01:13 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-c36abbf4-8ca8-40ee-8535-08b00d6a91f1 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Searching for a device in session 53 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75122) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 10:01:13 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-c36abbf4-8ca8-40ee-8535-08b00d6a91f1 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:d42739d6-477a-4322-ad52-6491b80a4a48', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CInMWrXi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75122) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 10:01:14 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-c36abbf4-8ca8-40ee-8535-08b00d6a91f1 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.294s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 10:01:14 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-c36abbf4-8ca8-40ee-8535-08b00d6a91f1 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] <== connect_volume: return (1296ms) {'type': 'block', 'scsi_wwn': '23030353032623361', 'path': '/dev/sdd'} {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 10:01:14 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c36abbf4-8ca8-40ee-8535-08b00d6a91f1 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] [instance: 9ad77a91-bc65-44a8-8ced-fd2ad9237946] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23030353032623361', 'path': '/dev/sdd'} {{(pid=75122) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 10:01:14 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-c36abbf4-8ca8-40ee-8535-08b00d6a91f1 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T09:57:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-803179351',display_name='tempest-AttachVolumeTestJSON-server-803179351',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-803179351',id=41,image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOazdcLoty/Tvb58dOdgjYRlbmZHLxyOye3e81xDJ6xblOKkjaBcaTxCMTaYL2kE3EQ/2KT89+o54kjCi92RXyGz9Fa5Z/xA8RuG+orKH3o1/047NRIGM2FIaGKSP1LaWg==',key_name='tempest-keypair-269122459',keypairs=<?>,launch_index=0,launched_at=2023-11-15T09:57:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='ab6afbe7809a4ad3921cbc18145d1816',ramdisk_id='',reservation_id='r-3ag6vy4w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-970815916',owner_user_name='tempest-AttachVolumeTestJSON-970815916-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T09:59:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f18eb706375c4b2e9e7de793cd2950ad',uuid=9ad77a91-bc65-44a8-8ced-fd2ad9237946,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "e348b3b5-1fc0-4c27-98e7-41a152a67610", "address": "fa:16:3e:d3:b1:38", "network": {"id": "8c1491a5-d5c6-4a22-84fd-bdeca00bbaad", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1848328203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab6afbe7809a4ad3921cbc18145d1816", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape348b3b5-1f", "ovs_interfaceid": "e348b3b5-1fc0-4c27-98e7-41a152a67610", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75122) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 10:01:14 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-c36abbf4-8ca8-40ee-8535-08b00d6a91f1 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Converting VIF {"id": "e348b3b5-1fc0-4c27-98e7-41a152a67610", "address": "fa:16:3e:d3:b1:38", "network": {"id": "8c1491a5-d5c6-4a22-84fd-bdeca00bbaad", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1848328203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab6afbe7809a4ad3921cbc18145d1816", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape348b3b5-1f", "ovs_interfaceid": "e348b3b5-1fc0-4c27-98e7-41a152a67610", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 10:01:14 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-c36abbf4-8ca8-40ee-8535-08b00d6a91f1 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:b1:38,bridge_name='br-int',has_traffic_filtering=True,id=e348b3b5-1fc0-4c27-98e7-41a152a67610,network=Network(8c1491a5-d5c6-4a22-84fd-bdeca00bbaad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape348b3b5-1f') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 10:01:14 user nova-compute[75122]: DEBUG nova.objects.instance [None req-c36abbf4-8ca8-40ee-8535-08b00d6a91f1 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Lazy-loading 'pci_devices' on Instance uuid 9ad77a91-bc65-44a8-8ced-fd2ad9237946 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 10:01:14 user nova-compute[75122]: DEBUG nova.objects.base [None req-c36abbf4-8ca8-40ee-8535-08b00d6a91f1 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Object Instance<9ad77a91-bc65-44a8-8ced-fd2ad9237946> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=75122) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 10:01:14 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-c36abbf4-8ca8-40ee-8535-08b00d6a91f1 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] [instance: 9ad77a91-bc65-44a8-8ced-fd2ad9237946] End _get_guest_xml xml=<domain type="kvm">
Nov 15 10:01:14 user nova-compute[75122]:   <uuid>9ad77a91-bc65-44a8-8ced-fd2ad9237946</uuid>
Nov 15 10:01:14 user nova-compute[75122]:   <name>instance-00000029</name>
Nov 15 10:01:14 user nova-compute[75122]:   <memory>524288</memory>
Nov 15 10:01:14 user nova-compute[75122]:   <vcpu>1</vcpu>
Nov 15 10:01:14 user nova-compute[75122]:   <metadata>
Nov 15 10:01:14 user nova-compute[75122]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 10:01:14 user nova-compute[75122]:       <nova:package version="0.0.0"/>
Nov 15 10:01:14 user nova-compute[75122]:       <nova:name>tempest-AttachVolumeTestJSON-server-803179351</nova:name>
Nov 15 10:01:14 user nova-compute[75122]:       <nova:creationTime>2023-11-15 10:01:13</nova:creationTime>
Nov 15 10:01:14 user nova-compute[75122]:       <nova:flavor name="m1.tiny">
Nov 15 10:01:14 user nova-compute[75122]:         <nova:memory>512</nova:memory>
Nov 15 10:01:14 user nova-compute[75122]:         <nova:disk>1</nova:disk>
Nov 15 10:01:14 user nova-compute[75122]:         <nova:swap>0</nova:swap>
Nov 15 10:01:14 user nova-compute[75122]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 10:01:14 user nova-compute[75122]:         <nova:vcpus>1</nova:vcpus>
Nov 15 10:01:14 user nova-compute[75122]:       </nova:flavor>
Nov 15 10:01:14 user nova-compute[75122]:       <nova:owner>
Nov 15 10:01:14 user nova-compute[75122]:         <nova:user uuid="f18eb706375c4b2e9e7de793cd2950ad">tempest-AttachVolumeTestJSON-970815916-project-member</nova:user>
Nov 15 10:01:14 user nova-compute[75122]:         <nova:project uuid="ab6afbe7809a4ad3921cbc18145d1816">tempest-AttachVolumeTestJSON-970815916</nova:project>
Nov 15 10:01:14 user nova-compute[75122]:       </nova:owner>
Nov 15 10:01:14 user nova-compute[75122]:       <nova:root type="image" uuid="5e862cfe-47b8-4725-8292-65761ee6d0f5"/>
Nov 15 10:01:14 user nova-compute[75122]:       <nova:ports>
Nov 15 10:01:14 user nova-compute[75122]:         <nova:port uuid="e348b3b5-1fc0-4c27-98e7-41a152a67610">
Nov 15 10:01:14 user nova-compute[75122]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 15 10:01:14 user nova-compute[75122]:         </nova:port>
Nov 15 10:01:14 user nova-compute[75122]:       </nova:ports>
Nov 15 10:01:14 user nova-compute[75122]:     </nova:instance>
Nov 15 10:01:14 user nova-compute[75122]:   </metadata>
Nov 15 10:01:14 user nova-compute[75122]:   <sysinfo type="smbios">
Nov 15 10:01:14 user nova-compute[75122]:     <system>
Nov 15 10:01:14 user nova-compute[75122]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 10:01:14 user nova-compute[75122]:       <entry name="product">OpenStack Nova</entry>
Nov 15 10:01:14 user nova-compute[75122]:       <entry name="version">0.0.0</entry>
Nov 15 10:01:14 user nova-compute[75122]:       <entry name="serial">9ad77a91-bc65-44a8-8ced-fd2ad9237946</entry>
Nov 15 10:01:14 user nova-compute[75122]:       <entry name="uuid">9ad77a91-bc65-44a8-8ced-fd2ad9237946</entry>
Nov 15 10:01:14 user nova-compute[75122]:       <entry name="family">Virtual Machine</entry>
Nov 15 10:01:14 user nova-compute[75122]:     </system>
Nov 15 10:01:14 user nova-compute[75122]:   </sysinfo>
Nov 15 10:01:14 user nova-compute[75122]:   <os>
Nov 15 10:01:14 user nova-compute[75122]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 10:01:14 user nova-compute[75122]:     <boot dev="hd"/>
Nov 15 10:01:14 user nova-compute[75122]:     <smbios mode="sysinfo"/>
Nov 15 10:01:14 user nova-compute[75122]:   </os>
Nov 15 10:01:14 user nova-compute[75122]:   <features>
Nov 15 10:01:14 user nova-compute[75122]:     <acpi/>
Nov 15 10:01:14 user nova-compute[75122]:     <apic/>
Nov 15 10:01:14 user nova-compute[75122]:     <vmcoreinfo/>
Nov 15 10:01:14 user nova-compute[75122]:   </features>
Nov 15 10:01:14 user nova-compute[75122]:   <clock offset="utc">
Nov 15 10:01:14 user nova-compute[75122]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 10:01:14 user nova-compute[75122]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 10:01:14 user nova-compute[75122]:     <timer name="hpet" present="no"/>
Nov 15 10:01:14 user nova-compute[75122]:   </clock>
Nov 15 10:01:14 user nova-compute[75122]:   <cpu mode="custom" match="exact">
Nov 15 10:01:14 user nova-compute[75122]:     <model>Nehalem</model>
Nov 15 10:01:14 user nova-compute[75122]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 10:01:14 user nova-compute[75122]:   </cpu>
Nov 15 10:01:14 user nova-compute[75122]:   <devices>
Nov 15 10:01:14 user nova-compute[75122]:     <disk type="file" device="disk">
Nov 15 10:01:14 user nova-compute[75122]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 10:01:14 user nova-compute[75122]:       <source file="/opt/stack/data/nova/instances/9ad77a91-bc65-44a8-8ced-fd2ad9237946/disk"/>
Nov 15 10:01:14 user nova-compute[75122]:       <target dev="vda" bus="virtio"/>
Nov 15 10:01:14 user nova-compute[75122]:     </disk>
Nov 15 10:01:14 user nova-compute[75122]:     <disk type="block" device="disk">
Nov 15 10:01:14 user nova-compute[75122]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 10:01:14 user nova-compute[75122]:       <source dev="/dev/sdd"/>
Nov 15 10:01:14 user nova-compute[75122]:       <target dev="vdb" bus="virtio"/>
Nov 15 10:01:14 user nova-compute[75122]:       <serial>d42739d6-477a-4322-ad52-6491b80a4a48</serial>
Nov 15 10:01:14 user nova-compute[75122]:     </disk>
Nov 15 10:01:14 user nova-compute[75122]:     <interface type="ethernet">
Nov 15 10:01:14 user nova-compute[75122]:       <mac address="fa:16:3e:d3:b1:38"/>
Nov 15 10:01:14 user nova-compute[75122]:       <model type="virtio"/>
Nov 15 10:01:14 user nova-compute[75122]:       <mtu size="1442"/>
Nov 15 10:01:14 user nova-compute[75122]:       <target dev="tape348b3b5-1f"/>
Nov 15 10:01:14 user nova-compute[75122]:     </interface>
Nov 15 10:01:14 user nova-compute[75122]:     <serial type="pty">
Nov 15 10:01:14 user nova-compute[75122]:       <log file="/opt/stack/data/nova/instances/9ad77a91-bc65-44a8-8ced-fd2ad9237946/console.log" append="off"/>
Nov 15 10:01:14 user nova-compute[75122]:     </serial>
Nov 15 10:01:14 user nova-compute[75122]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 10:01:14 user nova-compute[75122]:     <video>
Nov 15 10:01:14 user nova-compute[75122]:       <model type="virtio"/>
Nov 15 10:01:14 user nova-compute[75122]:     </video>
Nov 15 10:01:14 user nova-compute[75122]:     <rng model="virtio">
Nov 15 10:01:14 user nova-compute[75122]:       <backend model="random">/dev/urandom</backend>
Nov 15 10:01:14 user nova-compute[75122]:     </rng>
Nov 15 10:01:14 user nova-compute[75122]:     <controller type="usb" index="0" model="none"/>
Nov 15 10:01:14 user nova-compute[75122]:     <memballoon model="virtio">
Nov 15 10:01:14 user nova-compute[75122]:       <stats period="10"/>
Nov 15 10:01:14 user nova-compute[75122]:     </memballoon>
Nov 15 10:01:14 user nova-compute[75122]:   </devices>
Nov 15 10:01:14 user nova-compute[75122]: </domain>
Nov 15 10:01:14 user nova-compute[75122]:  {{(pid=75122) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 10:01:14 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-c36abbf4-8ca8-40ee-8535-08b00d6a91f1 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ad77a91-bc65-44a8-8ced-fd2ad9237946/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:01:14 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-c36abbf4-8ca8-40ee-8535-08b00d6a91f1 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ad77a91-bc65-44a8-8ced-fd2ad9237946/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:01:14 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-c36abbf4-8ca8-40ee-8535-08b00d6a91f1 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ad77a91-bc65-44a8-8ced-fd2ad9237946/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:01:15 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-c36abbf4-8ca8-40ee-8535-08b00d6a91f1 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ad77a91-bc65-44a8-8ced-fd2ad9237946/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:01:15 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-c36abbf4-8ca8-40ee-8535-08b00d6a91f1 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75122) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 10:01:15 user nova-compute[75122]: DEBUG nova.objects.instance [None req-c36abbf4-8ca8-40ee-8535-08b00d6a91f1 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Lazy-loading 'trusted_certs' on Instance uuid 9ad77a91-bc65-44a8-8ced-fd2ad9237946 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 10:01:15 user nova-compute[75122]: DEBUG nova.objects.base [None req-c36abbf4-8ca8-40ee-8535-08b00d6a91f1 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Object Instance<9ad77a91-bc65-44a8-8ced-fd2ad9237946> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=75122) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 10:01:15 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-c36abbf4-8ca8-40ee-8535-08b00d6a91f1 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:01:15 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-c36abbf4-8ca8-40ee-8535-08b00d6a91f1 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json" returned: 0 in 0.180s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:01:15 user nova-compute[75122]: DEBUG nova.virt.disk.api [None req-c36abbf4-8ca8-40ee-8535-08b00d6a91f1 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9ad77a91-bc65-44a8-8ced-fd2ad9237946/disk. size=1073741824 {{(pid=75122) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 10:01:15 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-c36abbf4-8ca8-40ee-8535-08b00d6a91f1 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ad77a91-bc65-44a8-8ced-fd2ad9237946/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:01:15 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-c36abbf4-8ca8-40ee-8535-08b00d6a91f1 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ad77a91-bc65-44a8-8ced-fd2ad9237946/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:01:15 user nova-compute[75122]: DEBUG nova.virt.disk.api [None req-c36abbf4-8ca8-40ee-8535-08b00d6a91f1 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Cannot resize image /opt/stack/data/nova/instances/9ad77a91-bc65-44a8-8ced-fd2ad9237946/disk to a smaller size. {{(pid=75122) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 10:01:15 user nova-compute[75122]: DEBUG nova.objects.instance [None req-c36abbf4-8ca8-40ee-8535-08b00d6a91f1 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Lazy-loading 'migration_context' on Instance uuid 9ad77a91-bc65-44a8-8ced-fd2ad9237946 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 10:01:15 user nova-compute[75122]: DEBUG nova.objects.base [None req-c36abbf4-8ca8-40ee-8535-08b00d6a91f1 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Object Instance<9ad77a91-bc65-44a8-8ced-fd2ad9237946> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75122) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 10:01:15 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-c36abbf4-8ca8-40ee-8535-08b00d6a91f1 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T09:57:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-803179351',display_name='tempest-AttachVolumeTestJSON-server-803179351',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-803179351',id=41,image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOazdcLoty/Tvb58dOdgjYRlbmZHLxyOye3e81xDJ6xblOKkjaBcaTxCMTaYL2kE3EQ/2KT89+o54kjCi92RXyGz9Fa5Z/xA8RuG+orKH3o1/047NRIGM2FIaGKSP1LaWg==',key_name='tempest-keypair-269122459',keypairs=<?>,launch_index=0,launched_at=2023-11-15T09:57:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='ab6afbe7809a4ad3921cbc18145d1816',ramdisk_id='',reservation_id='r-3ag6vy4w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-970815916',owner_user_name='tempest-AttachVolumeTestJSON-970815916-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T09:59:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f18eb706375c4b2e9e7de793cd2950ad',uuid=9ad77a91-bc65-44a8-8ced-fd2ad9237946,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "e348b3b5-1fc0-4c27-98e7-41a152a67610", "address": "fa:16:3e:d3:b1:38", "network": {"id": "8c1491a5-d5c6-4a22-84fd-bdeca00bbaad", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1848328203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab6afbe7809a4ad3921cbc18145d1816", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape348b3b5-1f", "ovs_interfaceid": "e348b3b5-1fc0-4c27-98e7-41a152a67610", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 10:01:15 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-c36abbf4-8ca8-40ee-8535-08b00d6a91f1 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Converting VIF {"id": "e348b3b5-1fc0-4c27-98e7-41a152a67610", "address": "fa:16:3e:d3:b1:38", "network": {"id": "8c1491a5-d5c6-4a22-84fd-bdeca00bbaad", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1848328203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab6afbe7809a4ad3921cbc18145d1816", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape348b3b5-1f", "ovs_interfaceid": "e348b3b5-1fc0-4c27-98e7-41a152a67610", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 10:01:15 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-c36abbf4-8ca8-40ee-8535-08b00d6a91f1 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:b1:38,bridge_name='br-int',has_traffic_filtering=True,id=e348b3b5-1fc0-4c27-98e7-41a152a67610,network=Network(8c1491a5-d5c6-4a22-84fd-bdeca00bbaad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape348b3b5-1f') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 10:01:15 user nova-compute[75122]: DEBUG os_vif [None req-c36abbf4-8ca8-40ee-8535-08b00d6a91f1 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:b1:38,bridge_name='br-int',has_traffic_filtering=True,id=e348b3b5-1fc0-4c27-98e7-41a152a67610,network=Network(8c1491a5-d5c6-4a22-84fd-bdeca00bbaad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape348b3b5-1f') {{(pid=75122) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 10:01:15 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:01:15 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 10:01:15 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 10:01:15 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:01:15 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '623692db-914d-5664-8c44-2a29b0e02627', '_type': 'linux-noop'}}, row=False) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 10:01:15 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:01:15 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:01:15 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:01:15 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape348b3b5-1f, may_exist=True, interface_attrs={}) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 10:01:15 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape348b3b5-1f, col_values=(('qos', UUID('06034be8-271f-4074-a629-2490a11c50f0')),), if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 10:01:15 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape348b3b5-1f, col_values=(('external_ids', {'iface-id': 'e348b3b5-1fc0-4c27-98e7-41a152a67610', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d3:b1:38', 'vm-uuid': '9ad77a91-bc65-44a8-8ced-fd2ad9237946'}),), if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 10:01:15 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:01:15 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:01:15 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:01:15 user nova-compute[75122]: INFO os_vif [None req-c36abbf4-8ca8-40ee-8535-08b00d6a91f1 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:b1:38,bridge_name='br-int',has_traffic_filtering=True,id=e348b3b5-1fc0-4c27-98e7-41a152a67610,network=Network(8c1491a5-d5c6-4a22-84fd-bdeca00bbaad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape348b3b5-1f')
Nov 15 10:01:16 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:01:16 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:01:16 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:01:17 user nova-compute[75122]: DEBUG nova.compute.manager [req-5278ea5e-dd55-4205-942f-a52ab1b220a1 req-7d54421d-cca0-4cc1-82e9-c5761daa7754 service nova] [instance: 9ad77a91-bc65-44a8-8ced-fd2ad9237946] Received event network-vif-plugged-e348b3b5-1fc0-4c27-98e7-41a152a67610 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 10:01:17 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-5278ea5e-dd55-4205-942f-a52ab1b220a1 req-7d54421d-cca0-4cc1-82e9-c5761daa7754 service nova] Acquiring lock "9ad77a91-bc65-44a8-8ced-fd2ad9237946-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:01:17 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-5278ea5e-dd55-4205-942f-a52ab1b220a1 req-7d54421d-cca0-4cc1-82e9-c5761daa7754 service nova] Lock "9ad77a91-bc65-44a8-8ced-fd2ad9237946-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:01:17 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-5278ea5e-dd55-4205-942f-a52ab1b220a1 req-7d54421d-cca0-4cc1-82e9-c5761daa7754 service nova] Lock "9ad77a91-bc65-44a8-8ced-fd2ad9237946-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:01:17 user nova-compute[75122]: DEBUG nova.compute.manager [req-5278ea5e-dd55-4205-942f-a52ab1b220a1 req-7d54421d-cca0-4cc1-82e9-c5761daa7754 service nova] [instance: 9ad77a91-bc65-44a8-8ced-fd2ad9237946] No waiting events found dispatching network-vif-plugged-e348b3b5-1fc0-4c27-98e7-41a152a67610 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 10:01:17 user nova-compute[75122]: WARNING nova.compute.manager [req-5278ea5e-dd55-4205-942f-a52ab1b220a1 req-7d54421d-cca0-4cc1-82e9-c5761daa7754 service nova] [instance: 9ad77a91-bc65-44a8-8ced-fd2ad9237946] Received unexpected event network-vif-plugged-e348b3b5-1fc0-4c27-98e7-41a152a67610 for instance with vm_state stopped and task_state powering-on.
Nov 15 10:01:17 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:01:17 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:01:17 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:01:18 user nova-compute[75122]: DEBUG nova.compute.manager [None req-c36abbf4-8ca8-40ee-8535-08b00d6a91f1 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] [instance: 9ad77a91-bc65-44a8-8ced-fd2ad9237946] Instance event wait completed in 0 seconds for  {{(pid=75122) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 10:01:18 user nova-compute[75122]: INFO nova.virt.libvirt.driver [-] [instance: 9ad77a91-bc65-44a8-8ced-fd2ad9237946] Instance rebooted successfully.
Nov 15 10:01:18 user nova-compute[75122]: DEBUG nova.compute.manager [None req-c36abbf4-8ca8-40ee-8535-08b00d6a91f1 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] [instance: 9ad77a91-bc65-44a8-8ced-fd2ad9237946] Checking state {{(pid=75122) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 10:01:19 user nova-compute[75122]: DEBUG nova.compute.manager [req-52cdebe5-86e4-40bc-883d-d66b725e43c7 req-b235344b-24b4-4a64-b9ed-345e44076d37 service nova] [instance: 9ad77a91-bc65-44a8-8ced-fd2ad9237946] Received event network-vif-plugged-e348b3b5-1fc0-4c27-98e7-41a152a67610 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 10:01:19 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-52cdebe5-86e4-40bc-883d-d66b725e43c7 req-b235344b-24b4-4a64-b9ed-345e44076d37 service nova] Acquiring lock "9ad77a91-bc65-44a8-8ced-fd2ad9237946-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:01:19 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-52cdebe5-86e4-40bc-883d-d66b725e43c7 req-b235344b-24b4-4a64-b9ed-345e44076d37 service nova] Lock "9ad77a91-bc65-44a8-8ced-fd2ad9237946-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:01:19 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-52cdebe5-86e4-40bc-883d-d66b725e43c7 req-b235344b-24b4-4a64-b9ed-345e44076d37 service nova] Lock "9ad77a91-bc65-44a8-8ced-fd2ad9237946-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:01:19 user nova-compute[75122]: DEBUG nova.compute.manager [req-52cdebe5-86e4-40bc-883d-d66b725e43c7 req-b235344b-24b4-4a64-b9ed-345e44076d37 service nova] [instance: 9ad77a91-bc65-44a8-8ced-fd2ad9237946] No waiting events found dispatching network-vif-plugged-e348b3b5-1fc0-4c27-98e7-41a152a67610 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 10:01:19 user nova-compute[75122]: WARNING nova.compute.manager [req-52cdebe5-86e4-40bc-883d-d66b725e43c7 req-b235344b-24b4-4a64-b9ed-345e44076d37 service nova] [instance: 9ad77a91-bc65-44a8-8ced-fd2ad9237946] Received unexpected event network-vif-plugged-e348b3b5-1fc0-4c27-98e7-41a152a67610 for instance with vm_state stopped and task_state powering-on.
Nov 15 10:01:20 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:01:21 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:01:25 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:01:30 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:01:30 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:01:30 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75122) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 10:01:30 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75122) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 10:01:30 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75122) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 10:01:30 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:01:33 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:01:33 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Cleaning up deleted instances {{(pid=75122) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 15 10:01:33 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] There are 0 instances to clean {{(pid=75122) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 15 10:01:34 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:01:35 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:01:35 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:01:35 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:01:35 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:01:35 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75122) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 10:01:35 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c8b3a13-761f-4491-a367-64e74f038629/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:01:35 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c8b3a13-761f-4491-a367-64e74f038629/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:01:35 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c8b3a13-761f-4491-a367-64e74f038629/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:01:35 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:01:35 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c8b3a13-761f-4491-a367-64e74f038629/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:01:35 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75122) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 10:01:35 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/001d589e-1bee-42da-8422-233ba796fbab/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:01:35 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/001d589e-1bee-42da-8422-233ba796fbab/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:01:35 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/001d589e-1bee-42da-8422-233ba796fbab/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:01:36 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/001d589e-1bee-42da-8422-233ba796fbab/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:01:36 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be71985e-a370-43d9-adef-afb31d03e2fd/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:01:36 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be71985e-a370-43d9-adef-afb31d03e2fd/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:01:36 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be71985e-a370-43d9-adef-afb31d03e2fd/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:01:36 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be71985e-a370-43d9-adef-afb31d03e2fd/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:01:36 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75122) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 10:01:36 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ad77a91-bc65-44a8-8ced-fd2ad9237946/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:01:36 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ad77a91-bc65-44a8-8ced-fd2ad9237946/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:01:36 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ad77a91-bc65-44a8-8ced-fd2ad9237946/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:01:36 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:01:36 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ad77a91-bc65-44a8-8ced-fd2ad9237946/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:01:36 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75122) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 10:01:37 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 10:01:37 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 10:01:37 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Hypervisor/Node resource view: name=user free_ram=8450MB free_disk=25.012813568115234GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75122) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 10:01:37 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:01:37 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:01:37 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance 001d589e-1bee-42da-8422-233ba796fbab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 10:01:37 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance db848537-676f-464a-806d-febb14d920a6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 10:01:37 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance be71985e-a370-43d9-adef-afb31d03e2fd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 10:01:37 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance 9ad77a91-bc65-44a8-8ced-fd2ad9237946 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 10:01:37 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance 4c8b3a13-761f-4491-a367-64e74f038629 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 10:01:37 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance 1f426091-b78a-4d40-bff4-a5c23f155e54 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 10:01:37 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=75122) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 10:01:37 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=75122) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 10:01:37 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Refreshing inventories for resource provider 69a3da65-47be-44c6-b67c-c692b58284ef {{(pid=75122) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 15 10:01:37 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Updating ProviderTree inventory for provider 69a3da65-47be-44c6-b67c-c692b58284ef from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 15 10:01:37 user nova-compute[75122]: DEBUG nova.compute.provider_tree [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Updating inventory in ProviderTree for provider 69a3da65-47be-44c6-b67c-c692b58284ef with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 15 10:01:37 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Refreshing aggregate associations for resource provider 69a3da65-47be-44c6-b67c-c692b58284ef, aggregates: None {{(pid=75122) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 15 10:01:37 user nova-compute[75122]: DEBUG nova.compute.provider_tree [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Updating resource provider 69a3da65-47be-44c6-b67c-c692b58284ef generation from 55 to 56 during operation: update_aggregates {{(pid=75122) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 15 10:01:37 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Refreshing trait associations for resource provider 69a3da65-47be-44c6-b67c-c692b58284ef, traits: COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_RESCUE_BFV,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE,COMPUTE_NODE,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_ACCELERATORS,HW_CPU_X86_MMX {{(pid=75122) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 15 10:01:37 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-008fe0b6-657e-43ec-b230-f9788c5c845f tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Acquiring lock "5954fd91-94c6-4521-9465-1477c0e35f8d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:01:37 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-008fe0b6-657e-43ec-b230-f9788c5c845f tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Lock "5954fd91-94c6-4521-9465-1477c0e35f8d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:01:37 user nova-compute[75122]: DEBUG nova.compute.manager [None req-008fe0b6-657e-43ec-b230-f9788c5c845f tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: 5954fd91-94c6-4521-9465-1477c0e35f8d] Starting instance... {{(pid=75122) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 10:01:37 user nova-compute[75122]: DEBUG nova.compute.provider_tree [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Inventory has not changed in ProviderTree for provider: 69a3da65-47be-44c6-b67c-c692b58284ef {{(pid=75122) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 10:01:37 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-008fe0b6-657e-43ec-b230-f9788c5c845f tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:01:37 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Inventory has not changed for provider 69a3da65-47be-44c6-b67c-c692b58284ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 10:01:37 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Compute_service record updated for user:user {{(pid=75122) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 10:01:37 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.566s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:01:37 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-008fe0b6-657e-43ec-b230-f9788c5c845f tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.059s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:01:37 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-008fe0b6-657e-43ec-b230-f9788c5c845f tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75122) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 10:01:37 user nova-compute[75122]: INFO nova.compute.claims [None req-008fe0b6-657e-43ec-b230-f9788c5c845f tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: 5954fd91-94c6-4521-9465-1477c0e35f8d] Claim successful on node user
Nov 15 10:01:38 user nova-compute[75122]: DEBUG nova.compute.provider_tree [None req-008fe0b6-657e-43ec-b230-f9788c5c845f tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Inventory has not changed in ProviderTree for provider: 69a3da65-47be-44c6-b67c-c692b58284ef {{(pid=75122) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 10:01:38 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-008fe0b6-657e-43ec-b230-f9788c5c845f tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Inventory has not changed for provider 69a3da65-47be-44c6-b67c-c692b58284ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 10:01:38 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-008fe0b6-657e-43ec-b230-f9788c5c845f tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.331s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:01:38 user nova-compute[75122]: DEBUG nova.compute.manager [None req-008fe0b6-657e-43ec-b230-f9788c5c845f tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: 5954fd91-94c6-4521-9465-1477c0e35f8d] Start building networks asynchronously for instance. {{(pid=75122) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 10:01:38 user nova-compute[75122]: DEBUG nova.compute.manager [None req-008fe0b6-657e-43ec-b230-f9788c5c845f tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: 5954fd91-94c6-4521-9465-1477c0e35f8d] Allocating IP information in the background. {{(pid=75122) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 10:01:38 user nova-compute[75122]: DEBUG nova.network.neutron [None req-008fe0b6-657e-43ec-b230-f9788c5c845f tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: 5954fd91-94c6-4521-9465-1477c0e35f8d] allocate_for_instance() {{(pid=75122) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 10:01:38 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-008fe0b6-657e-43ec-b230-f9788c5c845f tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: 5954fd91-94c6-4521-9465-1477c0e35f8d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 10:01:38 user nova-compute[75122]: DEBUG nova.compute.manager [None req-008fe0b6-657e-43ec-b230-f9788c5c845f tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: 5954fd91-94c6-4521-9465-1477c0e35f8d] Start building block device mappings for instance. {{(pid=75122) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 10:01:38 user nova-compute[75122]: INFO nova.virt.block_device [None req-008fe0b6-657e-43ec-b230-f9788c5c845f tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: 5954fd91-94c6-4521-9465-1477c0e35f8d] Booting with volume-backed-image 5e862cfe-47b8-4725-8292-65761ee6d0f5 at /dev/vda
Nov 15 10:01:38 user nova-compute[75122]: DEBUG nova.policy [None req-008fe0b6-657e-43ec-b230-f9788c5c845f tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '53d187e2a07b4437a02f65fb47a003ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c046170a2ad44ebba5d2de236d940be0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75122) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 10:01:38 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:01:38 user nova-compute[75122]: DEBUG nova.network.neutron [None req-008fe0b6-657e-43ec-b230-f9788c5c845f tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: 5954fd91-94c6-4521-9465-1477c0e35f8d] Successfully created port: e9b84607-88fe-411c-be24-0f2d1709d9e9 {{(pid=75122) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 10:01:39 user nova-compute[75122]: DEBUG nova.network.neutron [None req-008fe0b6-657e-43ec-b230-f9788c5c845f tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: 5954fd91-94c6-4521-9465-1477c0e35f8d] Successfully updated port: e9b84607-88fe-411c-be24-0f2d1709d9e9 {{(pid=75122) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 10:01:39 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-008fe0b6-657e-43ec-b230-f9788c5c845f tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Acquiring lock "refresh_cache-5954fd91-94c6-4521-9465-1477c0e35f8d" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 10:01:39 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-008fe0b6-657e-43ec-b230-f9788c5c845f tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Acquired lock "refresh_cache-5954fd91-94c6-4521-9465-1477c0e35f8d" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 10:01:39 user nova-compute[75122]: DEBUG nova.network.neutron [None req-008fe0b6-657e-43ec-b230-f9788c5c845f tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: 5954fd91-94c6-4521-9465-1477c0e35f8d] Building network info cache for instance {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 10:01:39 user nova-compute[75122]: DEBUG nova.compute.manager [req-583e6a2d-33eb-4597-a775-c4d545809fbf req-421023a9-f34d-4989-be19-0a0d01f90b1c service nova] [instance: 5954fd91-94c6-4521-9465-1477c0e35f8d] Received event network-changed-e9b84607-88fe-411c-be24-0f2d1709d9e9 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 10:01:39 user nova-compute[75122]: DEBUG nova.compute.manager [req-583e6a2d-33eb-4597-a775-c4d545809fbf req-421023a9-f34d-4989-be19-0a0d01f90b1c service nova] [instance: 5954fd91-94c6-4521-9465-1477c0e35f8d] Refreshing instance network info cache due to event network-changed-e9b84607-88fe-411c-be24-0f2d1709d9e9. {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 10:01:39 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-583e6a2d-33eb-4597-a775-c4d545809fbf req-421023a9-f34d-4989-be19-0a0d01f90b1c service nova] Acquiring lock "refresh_cache-5954fd91-94c6-4521-9465-1477c0e35f8d" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 10:01:39 user nova-compute[75122]: DEBUG nova.network.neutron [None req-008fe0b6-657e-43ec-b230-f9788c5c845f tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: 5954fd91-94c6-4521-9465-1477c0e35f8d] Instance cache missing network info. {{(pid=75122) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 10:01:39 user nova-compute[75122]: DEBUG nova.network.neutron [None req-008fe0b6-657e-43ec-b230-f9788c5c845f tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: 5954fd91-94c6-4521-9465-1477c0e35f8d] Updating instance_info_cache with network_info: [{"id": "e9b84607-88fe-411c-be24-0f2d1709d9e9", "address": "fa:16:3e:ef:6d:f1", "network": {"id": "b780d5c1-a549-4b49-a036-5a272697d4b6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-229344021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c046170a2ad44ebba5d2de236d940be0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9b84607-88", "ovs_interfaceid": "e9b84607-88fe-411c-be24-0f2d1709d9e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 10:01:39 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-008fe0b6-657e-43ec-b230-f9788c5c845f tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Releasing lock "refresh_cache-5954fd91-94c6-4521-9465-1477c0e35f8d" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 10:01:39 user nova-compute[75122]: DEBUG nova.compute.manager [None req-008fe0b6-657e-43ec-b230-f9788c5c845f tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: 5954fd91-94c6-4521-9465-1477c0e35f8d] Instance network_info: |[{"id": "e9b84607-88fe-411c-be24-0f2d1709d9e9", "address": "fa:16:3e:ef:6d:f1", "network": {"id": "b780d5c1-a549-4b49-a036-5a272697d4b6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-229344021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c046170a2ad44ebba5d2de236d940be0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9b84607-88", "ovs_interfaceid": "e9b84607-88fe-411c-be24-0f2d1709d9e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75122) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 10:01:39 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-583e6a2d-33eb-4597-a775-c4d545809fbf req-421023a9-f34d-4989-be19-0a0d01f90b1c service nova] Acquired lock "refresh_cache-5954fd91-94c6-4521-9465-1477c0e35f8d" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 10:01:39 user nova-compute[75122]: DEBUG nova.network.neutron [req-583e6a2d-33eb-4597-a775-c4d545809fbf req-421023a9-f34d-4989-be19-0a0d01f90b1c service nova] [instance: 5954fd91-94c6-4521-9465-1477c0e35f8d] Refreshing network info cache for port e9b84607-88fe-411c-be24-0f2d1709d9e9 {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 10:01:40 user nova-compute[75122]: DEBUG nova.network.neutron [req-583e6a2d-33eb-4597-a775-c4d545809fbf req-421023a9-f34d-4989-be19-0a0d01f90b1c service nova] [instance: 5954fd91-94c6-4521-9465-1477c0e35f8d] Updated VIF entry in instance network info cache for port e9b84607-88fe-411c-be24-0f2d1709d9e9. {{(pid=75122) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 10:01:40 user nova-compute[75122]: DEBUG nova.network.neutron [req-583e6a2d-33eb-4597-a775-c4d545809fbf req-421023a9-f34d-4989-be19-0a0d01f90b1c service nova] [instance: 5954fd91-94c6-4521-9465-1477c0e35f8d] Updating instance_info_cache with network_info: [{"id": "e9b84607-88fe-411c-be24-0f2d1709d9e9", "address": "fa:16:3e:ef:6d:f1", "network": {"id": "b780d5c1-a549-4b49-a036-5a272697d4b6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-229344021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c046170a2ad44ebba5d2de236d940be0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9b84607-88", "ovs_interfaceid": "e9b84607-88fe-411c-be24-0f2d1709d9e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 10:01:40 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-583e6a2d-33eb-4597-a775-c4d545809fbf req-421023a9-f34d-4989-be19-0a0d01f90b1c service nova] Releasing lock "refresh_cache-5954fd91-94c6-4521-9465-1477c0e35f8d" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 10:01:40 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:01:40 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:01:41 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:01:41 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:01:41 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:01:42 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:01:43 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:01:43 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75122) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 10:01:43 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:01:43 user nova-compute[75122]: DEBUG os_brick.utils [None req-008fe0b6-657e-43ec-b230-f9788c5c845f tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 10:01:43 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:01:43 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:01:43 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[d93df6c2-f172-4453-bc7a-e464b0f68246]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:742fb64b3587\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:01:43 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:01:43 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:01:43 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[466de6f4-5bb3-4585-ba7a-8b0a95307fda]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:01:43 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:01:43 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:01:43 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[77af7614-5c60-4745-abcf-fb6a6f5e3523]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:01:43 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ca05027-bf67-4996-8236-93143605d6fc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:01:43 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-008fe0b6-657e-43ec-b230-f9788c5c845f tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Running cmd (subprocess): nvme version {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:01:44 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-008fe0b6-657e-43ec-b230-f9788c5c845f tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] 'nvme version' failed. Not Retrying. {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 10:01:44 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.nvmeof [None req-008fe0b6-657e-43ec-b230-f9788c5c845f tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] nvme not present on system {{(pid=75122) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 10:01:44 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:01:44 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 10:01:44 user nova-compute[75122]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 10:01:44 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[61fc2692-49d6-476c-89e8-2e750992ad67]: (4, '') {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:01:44 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.lightos [None req-008fe0b6-657e-43ec-b230-f9788c5c845f tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75122) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 10:01:44 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.lightos [None req-008fe0b6-657e-43ec-b230-f9788c5c845f tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75122) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 10:01:44 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.lightos [None req-008fe0b6-657e-43ec-b230-f9788c5c845f tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] LIGHTOS: no hostnqn found. {{(pid=75122) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 10:01:44 user nova-compute[75122]: DEBUG os_brick.utils [None req-008fe0b6-657e-43ec-b230-f9788c5c845f tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:742fb64b3587', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 10:01:44 user nova-compute[75122]: DEBUG nova.virt.block_device [None req-008fe0b6-657e-43ec-b230-f9788c5c845f tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: 5954fd91-94c6-4521-9465-1477c0e35f8d] Updating existing volume attachment record: a361809b-0cd3-4558-80a6-1fc87c79058e {{(pid=75122) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 10:01:44 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:01:44 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Starting heal instance info cache {{(pid=75122) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 10:01:44 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "refresh_cache-be71985e-a370-43d9-adef-afb31d03e2fd" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 10:01:44 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquired lock "refresh_cache-be71985e-a370-43d9-adef-afb31d03e2fd" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 10:01:44 user nova-compute[75122]: DEBUG nova.network.neutron [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] [instance: be71985e-a370-43d9-adef-afb31d03e2fd] Forcefully refreshing network info cache for instance {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 10:01:44 user nova-compute[75122]: DEBUG nova.network.neutron [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] [instance: be71985e-a370-43d9-adef-afb31d03e2fd] Updating instance_info_cache with network_info: [{"id": "4d28d025-0115-4813-b62a-a84ec8c47d58", "address": "fa:16:3e:fa:cb:ca", "network": {"id": "ca2dff40-00d3-46b0-b9e2-dca375439496", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1592022235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88f16d3dc8434cb5ac78c8d2f51d305b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d28d025-01", "ovs_interfaceid": "4d28d025-0115-4813-b62a-a84ec8c47d58", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 10:01:44 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Releasing lock "refresh_cache-be71985e-a370-43d9-adef-afb31d03e2fd" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 10:01:44 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] [instance: be71985e-a370-43d9-adef-afb31d03e2fd] Updated the network info_cache for instance {{(pid=75122) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 10:01:45 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:01:45 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:01:46 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:01:50 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:01:52 user nova-compute[75122]: DEBUG nova.compute.manager [None req-008fe0b6-657e-43ec-b230-f9788c5c845f tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: 5954fd91-94c6-4521-9465-1477c0e35f8d] Start spawning the instance on the hypervisor. {{(pid=75122) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 10:01:52 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-008fe0b6-657e-43ec-b230-f9788c5c845f tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: 5954fd91-94c6-4521-9465-1477c0e35f8d] Creating instance directory {{(pid=75122) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 10:01:52 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-008fe0b6-657e-43ec-b230-f9788c5c845f tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: 5954fd91-94c6-4521-9465-1477c0e35f8d] Creating image(s)
Nov 15 10:01:52 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-008fe0b6-657e-43ec-b230-f9788c5c845f tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: 5954fd91-94c6-4521-9465-1477c0e35f8d] Did not create local disks {{(pid=75122) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 10:01:52 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-008fe0b6-657e-43ec-b230-f9788c5c845f tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: 5954fd91-94c6-4521-9465-1477c0e35f8d] Ensure instance console log exists: /opt/stack/data/nova/instances/5954fd91-94c6-4521-9465-1477c0e35f8d/console.log {{(pid=75122) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 10:01:52 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-008fe0b6-657e-43ec-b230-f9788c5c845f tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:01:52 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-008fe0b6-657e-43ec-b230-f9788c5c845f tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:01:52 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-008fe0b6-657e-43ec-b230-f9788c5c845f tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:01:52 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-008fe0b6-657e-43ec-b230-f9788c5c845f tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: 5954fd91-94c6-4521-9465-1477c0e35f8d] Start _get_guest_xml network_info=[{"id": "e9b84607-88fe-411c-be24-0f2d1709d9e9", "address": "fa:16:3e:ef:6d:f1", "network": {"id": "b780d5c1-a549-4b49-a036-5a272697d4b6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-229344021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c046170a2ad44ebba5d2de236d940be0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9b84607-88", "ovs_interfaceid": "e9b84607-88fe-411c-be24-0f2d1709d9e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T09:26:31Z,direct_url=<?>,disk_format='qcow2',id=5e862cfe-47b8-4725-8292-65761ee6d0f5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9c57733cb41847c0b4ad31519c382e5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T09:26:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:11d2deb7-c652-48e3-ae06-5557c9bef981', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YoxPBlsS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '5954fd91-94c6-4521-9465-1477c0e35f8d', 'attached_at': '', 'detached_at': '', 'volume_id': '11d2deb7-c652-48e3-ae06-5557c9bef981', 'serial': '11d2deb7-c652-48e3-ae06-5557c9bef981'}, 'guest_format': None, 'delete_on_termination': False, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vda', 'attachment_id': 'a361809b-0cd3-4558-80a6-1fc87c79058e', 'volume_type': None} {{(pid=75122) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 10:01:52 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-008fe0b6-657e-43ec-b230-f9788c5c845f tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 10:01:52 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-008fe0b6-657e-43ec-b230-f9788c5c845f tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 10:01:52 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-008fe0b6-657e-43ec-b230-f9788c5c845f tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75122) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 10:01:52 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-008fe0b6-657e-43ec-b230-f9788c5c845f tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] CPU controller missing on host. {{(pid=75122) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 10:01:52 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-008fe0b6-657e-43ec-b230-f9788c5c845f tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75122) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 10:01:52 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-008fe0b6-657e-43ec-b230-f9788c5c845f tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] CPU controller found on host. {{(pid=75122) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 10:01:52 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-008fe0b6-657e-43ec-b230-f9788c5c845f tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75122) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 10:01:52 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-008fe0b6-657e-43ec-b230-f9788c5c845f tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T09:26:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T09:26:31Z,direct_url=<?>,disk_format='qcow2',id=5e862cfe-47b8-4725-8292-65761ee6d0f5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9c57733cb41847c0b4ad31519c382e5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T09:26:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 10:01:52 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-008fe0b6-657e-43ec-b230-f9788c5c845f tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Flavor limits 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 10:01:52 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-008fe0b6-657e-43ec-b230-f9788c5c845f tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Image limits 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 10:01:52 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-008fe0b6-657e-43ec-b230-f9788c5c845f tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Flavor pref 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 10:01:52 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-008fe0b6-657e-43ec-b230-f9788c5c845f tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Image pref 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 10:01:52 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-008fe0b6-657e-43ec-b230-f9788c5c845f tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 10:01:52 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-008fe0b6-657e-43ec-b230-f9788c5c845f tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 10:01:52 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-008fe0b6-657e-43ec-b230-f9788c5c845f tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75122) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 10:01:52 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-008fe0b6-657e-43ec-b230-f9788c5c845f tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Got 1 possible topologies {{(pid=75122) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 10:01:52 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-008fe0b6-657e-43ec-b230-f9788c5c845f tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 10:01:52 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-008fe0b6-657e-43ec-b230-f9788c5c845f tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 10:01:52 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-008fe0b6-657e-43ec-b230-f9788c5c845f tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: 5954fd91-94c6-4521-9465-1477c0e35f8d] Calling os-brick to attach iSCSI Volume {{(pid=75122) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 10:01:52 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-008fe0b6-657e-43ec-b230-f9788c5c845f tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffa04060b80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:11d2deb7-c652-48e3-ae06-5557c9bef981', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YoxPBlsS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 10:01:52 user nova-compute[75122]: WARNING os_brick.initiator.connectors.base [None req-008fe0b6-657e-43ec-b230-f9788c5c845f tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 10:01:52 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-008fe0b6-657e-43ec-b230-f9788c5c845f tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 10:01:52 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-008fe0b6-657e-43ec-b230-f9788c5c845f tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 10:01:52 user nova-compute[75122]: WARNING os_brick.initiator.connectors.base [None req-008fe0b6-657e-43ec-b230-f9788c5c845f tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 10:01:52 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-008fe0b6-657e-43ec-b230-f9788c5c845f tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:11d2deb7-c652-48e3-ae06-5557c9bef981" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 10:01:52 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-008fe0b6-657e-43ec-b230-f9788c5c845f tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:11d2deb7-c652-48e3-ae06-5557c9bef981" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 10:01:52 user nova-compute[75122]: INFO os_brick.initiator.connectors.iscsi [None req-008fe0b6-657e-43ec-b230-f9788c5c845f tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 10:01:52 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11d2deb7-c652-48e3-ae06-5557c9bef981 -p 172.16.0.220:3260 {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:01:52 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11d2deb7-c652-48e3-ae06-5557c9bef981 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:01:52 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c880075-c346-4186-87d4-39143b026463]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:01:52 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-008fe0b6-657e-43ec-b230-f9788c5c845f tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 10:01:52 user nova-compute[75122]:  {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 10:01:52 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11d2deb7-c652-48e3-ae06-5557c9bef981 -p 172.16.0.220:3260 --interface default --op new {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:01:52 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11d2deb7-c652-48e3-ae06-5557c9bef981 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:01:52 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[edc81fae-a96f-4c8e-b2dd-3db2060b81c9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:11d2deb7-c652-48e3-ae06-5557c9bef981] added\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:01:52 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-008fe0b6-657e-43ec-b230-f9788c5c845f tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:11d2deb7-c652-48e3-ae06-5557c9bef981] added
Nov 15 10:01:52 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 10:01:52 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11d2deb7-c652-48e3-ae06-5557c9bef981 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:01:52 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11d2deb7-c652-48e3-ae06-5557c9bef981 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:01:52 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[53cfd8ee-5fe6-4b80-8a8b-04c516ff9bdf]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:01:52 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-008fe0b6-657e-43ec-b230-f9788c5c845f tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 10:01:52 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11d2deb7-c652-48e3-ae06-5557c9bef981 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:01:52 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11d2deb7-c652-48e3-ae06-5557c9bef981 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:01:52 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[31019c48-19f4-4fce-8f2e-11a0bd111cab]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:01:52 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-008fe0b6-657e-43ec-b230-f9788c5c845f tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 10:01:52 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11d2deb7-c652-48e3-ae06-5557c9bef981 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YoxPBlsS {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:01:52 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11d2deb7-c652-48e3-ae06-5557c9bef981 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YoxPBlsS" returned: 0 in 0.019s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:01:52 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[a41751ef-659b-4427-aa7b-6691f9615eeb]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:01:52 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-008fe0b6-657e-43ec-b230-f9788c5c845f tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YoxPBlsS'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 10:01:52 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11d2deb7-c652-48e3-ae06-5557c9bef981 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:01:52 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11d2deb7-c652-48e3-ae06-5557c9bef981 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:01:52 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[e13592b3-ed6d-44c9-94c7-dce2d6c4b64d]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:01:52 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-008fe0b6-657e-43ec-b230-f9788c5c845f tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 10:01:52 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:01:52 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:01:52 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3219979-bade-4677-86a2-c1f46e6cdfd6]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee79db2-27c2-4d0f-8ee6-5b03e05ebba5 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d703360-7eee-4b0b-9b1d-a42e2170de6c (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d42739d6-477a-4322-ad52-6491b80a4a48 (non-flash)\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:01:52 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-008fe0b6-657e-43ec-b230-f9788c5c845f tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee79db2-27c2-4d0f-8ee6-5b03e05ebba5 (non-flash)
Nov 15 10:01:52 user nova-compute[75122]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d703360-7eee-4b0b-9b1d-a42e2170de6c (non-flash)
Nov 15 10:01:52 user nova-compute[75122]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d42739d6-477a-4322-ad52-6491b80a4a48 (non-flash)
Nov 15 10:01:52 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 10:01:52 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-008fe0b6-657e-43ec-b230-f9788c5c845f tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee79db2-27c2-4d0f-8ee6-5b03e05ebba5 (non-flash)
Nov 15 10:01:52 user nova-compute[75122]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d703360-7eee-4b0b-9b1d-a42e2170de6c (non-flash)
Nov 15 10:01:52 user nova-compute[75122]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d42739d6-477a-4322-ad52-6491b80a4a48 (non-flash)
Nov 15 10:01:52 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 10:01:52 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11d2deb7-c652-48e3-ae06-5557c9bef981 -p 172.16.0.220:3260 --login {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:01:52 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11d2deb7-c652-48e3-ae06-5557c9bef981 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:01:52 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea782b3f-d5bf-46fa-bf21-5c8ac0c7ca63]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:11d2deb7-c652-48e3-ae06-5557c9bef981, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:11d2deb7-c652-48e3-ae06-5557c9bef981, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:01:52 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-008fe0b6-657e-43ec-b230-f9788c5c845f tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:11d2deb7-c652-48e3-ae06-5557c9bef981, portal: 172.16.0.220,3260]
Nov 15 10:01:52 user nova-compute[75122]: Login to [iface: default, target: iqn.2010-10.org.openstack:11d2deb7-c652-48e3-ae06-5557c9bef981, portal: 172.16.0.220,3260] successful.
Nov 15 10:01:52 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 10:01:52 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-510f15d4-0608-44a8-a8c0-7b653fe0b089 tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] Acquiring lock "be71985e-a370-43d9-adef-afb31d03e2fd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:01:52 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-510f15d4-0608-44a8-a8c0-7b653fe0b089 tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] Lock "be71985e-a370-43d9-adef-afb31d03e2fd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:01:52 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-510f15d4-0608-44a8-a8c0-7b653fe0b089 tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] Acquiring lock "be71985e-a370-43d9-adef-afb31d03e2fd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:01:52 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-510f15d4-0608-44a8-a8c0-7b653fe0b089 tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] Lock "be71985e-a370-43d9-adef-afb31d03e2fd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:01:52 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-510f15d4-0608-44a8-a8c0-7b653fe0b089 tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] Lock "be71985e-a370-43d9-adef-afb31d03e2fd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:01:52 user nova-compute[75122]: INFO nova.compute.manager [None req-510f15d4-0608-44a8-a8c0-7b653fe0b089 tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] [instance: be71985e-a370-43d9-adef-afb31d03e2fd] Terminating instance
Nov 15 10:01:52 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11d2deb7-c652-48e3-ae06-5557c9bef981 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:01:52 user nova-compute[75122]: DEBUG nova.compute.manager [None req-510f15d4-0608-44a8-a8c0-7b653fe0b089 tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] [instance: be71985e-a370-43d9-adef-afb31d03e2fd] Start destroying the instance on the hypervisor. {{(pid=75122) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 10:01:52 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11d2deb7-c652-48e3-ae06-5557c9bef981 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.037s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:01:52 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba8928a8-af3f-4e7c-a76d-e37bf2eaed76]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:01:52 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-008fe0b6-657e-43ec-b230-f9788c5c845f tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 10:01:52 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:01:52 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:01:52 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[167916ab-07bd-4c46-bdce-69e1a754d61a]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee79db2-27c2-4d0f-8ee6-5b03e05ebba5 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d703360-7eee-4b0b-9b1d-a42e2170de6c (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d42739d6-477a-4322-ad52-6491b80a4a48 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11d2deb7-c652-48e3-ae06-5557c9bef981 (non-flash)\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:01:52 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-008fe0b6-657e-43ec-b230-f9788c5c845f tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee79db2-27c2-4d0f-8ee6-5b03e05ebba5 (non-flash)
Nov 15 10:01:52 user nova-compute[75122]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d703360-7eee-4b0b-9b1d-a42e2170de6c (non-flash)
Nov 15 10:01:52 user nova-compute[75122]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d42739d6-477a-4322-ad52-6491b80a4a48 (non-flash)
Nov 15 10:01:52 user nova-compute[75122]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11d2deb7-c652-48e3-ae06-5557c9bef981 (non-flash)
Nov 15 10:01:52 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 10:01:52 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-008fe0b6-657e-43ec-b230-f9788c5c845f tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee79db2-27c2-4d0f-8ee6-5b03e05ebba5 (non-flash)
Nov 15 10:01:52 user nova-compute[75122]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d703360-7eee-4b0b-9b1d-a42e2170de6c (non-flash)
Nov 15 10:01:52 user nova-compute[75122]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d42739d6-477a-4322-ad52-6491b80a4a48 (non-flash)
Nov 15 10:01:52 user nova-compute[75122]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11d2deb7-c652-48e3-ae06-5557c9bef981 (non-flash)
Nov 15 10:01:52 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 10:01:52 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-008fe0b6-657e-43ec-b230-f9788c5c845f tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:11d2deb7-c652-48e3-ae06-5557c9bef981" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.314s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 10:01:52 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-008fe0b6-657e-43ec-b230-f9788c5c845f tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Connected to 172.16.0.220:3260 {{(pid=75122) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 10:01:52 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-008fe0b6-657e-43ec-b230-f9788c5c845f tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] HCTL ('36', '-', '-', 0) found on session 54 with lun 0 {{(pid=75122) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 10:01:52 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-008fe0b6-657e-43ec-b230-f9788c5c845f tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75122) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 10:01:52 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:01:52 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:01:52 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.023s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:01:52 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[014ac575-85f8-44bc-aefd-7cebe7305076]: (4, ('- - 0', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:01:52 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-008fe0b6-657e-43ec-b230-f9788c5c845f tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Searching for a device in session 54 and hctl ['36', '*', '*', 0] yield: None {{(pid=75122) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 10:01:52 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:01:52 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:01:52 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:01:52 user nova-compute[75122]: DEBUG nova.compute.manager [req-c44f0af5-1348-4f2e-a39e-0c5d1a87f7b5 req-7ec921a1-c5af-4471-ac25-8ee2f3ec4e1c service nova] [instance: be71985e-a370-43d9-adef-afb31d03e2fd] Received event network-vif-unplugged-4d28d025-0115-4813-b62a-a84ec8c47d58 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 10:01:52 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-c44f0af5-1348-4f2e-a39e-0c5d1a87f7b5 req-7ec921a1-c5af-4471-ac25-8ee2f3ec4e1c service nova] Acquiring lock "be71985e-a370-43d9-adef-afb31d03e2fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:01:52 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-c44f0af5-1348-4f2e-a39e-0c5d1a87f7b5 req-7ec921a1-c5af-4471-ac25-8ee2f3ec4e1c service nova] Lock "be71985e-a370-43d9-adef-afb31d03e2fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:01:52 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-c44f0af5-1348-4f2e-a39e-0c5d1a87f7b5 req-7ec921a1-c5af-4471-ac25-8ee2f3ec4e1c service nova] Lock "be71985e-a370-43d9-adef-afb31d03e2fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:01:52 user nova-compute[75122]: DEBUG nova.compute.manager [req-c44f0af5-1348-4f2e-a39e-0c5d1a87f7b5 req-7ec921a1-c5af-4471-ac25-8ee2f3ec4e1c service nova] [instance: be71985e-a370-43d9-adef-afb31d03e2fd] No waiting events found dispatching network-vif-unplugged-4d28d025-0115-4813-b62a-a84ec8c47d58 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 10:01:52 user nova-compute[75122]: DEBUG nova.compute.manager [req-c44f0af5-1348-4f2e-a39e-0c5d1a87f7b5 req-7ec921a1-c5af-4471-ac25-8ee2f3ec4e1c service nova] [instance: be71985e-a370-43d9-adef-afb31d03e2fd] Received event network-vif-unplugged-4d28d025-0115-4813-b62a-a84ec8c47d58 for instance with task_state deleting. {{(pid=75122) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 10:01:53 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:01:53 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:01:53 user nova-compute[75122]: INFO nova.virt.libvirt.driver [-] [instance: be71985e-a370-43d9-adef-afb31d03e2fd] Instance destroyed successfully.
Nov 15 10:01:53 user nova-compute[75122]: DEBUG nova.objects.instance [None req-510f15d4-0608-44a8-a8c0-7b653fe0b089 tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] Lazy-loading 'resources' on Instance uuid be71985e-a370-43d9-adef-afb31d03e2fd {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 10:01:53 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-510f15d4-0608-44a8-a8c0-7b653fe0b089 tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T09:53:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1825073794',display_name='tempest-ServersNegativeTestJSON-server-1825073794',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1825073794',id=39,image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T09:53:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='88f16d3dc8434cb5ac78c8d2f51d305b',ramdisk_id='',reservation_id='r-qc02nu2a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1688784762',owner_user_name='tempest-ServersNegativeTestJSON-1688784762-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T09:53:13Z,user_data=None,user_id='199452e19f8742ea810c917fbfa0581a',uuid=be71985e-a370-43d9-adef-afb31d03e2fd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4d28d025-0115-4813-b62a-a84ec8c47d58", "address": "fa:16:3e:fa:cb:ca", "network": {"id": "ca2dff40-00d3-46b0-b9e2-dca375439496", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1592022235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88f16d3dc8434cb5ac78c8d2f51d305b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d28d025-01", "ovs_interfaceid": "4d28d025-0115-4813-b62a-a84ec8c47d58", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 10:01:53 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-510f15d4-0608-44a8-a8c0-7b653fe0b089 tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] Converting VIF {"id": "4d28d025-0115-4813-b62a-a84ec8c47d58", "address": "fa:16:3e:fa:cb:ca", "network": {"id": "ca2dff40-00d3-46b0-b9e2-dca375439496", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1592022235-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88f16d3dc8434cb5ac78c8d2f51d305b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d28d025-01", "ovs_interfaceid": "4d28d025-0115-4813-b62a-a84ec8c47d58", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 10:01:53 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-510f15d4-0608-44a8-a8c0-7b653fe0b089 tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fa:cb:ca,bridge_name='br-int',has_traffic_filtering=True,id=4d28d025-0115-4813-b62a-a84ec8c47d58,network=Network(ca2dff40-00d3-46b0-b9e2-dca375439496),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d28d025-01') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 10:01:53 user nova-compute[75122]: DEBUG os_vif [None req-510f15d4-0608-44a8-a8c0-7b653fe0b089 tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fa:cb:ca,bridge_name='br-int',has_traffic_filtering=True,id=4d28d025-0115-4813-b62a-a84ec8c47d58,network=Network(ca2dff40-00d3-46b0-b9e2-dca375439496),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d28d025-01') {{(pid=75122) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 10:01:53 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:01:53 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4d28d025-01, bridge=br-int, if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 10:01:53 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:01:53 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:01:53 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:01:53 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=258dea24-a594-40fd-8a1d-7cb4e88a1912) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 10:01:53 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:01:53 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:01:53 user nova-compute[75122]: INFO os_vif [None req-510f15d4-0608-44a8-a8c0-7b653fe0b089 tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fa:cb:ca,bridge_name='br-int',has_traffic_filtering=True,id=4d28d025-0115-4813-b62a-a84ec8c47d58,network=Network(ca2dff40-00d3-46b0-b9e2-dca375439496),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d28d025-01')
Nov 15 10:01:53 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-510f15d4-0608-44a8-a8c0-7b653fe0b089 tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] [instance: be71985e-a370-43d9-adef-afb31d03e2fd] Deleting instance files /opt/stack/data/nova/instances/be71985e-a370-43d9-adef-afb31d03e2fd_del
Nov 15 10:01:53 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-510f15d4-0608-44a8-a8c0-7b653fe0b089 tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] [instance: be71985e-a370-43d9-adef-afb31d03e2fd] Deletion of /opt/stack/data/nova/instances/be71985e-a370-43d9-adef-afb31d03e2fd_del complete
Nov 15 10:01:53 user nova-compute[75122]: INFO nova.compute.manager [None req-510f15d4-0608-44a8-a8c0-7b653fe0b089 tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] [instance: be71985e-a370-43d9-adef-afb31d03e2fd] Took 0.90 seconds to destroy the instance on the hypervisor.
Nov 15 10:01:53 user nova-compute[75122]: DEBUG oslo.service.loopingcall [None req-510f15d4-0608-44a8-a8c0-7b653fe0b089 tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75122) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 10:01:53 user nova-compute[75122]: DEBUG nova.compute.manager [-] [instance: be71985e-a370-43d9-adef-afb31d03e2fd] Deallocating network for instance {{(pid=75122) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 10:01:53 user nova-compute[75122]: DEBUG nova.network.neutron [-] [instance: be71985e-a370-43d9-adef-afb31d03e2fd] deallocate_for_instance() {{(pid=75122) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 10:01:53 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-008fe0b6-657e-43ec-b230-f9788c5c845f tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Searching for a device in session 54 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75122) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 10:01:53 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-008fe0b6-657e-43ec-b230-f9788c5c845f tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:11d2deb7-c652-48e3-ae06-5557c9bef981', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YoxPBlsS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75122) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 10:01:53 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-008fe0b6-657e-43ec-b230-f9788c5c845f tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.354s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 10:01:53 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-008fe0b6-657e-43ec-b230-f9788c5c845f tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] <== connect_volume: return (1356ms) {'type': 'block', 'scsi_wwn': '26232643833313265', 'path': '/dev/sde'} {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 10:01:53 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-008fe0b6-657e-43ec-b230-f9788c5c845f tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: 5954fd91-94c6-4521-9465-1477c0e35f8d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26232643833313265', 'path': '/dev/sde'} {{(pid=75122) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 10:01:53 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-008fe0b6-657e-43ec-b230-f9788c5c845f tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T10:01:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1321201668',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1321201668',id=45,image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c046170a2ad44ebba5d2de236d940be0',ramdisk_id='',reservation_id='r-0dynjry9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1545444983',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T10:01:38Z,user_data=None,user_id='53d187e2a07b4437a02f65fb47a003ee',uuid=5954fd91-94c6-4521-9465-1477c0e35f8d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e9b84607-88fe-411c-be24-0f2d1709d9e9", "address": "fa:16:3e:ef:6d:f1", "network": {"id": "b780d5c1-a549-4b49-a036-5a272697d4b6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-229344021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c046170a2ad44ebba5d2de236d940be0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9b84607-88", "ovs_interfaceid": "e9b84607-88fe-411c-be24-0f2d1709d9e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75122) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 10:01:53 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-008fe0b6-657e-43ec-b230-f9788c5c845f tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Converting VIF {"id": "e9b84607-88fe-411c-be24-0f2d1709d9e9", "address": "fa:16:3e:ef:6d:f1", "network": {"id": "b780d5c1-a549-4b49-a036-5a272697d4b6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-229344021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c046170a2ad44ebba5d2de236d940be0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9b84607-88", "ovs_interfaceid": "e9b84607-88fe-411c-be24-0f2d1709d9e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 10:01:53 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-008fe0b6-657e-43ec-b230-f9788c5c845f tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ef:6d:f1,bridge_name='br-int',has_traffic_filtering=True,id=e9b84607-88fe-411c-be24-0f2d1709d9e9,network=Network(b780d5c1-a549-4b49-a036-5a272697d4b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9b84607-88') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 10:01:53 user nova-compute[75122]: DEBUG nova.objects.instance [None req-008fe0b6-657e-43ec-b230-f9788c5c845f tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Lazy-loading 'pci_devices' on Instance uuid 5954fd91-94c6-4521-9465-1477c0e35f8d {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 10:01:53 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-008fe0b6-657e-43ec-b230-f9788c5c845f tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: 5954fd91-94c6-4521-9465-1477c0e35f8d] End _get_guest_xml xml=<domain type="kvm">
Nov 15 10:01:53 user nova-compute[75122]:   <uuid>5954fd91-94c6-4521-9465-1477c0e35f8d</uuid>
Nov 15 10:01:53 user nova-compute[75122]:   <name>instance-0000002d</name>
Nov 15 10:01:53 user nova-compute[75122]:   <memory>524288</memory>
Nov 15 10:01:53 user nova-compute[75122]:   <vcpu>1</vcpu>
Nov 15 10:01:53 user nova-compute[75122]:   <metadata>
Nov 15 10:01:53 user nova-compute[75122]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 10:01:53 user nova-compute[75122]:       <nova:package version="0.0.0"/>
Nov 15 10:01:53 user nova-compute[75122]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1321201668</nova:name>
Nov 15 10:01:53 user nova-compute[75122]:       <nova:creationTime>2023-11-15 10:01:52</nova:creationTime>
Nov 15 10:01:53 user nova-compute[75122]:       <nova:flavor name="m1.tiny">
Nov 15 10:01:53 user nova-compute[75122]:         <nova:memory>512</nova:memory>
Nov 15 10:01:53 user nova-compute[75122]:         <nova:disk>1</nova:disk>
Nov 15 10:01:53 user nova-compute[75122]:         <nova:swap>0</nova:swap>
Nov 15 10:01:53 user nova-compute[75122]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 10:01:53 user nova-compute[75122]:         <nova:vcpus>1</nova:vcpus>
Nov 15 10:01:53 user nova-compute[75122]:       </nova:flavor>
Nov 15 10:01:53 user nova-compute[75122]:       <nova:owner>
Nov 15 10:01:53 user nova-compute[75122]:         <nova:user uuid="53d187e2a07b4437a02f65fb47a003ee">tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member</nova:user>
Nov 15 10:01:53 user nova-compute[75122]:         <nova:project uuid="c046170a2ad44ebba5d2de236d940be0">tempest-ServerBootFromVolumeStableRescueTest-1545444983</nova:project>
Nov 15 10:01:53 user nova-compute[75122]:       </nova:owner>
Nov 15 10:01:53 user nova-compute[75122]:       <nova:root type="image" uuid="5e862cfe-47b8-4725-8292-65761ee6d0f5"/>
Nov 15 10:01:53 user nova-compute[75122]:       <nova:ports>
Nov 15 10:01:53 user nova-compute[75122]:         <nova:port uuid="e9b84607-88fe-411c-be24-0f2d1709d9e9">
Nov 15 10:01:53 user nova-compute[75122]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 15 10:01:53 user nova-compute[75122]:         </nova:port>
Nov 15 10:01:53 user nova-compute[75122]:       </nova:ports>
Nov 15 10:01:53 user nova-compute[75122]:     </nova:instance>
Nov 15 10:01:53 user nova-compute[75122]:   </metadata>
Nov 15 10:01:53 user nova-compute[75122]:   <sysinfo type="smbios">
Nov 15 10:01:53 user nova-compute[75122]:     <system>
Nov 15 10:01:53 user nova-compute[75122]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 10:01:53 user nova-compute[75122]:       <entry name="product">OpenStack Nova</entry>
Nov 15 10:01:53 user nova-compute[75122]:       <entry name="version">0.0.0</entry>
Nov 15 10:01:53 user nova-compute[75122]:       <entry name="serial">5954fd91-94c6-4521-9465-1477c0e35f8d</entry>
Nov 15 10:01:53 user nova-compute[75122]:       <entry name="uuid">5954fd91-94c6-4521-9465-1477c0e35f8d</entry>
Nov 15 10:01:53 user nova-compute[75122]:       <entry name="family">Virtual Machine</entry>
Nov 15 10:01:53 user nova-compute[75122]:     </system>
Nov 15 10:01:53 user nova-compute[75122]:   </sysinfo>
Nov 15 10:01:53 user nova-compute[75122]:   <os>
Nov 15 10:01:53 user nova-compute[75122]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 10:01:53 user nova-compute[75122]:     <boot dev="hd"/>
Nov 15 10:01:53 user nova-compute[75122]:     <smbios mode="sysinfo"/>
Nov 15 10:01:53 user nova-compute[75122]:   </os>
Nov 15 10:01:53 user nova-compute[75122]:   <features>
Nov 15 10:01:53 user nova-compute[75122]:     <acpi/>
Nov 15 10:01:53 user nova-compute[75122]:     <apic/>
Nov 15 10:01:53 user nova-compute[75122]:     <vmcoreinfo/>
Nov 15 10:01:53 user nova-compute[75122]:   </features>
Nov 15 10:01:53 user nova-compute[75122]:   <clock offset="utc">
Nov 15 10:01:53 user nova-compute[75122]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 10:01:53 user nova-compute[75122]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 10:01:53 user nova-compute[75122]:     <timer name="hpet" present="no"/>
Nov 15 10:01:53 user nova-compute[75122]:   </clock>
Nov 15 10:01:53 user nova-compute[75122]:   <cpu mode="custom" match="exact">
Nov 15 10:01:53 user nova-compute[75122]:     <model>Nehalem</model>
Nov 15 10:01:53 user nova-compute[75122]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 10:01:53 user nova-compute[75122]:   </cpu>
Nov 15 10:01:53 user nova-compute[75122]:   <devices>
Nov 15 10:01:53 user nova-compute[75122]:     <disk type="block" device="disk">
Nov 15 10:01:53 user nova-compute[75122]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 10:01:53 user nova-compute[75122]:       <source dev="/dev/sde"/>
Nov 15 10:01:53 user nova-compute[75122]:       <target dev="vda" bus="virtio"/>
Nov 15 10:01:53 user nova-compute[75122]:       <serial>11d2deb7-c652-48e3-ae06-5557c9bef981</serial>
Nov 15 10:01:53 user nova-compute[75122]:     </disk>
Nov 15 10:01:53 user nova-compute[75122]:     <interface type="ethernet">
Nov 15 10:01:53 user nova-compute[75122]:       <mac address="fa:16:3e:ef:6d:f1"/>
Nov 15 10:01:53 user nova-compute[75122]:       <model type="virtio"/>
Nov 15 10:01:53 user nova-compute[75122]:       <mtu size="1442"/>
Nov 15 10:01:53 user nova-compute[75122]:       <target dev="tape9b84607-88"/>
Nov 15 10:01:53 user nova-compute[75122]:     </interface>
Nov 15 10:01:53 user nova-compute[75122]:     <serial type="pty">
Nov 15 10:01:53 user nova-compute[75122]:       <log file="/opt/stack/data/nova/instances/5954fd91-94c6-4521-9465-1477c0e35f8d/console.log" append="off"/>
Nov 15 10:01:53 user nova-compute[75122]:     </serial>
Nov 15 10:01:53 user nova-compute[75122]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 10:01:53 user nova-compute[75122]:     <video>
Nov 15 10:01:53 user nova-compute[75122]:       <model type="virtio"/>
Nov 15 10:01:53 user nova-compute[75122]:     </video>
Nov 15 10:01:53 user nova-compute[75122]:     <rng model="virtio">
Nov 15 10:01:53 user nova-compute[75122]:       <backend model="random">/dev/urandom</backend>
Nov 15 10:01:53 user nova-compute[75122]:     </rng>
Nov 15 10:01:53 user nova-compute[75122]:     <controller type="usb" index="0" model="none"/>
Nov 15 10:01:53 user nova-compute[75122]:     <memballoon model="virtio">
Nov 15 10:01:53 user nova-compute[75122]:       <stats period="10"/>
Nov 15 10:01:53 user nova-compute[75122]:     </memballoon>
Nov 15 10:01:53 user nova-compute[75122]:   </devices>
Nov 15 10:01:53 user nova-compute[75122]: </domain>
Nov 15 10:01:53 user nova-compute[75122]:  {{(pid=75122) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 10:01:53 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-008fe0b6-657e-43ec-b230-f9788c5c845f tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T10:01:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1321201668',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1321201668',id=45,image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c046170a2ad44ebba5d2de236d940be0',ramdisk_id='',reservation_id='r-0dynjry9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1545444983',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T10:01:38Z,user_data=None,user_id='53d187e2a07b4437a02f65fb47a003ee',uuid=5954fd91-94c6-4521-9465-1477c0e35f8d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e9b84607-88fe-411c-be24-0f2d1709d9e9", "address": "fa:16:3e:ef:6d:f1", "network": {"id": "b780d5c1-a549-4b49-a036-5a272697d4b6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-229344021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c046170a2ad44ebba5d2de236d940be0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9b84607-88", "ovs_interfaceid": "e9b84607-88fe-411c-be24-0f2d1709d9e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 10:01:53 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-008fe0b6-657e-43ec-b230-f9788c5c845f tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Converting VIF {"id": "e9b84607-88fe-411c-be24-0f2d1709d9e9", "address": "fa:16:3e:ef:6d:f1", "network": {"id": "b780d5c1-a549-4b49-a036-5a272697d4b6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-229344021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c046170a2ad44ebba5d2de236d940be0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9b84607-88", "ovs_interfaceid": "e9b84607-88fe-411c-be24-0f2d1709d9e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 10:01:53 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-008fe0b6-657e-43ec-b230-f9788c5c845f tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ef:6d:f1,bridge_name='br-int',has_traffic_filtering=True,id=e9b84607-88fe-411c-be24-0f2d1709d9e9,network=Network(b780d5c1-a549-4b49-a036-5a272697d4b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9b84607-88') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 10:01:53 user nova-compute[75122]: DEBUG os_vif [None req-008fe0b6-657e-43ec-b230-f9788c5c845f tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:6d:f1,bridge_name='br-int',has_traffic_filtering=True,id=e9b84607-88fe-411c-be24-0f2d1709d9e9,network=Network(b780d5c1-a549-4b49-a036-5a272697d4b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9b84607-88') {{(pid=75122) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 10:01:53 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:01:53 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 10:01:53 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 10:01:53 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:01:53 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '92fe250f-20f3-58a2-9bec-dcdda4e8ec9b', '_type': 'linux-noop'}}, row=False) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 10:01:53 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:01:53 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:01:53 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:01:53 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:01:53 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape9b84607-88, may_exist=True, interface_attrs={}) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 10:01:53 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape9b84607-88, col_values=(('qos', UUID('835293ce-0c0f-4cd1-b618-ff4d3cda4c40')),), if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 10:01:53 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape9b84607-88, col_values=(('external_ids', {'iface-id': 'e9b84607-88fe-411c-be24-0f2d1709d9e9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ef:6d:f1', 'vm-uuid': '5954fd91-94c6-4521-9465-1477c0e35f8d'}),), if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 10:01:53 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:01:53 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:01:53 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:01:53 user nova-compute[75122]: INFO os_vif [None req-008fe0b6-657e-43ec-b230-f9788c5c845f tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ef:6d:f1,bridge_name='br-int',has_traffic_filtering=True,id=e9b84607-88fe-411c-be24-0f2d1709d9e9,network=Network(b780d5c1-a549-4b49-a036-5a272697d4b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9b84607-88')
Nov 15 10:01:53 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-008fe0b6-657e-43ec-b230-f9788c5c845f tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] No BDM found with device name vda, not building metadata. {{(pid=75122) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 10:01:53 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-008fe0b6-657e-43ec-b230-f9788c5c845f tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] No VIF found with MAC fa:16:3e:ef:6d:f1, not building metadata {{(pid=75122) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 10:01:53 user nova-compute[75122]: DEBUG nova.network.neutron [-] [instance: be71985e-a370-43d9-adef-afb31d03e2fd] Updating instance_info_cache with network_info: [] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 10:01:53 user nova-compute[75122]: INFO nova.compute.manager [-] [instance: be71985e-a370-43d9-adef-afb31d03e2fd] Took 0.45 seconds to deallocate network for instance.
Nov 15 10:01:53 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-510f15d4-0608-44a8-a8c0-7b653fe0b089 tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:01:53 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-510f15d4-0608-44a8-a8c0-7b653fe0b089 tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:01:53 user nova-compute[75122]: DEBUG nova.compute.manager [req-2d753f33-4493-46fa-b2df-ed6e04967967 req-585d83d0-9999-4906-a697-17b3abf182a2 service nova] [instance: be71985e-a370-43d9-adef-afb31d03e2fd] Received event network-vif-deleted-4d28d025-0115-4813-b62a-a84ec8c47d58 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 10:01:54 user nova-compute[75122]: DEBUG nova.compute.provider_tree [None req-510f15d4-0608-44a8-a8c0-7b653fe0b089 tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] Inventory has not changed in ProviderTree for provider: 69a3da65-47be-44c6-b67c-c692b58284ef {{(pid=75122) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 10:01:54 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-510f15d4-0608-44a8-a8c0-7b653fe0b089 tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] Inventory has not changed for provider 69a3da65-47be-44c6-b67c-c692b58284ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 10:01:54 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-510f15d4-0608-44a8-a8c0-7b653fe0b089 tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.340s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:01:54 user nova-compute[75122]: INFO nova.scheduler.client.report [None req-510f15d4-0608-44a8-a8c0-7b653fe0b089 tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] Deleted allocations for instance be71985e-a370-43d9-adef-afb31d03e2fd
Nov 15 10:01:54 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-510f15d4-0608-44a8-a8c0-7b653fe0b089 tempest-ServersNegativeTestJSON-1688784762 tempest-ServersNegativeTestJSON-1688784762-project-member] Lock "be71985e-a370-43d9-adef-afb31d03e2fd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.875s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:01:54 user nova-compute[75122]: DEBUG nova.compute.manager [req-88de6819-e6f6-4a90-af1a-6c99e0f6f83b req-e523d4c6-693c-4096-9e8d-c4fe58190460 service nova] [instance: be71985e-a370-43d9-adef-afb31d03e2fd] Received event network-vif-plugged-4d28d025-0115-4813-b62a-a84ec8c47d58 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 10:01:54 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-88de6819-e6f6-4a90-af1a-6c99e0f6f83b req-e523d4c6-693c-4096-9e8d-c4fe58190460 service nova] Acquiring lock "be71985e-a370-43d9-adef-afb31d03e2fd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:01:54 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-88de6819-e6f6-4a90-af1a-6c99e0f6f83b req-e523d4c6-693c-4096-9e8d-c4fe58190460 service nova] Lock "be71985e-a370-43d9-adef-afb31d03e2fd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:01:54 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-88de6819-e6f6-4a90-af1a-6c99e0f6f83b req-e523d4c6-693c-4096-9e8d-c4fe58190460 service nova] Lock "be71985e-a370-43d9-adef-afb31d03e2fd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:01:54 user nova-compute[75122]: DEBUG nova.compute.manager [req-88de6819-e6f6-4a90-af1a-6c99e0f6f83b req-e523d4c6-693c-4096-9e8d-c4fe58190460 service nova] [instance: be71985e-a370-43d9-adef-afb31d03e2fd] No waiting events found dispatching network-vif-plugged-4d28d025-0115-4813-b62a-a84ec8c47d58 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 10:01:54 user nova-compute[75122]: WARNING nova.compute.manager [req-88de6819-e6f6-4a90-af1a-6c99e0f6f83b req-e523d4c6-693c-4096-9e8d-c4fe58190460 service nova] [instance: be71985e-a370-43d9-adef-afb31d03e2fd] Received unexpected event network-vif-plugged-4d28d025-0115-4813-b62a-a84ec8c47d58 for instance with vm_state deleted and task_state None.
Nov 15 10:01:54 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:01:54 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:01:54 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:01:55 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:01:55 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:01:55 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:01:55 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75122) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 15 10:01:55 user nova-compute[75122]: DEBUG nova.compute.manager [req-be4b6259-150e-4200-a9f6-bf556de28397 req-b5751490-6436-482b-be78-dd2c2a242f0e service nova] [instance: 5954fd91-94c6-4521-9465-1477c0e35f8d] Received event network-vif-plugged-e9b84607-88fe-411c-be24-0f2d1709d9e9 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 10:01:55 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-be4b6259-150e-4200-a9f6-bf556de28397 req-b5751490-6436-482b-be78-dd2c2a242f0e service nova] Acquiring lock "5954fd91-94c6-4521-9465-1477c0e35f8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:01:55 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-be4b6259-150e-4200-a9f6-bf556de28397 req-b5751490-6436-482b-be78-dd2c2a242f0e service nova] Lock "5954fd91-94c6-4521-9465-1477c0e35f8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:01:55 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-be4b6259-150e-4200-a9f6-bf556de28397 req-b5751490-6436-482b-be78-dd2c2a242f0e service nova] Lock "5954fd91-94c6-4521-9465-1477c0e35f8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:01:55 user nova-compute[75122]: DEBUG nova.compute.manager [req-be4b6259-150e-4200-a9f6-bf556de28397 req-b5751490-6436-482b-be78-dd2c2a242f0e service nova] [instance: 5954fd91-94c6-4521-9465-1477c0e35f8d] No waiting events found dispatching network-vif-plugged-e9b84607-88fe-411c-be24-0f2d1709d9e9 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 10:01:55 user nova-compute[75122]: WARNING nova.compute.manager [req-be4b6259-150e-4200-a9f6-bf556de28397 req-b5751490-6436-482b-be78-dd2c2a242f0e service nova] [instance: 5954fd91-94c6-4521-9465-1477c0e35f8d] Received unexpected event network-vif-plugged-e9b84607-88fe-411c-be24-0f2d1709d9e9 for instance with vm_state building and task_state spawning.
Nov 15 10:01:55 user nova-compute[75122]: DEBUG nova.compute.manager [req-be4b6259-150e-4200-a9f6-bf556de28397 req-b5751490-6436-482b-be78-dd2c2a242f0e service nova] [instance: 5954fd91-94c6-4521-9465-1477c0e35f8d] Received event network-vif-plugged-e9b84607-88fe-411c-be24-0f2d1709d9e9 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 10:01:55 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-be4b6259-150e-4200-a9f6-bf556de28397 req-b5751490-6436-482b-be78-dd2c2a242f0e service nova] Acquiring lock "5954fd91-94c6-4521-9465-1477c0e35f8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:01:55 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-be4b6259-150e-4200-a9f6-bf556de28397 req-b5751490-6436-482b-be78-dd2c2a242f0e service nova] Lock "5954fd91-94c6-4521-9465-1477c0e35f8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:01:55 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-be4b6259-150e-4200-a9f6-bf556de28397 req-b5751490-6436-482b-be78-dd2c2a242f0e service nova] Lock "5954fd91-94c6-4521-9465-1477c0e35f8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:01:55 user nova-compute[75122]: DEBUG nova.compute.manager [req-be4b6259-150e-4200-a9f6-bf556de28397 req-b5751490-6436-482b-be78-dd2c2a242f0e service nova] [instance: 5954fd91-94c6-4521-9465-1477c0e35f8d] No waiting events found dispatching network-vif-plugged-e9b84607-88fe-411c-be24-0f2d1709d9e9 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 10:01:55 user nova-compute[75122]: WARNING nova.compute.manager [req-be4b6259-150e-4200-a9f6-bf556de28397 req-b5751490-6436-482b-be78-dd2c2a242f0e service nova] [instance: 5954fd91-94c6-4521-9465-1477c0e35f8d] Received unexpected event network-vif-plugged-e9b84607-88fe-411c-be24-0f2d1709d9e9 for instance with vm_state building and task_state spawning.
Nov 15 10:01:56 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:01:56 user nova-compute[75122]: DEBUG nova.compute.manager [None req-008fe0b6-657e-43ec-b230-f9788c5c845f tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: 5954fd91-94c6-4521-9465-1477c0e35f8d] Instance event wait completed in 0 seconds for  {{(pid=75122) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 10:01:56 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-008fe0b6-657e-43ec-b230-f9788c5c845f tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: 5954fd91-94c6-4521-9465-1477c0e35f8d] Guest created on hypervisor {{(pid=75122) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 10:01:56 user nova-compute[75122]: INFO nova.virt.libvirt.driver [-] [instance: 5954fd91-94c6-4521-9465-1477c0e35f8d] Instance spawned successfully.
Nov 15 10:01:56 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-008fe0b6-657e-43ec-b230-f9788c5c845f tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: 5954fd91-94c6-4521-9465-1477c0e35f8d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 10:01:56 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-008fe0b6-657e-43ec-b230-f9788c5c845f tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: 5954fd91-94c6-4521-9465-1477c0e35f8d] Found default for hw_cdrom_bus of ide {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 10:01:56 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-008fe0b6-657e-43ec-b230-f9788c5c845f tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: 5954fd91-94c6-4521-9465-1477c0e35f8d] Found default for hw_disk_bus of virtio {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 10:01:56 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-008fe0b6-657e-43ec-b230-f9788c5c845f tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: 5954fd91-94c6-4521-9465-1477c0e35f8d] Found default for hw_input_bus of None {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 10:01:56 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-008fe0b6-657e-43ec-b230-f9788c5c845f tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: 5954fd91-94c6-4521-9465-1477c0e35f8d] Found default for hw_pointer_model of None {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 10:01:56 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-008fe0b6-657e-43ec-b230-f9788c5c845f tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: 5954fd91-94c6-4521-9465-1477c0e35f8d] Found default for hw_video_model of virtio {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 10:01:56 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-008fe0b6-657e-43ec-b230-f9788c5c845f tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: 5954fd91-94c6-4521-9465-1477c0e35f8d] Found default for hw_vif_model of virtio {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 10:01:57 user nova-compute[75122]: INFO nova.compute.manager [None req-008fe0b6-657e-43ec-b230-f9788c5c845f tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: 5954fd91-94c6-4521-9465-1477c0e35f8d] Took 4.96 seconds to spawn the instance on the hypervisor.
Nov 15 10:01:57 user nova-compute[75122]: DEBUG nova.compute.manager [None req-008fe0b6-657e-43ec-b230-f9788c5c845f tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: 5954fd91-94c6-4521-9465-1477c0e35f8d] Checking state {{(pid=75122) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 10:01:57 user nova-compute[75122]: INFO nova.compute.manager [None req-008fe0b6-657e-43ec-b230-f9788c5c845f tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: 5954fd91-94c6-4521-9465-1477c0e35f8d] Took 19.37 seconds to build instance.
Nov 15 10:01:57 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-008fe0b6-657e-43ec-b230-f9788c5c845f tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Lock "5954fd91-94c6-4521-9465-1477c0e35f8d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.462s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:01:58 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:02:03 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:02:03 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:02:03 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75122) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 10:02:03 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75122) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 10:02:03 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75122) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 10:02:03 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:02:08 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:02:08 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:02:08 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75122) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 10:02:08 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75122) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 10:02:08 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75122) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 10:02:08 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:02:13 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:02:13 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:02:13 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75122) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 10:02:13 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75122) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 10:02:13 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75122) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 10:02:13 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:02:16 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:02:17 user nova-compute[75122]: DEBUG nova.compute.manager [req-8d8f60b0-8225-4edd-8a5e-2be612eed197 req-6a313338-f990-45d3-8500-b815bd07195b service nova] [instance: 1f426091-b78a-4d40-bff4-a5c23f155e54] Received event network-changed-f096e3d4-b769-4e60-a355-52e3765faeb9 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 10:02:17 user nova-compute[75122]: DEBUG nova.compute.manager [req-8d8f60b0-8225-4edd-8a5e-2be612eed197 req-6a313338-f990-45d3-8500-b815bd07195b service nova] [instance: 1f426091-b78a-4d40-bff4-a5c23f155e54] Refreshing instance network info cache due to event network-changed-f096e3d4-b769-4e60-a355-52e3765faeb9. {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 10:02:17 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-8d8f60b0-8225-4edd-8a5e-2be612eed197 req-6a313338-f990-45d3-8500-b815bd07195b service nova] Acquiring lock "refresh_cache-1f426091-b78a-4d40-bff4-a5c23f155e54" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 10:02:17 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-8d8f60b0-8225-4edd-8a5e-2be612eed197 req-6a313338-f990-45d3-8500-b815bd07195b service nova] Acquired lock "refresh_cache-1f426091-b78a-4d40-bff4-a5c23f155e54" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 10:02:17 user nova-compute[75122]: DEBUG nova.network.neutron [req-8d8f60b0-8225-4edd-8a5e-2be612eed197 req-6a313338-f990-45d3-8500-b815bd07195b service nova] [instance: 1f426091-b78a-4d40-bff4-a5c23f155e54] Refreshing network info cache for port f096e3d4-b769-4e60-a355-52e3765faeb9 {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 10:02:17 user nova-compute[75122]: DEBUG nova.network.neutron [req-8d8f60b0-8225-4edd-8a5e-2be612eed197 req-6a313338-f990-45d3-8500-b815bd07195b service nova] [instance: 1f426091-b78a-4d40-bff4-a5c23f155e54] Updated VIF entry in instance network info cache for port f096e3d4-b769-4e60-a355-52e3765faeb9. {{(pid=75122) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 10:02:17 user nova-compute[75122]: DEBUG nova.network.neutron [req-8d8f60b0-8225-4edd-8a5e-2be612eed197 req-6a313338-f990-45d3-8500-b815bd07195b service nova] [instance: 1f426091-b78a-4d40-bff4-a5c23f155e54] Updating instance_info_cache with network_info: [{"id": "f096e3d4-b769-4e60-a355-52e3765faeb9", "address": "fa:16:3e:cc:76:68", "network": {"id": "03073971-5253-4f06-a46a-94840841fd6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2056706757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7941f36c30b49408ae5709a1b75346d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf096e3d4-b7", "ovs_interfaceid": "f096e3d4-b769-4e60-a355-52e3765faeb9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 10:02:17 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-8d8f60b0-8225-4edd-8a5e-2be612eed197 req-6a313338-f990-45d3-8500-b815bd07195b service nova] Releasing lock "refresh_cache-1f426091-b78a-4d40-bff4-a5c23f155e54" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 10:02:18 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:02:21 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:02:21 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:02:23 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-97411bcf-7975-41fb-ad4d-ee7828f54418 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Acquiring lock "066af25e-462a-4c1e-b7de-9df3bca4c679" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:02:23 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-97411bcf-7975-41fb-ad4d-ee7828f54418 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Lock "066af25e-462a-4c1e-b7de-9df3bca4c679" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:02:23 user nova-compute[75122]: DEBUG nova.compute.manager [None req-97411bcf-7975-41fb-ad4d-ee7828f54418 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 066af25e-462a-4c1e-b7de-9df3bca4c679] Starting instance... {{(pid=75122) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 10:02:23 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-97411bcf-7975-41fb-ad4d-ee7828f54418 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:02:23 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-97411bcf-7975-41fb-ad4d-ee7828f54418 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:02:23 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-97411bcf-7975-41fb-ad4d-ee7828f54418 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75122) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 10:02:23 user nova-compute[75122]: INFO nova.compute.claims [None req-97411bcf-7975-41fb-ad4d-ee7828f54418 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 066af25e-462a-4c1e-b7de-9df3bca4c679] Claim successful on node user
Nov 15 10:02:23 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:02:23 user nova-compute[75122]: DEBUG nova.compute.provider_tree [None req-97411bcf-7975-41fb-ad4d-ee7828f54418 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Inventory has not changed in ProviderTree for provider: 69a3da65-47be-44c6-b67c-c692b58284ef {{(pid=75122) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 10:02:23 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-97411bcf-7975-41fb-ad4d-ee7828f54418 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Inventory has not changed for provider 69a3da65-47be-44c6-b67c-c692b58284ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 10:02:23 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-97411bcf-7975-41fb-ad4d-ee7828f54418 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.323s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:02:23 user nova-compute[75122]: DEBUG nova.compute.manager [None req-97411bcf-7975-41fb-ad4d-ee7828f54418 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 066af25e-462a-4c1e-b7de-9df3bca4c679] Start building networks asynchronously for instance. {{(pid=75122) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 10:02:23 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-97411bcf-7975-41fb-ad4d-ee7828f54418 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 066af25e-462a-4c1e-b7de-9df3bca4c679] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 10:02:23 user nova-compute[75122]: DEBUG nova.compute.manager [None req-97411bcf-7975-41fb-ad4d-ee7828f54418 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 066af25e-462a-4c1e-b7de-9df3bca4c679] Allocating IP information in the background. {{(pid=75122) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 10:02:23 user nova-compute[75122]: DEBUG nova.network.neutron [None req-97411bcf-7975-41fb-ad4d-ee7828f54418 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 066af25e-462a-4c1e-b7de-9df3bca4c679] allocate_for_instance() {{(pid=75122) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 10:02:23 user nova-compute[75122]: DEBUG nova.compute.manager [None req-97411bcf-7975-41fb-ad4d-ee7828f54418 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 066af25e-462a-4c1e-b7de-9df3bca4c679] Start building block device mappings for instance. {{(pid=75122) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 10:02:23 user nova-compute[75122]: INFO nova.virt.block_device [None req-97411bcf-7975-41fb-ad4d-ee7828f54418 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 066af25e-462a-4c1e-b7de-9df3bca4c679] Booting with volume snapshot ca77c793-f2b4-4640-98a3-c88eaadee6e7 at /dev/vda
Nov 15 10:02:23 user nova-compute[75122]: DEBUG nova.policy [None req-97411bcf-7975-41fb-ad4d-ee7828f54418 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '00f5cc88e43c434c8a061dcec472a16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7941f36c30b49408ae5709a1b75346d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75122) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 10:02:24 user nova-compute[75122]: DEBUG nova.network.neutron [None req-97411bcf-7975-41fb-ad4d-ee7828f54418 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 066af25e-462a-4c1e-b7de-9df3bca4c679] Successfully created port: 78d7ad1b-c17f-4a6b-b1b5-5b3b44d55890 {{(pid=75122) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 10:02:25 user nova-compute[75122]: DEBUG nova.network.neutron [None req-97411bcf-7975-41fb-ad4d-ee7828f54418 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 066af25e-462a-4c1e-b7de-9df3bca4c679] Successfully updated port: 78d7ad1b-c17f-4a6b-b1b5-5b3b44d55890 {{(pid=75122) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 10:02:25 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-97411bcf-7975-41fb-ad4d-ee7828f54418 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Acquiring lock "refresh_cache-066af25e-462a-4c1e-b7de-9df3bca4c679" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 10:02:25 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-97411bcf-7975-41fb-ad4d-ee7828f54418 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Acquired lock "refresh_cache-066af25e-462a-4c1e-b7de-9df3bca4c679" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 10:02:25 user nova-compute[75122]: DEBUG nova.network.neutron [None req-97411bcf-7975-41fb-ad4d-ee7828f54418 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 066af25e-462a-4c1e-b7de-9df3bca4c679] Building network info cache for instance {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 10:02:25 user nova-compute[75122]: DEBUG nova.compute.manager [req-ac85e016-060c-447f-91e5-50c1945cc330 req-ab3a3830-c623-4e9f-bd11-3b53a325697a service nova] [instance: 066af25e-462a-4c1e-b7de-9df3bca4c679] Received event network-changed-78d7ad1b-c17f-4a6b-b1b5-5b3b44d55890 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 10:02:25 user nova-compute[75122]: DEBUG nova.compute.manager [req-ac85e016-060c-447f-91e5-50c1945cc330 req-ab3a3830-c623-4e9f-bd11-3b53a325697a service nova] [instance: 066af25e-462a-4c1e-b7de-9df3bca4c679] Refreshing instance network info cache due to event network-changed-78d7ad1b-c17f-4a6b-b1b5-5b3b44d55890. {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 10:02:25 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-ac85e016-060c-447f-91e5-50c1945cc330 req-ab3a3830-c623-4e9f-bd11-3b53a325697a service nova] Acquiring lock "refresh_cache-066af25e-462a-4c1e-b7de-9df3bca4c679" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 10:02:25 user nova-compute[75122]: DEBUG nova.network.neutron [None req-97411bcf-7975-41fb-ad4d-ee7828f54418 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 066af25e-462a-4c1e-b7de-9df3bca4c679] Instance cache missing network info. {{(pid=75122) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 10:02:25 user nova-compute[75122]: DEBUG nova.network.neutron [None req-97411bcf-7975-41fb-ad4d-ee7828f54418 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 066af25e-462a-4c1e-b7de-9df3bca4c679] Updating instance_info_cache with network_info: [{"id": "78d7ad1b-c17f-4a6b-b1b5-5b3b44d55890", "address": "fa:16:3e:75:fc:9e", "network": {"id": "03073971-5253-4f06-a46a-94840841fd6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2056706757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7941f36c30b49408ae5709a1b75346d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78d7ad1b-c1", "ovs_interfaceid": "78d7ad1b-c17f-4a6b-b1b5-5b3b44d55890", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 10:02:25 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-97411bcf-7975-41fb-ad4d-ee7828f54418 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Releasing lock "refresh_cache-066af25e-462a-4c1e-b7de-9df3bca4c679" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 10:02:25 user nova-compute[75122]: DEBUG nova.compute.manager [None req-97411bcf-7975-41fb-ad4d-ee7828f54418 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 066af25e-462a-4c1e-b7de-9df3bca4c679] Instance network_info: |[{"id": "78d7ad1b-c17f-4a6b-b1b5-5b3b44d55890", "address": "fa:16:3e:75:fc:9e", "network": {"id": "03073971-5253-4f06-a46a-94840841fd6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2056706757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7941f36c30b49408ae5709a1b75346d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78d7ad1b-c1", "ovs_interfaceid": "78d7ad1b-c17f-4a6b-b1b5-5b3b44d55890", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75122) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 10:02:25 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-ac85e016-060c-447f-91e5-50c1945cc330 req-ab3a3830-c623-4e9f-bd11-3b53a325697a service nova] Acquired lock "refresh_cache-066af25e-462a-4c1e-b7de-9df3bca4c679" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 10:02:25 user nova-compute[75122]: DEBUG nova.network.neutron [req-ac85e016-060c-447f-91e5-50c1945cc330 req-ab3a3830-c623-4e9f-bd11-3b53a325697a service nova] [instance: 066af25e-462a-4c1e-b7de-9df3bca4c679] Refreshing network info cache for port 78d7ad1b-c17f-4a6b-b1b5-5b3b44d55890 {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 10:02:26 user nova-compute[75122]: DEBUG nova.network.neutron [req-ac85e016-060c-447f-91e5-50c1945cc330 req-ab3a3830-c623-4e9f-bd11-3b53a325697a service nova] [instance: 066af25e-462a-4c1e-b7de-9df3bca4c679] Updated VIF entry in instance network info cache for port 78d7ad1b-c17f-4a6b-b1b5-5b3b44d55890. {{(pid=75122) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 10:02:26 user nova-compute[75122]: DEBUG nova.network.neutron [req-ac85e016-060c-447f-91e5-50c1945cc330 req-ab3a3830-c623-4e9f-bd11-3b53a325697a service nova] [instance: 066af25e-462a-4c1e-b7de-9df3bca4c679] Updating instance_info_cache with network_info: [{"id": "78d7ad1b-c17f-4a6b-b1b5-5b3b44d55890", "address": "fa:16:3e:75:fc:9e", "network": {"id": "03073971-5253-4f06-a46a-94840841fd6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2056706757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7941f36c30b49408ae5709a1b75346d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78d7ad1b-c1", "ovs_interfaceid": "78d7ad1b-c17f-4a6b-b1b5-5b3b44d55890", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 10:02:26 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-ac85e016-060c-447f-91e5-50c1945cc330 req-ab3a3830-c623-4e9f-bd11-3b53a325697a service nova] Releasing lock "refresh_cache-066af25e-462a-4c1e-b7de-9df3bca4c679" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 10:02:26 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:02:28 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:02:29 user nova-compute[75122]: DEBUG os_brick.utils [None req-97411bcf-7975-41fb-ad4d-ee7828f54418 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 10:02:29 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:02:29 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:02:29 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[34a84ee6-a6df-4bf3-a19b-52df35993d1a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:742fb64b3587\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:02:29 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:02:29 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:02:29 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[4717f69c-8dcc-4b8b-8668-bf205d6be348]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:02:29 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:02:29 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:02:29 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[2da062a8-3a23-481e-9991-9831e7d08486]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:02:29 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b239e59-97f6-46b3-ba41-8b29faeb3574]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:02:29 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-97411bcf-7975-41fb-ad4d-ee7828f54418 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Running cmd (subprocess): nvme version {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:02:29 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-97411bcf-7975-41fb-ad4d-ee7828f54418 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] 'nvme version' failed. Not Retrying. {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 10:02:29 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.nvmeof [None req-97411bcf-7975-41fb-ad4d-ee7828f54418 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] nvme not present on system {{(pid=75122) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 10:02:29 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:02:29 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 10:02:29 user nova-compute[75122]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 10:02:29 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebc32ce7-4f08-42c2-a158-abbf9b488078]: (4, '') {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:02:29 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.lightos [None req-97411bcf-7975-41fb-ad4d-ee7828f54418 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75122) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 10:02:29 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.lightos [None req-97411bcf-7975-41fb-ad4d-ee7828f54418 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75122) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 10:02:29 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.lightos [None req-97411bcf-7975-41fb-ad4d-ee7828f54418 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] LIGHTOS: no hostnqn found. {{(pid=75122) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 10:02:29 user nova-compute[75122]: DEBUG os_brick.utils [None req-97411bcf-7975-41fb-ad4d-ee7828f54418 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:742fb64b3587', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 10:02:29 user nova-compute[75122]: DEBUG nova.virt.block_device [None req-97411bcf-7975-41fb-ad4d-ee7828f54418 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 066af25e-462a-4c1e-b7de-9df3bca4c679] Updating existing volume attachment record: 773a6a07-4554-42a7-a36b-fdcfd6a5459b {{(pid=75122) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 10:02:31 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:02:33 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:02:34 user nova-compute[75122]: DEBUG nova.compute.manager [None req-97411bcf-7975-41fb-ad4d-ee7828f54418 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 066af25e-462a-4c1e-b7de-9df3bca4c679] Start spawning the instance on the hypervisor. {{(pid=75122) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 10:02:34 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-97411bcf-7975-41fb-ad4d-ee7828f54418 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 066af25e-462a-4c1e-b7de-9df3bca4c679] Creating instance directory {{(pid=75122) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 10:02:34 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-97411bcf-7975-41fb-ad4d-ee7828f54418 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 066af25e-462a-4c1e-b7de-9df3bca4c679] Creating image(s)
Nov 15 10:02:34 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-97411bcf-7975-41fb-ad4d-ee7828f54418 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 066af25e-462a-4c1e-b7de-9df3bca4c679] Did not create local disks {{(pid=75122) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 10:02:34 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-97411bcf-7975-41fb-ad4d-ee7828f54418 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 066af25e-462a-4c1e-b7de-9df3bca4c679] Ensure instance console log exists: /opt/stack/data/nova/instances/066af25e-462a-4c1e-b7de-9df3bca4c679/console.log {{(pid=75122) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 10:02:34 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-97411bcf-7975-41fb-ad4d-ee7828f54418 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:02:34 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-97411bcf-7975-41fb-ad4d-ee7828f54418 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:02:34 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-97411bcf-7975-41fb-ad4d-ee7828f54418 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:02:34 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-97411bcf-7975-41fb-ad4d-ee7828f54418 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 066af25e-462a-4c1e-b7de-9df3bca4c679] Start _get_guest_xml network_info=[{"id": "78d7ad1b-c17f-4a6b-b1b5-5b3b44d55890", "address": "fa:16:3e:75:fc:9e", "network": {"id": "03073971-5253-4f06-a46a-94840841fd6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2056706757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7941f36c30b49408ae5709a1b75346d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78d7ad1b-c1", "ovs_interfaceid": "78d7ad1b-c17f-4a6b-b1b5-5b3b44d55890", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-15T10:02:19Z,direct_url=<?>,disk_format='qcow2',id=4f1cef98-363f-4654-8182-82d5d4ca179f,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1938081661',owner='c7941f36c30b49408ae5709a1b75346d',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-15T10:02:21Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0e03a7fc-bdb5-4505-ba7a-b0a896124e5f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pAQOsJZe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '066af25e-462a-4c1e-b7de-9df3bca4c679', 'attached_at': '', 'detached_at': '', 'volume_id': '0e03a7fc-bdb5-4505-ba7a-b0a896124e5f', 'serial': '0e03a7fc-bdb5-4505-ba7a-b0a896124e5f'}, 'guest_format': None, 'delete_on_termination': True, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vda', 'attachment_id': '773a6a07-4554-42a7-a36b-fdcfd6a5459b', 'volume_type': None} {{(pid=75122) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 10:02:34 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-97411bcf-7975-41fb-ad4d-ee7828f54418 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 10:02:34 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-97411bcf-7975-41fb-ad4d-ee7828f54418 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 10:02:34 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-97411bcf-7975-41fb-ad4d-ee7828f54418 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75122) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 10:02:34 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-97411bcf-7975-41fb-ad4d-ee7828f54418 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] CPU controller missing on host. {{(pid=75122) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 10:02:34 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-97411bcf-7975-41fb-ad4d-ee7828f54418 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75122) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 10:02:34 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-97411bcf-7975-41fb-ad4d-ee7828f54418 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] CPU controller found on host. {{(pid=75122) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 10:02:34 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-97411bcf-7975-41fb-ad4d-ee7828f54418 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75122) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 10:02:34 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-97411bcf-7975-41fb-ad4d-ee7828f54418 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T09:26:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-15T10:02:19Z,direct_url=<?>,disk_format='qcow2',id=4f1cef98-363f-4654-8182-82d5d4ca179f,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1938081661',owner='c7941f36c30b49408ae5709a1b75346d',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-15T10:02:21Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 10:02:34 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-97411bcf-7975-41fb-ad4d-ee7828f54418 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Flavor limits 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 10:02:34 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-97411bcf-7975-41fb-ad4d-ee7828f54418 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Image limits 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 10:02:34 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-97411bcf-7975-41fb-ad4d-ee7828f54418 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Flavor pref 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 10:02:34 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-97411bcf-7975-41fb-ad4d-ee7828f54418 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Image pref 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 10:02:34 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-97411bcf-7975-41fb-ad4d-ee7828f54418 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 10:02:34 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-97411bcf-7975-41fb-ad4d-ee7828f54418 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 10:02:34 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-97411bcf-7975-41fb-ad4d-ee7828f54418 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75122) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 10:02:34 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-97411bcf-7975-41fb-ad4d-ee7828f54418 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Got 1 possible topologies {{(pid=75122) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 10:02:34 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-97411bcf-7975-41fb-ad4d-ee7828f54418 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 10:02:34 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-97411bcf-7975-41fb-ad4d-ee7828f54418 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 10:02:34 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-97411bcf-7975-41fb-ad4d-ee7828f54418 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 066af25e-462a-4c1e-b7de-9df3bca4c679] Calling os-brick to attach iSCSI Volume {{(pid=75122) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 10:02:34 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-97411bcf-7975-41fb-ad4d-ee7828f54418 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffa04060b80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0e03a7fc-bdb5-4505-ba7a-b0a896124e5f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pAQOsJZe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 10:02:34 user nova-compute[75122]: WARNING os_brick.initiator.connectors.base [None req-97411bcf-7975-41fb-ad4d-ee7828f54418 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 10:02:34 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-97411bcf-7975-41fb-ad4d-ee7828f54418 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 10:02:34 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-97411bcf-7975-41fb-ad4d-ee7828f54418 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 10:02:34 user nova-compute[75122]: WARNING os_brick.initiator.connectors.base [None req-97411bcf-7975-41fb-ad4d-ee7828f54418 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 10:02:34 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-97411bcf-7975-41fb-ad4d-ee7828f54418 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0e03a7fc-bdb5-4505-ba7a-b0a896124e5f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 10:02:34 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-97411bcf-7975-41fb-ad4d-ee7828f54418 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0e03a7fc-bdb5-4505-ba7a-b0a896124e5f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 10:02:34 user nova-compute[75122]: INFO os_brick.initiator.connectors.iscsi [None req-97411bcf-7975-41fb-ad4d-ee7828f54418 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 10:02:34 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e03a7fc-bdb5-4505-ba7a-b0a896124e5f -p 172.16.0.220:3260 {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:02:34 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e03a7fc-bdb5-4505-ba7a-b0a896124e5f -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:02:34 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[1887ec49-e031-41af-878a-fedbe9678158]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:02:34 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-97411bcf-7975-41fb-ad4d-ee7828f54418 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 10:02:34 user nova-compute[75122]:  {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 10:02:34 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e03a7fc-bdb5-4505-ba7a-b0a896124e5f -p 172.16.0.220:3260 --interface default --op new {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:02:34 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e03a7fc-bdb5-4505-ba7a-b0a896124e5f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:02:34 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[03ec79d2-afa9-4449-b0fc-1b7dd6efa9d3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0e03a7fc-bdb5-4505-ba7a-b0a896124e5f] added\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:02:34 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-97411bcf-7975-41fb-ad4d-ee7828f54418 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0e03a7fc-bdb5-4505-ba7a-b0a896124e5f] added
Nov 15 10:02:34 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 10:02:34 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e03a7fc-bdb5-4505-ba7a-b0a896124e5f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:02:34 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e03a7fc-bdb5-4505-ba7a-b0a896124e5f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:02:34 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8bd7250-8b9c-41b7-8ae5-e92307c0ff9f]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:02:34 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-97411bcf-7975-41fb-ad4d-ee7828f54418 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 10:02:34 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e03a7fc-bdb5-4505-ba7a-b0a896124e5f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:02:34 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e03a7fc-bdb5-4505-ba7a-b0a896124e5f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:02:34 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[a93e59cf-eb69-45f2-904c-9b34d7584e84]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:02:34 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-97411bcf-7975-41fb-ad4d-ee7828f54418 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 10:02:34 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e03a7fc-bdb5-4505-ba7a-b0a896124e5f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pAQOsJZe {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:02:34 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e03a7fc-bdb5-4505-ba7a-b0a896124e5f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pAQOsJZe" returned: 0 in 0.021s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:02:34 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fe4afa6-da7a-4731-ba15-0b9bbc673b46]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:02:34 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-97411bcf-7975-41fb-ad4d-ee7828f54418 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pAQOsJZe'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 10:02:34 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e03a7fc-bdb5-4505-ba7a-b0a896124e5f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:02:34 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e03a7fc-bdb5-4505-ba7a-b0a896124e5f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:02:34 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6aacd35-9fbd-4ff9-9c0a-84876b4ab532]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:02:34 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-97411bcf-7975-41fb-ad4d-ee7828f54418 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 10:02:34 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:02:34 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:02:34 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1827028-14a7-4a27-b6e9-81e246543a9f]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee79db2-27c2-4d0f-8ee6-5b03e05ebba5 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d703360-7eee-4b0b-9b1d-a42e2170de6c (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d42739d6-477a-4322-ad52-6491b80a4a48 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11d2deb7-c652-48e3-ae06-5557c9bef981 (non-flash)\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:02:34 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-97411bcf-7975-41fb-ad4d-ee7828f54418 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee79db2-27c2-4d0f-8ee6-5b03e05ebba5 (non-flash)
Nov 15 10:02:34 user nova-compute[75122]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d703360-7eee-4b0b-9b1d-a42e2170de6c (non-flash)
Nov 15 10:02:34 user nova-compute[75122]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d42739d6-477a-4322-ad52-6491b80a4a48 (non-flash)
Nov 15 10:02:34 user nova-compute[75122]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11d2deb7-c652-48e3-ae06-5557c9bef981 (non-flash)
Nov 15 10:02:34 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 10:02:34 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-97411bcf-7975-41fb-ad4d-ee7828f54418 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee79db2-27c2-4d0f-8ee6-5b03e05ebba5 (non-flash)
Nov 15 10:02:34 user nova-compute[75122]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d703360-7eee-4b0b-9b1d-a42e2170de6c (non-flash)
Nov 15 10:02:34 user nova-compute[75122]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d42739d6-477a-4322-ad52-6491b80a4a48 (non-flash)
Nov 15 10:02:34 user nova-compute[75122]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11d2deb7-c652-48e3-ae06-5557c9bef981 (non-flash)
Nov 15 10:02:34 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 10:02:34 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e03a7fc-bdb5-4505-ba7a-b0a896124e5f -p 172.16.0.220:3260 --login {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:02:34 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e03a7fc-bdb5-4505-ba7a-b0a896124e5f -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:02:34 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d061c1d-d126-42e9-901a-b6b0ca2377c3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0e03a7fc-bdb5-4505-ba7a-b0a896124e5f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0e03a7fc-bdb5-4505-ba7a-b0a896124e5f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:02:34 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-97411bcf-7975-41fb-ad4d-ee7828f54418 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0e03a7fc-bdb5-4505-ba7a-b0a896124e5f, portal: 172.16.0.220,3260]
Nov 15 10:02:34 user nova-compute[75122]: Login to [iface: default, target: iqn.2010-10.org.openstack:0e03a7fc-bdb5-4505-ba7a-b0a896124e5f, portal: 172.16.0.220,3260] successful.
Nov 15 10:02:34 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 10:02:34 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e03a7fc-bdb5-4505-ba7a-b0a896124e5f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:02:34 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e03a7fc-bdb5-4505-ba7a-b0a896124e5f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:02:34 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[e45e86a6-d5c2-4337-8c2f-b826f4944277]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:02:34 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-97411bcf-7975-41fb-ad4d-ee7828f54418 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 10:02:34 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:02:34 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:02:34 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[7171e011-9cc6-4b24-9311-ffd64762fc7a]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee79db2-27c2-4d0f-8ee6-5b03e05ebba5 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d703360-7eee-4b0b-9b1d-a42e2170de6c (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d42739d6-477a-4322-ad52-6491b80a4a48 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11d2deb7-c652-48e3-ae06-5557c9bef981 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e03a7fc-bdb5-4505-ba7a-b0a896124e5f (non-flash)\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:02:34 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-97411bcf-7975-41fb-ad4d-ee7828f54418 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee79db2-27c2-4d0f-8ee6-5b03e05ebba5 (non-flash)
Nov 15 10:02:34 user nova-compute[75122]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d703360-7eee-4b0b-9b1d-a42e2170de6c (non-flash)
Nov 15 10:02:34 user nova-compute[75122]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d42739d6-477a-4322-ad52-6491b80a4a48 (non-flash)
Nov 15 10:02:34 user nova-compute[75122]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11d2deb7-c652-48e3-ae06-5557c9bef981 (non-flash)
Nov 15 10:02:34 user nova-compute[75122]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e03a7fc-bdb5-4505-ba7a-b0a896124e5f (non-flash)
Nov 15 10:02:34 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 10:02:34 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-97411bcf-7975-41fb-ad4d-ee7828f54418 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee79db2-27c2-4d0f-8ee6-5b03e05ebba5 (non-flash)
Nov 15 10:02:34 user nova-compute[75122]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d703360-7eee-4b0b-9b1d-a42e2170de6c (non-flash)
Nov 15 10:02:34 user nova-compute[75122]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d42739d6-477a-4322-ad52-6491b80a4a48 (non-flash)
Nov 15 10:02:34 user nova-compute[75122]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11d2deb7-c652-48e3-ae06-5557c9bef981 (non-flash)
Nov 15 10:02:34 user nova-compute[75122]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e03a7fc-bdb5-4505-ba7a-b0a896124e5f (non-flash)
Nov 15 10:02:34 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 10:02:34 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-97411bcf-7975-41fb-ad4d-ee7828f54418 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0e03a7fc-bdb5-4505-ba7a-b0a896124e5f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.279s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 10:02:34 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-97411bcf-7975-41fb-ad4d-ee7828f54418 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Connected to 172.16.0.220:3260 {{(pid=75122) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 10:02:34 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-97411bcf-7975-41fb-ad4d-ee7828f54418 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] HCTL ('37', '-', '-', 0) found on session 55 with lun 0 {{(pid=75122) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 10:02:34 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-97411bcf-7975-41fb-ad4d-ee7828f54418 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75122) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 10:02:34 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:02:34 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:02:34 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[b039c8ac-99c3-4dc3-a708-196062d9fda5]: (4, ('- - 0', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:02:34 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-97411bcf-7975-41fb-ad4d-ee7828f54418 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Searching for a device in session 55 and hctl ['37', '*', '*', 0] yield: None {{(pid=75122) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 10:02:35 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-97411bcf-7975-41fb-ad4d-ee7828f54418 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Searching for a device in session 55 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75122) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 10:02:35 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-97411bcf-7975-41fb-ad4d-ee7828f54418 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:0e03a7fc-bdb5-4505-ba7a-b0a896124e5f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pAQOsJZe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75122) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 10:02:35 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-97411bcf-7975-41fb-ad4d-ee7828f54418 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.382s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 10:02:35 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-97411bcf-7975-41fb-ad4d-ee7828f54418 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] <== connect_volume: return (1383ms) {'type': 'block', 'scsi_wwn': '23637303434386561', 'path': '/dev/sdf'} {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 10:02:35 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-97411bcf-7975-41fb-ad4d-ee7828f54418 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 066af25e-462a-4c1e-b7de-9df3bca4c679] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23637303434386561', 'path': '/dev/sdf'} {{(pid=75122) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 10:02:36 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:02:36 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-97411bcf-7975-41fb-ad4d-ee7828f54418 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T10:02:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1995821154',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1995821154',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1995821154',id=46,image_ref='4f1cef98-363f-4654-8182-82d5d4ca179f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKeGIKbGOsxVJWCNdSeKOUaiLUUQXUsXJRcFpZhOxjxm+jZxfKvhoJhLQVqNZLJrlxuYFKNje7SnTs+spajGXtffc0Tjmp9J8l1ajoV4yt62ekgTKejfwVfmIwk3RJosWQ==',key_name='tempest-keypair-657382480',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c7941f36c30b49408ae5709a1b75346d',ramdisk_id='',reservation_id='r-uexssavu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-296749341',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-296749341-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-296749341',owner_user_name='tempest-TestVolumeBootPattern-296749341-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T10:02:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='00f5cc88e43c434c8a061dcec472a16b',uuid=066af25e-462a-4c1e-b7de-9df3bca4c679,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "78d7ad1b-c17f-4a6b-b1b5-5b3b44d55890", "address": "fa:16:3e:75:fc:9e", "network": {"id": "03073971-5253-4f06-a46a-94840841fd6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2056706757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7941f36c30b49408ae5709a1b75346d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78d7ad1b-c1", "ovs_interfaceid": "78d7ad1b-c17f-4a6b-b1b5-5b3b44d55890", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75122) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 10:02:36 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-97411bcf-7975-41fb-ad4d-ee7828f54418 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Converting VIF {"id": "78d7ad1b-c17f-4a6b-b1b5-5b3b44d55890", "address": "fa:16:3e:75:fc:9e", "network": {"id": "03073971-5253-4f06-a46a-94840841fd6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2056706757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7941f36c30b49408ae5709a1b75346d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78d7ad1b-c1", "ovs_interfaceid": "78d7ad1b-c17f-4a6b-b1b5-5b3b44d55890", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 10:02:36 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-97411bcf-7975-41fb-ad4d-ee7828f54418 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:fc:9e,bridge_name='br-int',has_traffic_filtering=True,id=78d7ad1b-c17f-4a6b-b1b5-5b3b44d55890,network=Network(03073971-5253-4f06-a46a-94840841fd6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78d7ad1b-c1') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 10:02:36 user nova-compute[75122]: DEBUG nova.objects.instance [None req-97411bcf-7975-41fb-ad4d-ee7828f54418 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Lazy-loading 'pci_devices' on Instance uuid 066af25e-462a-4c1e-b7de-9df3bca4c679 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 10:02:36 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-97411bcf-7975-41fb-ad4d-ee7828f54418 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 066af25e-462a-4c1e-b7de-9df3bca4c679] End _get_guest_xml xml=<domain type="kvm">
Nov 15 10:02:36 user nova-compute[75122]:   <uuid>066af25e-462a-4c1e-b7de-9df3bca4c679</uuid>
Nov 15 10:02:36 user nova-compute[75122]:   <name>instance-0000002e</name>
Nov 15 10:02:36 user nova-compute[75122]:   <memory>524288</memory>
Nov 15 10:02:36 user nova-compute[75122]:   <vcpu>1</vcpu>
Nov 15 10:02:36 user nova-compute[75122]:   <metadata>
Nov 15 10:02:36 user nova-compute[75122]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 10:02:36 user nova-compute[75122]:       <nova:package version="0.0.0"/>
Nov 15 10:02:36 user nova-compute[75122]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-1995821154</nova:name>
Nov 15 10:02:36 user nova-compute[75122]:       <nova:creationTime>2023-11-15 10:02:34</nova:creationTime>
Nov 15 10:02:36 user nova-compute[75122]:       <nova:flavor name="m1.tiny">
Nov 15 10:02:36 user nova-compute[75122]:         <nova:memory>512</nova:memory>
Nov 15 10:02:36 user nova-compute[75122]:         <nova:disk>1</nova:disk>
Nov 15 10:02:36 user nova-compute[75122]:         <nova:swap>0</nova:swap>
Nov 15 10:02:36 user nova-compute[75122]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 10:02:36 user nova-compute[75122]:         <nova:vcpus>1</nova:vcpus>
Nov 15 10:02:36 user nova-compute[75122]:       </nova:flavor>
Nov 15 10:02:36 user nova-compute[75122]:       <nova:owner>
Nov 15 10:02:36 user nova-compute[75122]:         <nova:user uuid="00f5cc88e43c434c8a061dcec472a16b">tempest-TestVolumeBootPattern-296749341-project-member</nova:user>
Nov 15 10:02:36 user nova-compute[75122]:         <nova:project uuid="c7941f36c30b49408ae5709a1b75346d">tempest-TestVolumeBootPattern-296749341</nova:project>
Nov 15 10:02:36 user nova-compute[75122]:       </nova:owner>
Nov 15 10:02:36 user nova-compute[75122]:       <nova:root type="image" uuid="4f1cef98-363f-4654-8182-82d5d4ca179f"/>
Nov 15 10:02:36 user nova-compute[75122]:       <nova:ports>
Nov 15 10:02:36 user nova-compute[75122]:         <nova:port uuid="78d7ad1b-c17f-4a6b-b1b5-5b3b44d55890">
Nov 15 10:02:36 user nova-compute[75122]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 15 10:02:36 user nova-compute[75122]:         </nova:port>
Nov 15 10:02:36 user nova-compute[75122]:       </nova:ports>
Nov 15 10:02:36 user nova-compute[75122]:     </nova:instance>
Nov 15 10:02:36 user nova-compute[75122]:   </metadata>
Nov 15 10:02:36 user nova-compute[75122]:   <sysinfo type="smbios">
Nov 15 10:02:36 user nova-compute[75122]:     <system>
Nov 15 10:02:36 user nova-compute[75122]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 10:02:36 user nova-compute[75122]:       <entry name="product">OpenStack Nova</entry>
Nov 15 10:02:36 user nova-compute[75122]:       <entry name="version">0.0.0</entry>
Nov 15 10:02:36 user nova-compute[75122]:       <entry name="serial">066af25e-462a-4c1e-b7de-9df3bca4c679</entry>
Nov 15 10:02:36 user nova-compute[75122]:       <entry name="uuid">066af25e-462a-4c1e-b7de-9df3bca4c679</entry>
Nov 15 10:02:36 user nova-compute[75122]:       <entry name="family">Virtual Machine</entry>
Nov 15 10:02:36 user nova-compute[75122]:     </system>
Nov 15 10:02:36 user nova-compute[75122]:   </sysinfo>
Nov 15 10:02:36 user nova-compute[75122]:   <os>
Nov 15 10:02:36 user nova-compute[75122]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 10:02:36 user nova-compute[75122]:     <boot dev="hd"/>
Nov 15 10:02:36 user nova-compute[75122]:     <smbios mode="sysinfo"/>
Nov 15 10:02:36 user nova-compute[75122]:   </os>
Nov 15 10:02:36 user nova-compute[75122]:   <features>
Nov 15 10:02:36 user nova-compute[75122]:     <acpi/>
Nov 15 10:02:36 user nova-compute[75122]:     <apic/>
Nov 15 10:02:36 user nova-compute[75122]:     <vmcoreinfo/>
Nov 15 10:02:36 user nova-compute[75122]:   </features>
Nov 15 10:02:36 user nova-compute[75122]:   <clock offset="utc">
Nov 15 10:02:36 user nova-compute[75122]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 10:02:36 user nova-compute[75122]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 10:02:36 user nova-compute[75122]:     <timer name="hpet" present="no"/>
Nov 15 10:02:36 user nova-compute[75122]:   </clock>
Nov 15 10:02:36 user nova-compute[75122]:   <cpu mode="custom" match="exact">
Nov 15 10:02:36 user nova-compute[75122]:     <model>Nehalem</model>
Nov 15 10:02:36 user nova-compute[75122]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 10:02:36 user nova-compute[75122]:   </cpu>
Nov 15 10:02:36 user nova-compute[75122]:   <devices>
Nov 15 10:02:36 user nova-compute[75122]:     <disk type="block" device="disk">
Nov 15 10:02:36 user nova-compute[75122]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 10:02:36 user nova-compute[75122]:       <source dev="/dev/sdf"/>
Nov 15 10:02:36 user nova-compute[75122]:       <target dev="vda" bus="virtio"/>
Nov 15 10:02:36 user nova-compute[75122]:       <serial>0e03a7fc-bdb5-4505-ba7a-b0a896124e5f</serial>
Nov 15 10:02:36 user nova-compute[75122]:     </disk>
Nov 15 10:02:36 user nova-compute[75122]:     <interface type="ethernet">
Nov 15 10:02:36 user nova-compute[75122]:       <mac address="fa:16:3e:75:fc:9e"/>
Nov 15 10:02:36 user nova-compute[75122]:       <model type="virtio"/>
Nov 15 10:02:36 user nova-compute[75122]:       <mtu size="1442"/>
Nov 15 10:02:36 user nova-compute[75122]:       <target dev="tap78d7ad1b-c1"/>
Nov 15 10:02:36 user nova-compute[75122]:     </interface>
Nov 15 10:02:36 user nova-compute[75122]:     <serial type="pty">
Nov 15 10:02:36 user nova-compute[75122]:       <log file="/opt/stack/data/nova/instances/066af25e-462a-4c1e-b7de-9df3bca4c679/console.log" append="off"/>
Nov 15 10:02:36 user nova-compute[75122]:     </serial>
Nov 15 10:02:36 user nova-compute[75122]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 10:02:36 user nova-compute[75122]:     <video>
Nov 15 10:02:36 user nova-compute[75122]:       <model type="virtio"/>
Nov 15 10:02:36 user nova-compute[75122]:     </video>
Nov 15 10:02:36 user nova-compute[75122]:     <rng model="virtio">
Nov 15 10:02:36 user nova-compute[75122]:       <backend model="random">/dev/urandom</backend>
Nov 15 10:02:36 user nova-compute[75122]:     </rng>
Nov 15 10:02:36 user nova-compute[75122]:     <controller type="usb" index="0" model="none"/>
Nov 15 10:02:36 user nova-compute[75122]:     <memballoon model="virtio">
Nov 15 10:02:36 user nova-compute[75122]:       <stats period="10"/>
Nov 15 10:02:36 user nova-compute[75122]:     </memballoon>
Nov 15 10:02:36 user nova-compute[75122]:   </devices>
Nov 15 10:02:36 user nova-compute[75122]: </domain>
Nov 15 10:02:36 user nova-compute[75122]:  {{(pid=75122) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 10:02:36 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-97411bcf-7975-41fb-ad4d-ee7828f54418 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T10:02:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1995821154',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1995821154',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1995821154',id=46,image_ref='4f1cef98-363f-4654-8182-82d5d4ca179f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKeGIKbGOsxVJWCNdSeKOUaiLUUQXUsXJRcFpZhOxjxm+jZxfKvhoJhLQVqNZLJrlxuYFKNje7SnTs+spajGXtffc0Tjmp9J8l1ajoV4yt62ekgTKejfwVfmIwk3RJosWQ==',key_name='tempest-keypair-657382480',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c7941f36c30b49408ae5709a1b75346d',ramdisk_id='',reservation_id='r-uexssavu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-296749341',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-296749341-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-296749341',owner_user_name='tempest-TestVolumeBootPattern-296749341-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T10:02:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='00f5cc88e43c434c8a061dcec472a16b',uuid=066af25e-462a-4c1e-b7de-9df3bca4c679,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "78d7ad1b-c17f-4a6b-b1b5-5b3b44d55890", "address": "fa:16:3e:75:fc:9e", "network": {"id": "03073971-5253-4f06-a46a-94840841fd6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2056706757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7941f36c30b49408ae5709a1b75346d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78d7ad1b-c1", "ovs_interfaceid": "78d7ad1b-c17f-4a6b-b1b5-5b3b44d55890", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 10:02:36 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-97411bcf-7975-41fb-ad4d-ee7828f54418 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Converting VIF {"id": "78d7ad1b-c17f-4a6b-b1b5-5b3b44d55890", "address": "fa:16:3e:75:fc:9e", "network": {"id": "03073971-5253-4f06-a46a-94840841fd6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2056706757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7941f36c30b49408ae5709a1b75346d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78d7ad1b-c1", "ovs_interfaceid": "78d7ad1b-c17f-4a6b-b1b5-5b3b44d55890", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 10:02:36 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-97411bcf-7975-41fb-ad4d-ee7828f54418 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:fc:9e,bridge_name='br-int',has_traffic_filtering=True,id=78d7ad1b-c17f-4a6b-b1b5-5b3b44d55890,network=Network(03073971-5253-4f06-a46a-94840841fd6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78d7ad1b-c1') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 10:02:36 user nova-compute[75122]: DEBUG os_vif [None req-97411bcf-7975-41fb-ad4d-ee7828f54418 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:fc:9e,bridge_name='br-int',has_traffic_filtering=True,id=78d7ad1b-c17f-4a6b-b1b5-5b3b44d55890,network=Network(03073971-5253-4f06-a46a-94840841fd6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78d7ad1b-c1') {{(pid=75122) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 10:02:36 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:02:36 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 10:02:36 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 10:02:36 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:02:36 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5c7d7ee4-a8f0-5f49-be14-1043422dbdd2', '_type': 'linux-noop'}}, row=False) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 10:02:36 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:02:36 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:02:36 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:02:36 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap78d7ad1b-c1, may_exist=True, interface_attrs={}) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 10:02:36 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap78d7ad1b-c1, col_values=(('qos', UUID('49f08710-0474-4947-96fd-1fdfd611a4f3')),), if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 10:02:36 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap78d7ad1b-c1, col_values=(('external_ids', {'iface-id': '78d7ad1b-c17f-4a6b-b1b5-5b3b44d55890', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:75:fc:9e', 'vm-uuid': '066af25e-462a-4c1e-b7de-9df3bca4c679'}),), if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 10:02:36 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:02:36 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:02:36 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:02:36 user nova-compute[75122]: INFO os_vif [None req-97411bcf-7975-41fb-ad4d-ee7828f54418 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:fc:9e,bridge_name='br-int',has_traffic_filtering=True,id=78d7ad1b-c17f-4a6b-b1b5-5b3b44d55890,network=Network(03073971-5253-4f06-a46a-94840841fd6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78d7ad1b-c1')
Nov 15 10:02:36 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-97411bcf-7975-41fb-ad4d-ee7828f54418 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] No BDM found with device name vda, not building metadata. {{(pid=75122) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 10:02:36 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-97411bcf-7975-41fb-ad4d-ee7828f54418 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] No VIF found with MAC fa:16:3e:75:fc:9e, not building metadata {{(pid=75122) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 10:02:36 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:02:37 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:02:37 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:02:37 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:02:37 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:02:37 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75122) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 10:02:37 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:02:37 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:02:37 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:02:37 user nova-compute[75122]: DEBUG nova.compute.manager [req-eebbd4c7-e05b-4cc0-b114-ea3668cf8c9f req-71a89d20-344f-4531-8f56-577ed830dbfc service nova] [instance: 066af25e-462a-4c1e-b7de-9df3bca4c679] Received event network-vif-plugged-78d7ad1b-c17f-4a6b-b1b5-5b3b44d55890 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 10:02:37 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-eebbd4c7-e05b-4cc0-b114-ea3668cf8c9f req-71a89d20-344f-4531-8f56-577ed830dbfc service nova] Acquiring lock "066af25e-462a-4c1e-b7de-9df3bca4c679-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:02:37 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-eebbd4c7-e05b-4cc0-b114-ea3668cf8c9f req-71a89d20-344f-4531-8f56-577ed830dbfc service nova] Lock "066af25e-462a-4c1e-b7de-9df3bca4c679-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:02:37 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-eebbd4c7-e05b-4cc0-b114-ea3668cf8c9f req-71a89d20-344f-4531-8f56-577ed830dbfc service nova] Lock "066af25e-462a-4c1e-b7de-9df3bca4c679-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:02:37 user nova-compute[75122]: DEBUG nova.compute.manager [req-eebbd4c7-e05b-4cc0-b114-ea3668cf8c9f req-71a89d20-344f-4531-8f56-577ed830dbfc service nova] [instance: 066af25e-462a-4c1e-b7de-9df3bca4c679] No waiting events found dispatching network-vif-plugged-78d7ad1b-c17f-4a6b-b1b5-5b3b44d55890 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 10:02:37 user nova-compute[75122]: WARNING nova.compute.manager [req-eebbd4c7-e05b-4cc0-b114-ea3668cf8c9f req-71a89d20-344f-4531-8f56-577ed830dbfc service nova] [instance: 066af25e-462a-4c1e-b7de-9df3bca4c679] Received unexpected event network-vif-plugged-78d7ad1b-c17f-4a6b-b1b5-5b3b44d55890 for instance with vm_state building and task_state spawning.
Nov 15 10:02:37 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:02:38 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75122) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 10:02:38 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c8b3a13-761f-4491-a367-64e74f038629/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:02:38 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c8b3a13-761f-4491-a367-64e74f038629/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:02:38 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c8b3a13-761f-4491-a367-64e74f038629/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:02:38 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c8b3a13-761f-4491-a367-64e74f038629/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:02:38 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75122) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 10:02:38 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/001d589e-1bee-42da-8422-233ba796fbab/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:02:38 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/001d589e-1bee-42da-8422-233ba796fbab/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:02:38 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/001d589e-1bee-42da-8422-233ba796fbab/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:02:38 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/001d589e-1bee-42da-8422-233ba796fbab/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:02:38 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75122) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 10:02:38 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75122) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 10:02:38 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ad77a91-bc65-44a8-8ced-fd2ad9237946/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:02:39 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ad77a91-bc65-44a8-8ced-fd2ad9237946/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:02:39 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ad77a91-bc65-44a8-8ced-fd2ad9237946/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:02:39 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ad77a91-bc65-44a8-8ced-fd2ad9237946/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:02:39 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75122) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 10:02:39 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 10:02:39 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 10:02:39 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Hypervisor/Node resource view: name=user free_ram=8395MB free_disk=25.037498474121094GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75122) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 10:02:39 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:02:39 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:02:39 user nova-compute[75122]: DEBUG nova.compute.manager [None req-97411bcf-7975-41fb-ad4d-ee7828f54418 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 066af25e-462a-4c1e-b7de-9df3bca4c679] Instance event wait completed in 0 seconds for  {{(pid=75122) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 10:02:39 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-97411bcf-7975-41fb-ad4d-ee7828f54418 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 066af25e-462a-4c1e-b7de-9df3bca4c679] Guest created on hypervisor {{(pid=75122) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 10:02:39 user nova-compute[75122]: INFO nova.virt.libvirt.driver [-] [instance: 066af25e-462a-4c1e-b7de-9df3bca4c679] Instance spawned successfully.
Nov 15 10:02:39 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-97411bcf-7975-41fb-ad4d-ee7828f54418 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 066af25e-462a-4c1e-b7de-9df3bca4c679] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 10:02:39 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-97411bcf-7975-41fb-ad4d-ee7828f54418 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 066af25e-462a-4c1e-b7de-9df3bca4c679] Found default for hw_input_bus of None {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 10:02:39 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-97411bcf-7975-41fb-ad4d-ee7828f54418 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 066af25e-462a-4c1e-b7de-9df3bca4c679] Found default for hw_pointer_model of None {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 10:02:39 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance 001d589e-1bee-42da-8422-233ba796fbab actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 10:02:39 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance db848537-676f-464a-806d-febb14d920a6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 10:02:39 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance 9ad77a91-bc65-44a8-8ced-fd2ad9237946 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 10:02:39 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance 4c8b3a13-761f-4491-a367-64e74f038629 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 10:02:39 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance 1f426091-b78a-4d40-bff4-a5c23f155e54 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 10:02:39 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance 5954fd91-94c6-4521-9465-1477c0e35f8d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 10:02:39 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance 066af25e-462a-4c1e-b7de-9df3bca4c679 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 10:02:39 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75122) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 10:02:39 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75122) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 10:02:39 user nova-compute[75122]: INFO nova.compute.manager [None req-97411bcf-7975-41fb-ad4d-ee7828f54418 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 066af25e-462a-4c1e-b7de-9df3bca4c679] Took 5.29 seconds to spawn the instance on the hypervisor.
Nov 15 10:02:39 user nova-compute[75122]: DEBUG nova.compute.manager [None req-97411bcf-7975-41fb-ad4d-ee7828f54418 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 066af25e-462a-4c1e-b7de-9df3bca4c679] Checking state {{(pid=75122) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 10:02:39 user nova-compute[75122]: DEBUG nova.compute.manager [req-b5c9bf28-5044-485b-81f1-3dab60f25c7d req-89f3a21c-5e36-47c1-a0f0-8848d9b8819c service nova] [instance: 066af25e-462a-4c1e-b7de-9df3bca4c679] Received event network-vif-plugged-78d7ad1b-c17f-4a6b-b1b5-5b3b44d55890 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 10:02:39 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-b5c9bf28-5044-485b-81f1-3dab60f25c7d req-89f3a21c-5e36-47c1-a0f0-8848d9b8819c service nova] Acquiring lock "066af25e-462a-4c1e-b7de-9df3bca4c679-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:02:39 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-b5c9bf28-5044-485b-81f1-3dab60f25c7d req-89f3a21c-5e36-47c1-a0f0-8848d9b8819c service nova] Lock "066af25e-462a-4c1e-b7de-9df3bca4c679-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:02:39 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-b5c9bf28-5044-485b-81f1-3dab60f25c7d req-89f3a21c-5e36-47c1-a0f0-8848d9b8819c service nova] Lock "066af25e-462a-4c1e-b7de-9df3bca4c679-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:02:39 user nova-compute[75122]: DEBUG nova.compute.manager [req-b5c9bf28-5044-485b-81f1-3dab60f25c7d req-89f3a21c-5e36-47c1-a0f0-8848d9b8819c service nova] [instance: 066af25e-462a-4c1e-b7de-9df3bca4c679] No waiting events found dispatching network-vif-plugged-78d7ad1b-c17f-4a6b-b1b5-5b3b44d55890 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 10:02:39 user nova-compute[75122]: WARNING nova.compute.manager [req-b5c9bf28-5044-485b-81f1-3dab60f25c7d req-89f3a21c-5e36-47c1-a0f0-8848d9b8819c service nova] [instance: 066af25e-462a-4c1e-b7de-9df3bca4c679] Received unexpected event network-vif-plugged-78d7ad1b-c17f-4a6b-b1b5-5b3b44d55890 for instance with vm_state building and task_state spawning.
Nov 15 10:02:39 user nova-compute[75122]: INFO nova.compute.manager [None req-97411bcf-7975-41fb-ad4d-ee7828f54418 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 066af25e-462a-4c1e-b7de-9df3bca4c679] Took 16.48 seconds to build instance.
Nov 15 10:02:39 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-97411bcf-7975-41fb-ad4d-ee7828f54418 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Lock "066af25e-462a-4c1e-b7de-9df3bca4c679" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.567s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:02:39 user nova-compute[75122]: DEBUG nova.compute.provider_tree [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Inventory has not changed in ProviderTree for provider: 69a3da65-47be-44c6-b67c-c692b58284ef {{(pid=75122) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 10:02:39 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Inventory has not changed for provider 69a3da65-47be-44c6-b67c-c692b58284ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 10:02:39 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Compute_service record updated for user:user {{(pid=75122) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 10:02:39 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.370s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:02:41 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:02:41 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:02:41 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:02:41 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:02:42 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:02:43 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:02:43 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:02:43 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:02:43 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75122) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 10:02:45 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:02:46 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:02:46 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:02:46 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Starting heal instance info cache {{(pid=75122) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 10:02:46 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:02:46 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "refresh_cache-9ad77a91-bc65-44a8-8ced-fd2ad9237946" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 10:02:46 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquired lock "refresh_cache-9ad77a91-bc65-44a8-8ced-fd2ad9237946" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 10:02:46 user nova-compute[75122]: DEBUG nova.network.neutron [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] [instance: 9ad77a91-bc65-44a8-8ced-fd2ad9237946] Forcefully refreshing network info cache for instance {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 10:02:46 user nova-compute[75122]: DEBUG nova.network.neutron [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] [instance: 9ad77a91-bc65-44a8-8ced-fd2ad9237946] Updating instance_info_cache with network_info: [{"id": "e348b3b5-1fc0-4c27-98e7-41a152a67610", "address": "fa:16:3e:d3:b1:38", "network": {"id": "8c1491a5-d5c6-4a22-84fd-bdeca00bbaad", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1848328203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab6afbe7809a4ad3921cbc18145d1816", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape348b3b5-1f", "ovs_interfaceid": "e348b3b5-1fc0-4c27-98e7-41a152a67610", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 10:02:46 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Releasing lock "refresh_cache-9ad77a91-bc65-44a8-8ced-fd2ad9237946" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 10:02:46 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] [instance: 9ad77a91-bc65-44a8-8ced-fd2ad9237946] Updated the network info_cache for instance {{(pid=75122) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 10:02:51 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:02:51 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:02:51 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75122) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 10:02:51 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75122) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 10:02:51 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75122) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 10:02:51 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:02:51 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:02:56 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:02:56 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:03:01 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:03:01 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:03:03 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-2d832cd8-92fa-4ff9-b34c-9214440de0fc tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Acquiring lock "9ad77a91-bc65-44a8-8ced-fd2ad9237946" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:03:03 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-2d832cd8-92fa-4ff9-b34c-9214440de0fc tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Lock "9ad77a91-bc65-44a8-8ced-fd2ad9237946" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:03:03 user nova-compute[75122]: INFO nova.compute.manager [None req-2d832cd8-92fa-4ff9-b34c-9214440de0fc tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] [instance: 9ad77a91-bc65-44a8-8ced-fd2ad9237946] Detaching volume d42739d6-477a-4322-ad52-6491b80a4a48
Nov 15 10:03:03 user nova-compute[75122]: INFO nova.virt.block_device [None req-2d832cd8-92fa-4ff9-b34c-9214440de0fc tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] [instance: 9ad77a91-bc65-44a8-8ced-fd2ad9237946] Attempting to driver detach volume d42739d6-477a-4322-ad52-6491b80a4a48 from mountpoint /dev/vdb
Nov 15 10:03:03 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-2d832cd8-92fa-4ff9-b34c-9214440de0fc tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Attempting to detach device vdb from instance 9ad77a91-bc65-44a8-8ced-fd2ad9237946 from the persistent domain config. {{(pid=75122) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 10:03:03 user nova-compute[75122]: DEBUG nova.virt.libvirt.guest [None req-2d832cd8-92fa-4ff9-b34c-9214440de0fc tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 10:03:03 user nova-compute[75122]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 10:03:03 user nova-compute[75122]:   <source dev="/dev/sdd"/>
Nov 15 10:03:03 user nova-compute[75122]:   <target dev="vdb" bus="virtio"/>
Nov 15 10:03:03 user nova-compute[75122]:   <serial>d42739d6-477a-4322-ad52-6491b80a4a48</serial>
Nov 15 10:03:03 user nova-compute[75122]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 15 10:03:03 user nova-compute[75122]: </disk>
Nov 15 10:03:03 user nova-compute[75122]:  {{(pid=75122) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 10:03:03 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-2d832cd8-92fa-4ff9-b34c-9214440de0fc tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Successfully detached device vdb from instance 9ad77a91-bc65-44a8-8ced-fd2ad9237946 from the persistent domain config.
Nov 15 10:03:03 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-2d832cd8-92fa-4ff9-b34c-9214440de0fc tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9ad77a91-bc65-44a8-8ced-fd2ad9237946 from the live domain config. {{(pid=75122) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 10:03:03 user nova-compute[75122]: DEBUG nova.virt.libvirt.guest [None req-2d832cd8-92fa-4ff9-b34c-9214440de0fc tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 10:03:03 user nova-compute[75122]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 10:03:03 user nova-compute[75122]:   <source dev="/dev/sdd"/>
Nov 15 10:03:03 user nova-compute[75122]:   <target dev="vdb" bus="virtio"/>
Nov 15 10:03:03 user nova-compute[75122]:   <serial>d42739d6-477a-4322-ad52-6491b80a4a48</serial>
Nov 15 10:03:03 user nova-compute[75122]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 15 10:03:03 user nova-compute[75122]: </disk>
Nov 15 10:03:03 user nova-compute[75122]:  {{(pid=75122) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 10:03:04 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-2d832cd8-92fa-4ff9-b34c-9214440de0fc tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9ad77a91-bc65-44a8-8ced-fd2ad9237946 {{(pid=75122) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 10:03:06 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:03:06 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:03:11 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:03:11 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:03:16 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:03:21 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:03:21 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:03:21 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75122) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 10:03:21 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75122) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 10:03:21 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75122) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 10:03:21 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:03:24 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-2d832cd8-92fa-4ff9-b34c-9214440de0fc tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 9ad77a91-bc65-44a8-8ced-fd2ad9237946 is timed out.
Nov 15 10:03:24 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-2d832cd8-92fa-4ff9-b34c-9214440de0fc tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Successfully detached device vdb from instance 9ad77a91-bc65-44a8-8ced-fd2ad9237946 from the live domain config.
Nov 15 10:03:24 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2d832cd8-92fa-4ff9-b34c-9214440de0fc tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] [instance: 9ad77a91-bc65-44a8-8ced-fd2ad9237946] calling os-brick to detach iSCSI Volume {{(pid=75122) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 10:03:24 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d832cd8-92fa-4ff9-b34c-9214440de0fc tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffa04060b80>, {'target_iqn': 'iqn.2010-10.org.openstack:d42739d6-477a-4322-ad52-6491b80a4a48', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CInMWrXi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 10:03:24 user nova-compute[75122]: WARNING os_brick.initiator.connectors.base [None req-2d832cd8-92fa-4ff9-b34c-9214440de0fc tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 10:03:24 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-2d832cd8-92fa-4ff9-b34c-9214440de0fc tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 10:03:24 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-2d832cd8-92fa-4ff9-b34c-9214440de0fc tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 10:03:24 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:03:24 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:03:24 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4ed1c59-89fc-4098-bac1-54955af4286b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2d703360-7eee-4b0b-9b1d-a42e2170de6c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:11d2deb7-c652-48e3-ae06-5557c9bef981\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d42739d6-477a-4322-ad52-6491b80a4a48\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8ee79db2-27c2-4d0f-8ee6-5b03e05ebba5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0e03a7fc-bdb5-4505-ba7a-b0a896124e5f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:03:24 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d832cd8-92fa-4ff9-b34c-9214440de0fc tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 10:03:24 user nova-compute[75122]: No targets found.
Nov 15 10:03:24 user nova-compute[75122]: iSNS:
Nov 15 10:03:24 user nova-compute[75122]: No targets found.
Nov 15 10:03:24 user nova-compute[75122]: STATIC:
Nov 15 10:03:24 user nova-compute[75122]: Target: iqn.2010-10.org.openstack:2d703360-7eee-4b0b-9b1d-a42e2170de6c
Nov 15 10:03:24 user nova-compute[75122]:         Portal: 172.16.0.220:3260,-1
Nov 15 10:03:24 user nova-compute[75122]:                 Iface Name: default
Nov 15 10:03:24 user nova-compute[75122]: Target: iqn.2010-10.org.openstack:11d2deb7-c652-48e3-ae06-5557c9bef981
Nov 15 10:03:24 user nova-compute[75122]:         Portal: 172.16.0.220:3260,-1
Nov 15 10:03:24 user nova-compute[75122]:                 Iface Name: default
Nov 15 10:03:24 user nova-compute[75122]: Target: iqn.2010-10.org.openstack:d42739d6-477a-4322-ad52-6491b80a4a48
Nov 15 10:03:24 user nova-compute[75122]:         Portal: 172.16.0.220:3260,-1
Nov 15 10:03:24 user nova-compute[75122]:                 Iface Name: default
Nov 15 10:03:24 user nova-compute[75122]: Target: iqn.2010-10.org.openstack:8ee79db2-27c2-4d0f-8ee6-5b03e05ebba5
Nov 15 10:03:24 user nova-compute[75122]:         Portal: 172.16.0.220:3260,-1
Nov 15 10:03:24 user nova-compute[75122]:                 Iface Name: default
Nov 15 10:03:24 user nova-compute[75122]: Target: iqn.2010-10.org.openstack:0e03a7fc-bdb5-4505-ba7a-b0a896124e5f
Nov 15 10:03:24 user nova-compute[75122]:         Portal: 172.16.0.220:3260,-1
Nov 15 10:03:24 user nova-compute[75122]:                 Iface Name: default
Nov 15 10:03:24 user nova-compute[75122]: FIRMWARE:
Nov 15 10:03:24 user nova-compute[75122]: No targets found.
Nov 15 10:03:24 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 10:03:24 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d832cd8-92fa-4ff9-b34c-9214440de0fc tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 10:03:24 user nova-compute[75122]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 10:03:24 user nova-compute[75122]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75122) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 10:03:24 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d832cd8-92fa-4ff9-b34c-9214440de0fc tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d42739d6-477a-4322-ad52-6491b80a4a48', 0)] {{(pid=75122) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 10:03:24 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:03:24 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:03:24 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[6382391e-8670-4909-903a-5394adde3711]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0e03a7fc-bdb5-4505-ba7a-b0a896124e5f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:11d2deb7-c652-48e3-ae06-5557c9bef981\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2d703360-7eee-4b0b-9b1d-a42e2170de6c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8ee79db2-27c2-4d0f-8ee6-5b03e05ebba5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d42739d6-477a-4322-ad52-6491b80a4a48\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:03:24 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:03:24 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:03:24 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[80b49402-d107-4b2b-92c6-3b60ba006ba2]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee79db2-27c2-4d0f-8ee6-5b03e05ebba5 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d703360-7eee-4b0b-9b1d-a42e2170de6c (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d42739d6-477a-4322-ad52-6491b80a4a48 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11d2deb7-c652-48e3-ae06-5557c9bef981 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e03a7fc-bdb5-4505-ba7a-b0a896124e5f (non-flash)\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:03:24 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d832cd8-92fa-4ff9-b34c-9214440de0fc tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee79db2-27c2-4d0f-8ee6-5b03e05ebba5 (non-flash)
Nov 15 10:03:24 user nova-compute[75122]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d703360-7eee-4b0b-9b1d-a42e2170de6c (non-flash)
Nov 15 10:03:24 user nova-compute[75122]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d42739d6-477a-4322-ad52-6491b80a4a48 (non-flash)
Nov 15 10:03:24 user nova-compute[75122]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11d2deb7-c652-48e3-ae06-5557c9bef981 (non-flash)
Nov 15 10:03:24 user nova-compute[75122]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e03a7fc-bdb5-4505-ba7a-b0a896124e5f (non-flash)
Nov 15 10:03:24 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 10:03:24 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d832cd8-92fa-4ff9-b34c-9214440de0fc tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee79db2-27c2-4d0f-8ee6-5b03e05ebba5 (non-flash)
Nov 15 10:03:24 user nova-compute[75122]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d703360-7eee-4b0b-9b1d-a42e2170de6c (non-flash)
Nov 15 10:03:24 user nova-compute[75122]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d42739d6-477a-4322-ad52-6491b80a4a48 (non-flash)
Nov 15 10:03:24 user nova-compute[75122]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11d2deb7-c652-48e3-ae06-5557c9bef981 (non-flash)
Nov 15 10:03:24 user nova-compute[75122]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e03a7fc-bdb5-4505-ba7a-b0a896124e5f (non-flash)
Nov 15 10:03:24 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 10:03:24 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d832cd8-92fa-4ff9-b34c-9214440de0fc tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ffa08425510>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d42739d6-477a-4322-ad52-6491b80a4a48'): ({'sdd'}, set())}) {{(pid=75122) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 10:03:24 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-2d832cd8-92fa-4ff9-b34c-9214440de0fc tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Removing single pathed devices sdd {{(pid=75122) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 10:03:24 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:03:24 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:03:24 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef7c8a4b-3387-4840-be0d-e0be03a433a3]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:03:24 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:03:24 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:03:24 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[438e4e72-e821-49e4-a2b3-bd907453c513]: (4, ('ok\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:03:24 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-2d832cd8-92fa-4ff9-b34c-9214440de0fc tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Flushing IO for device /dev/sdd {{(pid=75122) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 10:03:24 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:03:24 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:03:24 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[763cc1bb-93e9-4537-9866-d2517d5553e0]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:03:24 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-2d832cd8-92fa-4ff9-b34c-9214440de0fc tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75122) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 10:03:24 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:03:24 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.042s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:03:24 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[457115fe-2782-436b-b9a3-c90beec742b4]: (4, ('1', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:03:24 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-2d832cd8-92fa-4ff9-b34c-9214440de0fc tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75122) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 10:03:24 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-2d832cd8-92fa-4ff9-b34c-9214440de0fc tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] SCSI volumes sdd have been removed. {{(pid=75122) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 10:03:24 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d832cd8-92fa-4ff9-b34c-9214440de0fc tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d42739d6-477a-4322-ad52-6491b80a4a48')] {{(pid=75122) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 10:03:24 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d42739d6-477a-4322-ad52-6491b80a4a48 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:03:24 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d42739d6-477a-4322-ad52-6491b80a4a48 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:03:24 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2ed5246-64eb-4228-87d7-87c08fa54922]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:03:24 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d832cd8-92fa-4ff9-b34c-9214440de0fc tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 10:03:24 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d42739d6-477a-4322-ad52-6491b80a4a48 -p 172.16.0.220:3260 --logout {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:03:24 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d42739d6-477a-4322-ad52-6491b80a4a48 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:03:24 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbe43b3a-4d62-4ab3-b05a-9f78a10bc533]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:d42739d6-477a-4322-ad52-6491b80a4a48, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:d42739d6-477a-4322-ad52-6491b80a4a48, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:03:24 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d832cd8-92fa-4ff9-b34c-9214440de0fc tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:d42739d6-477a-4322-ad52-6491b80a4a48, portal: 172.16.0.220,3260]
Nov 15 10:03:24 user nova-compute[75122]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:d42739d6-477a-4322-ad52-6491b80a4a48, portal: 172.16.0.220,3260] successful.
Nov 15 10:03:24 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 10:03:24 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d42739d6-477a-4322-ad52-6491b80a4a48 -p 172.16.0.220:3260 --op delete {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:03:24 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d42739d6-477a-4322-ad52-6491b80a4a48 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:03:24 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c20d3bd-6e54-418a-8535-d83a941bfb30]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:03:24 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d832cd8-92fa-4ff9-b34c-9214440de0fc tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 10:03:24 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-2d832cd8-92fa-4ff9-b34c-9214440de0fc tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.305s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 10:03:24 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d832cd8-92fa-4ff9-b34c-9214440de0fc tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] <== disconnect_volume: return (306ms) None {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 10:03:24 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2d832cd8-92fa-4ff9-b34c-9214440de0fc tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] [instance: 9ad77a91-bc65-44a8-8ced-fd2ad9237946] Disconnected iSCSI Volume {{(pid=75122) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 10:03:25 user nova-compute[75122]: DEBUG nova.objects.instance [None req-2d832cd8-92fa-4ff9-b34c-9214440de0fc tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Lazy-loading 'flavor' on Instance uuid 9ad77a91-bc65-44a8-8ced-fd2ad9237946 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 10:03:25 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-2d832cd8-92fa-4ff9-b34c-9214440de0fc tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Lock "9ad77a91-bc65-44a8-8ced-fd2ad9237946" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.650s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:03:26 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-365a1916-88f8-4c84-b31a-e6afd01a4ad5 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Acquiring lock "9ad77a91-bc65-44a8-8ced-fd2ad9237946" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:03:26 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-365a1916-88f8-4c84-b31a-e6afd01a4ad5 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Lock "9ad77a91-bc65-44a8-8ced-fd2ad9237946" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:03:26 user nova-compute[75122]: DEBUG nova.compute.manager [None req-365a1916-88f8-4c84-b31a-e6afd01a4ad5 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] [instance: 9ad77a91-bc65-44a8-8ced-fd2ad9237946] Checking state {{(pid=75122) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 10:03:26 user nova-compute[75122]: DEBUG nova.compute.manager [None req-365a1916-88f8-4c84-b31a-e6afd01a4ad5 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] [instance: 9ad77a91-bc65-44a8-8ced-fd2ad9237946] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=75122) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 15 10:03:26 user nova-compute[75122]: DEBUG nova.objects.instance [None req-365a1916-88f8-4c84-b31a-e6afd01a4ad5 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Lazy-loading 'flavor' on Instance uuid 9ad77a91-bc65-44a8-8ced-fd2ad9237946 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 10:03:26 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:03:26 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:03:26 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:03:26 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:03:26 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:03:26 user nova-compute[75122]: DEBUG nova.compute.manager [req-c3ebb1d9-fd19-4e68-bc1e-d00ba4d0a89f req-4812a2fa-1175-424c-b8b4-3d0cbf0a6c57 service nova] [instance: 9ad77a91-bc65-44a8-8ced-fd2ad9237946] Received event network-vif-unplugged-e348b3b5-1fc0-4c27-98e7-41a152a67610 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 10:03:26 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-c3ebb1d9-fd19-4e68-bc1e-d00ba4d0a89f req-4812a2fa-1175-424c-b8b4-3d0cbf0a6c57 service nova] Acquiring lock "9ad77a91-bc65-44a8-8ced-fd2ad9237946-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:03:26 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-c3ebb1d9-fd19-4e68-bc1e-d00ba4d0a89f req-4812a2fa-1175-424c-b8b4-3d0cbf0a6c57 service nova] Lock "9ad77a91-bc65-44a8-8ced-fd2ad9237946-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:03:26 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-c3ebb1d9-fd19-4e68-bc1e-d00ba4d0a89f req-4812a2fa-1175-424c-b8b4-3d0cbf0a6c57 service nova] Lock "9ad77a91-bc65-44a8-8ced-fd2ad9237946-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:03:26 user nova-compute[75122]: DEBUG nova.compute.manager [req-c3ebb1d9-fd19-4e68-bc1e-d00ba4d0a89f req-4812a2fa-1175-424c-b8b4-3d0cbf0a6c57 service nova] [instance: 9ad77a91-bc65-44a8-8ced-fd2ad9237946] No waiting events found dispatching network-vif-unplugged-e348b3b5-1fc0-4c27-98e7-41a152a67610 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 10:03:26 user nova-compute[75122]: WARNING nova.compute.manager [req-c3ebb1d9-fd19-4e68-bc1e-d00ba4d0a89f req-4812a2fa-1175-424c-b8b4-3d0cbf0a6c57 service nova] [instance: 9ad77a91-bc65-44a8-8ced-fd2ad9237946] Received unexpected event network-vif-unplugged-e348b3b5-1fc0-4c27-98e7-41a152a67610 for instance with vm_state active and task_state powering-off.
Nov 15 10:03:27 user nova-compute[75122]: INFO nova.virt.libvirt.driver [-] [instance: 9ad77a91-bc65-44a8-8ced-fd2ad9237946] Instance destroyed successfully.
Nov 15 10:03:27 user nova-compute[75122]: DEBUG nova.compute.manager [None req-365a1916-88f8-4c84-b31a-e6afd01a4ad5 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] [instance: 9ad77a91-bc65-44a8-8ced-fd2ad9237946] Checking state {{(pid=75122) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 10:03:27 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-365a1916-88f8-4c84-b31a-e6afd01a4ad5 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Lock "9ad77a91-bc65-44a8-8ced-fd2ad9237946" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.915s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:03:28 user nova-compute[75122]: DEBUG nova.compute.manager [req-3c06f611-30a9-48cd-94cf-ee1b6eb8a760 req-44a22354-c47f-4e02-a341-afd7bf4956d3 service nova] [instance: 9ad77a91-bc65-44a8-8ced-fd2ad9237946] Received event network-vif-plugged-e348b3b5-1fc0-4c27-98e7-41a152a67610 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 10:03:28 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-3c06f611-30a9-48cd-94cf-ee1b6eb8a760 req-44a22354-c47f-4e02-a341-afd7bf4956d3 service nova] Acquiring lock "9ad77a91-bc65-44a8-8ced-fd2ad9237946-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:03:28 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-3c06f611-30a9-48cd-94cf-ee1b6eb8a760 req-44a22354-c47f-4e02-a341-afd7bf4956d3 service nova] Lock "9ad77a91-bc65-44a8-8ced-fd2ad9237946-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:03:28 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-3c06f611-30a9-48cd-94cf-ee1b6eb8a760 req-44a22354-c47f-4e02-a341-afd7bf4956d3 service nova] Lock "9ad77a91-bc65-44a8-8ced-fd2ad9237946-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:03:28 user nova-compute[75122]: DEBUG nova.compute.manager [req-3c06f611-30a9-48cd-94cf-ee1b6eb8a760 req-44a22354-c47f-4e02-a341-afd7bf4956d3 service nova] [instance: 9ad77a91-bc65-44a8-8ced-fd2ad9237946] No waiting events found dispatching network-vif-plugged-e348b3b5-1fc0-4c27-98e7-41a152a67610 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 10:03:28 user nova-compute[75122]: WARNING nova.compute.manager [req-3c06f611-30a9-48cd-94cf-ee1b6eb8a760 req-44a22354-c47f-4e02-a341-afd7bf4956d3 service nova] [instance: 9ad77a91-bc65-44a8-8ced-fd2ad9237946] Received unexpected event network-vif-plugged-e348b3b5-1fc0-4c27-98e7-41a152a67610 for instance with vm_state stopped and task_state None.
Nov 15 10:03:28 user nova-compute[75122]: INFO nova.compute.manager [None req-34505230-2f1e-4500-9500-d28d1452ecfe tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: 5954fd91-94c6-4521-9465-1477c0e35f8d] Rescuing
Nov 15 10:03:28 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-34505230-2f1e-4500-9500-d28d1452ecfe tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Acquiring lock "refresh_cache-5954fd91-94c6-4521-9465-1477c0e35f8d" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 10:03:28 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-34505230-2f1e-4500-9500-d28d1452ecfe tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Acquired lock "refresh_cache-5954fd91-94c6-4521-9465-1477c0e35f8d" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 10:03:28 user nova-compute[75122]: DEBUG nova.network.neutron [None req-34505230-2f1e-4500-9500-d28d1452ecfe tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: 5954fd91-94c6-4521-9465-1477c0e35f8d] Building network info cache for instance {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 10:03:29 user nova-compute[75122]: DEBUG nova.network.neutron [None req-34505230-2f1e-4500-9500-d28d1452ecfe tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: 5954fd91-94c6-4521-9465-1477c0e35f8d] Updating instance_info_cache with network_info: [{"id": "e9b84607-88fe-411c-be24-0f2d1709d9e9", "address": "fa:16:3e:ef:6d:f1", "network": {"id": "b780d5c1-a549-4b49-a036-5a272697d4b6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-229344021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c046170a2ad44ebba5d2de236d940be0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9b84607-88", "ovs_interfaceid": "e9b84607-88fe-411c-be24-0f2d1709d9e9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 10:03:29 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-34505230-2f1e-4500-9500-d28d1452ecfe tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Releasing lock "refresh_cache-5954fd91-94c6-4521-9465-1477c0e35f8d" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 10:03:29 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:03:29 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:03:29 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:03:29 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:03:30 user nova-compute[75122]: INFO nova.virt.libvirt.driver [-] [instance: 5954fd91-94c6-4521-9465-1477c0e35f8d] Instance destroyed successfully.
Nov 15 10:03:30 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-34505230-2f1e-4500-9500-d28d1452ecfe tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: 5954fd91-94c6-4521-9465-1477c0e35f8d] Attempting a stable device rescue
Nov 15 10:03:30 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-34505230-2f1e-4500-9500-d28d1452ecfe tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75122) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 15 10:03:30 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-34505230-2f1e-4500-9500-d28d1452ecfe tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: 5954fd91-94c6-4521-9465-1477c0e35f8d] Instance directory exists: not creating {{(pid=75122) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 15 10:03:30 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-34505230-2f1e-4500-9500-d28d1452ecfe tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: 5954fd91-94c6-4521-9465-1477c0e35f8d] Creating image(s)
Nov 15 10:03:30 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-34505230-2f1e-4500-9500-d28d1452ecfe tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Acquiring lock "/opt/stack/data/nova/instances/5954fd91-94c6-4521-9465-1477c0e35f8d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:03:30 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-34505230-2f1e-4500-9500-d28d1452ecfe tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Lock "/opt/stack/data/nova/instances/5954fd91-94c6-4521-9465-1477c0e35f8d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:03:30 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-34505230-2f1e-4500-9500-d28d1452ecfe tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Lock "/opt/stack/data/nova/instances/5954fd91-94c6-4521-9465-1477c0e35f8d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:03:30 user nova-compute[75122]: DEBUG nova.objects.instance [None req-34505230-2f1e-4500-9500-d28d1452ecfe tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Lazy-loading 'trusted_certs' on Instance uuid 5954fd91-94c6-4521-9465-1477c0e35f8d {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 10:03:30 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-34505230-2f1e-4500-9500-d28d1452ecfe tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Acquiring lock "10a93c75ac3f14f0dc2199b857b9a5aeae83d8c0" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:03:30 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-34505230-2f1e-4500-9500-d28d1452ecfe tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Lock "10a93c75ac3f14f0dc2199b857b9a5aeae83d8c0" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:03:31 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-34505230-2f1e-4500-9500-d28d1452ecfe tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/10a93c75ac3f14f0dc2199b857b9a5aeae83d8c0.part --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:03:31 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:03:31 user nova-compute[75122]: DEBUG nova.compute.manager [req-21421dd2-1b69-4e00-af67-310c0a589cd0 req-21a8b9ec-6607-4a80-b8b5-5ec9fb181e98 service nova] [instance: 5954fd91-94c6-4521-9465-1477c0e35f8d] Received event network-vif-unplugged-e9b84607-88fe-411c-be24-0f2d1709d9e9 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 10:03:31 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-21421dd2-1b69-4e00-af67-310c0a589cd0 req-21a8b9ec-6607-4a80-b8b5-5ec9fb181e98 service nova] Acquiring lock "5954fd91-94c6-4521-9465-1477c0e35f8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:03:31 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-21421dd2-1b69-4e00-af67-310c0a589cd0 req-21a8b9ec-6607-4a80-b8b5-5ec9fb181e98 service nova] Lock "5954fd91-94c6-4521-9465-1477c0e35f8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:03:31 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-21421dd2-1b69-4e00-af67-310c0a589cd0 req-21a8b9ec-6607-4a80-b8b5-5ec9fb181e98 service nova] Lock "5954fd91-94c6-4521-9465-1477c0e35f8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:03:31 user nova-compute[75122]: DEBUG nova.compute.manager [req-21421dd2-1b69-4e00-af67-310c0a589cd0 req-21a8b9ec-6607-4a80-b8b5-5ec9fb181e98 service nova] [instance: 5954fd91-94c6-4521-9465-1477c0e35f8d] No waiting events found dispatching network-vif-unplugged-e9b84607-88fe-411c-be24-0f2d1709d9e9 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 10:03:31 user nova-compute[75122]: WARNING nova.compute.manager [req-21421dd2-1b69-4e00-af67-310c0a589cd0 req-21a8b9ec-6607-4a80-b8b5-5ec9fb181e98 service nova] [instance: 5954fd91-94c6-4521-9465-1477c0e35f8d] Received unexpected event network-vif-unplugged-e9b84607-88fe-411c-be24-0f2d1709d9e9 for instance with vm_state active and task_state rescuing.
Nov 15 10:03:31 user nova-compute[75122]: DEBUG nova.compute.manager [req-21421dd2-1b69-4e00-af67-310c0a589cd0 req-21a8b9ec-6607-4a80-b8b5-5ec9fb181e98 service nova] [instance: 5954fd91-94c6-4521-9465-1477c0e35f8d] Received event network-vif-plugged-e9b84607-88fe-411c-be24-0f2d1709d9e9 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 10:03:31 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-21421dd2-1b69-4e00-af67-310c0a589cd0 req-21a8b9ec-6607-4a80-b8b5-5ec9fb181e98 service nova] Acquiring lock "5954fd91-94c6-4521-9465-1477c0e35f8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:03:31 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-21421dd2-1b69-4e00-af67-310c0a589cd0 req-21a8b9ec-6607-4a80-b8b5-5ec9fb181e98 service nova] Lock "5954fd91-94c6-4521-9465-1477c0e35f8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:03:31 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-21421dd2-1b69-4e00-af67-310c0a589cd0 req-21a8b9ec-6607-4a80-b8b5-5ec9fb181e98 service nova] Lock "5954fd91-94c6-4521-9465-1477c0e35f8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:03:31 user nova-compute[75122]: DEBUG nova.compute.manager [req-21421dd2-1b69-4e00-af67-310c0a589cd0 req-21a8b9ec-6607-4a80-b8b5-5ec9fb181e98 service nova] [instance: 5954fd91-94c6-4521-9465-1477c0e35f8d] No waiting events found dispatching network-vif-plugged-e9b84607-88fe-411c-be24-0f2d1709d9e9 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 10:03:31 user nova-compute[75122]: WARNING nova.compute.manager [req-21421dd2-1b69-4e00-af67-310c0a589cd0 req-21a8b9ec-6607-4a80-b8b5-5ec9fb181e98 service nova] [instance: 5954fd91-94c6-4521-9465-1477c0e35f8d] Received unexpected event network-vif-plugged-e9b84607-88fe-411c-be24-0f2d1709d9e9 for instance with vm_state active and task_state rescuing.
Nov 15 10:03:31 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-34505230-2f1e-4500-9500-d28d1452ecfe tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/10a93c75ac3f14f0dc2199b857b9a5aeae83d8c0.part --force-share --output=json" returned: 0 in 0.190s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:03:31 user nova-compute[75122]: DEBUG nova.virt.images [None req-34505230-2f1e-4500-9500-d28d1452ecfe tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] 02b6c08c-db66-4c87-81ac-547ad56cf76e was qcow2, converting to raw {{(pid=75122) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 15 10:03:31 user nova-compute[75122]: DEBUG nova.privsep.utils [None req-34505230-2f1e-4500-9500-d28d1452ecfe tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75122) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 10:03:31 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-34505230-2f1e-4500-9500-d28d1452ecfe tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/10a93c75ac3f14f0dc2199b857b9a5aeae83d8c0.part /opt/stack/data/nova/instances/_base/10a93c75ac3f14f0dc2199b857b9a5aeae83d8c0.converted {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:03:32 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-34505230-2f1e-4500-9500-d28d1452ecfe tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/10a93c75ac3f14f0dc2199b857b9a5aeae83d8c0.part /opt/stack/data/nova/instances/_base/10a93c75ac3f14f0dc2199b857b9a5aeae83d8c0.converted" returned: 0 in 0.473s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:03:32 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-34505230-2f1e-4500-9500-d28d1452ecfe tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/10a93c75ac3f14f0dc2199b857b9a5aeae83d8c0.converted --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:03:32 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-34505230-2f1e-4500-9500-d28d1452ecfe tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/10a93c75ac3f14f0dc2199b857b9a5aeae83d8c0.converted --force-share --output=json" returned: 0 in 0.179s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:03:32 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-34505230-2f1e-4500-9500-d28d1452ecfe tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Lock "10a93c75ac3f14f0dc2199b857b9a5aeae83d8c0" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.978s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:03:32 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-34505230-2f1e-4500-9500-d28d1452ecfe tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Acquiring lock "10a93c75ac3f14f0dc2199b857b9a5aeae83d8c0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:03:32 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-34505230-2f1e-4500-9500-d28d1452ecfe tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Lock "10a93c75ac3f14f0dc2199b857b9a5aeae83d8c0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:03:32 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-34505230-2f1e-4500-9500-d28d1452ecfe tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/10a93c75ac3f14f0dc2199b857b9a5aeae83d8c0 --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:03:32 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-34505230-2f1e-4500-9500-d28d1452ecfe tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/10a93c75ac3f14f0dc2199b857b9a5aeae83d8c0 --force-share --output=json" returned: 0 in 0.173s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:03:32 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-34505230-2f1e-4500-9500-d28d1452ecfe tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/10a93c75ac3f14f0dc2199b857b9a5aeae83d8c0,backing_fmt=raw /opt/stack/data/nova/instances/5954fd91-94c6-4521-9465-1477c0e35f8d/disk.rescue {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:03:32 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-34505230-2f1e-4500-9500-d28d1452ecfe tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/10a93c75ac3f14f0dc2199b857b9a5aeae83d8c0,backing_fmt=raw /opt/stack/data/nova/instances/5954fd91-94c6-4521-9465-1477c0e35f8d/disk.rescue" returned: 0 in 0.048s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:03:32 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-34505230-2f1e-4500-9500-d28d1452ecfe tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Lock "10a93c75ac3f14f0dc2199b857b9a5aeae83d8c0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.231s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:03:32 user nova-compute[75122]: DEBUG nova.objects.instance [None req-34505230-2f1e-4500-9500-d28d1452ecfe tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Lazy-loading 'migration_context' on Instance uuid 5954fd91-94c6-4521-9465-1477c0e35f8d {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 10:03:32 user nova-compute[75122]: DEBUG nova.objects.base [None req-34505230-2f1e-4500-9500-d28d1452ecfe tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Object Instance<5954fd91-94c6-4521-9465-1477c0e35f8d> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75122) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 10:03:32 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-34505230-2f1e-4500-9500-d28d1452ecfe tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: 5954fd91-94c6-4521-9465-1477c0e35f8d] Created local disks {{(pid=75122) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 10:03:32 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-34505230-2f1e-4500-9500-d28d1452ecfe tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: 5954fd91-94c6-4521-9465-1477c0e35f8d] Start _get_guest_xml network_info=[{"id": "e9b84607-88fe-411c-be24-0f2d1709d9e9", "address": "fa:16:3e:ef:6d:f1", "network": {"id": "b780d5c1-a549-4b49-a036-5a272697d4b6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-229344021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-229344021-network", "vif_mac": "fa:16:3e:ef:6d:f1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c046170a2ad44ebba5d2de236d940be0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9b84607-88", "ovs_interfaceid": "e9b84607-88fe-411c-be24-0f2d1709d9e9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T09:26:31Z,direct_url=<?>,disk_format='qcow2',id=5e862cfe-47b8-4725-8292-65761ee6d0f5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9c57733cb41847c0b4ad31519c382e5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T09:26:33Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '02b6c08c-db66-4c87-81ac-547ad56cf76e', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:11d2deb7-c652-48e3-ae06-5557c9bef981', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YoxPBlsS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': '5954fd91-94c6-4521-9465-1477c0e35f8d', 'attached_at': '', 'detached_at': '', 'volume_id': '11d2deb7-c652-48e3-ae06-5557c9bef981', 'serial': '11d2deb7-c652-48e3-ae06-5557c9bef981'}, 'guest_format': None, 'delete_on_termination': False, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vda', 'attachment_id': 'a361809b-0cd3-4558-80a6-1fc87c79058e', 'volume_type': None} {{(pid=75122) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 10:03:32 user nova-compute[75122]: DEBUG nova.objects.instance [None req-34505230-2f1e-4500-9500-d28d1452ecfe tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Lazy-loading 'resources' on Instance uuid 5954fd91-94c6-4521-9465-1477c0e35f8d {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 10:03:32 user nova-compute[75122]: DEBUG nova.objects.base [None req-34505230-2f1e-4500-9500-d28d1452ecfe tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Object Instance<5954fd91-94c6-4521-9465-1477c0e35f8d> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75122) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 10:03:32 user nova-compute[75122]: DEBUG nova.objects.instance [None req-34505230-2f1e-4500-9500-d28d1452ecfe tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Lazy-loading 'numa_topology' on Instance uuid 5954fd91-94c6-4521-9465-1477c0e35f8d {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 10:03:32 user nova-compute[75122]: DEBUG nova.objects.base [None req-34505230-2f1e-4500-9500-d28d1452ecfe tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Object Instance<5954fd91-94c6-4521-9465-1477c0e35f8d> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75122) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 10:03:32 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-34505230-2f1e-4500-9500-d28d1452ecfe tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 10:03:32 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-34505230-2f1e-4500-9500-d28d1452ecfe tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 10:03:32 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-34505230-2f1e-4500-9500-d28d1452ecfe tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75122) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 10:03:32 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-34505230-2f1e-4500-9500-d28d1452ecfe tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] CPU controller missing on host. {{(pid=75122) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 10:03:32 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-34505230-2f1e-4500-9500-d28d1452ecfe tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75122) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 10:03:32 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-34505230-2f1e-4500-9500-d28d1452ecfe tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] CPU controller found on host. {{(pid=75122) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 10:03:32 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-34505230-2f1e-4500-9500-d28d1452ecfe tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75122) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 10:03:32 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-34505230-2f1e-4500-9500-d28d1452ecfe tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T09:26:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T09:26:31Z,direct_url=<?>,disk_format='qcow2',id=5e862cfe-47b8-4725-8292-65761ee6d0f5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9c57733cb41847c0b4ad31519c382e5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T09:26:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 10:03:32 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-34505230-2f1e-4500-9500-d28d1452ecfe tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Flavor limits 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 10:03:32 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-34505230-2f1e-4500-9500-d28d1452ecfe tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Image limits 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 10:03:32 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-34505230-2f1e-4500-9500-d28d1452ecfe tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Flavor pref 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 10:03:32 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-34505230-2f1e-4500-9500-d28d1452ecfe tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Image pref 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 10:03:32 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-34505230-2f1e-4500-9500-d28d1452ecfe tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 10:03:32 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-34505230-2f1e-4500-9500-d28d1452ecfe tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 10:03:32 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-34505230-2f1e-4500-9500-d28d1452ecfe tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75122) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 10:03:32 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-34505230-2f1e-4500-9500-d28d1452ecfe tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Got 1 possible topologies {{(pid=75122) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 10:03:32 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-34505230-2f1e-4500-9500-d28d1452ecfe tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 10:03:32 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-34505230-2f1e-4500-9500-d28d1452ecfe tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 10:03:32 user nova-compute[75122]: DEBUG nova.objects.instance [None req-34505230-2f1e-4500-9500-d28d1452ecfe tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Lazy-loading 'vcpu_model' on Instance uuid 5954fd91-94c6-4521-9465-1477c0e35f8d {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 10:03:32 user nova-compute[75122]: DEBUG nova.objects.base [None req-34505230-2f1e-4500-9500-d28d1452ecfe tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Object Instance<5954fd91-94c6-4521-9465-1477c0e35f8d> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75122) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 10:03:32 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34505230-2f1e-4500-9500-d28d1452ecfe tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: 5954fd91-94c6-4521-9465-1477c0e35f8d] Calling os-brick to attach iSCSI Volume {{(pid=75122) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 10:03:32 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-34505230-2f1e-4500-9500-d28d1452ecfe tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffa04060b80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:11d2deb7-c652-48e3-ae06-5557c9bef981', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YoxPBlsS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 10:03:32 user nova-compute[75122]: WARNING os_brick.initiator.connectors.base [None req-34505230-2f1e-4500-9500-d28d1452ecfe tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 10:03:32 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-34505230-2f1e-4500-9500-d28d1452ecfe tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 10:03:32 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-34505230-2f1e-4500-9500-d28d1452ecfe tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 10:03:32 user nova-compute[75122]: WARNING os_brick.initiator.connectors.base [None req-34505230-2f1e-4500-9500-d28d1452ecfe tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 10:03:32 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-34505230-2f1e-4500-9500-d28d1452ecfe tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:11d2deb7-c652-48e3-ae06-5557c9bef981" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 10:03:32 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-34505230-2f1e-4500-9500-d28d1452ecfe tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:11d2deb7-c652-48e3-ae06-5557c9bef981" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 10:03:32 user nova-compute[75122]: INFO os_brick.initiator.connectors.iscsi [None req-34505230-2f1e-4500-9500-d28d1452ecfe tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 10:03:32 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11d2deb7-c652-48e3-ae06-5557c9bef981 -p 172.16.0.220:3260 {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:03:32 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11d2deb7-c652-48e3-ae06-5557c9bef981 -p 172.16.0.220:3260" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:03:32 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[d25d9086-b71f-4581-bc57-0830f1c9af96]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:11d2deb7-c652-48e3-ae06-5557c9bef981\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = YoxPBlsS\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:03:32 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-34505230-2f1e-4500-9500-d28d1452ecfe tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 15 10:03:32 user nova-compute[75122]: node.name = iqn.2010-10.org.openstack:11d2deb7-c652-48e3-ae06-5557c9bef981
Nov 15 10:03:32 user nova-compute[75122]: node.tpgt = -1
Nov 15 10:03:32 user nova-compute[75122]: node.startup = automatic
Nov 15 10:03:32 user nova-compute[75122]: node.leading_login = No
Nov 15 10:03:32 user nova-compute[75122]: iface.iscsi_ifacename = default
Nov 15 10:03:32 user nova-compute[75122]: iface.net_ifacename = <empty>
Nov 15 10:03:32 user nova-compute[75122]: iface.ipaddress = <empty>
Nov 15 10:03:32 user nova-compute[75122]: iface.prefix_len = 0
Nov 15 10:03:32 user nova-compute[75122]: iface.hwaddress = <empty>
Nov 15 10:03:32 user nova-compute[75122]: iface.transport_name = tcp
Nov 15 10:03:32 user nova-compute[75122]: iface.initiatorname = <empty>
Nov 15 10:03:32 user nova-compute[75122]: iface.state = <empty>
Nov 15 10:03:32 user nova-compute[75122]: iface.vlan_id = 0
Nov 15 10:03:32 user nova-compute[75122]: iface.vlan_priority = 0
Nov 15 10:03:32 user nova-compute[75122]: iface.vlan_state = <empty>
Nov 15 10:03:32 user nova-compute[75122]: iface.iface_num = 0
Nov 15 10:03:32 user nova-compute[75122]: iface.mtu = 0
Nov 15 10:03:32 user nova-compute[75122]: iface.port = 0
Nov 15 10:03:32 user nova-compute[75122]: iface.bootproto = <empty>
Nov 15 10:03:32 user nova-compute[75122]: iface.subnet_mask = <empty>
Nov 15 10:03:32 user nova-compute[75122]: iface.gateway = <empty>
Nov 15 10:03:32 user nova-compute[75122]: iface.dhcp_alt_client_id_state = <empty>
Nov 15 10:03:32 user nova-compute[75122]: iface.dhcp_alt_client_id = <empty>
Nov 15 10:03:32 user nova-compute[75122]: iface.dhcp_dns = <empty>
Nov 15 10:03:32 user nova-compute[75122]: iface.dhcp_learn_iqn = <empty>
Nov 15 10:03:32 user nova-compute[75122]: iface.dhcp_req_vendor_id_state = <empty>
Nov 15 10:03:32 user nova-compute[75122]: iface.dhcp_vendor_id_state = <empty>
Nov 15 10:03:32 user nova-compute[75122]: iface.dhcp_vendor_id = <empty>
Nov 15 10:03:32 user nova-compute[75122]: iface.dhcp_slp_da = <empty>
Nov 15 10:03:32 user nova-compute[75122]: iface.fragmentation = <empty>
Nov 15 10:03:32 user nova-compute[75122]: iface.gratuitous_arp = <empty>
Nov 15 10:03:32 user nova-compute[75122]: iface.incoming_forwarding = <empty>
Nov 15 10:03:32 user nova-compute[75122]: iface.tos_state = <empty>
Nov 15 10:03:32 user nova-compute[75122]: iface.tos = 0
Nov 15 10:03:32 user nova-compute[75122]: iface.ttl = 0
Nov 15 10:03:32 user nova-compute[75122]: iface.delayed_ack = <empty>
Nov 15 10:03:32 user nova-compute[75122]: iface.tcp_nagle = <empty>
Nov 15 10:03:32 user nova-compute[75122]: iface.tcp_wsf_state = <empty>
Nov 15 10:03:32 user nova-compute[75122]: iface.tcp_wsf = 0
Nov 15 10:03:32 user nova-compute[75122]: iface.tcp_timer_scale = 0
Nov 15 10:03:32 user nova-compute[75122]: iface.tcp_timestamp = <empty>
Nov 15 10:03:32 user nova-compute[75122]: iface.redirect = <empty>
Nov 15 10:03:32 user nova-compute[75122]: iface.def_task_mgmt_timeout = 0
Nov 15 10:03:32 user nova-compute[75122]: iface.header_digest = <empty>
Nov 15 10:03:32 user nova-compute[75122]: iface.data_digest = <empty>
Nov 15 10:03:32 user nova-compute[75122]: iface.immediate_data = <empty>
Nov 15 10:03:32 user nova-compute[75122]: iface.initial_r2t = <empty>
Nov 15 10:03:32 user nova-compute[75122]: iface.data_seq_inorder = <empty>
Nov 15 10:03:32 user nova-compute[75122]: iface.data_pdu_inorder = <empty>
Nov 15 10:03:32 user nova-compute[75122]: iface.erl = 0
Nov 15 10:03:32 user nova-compute[75122]: iface.max_receive_data_len = 0
Nov 15 10:03:32 user nova-compute[75122]: iface.first_burst_len = 0
Nov 15 10:03:32 user nova-compute[75122]: iface.max_outstanding_r2t = 0
Nov 15 10:03:32 user nova-compute[75122]: iface.max_burst_len = 0
Nov 15 10:03:32 user nova-compute[75122]: iface.chap_auth = <empty>
Nov 15 10:03:32 user nova-compute[75122]: iface.bidi_chap = <empty>
Nov 15 10:03:32 user nova-compute[75122]: iface.strict_login_compliance = <empty>
Nov 15 10:03:32 user nova-compute[75122]: iface.discovery_auth = <empty>
Nov 15 10:03:32 user nova-compute[75122]: iface.discovery_logout = <empty>
Nov 15 10:03:32 user nova-compute[75122]: node.discovery_address = <empty>
Nov 15 10:03:32 user nova-compute[75122]: node.discovery_port = 0
Nov 15 10:03:32 user nova-compute[75122]: node.discovery_type = static
Nov 15 10:03:32 user nova-compute[75122]: node.session.initial_cmdsn = 0
Nov 15 10:03:32 user nova-compute[75122]: node.session.initial_login_retry_max = 8
Nov 15 10:03:32 user nova-compute[75122]: node.session.xmit_thread_priority = -20
Nov 15 10:03:32 user nova-compute[75122]: node.session.cmds_max = 128
Nov 15 10:03:32 user nova-compute[75122]: node.session.queue_depth = 32
Nov 15 10:03:32 user nova-compute[75122]: node.session.nr_sessions = 1
Nov 15 10:03:32 user nova-compute[75122]: node.session.auth.authmethod = CHAP
Nov 15 10:03:32 user nova-compute[75122]: node.session.auth.username = YoxPBlsS
Nov 15 10:03:32 user nova-compute[75122]: node.session.auth.password = ***
Nov 15 10:03:32 user nova-compute[75122]: node.session.auth.username_in = <empty>
Nov 15 10:03:32 user nova-compute[75122]: node.session.auth.password_in = <empty>
Nov 15 10:03:32 user nova-compute[75122]: node.session.auth.chap_algs = MD5
Nov 15 10:03:32 user nova-compute[75122]: node.session.timeo.replacement_timeout = 120
Nov 15 10:03:32 user nova-compute[75122]: node.session.err_timeo.abort_timeout = 15
Nov 15 10:03:32 user nova-compute[75122]: node.session.err_timeo.lu_reset_timeout = 30
Nov 15 10:03:32 user nova-compute[75122]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 15 10:03:32 user nova-compute[75122]: node.session.err_timeo.host_reset_timeout = 60
Nov 15 10:03:32 user nova-compute[75122]: node.session.iscsi.FastAbort = Yes
Nov 15 10:03:32 user nova-compute[75122]: node.session.iscsi.InitialR2T = No
Nov 15 10:03:32 user nova-compute[75122]: node.session.iscsi.ImmediateData = Yes
Nov 15 10:03:32 user nova-compute[75122]: node.session.iscsi.FirstBurstLength = 262144
Nov 15 10:03:32 user nova-compute[75122]: node.session.iscsi.MaxBurstLength = 16776192
Nov 15 10:03:32 user nova-compute[75122]: node.session.iscsi.DefaultTime2Retain = 0
Nov 15 10:03:32 user nova-compute[75122]: node.session.iscsi.DefaultTime2Wait = 2
Nov 15 10:03:32 user nova-compute[75122]: node.session.iscsi.MaxConnections = 1
Nov 15 10:03:32 user nova-compute[75122]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 15 10:03:32 user nova-compute[75122]: node.session.iscsi.ERL = 0
Nov 15 10:03:32 user nova-compute[75122]: node.session.scan = manual
Nov 15 10:03:32 user nova-compute[75122]: node.session.reopen_max = 0
Nov 15 10:03:32 user nova-compute[75122]: node.conn[0].address = 172.16.0.220
Nov 15 10:03:32 user nova-compute[75122]: node.conn[0].port = 3260
Nov 15 10:03:32 user nova-compute[75122]: node.conn[0].startup = manual
Nov 15 10:03:32 user nova-compute[75122]: node.conn[0].tcp.window_size = 524288
Nov 15 10:03:32 user nova-compute[75122]: node.conn[0].tcp.type_of_service = 0
Nov 15 10:03:32 user nova-compute[75122]: node.conn[0].timeo.logout_timeout = 15
Nov 15 10:03:32 user nova-compute[75122]: node.conn[0].timeo.login_timeout = 15
Nov 15 10:03:32 user nova-compute[75122]: node.conn[0].timeo.auth_timeout = 45
Nov 15 10:03:32 user nova-compute[75122]: node.conn[0].timeo.noop_out_interval = 5
Nov 15 10:03:32 user nova-compute[75122]: node.conn[0].timeo.noop_out_timeout = 5
Nov 15 10:03:32 user nova-compute[75122]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 15 10:03:32 user nova-compute[75122]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 15 10:03:32 user nova-compute[75122]: node.conn[0].iscsi.HeaderDigest = None
Nov 15 10:03:32 user nova-compute[75122]: node.conn[0].iscsi.DataDigest = None
Nov 15 10:03:32 user nova-compute[75122]: node.conn[0].iscsi.IFMarker = No
Nov 15 10:03:32 user nova-compute[75122]: node.conn[0].iscsi.OFMarker = No
Nov 15 10:03:32 user nova-compute[75122]: # END RECORD
Nov 15 10:03:32 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 10:03:32 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11d2deb7-c652-48e3-ae06-5557c9bef981 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:03:32 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11d2deb7-c652-48e3-ae06-5557c9bef981 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:03:32 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f3a560c-4392-442d-94fe-30c87e1d57e7]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:03:32 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-34505230-2f1e-4500-9500-d28d1452ecfe tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 10:03:32 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11d2deb7-c652-48e3-ae06-5557c9bef981 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:03:32 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11d2deb7-c652-48e3-ae06-5557c9bef981 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:03:32 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[316943c0-bf3b-4a65-8d8d-f1578796a32d]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:03:32 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-34505230-2f1e-4500-9500-d28d1452ecfe tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 10:03:32 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11d2deb7-c652-48e3-ae06-5557c9bef981 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YoxPBlsS {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:03:32 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11d2deb7-c652-48e3-ae06-5557c9bef981 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YoxPBlsS" returned: 0 in 0.017s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:03:32 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e5e3b2e-b2c1-438f-937c-102279c00e88]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:03:32 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-34505230-2f1e-4500-9500-d28d1452ecfe tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YoxPBlsS'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 10:03:32 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11d2deb7-c652-48e3-ae06-5557c9bef981 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:03:32 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11d2deb7-c652-48e3-ae06-5557c9bef981 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:03:32 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4565b8e-bf2d-4dc4-a887-aa9241b035b8]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:03:32 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-34505230-2f1e-4500-9500-d28d1452ecfe tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 10:03:32 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:03:32 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:03:32 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[16034402-7e84-45c6-84f7-5be81bcf3e20]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee79db2-27c2-4d0f-8ee6-5b03e05ebba5 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d703360-7eee-4b0b-9b1d-a42e2170de6c (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11d2deb7-c652-48e3-ae06-5557c9bef981 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e03a7fc-bdb5-4505-ba7a-b0a896124e5f (non-flash)\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:03:32 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-34505230-2f1e-4500-9500-d28d1452ecfe tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee79db2-27c2-4d0f-8ee6-5b03e05ebba5 (non-flash)
Nov 15 10:03:32 user nova-compute[75122]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d703360-7eee-4b0b-9b1d-a42e2170de6c (non-flash)
Nov 15 10:03:32 user nova-compute[75122]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11d2deb7-c652-48e3-ae06-5557c9bef981 (non-flash)
Nov 15 10:03:32 user nova-compute[75122]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e03a7fc-bdb5-4505-ba7a-b0a896124e5f (non-flash)
Nov 15 10:03:32 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 10:03:32 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-34505230-2f1e-4500-9500-d28d1452ecfe tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee79db2-27c2-4d0f-8ee6-5b03e05ebba5 (non-flash)
Nov 15 10:03:32 user nova-compute[75122]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d703360-7eee-4b0b-9b1d-a42e2170de6c (non-flash)
Nov 15 10:03:32 user nova-compute[75122]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11d2deb7-c652-48e3-ae06-5557c9bef981 (non-flash)
Nov 15 10:03:32 user nova-compute[75122]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e03a7fc-bdb5-4505-ba7a-b0a896124e5f (non-flash)
Nov 15 10:03:32 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 10:03:32 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-34505230-2f1e-4500-9500-d28d1452ecfe tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:11d2deb7-c652-48e3-ae06-5557c9bef981" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.146s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 10:03:32 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-34505230-2f1e-4500-9500-d28d1452ecfe tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Connected to 172.16.0.220:3260 {{(pid=75122) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 10:03:32 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-34505230-2f1e-4500-9500-d28d1452ecfe tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] HCTL ('36', '0', '0', 0) found on session 54 with lun 0 {{(pid=75122) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 10:03:32 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-34505230-2f1e-4500-9500-d28d1452ecfe tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Scanning host 36 c: 0, t: 0, l: 0) {{(pid=75122) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 10:03:32 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:03:32 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.013s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:03:32 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[94b6a51d-3b45-4eca-8214-1ee4191e2610]: (4, ('0 0 0', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:03:32 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-34505230-2f1e-4500-9500-d28d1452ecfe tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Searching for a device in session 54 and hctl ('36', '0', '0', 0) yield: sde {{(pid=75122) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 10:03:32 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-34505230-2f1e-4500-9500-d28d1452ecfe tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:11d2deb7-c652-48e3-ae06-5557c9bef981', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YoxPBlsS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75122) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 10:03:32 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-34505230-2f1e-4500-9500-d28d1452ecfe tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.170s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 10:03:32 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-34505230-2f1e-4500-9500-d28d1452ecfe tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] <== connect_volume: return (171ms) {'type': 'block', 'scsi_wwn': '26232643833313265', 'path': '/dev/sde'} {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 10:03:32 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34505230-2f1e-4500-9500-d28d1452ecfe tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: 5954fd91-94c6-4521-9465-1477c0e35f8d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26232643833313265', 'path': '/dev/sde'} {{(pid=75122) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 10:03:32 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-34505230-2f1e-4500-9500-d28d1452ecfe tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T10:01:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1321201668',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1321201668',id=45,image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T10:01:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c046170a2ad44ebba5d2de236d940be0',ramdisk_id='',reservation_id='r-0dynjry9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1545444983',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T10:01:57Z,user_data=None,user_id='53d187e2a07b4437a02f65fb47a003ee',uuid=5954fd91-94c6-4521-9465-1477c0e35f8d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e9b84607-88fe-411c-be24-0f2d1709d9e9", "address": "fa:16:3e:ef:6d:f1", "network": {"id": "b780d5c1-a549-4b49-a036-5a272697d4b6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-229344021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-229344021-network", "vif_mac": "fa:16:3e:ef:6d:f1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c046170a2ad44ebba5d2de236d940be0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9b84607-88", "ovs_interfaceid": "e9b84607-88fe-411c-be24-0f2d1709d9e9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75122) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 10:03:32 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-34505230-2f1e-4500-9500-d28d1452ecfe tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Converting VIF {"id": "e9b84607-88fe-411c-be24-0f2d1709d9e9", "address": "fa:16:3e:ef:6d:f1", "network": {"id": "b780d5c1-a549-4b49-a036-5a272697d4b6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-229344021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-229344021-network", "vif_mac": "fa:16:3e:ef:6d:f1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c046170a2ad44ebba5d2de236d940be0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9b84607-88", "ovs_interfaceid": "e9b84607-88fe-411c-be24-0f2d1709d9e9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 10:03:32 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-34505230-2f1e-4500-9500-d28d1452ecfe tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ef:6d:f1,bridge_name='br-int',has_traffic_filtering=True,id=e9b84607-88fe-411c-be24-0f2d1709d9e9,network=Network(b780d5c1-a549-4b49-a036-5a272697d4b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9b84607-88') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 10:03:32 user nova-compute[75122]: DEBUG nova.objects.instance [None req-34505230-2f1e-4500-9500-d28d1452ecfe tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Lazy-loading 'pci_devices' on Instance uuid 5954fd91-94c6-4521-9465-1477c0e35f8d {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 10:03:32 user nova-compute[75122]: DEBUG nova.objects.base [None req-34505230-2f1e-4500-9500-d28d1452ecfe tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Object Instance<5954fd91-94c6-4521-9465-1477c0e35f8d> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75122) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 10:03:32 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-34505230-2f1e-4500-9500-d28d1452ecfe tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: 5954fd91-94c6-4521-9465-1477c0e35f8d] End _get_guest_xml xml=<domain type="kvm">
Nov 15 10:03:32 user nova-compute[75122]:   <uuid>5954fd91-94c6-4521-9465-1477c0e35f8d</uuid>
Nov 15 10:03:32 user nova-compute[75122]:   <name>instance-0000002d</name>
Nov 15 10:03:32 user nova-compute[75122]:   <memory>524288</memory>
Nov 15 10:03:32 user nova-compute[75122]:   <vcpu>1</vcpu>
Nov 15 10:03:32 user nova-compute[75122]:   <metadata>
Nov 15 10:03:32 user nova-compute[75122]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 10:03:32 user nova-compute[75122]:       <nova:package version="0.0.0"/>
Nov 15 10:03:32 user nova-compute[75122]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1321201668</nova:name>
Nov 15 10:03:32 user nova-compute[75122]:       <nova:creationTime>2023-11-15 10:03:32</nova:creationTime>
Nov 15 10:03:32 user nova-compute[75122]:       <nova:flavor name="m1.tiny">
Nov 15 10:03:32 user nova-compute[75122]:         <nova:memory>512</nova:memory>
Nov 15 10:03:32 user nova-compute[75122]:         <nova:disk>1</nova:disk>
Nov 15 10:03:32 user nova-compute[75122]:         <nova:swap>0</nova:swap>
Nov 15 10:03:32 user nova-compute[75122]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 10:03:32 user nova-compute[75122]:         <nova:vcpus>1</nova:vcpus>
Nov 15 10:03:32 user nova-compute[75122]:       </nova:flavor>
Nov 15 10:03:32 user nova-compute[75122]:       <nova:owner>
Nov 15 10:03:32 user nova-compute[75122]:         <nova:user uuid="53d187e2a07b4437a02f65fb47a003ee">tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member</nova:user>
Nov 15 10:03:32 user nova-compute[75122]:         <nova:project uuid="c046170a2ad44ebba5d2de236d940be0">tempest-ServerBootFromVolumeStableRescueTest-1545444983</nova:project>
Nov 15 10:03:32 user nova-compute[75122]:       </nova:owner>
Nov 15 10:03:32 user nova-compute[75122]:       <nova:root type="image" uuid="5e862cfe-47b8-4725-8292-65761ee6d0f5"/>
Nov 15 10:03:32 user nova-compute[75122]:       <nova:ports>
Nov 15 10:03:32 user nova-compute[75122]:         <nova:port uuid="e9b84607-88fe-411c-be24-0f2d1709d9e9">
Nov 15 10:03:32 user nova-compute[75122]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 15 10:03:32 user nova-compute[75122]:         </nova:port>
Nov 15 10:03:32 user nova-compute[75122]:       </nova:ports>
Nov 15 10:03:32 user nova-compute[75122]:     </nova:instance>
Nov 15 10:03:32 user nova-compute[75122]:   </metadata>
Nov 15 10:03:32 user nova-compute[75122]:   <sysinfo type="smbios">
Nov 15 10:03:32 user nova-compute[75122]:     <system>
Nov 15 10:03:32 user nova-compute[75122]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 10:03:32 user nova-compute[75122]:       <entry name="product">OpenStack Nova</entry>
Nov 15 10:03:32 user nova-compute[75122]:       <entry name="version">0.0.0</entry>
Nov 15 10:03:32 user nova-compute[75122]:       <entry name="serial">5954fd91-94c6-4521-9465-1477c0e35f8d</entry>
Nov 15 10:03:32 user nova-compute[75122]:       <entry name="uuid">5954fd91-94c6-4521-9465-1477c0e35f8d</entry>
Nov 15 10:03:32 user nova-compute[75122]:       <entry name="family">Virtual Machine</entry>
Nov 15 10:03:32 user nova-compute[75122]:     </system>
Nov 15 10:03:32 user nova-compute[75122]:   </sysinfo>
Nov 15 10:03:32 user nova-compute[75122]:   <os>
Nov 15 10:03:32 user nova-compute[75122]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 10:03:32 user nova-compute[75122]:     <smbios mode="sysinfo"/>
Nov 15 10:03:32 user nova-compute[75122]:   </os>
Nov 15 10:03:32 user nova-compute[75122]:   <features>
Nov 15 10:03:32 user nova-compute[75122]:     <acpi/>
Nov 15 10:03:32 user nova-compute[75122]:     <apic/>
Nov 15 10:03:32 user nova-compute[75122]:     <vmcoreinfo/>
Nov 15 10:03:32 user nova-compute[75122]:   </features>
Nov 15 10:03:32 user nova-compute[75122]:   <clock offset="utc">
Nov 15 10:03:32 user nova-compute[75122]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 10:03:32 user nova-compute[75122]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 10:03:32 user nova-compute[75122]:     <timer name="hpet" present="no"/>
Nov 15 10:03:32 user nova-compute[75122]:   </clock>
Nov 15 10:03:32 user nova-compute[75122]:   <cpu mode="custom" match="exact">
Nov 15 10:03:32 user nova-compute[75122]:     <model>Nehalem</model>
Nov 15 10:03:32 user nova-compute[75122]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 10:03:32 user nova-compute[75122]:   </cpu>
Nov 15 10:03:32 user nova-compute[75122]:   <devices>
Nov 15 10:03:32 user nova-compute[75122]:     <disk type="block" device="disk">
Nov 15 10:03:32 user nova-compute[75122]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 10:03:32 user nova-compute[75122]:       <source dev="/dev/sde"/>
Nov 15 10:03:32 user nova-compute[75122]:       <target dev="vda" bus="virtio"/>
Nov 15 10:03:32 user nova-compute[75122]:       <serial>11d2deb7-c652-48e3-ae06-5557c9bef981</serial>
Nov 15 10:03:32 user nova-compute[75122]:     </disk>
Nov 15 10:03:32 user nova-compute[75122]:     <disk type="file" device="disk">
Nov 15 10:03:32 user nova-compute[75122]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 10:03:32 user nova-compute[75122]:       <source file="/opt/stack/data/nova/instances/5954fd91-94c6-4521-9465-1477c0e35f8d/disk.rescue"/>
Nov 15 10:03:32 user nova-compute[75122]:       <target dev="vdb" bus="virtio"/>
Nov 15 10:03:32 user nova-compute[75122]:       <boot order="1"/>
Nov 15 10:03:32 user nova-compute[75122]:     </disk>
Nov 15 10:03:32 user nova-compute[75122]:     <interface type="ethernet">
Nov 15 10:03:32 user nova-compute[75122]:       <mac address="fa:16:3e:ef:6d:f1"/>
Nov 15 10:03:32 user nova-compute[75122]:       <model type="virtio"/>
Nov 15 10:03:32 user nova-compute[75122]:       <mtu size="1442"/>
Nov 15 10:03:32 user nova-compute[75122]:       <target dev="tape9b84607-88"/>
Nov 15 10:03:32 user nova-compute[75122]:     </interface>
Nov 15 10:03:32 user nova-compute[75122]:     <serial type="pty">
Nov 15 10:03:32 user nova-compute[75122]:       <log file="/opt/stack/data/nova/instances/5954fd91-94c6-4521-9465-1477c0e35f8d/console.log" append="off"/>
Nov 15 10:03:32 user nova-compute[75122]:     </serial>
Nov 15 10:03:32 user nova-compute[75122]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 10:03:32 user nova-compute[75122]:     <video>
Nov 15 10:03:32 user nova-compute[75122]:       <model type="virtio"/>
Nov 15 10:03:32 user nova-compute[75122]:     </video>
Nov 15 10:03:32 user nova-compute[75122]:     <rng model="virtio">
Nov 15 10:03:32 user nova-compute[75122]:       <backend model="random">/dev/urandom</backend>
Nov 15 10:03:32 user nova-compute[75122]:     </rng>
Nov 15 10:03:32 user nova-compute[75122]:     <controller type="usb" index="0" model="none"/>
Nov 15 10:03:32 user nova-compute[75122]:     <memballoon model="virtio">
Nov 15 10:03:32 user nova-compute[75122]:       <stats period="10"/>
Nov 15 10:03:32 user nova-compute[75122]:     </memballoon>
Nov 15 10:03:32 user nova-compute[75122]:   </devices>
Nov 15 10:03:32 user nova-compute[75122]: </domain>
Nov 15 10:03:32 user nova-compute[75122]:  {{(pid=75122) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 10:03:33 user nova-compute[75122]: INFO nova.virt.libvirt.driver [-] [instance: 5954fd91-94c6-4521-9465-1477c0e35f8d] Instance destroyed successfully.
Nov 15 10:03:33 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-34505230-2f1e-4500-9500-d28d1452ecfe tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] No BDM found with device name vda, not building metadata. {{(pid=75122) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 10:03:33 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-34505230-2f1e-4500-9500-d28d1452ecfe tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75122) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 10:03:33 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-34505230-2f1e-4500-9500-d28d1452ecfe tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] No VIF found with MAC fa:16:3e:ef:6d:f1, not building metadata {{(pid=75122) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 10:03:34 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:03:34 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:03:34 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:03:34 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:03:34 user nova-compute[75122]: DEBUG nova.compute.manager [req-41a6ccc4-d295-4507-8511-6eb74bb304ec req-735a5e6e-23b2-4b8f-a737-a41906cd063a service nova] [instance: 5954fd91-94c6-4521-9465-1477c0e35f8d] Received event network-vif-plugged-e9b84607-88fe-411c-be24-0f2d1709d9e9 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 10:03:34 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-41a6ccc4-d295-4507-8511-6eb74bb304ec req-735a5e6e-23b2-4b8f-a737-a41906cd063a service nova] Acquiring lock "5954fd91-94c6-4521-9465-1477c0e35f8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:03:34 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-41a6ccc4-d295-4507-8511-6eb74bb304ec req-735a5e6e-23b2-4b8f-a737-a41906cd063a service nova] Lock "5954fd91-94c6-4521-9465-1477c0e35f8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:03:34 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-41a6ccc4-d295-4507-8511-6eb74bb304ec req-735a5e6e-23b2-4b8f-a737-a41906cd063a service nova] Lock "5954fd91-94c6-4521-9465-1477c0e35f8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:03:34 user nova-compute[75122]: DEBUG nova.compute.manager [req-41a6ccc4-d295-4507-8511-6eb74bb304ec req-735a5e6e-23b2-4b8f-a737-a41906cd063a service nova] [instance: 5954fd91-94c6-4521-9465-1477c0e35f8d] No waiting events found dispatching network-vif-plugged-e9b84607-88fe-411c-be24-0f2d1709d9e9 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 10:03:34 user nova-compute[75122]: WARNING nova.compute.manager [req-41a6ccc4-d295-4507-8511-6eb74bb304ec req-735a5e6e-23b2-4b8f-a737-a41906cd063a service nova] [instance: 5954fd91-94c6-4521-9465-1477c0e35f8d] Received unexpected event network-vif-plugged-e9b84607-88fe-411c-be24-0f2d1709d9e9 for instance with vm_state active and task_state rescuing.
Nov 15 10:03:34 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:03:34 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:03:36 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:03:36 user nova-compute[75122]: DEBUG nova.compute.manager [None req-34505230-2f1e-4500-9500-d28d1452ecfe tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: 5954fd91-94c6-4521-9465-1477c0e35f8d] Checking state {{(pid=75122) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 10:03:36 user nova-compute[75122]: DEBUG nova.compute.manager [req-41c0ffd3-e5ff-4f84-afef-94f7a48485ba req-469a1588-ac3e-4896-bbee-c8c7ede7c9fe service nova] [instance: 5954fd91-94c6-4521-9465-1477c0e35f8d] Received event network-vif-plugged-e9b84607-88fe-411c-be24-0f2d1709d9e9 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 10:03:36 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-41c0ffd3-e5ff-4f84-afef-94f7a48485ba req-469a1588-ac3e-4896-bbee-c8c7ede7c9fe service nova] Acquiring lock "5954fd91-94c6-4521-9465-1477c0e35f8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:03:36 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-41c0ffd3-e5ff-4f84-afef-94f7a48485ba req-469a1588-ac3e-4896-bbee-c8c7ede7c9fe service nova] Lock "5954fd91-94c6-4521-9465-1477c0e35f8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:03:36 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-41c0ffd3-e5ff-4f84-afef-94f7a48485ba req-469a1588-ac3e-4896-bbee-c8c7ede7c9fe service nova] Lock "5954fd91-94c6-4521-9465-1477c0e35f8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:03:36 user nova-compute[75122]: DEBUG nova.compute.manager [req-41c0ffd3-e5ff-4f84-afef-94f7a48485ba req-469a1588-ac3e-4896-bbee-c8c7ede7c9fe service nova] [instance: 5954fd91-94c6-4521-9465-1477c0e35f8d] No waiting events found dispatching network-vif-plugged-e9b84607-88fe-411c-be24-0f2d1709d9e9 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 10:03:36 user nova-compute[75122]: WARNING nova.compute.manager [req-41c0ffd3-e5ff-4f84-afef-94f7a48485ba req-469a1588-ac3e-4896-bbee-c8c7ede7c9fe service nova] [instance: 5954fd91-94c6-4521-9465-1477c0e35f8d] Received unexpected event network-vif-plugged-e9b84607-88fe-411c-be24-0f2d1709d9e9 for instance with vm_state rescued and task_state None.
Nov 15 10:03:36 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:03:37 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:03:37 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:03:37 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:03:37 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:03:37 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:03:37 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75122) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 10:03:37 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75122) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 10:03:37 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5954fd91-94c6-4521-9465-1477c0e35f8d/disk.rescue --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:03:37 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5954fd91-94c6-4521-9465-1477c0e35f8d/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:03:37 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5954fd91-94c6-4521-9465-1477c0e35f8d/disk.rescue --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:03:37 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5954fd91-94c6-4521-9465-1477c0e35f8d/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:03:37 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c8b3a13-761f-4491-a367-64e74f038629/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:03:37 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c8b3a13-761f-4491-a367-64e74f038629/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:03:37 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c8b3a13-761f-4491-a367-64e74f038629/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:03:38 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c8b3a13-761f-4491-a367-64e74f038629/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:03:38 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75122) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 10:03:38 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/001d589e-1bee-42da-8422-233ba796fbab/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:03:38 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/001d589e-1bee-42da-8422-233ba796fbab/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:03:38 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/001d589e-1bee-42da-8422-233ba796fbab/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:03:38 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/001d589e-1bee-42da-8422-233ba796fbab/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:03:38 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75122) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 10:03:38 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75122) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 10:03:38 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ad77a91-bc65-44a8-8ced-fd2ad9237946/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:03:38 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ad77a91-bc65-44a8-8ced-fd2ad9237946/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:03:38 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ad77a91-bc65-44a8-8ced-fd2ad9237946/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:03:39 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ad77a91-bc65-44a8-8ced-fd2ad9237946/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:03:39 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 10:03:39 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 10:03:39 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Hypervisor/Node resource view: name=user free_ram=8496MB free_disk=24.923263549804688GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75122) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 10:03:39 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:03:39 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:03:39 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance 001d589e-1bee-42da-8422-233ba796fbab actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 10:03:39 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance db848537-676f-464a-806d-febb14d920a6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 10:03:39 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance 9ad77a91-bc65-44a8-8ced-fd2ad9237946 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 10:03:39 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance 4c8b3a13-761f-4491-a367-64e74f038629 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 10:03:39 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance 1f426091-b78a-4d40-bff4-a5c23f155e54 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 10:03:39 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance 5954fd91-94c6-4521-9465-1477c0e35f8d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 10:03:39 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance 066af25e-462a-4c1e-b7de-9df3bca4c679 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 10:03:39 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75122) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 10:03:39 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75122) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 10:03:39 user nova-compute[75122]: DEBUG nova.compute.provider_tree [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Inventory has not changed in ProviderTree for provider: 69a3da65-47be-44c6-b67c-c692b58284ef {{(pid=75122) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 10:03:39 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Inventory has not changed for provider 69a3da65-47be-44c6-b67c-c692b58284ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 10:03:39 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Compute_service record updated for user:user {{(pid=75122) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 10:03:39 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.412s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:03:41 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:03:41 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:03:41 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:03:43 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:03:43 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:03:45 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:03:45 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75122) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 10:03:46 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:03:47 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:03:47 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:03:47 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Starting heal instance info cache {{(pid=75122) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 10:03:47 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "refresh_cache-4c8b3a13-761f-4491-a367-64e74f038629" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 10:03:47 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquired lock "refresh_cache-4c8b3a13-761f-4491-a367-64e74f038629" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 10:03:47 user nova-compute[75122]: DEBUG nova.network.neutron [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] [instance: 4c8b3a13-761f-4491-a367-64e74f038629] Forcefully refreshing network info cache for instance {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 10:03:47 user nova-compute[75122]: DEBUG nova.network.neutron [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] [instance: 4c8b3a13-761f-4491-a367-64e74f038629] Updating instance_info_cache with network_info: [{"id": "e514c549-93ff-4c5e-88ef-2b3301f91069", "address": "fa:16:3e:75:23:6d", "network": {"id": "b780d5c1-a549-4b49-a036-5a272697d4b6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-229344021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c046170a2ad44ebba5d2de236d940be0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape514c549-93", "ovs_interfaceid": "e514c549-93ff-4c5e-88ef-2b3301f91069", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 10:03:47 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Releasing lock "refresh_cache-4c8b3a13-761f-4491-a367-64e74f038629" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 10:03:47 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] [instance: 4c8b3a13-761f-4491-a367-64e74f038629] Updated the network info_cache for instance {{(pid=75122) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 10:03:51 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:03:51 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:03:51 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:03:56 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:03:56 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:04:01 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:04:01 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:04:06 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:04:06 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:04:11 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:04:11 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:04:14 user nova-compute[75122]: DEBUG nova.compute.manager [req-35eeb739-b0b8-4a6b-9b9f-adc6828d60d7 req-8361dda8-f743-4e9f-8b57-7bca1ec9fae1 service nova] [instance: 066af25e-462a-4c1e-b7de-9df3bca4c679] Received event network-changed-78d7ad1b-c17f-4a6b-b1b5-5b3b44d55890 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 10:04:14 user nova-compute[75122]: DEBUG nova.compute.manager [req-35eeb739-b0b8-4a6b-9b9f-adc6828d60d7 req-8361dda8-f743-4e9f-8b57-7bca1ec9fae1 service nova] [instance: 066af25e-462a-4c1e-b7de-9df3bca4c679] Refreshing instance network info cache due to event network-changed-78d7ad1b-c17f-4a6b-b1b5-5b3b44d55890. {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 10:04:14 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-35eeb739-b0b8-4a6b-9b9f-adc6828d60d7 req-8361dda8-f743-4e9f-8b57-7bca1ec9fae1 service nova] Acquiring lock "refresh_cache-066af25e-462a-4c1e-b7de-9df3bca4c679" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 10:04:14 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-35eeb739-b0b8-4a6b-9b9f-adc6828d60d7 req-8361dda8-f743-4e9f-8b57-7bca1ec9fae1 service nova] Acquired lock "refresh_cache-066af25e-462a-4c1e-b7de-9df3bca4c679" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 10:04:14 user nova-compute[75122]: DEBUG nova.network.neutron [req-35eeb739-b0b8-4a6b-9b9f-adc6828d60d7 req-8361dda8-f743-4e9f-8b57-7bca1ec9fae1 service nova] [instance: 066af25e-462a-4c1e-b7de-9df3bca4c679] Refreshing network info cache for port 78d7ad1b-c17f-4a6b-b1b5-5b3b44d55890 {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 10:04:14 user nova-compute[75122]: DEBUG nova.network.neutron [req-35eeb739-b0b8-4a6b-9b9f-adc6828d60d7 req-8361dda8-f743-4e9f-8b57-7bca1ec9fae1 service nova] [instance: 066af25e-462a-4c1e-b7de-9df3bca4c679] Updated VIF entry in instance network info cache for port 78d7ad1b-c17f-4a6b-b1b5-5b3b44d55890. {{(pid=75122) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 10:04:14 user nova-compute[75122]: DEBUG nova.network.neutron [req-35eeb739-b0b8-4a6b-9b9f-adc6828d60d7 req-8361dda8-f743-4e9f-8b57-7bca1ec9fae1 service nova] [instance: 066af25e-462a-4c1e-b7de-9df3bca4c679] Updating instance_info_cache with network_info: [{"id": "78d7ad1b-c17f-4a6b-b1b5-5b3b44d55890", "address": "fa:16:3e:75:fc:9e", "network": {"id": "03073971-5253-4f06-a46a-94840841fd6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2056706757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7941f36c30b49408ae5709a1b75346d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78d7ad1b-c1", "ovs_interfaceid": "78d7ad1b-c17f-4a6b-b1b5-5b3b44d55890", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 10:04:14 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-35eeb739-b0b8-4a6b-9b9f-adc6828d60d7 req-8361dda8-f743-4e9f-8b57-7bca1ec9fae1 service nova] Releasing lock "refresh_cache-066af25e-462a-4c1e-b7de-9df3bca4c679" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 10:04:15 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-e8f64955-d1ca-4c77-88d5-23a539d61bcf tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Acquiring lock "066af25e-462a-4c1e-b7de-9df3bca4c679" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:04:15 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-e8f64955-d1ca-4c77-88d5-23a539d61bcf tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Lock "066af25e-462a-4c1e-b7de-9df3bca4c679" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:04:15 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-e8f64955-d1ca-4c77-88d5-23a539d61bcf tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Acquiring lock "066af25e-462a-4c1e-b7de-9df3bca4c679-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:04:15 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-e8f64955-d1ca-4c77-88d5-23a539d61bcf tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Lock "066af25e-462a-4c1e-b7de-9df3bca4c679-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:04:15 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-e8f64955-d1ca-4c77-88d5-23a539d61bcf tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Lock "066af25e-462a-4c1e-b7de-9df3bca4c679-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:04:15 user nova-compute[75122]: INFO nova.compute.manager [None req-e8f64955-d1ca-4c77-88d5-23a539d61bcf tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 066af25e-462a-4c1e-b7de-9df3bca4c679] Terminating instance
Nov 15 10:04:15 user nova-compute[75122]: DEBUG nova.compute.manager [None req-e8f64955-d1ca-4c77-88d5-23a539d61bcf tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 066af25e-462a-4c1e-b7de-9df3bca4c679] Start destroying the instance on the hypervisor. {{(pid=75122) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 10:04:15 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:04:15 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:04:16 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:04:16 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:04:16 user nova-compute[75122]: DEBUG nova.compute.manager [req-e1844c85-fd22-4ab0-928e-8be2a7e9a418 req-409b3d52-a9df-4398-b6a3-049167dfc1c3 service nova] [instance: 066af25e-462a-4c1e-b7de-9df3bca4c679] Received event network-vif-unplugged-78d7ad1b-c17f-4a6b-b1b5-5b3b44d55890 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 10:04:16 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-e1844c85-fd22-4ab0-928e-8be2a7e9a418 req-409b3d52-a9df-4398-b6a3-049167dfc1c3 service nova] Acquiring lock "066af25e-462a-4c1e-b7de-9df3bca4c679-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:04:16 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-e1844c85-fd22-4ab0-928e-8be2a7e9a418 req-409b3d52-a9df-4398-b6a3-049167dfc1c3 service nova] Lock "066af25e-462a-4c1e-b7de-9df3bca4c679-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:04:16 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-e1844c85-fd22-4ab0-928e-8be2a7e9a418 req-409b3d52-a9df-4398-b6a3-049167dfc1c3 service nova] Lock "066af25e-462a-4c1e-b7de-9df3bca4c679-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:04:16 user nova-compute[75122]: DEBUG nova.compute.manager [req-e1844c85-fd22-4ab0-928e-8be2a7e9a418 req-409b3d52-a9df-4398-b6a3-049167dfc1c3 service nova] [instance: 066af25e-462a-4c1e-b7de-9df3bca4c679] No waiting events found dispatching network-vif-unplugged-78d7ad1b-c17f-4a6b-b1b5-5b3b44d55890 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 10:04:16 user nova-compute[75122]: DEBUG nova.compute.manager [req-e1844c85-fd22-4ab0-928e-8be2a7e9a418 req-409b3d52-a9df-4398-b6a3-049167dfc1c3 service nova] [instance: 066af25e-462a-4c1e-b7de-9df3bca4c679] Received event network-vif-unplugged-78d7ad1b-c17f-4a6b-b1b5-5b3b44d55890 for instance with task_state deleting. {{(pid=75122) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 10:04:16 user nova-compute[75122]: DEBUG nova.compute.manager [req-e1844c85-fd22-4ab0-928e-8be2a7e9a418 req-409b3d52-a9df-4398-b6a3-049167dfc1c3 service nova] [instance: 066af25e-462a-4c1e-b7de-9df3bca4c679] Received event network-vif-plugged-78d7ad1b-c17f-4a6b-b1b5-5b3b44d55890 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 10:04:16 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-e1844c85-fd22-4ab0-928e-8be2a7e9a418 req-409b3d52-a9df-4398-b6a3-049167dfc1c3 service nova] Acquiring lock "066af25e-462a-4c1e-b7de-9df3bca4c679-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:04:16 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-e1844c85-fd22-4ab0-928e-8be2a7e9a418 req-409b3d52-a9df-4398-b6a3-049167dfc1c3 service nova] Lock "066af25e-462a-4c1e-b7de-9df3bca4c679-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:04:16 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-e1844c85-fd22-4ab0-928e-8be2a7e9a418 req-409b3d52-a9df-4398-b6a3-049167dfc1c3 service nova] Lock "066af25e-462a-4c1e-b7de-9df3bca4c679-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:04:16 user nova-compute[75122]: DEBUG nova.compute.manager [req-e1844c85-fd22-4ab0-928e-8be2a7e9a418 req-409b3d52-a9df-4398-b6a3-049167dfc1c3 service nova] [instance: 066af25e-462a-4c1e-b7de-9df3bca4c679] No waiting events found dispatching network-vif-plugged-78d7ad1b-c17f-4a6b-b1b5-5b3b44d55890 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 10:04:16 user nova-compute[75122]: WARNING nova.compute.manager [req-e1844c85-fd22-4ab0-928e-8be2a7e9a418 req-409b3d52-a9df-4398-b6a3-049167dfc1c3 service nova] [instance: 066af25e-462a-4c1e-b7de-9df3bca4c679] Received unexpected event network-vif-plugged-78d7ad1b-c17f-4a6b-b1b5-5b3b44d55890 for instance with vm_state active and task_state deleting.
Nov 15 10:04:16 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:04:16 user nova-compute[75122]: INFO nova.virt.libvirt.driver [-] [instance: 066af25e-462a-4c1e-b7de-9df3bca4c679] Instance destroyed successfully.
Nov 15 10:04:16 user nova-compute[75122]: DEBUG nova.objects.instance [None req-e8f64955-d1ca-4c77-88d5-23a539d61bcf tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Lazy-loading 'resources' on Instance uuid 066af25e-462a-4c1e-b7de-9df3bca4c679 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 10:04:16 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-e8f64955-d1ca-4c77-88d5-23a539d61bcf tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T10:02:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1995821154',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1995821154',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1995821154',id=46,image_ref='4f1cef98-363f-4654-8182-82d5d4ca179f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKeGIKbGOsxVJWCNdSeKOUaiLUUQXUsXJRcFpZhOxjxm+jZxfKvhoJhLQVqNZLJrlxuYFKNje7SnTs+spajGXtffc0Tjmp9J8l1ajoV4yt62ekgTKejfwVfmIwk3RJosWQ==',key_name='tempest-keypair-657382480',keypairs=<?>,launch_index=0,launched_at=2023-11-15T10:02:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c7941f36c30b49408ae5709a1b75346d',ramdisk_id='',reservation_id='r-uexssavu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-296749341',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-296749341-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-296749341',owner_user_name='tempest-TestVolumeBootPattern-296749341-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T10:02:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='00f5cc88e43c434c8a061dcec472a16b',uuid=066af25e-462a-4c1e-b7de-9df3bca4c679,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "78d7ad1b-c17f-4a6b-b1b5-5b3b44d55890", "address": "fa:16:3e:75:fc:9e", "network": {"id": "03073971-5253-4f06-a46a-94840841fd6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2056706757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7941f36c30b49408ae5709a1b75346d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78d7ad1b-c1", "ovs_interfaceid": "78d7ad1b-c17f-4a6b-b1b5-5b3b44d55890", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 10:04:16 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-e8f64955-d1ca-4c77-88d5-23a539d61bcf tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Converting VIF {"id": "78d7ad1b-c17f-4a6b-b1b5-5b3b44d55890", "address": "fa:16:3e:75:fc:9e", "network": {"id": "03073971-5253-4f06-a46a-94840841fd6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2056706757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7941f36c30b49408ae5709a1b75346d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78d7ad1b-c1", "ovs_interfaceid": "78d7ad1b-c17f-4a6b-b1b5-5b3b44d55890", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 10:04:16 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-e8f64955-d1ca-4c77-88d5-23a539d61bcf tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:75:fc:9e,bridge_name='br-int',has_traffic_filtering=True,id=78d7ad1b-c17f-4a6b-b1b5-5b3b44d55890,network=Network(03073971-5253-4f06-a46a-94840841fd6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78d7ad1b-c1') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 10:04:16 user nova-compute[75122]: DEBUG os_vif [None req-e8f64955-d1ca-4c77-88d5-23a539d61bcf tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:75:fc:9e,bridge_name='br-int',has_traffic_filtering=True,id=78d7ad1b-c17f-4a6b-b1b5-5b3b44d55890,network=Network(03073971-5253-4f06-a46a-94840841fd6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78d7ad1b-c1') {{(pid=75122) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 10:04:16 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:04:16 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap78d7ad1b-c1, bridge=br-int, if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 10:04:16 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:04:16 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:04:16 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:04:16 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:04:16 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=49f08710-0474-4947-96fd-1fdfd611a4f3) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 10:04:16 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:04:16 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:04:16 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:04:16 user nova-compute[75122]: INFO os_vif [None req-e8f64955-d1ca-4c77-88d5-23a539d61bcf tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:75:fc:9e,bridge_name='br-int',has_traffic_filtering=True,id=78d7ad1b-c17f-4a6b-b1b5-5b3b44d55890,network=Network(03073971-5253-4f06-a46a-94840841fd6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78d7ad1b-c1')
Nov 15 10:04:16 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e8f64955-d1ca-4c77-88d5-23a539d61bcf tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 066af25e-462a-4c1e-b7de-9df3bca4c679] calling os-brick to detach iSCSI Volume {{(pid=75122) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 10:04:16 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8f64955-d1ca-4c77-88d5-23a539d61bcf tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffa04060b80>, {'target_iqn': 'iqn.2010-10.org.openstack:0e03a7fc-bdb5-4505-ba7a-b0a896124e5f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pAQOsJZe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 10:04:16 user nova-compute[75122]: WARNING os_brick.initiator.connectors.base [None req-e8f64955-d1ca-4c77-88d5-23a539d61bcf tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 10:04:16 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-e8f64955-d1ca-4c77-88d5-23a539d61bcf tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 10:04:16 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-e8f64955-d1ca-4c77-88d5-23a539d61bcf tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 10:04:16 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:04:16 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:04:16 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[7361cc53-3ac5-4b3f-b8df-dc29be8018ee]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2d703360-7eee-4b0b-9b1d-a42e2170de6c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:11d2deb7-c652-48e3-ae06-5557c9bef981\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8ee79db2-27c2-4d0f-8ee6-5b03e05ebba5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0e03a7fc-bdb5-4505-ba7a-b0a896124e5f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:04:16 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8f64955-d1ca-4c77-88d5-23a539d61bcf tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 10:04:16 user nova-compute[75122]: No targets found.
Nov 15 10:04:16 user nova-compute[75122]: iSNS:
Nov 15 10:04:16 user nova-compute[75122]: No targets found.
Nov 15 10:04:16 user nova-compute[75122]: STATIC:
Nov 15 10:04:16 user nova-compute[75122]: Target: iqn.2010-10.org.openstack:2d703360-7eee-4b0b-9b1d-a42e2170de6c
Nov 15 10:04:16 user nova-compute[75122]:         Portal: 172.16.0.220:3260,-1
Nov 15 10:04:16 user nova-compute[75122]:                 Iface Name: default
Nov 15 10:04:16 user nova-compute[75122]: Target: iqn.2010-10.org.openstack:11d2deb7-c652-48e3-ae06-5557c9bef981
Nov 15 10:04:16 user nova-compute[75122]:         Portal: 172.16.0.220:3260,-1
Nov 15 10:04:16 user nova-compute[75122]:                 Iface Name: default
Nov 15 10:04:16 user nova-compute[75122]: Target: iqn.2010-10.org.openstack:8ee79db2-27c2-4d0f-8ee6-5b03e05ebba5
Nov 15 10:04:16 user nova-compute[75122]:         Portal: 172.16.0.220:3260,-1
Nov 15 10:04:16 user nova-compute[75122]:                 Iface Name: default
Nov 15 10:04:16 user nova-compute[75122]: Target: iqn.2010-10.org.openstack:0e03a7fc-bdb5-4505-ba7a-b0a896124e5f
Nov 15 10:04:16 user nova-compute[75122]:         Portal: 172.16.0.220:3260,-1
Nov 15 10:04:16 user nova-compute[75122]:                 Iface Name: default
Nov 15 10:04:16 user nova-compute[75122]: FIRMWARE:
Nov 15 10:04:16 user nova-compute[75122]: No targets found.
Nov 15 10:04:16 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 10:04:16 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8f64955-d1ca-4c77-88d5-23a539d61bcf tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 10:04:16 user nova-compute[75122]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 10:04:16 user nova-compute[75122]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75122) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 10:04:16 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8f64955-d1ca-4c77-88d5-23a539d61bcf tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0e03a7fc-bdb5-4505-ba7a-b0a896124e5f', 0)] {{(pid=75122) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 10:04:16 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:04:16 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:04:16 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:04:16 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[80ab6bea-46ba-4a9f-9175-17864aa06275]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0e03a7fc-bdb5-4505-ba7a-b0a896124e5f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:11d2deb7-c652-48e3-ae06-5557c9bef981\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2d703360-7eee-4b0b-9b1d-a42e2170de6c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8ee79db2-27c2-4d0f-8ee6-5b03e05ebba5\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:04:16 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:04:16 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:04:16 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[11faf150-5fa7-4c80-a3a0-2473f899c3f8]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee79db2-27c2-4d0f-8ee6-5b03e05ebba5 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d703360-7eee-4b0b-9b1d-a42e2170de6c (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11d2deb7-c652-48e3-ae06-5557c9bef981 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e03a7fc-bdb5-4505-ba7a-b0a896124e5f (non-flash)\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:04:16 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8f64955-d1ca-4c77-88d5-23a539d61bcf tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee79db2-27c2-4d0f-8ee6-5b03e05ebba5 (non-flash)
Nov 15 10:04:16 user nova-compute[75122]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d703360-7eee-4b0b-9b1d-a42e2170de6c (non-flash)
Nov 15 10:04:16 user nova-compute[75122]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11d2deb7-c652-48e3-ae06-5557c9bef981 (non-flash)
Nov 15 10:04:16 user nova-compute[75122]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e03a7fc-bdb5-4505-ba7a-b0a896124e5f (non-flash)
Nov 15 10:04:16 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 10:04:16 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8f64955-d1ca-4c77-88d5-23a539d61bcf tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee79db2-27c2-4d0f-8ee6-5b03e05ebba5 (non-flash)
Nov 15 10:04:16 user nova-compute[75122]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d703360-7eee-4b0b-9b1d-a42e2170de6c (non-flash)
Nov 15 10:04:16 user nova-compute[75122]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11d2deb7-c652-48e3-ae06-5557c9bef981 (non-flash)
Nov 15 10:04:16 user nova-compute[75122]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e03a7fc-bdb5-4505-ba7a-b0a896124e5f (non-flash)
Nov 15 10:04:16 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 10:04:16 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8f64955-d1ca-4c77-88d5-23a539d61bcf tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff9fc1f8700>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0e03a7fc-bdb5-4505-ba7a-b0a896124e5f'): ({'sdf'}, set())}) {{(pid=75122) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 10:04:16 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-e8f64955-d1ca-4c77-88d5-23a539d61bcf tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Removing single pathed devices sdf {{(pid=75122) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 10:04:16 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:04:16 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:04:16 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c6e1ec6-eade-48c1-87e3-70e357279888]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:04:16 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:04:16 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.027s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:04:16 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bbf7fa1-a222-42c1-9d24-13404a0419f4]: (4, ('ok\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:04:16 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-e8f64955-d1ca-4c77-88d5-23a539d61bcf tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Flushing IO for device /dev/sdf {{(pid=75122) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 10:04:16 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:04:16 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.019s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:04:16 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7062d8f-dab8-430d-a8cd-f1a9b1faba36]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:04:16 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-e8f64955-d1ca-4c77-88d5-23a539d61bcf tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75122) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 10:04:16 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:04:16 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.046s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:04:16 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[03694829-61b0-4472-ae27-8e4e77c3f2cf]: (4, ('1', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:04:16 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-e8f64955-d1ca-4c77-88d5-23a539d61bcf tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75122) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 10:04:16 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-e8f64955-d1ca-4c77-88d5-23a539d61bcf tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] SCSI volumes sdf have been removed. {{(pid=75122) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 10:04:16 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8f64955-d1ca-4c77-88d5-23a539d61bcf tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0e03a7fc-bdb5-4505-ba7a-b0a896124e5f')] {{(pid=75122) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 10:04:16 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e03a7fc-bdb5-4505-ba7a-b0a896124e5f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:04:16 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e03a7fc-bdb5-4505-ba7a-b0a896124e5f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:04:16 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[79d9c932-9dfc-448f-8596-2c822e26c84d]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:04:16 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8f64955-d1ca-4c77-88d5-23a539d61bcf tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 10:04:16 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e03a7fc-bdb5-4505-ba7a-b0a896124e5f -p 172.16.0.220:3260 --logout {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:04:17 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e03a7fc-bdb5-4505-ba7a-b0a896124e5f -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:04:17 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd18255c-30ec-4d80-bcc2-3fecc31e13ee]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:0e03a7fc-bdb5-4505-ba7a-b0a896124e5f, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:0e03a7fc-bdb5-4505-ba7a-b0a896124e5f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:04:17 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8f64955-d1ca-4c77-88d5-23a539d61bcf tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:0e03a7fc-bdb5-4505-ba7a-b0a896124e5f, portal: 172.16.0.220,3260]
Nov 15 10:04:17 user nova-compute[75122]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:0e03a7fc-bdb5-4505-ba7a-b0a896124e5f, portal: 172.16.0.220,3260] successful.
Nov 15 10:04:17 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 10:04:17 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e03a7fc-bdb5-4505-ba7a-b0a896124e5f -p 172.16.0.220:3260 --op delete {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:04:17 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e03a7fc-bdb5-4505-ba7a-b0a896124e5f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:04:17 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[49a33d44-8b78-429c-8a57-db3a3ec73980]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:04:17 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8f64955-d1ca-4c77-88d5-23a539d61bcf tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 10:04:17 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-e8f64955-d1ca-4c77-88d5-23a539d61bcf tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.368s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 10:04:17 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8f64955-d1ca-4c77-88d5-23a539d61bcf tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] <== disconnect_volume: return (370ms) None {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 10:04:17 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e8f64955-d1ca-4c77-88d5-23a539d61bcf tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 066af25e-462a-4c1e-b7de-9df3bca4c679] Disconnected iSCSI Volume {{(pid=75122) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 10:04:17 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-e8f64955-d1ca-4c77-88d5-23a539d61bcf tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 066af25e-462a-4c1e-b7de-9df3bca4c679] Deleting instance files /opt/stack/data/nova/instances/066af25e-462a-4c1e-b7de-9df3bca4c679_del
Nov 15 10:04:17 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-e8f64955-d1ca-4c77-88d5-23a539d61bcf tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 066af25e-462a-4c1e-b7de-9df3bca4c679] Deletion of /opt/stack/data/nova/instances/066af25e-462a-4c1e-b7de-9df3bca4c679_del complete
Nov 15 10:04:17 user nova-compute[75122]: INFO nova.compute.manager [None req-e8f64955-d1ca-4c77-88d5-23a539d61bcf tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 066af25e-462a-4c1e-b7de-9df3bca4c679] Took 1.28 seconds to destroy the instance on the hypervisor.
Nov 15 10:04:17 user nova-compute[75122]: DEBUG oslo.service.loopingcall [None req-e8f64955-d1ca-4c77-88d5-23a539d61bcf tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75122) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 10:04:17 user nova-compute[75122]: DEBUG nova.compute.manager [-] [instance: 066af25e-462a-4c1e-b7de-9df3bca4c679] Deallocating network for instance {{(pid=75122) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 10:04:17 user nova-compute[75122]: DEBUG nova.network.neutron [-] [instance: 066af25e-462a-4c1e-b7de-9df3bca4c679] deallocate_for_instance() {{(pid=75122) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 10:04:18 user nova-compute[75122]: DEBUG nova.network.neutron [-] [instance: 066af25e-462a-4c1e-b7de-9df3bca4c679] Updating instance_info_cache with network_info: [] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 10:04:18 user nova-compute[75122]: INFO nova.compute.manager [-] [instance: 066af25e-462a-4c1e-b7de-9df3bca4c679] Took 0.87 seconds to deallocate network for instance.
Nov 15 10:04:18 user nova-compute[75122]: DEBUG nova.compute.manager [req-8763461a-5e05-4dc2-ba79-417431082274 req-9581a925-9c5b-4f0c-b464-d24edfada723 service nova] [instance: 066af25e-462a-4c1e-b7de-9df3bca4c679] Received event network-vif-deleted-78d7ad1b-c17f-4a6b-b1b5-5b3b44d55890 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 10:04:18 user nova-compute[75122]: INFO nova.compute.manager [None req-e8f64955-d1ca-4c77-88d5-23a539d61bcf tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 066af25e-462a-4c1e-b7de-9df3bca4c679] Took 0.92 seconds to detach 1 volumes for instance.
Nov 15 10:04:18 user nova-compute[75122]: DEBUG nova.compute.manager [None req-e8f64955-d1ca-4c77-88d5-23a539d61bcf tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 066af25e-462a-4c1e-b7de-9df3bca4c679] Deleting volume: 0e03a7fc-bdb5-4505-ba7a-b0a896124e5f {{(pid=75122) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 15 10:04:19 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-e8f64955-d1ca-4c77-88d5-23a539d61bcf tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:04:19 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-e8f64955-d1ca-4c77-88d5-23a539d61bcf tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:04:19 user nova-compute[75122]: DEBUG nova.compute.provider_tree [None req-e8f64955-d1ca-4c77-88d5-23a539d61bcf tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Inventory has not changed in ProviderTree for provider: 69a3da65-47be-44c6-b67c-c692b58284ef {{(pid=75122) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 10:04:19 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-e8f64955-d1ca-4c77-88d5-23a539d61bcf tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Inventory has not changed for provider 69a3da65-47be-44c6-b67c-c692b58284ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 10:04:19 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-e8f64955-d1ca-4c77-88d5-23a539d61bcf tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.255s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:04:19 user nova-compute[75122]: INFO nova.scheduler.client.report [None req-e8f64955-d1ca-4c77-88d5-23a539d61bcf tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Deleted allocations for instance 066af25e-462a-4c1e-b7de-9df3bca4c679
Nov 15 10:04:19 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-e8f64955-d1ca-4c77-88d5-23a539d61bcf tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Lock "066af25e-462a-4c1e-b7de-9df3bca4c679" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.576s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:04:21 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:04:21 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:04:26 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:04:26 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:04:31 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:04:36 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:04:37 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:04:37 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:04:37 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:04:37 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:04:37 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75122) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 10:04:37 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75122) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 10:04:37 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5954fd91-94c6-4521-9465-1477c0e35f8d/disk.rescue --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:04:37 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5954fd91-94c6-4521-9465-1477c0e35f8d/disk.rescue --force-share --output=json" returned: 0 in 0.169s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:04:37 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5954fd91-94c6-4521-9465-1477c0e35f8d/disk.rescue --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:04:37 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5954fd91-94c6-4521-9465-1477c0e35f8d/disk.rescue --force-share --output=json" returned: 0 in 0.168s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:04:37 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c8b3a13-761f-4491-a367-64e74f038629/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:04:37 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c8b3a13-761f-4491-a367-64e74f038629/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:04:37 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c8b3a13-761f-4491-a367-64e74f038629/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:04:38 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c8b3a13-761f-4491-a367-64e74f038629/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:04:38 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75122) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 10:04:38 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/001d589e-1bee-42da-8422-233ba796fbab/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:04:38 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/001d589e-1bee-42da-8422-233ba796fbab/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:04:38 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/001d589e-1bee-42da-8422-233ba796fbab/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:04:38 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/001d589e-1bee-42da-8422-233ba796fbab/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:04:38 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75122) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 10:04:38 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ad77a91-bc65-44a8-8ced-fd2ad9237946/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:04:38 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ad77a91-bc65-44a8-8ced-fd2ad9237946/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:04:38 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ad77a91-bc65-44a8-8ced-fd2ad9237946/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:04:38 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ad77a91-bc65-44a8-8ced-fd2ad9237946/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:04:39 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 10:04:39 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 10:04:39 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Hypervisor/Node resource view: name=user free_ram=8593MB free_disk=24.910675048828125GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75122) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 10:04:39 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:04:39 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:04:39 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance 001d589e-1bee-42da-8422-233ba796fbab actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 10:04:39 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance db848537-676f-464a-806d-febb14d920a6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 10:04:39 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance 9ad77a91-bc65-44a8-8ced-fd2ad9237946 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 10:04:39 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance 4c8b3a13-761f-4491-a367-64e74f038629 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 10:04:39 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance 1f426091-b78a-4d40-bff4-a5c23f155e54 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 10:04:39 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance 5954fd91-94c6-4521-9465-1477c0e35f8d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 10:04:39 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=75122) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 10:04:39 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=75122) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 10:04:39 user nova-compute[75122]: DEBUG nova.compute.provider_tree [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Inventory has not changed in ProviderTree for provider: 69a3da65-47be-44c6-b67c-c692b58284ef {{(pid=75122) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 10:04:39 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Inventory has not changed for provider 69a3da65-47be-44c6-b67c-c692b58284ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 10:04:39 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Compute_service record updated for user:user {{(pid=75122) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 10:04:39 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.309s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:04:40 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:04:40 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:04:41 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:04:42 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:04:43 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:04:45 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:04:46 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:04:46 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:04:47 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:04:47 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75122) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 10:04:48 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:04:48 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:04:48 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Starting heal instance info cache {{(pid=75122) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 10:04:48 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Rebuilding the list of instances to heal {{(pid=75122) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 10:04:48 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "refresh_cache-001d589e-1bee-42da-8422-233ba796fbab" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 10:04:48 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquired lock "refresh_cache-001d589e-1bee-42da-8422-233ba796fbab" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 10:04:48 user nova-compute[75122]: DEBUG nova.network.neutron [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] [instance: 001d589e-1bee-42da-8422-233ba796fbab] Forcefully refreshing network info cache for instance {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 10:04:48 user nova-compute[75122]: DEBUG nova.objects.instance [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lazy-loading 'info_cache' on Instance uuid 001d589e-1bee-42da-8422-233ba796fbab {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 10:04:49 user nova-compute[75122]: DEBUG nova.network.neutron [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] [instance: 001d589e-1bee-42da-8422-233ba796fbab] Updating instance_info_cache with network_info: [{"id": "6a77f68d-d3da-47c6-a3de-09bd69399762", "address": "fa:16:3e:87:a0:de", "network": {"id": "b780d5c1-a549-4b49-a036-5a272697d4b6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-229344021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c046170a2ad44ebba5d2de236d940be0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a77f68d-d3", "ovs_interfaceid": "6a77f68d-d3da-47c6-a3de-09bd69399762", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 10:04:49 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Releasing lock "refresh_cache-001d589e-1bee-42da-8422-233ba796fbab" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 10:04:49 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] [instance: 001d589e-1bee-42da-8422-233ba796fbab] Updated the network info_cache for instance {{(pid=75122) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 10:04:51 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:04:56 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:05:01 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:05:06 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:05:07 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-dff9139a-90a8-4574-b6c9-786549de4010 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Acquiring lock "1f426091-b78a-4d40-bff4-a5c23f155e54" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:05:07 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-dff9139a-90a8-4574-b6c9-786549de4010 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Lock "1f426091-b78a-4d40-bff4-a5c23f155e54" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:05:07 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-dff9139a-90a8-4574-b6c9-786549de4010 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Acquiring lock "1f426091-b78a-4d40-bff4-a5c23f155e54-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:05:07 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-dff9139a-90a8-4574-b6c9-786549de4010 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Lock "1f426091-b78a-4d40-bff4-a5c23f155e54-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:05:07 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-dff9139a-90a8-4574-b6c9-786549de4010 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Lock "1f426091-b78a-4d40-bff4-a5c23f155e54-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:05:07 user nova-compute[75122]: INFO nova.compute.manager [None req-dff9139a-90a8-4574-b6c9-786549de4010 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 1f426091-b78a-4d40-bff4-a5c23f155e54] Terminating instance
Nov 15 10:05:07 user nova-compute[75122]: DEBUG nova.compute.manager [None req-dff9139a-90a8-4574-b6c9-786549de4010 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 1f426091-b78a-4d40-bff4-a5c23f155e54] Start destroying the instance on the hypervisor. {{(pid=75122) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 10:05:07 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:05:07 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:05:07 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:05:07 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:05:07 user nova-compute[75122]: DEBUG nova.compute.manager [req-427c7567-77fa-4805-87af-ed0a0bab4937 req-3e8ec054-9bf5-4801-b955-4820e044c4a8 service nova] [instance: 1f426091-b78a-4d40-bff4-a5c23f155e54] Received event network-vif-unplugged-f096e3d4-b769-4e60-a355-52e3765faeb9 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 10:05:07 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-427c7567-77fa-4805-87af-ed0a0bab4937 req-3e8ec054-9bf5-4801-b955-4820e044c4a8 service nova] Acquiring lock "1f426091-b78a-4d40-bff4-a5c23f155e54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:05:07 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-427c7567-77fa-4805-87af-ed0a0bab4937 req-3e8ec054-9bf5-4801-b955-4820e044c4a8 service nova] Lock "1f426091-b78a-4d40-bff4-a5c23f155e54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:05:07 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-427c7567-77fa-4805-87af-ed0a0bab4937 req-3e8ec054-9bf5-4801-b955-4820e044c4a8 service nova] Lock "1f426091-b78a-4d40-bff4-a5c23f155e54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:05:07 user nova-compute[75122]: DEBUG nova.compute.manager [req-427c7567-77fa-4805-87af-ed0a0bab4937 req-3e8ec054-9bf5-4801-b955-4820e044c4a8 service nova] [instance: 1f426091-b78a-4d40-bff4-a5c23f155e54] No waiting events found dispatching network-vif-unplugged-f096e3d4-b769-4e60-a355-52e3765faeb9 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 10:05:07 user nova-compute[75122]: DEBUG nova.compute.manager [req-427c7567-77fa-4805-87af-ed0a0bab4937 req-3e8ec054-9bf5-4801-b955-4820e044c4a8 service nova] [instance: 1f426091-b78a-4d40-bff4-a5c23f155e54] Received event network-vif-unplugged-f096e3d4-b769-4e60-a355-52e3765faeb9 for instance with task_state deleting. {{(pid=75122) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 10:05:08 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:05:08 user nova-compute[75122]: INFO nova.virt.libvirt.driver [-] [instance: 1f426091-b78a-4d40-bff4-a5c23f155e54] Instance destroyed successfully.
Nov 15 10:05:08 user nova-compute[75122]: DEBUG nova.objects.instance [None req-dff9139a-90a8-4574-b6c9-786549de4010 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Lazy-loading 'resources' on Instance uuid 1f426091-b78a-4d40-bff4-a5c23f155e54 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 10:05:08 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-dff9139a-90a8-4574-b6c9-786549de4010 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T10:00:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1834533455',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1834533455',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1834533455',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFv9ey23GI3cfdrs8WtI+94p+2HeOim4GqGQ2CzDpuC8PZXSPGarxzIQdboWmdQjsPVPOShvpZrEssd9J05BIqWp+W2XIB0KG00TY9OfBaGF5DpizQ83Pnp6p2L5Cj2Wpw==',key_name='tempest-keypair-146489',keypairs=<?>,launch_index=0,launched_at=2023-11-15T10:00:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c7941f36c30b49408ae5709a1b75346d',ramdisk_id='',reservation_id='r-y6i6a02s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-296749341',owner_user_name='tempest-TestVolumeBootPattern-296749341-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T10:00:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='00f5cc88e43c434c8a061dcec472a16b',uuid=1f426091-b78a-4d40-bff4-a5c23f155e54,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f096e3d4-b769-4e60-a355-52e3765faeb9", "address": "fa:16:3e:cc:76:68", "network": {"id": "03073971-5253-4f06-a46a-94840841fd6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2056706757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7941f36c30b49408ae5709a1b75346d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf096e3d4-b7", "ovs_interfaceid": "f096e3d4-b769-4e60-a355-52e3765faeb9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 10:05:08 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-dff9139a-90a8-4574-b6c9-786549de4010 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Converting VIF {"id": "f096e3d4-b769-4e60-a355-52e3765faeb9", "address": "fa:16:3e:cc:76:68", "network": {"id": "03073971-5253-4f06-a46a-94840841fd6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2056706757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7941f36c30b49408ae5709a1b75346d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf096e3d4-b7", "ovs_interfaceid": "f096e3d4-b769-4e60-a355-52e3765faeb9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 10:05:08 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-dff9139a-90a8-4574-b6c9-786549de4010 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cc:76:68,bridge_name='br-int',has_traffic_filtering=True,id=f096e3d4-b769-4e60-a355-52e3765faeb9,network=Network(03073971-5253-4f06-a46a-94840841fd6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf096e3d4-b7') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 10:05:08 user nova-compute[75122]: DEBUG os_vif [None req-dff9139a-90a8-4574-b6c9-786549de4010 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cc:76:68,bridge_name='br-int',has_traffic_filtering=True,id=f096e3d4-b769-4e60-a355-52e3765faeb9,network=Network(03073971-5253-4f06-a46a-94840841fd6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf096e3d4-b7') {{(pid=75122) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 10:05:08 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:05:08 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf096e3d4-b7, bridge=br-int, if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 10:05:08 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:05:08 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:05:08 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:05:08 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:05:08 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e1563e57-6b58-4a8f-a7b2-cdb0dce1d901) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 10:05:08 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:05:08 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:05:08 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:05:08 user nova-compute[75122]: INFO os_vif [None req-dff9139a-90a8-4574-b6c9-786549de4010 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cc:76:68,bridge_name='br-int',has_traffic_filtering=True,id=f096e3d4-b769-4e60-a355-52e3765faeb9,network=Network(03073971-5253-4f06-a46a-94840841fd6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf096e3d4-b7')
Nov 15 10:05:08 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dff9139a-90a8-4574-b6c9-786549de4010 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 1f426091-b78a-4d40-bff4-a5c23f155e54] calling os-brick to detach iSCSI Volume {{(pid=75122) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 10:05:08 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-dff9139a-90a8-4574-b6c9-786549de4010 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffa04060b80>, {'target_iqn': 'iqn.2010-10.org.openstack:2d703360-7eee-4b0b-9b1d-a42e2170de6c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PbeLrWDj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 10:05:08 user nova-compute[75122]: WARNING os_brick.initiator.connectors.base [None req-dff9139a-90a8-4574-b6c9-786549de4010 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 10:05:08 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-dff9139a-90a8-4574-b6c9-786549de4010 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 10:05:08 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-dff9139a-90a8-4574-b6c9-786549de4010 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 10:05:08 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:05:08 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:05:08 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[160dba53-a373-42aa-9d36-b4fcaa5b5720]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2d703360-7eee-4b0b-9b1d-a42e2170de6c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:11d2deb7-c652-48e3-ae06-5557c9bef981\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8ee79db2-27c2-4d0f-8ee6-5b03e05ebba5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:05:08 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-dff9139a-90a8-4574-b6c9-786549de4010 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 10:05:08 user nova-compute[75122]: No targets found.
Nov 15 10:05:08 user nova-compute[75122]: iSNS:
Nov 15 10:05:08 user nova-compute[75122]: No targets found.
Nov 15 10:05:08 user nova-compute[75122]: STATIC:
Nov 15 10:05:08 user nova-compute[75122]: Target: iqn.2010-10.org.openstack:2d703360-7eee-4b0b-9b1d-a42e2170de6c
Nov 15 10:05:08 user nova-compute[75122]:         Portal: 172.16.0.220:3260,-1
Nov 15 10:05:08 user nova-compute[75122]:                 Iface Name: default
Nov 15 10:05:08 user nova-compute[75122]: Target: iqn.2010-10.org.openstack:11d2deb7-c652-48e3-ae06-5557c9bef981
Nov 15 10:05:08 user nova-compute[75122]:         Portal: 172.16.0.220:3260,-1
Nov 15 10:05:08 user nova-compute[75122]:                 Iface Name: default
Nov 15 10:05:08 user nova-compute[75122]: Target: iqn.2010-10.org.openstack:8ee79db2-27c2-4d0f-8ee6-5b03e05ebba5
Nov 15 10:05:08 user nova-compute[75122]:         Portal: 172.16.0.220:3260,-1
Nov 15 10:05:08 user nova-compute[75122]:                 Iface Name: default
Nov 15 10:05:08 user nova-compute[75122]: FIRMWARE:
Nov 15 10:05:08 user nova-compute[75122]: No targets found.
Nov 15 10:05:08 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 10:05:08 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-dff9139a-90a8-4574-b6c9-786549de4010 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 10:05:08 user nova-compute[75122]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 10:05:08 user nova-compute[75122]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75122) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 10:05:08 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-dff9139a-90a8-4574-b6c9-786549de4010 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2d703360-7eee-4b0b-9b1d-a42e2170de6c', 0)] {{(pid=75122) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 10:05:08 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:05:08 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:05:08 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbf86477-70fc-4a66-9cc2-c70c992c1426]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:11d2deb7-c652-48e3-ae06-5557c9bef981\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2d703360-7eee-4b0b-9b1d-a42e2170de6c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8ee79db2-27c2-4d0f-8ee6-5b03e05ebba5\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:05:08 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:05:08 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:05:08 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b458758-04f8-4cef-b5d5-dbfa0d792c2c]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee79db2-27c2-4d0f-8ee6-5b03e05ebba5 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d703360-7eee-4b0b-9b1d-a42e2170de6c (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11d2deb7-c652-48e3-ae06-5557c9bef981 (non-flash)\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:05:08 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-dff9139a-90a8-4574-b6c9-786549de4010 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee79db2-27c2-4d0f-8ee6-5b03e05ebba5 (non-flash)
Nov 15 10:05:08 user nova-compute[75122]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d703360-7eee-4b0b-9b1d-a42e2170de6c (non-flash)
Nov 15 10:05:08 user nova-compute[75122]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11d2deb7-c652-48e3-ae06-5557c9bef981 (non-flash)
Nov 15 10:05:08 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 10:05:08 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-dff9139a-90a8-4574-b6c9-786549de4010 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee79db2-27c2-4d0f-8ee6-5b03e05ebba5 (non-flash)
Nov 15 10:05:08 user nova-compute[75122]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2d703360-7eee-4b0b-9b1d-a42e2170de6c (non-flash)
Nov 15 10:05:08 user nova-compute[75122]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11d2deb7-c652-48e3-ae06-5557c9bef981 (non-flash)
Nov 15 10:05:08 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 10:05:08 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-dff9139a-90a8-4574-b6c9-786549de4010 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ffa04039d80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2d703360-7eee-4b0b-9b1d-a42e2170de6c'): ({'sdc'}, set())}) {{(pid=75122) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 10:05:08 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-dff9139a-90a8-4574-b6c9-786549de4010 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Removing single pathed devices sdc {{(pid=75122) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 10:05:08 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:05:08 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:05:08 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[665850a2-70fe-4d63-baee-7404c49a293f]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:05:08 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:05:08 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:05:08 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc019151-43db-4102-8615-961902d01e97]: (4, ('ok\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:05:08 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-dff9139a-90a8-4574-b6c9-786549de4010 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Flushing IO for device /dev/sdc {{(pid=75122) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 10:05:08 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:05:08 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:05:08 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[210c8164-ca52-47a1-8a3b-a84b0219e588]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:05:08 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-dff9139a-90a8-4574-b6c9-786549de4010 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75122) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 10:05:08 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:05:08 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.053s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:05:08 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[efe700bf-141e-4a47-bd65-c44539bf18f9]: (4, ('1', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:05:08 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-dff9139a-90a8-4574-b6c9-786549de4010 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75122) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 10:05:08 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-dff9139a-90a8-4574-b6c9-786549de4010 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] SCSI volumes sdc have been removed. {{(pid=75122) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 10:05:08 user nova-compute[75122]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO26ce5d3b-c11ddb2ae1c88efc', '/dev/disk/by-id/scsi-26331316464623261', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_26ce5d3b') {{(pid=85998) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 15 10:05:08 user nova-compute[75122]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-26331316464623261
Nov 15 10:05:08 user nova-compute[75122]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_26ce5d3b
Nov 15 10:05:08 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[874ac5ba-36a6-4c71-bd66-681df9f55098]: (4, None) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:05:08 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-dff9139a-90a8-4574-b6c9-786549de4010 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2d703360-7eee-4b0b-9b1d-a42e2170de6c')] {{(pid=75122) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 10:05:08 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d703360-7eee-4b0b-9b1d-a42e2170de6c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:05:08 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d703360-7eee-4b0b-9b1d-a42e2170de6c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:05:08 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[48b42709-6576-4efc-859d-2a8dc2828769]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:05:08 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-dff9139a-90a8-4574-b6c9-786549de4010 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 10:05:08 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d703360-7eee-4b0b-9b1d-a42e2170de6c -p 172.16.0.220:3260 --logout {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:05:08 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d703360-7eee-4b0b-9b1d-a42e2170de6c -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:05:08 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e5028cb-b598-4125-abf6-fe03afeda6ad]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:2d703360-7eee-4b0b-9b1d-a42e2170de6c, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:2d703360-7eee-4b0b-9b1d-a42e2170de6c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:05:08 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-dff9139a-90a8-4574-b6c9-786549de4010 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:2d703360-7eee-4b0b-9b1d-a42e2170de6c, portal: 172.16.0.220,3260]
Nov 15 10:05:08 user nova-compute[75122]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:2d703360-7eee-4b0b-9b1d-a42e2170de6c, portal: 172.16.0.220,3260] successful.
Nov 15 10:05:08 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 10:05:08 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2d703360-7eee-4b0b-9b1d-a42e2170de6c -p 172.16.0.220:3260 --op delete {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:05:08 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2d703360-7eee-4b0b-9b1d-a42e2170de6c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:05:08 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b5422d0-323b-4571-bfce-513d4193f136]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:05:08 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-dff9139a-90a8-4574-b6c9-786549de4010 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 10:05:08 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-dff9139a-90a8-4574-b6c9-786549de4010 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.307s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 10:05:08 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-dff9139a-90a8-4574-b6c9-786549de4010 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] <== disconnect_volume: return (308ms) None {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 10:05:08 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dff9139a-90a8-4574-b6c9-786549de4010 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 1f426091-b78a-4d40-bff4-a5c23f155e54] Disconnected iSCSI Volume {{(pid=75122) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 10:05:08 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-dff9139a-90a8-4574-b6c9-786549de4010 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 1f426091-b78a-4d40-bff4-a5c23f155e54] Deleting instance files /opt/stack/data/nova/instances/1f426091-b78a-4d40-bff4-a5c23f155e54_del
Nov 15 10:05:08 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-dff9139a-90a8-4574-b6c9-786549de4010 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 1f426091-b78a-4d40-bff4-a5c23f155e54] Deletion of /opt/stack/data/nova/instances/1f426091-b78a-4d40-bff4-a5c23f155e54_del complete
Nov 15 10:05:08 user nova-compute[75122]: INFO nova.compute.manager [None req-dff9139a-90a8-4574-b6c9-786549de4010 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 1f426091-b78a-4d40-bff4-a5c23f155e54] Took 1.17 seconds to destroy the instance on the hypervisor.
Nov 15 10:05:08 user nova-compute[75122]: DEBUG oslo.service.loopingcall [None req-dff9139a-90a8-4574-b6c9-786549de4010 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75122) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 10:05:08 user nova-compute[75122]: DEBUG nova.compute.manager [-] [instance: 1f426091-b78a-4d40-bff4-a5c23f155e54] Deallocating network for instance {{(pid=75122) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 10:05:08 user nova-compute[75122]: DEBUG nova.network.neutron [-] [instance: 1f426091-b78a-4d40-bff4-a5c23f155e54] deallocate_for_instance() {{(pid=75122) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 10:05:09 user nova-compute[75122]: DEBUG nova.network.neutron [-] [instance: 1f426091-b78a-4d40-bff4-a5c23f155e54] Updating instance_info_cache with network_info: [] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 10:05:09 user nova-compute[75122]: INFO nova.compute.manager [-] [instance: 1f426091-b78a-4d40-bff4-a5c23f155e54] Took 0.60 seconds to deallocate network for instance.
Nov 15 10:05:09 user nova-compute[75122]: DEBUG nova.compute.manager [req-1b1cdd42-e23a-484e-aec5-195903e0bec9 req-8a24a40c-38d0-40d5-b881-1ddd7379d5f8 service nova] [instance: 1f426091-b78a-4d40-bff4-a5c23f155e54] Received event network-vif-plugged-f096e3d4-b769-4e60-a355-52e3765faeb9 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 10:05:09 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-1b1cdd42-e23a-484e-aec5-195903e0bec9 req-8a24a40c-38d0-40d5-b881-1ddd7379d5f8 service nova] Acquiring lock "1f426091-b78a-4d40-bff4-a5c23f155e54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:05:09 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-1b1cdd42-e23a-484e-aec5-195903e0bec9 req-8a24a40c-38d0-40d5-b881-1ddd7379d5f8 service nova] Lock "1f426091-b78a-4d40-bff4-a5c23f155e54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:05:09 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-1b1cdd42-e23a-484e-aec5-195903e0bec9 req-8a24a40c-38d0-40d5-b881-1ddd7379d5f8 service nova] Lock "1f426091-b78a-4d40-bff4-a5c23f155e54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:05:09 user nova-compute[75122]: DEBUG nova.compute.manager [req-1b1cdd42-e23a-484e-aec5-195903e0bec9 req-8a24a40c-38d0-40d5-b881-1ddd7379d5f8 service nova] [instance: 1f426091-b78a-4d40-bff4-a5c23f155e54] No waiting events found dispatching network-vif-plugged-f096e3d4-b769-4e60-a355-52e3765faeb9 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 10:05:09 user nova-compute[75122]: WARNING nova.compute.manager [req-1b1cdd42-e23a-484e-aec5-195903e0bec9 req-8a24a40c-38d0-40d5-b881-1ddd7379d5f8 service nova] [instance: 1f426091-b78a-4d40-bff4-a5c23f155e54] Received unexpected event network-vif-plugged-f096e3d4-b769-4e60-a355-52e3765faeb9 for instance with vm_state active and task_state deleting.
Nov 15 10:05:09 user nova-compute[75122]: DEBUG nova.compute.manager [req-1b1cdd42-e23a-484e-aec5-195903e0bec9 req-8a24a40c-38d0-40d5-b881-1ddd7379d5f8 service nova] [instance: 1f426091-b78a-4d40-bff4-a5c23f155e54] Received event network-vif-deleted-f096e3d4-b769-4e60-a355-52e3765faeb9 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 10:05:10 user nova-compute[75122]: INFO nova.compute.manager [None req-dff9139a-90a8-4574-b6c9-786549de4010 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 1f426091-b78a-4d40-bff4-a5c23f155e54] Took 0.71 seconds to detach 1 volumes for instance.
Nov 15 10:05:10 user nova-compute[75122]: DEBUG nova.compute.manager [None req-dff9139a-90a8-4574-b6c9-786549de4010 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 1f426091-b78a-4d40-bff4-a5c23f155e54] Deleting volume: 2d703360-7eee-4b0b-9b1d-a42e2170de6c {{(pid=75122) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 15 10:05:10 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-dff9139a-90a8-4574-b6c9-786549de4010 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:05:10 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-dff9139a-90a8-4574-b6c9-786549de4010 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:05:10 user nova-compute[75122]: DEBUG nova.compute.provider_tree [None req-dff9139a-90a8-4574-b6c9-786549de4010 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Inventory has not changed in ProviderTree for provider: 69a3da65-47be-44c6-b67c-c692b58284ef {{(pid=75122) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 10:05:10 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-dff9139a-90a8-4574-b6c9-786549de4010 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Inventory has not changed for provider 69a3da65-47be-44c6-b67c-c692b58284ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 10:05:10 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-dff9139a-90a8-4574-b6c9-786549de4010 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.275s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:05:10 user nova-compute[75122]: INFO nova.scheduler.client.report [None req-dff9139a-90a8-4574-b6c9-786549de4010 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Deleted allocations for instance 1f426091-b78a-4d40-bff4-a5c23f155e54
Nov 15 10:05:10 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-dff9139a-90a8-4574-b6c9-786549de4010 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Lock "1f426091-b78a-4d40-bff4-a5c23f155e54" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.008s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:05:13 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:05:16 user nova-compute[75122]: DEBUG nova.objects.instance [None req-3ce31bbb-3ce4-4295-a3e9-a78721ea9a61 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Lazy-loading 'flavor' on Instance uuid 9ad77a91-bc65-44a8-8ced-fd2ad9237946 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 10:05:16 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-3ce31bbb-3ce4-4295-a3e9-a78721ea9a61 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Acquiring lock "refresh_cache-9ad77a91-bc65-44a8-8ced-fd2ad9237946" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 10:05:17 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-3ce31bbb-3ce4-4295-a3e9-a78721ea9a61 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Acquired lock "refresh_cache-9ad77a91-bc65-44a8-8ced-fd2ad9237946" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 10:05:17 user nova-compute[75122]: DEBUG nova.network.neutron [None req-3ce31bbb-3ce4-4295-a3e9-a78721ea9a61 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] [instance: 9ad77a91-bc65-44a8-8ced-fd2ad9237946] Building network info cache for instance {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 10:05:17 user nova-compute[75122]: DEBUG nova.objects.instance [None req-3ce31bbb-3ce4-4295-a3e9-a78721ea9a61 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Lazy-loading 'info_cache' on Instance uuid 9ad77a91-bc65-44a8-8ced-fd2ad9237946 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 10:05:17 user nova-compute[75122]: DEBUG nova.objects.base [None req-3ce31bbb-3ce4-4295-a3e9-a78721ea9a61 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Object Instance<9ad77a91-bc65-44a8-8ced-fd2ad9237946> lazy-loaded attributes: flavor,info_cache {{(pid=75122) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 10:05:17 user nova-compute[75122]: DEBUG nova.network.neutron [None req-3ce31bbb-3ce4-4295-a3e9-a78721ea9a61 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] [instance: 9ad77a91-bc65-44a8-8ced-fd2ad9237946] Updating instance_info_cache with network_info: [{"id": "e348b3b5-1fc0-4c27-98e7-41a152a67610", "address": "fa:16:3e:d3:b1:38", "network": {"id": "8c1491a5-d5c6-4a22-84fd-bdeca00bbaad", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1848328203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab6afbe7809a4ad3921cbc18145d1816", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape348b3b5-1f", "ovs_interfaceid": "e348b3b5-1fc0-4c27-98e7-41a152a67610", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 10:05:17 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-3ce31bbb-3ce4-4295-a3e9-a78721ea9a61 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Releasing lock "refresh_cache-9ad77a91-bc65-44a8-8ced-fd2ad9237946" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 10:05:17 user nova-compute[75122]: INFO nova.virt.libvirt.driver [-] [instance: 9ad77a91-bc65-44a8-8ced-fd2ad9237946] Instance destroyed successfully.
Nov 15 10:05:17 user nova-compute[75122]: DEBUG nova.objects.instance [None req-3ce31bbb-3ce4-4295-a3e9-a78721ea9a61 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Lazy-loading 'resources' on Instance uuid 9ad77a91-bc65-44a8-8ced-fd2ad9237946 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 10:05:17 user nova-compute[75122]: DEBUG nova.objects.base [None req-3ce31bbb-3ce4-4295-a3e9-a78721ea9a61 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Object Instance<9ad77a91-bc65-44a8-8ced-fd2ad9237946> lazy-loaded attributes: flavor,info_cache,resources {{(pid=75122) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 10:05:17 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-3ce31bbb-3ce4-4295-a3e9-a78721ea9a61 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T09:57:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-803179351',display_name='tempest-AttachVolumeTestJSON-server-803179351',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-803179351',id=41,image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOazdcLoty/Tvb58dOdgjYRlbmZHLxyOye3e81xDJ6xblOKkjaBcaTxCMTaYL2kE3EQ/2KT89+o54kjCi92RXyGz9Fa5Z/xA8RuG+orKH3o1/047NRIGM2FIaGKSP1LaWg==',key_name='tempest-keypair-269122459',keypairs=<?>,launch_index=0,launched_at=2023-11-15T09:57:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='ab6afbe7809a4ad3921cbc18145d1816',ramdisk_id='',reservation_id='r-3ag6vy4w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-970815916',owner_user_name='tempest-AttachVolumeTestJSON-970815916-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T10:03:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f18eb706375c4b2e9e7de793cd2950ad',uuid=9ad77a91-bc65-44a8-8ced-fd2ad9237946,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "e348b3b5-1fc0-4c27-98e7-41a152a67610", "address": "fa:16:3e:d3:b1:38", "network": {"id": "8c1491a5-d5c6-4a22-84fd-bdeca00bbaad", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1848328203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab6afbe7809a4ad3921cbc18145d1816", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape348b3b5-1f", "ovs_interfaceid": "e348b3b5-1fc0-4c27-98e7-41a152a67610", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 10:05:17 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-3ce31bbb-3ce4-4295-a3e9-a78721ea9a61 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Converting VIF {"id": "e348b3b5-1fc0-4c27-98e7-41a152a67610", "address": "fa:16:3e:d3:b1:38", "network": {"id": "8c1491a5-d5c6-4a22-84fd-bdeca00bbaad", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1848328203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab6afbe7809a4ad3921cbc18145d1816", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape348b3b5-1f", "ovs_interfaceid": "e348b3b5-1fc0-4c27-98e7-41a152a67610", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 10:05:17 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-3ce31bbb-3ce4-4295-a3e9-a78721ea9a61 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:b1:38,bridge_name='br-int',has_traffic_filtering=True,id=e348b3b5-1fc0-4c27-98e7-41a152a67610,network=Network(8c1491a5-d5c6-4a22-84fd-bdeca00bbaad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape348b3b5-1f') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 10:05:17 user nova-compute[75122]: DEBUG os_vif [None req-3ce31bbb-3ce4-4295-a3e9-a78721ea9a61 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:b1:38,bridge_name='br-int',has_traffic_filtering=True,id=e348b3b5-1fc0-4c27-98e7-41a152a67610,network=Network(8c1491a5-d5c6-4a22-84fd-bdeca00bbaad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape348b3b5-1f') {{(pid=75122) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 10:05:17 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:05:17 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape348b3b5-1f, bridge=br-int, if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 10:05:17 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:05:17 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:05:17 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:05:17 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=06034be8-271f-4074-a629-2490a11c50f0) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 10:05:17 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:05:17 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:05:17 user nova-compute[75122]: INFO os_vif [None req-3ce31bbb-3ce4-4295-a3e9-a78721ea9a61 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:b1:38,bridge_name='br-int',has_traffic_filtering=True,id=e348b3b5-1fc0-4c27-98e7-41a152a67610,network=Network(8c1491a5-d5c6-4a22-84fd-bdeca00bbaad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape348b3b5-1f')
Nov 15 10:05:17 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-3ce31bbb-3ce4-4295-a3e9-a78721ea9a61 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] [instance: 9ad77a91-bc65-44a8-8ced-fd2ad9237946] Start _get_guest_xml network_info=[{"id": "e348b3b5-1fc0-4c27-98e7-41a152a67610", "address": "fa:16:3e:d3:b1:38", "network": {"id": "8c1491a5-d5c6-4a22-84fd-bdeca00bbaad", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1848328203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab6afbe7809a4ad3921cbc18145d1816", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape348b3b5-1f", "ovs_interfaceid": "e348b3b5-1fc0-4c27-98e7-41a152a67610", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=5e862cfe-47b8-4725-8292-65761ee6d0f5,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '5e862cfe-47b8-4725-8292-65761ee6d0f5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75122) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 10:05:17 user nova-compute[75122]: DEBUG nova.objects.instance [None req-3ce31bbb-3ce4-4295-a3e9-a78721ea9a61 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Lazy-loading 'numa_topology' on Instance uuid 9ad77a91-bc65-44a8-8ced-fd2ad9237946 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 10:05:17 user nova-compute[75122]: DEBUG nova.objects.base [None req-3ce31bbb-3ce4-4295-a3e9-a78721ea9a61 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Object Instance<9ad77a91-bc65-44a8-8ced-fd2ad9237946> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=75122) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 10:05:17 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-3ce31bbb-3ce4-4295-a3e9-a78721ea9a61 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 10:05:17 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-3ce31bbb-3ce4-4295-a3e9-a78721ea9a61 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 10:05:17 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-3ce31bbb-3ce4-4295-a3e9-a78721ea9a61 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75122) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 10:05:17 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-3ce31bbb-3ce4-4295-a3e9-a78721ea9a61 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] CPU controller missing on host. {{(pid=75122) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 10:05:17 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-3ce31bbb-3ce4-4295-a3e9-a78721ea9a61 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75122) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 10:05:17 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-3ce31bbb-3ce4-4295-a3e9-a78721ea9a61 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] CPU controller found on host. {{(pid=75122) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 10:05:17 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-3ce31bbb-3ce4-4295-a3e9-a78721ea9a61 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75122) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 10:05:17 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-3ce31bbb-3ce4-4295-a3e9-a78721ea9a61 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T09:26:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=5e862cfe-47b8-4725-8292-65761ee6d0f5,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 10:05:17 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-3ce31bbb-3ce4-4295-a3e9-a78721ea9a61 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Flavor limits 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 10:05:17 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-3ce31bbb-3ce4-4295-a3e9-a78721ea9a61 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Image limits 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 10:05:17 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-3ce31bbb-3ce4-4295-a3e9-a78721ea9a61 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Flavor pref 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 10:05:17 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-3ce31bbb-3ce4-4295-a3e9-a78721ea9a61 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Image pref 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 10:05:17 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-3ce31bbb-3ce4-4295-a3e9-a78721ea9a61 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 10:05:17 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-3ce31bbb-3ce4-4295-a3e9-a78721ea9a61 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 10:05:17 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-3ce31bbb-3ce4-4295-a3e9-a78721ea9a61 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75122) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 10:05:17 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-3ce31bbb-3ce4-4295-a3e9-a78721ea9a61 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Got 1 possible topologies {{(pid=75122) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 10:05:17 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-3ce31bbb-3ce4-4295-a3e9-a78721ea9a61 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 10:05:17 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-3ce31bbb-3ce4-4295-a3e9-a78721ea9a61 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 10:05:17 user nova-compute[75122]: DEBUG nova.objects.instance [None req-3ce31bbb-3ce4-4295-a3e9-a78721ea9a61 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Lazy-loading 'vcpu_model' on Instance uuid 9ad77a91-bc65-44a8-8ced-fd2ad9237946 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 10:05:17 user nova-compute[75122]: DEBUG nova.objects.base [None req-3ce31bbb-3ce4-4295-a3e9-a78721ea9a61 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Object Instance<9ad77a91-bc65-44a8-8ced-fd2ad9237946> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=75122) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 10:05:17 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-3ce31bbb-3ce4-4295-a3e9-a78721ea9a61 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T09:57:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-803179351',display_name='tempest-AttachVolumeTestJSON-server-803179351',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-803179351',id=41,image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOazdcLoty/Tvb58dOdgjYRlbmZHLxyOye3e81xDJ6xblOKkjaBcaTxCMTaYL2kE3EQ/2KT89+o54kjCi92RXyGz9Fa5Z/xA8RuG+orKH3o1/047NRIGM2FIaGKSP1LaWg==',key_name='tempest-keypair-269122459',keypairs=<?>,launch_index=0,launched_at=2023-11-15T09:57:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='ab6afbe7809a4ad3921cbc18145d1816',ramdisk_id='',reservation_id='r-3ag6vy4w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-970815916',owner_user_name='tempest-AttachVolumeTestJSON-970815916-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T10:03:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f18eb706375c4b2e9e7de793cd2950ad',uuid=9ad77a91-bc65-44a8-8ced-fd2ad9237946,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "e348b3b5-1fc0-4c27-98e7-41a152a67610", "address": "fa:16:3e:d3:b1:38", "network": {"id": "8c1491a5-d5c6-4a22-84fd-bdeca00bbaad", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1848328203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab6afbe7809a4ad3921cbc18145d1816", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape348b3b5-1f", "ovs_interfaceid": "e348b3b5-1fc0-4c27-98e7-41a152a67610", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75122) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 10:05:17 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-3ce31bbb-3ce4-4295-a3e9-a78721ea9a61 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Converting VIF {"id": "e348b3b5-1fc0-4c27-98e7-41a152a67610", "address": "fa:16:3e:d3:b1:38", "network": {"id": "8c1491a5-d5c6-4a22-84fd-bdeca00bbaad", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1848328203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab6afbe7809a4ad3921cbc18145d1816", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape348b3b5-1f", "ovs_interfaceid": "e348b3b5-1fc0-4c27-98e7-41a152a67610", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 10:05:17 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-3ce31bbb-3ce4-4295-a3e9-a78721ea9a61 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:b1:38,bridge_name='br-int',has_traffic_filtering=True,id=e348b3b5-1fc0-4c27-98e7-41a152a67610,network=Network(8c1491a5-d5c6-4a22-84fd-bdeca00bbaad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape348b3b5-1f') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 10:05:17 user nova-compute[75122]: DEBUG nova.objects.instance [None req-3ce31bbb-3ce4-4295-a3e9-a78721ea9a61 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Lazy-loading 'pci_devices' on Instance uuid 9ad77a91-bc65-44a8-8ced-fd2ad9237946 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 10:05:17 user nova-compute[75122]: DEBUG nova.objects.base [None req-3ce31bbb-3ce4-4295-a3e9-a78721ea9a61 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Object Instance<9ad77a91-bc65-44a8-8ced-fd2ad9237946> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=75122) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 10:05:17 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-3ce31bbb-3ce4-4295-a3e9-a78721ea9a61 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] [instance: 9ad77a91-bc65-44a8-8ced-fd2ad9237946] End _get_guest_xml xml=<domain type="kvm">
Nov 15 10:05:17 user nova-compute[75122]:   <uuid>9ad77a91-bc65-44a8-8ced-fd2ad9237946</uuid>
Nov 15 10:05:17 user nova-compute[75122]:   <name>instance-00000029</name>
Nov 15 10:05:17 user nova-compute[75122]:   <memory>524288</memory>
Nov 15 10:05:17 user nova-compute[75122]:   <vcpu>1</vcpu>
Nov 15 10:05:17 user nova-compute[75122]:   <metadata>
Nov 15 10:05:17 user nova-compute[75122]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 10:05:17 user nova-compute[75122]:       <nova:package version="0.0.0"/>
Nov 15 10:05:17 user nova-compute[75122]:       <nova:name>tempest-AttachVolumeTestJSON-server-803179351</nova:name>
Nov 15 10:05:17 user nova-compute[75122]:       <nova:creationTime>2023-11-15 10:05:17</nova:creationTime>
Nov 15 10:05:17 user nova-compute[75122]:       <nova:flavor name="m1.tiny">
Nov 15 10:05:17 user nova-compute[75122]:         <nova:memory>512</nova:memory>
Nov 15 10:05:17 user nova-compute[75122]:         <nova:disk>1</nova:disk>
Nov 15 10:05:17 user nova-compute[75122]:         <nova:swap>0</nova:swap>
Nov 15 10:05:17 user nova-compute[75122]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 10:05:17 user nova-compute[75122]:         <nova:vcpus>1</nova:vcpus>
Nov 15 10:05:17 user nova-compute[75122]:       </nova:flavor>
Nov 15 10:05:17 user nova-compute[75122]:       <nova:owner>
Nov 15 10:05:17 user nova-compute[75122]:         <nova:user uuid="f18eb706375c4b2e9e7de793cd2950ad">tempest-AttachVolumeTestJSON-970815916-project-member</nova:user>
Nov 15 10:05:17 user nova-compute[75122]:         <nova:project uuid="ab6afbe7809a4ad3921cbc18145d1816">tempest-AttachVolumeTestJSON-970815916</nova:project>
Nov 15 10:05:17 user nova-compute[75122]:       </nova:owner>
Nov 15 10:05:17 user nova-compute[75122]:       <nova:root type="image" uuid="5e862cfe-47b8-4725-8292-65761ee6d0f5"/>
Nov 15 10:05:17 user nova-compute[75122]:       <nova:ports>
Nov 15 10:05:17 user nova-compute[75122]:         <nova:port uuid="e348b3b5-1fc0-4c27-98e7-41a152a67610">
Nov 15 10:05:17 user nova-compute[75122]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 15 10:05:17 user nova-compute[75122]:         </nova:port>
Nov 15 10:05:17 user nova-compute[75122]:       </nova:ports>
Nov 15 10:05:17 user nova-compute[75122]:     </nova:instance>
Nov 15 10:05:17 user nova-compute[75122]:   </metadata>
Nov 15 10:05:17 user nova-compute[75122]:   <sysinfo type="smbios">
Nov 15 10:05:17 user nova-compute[75122]:     <system>
Nov 15 10:05:17 user nova-compute[75122]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 10:05:17 user nova-compute[75122]:       <entry name="product">OpenStack Nova</entry>
Nov 15 10:05:17 user nova-compute[75122]:       <entry name="version">0.0.0</entry>
Nov 15 10:05:17 user nova-compute[75122]:       <entry name="serial">9ad77a91-bc65-44a8-8ced-fd2ad9237946</entry>
Nov 15 10:05:17 user nova-compute[75122]:       <entry name="uuid">9ad77a91-bc65-44a8-8ced-fd2ad9237946</entry>
Nov 15 10:05:17 user nova-compute[75122]:       <entry name="family">Virtual Machine</entry>
Nov 15 10:05:17 user nova-compute[75122]:     </system>
Nov 15 10:05:17 user nova-compute[75122]:   </sysinfo>
Nov 15 10:05:17 user nova-compute[75122]:   <os>
Nov 15 10:05:17 user nova-compute[75122]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 10:05:17 user nova-compute[75122]:     <boot dev="hd"/>
Nov 15 10:05:17 user nova-compute[75122]:     <smbios mode="sysinfo"/>
Nov 15 10:05:17 user nova-compute[75122]:   </os>
Nov 15 10:05:17 user nova-compute[75122]:   <features>
Nov 15 10:05:17 user nova-compute[75122]:     <acpi/>
Nov 15 10:05:17 user nova-compute[75122]:     <apic/>
Nov 15 10:05:17 user nova-compute[75122]:     <vmcoreinfo/>
Nov 15 10:05:17 user nova-compute[75122]:   </features>
Nov 15 10:05:17 user nova-compute[75122]:   <clock offset="utc">
Nov 15 10:05:17 user nova-compute[75122]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 10:05:17 user nova-compute[75122]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 10:05:17 user nova-compute[75122]:     <timer name="hpet" present="no"/>
Nov 15 10:05:17 user nova-compute[75122]:   </clock>
Nov 15 10:05:17 user nova-compute[75122]:   <cpu mode="custom" match="exact">
Nov 15 10:05:17 user nova-compute[75122]:     <model>Nehalem</model>
Nov 15 10:05:17 user nova-compute[75122]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 10:05:17 user nova-compute[75122]:   </cpu>
Nov 15 10:05:17 user nova-compute[75122]:   <devices>
Nov 15 10:05:17 user nova-compute[75122]:     <disk type="file" device="disk">
Nov 15 10:05:17 user nova-compute[75122]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 10:05:17 user nova-compute[75122]:       <source file="/opt/stack/data/nova/instances/9ad77a91-bc65-44a8-8ced-fd2ad9237946/disk"/>
Nov 15 10:05:17 user nova-compute[75122]:       <target dev="vda" bus="virtio"/>
Nov 15 10:05:17 user nova-compute[75122]:     </disk>
Nov 15 10:05:17 user nova-compute[75122]:     <interface type="ethernet">
Nov 15 10:05:17 user nova-compute[75122]:       <mac address="fa:16:3e:d3:b1:38"/>
Nov 15 10:05:17 user nova-compute[75122]:       <model type="virtio"/>
Nov 15 10:05:17 user nova-compute[75122]:       <mtu size="1442"/>
Nov 15 10:05:17 user nova-compute[75122]:       <target dev="tape348b3b5-1f"/>
Nov 15 10:05:17 user nova-compute[75122]:     </interface>
Nov 15 10:05:17 user nova-compute[75122]:     <serial type="pty">
Nov 15 10:05:17 user nova-compute[75122]:       <log file="/opt/stack/data/nova/instances/9ad77a91-bc65-44a8-8ced-fd2ad9237946/console.log" append="off"/>
Nov 15 10:05:17 user nova-compute[75122]:     </serial>
Nov 15 10:05:17 user nova-compute[75122]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 10:05:17 user nova-compute[75122]:     <video>
Nov 15 10:05:17 user nova-compute[75122]:       <model type="virtio"/>
Nov 15 10:05:17 user nova-compute[75122]:     </video>
Nov 15 10:05:17 user nova-compute[75122]:     <rng model="virtio">
Nov 15 10:05:17 user nova-compute[75122]:       <backend model="random">/dev/urandom</backend>
Nov 15 10:05:17 user nova-compute[75122]:     </rng>
Nov 15 10:05:17 user nova-compute[75122]:     <controller type="usb" index="0" model="none"/>
Nov 15 10:05:17 user nova-compute[75122]:     <memballoon model="virtio">
Nov 15 10:05:17 user nova-compute[75122]:       <stats period="10"/>
Nov 15 10:05:17 user nova-compute[75122]:     </memballoon>
Nov 15 10:05:17 user nova-compute[75122]:   </devices>
Nov 15 10:05:17 user nova-compute[75122]: </domain>
Nov 15 10:05:17 user nova-compute[75122]:  {{(pid=75122) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 10:05:17 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-3ce31bbb-3ce4-4295-a3e9-a78721ea9a61 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ad77a91-bc65-44a8-8ced-fd2ad9237946/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:05:17 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-3ce31bbb-3ce4-4295-a3e9-a78721ea9a61 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ad77a91-bc65-44a8-8ced-fd2ad9237946/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:05:17 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-3ce31bbb-3ce4-4295-a3e9-a78721ea9a61 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ad77a91-bc65-44a8-8ced-fd2ad9237946/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:05:17 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-3ce31bbb-3ce4-4295-a3e9-a78721ea9a61 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ad77a91-bc65-44a8-8ced-fd2ad9237946/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:05:17 user nova-compute[75122]: DEBUG nova.objects.instance [None req-3ce31bbb-3ce4-4295-a3e9-a78721ea9a61 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Lazy-loading 'trusted_certs' on Instance uuid 9ad77a91-bc65-44a8-8ced-fd2ad9237946 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 10:05:17 user nova-compute[75122]: DEBUG nova.objects.base [None req-3ce31bbb-3ce4-4295-a3e9-a78721ea9a61 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Object Instance<9ad77a91-bc65-44a8-8ced-fd2ad9237946> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=75122) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 10:05:17 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-3ce31bbb-3ce4-4295-a3e9-a78721ea9a61 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:05:18 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-3ce31bbb-3ce4-4295-a3e9-a78721ea9a61 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json" returned: 0 in 0.179s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:05:18 user nova-compute[75122]: DEBUG nova.virt.disk.api [None req-3ce31bbb-3ce4-4295-a3e9-a78721ea9a61 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9ad77a91-bc65-44a8-8ced-fd2ad9237946/disk. size=1073741824 {{(pid=75122) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 10:05:18 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-3ce31bbb-3ce4-4295-a3e9-a78721ea9a61 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ad77a91-bc65-44a8-8ced-fd2ad9237946/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:05:18 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-3ce31bbb-3ce4-4295-a3e9-a78721ea9a61 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ad77a91-bc65-44a8-8ced-fd2ad9237946/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:05:18 user nova-compute[75122]: DEBUG nova.virt.disk.api [None req-3ce31bbb-3ce4-4295-a3e9-a78721ea9a61 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Cannot resize image /opt/stack/data/nova/instances/9ad77a91-bc65-44a8-8ced-fd2ad9237946/disk to a smaller size. {{(pid=75122) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 10:05:18 user nova-compute[75122]: DEBUG nova.objects.instance [None req-3ce31bbb-3ce4-4295-a3e9-a78721ea9a61 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Lazy-loading 'migration_context' on Instance uuid 9ad77a91-bc65-44a8-8ced-fd2ad9237946 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 10:05:18 user nova-compute[75122]: DEBUG nova.objects.base [None req-3ce31bbb-3ce4-4295-a3e9-a78721ea9a61 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Object Instance<9ad77a91-bc65-44a8-8ced-fd2ad9237946> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75122) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 10:05:18 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-3ce31bbb-3ce4-4295-a3e9-a78721ea9a61 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T09:57:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-803179351',display_name='tempest-AttachVolumeTestJSON-server-803179351',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-803179351',id=41,image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOazdcLoty/Tvb58dOdgjYRlbmZHLxyOye3e81xDJ6xblOKkjaBcaTxCMTaYL2kE3EQ/2KT89+o54kjCi92RXyGz9Fa5Z/xA8RuG+orKH3o1/047NRIGM2FIaGKSP1LaWg==',key_name='tempest-keypair-269122459',keypairs=<?>,launch_index=0,launched_at=2023-11-15T09:57:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='ab6afbe7809a4ad3921cbc18145d1816',ramdisk_id='',reservation_id='r-3ag6vy4w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-970815916',owner_user_name='tempest-AttachVolumeTestJSON-970815916-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T10:03:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f18eb706375c4b2e9e7de793cd2950ad',uuid=9ad77a91-bc65-44a8-8ced-fd2ad9237946,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "e348b3b5-1fc0-4c27-98e7-41a152a67610", "address": "fa:16:3e:d3:b1:38", "network": {"id": "8c1491a5-d5c6-4a22-84fd-bdeca00bbaad", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1848328203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab6afbe7809a4ad3921cbc18145d1816", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape348b3b5-1f", "ovs_interfaceid": "e348b3b5-1fc0-4c27-98e7-41a152a67610", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 10:05:18 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-3ce31bbb-3ce4-4295-a3e9-a78721ea9a61 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Converting VIF {"id": "e348b3b5-1fc0-4c27-98e7-41a152a67610", "address": "fa:16:3e:d3:b1:38", "network": {"id": "8c1491a5-d5c6-4a22-84fd-bdeca00bbaad", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1848328203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab6afbe7809a4ad3921cbc18145d1816", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape348b3b5-1f", "ovs_interfaceid": "e348b3b5-1fc0-4c27-98e7-41a152a67610", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 10:05:18 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-3ce31bbb-3ce4-4295-a3e9-a78721ea9a61 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:b1:38,bridge_name='br-int',has_traffic_filtering=True,id=e348b3b5-1fc0-4c27-98e7-41a152a67610,network=Network(8c1491a5-d5c6-4a22-84fd-bdeca00bbaad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape348b3b5-1f') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 10:05:18 user nova-compute[75122]: DEBUG os_vif [None req-3ce31bbb-3ce4-4295-a3e9-a78721ea9a61 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:b1:38,bridge_name='br-int',has_traffic_filtering=True,id=e348b3b5-1fc0-4c27-98e7-41a152a67610,network=Network(8c1491a5-d5c6-4a22-84fd-bdeca00bbaad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape348b3b5-1f') {{(pid=75122) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 10:05:18 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:05:18 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 10:05:18 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 10:05:18 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:05:18 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '623692db-914d-5664-8c44-2a29b0e02627', '_type': 'linux-noop'}}, row=False) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 10:05:18 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:05:18 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:05:18 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:05:18 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape348b3b5-1f, may_exist=True, interface_attrs={}) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 10:05:18 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape348b3b5-1f, col_values=(('qos', UUID('484a097b-e172-4eb4-9238-bb640e1a5307')),), if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 10:05:18 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape348b3b5-1f, col_values=(('external_ids', {'iface-id': 'e348b3b5-1fc0-4c27-98e7-41a152a67610', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d3:b1:38', 'vm-uuid': '9ad77a91-bc65-44a8-8ced-fd2ad9237946'}),), if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 10:05:18 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:05:18 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:05:18 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:05:18 user nova-compute[75122]: INFO os_vif [None req-3ce31bbb-3ce4-4295-a3e9-a78721ea9a61 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:b1:38,bridge_name='br-int',has_traffic_filtering=True,id=e348b3b5-1fc0-4c27-98e7-41a152a67610,network=Network(8c1491a5-d5c6-4a22-84fd-bdeca00bbaad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape348b3b5-1f')
Nov 15 10:05:19 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:05:19 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:05:19 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:05:19 user nova-compute[75122]: DEBUG nova.compute.manager [req-0df35a2c-9a9e-41a9-9bcb-20085c9cb5db req-02847b2c-b518-4fcc-9a4a-27a937b91c6a service nova] [instance: 9ad77a91-bc65-44a8-8ced-fd2ad9237946] Received event network-vif-plugged-e348b3b5-1fc0-4c27-98e7-41a152a67610 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 10:05:19 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-0df35a2c-9a9e-41a9-9bcb-20085c9cb5db req-02847b2c-b518-4fcc-9a4a-27a937b91c6a service nova] Acquiring lock "9ad77a91-bc65-44a8-8ced-fd2ad9237946-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:05:19 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-0df35a2c-9a9e-41a9-9bcb-20085c9cb5db req-02847b2c-b518-4fcc-9a4a-27a937b91c6a service nova] Lock "9ad77a91-bc65-44a8-8ced-fd2ad9237946-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:05:19 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-0df35a2c-9a9e-41a9-9bcb-20085c9cb5db req-02847b2c-b518-4fcc-9a4a-27a937b91c6a service nova] Lock "9ad77a91-bc65-44a8-8ced-fd2ad9237946-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:05:19 user nova-compute[75122]: DEBUG nova.compute.manager [req-0df35a2c-9a9e-41a9-9bcb-20085c9cb5db req-02847b2c-b518-4fcc-9a4a-27a937b91c6a service nova] [instance: 9ad77a91-bc65-44a8-8ced-fd2ad9237946] No waiting events found dispatching network-vif-plugged-e348b3b5-1fc0-4c27-98e7-41a152a67610 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 10:05:19 user nova-compute[75122]: WARNING nova.compute.manager [req-0df35a2c-9a9e-41a9-9bcb-20085c9cb5db req-02847b2c-b518-4fcc-9a4a-27a937b91c6a service nova] [instance: 9ad77a91-bc65-44a8-8ced-fd2ad9237946] Received unexpected event network-vif-plugged-e348b3b5-1fc0-4c27-98e7-41a152a67610 for instance with vm_state stopped and task_state powering-on.
Nov 15 10:05:19 user nova-compute[75122]: INFO nova.compute.manager [None req-27a44120-3123-40fe-a06b-7f2241da6d57 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: 5954fd91-94c6-4521-9465-1477c0e35f8d] Unrescuing
Nov 15 10:05:19 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-27a44120-3123-40fe-a06b-7f2241da6d57 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Acquiring lock "refresh_cache-5954fd91-94c6-4521-9465-1477c0e35f8d" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 10:05:19 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-27a44120-3123-40fe-a06b-7f2241da6d57 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Acquired lock "refresh_cache-5954fd91-94c6-4521-9465-1477c0e35f8d" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 10:05:19 user nova-compute[75122]: DEBUG nova.network.neutron [None req-27a44120-3123-40fe-a06b-7f2241da6d57 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: 5954fd91-94c6-4521-9465-1477c0e35f8d] Building network info cache for instance {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 10:05:20 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:05:20 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:05:20 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:05:20 user nova-compute[75122]: DEBUG nova.network.neutron [None req-27a44120-3123-40fe-a06b-7f2241da6d57 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: 5954fd91-94c6-4521-9465-1477c0e35f8d] Updating instance_info_cache with network_info: [{"id": "e9b84607-88fe-411c-be24-0f2d1709d9e9", "address": "fa:16:3e:ef:6d:f1", "network": {"id": "b780d5c1-a549-4b49-a036-5a272697d4b6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-229344021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c046170a2ad44ebba5d2de236d940be0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9b84607-88", "ovs_interfaceid": "e9b84607-88fe-411c-be24-0f2d1709d9e9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 10:05:20 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-27a44120-3123-40fe-a06b-7f2241da6d57 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Releasing lock "refresh_cache-5954fd91-94c6-4521-9465-1477c0e35f8d" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 10:05:20 user nova-compute[75122]: DEBUG nova.objects.instance [None req-27a44120-3123-40fe-a06b-7f2241da6d57 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Lazy-loading 'flavor' on Instance uuid 5954fd91-94c6-4521-9465-1477c0e35f8d {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 10:05:20 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:05:20 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:05:20 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:05:20 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:05:21 user nova-compute[75122]: INFO nova.virt.libvirt.driver [-] [instance: 5954fd91-94c6-4521-9465-1477c0e35f8d] Instance destroyed successfully.
Nov 15 10:05:21 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:05:21 user nova-compute[75122]: DEBUG nova.compute.manager [None req-3ce31bbb-3ce4-4295-a3e9-a78721ea9a61 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] [instance: 9ad77a91-bc65-44a8-8ced-fd2ad9237946] Instance event wait completed in 0 seconds for  {{(pid=75122) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 10:05:21 user nova-compute[75122]: INFO nova.virt.libvirt.driver [-] [instance: 9ad77a91-bc65-44a8-8ced-fd2ad9237946] Instance rebooted successfully.
Nov 15 10:05:21 user nova-compute[75122]: DEBUG nova.compute.manager [None req-3ce31bbb-3ce4-4295-a3e9-a78721ea9a61 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] [instance: 9ad77a91-bc65-44a8-8ced-fd2ad9237946] Checking state {{(pid=75122) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 10:05:21 user nova-compute[75122]: DEBUG nova.compute.manager [req-61ae79da-8599-462f-8149-4a2f87facc74 req-7350c798-94dc-40a1-8a35-d31b891caa3e service nova] [instance: 9ad77a91-bc65-44a8-8ced-fd2ad9237946] Received event network-vif-plugged-e348b3b5-1fc0-4c27-98e7-41a152a67610 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 10:05:21 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-61ae79da-8599-462f-8149-4a2f87facc74 req-7350c798-94dc-40a1-8a35-d31b891caa3e service nova] Acquiring lock "9ad77a91-bc65-44a8-8ced-fd2ad9237946-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:05:21 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-61ae79da-8599-462f-8149-4a2f87facc74 req-7350c798-94dc-40a1-8a35-d31b891caa3e service nova] Lock "9ad77a91-bc65-44a8-8ced-fd2ad9237946-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:05:21 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-61ae79da-8599-462f-8149-4a2f87facc74 req-7350c798-94dc-40a1-8a35-d31b891caa3e service nova] Lock "9ad77a91-bc65-44a8-8ced-fd2ad9237946-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:05:21 user nova-compute[75122]: DEBUG nova.compute.manager [req-61ae79da-8599-462f-8149-4a2f87facc74 req-7350c798-94dc-40a1-8a35-d31b891caa3e service nova] [instance: 9ad77a91-bc65-44a8-8ced-fd2ad9237946] No waiting events found dispatching network-vif-plugged-e348b3b5-1fc0-4c27-98e7-41a152a67610 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 10:05:21 user nova-compute[75122]: WARNING nova.compute.manager [req-61ae79da-8599-462f-8149-4a2f87facc74 req-7350c798-94dc-40a1-8a35-d31b891caa3e service nova] [instance: 9ad77a91-bc65-44a8-8ced-fd2ad9237946] Received unexpected event network-vif-plugged-e348b3b5-1fc0-4c27-98e7-41a152a67610 for instance with vm_state stopped and task_state powering-on.
Nov 15 10:05:21 user nova-compute[75122]: DEBUG nova.compute.manager [req-61ae79da-8599-462f-8149-4a2f87facc74 req-7350c798-94dc-40a1-8a35-d31b891caa3e service nova] [instance: 5954fd91-94c6-4521-9465-1477c0e35f8d] Received event network-vif-unplugged-e9b84607-88fe-411c-be24-0f2d1709d9e9 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 10:05:21 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-61ae79da-8599-462f-8149-4a2f87facc74 req-7350c798-94dc-40a1-8a35-d31b891caa3e service nova] Acquiring lock "5954fd91-94c6-4521-9465-1477c0e35f8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:05:21 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-61ae79da-8599-462f-8149-4a2f87facc74 req-7350c798-94dc-40a1-8a35-d31b891caa3e service nova] Lock "5954fd91-94c6-4521-9465-1477c0e35f8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:05:21 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-61ae79da-8599-462f-8149-4a2f87facc74 req-7350c798-94dc-40a1-8a35-d31b891caa3e service nova] Lock "5954fd91-94c6-4521-9465-1477c0e35f8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:05:21 user nova-compute[75122]: DEBUG nova.compute.manager [req-61ae79da-8599-462f-8149-4a2f87facc74 req-7350c798-94dc-40a1-8a35-d31b891caa3e service nova] [instance: 5954fd91-94c6-4521-9465-1477c0e35f8d] No waiting events found dispatching network-vif-unplugged-e9b84607-88fe-411c-be24-0f2d1709d9e9 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 10:05:21 user nova-compute[75122]: WARNING nova.compute.manager [req-61ae79da-8599-462f-8149-4a2f87facc74 req-7350c798-94dc-40a1-8a35-d31b891caa3e service nova] [instance: 5954fd91-94c6-4521-9465-1477c0e35f8d] Received unexpected event network-vif-unplugged-e9b84607-88fe-411c-be24-0f2d1709d9e9 for instance with vm_state rescued and task_state unrescuing.
Nov 15 10:05:21 user nova-compute[75122]: DEBUG nova.compute.manager [req-61ae79da-8599-462f-8149-4a2f87facc74 req-7350c798-94dc-40a1-8a35-d31b891caa3e service nova] [instance: 5954fd91-94c6-4521-9465-1477c0e35f8d] Received event network-vif-plugged-e9b84607-88fe-411c-be24-0f2d1709d9e9 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 10:05:21 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-61ae79da-8599-462f-8149-4a2f87facc74 req-7350c798-94dc-40a1-8a35-d31b891caa3e service nova] Acquiring lock "5954fd91-94c6-4521-9465-1477c0e35f8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:05:21 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-61ae79da-8599-462f-8149-4a2f87facc74 req-7350c798-94dc-40a1-8a35-d31b891caa3e service nova] Lock "5954fd91-94c6-4521-9465-1477c0e35f8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:05:21 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-61ae79da-8599-462f-8149-4a2f87facc74 req-7350c798-94dc-40a1-8a35-d31b891caa3e service nova] Lock "5954fd91-94c6-4521-9465-1477c0e35f8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:05:21 user nova-compute[75122]: DEBUG nova.compute.manager [req-61ae79da-8599-462f-8149-4a2f87facc74 req-7350c798-94dc-40a1-8a35-d31b891caa3e service nova] [instance: 5954fd91-94c6-4521-9465-1477c0e35f8d] No waiting events found dispatching network-vif-plugged-e9b84607-88fe-411c-be24-0f2d1709d9e9 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 10:05:21 user nova-compute[75122]: WARNING nova.compute.manager [req-61ae79da-8599-462f-8149-4a2f87facc74 req-7350c798-94dc-40a1-8a35-d31b891caa3e service nova] [instance: 5954fd91-94c6-4521-9465-1477c0e35f8d] Received unexpected event network-vif-plugged-e9b84607-88fe-411c-be24-0f2d1709d9e9 for instance with vm_state rescued and task_state unrescuing.
Nov 15 10:05:22 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:05:22 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:05:22 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:05:22 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:05:22 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:05:22 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:05:23 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:05:23 user nova-compute[75122]: DEBUG nova.compute.manager [req-ff10542d-f893-4232-a7eb-cea178e310ab req-ca0acfc6-541f-4a5c-a7a1-8fe8328b1230 service nova] [instance: 5954fd91-94c6-4521-9465-1477c0e35f8d] Received event network-vif-plugged-e9b84607-88fe-411c-be24-0f2d1709d9e9 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 10:05:23 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-ff10542d-f893-4232-a7eb-cea178e310ab req-ca0acfc6-541f-4a5c-a7a1-8fe8328b1230 service nova] Acquiring lock "5954fd91-94c6-4521-9465-1477c0e35f8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:05:23 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-ff10542d-f893-4232-a7eb-cea178e310ab req-ca0acfc6-541f-4a5c-a7a1-8fe8328b1230 service nova] Lock "5954fd91-94c6-4521-9465-1477c0e35f8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:05:23 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-ff10542d-f893-4232-a7eb-cea178e310ab req-ca0acfc6-541f-4a5c-a7a1-8fe8328b1230 service nova] Lock "5954fd91-94c6-4521-9465-1477c0e35f8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:05:23 user nova-compute[75122]: DEBUG nova.compute.manager [req-ff10542d-f893-4232-a7eb-cea178e310ab req-ca0acfc6-541f-4a5c-a7a1-8fe8328b1230 service nova] [instance: 5954fd91-94c6-4521-9465-1477c0e35f8d] No waiting events found dispatching network-vif-plugged-e9b84607-88fe-411c-be24-0f2d1709d9e9 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 10:05:23 user nova-compute[75122]: WARNING nova.compute.manager [req-ff10542d-f893-4232-a7eb-cea178e310ab req-ca0acfc6-541f-4a5c-a7a1-8fe8328b1230 service nova] [instance: 5954fd91-94c6-4521-9465-1477c0e35f8d] Received unexpected event network-vif-plugged-e9b84607-88fe-411c-be24-0f2d1709d9e9 for instance with vm_state rescued and task_state unrescuing.
Nov 15 10:05:23 user nova-compute[75122]: DEBUG nova.compute.manager [req-ff10542d-f893-4232-a7eb-cea178e310ab req-ca0acfc6-541f-4a5c-a7a1-8fe8328b1230 service nova] [instance: 5954fd91-94c6-4521-9465-1477c0e35f8d] Received event network-vif-plugged-e9b84607-88fe-411c-be24-0f2d1709d9e9 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 10:05:23 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-ff10542d-f893-4232-a7eb-cea178e310ab req-ca0acfc6-541f-4a5c-a7a1-8fe8328b1230 service nova] Acquiring lock "5954fd91-94c6-4521-9465-1477c0e35f8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:05:23 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-ff10542d-f893-4232-a7eb-cea178e310ab req-ca0acfc6-541f-4a5c-a7a1-8fe8328b1230 service nova] Lock "5954fd91-94c6-4521-9465-1477c0e35f8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:05:23 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-ff10542d-f893-4232-a7eb-cea178e310ab req-ca0acfc6-541f-4a5c-a7a1-8fe8328b1230 service nova] Lock "5954fd91-94c6-4521-9465-1477c0e35f8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:05:23 user nova-compute[75122]: DEBUG nova.compute.manager [req-ff10542d-f893-4232-a7eb-cea178e310ab req-ca0acfc6-541f-4a5c-a7a1-8fe8328b1230 service nova] [instance: 5954fd91-94c6-4521-9465-1477c0e35f8d] No waiting events found dispatching network-vif-plugged-e9b84607-88fe-411c-be24-0f2d1709d9e9 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 10:05:23 user nova-compute[75122]: WARNING nova.compute.manager [req-ff10542d-f893-4232-a7eb-cea178e310ab req-ca0acfc6-541f-4a5c-a7a1-8fe8328b1230 service nova] [instance: 5954fd91-94c6-4521-9465-1477c0e35f8d] Received unexpected event network-vif-plugged-e9b84607-88fe-411c-be24-0f2d1709d9e9 for instance with vm_state rescued and task_state unrescuing.
Nov 15 10:05:24 user nova-compute[75122]: DEBUG nova.compute.manager [None req-27a44120-3123-40fe-a06b-7f2241da6d57 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: 5954fd91-94c6-4521-9465-1477c0e35f8d] Checking state {{(pid=75122) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 10:05:26 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:05:28 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:05:33 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:05:36 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:05:38 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:05:38 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:05:39 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:05:39 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:05:39 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:05:39 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:05:39 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75122) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 10:05:39 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75122) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 10:05:39 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c8b3a13-761f-4491-a367-64e74f038629/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:05:39 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c8b3a13-761f-4491-a367-64e74f038629/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:05:39 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c8b3a13-761f-4491-a367-64e74f038629/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:05:39 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c8b3a13-761f-4491-a367-64e74f038629/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:05:39 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/001d589e-1bee-42da-8422-233ba796fbab/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:05:39 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/001d589e-1bee-42da-8422-233ba796fbab/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:05:39 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/001d589e-1bee-42da-8422-233ba796fbab/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:05:40 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/001d589e-1bee-42da-8422-233ba796fbab/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:05:40 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ad77a91-bc65-44a8-8ced-fd2ad9237946/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:05:40 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ad77a91-bc65-44a8-8ced-fd2ad9237946/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:05:40 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ad77a91-bc65-44a8-8ced-fd2ad9237946/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:05:40 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ad77a91-bc65-44a8-8ced-fd2ad9237946/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:05:40 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75122) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 10:05:40 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 10:05:40 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 10:05:40 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Hypervisor/Node resource view: name=user free_ram=8527MB free_disk=24.90991973876953GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75122) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 10:05:40 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:05:40 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:05:40 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance 001d589e-1bee-42da-8422-233ba796fbab actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 10:05:40 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance db848537-676f-464a-806d-febb14d920a6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 10:05:40 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance 9ad77a91-bc65-44a8-8ced-fd2ad9237946 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 10:05:40 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance 4c8b3a13-761f-4491-a367-64e74f038629 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 10:05:40 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance 5954fd91-94c6-4521-9465-1477c0e35f8d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 10:05:40 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=75122) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 10:05:40 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=75122) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 10:05:41 user nova-compute[75122]: DEBUG nova.compute.provider_tree [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Inventory has not changed in ProviderTree for provider: 69a3da65-47be-44c6-b67c-c692b58284ef {{(pid=75122) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 10:05:41 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Inventory has not changed for provider 69a3da65-47be-44c6-b67c-c692b58284ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 10:05:41 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Compute_service record updated for user:user {{(pid=75122) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 10:05:41 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.305s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:05:41 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:05:43 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:05:43 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:05:43 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:05:44 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:05:45 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:05:46 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:05:48 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:05:48 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:05:48 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Starting heal instance info cache {{(pid=75122) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 10:05:48 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:05:48 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "refresh_cache-db848537-676f-464a-806d-febb14d920a6" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 10:05:48 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquired lock "refresh_cache-db848537-676f-464a-806d-febb14d920a6" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 10:05:48 user nova-compute[75122]: DEBUG nova.network.neutron [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] [instance: db848537-676f-464a-806d-febb14d920a6] Forcefully refreshing network info cache for instance {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 10:05:48 user nova-compute[75122]: DEBUG nova.network.neutron [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] [instance: db848537-676f-464a-806d-febb14d920a6] Updating instance_info_cache with network_info: [{"id": "93bbff2d-1d5c-47db-b436-43796849be51", "address": "fa:16:3e:eb:e9:ca", "network": {"id": "b780d5c1-a549-4b49-a036-5a272697d4b6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-229344021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c046170a2ad44ebba5d2de236d940be0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93bbff2d-1d", "ovs_interfaceid": "93bbff2d-1d5c-47db-b436-43796849be51", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 10:05:48 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Releasing lock "refresh_cache-db848537-676f-464a-806d-febb14d920a6" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 10:05:48 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] [instance: db848537-676f-464a-806d-febb14d920a6] Updated the network info_cache for instance {{(pid=75122) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 10:05:48 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:05:48 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75122) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 10:05:51 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:05:53 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:05:56 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:05:58 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:05:58 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:06:03 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:06:03 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:06:03 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:06:03 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:06:03 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:06:03 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:06:03 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:06:03 user nova-compute[75122]: DEBUG nova.virt.libvirt.imagecache [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Verify base images {{(pid=75122) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Nov 15 10:06:03 user nova-compute[75122]: DEBUG nova.virt.libvirt.imagecache [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Image id 5e862cfe-47b8-4725-8292-65761ee6d0f5 yields fingerprint 95d6e29f74d5408f818e32f3bc29bc8270a4c665 {{(pid=75122) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 15 10:06:03 user nova-compute[75122]: INFO nova.virt.libvirt.imagecache [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] image 5e862cfe-47b8-4725-8292-65761ee6d0f5 at (/opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665): checking
Nov 15 10:06:03 user nova-compute[75122]: DEBUG nova.virt.libvirt.imagecache [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] image 5e862cfe-47b8-4725-8292-65761ee6d0f5 at (/opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665): image is in use {{(pid=75122) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Nov 15 10:06:03 user nova-compute[75122]: DEBUG nova.virt.libvirt.imagecache [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=75122) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 15 10:06:03 user nova-compute[75122]: DEBUG nova.virt.libvirt.imagecache [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] db848537-676f-464a-806d-febb14d920a6 is a valid instance name {{(pid=75122) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 15 10:06:03 user nova-compute[75122]: DEBUG nova.virt.libvirt.imagecache [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] 001d589e-1bee-42da-8422-233ba796fbab is a valid instance name {{(pid=75122) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 15 10:06:03 user nova-compute[75122]: DEBUG nova.virt.libvirt.imagecache [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] 001d589e-1bee-42da-8422-233ba796fbab has a disk file {{(pid=75122) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Nov 15 10:06:03 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/001d589e-1bee-42da-8422-233ba796fbab/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:06:03 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:06:03 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/001d589e-1bee-42da-8422-233ba796fbab/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:06:03 user nova-compute[75122]: DEBUG nova.virt.libvirt.imagecache [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance 001d589e-1bee-42da-8422-233ba796fbab is backed by 95d6e29f74d5408f818e32f3bc29bc8270a4c665 {{(pid=75122) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Nov 15 10:06:03 user nova-compute[75122]: DEBUG nova.virt.libvirt.imagecache [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] 4c8b3a13-761f-4491-a367-64e74f038629 is a valid instance name {{(pid=75122) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 15 10:06:03 user nova-compute[75122]: DEBUG nova.virt.libvirt.imagecache [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] 4c8b3a13-761f-4491-a367-64e74f038629 has a disk file {{(pid=75122) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Nov 15 10:06:03 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c8b3a13-761f-4491-a367-64e74f038629/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:06:03 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c8b3a13-761f-4491-a367-64e74f038629/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:06:03 user nova-compute[75122]: DEBUG nova.virt.libvirt.imagecache [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance 4c8b3a13-761f-4491-a367-64e74f038629 is backed by 95d6e29f74d5408f818e32f3bc29bc8270a4c665 {{(pid=75122) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Nov 15 10:06:03 user nova-compute[75122]: DEBUG nova.virt.libvirt.imagecache [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] 9ad77a91-bc65-44a8-8ced-fd2ad9237946 is a valid instance name {{(pid=75122) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 15 10:06:03 user nova-compute[75122]: DEBUG nova.virt.libvirt.imagecache [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] 9ad77a91-bc65-44a8-8ced-fd2ad9237946 has a disk file {{(pid=75122) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Nov 15 10:06:03 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ad77a91-bc65-44a8-8ced-fd2ad9237946/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:06:03 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ad77a91-bc65-44a8-8ced-fd2ad9237946/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:06:03 user nova-compute[75122]: DEBUG nova.virt.libvirt.imagecache [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance 9ad77a91-bc65-44a8-8ced-fd2ad9237946 is backed by 95d6e29f74d5408f818e32f3bc29bc8270a4c665 {{(pid=75122) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Nov 15 10:06:03 user nova-compute[75122]: DEBUG nova.virt.libvirt.imagecache [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] 5954fd91-94c6-4521-9465-1477c0e35f8d is a valid instance name {{(pid=75122) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 15 10:06:03 user nova-compute[75122]: WARNING nova.virt.libvirt.imagecache [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Unknown base file: /opt/stack/data/nova/instances/_base/c477712bb5f1028349d55ba6416b688cbe21f00e
Nov 15 10:06:03 user nova-compute[75122]: WARNING nova.virt.libvirt.imagecache [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Unknown base file: /opt/stack/data/nova/instances/_base/10a93c75ac3f14f0dc2199b857b9a5aeae83d8c0
Nov 15 10:06:03 user nova-compute[75122]: WARNING nova.virt.libvirt.imagecache [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Unknown base file: /opt/stack/data/nova/instances/_base/0074bdc91483d34219af75dab5bc825f3f26328d
Nov 15 10:06:03 user nova-compute[75122]: WARNING nova.virt.libvirt.imagecache [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Unknown base file: /opt/stack/data/nova/instances/_base/c64d264fe623cc813627b08607eea20c64f5f0cc
Nov 15 10:06:03 user nova-compute[75122]: WARNING nova.virt.libvirt.imagecache [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Unknown base file: /opt/stack/data/nova/instances/_base/d0c596623ad7a7d7aeed895499cfae51405fcbde
Nov 15 10:06:03 user nova-compute[75122]: WARNING nova.virt.libvirt.imagecache [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Unknown base file: /opt/stack/data/nova/instances/_base/bd08f74a930a151a3dc56141e9442c690ebe8595
Nov 15 10:06:03 user nova-compute[75122]: WARNING nova.virt.libvirt.imagecache [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Unknown base file: /opt/stack/data/nova/instances/_base/ddd182cf2629c3be359fb82f9ee75c26505567bb
Nov 15 10:06:03 user nova-compute[75122]: INFO nova.virt.libvirt.imagecache [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Active base files: /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665
Nov 15 10:06:03 user nova-compute[75122]: INFO nova.virt.libvirt.imagecache [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Removable base files: /opt/stack/data/nova/instances/_base/c477712bb5f1028349d55ba6416b688cbe21f00e /opt/stack/data/nova/instances/_base/10a93c75ac3f14f0dc2199b857b9a5aeae83d8c0 /opt/stack/data/nova/instances/_base/0074bdc91483d34219af75dab5bc825f3f26328d /opt/stack/data/nova/instances/_base/c64d264fe623cc813627b08607eea20c64f5f0cc /opt/stack/data/nova/instances/_base/d0c596623ad7a7d7aeed895499cfae51405fcbde /opt/stack/data/nova/instances/_base/bd08f74a930a151a3dc56141e9442c690ebe8595 /opt/stack/data/nova/instances/_base/ddd182cf2629c3be359fb82f9ee75c26505567bb
Nov 15 10:06:03 user nova-compute[75122]: INFO nova.virt.libvirt.imagecache [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/c477712bb5f1028349d55ba6416b688cbe21f00e
Nov 15 10:06:03 user nova-compute[75122]: INFO nova.virt.libvirt.imagecache [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/10a93c75ac3f14f0dc2199b857b9a5aeae83d8c0
Nov 15 10:06:03 user nova-compute[75122]: INFO nova.virt.libvirt.imagecache [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/0074bdc91483d34219af75dab5bc825f3f26328d
Nov 15 10:06:03 user nova-compute[75122]: INFO nova.virt.libvirt.imagecache [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/c64d264fe623cc813627b08607eea20c64f5f0cc
Nov 15 10:06:03 user nova-compute[75122]: INFO nova.virt.libvirt.imagecache [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/d0c596623ad7a7d7aeed895499cfae51405fcbde
Nov 15 10:06:03 user nova-compute[75122]: INFO nova.virt.libvirt.imagecache [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/bd08f74a930a151a3dc56141e9442c690ebe8595
Nov 15 10:06:03 user nova-compute[75122]: INFO nova.virt.libvirt.imagecache [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/ddd182cf2629c3be359fb82f9ee75c26505567bb
Nov 15 10:06:03 user nova-compute[75122]: DEBUG nova.virt.libvirt.imagecache [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Verification complete {{(pid=75122) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Nov 15 10:06:03 user nova-compute[75122]: DEBUG nova.virt.libvirt.imagecache [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Verify swap images {{(pid=75122) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Nov 15 10:06:03 user nova-compute[75122]: DEBUG nova.virt.libvirt.imagecache [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Verify ephemeral images {{(pid=75122) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Nov 15 10:06:04 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-ce746fca-714e-4287-99d2-4bf0b4528c15 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Acquiring lock "50aef80d-eff3-437a-8bee-b041e49b463e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:06:04 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-ce746fca-714e-4287-99d2-4bf0b4528c15 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Lock "50aef80d-eff3-437a-8bee-b041e49b463e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:06:04 user nova-compute[75122]: DEBUG nova.compute.manager [None req-ce746fca-714e-4287-99d2-4bf0b4528c15 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 50aef80d-eff3-437a-8bee-b041e49b463e] Starting instance... {{(pid=75122) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 10:06:04 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-ce746fca-714e-4287-99d2-4bf0b4528c15 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:06:04 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-ce746fca-714e-4287-99d2-4bf0b4528c15 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:06:05 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-ce746fca-714e-4287-99d2-4bf0b4528c15 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75122) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 10:06:05 user nova-compute[75122]: INFO nova.compute.claims [None req-ce746fca-714e-4287-99d2-4bf0b4528c15 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 50aef80d-eff3-437a-8bee-b041e49b463e] Claim successful on node user
Nov 15 10:06:05 user nova-compute[75122]: DEBUG nova.compute.provider_tree [None req-ce746fca-714e-4287-99d2-4bf0b4528c15 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Inventory has not changed in ProviderTree for provider: 69a3da65-47be-44c6-b67c-c692b58284ef {{(pid=75122) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 10:06:05 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-ce746fca-714e-4287-99d2-4bf0b4528c15 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Inventory has not changed for provider 69a3da65-47be-44c6-b67c-c692b58284ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 10:06:05 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-ce746fca-714e-4287-99d2-4bf0b4528c15 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.333s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:06:05 user nova-compute[75122]: DEBUG nova.compute.manager [None req-ce746fca-714e-4287-99d2-4bf0b4528c15 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 50aef80d-eff3-437a-8bee-b041e49b463e] Start building networks asynchronously for instance. {{(pid=75122) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 10:06:05 user nova-compute[75122]: DEBUG nova.compute.manager [None req-ce746fca-714e-4287-99d2-4bf0b4528c15 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 50aef80d-eff3-437a-8bee-b041e49b463e] Allocating IP information in the background. {{(pid=75122) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 10:06:05 user nova-compute[75122]: DEBUG nova.network.neutron [None req-ce746fca-714e-4287-99d2-4bf0b4528c15 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 50aef80d-eff3-437a-8bee-b041e49b463e] allocate_for_instance() {{(pid=75122) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 10:06:05 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-ce746fca-714e-4287-99d2-4bf0b4528c15 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 50aef80d-eff3-437a-8bee-b041e49b463e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 10:06:05 user nova-compute[75122]: DEBUG nova.compute.manager [None req-ce746fca-714e-4287-99d2-4bf0b4528c15 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 50aef80d-eff3-437a-8bee-b041e49b463e] Start building block device mappings for instance. {{(pid=75122) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 10:06:05 user nova-compute[75122]: DEBUG nova.policy [None req-ce746fca-714e-4287-99d2-4bf0b4528c15 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '00f5cc88e43c434c8a061dcec472a16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7941f36c30b49408ae5709a1b75346d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75122) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 10:06:05 user nova-compute[75122]: INFO nova.virt.block_device [None req-ce746fca-714e-4287-99d2-4bf0b4528c15 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 50aef80d-eff3-437a-8bee-b041e49b463e] Booting with volume 59ca9506-19c1-4a17-a495-28601cdadf8b at /dev/vda
Nov 15 10:06:05 user nova-compute[75122]: DEBUG os_brick.utils [None req-ce746fca-714e-4287-99d2-4bf0b4528c15 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 10:06:05 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:06:05 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:06:05 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[2069c2c9-6a20-49be-a33d-e9633a426416]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:742fb64b3587\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:06:05 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:06:05 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:06:05 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fb2d01e-83f4-4f32-a05c-395959478b12]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:06:05 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:06:05 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:06:05 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad559758-f0f3-4dfd-abf6-23e14d5eec01]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:06:05 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc6855a0-421d-417f-9845-b00dff6d676e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:06:05 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-ce746fca-714e-4287-99d2-4bf0b4528c15 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Running cmd (subprocess): nvme version {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:06:05 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-ce746fca-714e-4287-99d2-4bf0b4528c15 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] 'nvme version' failed. Not Retrying. {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 10:06:05 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ce746fca-714e-4287-99d2-4bf0b4528c15 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] nvme not present on system {{(pid=75122) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 10:06:05 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:06:05 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 10:06:05 user nova-compute[75122]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 10:06:05 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c9f630d-a80b-4f3e-a1ad-cc5316f7dd98]: (4, '') {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:06:05 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.lightos [None req-ce746fca-714e-4287-99d2-4bf0b4528c15 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75122) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 10:06:05 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.lightos [None req-ce746fca-714e-4287-99d2-4bf0b4528c15 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75122) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 10:06:05 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.lightos [None req-ce746fca-714e-4287-99d2-4bf0b4528c15 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] LIGHTOS: no hostnqn found. {{(pid=75122) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 10:06:05 user nova-compute[75122]: DEBUG os_brick.utils [None req-ce746fca-714e-4287-99d2-4bf0b4528c15 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:742fb64b3587', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 10:06:05 user nova-compute[75122]: DEBUG nova.virt.block_device [None req-ce746fca-714e-4287-99d2-4bf0b4528c15 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 50aef80d-eff3-437a-8bee-b041e49b463e] Updating existing volume attachment record: b080adc1-3da2-4b1d-9935-ea24e02b3d54 {{(pid=75122) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 10:06:06 user nova-compute[75122]: DEBUG nova.network.neutron [None req-ce746fca-714e-4287-99d2-4bf0b4528c15 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 50aef80d-eff3-437a-8bee-b041e49b463e] Successfully created port: baef0235-e700-4ba9-b048-ec663bf64a37 {{(pid=75122) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 10:06:06 user nova-compute[75122]: DEBUG nova.network.neutron [None req-ce746fca-714e-4287-99d2-4bf0b4528c15 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 50aef80d-eff3-437a-8bee-b041e49b463e] Successfully updated port: baef0235-e700-4ba9-b048-ec663bf64a37 {{(pid=75122) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 10:06:06 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-ce746fca-714e-4287-99d2-4bf0b4528c15 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Acquiring lock "refresh_cache-50aef80d-eff3-437a-8bee-b041e49b463e" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 10:06:06 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-ce746fca-714e-4287-99d2-4bf0b4528c15 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Acquired lock "refresh_cache-50aef80d-eff3-437a-8bee-b041e49b463e" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 10:06:06 user nova-compute[75122]: DEBUG nova.network.neutron [None req-ce746fca-714e-4287-99d2-4bf0b4528c15 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 50aef80d-eff3-437a-8bee-b041e49b463e] Building network info cache for instance {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 10:06:06 user nova-compute[75122]: DEBUG nova.compute.manager [req-e51b2e88-804c-4823-9504-a21dfdf3a21a req-9a03c0fe-1e80-4d6c-a5e6-24977adfa959 service nova] [instance: 50aef80d-eff3-437a-8bee-b041e49b463e] Received event network-changed-baef0235-e700-4ba9-b048-ec663bf64a37 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 10:06:06 user nova-compute[75122]: DEBUG nova.compute.manager [req-e51b2e88-804c-4823-9504-a21dfdf3a21a req-9a03c0fe-1e80-4d6c-a5e6-24977adfa959 service nova] [instance: 50aef80d-eff3-437a-8bee-b041e49b463e] Refreshing instance network info cache due to event network-changed-baef0235-e700-4ba9-b048-ec663bf64a37. {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 10:06:06 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-e51b2e88-804c-4823-9504-a21dfdf3a21a req-9a03c0fe-1e80-4d6c-a5e6-24977adfa959 service nova] Acquiring lock "refresh_cache-50aef80d-eff3-437a-8bee-b041e49b463e" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 10:06:06 user nova-compute[75122]: DEBUG nova.network.neutron [None req-ce746fca-714e-4287-99d2-4bf0b4528c15 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 50aef80d-eff3-437a-8bee-b041e49b463e] Instance cache missing network info. {{(pid=75122) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 10:06:07 user nova-compute[75122]: DEBUG nova.network.neutron [None req-ce746fca-714e-4287-99d2-4bf0b4528c15 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 50aef80d-eff3-437a-8bee-b041e49b463e] Updating instance_info_cache with network_info: [{"id": "baef0235-e700-4ba9-b048-ec663bf64a37", "address": "fa:16:3e:f0:a0:d3", "network": {"id": "03073971-5253-4f06-a46a-94840841fd6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2056706757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7941f36c30b49408ae5709a1b75346d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbaef0235-e7", "ovs_interfaceid": "baef0235-e700-4ba9-b048-ec663bf64a37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 10:06:07 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-ce746fca-714e-4287-99d2-4bf0b4528c15 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Releasing lock "refresh_cache-50aef80d-eff3-437a-8bee-b041e49b463e" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 10:06:07 user nova-compute[75122]: DEBUG nova.compute.manager [None req-ce746fca-714e-4287-99d2-4bf0b4528c15 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 50aef80d-eff3-437a-8bee-b041e49b463e] Instance network_info: |[{"id": "baef0235-e700-4ba9-b048-ec663bf64a37", "address": "fa:16:3e:f0:a0:d3", "network": {"id": "03073971-5253-4f06-a46a-94840841fd6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2056706757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7941f36c30b49408ae5709a1b75346d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbaef0235-e7", "ovs_interfaceid": "baef0235-e700-4ba9-b048-ec663bf64a37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75122) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 10:06:07 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-e51b2e88-804c-4823-9504-a21dfdf3a21a req-9a03c0fe-1e80-4d6c-a5e6-24977adfa959 service nova] Acquired lock "refresh_cache-50aef80d-eff3-437a-8bee-b041e49b463e" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 10:06:07 user nova-compute[75122]: DEBUG nova.network.neutron [req-e51b2e88-804c-4823-9504-a21dfdf3a21a req-9a03c0fe-1e80-4d6c-a5e6-24977adfa959 service nova] [instance: 50aef80d-eff3-437a-8bee-b041e49b463e] Refreshing network info cache for port baef0235-e700-4ba9-b048-ec663bf64a37 {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 10:06:07 user nova-compute[75122]: DEBUG nova.network.neutron [req-e51b2e88-804c-4823-9504-a21dfdf3a21a req-9a03c0fe-1e80-4d6c-a5e6-24977adfa959 service nova] [instance: 50aef80d-eff3-437a-8bee-b041e49b463e] Updated VIF entry in instance network info cache for port baef0235-e700-4ba9-b048-ec663bf64a37. {{(pid=75122) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 10:06:07 user nova-compute[75122]: DEBUG nova.network.neutron [req-e51b2e88-804c-4823-9504-a21dfdf3a21a req-9a03c0fe-1e80-4d6c-a5e6-24977adfa959 service nova] [instance: 50aef80d-eff3-437a-8bee-b041e49b463e] Updating instance_info_cache with network_info: [{"id": "baef0235-e700-4ba9-b048-ec663bf64a37", "address": "fa:16:3e:f0:a0:d3", "network": {"id": "03073971-5253-4f06-a46a-94840841fd6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2056706757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7941f36c30b49408ae5709a1b75346d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbaef0235-e7", "ovs_interfaceid": "baef0235-e700-4ba9-b048-ec663bf64a37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 10:06:07 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-e51b2e88-804c-4823-9504-a21dfdf3a21a req-9a03c0fe-1e80-4d6c-a5e6-24977adfa959 service nova] Releasing lock "refresh_cache-50aef80d-eff3-437a-8bee-b041e49b463e" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 10:06:08 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:06:10 user nova-compute[75122]: DEBUG nova.compute.manager [None req-ce746fca-714e-4287-99d2-4bf0b4528c15 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 50aef80d-eff3-437a-8bee-b041e49b463e] Start spawning the instance on the hypervisor. {{(pid=75122) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 10:06:10 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-ce746fca-714e-4287-99d2-4bf0b4528c15 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 50aef80d-eff3-437a-8bee-b041e49b463e] Creating instance directory {{(pid=75122) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 10:06:10 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-ce746fca-714e-4287-99d2-4bf0b4528c15 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 50aef80d-eff3-437a-8bee-b041e49b463e] Creating image(s)
Nov 15 10:06:10 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-ce746fca-714e-4287-99d2-4bf0b4528c15 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 50aef80d-eff3-437a-8bee-b041e49b463e] Did not create local disks {{(pid=75122) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 10:06:10 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-ce746fca-714e-4287-99d2-4bf0b4528c15 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 50aef80d-eff3-437a-8bee-b041e49b463e] Ensure instance console log exists: /opt/stack/data/nova/instances/50aef80d-eff3-437a-8bee-b041e49b463e/console.log {{(pid=75122) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 10:06:10 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-ce746fca-714e-4287-99d2-4bf0b4528c15 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:06:10 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-ce746fca-714e-4287-99d2-4bf0b4528c15 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:06:10 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-ce746fca-714e-4287-99d2-4bf0b4528c15 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:06:10 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-ce746fca-714e-4287-99d2-4bf0b4528c15 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 50aef80d-eff3-437a-8bee-b041e49b463e] Start _get_guest_xml network_info=[{"id": "baef0235-e700-4ba9-b048-ec663bf64a37", "address": "fa:16:3e:f0:a0:d3", "network": {"id": "03073971-5253-4f06-a46a-94840841fd6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2056706757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7941f36c30b49408ae5709a1b75346d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbaef0235-e7", "ovs_interfaceid": "baef0235-e700-4ba9-b048-ec663bf64a37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:59ca9506-19c1-4a17-a495-28601cdadf8b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bYFsTknz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '50aef80d-eff3-437a-8bee-b041e49b463e', 'attached_at': '', 'detached_at': '', 'volume_id': '59ca9506-19c1-4a17-a495-28601cdadf8b', 'serial': '59ca9506-19c1-4a17-a495-28601cdadf8b'}, 'guest_format': None, 'delete_on_termination': False, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vda', 'attachment_id': 'b080adc1-3da2-4b1d-9935-ea24e02b3d54', 'volume_type': None} {{(pid=75122) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 10:06:10 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-ce746fca-714e-4287-99d2-4bf0b4528c15 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 10:06:10 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-ce746fca-714e-4287-99d2-4bf0b4528c15 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 10:06:10 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-ce746fca-714e-4287-99d2-4bf0b4528c15 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75122) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 10:06:10 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-ce746fca-714e-4287-99d2-4bf0b4528c15 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] CPU controller missing on host. {{(pid=75122) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 10:06:10 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-ce746fca-714e-4287-99d2-4bf0b4528c15 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75122) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 10:06:10 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-ce746fca-714e-4287-99d2-4bf0b4528c15 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] CPU controller found on host. {{(pid=75122) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 10:06:10 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-ce746fca-714e-4287-99d2-4bf0b4528c15 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75122) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 10:06:10 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-ce746fca-714e-4287-99d2-4bf0b4528c15 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T09:26:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 10:06:10 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-ce746fca-714e-4287-99d2-4bf0b4528c15 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Flavor limits 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 10:06:10 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-ce746fca-714e-4287-99d2-4bf0b4528c15 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Image limits 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 10:06:10 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-ce746fca-714e-4287-99d2-4bf0b4528c15 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Flavor pref 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 10:06:10 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-ce746fca-714e-4287-99d2-4bf0b4528c15 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Image pref 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 10:06:10 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-ce746fca-714e-4287-99d2-4bf0b4528c15 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 10:06:10 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-ce746fca-714e-4287-99d2-4bf0b4528c15 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 10:06:10 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-ce746fca-714e-4287-99d2-4bf0b4528c15 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75122) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 10:06:10 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-ce746fca-714e-4287-99d2-4bf0b4528c15 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Got 1 possible topologies {{(pid=75122) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 10:06:10 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-ce746fca-714e-4287-99d2-4bf0b4528c15 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 10:06:10 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-ce746fca-714e-4287-99d2-4bf0b4528c15 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 10:06:10 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ce746fca-714e-4287-99d2-4bf0b4528c15 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 50aef80d-eff3-437a-8bee-b041e49b463e] Calling os-brick to attach iSCSI Volume {{(pid=75122) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 10:06:10 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce746fca-714e-4287-99d2-4bf0b4528c15 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffa04060b80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:59ca9506-19c1-4a17-a495-28601cdadf8b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bYFsTknz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 10:06:10 user nova-compute[75122]: WARNING os_brick.initiator.connectors.base [None req-ce746fca-714e-4287-99d2-4bf0b4528c15 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 10:06:10 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-ce746fca-714e-4287-99d2-4bf0b4528c15 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 10:06:10 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-ce746fca-714e-4287-99d2-4bf0b4528c15 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 10:06:10 user nova-compute[75122]: WARNING os_brick.initiator.connectors.base [None req-ce746fca-714e-4287-99d2-4bf0b4528c15 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 10:06:10 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-ce746fca-714e-4287-99d2-4bf0b4528c15 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:59ca9506-19c1-4a17-a495-28601cdadf8b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 10:06:10 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-ce746fca-714e-4287-99d2-4bf0b4528c15 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:59ca9506-19c1-4a17-a495-28601cdadf8b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 10:06:10 user nova-compute[75122]: INFO os_brick.initiator.connectors.iscsi [None req-ce746fca-714e-4287-99d2-4bf0b4528c15 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 10:06:10 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59ca9506-19c1-4a17-a495-28601cdadf8b -p 172.16.0.220:3260 {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:06:10 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59ca9506-19c1-4a17-a495-28601cdadf8b -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:06:10 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[86352fad-257d-436d-896d-fc6152bc8f98]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:06:10 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce746fca-714e-4287-99d2-4bf0b4528c15 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 10:06:10 user nova-compute[75122]:  {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 10:06:10 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59ca9506-19c1-4a17-a495-28601cdadf8b -p 172.16.0.220:3260 --interface default --op new {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:06:10 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59ca9506-19c1-4a17-a495-28601cdadf8b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:06:10 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[84f707ef-7d99-467b-9537-be996d97838e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:59ca9506-19c1-4a17-a495-28601cdadf8b] added\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:06:10 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce746fca-714e-4287-99d2-4bf0b4528c15 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:59ca9506-19c1-4a17-a495-28601cdadf8b] added
Nov 15 10:06:10 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 10:06:10 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59ca9506-19c1-4a17-a495-28601cdadf8b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:06:10 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59ca9506-19c1-4a17-a495-28601cdadf8b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:06:10 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed86b915-878e-44ed-9222-09ac0b804a79]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:06:10 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce746fca-714e-4287-99d2-4bf0b4528c15 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 10:06:10 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59ca9506-19c1-4a17-a495-28601cdadf8b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:06:10 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59ca9506-19c1-4a17-a495-28601cdadf8b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:06:10 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4a9b099-a4b8-42a5-aecd-baab70fa5482]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:06:10 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce746fca-714e-4287-99d2-4bf0b4528c15 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 10:06:10 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59ca9506-19c1-4a17-a495-28601cdadf8b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bYFsTknz {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:06:10 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59ca9506-19c1-4a17-a495-28601cdadf8b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bYFsTknz" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:06:10 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[e567f087-3281-419f-9f58-02b6a7bcefb2]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:06:10 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce746fca-714e-4287-99d2-4bf0b4528c15 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bYFsTknz'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 10:06:10 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59ca9506-19c1-4a17-a495-28601cdadf8b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:06:10 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59ca9506-19c1-4a17-a495-28601cdadf8b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:06:10 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a413e9b-ded8-4fc4-930a-77c9f1d59f71]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:06:10 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce746fca-714e-4287-99d2-4bf0b4528c15 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 10:06:10 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:06:10 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:06:10 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[339a3a8b-dbe3-43e1-9841-f48095932038]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee79db2-27c2-4d0f-8ee6-5b03e05ebba5 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11d2deb7-c652-48e3-ae06-5557c9bef981 (non-flash)\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:06:10 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce746fca-714e-4287-99d2-4bf0b4528c15 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee79db2-27c2-4d0f-8ee6-5b03e05ebba5 (non-flash)
Nov 15 10:06:10 user nova-compute[75122]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11d2deb7-c652-48e3-ae06-5557c9bef981 (non-flash)
Nov 15 10:06:10 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 10:06:10 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce746fca-714e-4287-99d2-4bf0b4528c15 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee79db2-27c2-4d0f-8ee6-5b03e05ebba5 (non-flash)
Nov 15 10:06:10 user nova-compute[75122]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11d2deb7-c652-48e3-ae06-5557c9bef981 (non-flash)
Nov 15 10:06:10 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 10:06:10 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59ca9506-19c1-4a17-a495-28601cdadf8b -p 172.16.0.220:3260 --login {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:06:10 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59ca9506-19c1-4a17-a495-28601cdadf8b -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:06:10 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3ca1e64-a6c4-445f-b678-1f38d8a684e1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:59ca9506-19c1-4a17-a495-28601cdadf8b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:59ca9506-19c1-4a17-a495-28601cdadf8b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:06:10 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce746fca-714e-4287-99d2-4bf0b4528c15 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:59ca9506-19c1-4a17-a495-28601cdadf8b, portal: 172.16.0.220,3260]
Nov 15 10:06:10 user nova-compute[75122]: Login to [iface: default, target: iqn.2010-10.org.openstack:59ca9506-19c1-4a17-a495-28601cdadf8b, portal: 172.16.0.220,3260] successful.
Nov 15 10:06:10 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 10:06:10 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59ca9506-19c1-4a17-a495-28601cdadf8b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:06:10 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59ca9506-19c1-4a17-a495-28601cdadf8b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:06:10 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[416fc5b2-9d6e-4978-af58-435573095ad3]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:06:10 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce746fca-714e-4287-99d2-4bf0b4528c15 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 10:06:10 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:06:10 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:06:10 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[f774f367-4014-42a5-9076-2332f95fe361]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee79db2-27c2-4d0f-8ee6-5b03e05ebba5 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11d2deb7-c652-48e3-ae06-5557c9bef981 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59ca9506-19c1-4a17-a495-28601cdadf8b (non-flash)\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:06:10 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce746fca-714e-4287-99d2-4bf0b4528c15 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee79db2-27c2-4d0f-8ee6-5b03e05ebba5 (non-flash)
Nov 15 10:06:10 user nova-compute[75122]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11d2deb7-c652-48e3-ae06-5557c9bef981 (non-flash)
Nov 15 10:06:10 user nova-compute[75122]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59ca9506-19c1-4a17-a495-28601cdadf8b (non-flash)
Nov 15 10:06:10 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 10:06:10 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce746fca-714e-4287-99d2-4bf0b4528c15 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee79db2-27c2-4d0f-8ee6-5b03e05ebba5 (non-flash)
Nov 15 10:06:10 user nova-compute[75122]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11d2deb7-c652-48e3-ae06-5557c9bef981 (non-flash)
Nov 15 10:06:10 user nova-compute[75122]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59ca9506-19c1-4a17-a495-28601cdadf8b (non-flash)
Nov 15 10:06:10 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 10:06:10 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-ce746fca-714e-4287-99d2-4bf0b4528c15 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:59ca9506-19c1-4a17-a495-28601cdadf8b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.263s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 10:06:10 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce746fca-714e-4287-99d2-4bf0b4528c15 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Connected to 172.16.0.220:3260 {{(pid=75122) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 10:06:10 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-ce746fca-714e-4287-99d2-4bf0b4528c15 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] HCTL ('34', '-', '-', 0) found on session 56 with lun 0 {{(pid=75122) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 10:06:10 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-ce746fca-714e-4287-99d2-4bf0b4528c15 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75122) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 10:06:10 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:06:10 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:06:10 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[87204a3c-df20-49e6-afd2-b401dbc05c95]: (4, ('- - 0', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:06:10 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-ce746fca-714e-4287-99d2-4bf0b4528c15 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Searching for a device in session 56 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75122) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 10:06:10 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce746fca-714e-4287-99d2-4bf0b4528c15 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:59ca9506-19c1-4a17-a495-28601cdadf8b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bYFsTknz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75122) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 10:06:11 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-ce746fca-714e-4287-99d2-4bf0b4528c15 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.294s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 10:06:11 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce746fca-714e-4287-99d2-4bf0b4528c15 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] <== connect_volume: return (1296ms) {'type': 'block', 'scsi_wwn': '23664656631313830', 'path': '/dev/sdc'} {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 10:06:11 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ce746fca-714e-4287-99d2-4bf0b4528c15 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 50aef80d-eff3-437a-8bee-b041e49b463e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23664656631313830', 'path': '/dev/sdc'} {{(pid=75122) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 10:06:11 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-ce746fca-714e-4287-99d2-4bf0b4528c15 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T10:06:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1773217522',display_name='tempest-TestVolumeBootPattern-server-1773217522',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1773217522',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKHlpBGjgQO8WCWtscnQGPLWQNzcwgXW54O9CXzl/Z/CZ497o/Fb/9rP8/a86D2H+G6HyOK+OZYAd3QjjsdbXOlrlce1txRdWXFLkzlkbTs2rp1mYOku0vjKWQDJeaVaVQ==',key_name='tempest-TestVolumeBootPattern-2035754115',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c7941f36c30b49408ae5709a1b75346d',ramdisk_id='',reservation_id='r-rqn6uuq3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-296749341',owner_user_name='tempest-TestVolumeBootPattern-296749341-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T10:06:05Z,user_data=None,user_id='00f5cc88e43c434c8a061dcec472a16b',uuid=50aef80d-eff3-437a-8bee-b041e49b463e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "baef0235-e700-4ba9-b048-ec663bf64a37", "address": "fa:16:3e:f0:a0:d3", "network": {"id": "03073971-5253-4f06-a46a-94840841fd6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2056706757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7941f36c30b49408ae5709a1b75346d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbaef0235-e7", "ovs_interfaceid": "baef0235-e700-4ba9-b048-ec663bf64a37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75122) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 10:06:11 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-ce746fca-714e-4287-99d2-4bf0b4528c15 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Converting VIF {"id": "baef0235-e700-4ba9-b048-ec663bf64a37", "address": "fa:16:3e:f0:a0:d3", "network": {"id": "03073971-5253-4f06-a46a-94840841fd6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2056706757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7941f36c30b49408ae5709a1b75346d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbaef0235-e7", "ovs_interfaceid": "baef0235-e700-4ba9-b048-ec663bf64a37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 10:06:11 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-ce746fca-714e-4287-99d2-4bf0b4528c15 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:a0:d3,bridge_name='br-int',has_traffic_filtering=True,id=baef0235-e700-4ba9-b048-ec663bf64a37,network=Network(03073971-5253-4f06-a46a-94840841fd6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbaef0235-e7') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 10:06:11 user nova-compute[75122]: DEBUG nova.objects.instance [None req-ce746fca-714e-4287-99d2-4bf0b4528c15 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Lazy-loading 'pci_devices' on Instance uuid 50aef80d-eff3-437a-8bee-b041e49b463e {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 10:06:11 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-ce746fca-714e-4287-99d2-4bf0b4528c15 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 50aef80d-eff3-437a-8bee-b041e49b463e] End _get_guest_xml xml=<domain type="kvm">
Nov 15 10:06:11 user nova-compute[75122]:   <uuid>50aef80d-eff3-437a-8bee-b041e49b463e</uuid>
Nov 15 10:06:11 user nova-compute[75122]:   <name>instance-0000002f</name>
Nov 15 10:06:11 user nova-compute[75122]:   <memory>524288</memory>
Nov 15 10:06:11 user nova-compute[75122]:   <vcpu>1</vcpu>
Nov 15 10:06:11 user nova-compute[75122]:   <metadata>
Nov 15 10:06:11 user nova-compute[75122]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 10:06:11 user nova-compute[75122]:       <nova:package version="0.0.0"/>
Nov 15 10:06:11 user nova-compute[75122]:       <nova:name>tempest-TestVolumeBootPattern-server-1773217522</nova:name>
Nov 15 10:06:11 user nova-compute[75122]:       <nova:creationTime>2023-11-15 10:06:10</nova:creationTime>
Nov 15 10:06:11 user nova-compute[75122]:       <nova:flavor name="m1.tiny">
Nov 15 10:06:11 user nova-compute[75122]:         <nova:memory>512</nova:memory>
Nov 15 10:06:11 user nova-compute[75122]:         <nova:disk>1</nova:disk>
Nov 15 10:06:11 user nova-compute[75122]:         <nova:swap>0</nova:swap>
Nov 15 10:06:11 user nova-compute[75122]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 10:06:11 user nova-compute[75122]:         <nova:vcpus>1</nova:vcpus>
Nov 15 10:06:11 user nova-compute[75122]:       </nova:flavor>
Nov 15 10:06:11 user nova-compute[75122]:       <nova:owner>
Nov 15 10:06:11 user nova-compute[75122]:         <nova:user uuid="00f5cc88e43c434c8a061dcec472a16b">tempest-TestVolumeBootPattern-296749341-project-member</nova:user>
Nov 15 10:06:11 user nova-compute[75122]:         <nova:project uuid="c7941f36c30b49408ae5709a1b75346d">tempest-TestVolumeBootPattern-296749341</nova:project>
Nov 15 10:06:11 user nova-compute[75122]:       </nova:owner>
Nov 15 10:06:11 user nova-compute[75122]:       <nova:ports>
Nov 15 10:06:11 user nova-compute[75122]:         <nova:port uuid="baef0235-e700-4ba9-b048-ec663bf64a37">
Nov 15 10:06:11 user nova-compute[75122]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 15 10:06:11 user nova-compute[75122]:         </nova:port>
Nov 15 10:06:11 user nova-compute[75122]:       </nova:ports>
Nov 15 10:06:11 user nova-compute[75122]:     </nova:instance>
Nov 15 10:06:11 user nova-compute[75122]:   </metadata>
Nov 15 10:06:11 user nova-compute[75122]:   <sysinfo type="smbios">
Nov 15 10:06:11 user nova-compute[75122]:     <system>
Nov 15 10:06:11 user nova-compute[75122]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 10:06:11 user nova-compute[75122]:       <entry name="product">OpenStack Nova</entry>
Nov 15 10:06:11 user nova-compute[75122]:       <entry name="version">0.0.0</entry>
Nov 15 10:06:11 user nova-compute[75122]:       <entry name="serial">50aef80d-eff3-437a-8bee-b041e49b463e</entry>
Nov 15 10:06:11 user nova-compute[75122]:       <entry name="uuid">50aef80d-eff3-437a-8bee-b041e49b463e</entry>
Nov 15 10:06:11 user nova-compute[75122]:       <entry name="family">Virtual Machine</entry>
Nov 15 10:06:11 user nova-compute[75122]:     </system>
Nov 15 10:06:11 user nova-compute[75122]:   </sysinfo>
Nov 15 10:06:11 user nova-compute[75122]:   <os>
Nov 15 10:06:11 user nova-compute[75122]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 10:06:11 user nova-compute[75122]:     <boot dev="hd"/>
Nov 15 10:06:11 user nova-compute[75122]:     <smbios mode="sysinfo"/>
Nov 15 10:06:11 user nova-compute[75122]:   </os>
Nov 15 10:06:11 user nova-compute[75122]:   <features>
Nov 15 10:06:11 user nova-compute[75122]:     <acpi/>
Nov 15 10:06:11 user nova-compute[75122]:     <apic/>
Nov 15 10:06:11 user nova-compute[75122]:     <vmcoreinfo/>
Nov 15 10:06:11 user nova-compute[75122]:   </features>
Nov 15 10:06:11 user nova-compute[75122]:   <clock offset="utc">
Nov 15 10:06:11 user nova-compute[75122]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 10:06:11 user nova-compute[75122]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 10:06:11 user nova-compute[75122]:     <timer name="hpet" present="no"/>
Nov 15 10:06:11 user nova-compute[75122]:   </clock>
Nov 15 10:06:11 user nova-compute[75122]:   <cpu mode="custom" match="exact">
Nov 15 10:06:11 user nova-compute[75122]:     <model>Nehalem</model>
Nov 15 10:06:11 user nova-compute[75122]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 10:06:11 user nova-compute[75122]:   </cpu>
Nov 15 10:06:11 user nova-compute[75122]:   <devices>
Nov 15 10:06:11 user nova-compute[75122]:     <disk type="block" device="disk">
Nov 15 10:06:11 user nova-compute[75122]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 10:06:11 user nova-compute[75122]:       <source dev="/dev/sdc"/>
Nov 15 10:06:11 user nova-compute[75122]:       <target dev="vda" bus="virtio"/>
Nov 15 10:06:11 user nova-compute[75122]:       <serial>59ca9506-19c1-4a17-a495-28601cdadf8b</serial>
Nov 15 10:06:11 user nova-compute[75122]:     </disk>
Nov 15 10:06:11 user nova-compute[75122]:     <interface type="ethernet">
Nov 15 10:06:11 user nova-compute[75122]:       <mac address="fa:16:3e:f0:a0:d3"/>
Nov 15 10:06:11 user nova-compute[75122]:       <model type="virtio"/>
Nov 15 10:06:11 user nova-compute[75122]:       <mtu size="1442"/>
Nov 15 10:06:11 user nova-compute[75122]:       <target dev="tapbaef0235-e7"/>
Nov 15 10:06:11 user nova-compute[75122]:     </interface>
Nov 15 10:06:11 user nova-compute[75122]:     <serial type="pty">
Nov 15 10:06:11 user nova-compute[75122]:       <log file="/opt/stack/data/nova/instances/50aef80d-eff3-437a-8bee-b041e49b463e/console.log" append="off"/>
Nov 15 10:06:11 user nova-compute[75122]:     </serial>
Nov 15 10:06:11 user nova-compute[75122]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 10:06:11 user nova-compute[75122]:     <video>
Nov 15 10:06:11 user nova-compute[75122]:       <model type="virtio"/>
Nov 15 10:06:11 user nova-compute[75122]:     </video>
Nov 15 10:06:11 user nova-compute[75122]:     <rng model="virtio">
Nov 15 10:06:11 user nova-compute[75122]:       <backend model="random">/dev/urandom</backend>
Nov 15 10:06:11 user nova-compute[75122]:     </rng>
Nov 15 10:06:11 user nova-compute[75122]:     <controller type="usb" index="0" model="none"/>
Nov 15 10:06:11 user nova-compute[75122]:     <memballoon model="virtio">
Nov 15 10:06:11 user nova-compute[75122]:       <stats period="10"/>
Nov 15 10:06:11 user nova-compute[75122]:     </memballoon>
Nov 15 10:06:11 user nova-compute[75122]:   </devices>
Nov 15 10:06:11 user nova-compute[75122]: </domain>
Nov 15 10:06:11 user nova-compute[75122]:  {{(pid=75122) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 10:06:11 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-ce746fca-714e-4287-99d2-4bf0b4528c15 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T10:06:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1773217522',display_name='tempest-TestVolumeBootPattern-server-1773217522',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1773217522',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKHlpBGjgQO8WCWtscnQGPLWQNzcwgXW54O9CXzl/Z/CZ497o/Fb/9rP8/a86D2H+G6HyOK+OZYAd3QjjsdbXOlrlce1txRdWXFLkzlkbTs2rp1mYOku0vjKWQDJeaVaVQ==',key_name='tempest-TestVolumeBootPattern-2035754115',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c7941f36c30b49408ae5709a1b75346d',ramdisk_id='',reservation_id='r-rqn6uuq3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-296749341',owner_user_name='tempest-TestVolumeBootPattern-296749341-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T10:06:05Z,user_data=None,user_id='00f5cc88e43c434c8a061dcec472a16b',uuid=50aef80d-eff3-437a-8bee-b041e49b463e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "baef0235-e700-4ba9-b048-ec663bf64a37", "address": "fa:16:3e:f0:a0:d3", "network": {"id": "03073971-5253-4f06-a46a-94840841fd6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2056706757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7941f36c30b49408ae5709a1b75346d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbaef0235-e7", "ovs_interfaceid": "baef0235-e700-4ba9-b048-ec663bf64a37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 10:06:11 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-ce746fca-714e-4287-99d2-4bf0b4528c15 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Converting VIF {"id": "baef0235-e700-4ba9-b048-ec663bf64a37", "address": "fa:16:3e:f0:a0:d3", "network": {"id": "03073971-5253-4f06-a46a-94840841fd6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2056706757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7941f36c30b49408ae5709a1b75346d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbaef0235-e7", "ovs_interfaceid": "baef0235-e700-4ba9-b048-ec663bf64a37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 10:06:11 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-ce746fca-714e-4287-99d2-4bf0b4528c15 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:a0:d3,bridge_name='br-int',has_traffic_filtering=True,id=baef0235-e700-4ba9-b048-ec663bf64a37,network=Network(03073971-5253-4f06-a46a-94840841fd6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbaef0235-e7') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 10:06:11 user nova-compute[75122]: DEBUG os_vif [None req-ce746fca-714e-4287-99d2-4bf0b4528c15 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:a0:d3,bridge_name='br-int',has_traffic_filtering=True,id=baef0235-e700-4ba9-b048-ec663bf64a37,network=Network(03073971-5253-4f06-a46a-94840841fd6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbaef0235-e7') {{(pid=75122) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 10:06:11 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:06:11 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 10:06:11 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 10:06:11 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:06:11 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7043fc11-4215-5222-a2fd-bcfd1e1c5212', '_type': 'linux-noop'}}, row=False) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 10:06:11 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:06:11 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:06:11 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:06:11 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbaef0235-e7, may_exist=True, interface_attrs={}) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 10:06:11 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbaef0235-e7, col_values=(('qos', UUID('9883d6c4-927c-46e1-ae62-4b7af92280f0')),), if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 10:06:11 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbaef0235-e7, col_values=(('external_ids', {'iface-id': 'baef0235-e700-4ba9-b048-ec663bf64a37', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f0:a0:d3', 'vm-uuid': '50aef80d-eff3-437a-8bee-b041e49b463e'}),), if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 10:06:11 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:06:11 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:06:11 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:06:11 user nova-compute[75122]: INFO os_vif [None req-ce746fca-714e-4287-99d2-4bf0b4528c15 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:a0:d3,bridge_name='br-int',has_traffic_filtering=True,id=baef0235-e700-4ba9-b048-ec663bf64a37,network=Network(03073971-5253-4f06-a46a-94840841fd6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbaef0235-e7')
Nov 15 10:06:11 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-ce746fca-714e-4287-99d2-4bf0b4528c15 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] No BDM found with device name vda, not building metadata. {{(pid=75122) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 10:06:11 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-ce746fca-714e-4287-99d2-4bf0b4528c15 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] No VIF found with MAC fa:16:3e:f0:a0:d3, not building metadata {{(pid=75122) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 10:06:13 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:06:13 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:06:13 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:06:13 user nova-compute[75122]: DEBUG nova.compute.manager [req-6aad7dd3-72aa-4ede-9b7e-8525a342c9eb req-e60de79a-4214-4f07-bc18-b56c655db0b7 service nova] [instance: 50aef80d-eff3-437a-8bee-b041e49b463e] Received event network-vif-plugged-baef0235-e700-4ba9-b048-ec663bf64a37 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 10:06:13 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-6aad7dd3-72aa-4ede-9b7e-8525a342c9eb req-e60de79a-4214-4f07-bc18-b56c655db0b7 service nova] Acquiring lock "50aef80d-eff3-437a-8bee-b041e49b463e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:06:13 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-6aad7dd3-72aa-4ede-9b7e-8525a342c9eb req-e60de79a-4214-4f07-bc18-b56c655db0b7 service nova] Lock "50aef80d-eff3-437a-8bee-b041e49b463e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:06:13 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-6aad7dd3-72aa-4ede-9b7e-8525a342c9eb req-e60de79a-4214-4f07-bc18-b56c655db0b7 service nova] Lock "50aef80d-eff3-437a-8bee-b041e49b463e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:06:13 user nova-compute[75122]: DEBUG nova.compute.manager [req-6aad7dd3-72aa-4ede-9b7e-8525a342c9eb req-e60de79a-4214-4f07-bc18-b56c655db0b7 service nova] [instance: 50aef80d-eff3-437a-8bee-b041e49b463e] No waiting events found dispatching network-vif-plugged-baef0235-e700-4ba9-b048-ec663bf64a37 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 10:06:13 user nova-compute[75122]: WARNING nova.compute.manager [req-6aad7dd3-72aa-4ede-9b7e-8525a342c9eb req-e60de79a-4214-4f07-bc18-b56c655db0b7 service nova] [instance: 50aef80d-eff3-437a-8bee-b041e49b463e] Received unexpected event network-vif-plugged-baef0235-e700-4ba9-b048-ec663bf64a37 for instance with vm_state building and task_state spawning.
Nov 15 10:06:13 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:06:13 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:06:13 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:06:13 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:06:15 user nova-compute[75122]: DEBUG nova.compute.manager [None req-ce746fca-714e-4287-99d2-4bf0b4528c15 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 50aef80d-eff3-437a-8bee-b041e49b463e] Instance event wait completed in 0 seconds for  {{(pid=75122) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 10:06:15 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-ce746fca-714e-4287-99d2-4bf0b4528c15 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 50aef80d-eff3-437a-8bee-b041e49b463e] Guest created on hypervisor {{(pid=75122) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 10:06:15 user nova-compute[75122]: INFO nova.virt.libvirt.driver [-] [instance: 50aef80d-eff3-437a-8bee-b041e49b463e] Instance spawned successfully.
Nov 15 10:06:15 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-ce746fca-714e-4287-99d2-4bf0b4528c15 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 50aef80d-eff3-437a-8bee-b041e49b463e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 10:06:15 user nova-compute[75122]: DEBUG nova.compute.manager [req-dea5054e-479f-4392-90e1-3d56d458a64a req-08270ec5-6c1e-4770-8a7e-5ed965263f52 service nova] [instance: 50aef80d-eff3-437a-8bee-b041e49b463e] Received event network-vif-plugged-baef0235-e700-4ba9-b048-ec663bf64a37 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 10:06:15 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-dea5054e-479f-4392-90e1-3d56d458a64a req-08270ec5-6c1e-4770-8a7e-5ed965263f52 service nova] Acquiring lock "50aef80d-eff3-437a-8bee-b041e49b463e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:06:15 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-dea5054e-479f-4392-90e1-3d56d458a64a req-08270ec5-6c1e-4770-8a7e-5ed965263f52 service nova] Lock "50aef80d-eff3-437a-8bee-b041e49b463e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:06:15 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-dea5054e-479f-4392-90e1-3d56d458a64a req-08270ec5-6c1e-4770-8a7e-5ed965263f52 service nova] Lock "50aef80d-eff3-437a-8bee-b041e49b463e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:06:15 user nova-compute[75122]: DEBUG nova.compute.manager [req-dea5054e-479f-4392-90e1-3d56d458a64a req-08270ec5-6c1e-4770-8a7e-5ed965263f52 service nova] [instance: 50aef80d-eff3-437a-8bee-b041e49b463e] No waiting events found dispatching network-vif-plugged-baef0235-e700-4ba9-b048-ec663bf64a37 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 10:06:15 user nova-compute[75122]: WARNING nova.compute.manager [req-dea5054e-479f-4392-90e1-3d56d458a64a req-08270ec5-6c1e-4770-8a7e-5ed965263f52 service nova] [instance: 50aef80d-eff3-437a-8bee-b041e49b463e] Received unexpected event network-vif-plugged-baef0235-e700-4ba9-b048-ec663bf64a37 for instance with vm_state building and task_state spawning.
Nov 15 10:06:15 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-ce746fca-714e-4287-99d2-4bf0b4528c15 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 50aef80d-eff3-437a-8bee-b041e49b463e] Found default for hw_cdrom_bus of ide {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 10:06:15 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-ce746fca-714e-4287-99d2-4bf0b4528c15 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 50aef80d-eff3-437a-8bee-b041e49b463e] Found default for hw_disk_bus of virtio {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 10:06:15 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-ce746fca-714e-4287-99d2-4bf0b4528c15 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 50aef80d-eff3-437a-8bee-b041e49b463e] Found default for hw_input_bus of None {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 10:06:15 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-ce746fca-714e-4287-99d2-4bf0b4528c15 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 50aef80d-eff3-437a-8bee-b041e49b463e] Found default for hw_pointer_model of None {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 10:06:15 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-ce746fca-714e-4287-99d2-4bf0b4528c15 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 50aef80d-eff3-437a-8bee-b041e49b463e] Found default for hw_video_model of virtio {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 10:06:15 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-ce746fca-714e-4287-99d2-4bf0b4528c15 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 50aef80d-eff3-437a-8bee-b041e49b463e] Found default for hw_vif_model of virtio {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 10:06:15 user nova-compute[75122]: INFO nova.compute.manager [None req-ce746fca-714e-4287-99d2-4bf0b4528c15 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 50aef80d-eff3-437a-8bee-b041e49b463e] Took 5.04 seconds to spawn the instance on the hypervisor.
Nov 15 10:06:15 user nova-compute[75122]: DEBUG nova.compute.manager [None req-ce746fca-714e-4287-99d2-4bf0b4528c15 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 50aef80d-eff3-437a-8bee-b041e49b463e] Checking state {{(pid=75122) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 10:06:15 user nova-compute[75122]: INFO nova.compute.manager [None req-ce746fca-714e-4287-99d2-4bf0b4528c15 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 50aef80d-eff3-437a-8bee-b041e49b463e] Took 10.62 seconds to build instance.
Nov 15 10:06:15 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-ce746fca-714e-4287-99d2-4bf0b4528c15 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Lock "50aef80d-eff3-437a-8bee-b041e49b463e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.708s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:06:16 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:06:16 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:06:21 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:06:26 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:06:31 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:06:31 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:06:36 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:06:36 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:06:39 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:06:41 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:06:41 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:06:41 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:06:41 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:06:41 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75122) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 10:06:41 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75122) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 10:06:41 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c8b3a13-761f-4491-a367-64e74f038629/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:06:41 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c8b3a13-761f-4491-a367-64e74f038629/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:06:41 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c8b3a13-761f-4491-a367-64e74f038629/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:06:41 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c8b3a13-761f-4491-a367-64e74f038629/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:06:41 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/001d589e-1bee-42da-8422-233ba796fbab/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:06:41 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:06:41 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:06:41 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/001d589e-1bee-42da-8422-233ba796fbab/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:06:41 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/001d589e-1bee-42da-8422-233ba796fbab/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:06:42 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/001d589e-1bee-42da-8422-233ba796fbab/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:06:42 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ad77a91-bc65-44a8-8ced-fd2ad9237946/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:06:42 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ad77a91-bc65-44a8-8ced-fd2ad9237946/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:06:42 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ad77a91-bc65-44a8-8ced-fd2ad9237946/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:06:42 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ad77a91-bc65-44a8-8ced-fd2ad9237946/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:06:42 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75122) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 10:06:42 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75122) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 10:06:42 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 10:06:42 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 10:06:42 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Hypervisor/Node resource view: name=user free_ram=8476MB free_disk=24.907440185546875GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75122) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 10:06:42 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:06:42 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:06:43 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance 001d589e-1bee-42da-8422-233ba796fbab actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 10:06:43 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance db848537-676f-464a-806d-febb14d920a6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 10:06:43 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance 9ad77a91-bc65-44a8-8ced-fd2ad9237946 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 10:06:43 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance 4c8b3a13-761f-4491-a367-64e74f038629 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 10:06:43 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance 5954fd91-94c6-4521-9465-1477c0e35f8d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 10:06:43 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance 50aef80d-eff3-437a-8bee-b041e49b463e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 10:06:43 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=75122) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 10:06:43 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=75122) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 10:06:43 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Refreshing inventories for resource provider 69a3da65-47be-44c6-b67c-c692b58284ef {{(pid=75122) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 15 10:06:43 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Updating ProviderTree inventory for provider 69a3da65-47be-44c6-b67c-c692b58284ef from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 15 10:06:43 user nova-compute[75122]: DEBUG nova.compute.provider_tree [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Updating inventory in ProviderTree for provider 69a3da65-47be-44c6-b67c-c692b58284ef with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 15 10:06:43 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Refreshing aggregate associations for resource provider 69a3da65-47be-44c6-b67c-c692b58284ef, aggregates: None {{(pid=75122) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 15 10:06:43 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Refreshing trait associations for resource provider 69a3da65-47be-44c6-b67c-c692b58284ef, traits: COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_RESCUE_BFV,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE,COMPUTE_NODE,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_ACCELERATORS,HW_CPU_X86_MMX {{(pid=75122) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 15 10:06:43 user nova-compute[75122]: DEBUG nova.compute.provider_tree [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Inventory has not changed in ProviderTree for provider: 69a3da65-47be-44c6-b67c-c692b58284ef {{(pid=75122) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 10:06:43 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Inventory has not changed for provider 69a3da65-47be-44c6-b67c-c692b58284ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 10:06:43 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Compute_service record updated for user:user {{(pid=75122) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 10:06:43 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.544s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:06:44 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:06:44 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:06:45 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:06:46 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:06:46 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Cleaning up deleted instances {{(pid=75122) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 15 10:06:46 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] There are 0 instances to clean {{(pid=75122) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 15 10:06:46 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:06:46 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:06:47 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:06:49 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:06:50 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:06:50 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:06:50 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Starting heal instance info cache {{(pid=75122) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 10:06:50 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "refresh_cache-9ad77a91-bc65-44a8-8ced-fd2ad9237946" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 10:06:50 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquired lock "refresh_cache-9ad77a91-bc65-44a8-8ced-fd2ad9237946" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 10:06:50 user nova-compute[75122]: DEBUG nova.network.neutron [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] [instance: 9ad77a91-bc65-44a8-8ced-fd2ad9237946] Forcefully refreshing network info cache for instance {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 10:06:50 user nova-compute[75122]: DEBUG nova.network.neutron [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] [instance: 9ad77a91-bc65-44a8-8ced-fd2ad9237946] Updating instance_info_cache with network_info: [{"id": "e348b3b5-1fc0-4c27-98e7-41a152a67610", "address": "fa:16:3e:d3:b1:38", "network": {"id": "8c1491a5-d5c6-4a22-84fd-bdeca00bbaad", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1848328203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab6afbe7809a4ad3921cbc18145d1816", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape348b3b5-1f", "ovs_interfaceid": "e348b3b5-1fc0-4c27-98e7-41a152a67610", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 10:06:50 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Releasing lock "refresh_cache-9ad77a91-bc65-44a8-8ced-fd2ad9237946" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 10:06:50 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] [instance: 9ad77a91-bc65-44a8-8ced-fd2ad9237946] Updated the network info_cache for instance {{(pid=75122) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 10:06:50 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:06:50 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75122) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 10:06:51 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:06:51 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:06:51 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:06:51 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75122) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 10:06:51 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75122) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 10:06:51 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75122) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 10:06:51 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:06:56 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:07:01 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:07:03 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:07:03 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75122) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 15 10:07:06 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:07:08 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-4b0b706c-ecaf-420b-83bb-7e5f926596d2 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Acquiring lock "9ad77a91-bc65-44a8-8ced-fd2ad9237946" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:07:08 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-4b0b706c-ecaf-420b-83bb-7e5f926596d2 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Lock "9ad77a91-bc65-44a8-8ced-fd2ad9237946" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:07:08 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-4b0b706c-ecaf-420b-83bb-7e5f926596d2 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Acquiring lock "9ad77a91-bc65-44a8-8ced-fd2ad9237946-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:07:08 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-4b0b706c-ecaf-420b-83bb-7e5f926596d2 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Lock "9ad77a91-bc65-44a8-8ced-fd2ad9237946-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:07:08 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-4b0b706c-ecaf-420b-83bb-7e5f926596d2 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Lock "9ad77a91-bc65-44a8-8ced-fd2ad9237946-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:07:08 user nova-compute[75122]: INFO nova.compute.manager [None req-4b0b706c-ecaf-420b-83bb-7e5f926596d2 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] [instance: 9ad77a91-bc65-44a8-8ced-fd2ad9237946] Terminating instance
Nov 15 10:07:08 user nova-compute[75122]: DEBUG nova.compute.manager [None req-4b0b706c-ecaf-420b-83bb-7e5f926596d2 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] [instance: 9ad77a91-bc65-44a8-8ced-fd2ad9237946] Start destroying the instance on the hypervisor. {{(pid=75122) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 10:07:08 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:07:08 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:07:08 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:07:08 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:07:08 user nova-compute[75122]: DEBUG nova.compute.manager [req-5d3e8451-9670-45b8-a055-9b9087e038b8 req-837ceb9b-93a9-4136-a8d9-e0ee15d1b19b service nova] [instance: 9ad77a91-bc65-44a8-8ced-fd2ad9237946] Received event network-vif-unplugged-e348b3b5-1fc0-4c27-98e7-41a152a67610 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 10:07:08 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-5d3e8451-9670-45b8-a055-9b9087e038b8 req-837ceb9b-93a9-4136-a8d9-e0ee15d1b19b service nova] Acquiring lock "9ad77a91-bc65-44a8-8ced-fd2ad9237946-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:07:08 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-5d3e8451-9670-45b8-a055-9b9087e038b8 req-837ceb9b-93a9-4136-a8d9-e0ee15d1b19b service nova] Lock "9ad77a91-bc65-44a8-8ced-fd2ad9237946-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:07:08 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-5d3e8451-9670-45b8-a055-9b9087e038b8 req-837ceb9b-93a9-4136-a8d9-e0ee15d1b19b service nova] Lock "9ad77a91-bc65-44a8-8ced-fd2ad9237946-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:07:08 user nova-compute[75122]: DEBUG nova.compute.manager [req-5d3e8451-9670-45b8-a055-9b9087e038b8 req-837ceb9b-93a9-4136-a8d9-e0ee15d1b19b service nova] [instance: 9ad77a91-bc65-44a8-8ced-fd2ad9237946] No waiting events found dispatching network-vif-unplugged-e348b3b5-1fc0-4c27-98e7-41a152a67610 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 10:07:08 user nova-compute[75122]: DEBUG nova.compute.manager [req-5d3e8451-9670-45b8-a055-9b9087e038b8 req-837ceb9b-93a9-4136-a8d9-e0ee15d1b19b service nova] [instance: 9ad77a91-bc65-44a8-8ced-fd2ad9237946] Received event network-vif-unplugged-e348b3b5-1fc0-4c27-98e7-41a152a67610 for instance with task_state deleting. {{(pid=75122) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 10:07:08 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:07:09 user nova-compute[75122]: INFO nova.virt.libvirt.driver [-] [instance: 9ad77a91-bc65-44a8-8ced-fd2ad9237946] Instance destroyed successfully.
Nov 15 10:07:09 user nova-compute[75122]: DEBUG nova.objects.instance [None req-4b0b706c-ecaf-420b-83bb-7e5f926596d2 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Lazy-loading 'resources' on Instance uuid 9ad77a91-bc65-44a8-8ced-fd2ad9237946 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 10:07:09 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-4b0b706c-ecaf-420b-83bb-7e5f926596d2 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T09:57:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-803179351',display_name='tempest-AttachVolumeTestJSON-server-803179351',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-803179351',id=41,image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOazdcLoty/Tvb58dOdgjYRlbmZHLxyOye3e81xDJ6xblOKkjaBcaTxCMTaYL2kE3EQ/2KT89+o54kjCi92RXyGz9Fa5Z/xA8RuG+orKH3o1/047NRIGM2FIaGKSP1LaWg==',key_name='tempest-keypair-269122459',keypairs=<?>,launch_index=0,launched_at=2023-11-15T09:57:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ab6afbe7809a4ad3921cbc18145d1816',ramdisk_id='',reservation_id='r-3ag6vy4w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-970815916',owner_user_name='tempest-AttachVolumeTestJSON-970815916-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T10:05:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f18eb706375c4b2e9e7de793cd2950ad',uuid=9ad77a91-bc65-44a8-8ced-fd2ad9237946,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e348b3b5-1fc0-4c27-98e7-41a152a67610", "address": "fa:16:3e:d3:b1:38", "network": {"id": "8c1491a5-d5c6-4a22-84fd-bdeca00bbaad", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1848328203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab6afbe7809a4ad3921cbc18145d1816", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape348b3b5-1f", "ovs_interfaceid": "e348b3b5-1fc0-4c27-98e7-41a152a67610", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 10:07:09 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-4b0b706c-ecaf-420b-83bb-7e5f926596d2 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Converting VIF {"id": "e348b3b5-1fc0-4c27-98e7-41a152a67610", "address": "fa:16:3e:d3:b1:38", "network": {"id": "8c1491a5-d5c6-4a22-84fd-bdeca00bbaad", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1848328203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab6afbe7809a4ad3921cbc18145d1816", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape348b3b5-1f", "ovs_interfaceid": "e348b3b5-1fc0-4c27-98e7-41a152a67610", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 10:07:09 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-4b0b706c-ecaf-420b-83bb-7e5f926596d2 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d3:b1:38,bridge_name='br-int',has_traffic_filtering=True,id=e348b3b5-1fc0-4c27-98e7-41a152a67610,network=Network(8c1491a5-d5c6-4a22-84fd-bdeca00bbaad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape348b3b5-1f') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 10:07:09 user nova-compute[75122]: DEBUG os_vif [None req-4b0b706c-ecaf-420b-83bb-7e5f926596d2 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d3:b1:38,bridge_name='br-int',has_traffic_filtering=True,id=e348b3b5-1fc0-4c27-98e7-41a152a67610,network=Network(8c1491a5-d5c6-4a22-84fd-bdeca00bbaad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape348b3b5-1f') {{(pid=75122) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 10:07:09 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:07:09 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape348b3b5-1f, bridge=br-int, if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 10:07:09 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:07:09 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:07:09 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:07:09 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=484a097b-e172-4eb4-9238-bb640e1a5307) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 10:07:09 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:07:09 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:07:09 user nova-compute[75122]: INFO os_vif [None req-4b0b706c-ecaf-420b-83bb-7e5f926596d2 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d3:b1:38,bridge_name='br-int',has_traffic_filtering=True,id=e348b3b5-1fc0-4c27-98e7-41a152a67610,network=Network(8c1491a5-d5c6-4a22-84fd-bdeca00bbaad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape348b3b5-1f')
Nov 15 10:07:09 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-4b0b706c-ecaf-420b-83bb-7e5f926596d2 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] [instance: 9ad77a91-bc65-44a8-8ced-fd2ad9237946] Deleting instance files /opt/stack/data/nova/instances/9ad77a91-bc65-44a8-8ced-fd2ad9237946_del
Nov 15 10:07:09 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-4b0b706c-ecaf-420b-83bb-7e5f926596d2 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] [instance: 9ad77a91-bc65-44a8-8ced-fd2ad9237946] Deletion of /opt/stack/data/nova/instances/9ad77a91-bc65-44a8-8ced-fd2ad9237946_del complete
Nov 15 10:07:09 user nova-compute[75122]: INFO nova.compute.manager [None req-4b0b706c-ecaf-420b-83bb-7e5f926596d2 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] [instance: 9ad77a91-bc65-44a8-8ced-fd2ad9237946] Took 0.69 seconds to destroy the instance on the hypervisor.
Nov 15 10:07:09 user nova-compute[75122]: DEBUG oslo.service.loopingcall [None req-4b0b706c-ecaf-420b-83bb-7e5f926596d2 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75122) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 10:07:09 user nova-compute[75122]: DEBUG nova.compute.manager [-] [instance: 9ad77a91-bc65-44a8-8ced-fd2ad9237946] Deallocating network for instance {{(pid=75122) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 10:07:09 user nova-compute[75122]: DEBUG nova.network.neutron [-] [instance: 9ad77a91-bc65-44a8-8ced-fd2ad9237946] deallocate_for_instance() {{(pid=75122) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 10:07:09 user nova-compute[75122]: DEBUG nova.network.neutron [-] [instance: 9ad77a91-bc65-44a8-8ced-fd2ad9237946] Updating instance_info_cache with network_info: [] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 10:07:09 user nova-compute[75122]: INFO nova.compute.manager [-] [instance: 9ad77a91-bc65-44a8-8ced-fd2ad9237946] Took 0.68 seconds to deallocate network for instance.
Nov 15 10:07:09 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-4b0b706c-ecaf-420b-83bb-7e5f926596d2 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:07:09 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-4b0b706c-ecaf-420b-83bb-7e5f926596d2 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:07:10 user nova-compute[75122]: DEBUG nova.compute.provider_tree [None req-4b0b706c-ecaf-420b-83bb-7e5f926596d2 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Inventory has not changed in ProviderTree for provider: 69a3da65-47be-44c6-b67c-c692b58284ef {{(pid=75122) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 10:07:10 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-4b0b706c-ecaf-420b-83bb-7e5f926596d2 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Inventory has not changed for provider 69a3da65-47be-44c6-b67c-c692b58284ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 10:07:10 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-4b0b706c-ecaf-420b-83bb-7e5f926596d2 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.266s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:07:10 user nova-compute[75122]: INFO nova.scheduler.client.report [None req-4b0b706c-ecaf-420b-83bb-7e5f926596d2 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Deleted allocations for instance 9ad77a91-bc65-44a8-8ced-fd2ad9237946
Nov 15 10:07:10 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-4b0b706c-ecaf-420b-83bb-7e5f926596d2 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Lock "9ad77a91-bc65-44a8-8ced-fd2ad9237946" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.815s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:07:10 user nova-compute[75122]: DEBUG nova.compute.manager [req-53f49a92-7cde-4faa-97ea-0b6ab2bf72de req-61237583-646d-44b2-b97e-f4c583f77f0b service nova] [instance: 9ad77a91-bc65-44a8-8ced-fd2ad9237946] Received event network-vif-plugged-e348b3b5-1fc0-4c27-98e7-41a152a67610 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 10:07:10 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-53f49a92-7cde-4faa-97ea-0b6ab2bf72de req-61237583-646d-44b2-b97e-f4c583f77f0b service nova] Acquiring lock "9ad77a91-bc65-44a8-8ced-fd2ad9237946-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:07:10 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-53f49a92-7cde-4faa-97ea-0b6ab2bf72de req-61237583-646d-44b2-b97e-f4c583f77f0b service nova] Lock "9ad77a91-bc65-44a8-8ced-fd2ad9237946-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:07:10 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-53f49a92-7cde-4faa-97ea-0b6ab2bf72de req-61237583-646d-44b2-b97e-f4c583f77f0b service nova] Lock "9ad77a91-bc65-44a8-8ced-fd2ad9237946-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:07:10 user nova-compute[75122]: DEBUG nova.compute.manager [req-53f49a92-7cde-4faa-97ea-0b6ab2bf72de req-61237583-646d-44b2-b97e-f4c583f77f0b service nova] [instance: 9ad77a91-bc65-44a8-8ced-fd2ad9237946] No waiting events found dispatching network-vif-plugged-e348b3b5-1fc0-4c27-98e7-41a152a67610 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 10:07:10 user nova-compute[75122]: WARNING nova.compute.manager [req-53f49a92-7cde-4faa-97ea-0b6ab2bf72de req-61237583-646d-44b2-b97e-f4c583f77f0b service nova] [instance: 9ad77a91-bc65-44a8-8ced-fd2ad9237946] Received unexpected event network-vif-plugged-e348b3b5-1fc0-4c27-98e7-41a152a67610 for instance with vm_state deleted and task_state None.
Nov 15 10:07:10 user nova-compute[75122]: DEBUG nova.compute.manager [req-53f49a92-7cde-4faa-97ea-0b6ab2bf72de req-61237583-646d-44b2-b97e-f4c583f77f0b service nova] [instance: 9ad77a91-bc65-44a8-8ced-fd2ad9237946] Received event network-vif-deleted-e348b3b5-1fc0-4c27-98e7-41a152a67610 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 10:07:10 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-ea677fa8-578a-4d55-aee8-c6419d6acdf1 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Acquiring lock "5954fd91-94c6-4521-9465-1477c0e35f8d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:07:10 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-ea677fa8-578a-4d55-aee8-c6419d6acdf1 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Lock "5954fd91-94c6-4521-9465-1477c0e35f8d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:07:10 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-ea677fa8-578a-4d55-aee8-c6419d6acdf1 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Acquiring lock "5954fd91-94c6-4521-9465-1477c0e35f8d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:07:10 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-ea677fa8-578a-4d55-aee8-c6419d6acdf1 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Lock "5954fd91-94c6-4521-9465-1477c0e35f8d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:07:10 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-ea677fa8-578a-4d55-aee8-c6419d6acdf1 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Lock "5954fd91-94c6-4521-9465-1477c0e35f8d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:07:10 user nova-compute[75122]: INFO nova.compute.manager [None req-ea677fa8-578a-4d55-aee8-c6419d6acdf1 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: 5954fd91-94c6-4521-9465-1477c0e35f8d] Terminating instance
Nov 15 10:07:10 user nova-compute[75122]: DEBUG nova.compute.manager [None req-ea677fa8-578a-4d55-aee8-c6419d6acdf1 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: 5954fd91-94c6-4521-9465-1477c0e35f8d] Start destroying the instance on the hypervisor. {{(pid=75122) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 10:07:10 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:07:10 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:07:11 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:07:11 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:07:11 user nova-compute[75122]: INFO nova.virt.libvirt.driver [-] [instance: 5954fd91-94c6-4521-9465-1477c0e35f8d] Instance destroyed successfully.
Nov 15 10:07:11 user nova-compute[75122]: DEBUG nova.objects.instance [None req-ea677fa8-578a-4d55-aee8-c6419d6acdf1 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Lazy-loading 'resources' on Instance uuid 5954fd91-94c6-4521-9465-1477c0e35f8d {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 10:07:11 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-ea677fa8-578a-4d55-aee8-c6419d6acdf1 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T10:01:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1321201668',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1321201668',id=45,image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T10:03:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c046170a2ad44ebba5d2de236d940be0',ramdisk_id='',reservation_id='r-0dynjry9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1545444983',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T10:05:25Z,user_data=None,user_id='53d187e2a07b4437a02f65fb47a003ee',uuid=5954fd91-94c6-4521-9465-1477c0e35f8d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e9b84607-88fe-411c-be24-0f2d1709d9e9", "address": "fa:16:3e:ef:6d:f1", "network": {"id": "b780d5c1-a549-4b49-a036-5a272697d4b6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-229344021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c046170a2ad44ebba5d2de236d940be0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9b84607-88", "ovs_interfaceid": "e9b84607-88fe-411c-be24-0f2d1709d9e9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 10:07:11 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-ea677fa8-578a-4d55-aee8-c6419d6acdf1 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Converting VIF {"id": "e9b84607-88fe-411c-be24-0f2d1709d9e9", "address": "fa:16:3e:ef:6d:f1", "network": {"id": "b780d5c1-a549-4b49-a036-5a272697d4b6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-229344021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c046170a2ad44ebba5d2de236d940be0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9b84607-88", "ovs_interfaceid": "e9b84607-88fe-411c-be24-0f2d1709d9e9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 10:07:11 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-ea677fa8-578a-4d55-aee8-c6419d6acdf1 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ef:6d:f1,bridge_name='br-int',has_traffic_filtering=True,id=e9b84607-88fe-411c-be24-0f2d1709d9e9,network=Network(b780d5c1-a549-4b49-a036-5a272697d4b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9b84607-88') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 10:07:11 user nova-compute[75122]: DEBUG os_vif [None req-ea677fa8-578a-4d55-aee8-c6419d6acdf1 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ef:6d:f1,bridge_name='br-int',has_traffic_filtering=True,id=e9b84607-88fe-411c-be24-0f2d1709d9e9,network=Network(b780d5c1-a549-4b49-a036-5a272697d4b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9b84607-88') {{(pid=75122) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 10:07:11 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:07:11 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape9b84607-88, bridge=br-int, if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 10:07:11 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:07:11 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:07:11 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:07:11 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=835293ce-0c0f-4cd1-b618-ff4d3cda4c40) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 10:07:11 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:07:11 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:07:11 user nova-compute[75122]: INFO os_vif [None req-ea677fa8-578a-4d55-aee8-c6419d6acdf1 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ef:6d:f1,bridge_name='br-int',has_traffic_filtering=True,id=e9b84607-88fe-411c-be24-0f2d1709d9e9,network=Network(b780d5c1-a549-4b49-a036-5a272697d4b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9b84607-88')
Nov 15 10:07:11 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ea677fa8-578a-4d55-aee8-c6419d6acdf1 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: 5954fd91-94c6-4521-9465-1477c0e35f8d] calling os-brick to detach iSCSI Volume {{(pid=75122) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 10:07:11 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea677fa8-578a-4d55-aee8-c6419d6acdf1 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffa04060b80>, {'target_iqn': 'iqn.2010-10.org.openstack:11d2deb7-c652-48e3-ae06-5557c9bef981', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YoxPBlsS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 10:07:11 user nova-compute[75122]: WARNING os_brick.initiator.connectors.base [None req-ea677fa8-578a-4d55-aee8-c6419d6acdf1 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 10:07:11 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-ea677fa8-578a-4d55-aee8-c6419d6acdf1 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 10:07:11 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-ea677fa8-578a-4d55-aee8-c6419d6acdf1 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 10:07:11 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:07:11 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:07:11 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd7daf21-88b4-44e0-b202-6869bc537696]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:59ca9506-19c1-4a17-a495-28601cdadf8b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:11d2deb7-c652-48e3-ae06-5557c9bef981\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8ee79db2-27c2-4d0f-8ee6-5b03e05ebba5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:07:11 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea677fa8-578a-4d55-aee8-c6419d6acdf1 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 10:07:11 user nova-compute[75122]: No targets found.
Nov 15 10:07:11 user nova-compute[75122]: iSNS:
Nov 15 10:07:11 user nova-compute[75122]: No targets found.
Nov 15 10:07:11 user nova-compute[75122]: STATIC:
Nov 15 10:07:11 user nova-compute[75122]: Target: iqn.2010-10.org.openstack:59ca9506-19c1-4a17-a495-28601cdadf8b
Nov 15 10:07:11 user nova-compute[75122]:         Portal: 172.16.0.220:3260,-1
Nov 15 10:07:11 user nova-compute[75122]:                 Iface Name: default
Nov 15 10:07:11 user nova-compute[75122]: Target: iqn.2010-10.org.openstack:11d2deb7-c652-48e3-ae06-5557c9bef981
Nov 15 10:07:11 user nova-compute[75122]:         Portal: 172.16.0.220:3260,-1
Nov 15 10:07:11 user nova-compute[75122]:                 Iface Name: default
Nov 15 10:07:11 user nova-compute[75122]: Target: iqn.2010-10.org.openstack:8ee79db2-27c2-4d0f-8ee6-5b03e05ebba5
Nov 15 10:07:11 user nova-compute[75122]:         Portal: 172.16.0.220:3260,-1
Nov 15 10:07:11 user nova-compute[75122]:                 Iface Name: default
Nov 15 10:07:11 user nova-compute[75122]: FIRMWARE:
Nov 15 10:07:11 user nova-compute[75122]: No targets found.
Nov 15 10:07:11 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 10:07:11 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea677fa8-578a-4d55-aee8-c6419d6acdf1 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 10:07:11 user nova-compute[75122]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 10:07:11 user nova-compute[75122]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75122) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 10:07:11 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea677fa8-578a-4d55-aee8-c6419d6acdf1 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:11d2deb7-c652-48e3-ae06-5557c9bef981', 0)] {{(pid=75122) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 10:07:11 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:07:11 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:07:11 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[05f1ea03-caf3-47b0-860f-6d57acba53a5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:11d2deb7-c652-48e3-ae06-5557c9bef981\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:59ca9506-19c1-4a17-a495-28601cdadf8b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8ee79db2-27c2-4d0f-8ee6-5b03e05ebba5\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:07:11 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:07:11 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:07:11 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[17a76541-8d13-4bca-9135-eaa87a7d9ca7]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee79db2-27c2-4d0f-8ee6-5b03e05ebba5 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11d2deb7-c652-48e3-ae06-5557c9bef981 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59ca9506-19c1-4a17-a495-28601cdadf8b (non-flash)\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:07:11 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea677fa8-578a-4d55-aee8-c6419d6acdf1 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee79db2-27c2-4d0f-8ee6-5b03e05ebba5 (non-flash)
Nov 15 10:07:11 user nova-compute[75122]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11d2deb7-c652-48e3-ae06-5557c9bef981 (non-flash)
Nov 15 10:07:11 user nova-compute[75122]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59ca9506-19c1-4a17-a495-28601cdadf8b (non-flash)
Nov 15 10:07:11 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 10:07:11 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea677fa8-578a-4d55-aee8-c6419d6acdf1 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee79db2-27c2-4d0f-8ee6-5b03e05ebba5 (non-flash)
Nov 15 10:07:11 user nova-compute[75122]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:11d2deb7-c652-48e3-ae06-5557c9bef981 (non-flash)
Nov 15 10:07:11 user nova-compute[75122]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59ca9506-19c1-4a17-a495-28601cdadf8b (non-flash)
Nov 15 10:07:11 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 10:07:11 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea677fa8-578a-4d55-aee8-c6419d6acdf1 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff9e4547ac0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:11d2deb7-c652-48e3-ae06-5557c9bef981'): ({'sde'}, set())}) {{(pid=75122) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 10:07:11 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-ea677fa8-578a-4d55-aee8-c6419d6acdf1 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Removing single pathed devices sde {{(pid=75122) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 10:07:11 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:07:11 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:07:11 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d9b8737-0d04-46cc-a02e-9a76d0dcea72]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:07:11 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:07:11 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:07:11 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[80e62ee0-7b19-4f8a-a367-f277ad876cc8]: (4, ('ok\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:07:11 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-ea677fa8-578a-4d55-aee8-c6419d6acdf1 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Flushing IO for device /dev/sde {{(pid=75122) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 10:07:11 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:07:11 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:07:11 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[87c343f7-d88b-4243-8fc3-87434427d93a]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:07:11 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-ea677fa8-578a-4d55-aee8-c6419d6acdf1 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75122) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 10:07:11 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:07:11 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.054s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:07:11 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a1395b9-1cd6-4745-b9ef-ad1e6cb60db9]: (4, ('1', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:07:11 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-ea677fa8-578a-4d55-aee8-c6419d6acdf1 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75122) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 10:07:11 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-ea677fa8-578a-4d55-aee8-c6419d6acdf1 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] SCSI volumes sde have been removed. {{(pid=75122) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 10:07:11 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea677fa8-578a-4d55-aee8-c6419d6acdf1 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:11d2deb7-c652-48e3-ae06-5557c9bef981')] {{(pid=75122) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 10:07:11 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11d2deb7-c652-48e3-ae06-5557c9bef981 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:07:11 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:07:11 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11d2deb7-c652-48e3-ae06-5557c9bef981 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:07:11 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[629085dc-c8d2-48b6-8298-5cd57dc09038]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:07:11 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea677fa8-578a-4d55-aee8-c6419d6acdf1 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 10:07:11 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11d2deb7-c652-48e3-ae06-5557c9bef981 -p 172.16.0.220:3260 --logout {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:07:11 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11d2deb7-c652-48e3-ae06-5557c9bef981 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:07:11 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4e2dceb-34e2-4ede-a08b-7158bd5f33d5]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:11d2deb7-c652-48e3-ae06-5557c9bef981, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:11d2deb7-c652-48e3-ae06-5557c9bef981, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:07:11 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea677fa8-578a-4d55-aee8-c6419d6acdf1 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:11d2deb7-c652-48e3-ae06-5557c9bef981, portal: 172.16.0.220,3260]
Nov 15 10:07:11 user nova-compute[75122]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:11d2deb7-c652-48e3-ae06-5557c9bef981, portal: 172.16.0.220,3260] successful.
Nov 15 10:07:11 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 10:07:11 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:11d2deb7-c652-48e3-ae06-5557c9bef981 -p 172.16.0.220:3260 --op delete {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:07:11 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:11d2deb7-c652-48e3-ae06-5557c9bef981 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:07:11 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b513eab-9b20-414a-b9b3-65c69bb095f4]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:07:11 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea677fa8-578a-4d55-aee8-c6419d6acdf1 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 10:07:11 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-ea677fa8-578a-4d55-aee8-c6419d6acdf1 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.303s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 10:07:11 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea677fa8-578a-4d55-aee8-c6419d6acdf1 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] <== disconnect_volume: return (305ms) None {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 10:07:11 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ea677fa8-578a-4d55-aee8-c6419d6acdf1 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: 5954fd91-94c6-4521-9465-1477c0e35f8d] Disconnected iSCSI Volume {{(pid=75122) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 10:07:11 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-ea677fa8-578a-4d55-aee8-c6419d6acdf1 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: 5954fd91-94c6-4521-9465-1477c0e35f8d] Deleting instance files /opt/stack/data/nova/instances/5954fd91-94c6-4521-9465-1477c0e35f8d_del
Nov 15 10:07:11 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-ea677fa8-578a-4d55-aee8-c6419d6acdf1 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: 5954fd91-94c6-4521-9465-1477c0e35f8d] Deletion of /opt/stack/data/nova/instances/5954fd91-94c6-4521-9465-1477c0e35f8d_del complete
Nov 15 10:07:12 user nova-compute[75122]: INFO nova.compute.manager [None req-ea677fa8-578a-4d55-aee8-c6419d6acdf1 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: 5954fd91-94c6-4521-9465-1477c0e35f8d] Took 1.19 seconds to destroy the instance on the hypervisor.
Nov 15 10:07:12 user nova-compute[75122]: DEBUG oslo.service.loopingcall [None req-ea677fa8-578a-4d55-aee8-c6419d6acdf1 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75122) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 10:07:12 user nova-compute[75122]: DEBUG nova.compute.manager [-] [instance: 5954fd91-94c6-4521-9465-1477c0e35f8d] Deallocating network for instance {{(pid=75122) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 10:07:12 user nova-compute[75122]: DEBUG nova.network.neutron [-] [instance: 5954fd91-94c6-4521-9465-1477c0e35f8d] deallocate_for_instance() {{(pid=75122) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 10:07:12 user nova-compute[75122]: DEBUG nova.network.neutron [-] [instance: 5954fd91-94c6-4521-9465-1477c0e35f8d] Updating instance_info_cache with network_info: [] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 10:07:12 user nova-compute[75122]: INFO nova.compute.manager [-] [instance: 5954fd91-94c6-4521-9465-1477c0e35f8d] Took 0.41 seconds to deallocate network for instance.
Nov 15 10:07:12 user nova-compute[75122]: DEBUG nova.compute.manager [req-59c010ad-1980-47cd-830e-af0aeffb71d0 req-7832548b-067f-430b-9def-0bde092f3884 service nova] [instance: 5954fd91-94c6-4521-9465-1477c0e35f8d] Received event network-vif-unplugged-e9b84607-88fe-411c-be24-0f2d1709d9e9 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 10:07:12 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-59c010ad-1980-47cd-830e-af0aeffb71d0 req-7832548b-067f-430b-9def-0bde092f3884 service nova] Acquiring lock "5954fd91-94c6-4521-9465-1477c0e35f8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:07:12 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-59c010ad-1980-47cd-830e-af0aeffb71d0 req-7832548b-067f-430b-9def-0bde092f3884 service nova] Lock "5954fd91-94c6-4521-9465-1477c0e35f8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:07:12 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-59c010ad-1980-47cd-830e-af0aeffb71d0 req-7832548b-067f-430b-9def-0bde092f3884 service nova] Lock "5954fd91-94c6-4521-9465-1477c0e35f8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:07:12 user nova-compute[75122]: DEBUG nova.compute.manager [req-59c010ad-1980-47cd-830e-af0aeffb71d0 req-7832548b-067f-430b-9def-0bde092f3884 service nova] [instance: 5954fd91-94c6-4521-9465-1477c0e35f8d] No waiting events found dispatching network-vif-unplugged-e9b84607-88fe-411c-be24-0f2d1709d9e9 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 10:07:12 user nova-compute[75122]: DEBUG nova.compute.manager [req-59c010ad-1980-47cd-830e-af0aeffb71d0 req-7832548b-067f-430b-9def-0bde092f3884 service nova] [instance: 5954fd91-94c6-4521-9465-1477c0e35f8d] Received event network-vif-unplugged-e9b84607-88fe-411c-be24-0f2d1709d9e9 for instance with task_state deleting. {{(pid=75122) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 10:07:12 user nova-compute[75122]: DEBUG nova.compute.manager [req-59c010ad-1980-47cd-830e-af0aeffb71d0 req-7832548b-067f-430b-9def-0bde092f3884 service nova] [instance: 5954fd91-94c6-4521-9465-1477c0e35f8d] Received event network-vif-plugged-e9b84607-88fe-411c-be24-0f2d1709d9e9 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 10:07:12 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-59c010ad-1980-47cd-830e-af0aeffb71d0 req-7832548b-067f-430b-9def-0bde092f3884 service nova] Acquiring lock "5954fd91-94c6-4521-9465-1477c0e35f8d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:07:12 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-59c010ad-1980-47cd-830e-af0aeffb71d0 req-7832548b-067f-430b-9def-0bde092f3884 service nova] Lock "5954fd91-94c6-4521-9465-1477c0e35f8d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:07:12 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-59c010ad-1980-47cd-830e-af0aeffb71d0 req-7832548b-067f-430b-9def-0bde092f3884 service nova] Lock "5954fd91-94c6-4521-9465-1477c0e35f8d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:07:12 user nova-compute[75122]: DEBUG nova.compute.manager [req-59c010ad-1980-47cd-830e-af0aeffb71d0 req-7832548b-067f-430b-9def-0bde092f3884 service nova] [instance: 5954fd91-94c6-4521-9465-1477c0e35f8d] No waiting events found dispatching network-vif-plugged-e9b84607-88fe-411c-be24-0f2d1709d9e9 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 10:07:12 user nova-compute[75122]: WARNING nova.compute.manager [req-59c010ad-1980-47cd-830e-af0aeffb71d0 req-7832548b-067f-430b-9def-0bde092f3884 service nova] [instance: 5954fd91-94c6-4521-9465-1477c0e35f8d] Received unexpected event network-vif-plugged-e9b84607-88fe-411c-be24-0f2d1709d9e9 for instance with vm_state active and task_state deleting.
Nov 15 10:07:12 user nova-compute[75122]: DEBUG nova.compute.manager [req-59c010ad-1980-47cd-830e-af0aeffb71d0 req-7832548b-067f-430b-9def-0bde092f3884 service nova] [instance: 5954fd91-94c6-4521-9465-1477c0e35f8d] Received event network-vif-deleted-e9b84607-88fe-411c-be24-0f2d1709d9e9 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 10:07:13 user nova-compute[75122]: INFO nova.compute.manager [None req-ea677fa8-578a-4d55-aee8-c6419d6acdf1 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: 5954fd91-94c6-4521-9465-1477c0e35f8d] Took 0.75 seconds to detach 1 volumes for instance.
Nov 15 10:07:13 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-ea677fa8-578a-4d55-aee8-c6419d6acdf1 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:07:13 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-ea677fa8-578a-4d55-aee8-c6419d6acdf1 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:07:13 user nova-compute[75122]: DEBUG nova.compute.provider_tree [None req-ea677fa8-578a-4d55-aee8-c6419d6acdf1 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Inventory has not changed in ProviderTree for provider: 69a3da65-47be-44c6-b67c-c692b58284ef {{(pid=75122) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 10:07:13 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-ea677fa8-578a-4d55-aee8-c6419d6acdf1 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Inventory has not changed for provider 69a3da65-47be-44c6-b67c-c692b58284ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 10:07:13 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-ea677fa8-578a-4d55-aee8-c6419d6acdf1 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.212s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:07:13 user nova-compute[75122]: INFO nova.scheduler.client.report [None req-ea677fa8-578a-4d55-aee8-c6419d6acdf1 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Deleted allocations for instance 5954fd91-94c6-4521-9465-1477c0e35f8d
Nov 15 10:07:13 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-ea677fa8-578a-4d55-aee8-c6419d6acdf1 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Lock "5954fd91-94c6-4521-9465-1477c0e35f8d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.855s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:07:16 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:07:21 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:07:26 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:07:31 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:07:36 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:07:40 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:07:41 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:07:42 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:07:42 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Triggering sync for uuid 001d589e-1bee-42da-8422-233ba796fbab {{(pid=75122) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 10:07:42 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Triggering sync for uuid db848537-676f-464a-806d-febb14d920a6 {{(pid=75122) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 10:07:42 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Triggering sync for uuid 4c8b3a13-761f-4491-a367-64e74f038629 {{(pid=75122) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 10:07:42 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Triggering sync for uuid 50aef80d-eff3-437a-8bee-b041e49b463e {{(pid=75122) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 10:07:42 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "001d589e-1bee-42da-8422-233ba796fbab" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:07:42 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "001d589e-1bee-42da-8422-233ba796fbab" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:07:42 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "db848537-676f-464a-806d-febb14d920a6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:07:42 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "db848537-676f-464a-806d-febb14d920a6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:07:42 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "4c8b3a13-761f-4491-a367-64e74f038629" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:07:42 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "4c8b3a13-761f-4491-a367-64e74f038629" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:07:42 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "50aef80d-eff3-437a-8bee-b041e49b463e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:07:42 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "50aef80d-eff3-437a-8bee-b041e49b463e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:07:42 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:07:42 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "001d589e-1bee-42da-8422-233ba796fbab" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.034s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:07:42 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "4c8b3a13-761f-4491-a367-64e74f038629" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.035s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:07:42 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "db848537-676f-464a-806d-febb14d920a6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.037s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:07:42 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:07:42 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:07:42 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:07:42 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75122) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 10:07:42 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "50aef80d-eff3-437a-8bee-b041e49b463e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.043s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:07:42 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c8b3a13-761f-4491-a367-64e74f038629/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:07:42 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c8b3a13-761f-4491-a367-64e74f038629/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:07:42 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c8b3a13-761f-4491-a367-64e74f038629/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:07:42 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4c8b3a13-761f-4491-a367-64e74f038629/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:07:42 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/001d589e-1bee-42da-8422-233ba796fbab/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:07:42 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/001d589e-1bee-42da-8422-233ba796fbab/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:07:42 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/001d589e-1bee-42da-8422-233ba796fbab/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:07:43 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/001d589e-1bee-42da-8422-233ba796fbab/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:07:43 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75122) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 10:07:43 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75122) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 10:07:43 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 10:07:43 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 10:07:43 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Hypervisor/Node resource view: name=user free_ram=8717MB free_disk=24.93463134765625GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75122) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 10:07:43 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:07:43 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:07:43 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance 001d589e-1bee-42da-8422-233ba796fbab actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 10:07:43 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance db848537-676f-464a-806d-febb14d920a6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 10:07:43 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance 4c8b3a13-761f-4491-a367-64e74f038629 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 10:07:43 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance 50aef80d-eff3-437a-8bee-b041e49b463e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 10:07:43 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75122) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 10:07:43 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75122) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 10:07:43 user nova-compute[75122]: DEBUG nova.compute.provider_tree [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Inventory has not changed in ProviderTree for provider: 69a3da65-47be-44c6-b67c-c692b58284ef {{(pid=75122) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 10:07:43 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Inventory has not changed for provider 69a3da65-47be-44c6-b67c-c692b58284ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 10:07:43 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Compute_service record updated for user:user {{(pid=75122) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 10:07:43 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.266s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:07:44 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:07:44 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:07:46 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:07:47 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:07:49 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:07:50 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:07:50 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:07:50 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Starting heal instance info cache {{(pid=75122) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 10:07:50 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "refresh_cache-4c8b3a13-761f-4491-a367-64e74f038629" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 10:07:50 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquired lock "refresh_cache-4c8b3a13-761f-4491-a367-64e74f038629" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 10:07:50 user nova-compute[75122]: DEBUG nova.network.neutron [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] [instance: 4c8b3a13-761f-4491-a367-64e74f038629] Forcefully refreshing network info cache for instance {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 10:07:50 user nova-compute[75122]: DEBUG nova.network.neutron [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] [instance: 4c8b3a13-761f-4491-a367-64e74f038629] Updating instance_info_cache with network_info: [{"id": "e514c549-93ff-4c5e-88ef-2b3301f91069", "address": "fa:16:3e:75:23:6d", "network": {"id": "b780d5c1-a549-4b49-a036-5a272697d4b6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-229344021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c046170a2ad44ebba5d2de236d940be0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape514c549-93", "ovs_interfaceid": "e514c549-93ff-4c5e-88ef-2b3301f91069", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 10:07:50 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Releasing lock "refresh_cache-4c8b3a13-761f-4491-a367-64e74f038629" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 10:07:50 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] [instance: 4c8b3a13-761f-4491-a367-64e74f038629] Updated the network info_cache for instance {{(pid=75122) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 10:07:51 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:07:51 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75122) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 10:07:51 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:07:55 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:07:56 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:07:56 user nova-compute[75122]: DEBUG nova.compute.manager [req-07eccea7-5f17-4285-b1d4-60c36a99fb05 req-72a5c483-95b8-4f92-b870-1e74fd89db3c service nova] [instance: 50aef80d-eff3-437a-8bee-b041e49b463e] Received event network-changed-baef0235-e700-4ba9-b048-ec663bf64a37 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 10:07:56 user nova-compute[75122]: DEBUG nova.compute.manager [req-07eccea7-5f17-4285-b1d4-60c36a99fb05 req-72a5c483-95b8-4f92-b870-1e74fd89db3c service nova] [instance: 50aef80d-eff3-437a-8bee-b041e49b463e] Refreshing instance network info cache due to event network-changed-baef0235-e700-4ba9-b048-ec663bf64a37. {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 10:07:56 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-07eccea7-5f17-4285-b1d4-60c36a99fb05 req-72a5c483-95b8-4f92-b870-1e74fd89db3c service nova] Acquiring lock "refresh_cache-50aef80d-eff3-437a-8bee-b041e49b463e" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 10:07:56 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-07eccea7-5f17-4285-b1d4-60c36a99fb05 req-72a5c483-95b8-4f92-b870-1e74fd89db3c service nova] Acquired lock "refresh_cache-50aef80d-eff3-437a-8bee-b041e49b463e" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 10:07:56 user nova-compute[75122]: DEBUG nova.network.neutron [req-07eccea7-5f17-4285-b1d4-60c36a99fb05 req-72a5c483-95b8-4f92-b870-1e74fd89db3c service nova] [instance: 50aef80d-eff3-437a-8bee-b041e49b463e] Refreshing network info cache for port baef0235-e700-4ba9-b048-ec663bf64a37 {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 10:07:56 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:07:57 user nova-compute[75122]: DEBUG nova.network.neutron [req-07eccea7-5f17-4285-b1d4-60c36a99fb05 req-72a5c483-95b8-4f92-b870-1e74fd89db3c service nova] [instance: 50aef80d-eff3-437a-8bee-b041e49b463e] Updated VIF entry in instance network info cache for port baef0235-e700-4ba9-b048-ec663bf64a37. {{(pid=75122) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 10:07:57 user nova-compute[75122]: DEBUG nova.network.neutron [req-07eccea7-5f17-4285-b1d4-60c36a99fb05 req-72a5c483-95b8-4f92-b870-1e74fd89db3c service nova] [instance: 50aef80d-eff3-437a-8bee-b041e49b463e] Updating instance_info_cache with network_info: [{"id": "baef0235-e700-4ba9-b048-ec663bf64a37", "address": "fa:16:3e:f0:a0:d3", "network": {"id": "03073971-5253-4f06-a46a-94840841fd6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2056706757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7941f36c30b49408ae5709a1b75346d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbaef0235-e7", "ovs_interfaceid": "baef0235-e700-4ba9-b048-ec663bf64a37", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 10:07:57 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-07eccea7-5f17-4285-b1d4-60c36a99fb05 req-72a5c483-95b8-4f92-b870-1e74fd89db3c service nova] Releasing lock "refresh_cache-50aef80d-eff3-437a-8bee-b041e49b463e" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 10:07:57 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-3858faad-abff-46e7-86d4-5b3629c80563 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Acquiring lock "50aef80d-eff3-437a-8bee-b041e49b463e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:07:57 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-3858faad-abff-46e7-86d4-5b3629c80563 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Lock "50aef80d-eff3-437a-8bee-b041e49b463e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:07:57 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-3858faad-abff-46e7-86d4-5b3629c80563 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Acquiring lock "50aef80d-eff3-437a-8bee-b041e49b463e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:07:57 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-3858faad-abff-46e7-86d4-5b3629c80563 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Lock "50aef80d-eff3-437a-8bee-b041e49b463e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:07:57 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-3858faad-abff-46e7-86d4-5b3629c80563 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Lock "50aef80d-eff3-437a-8bee-b041e49b463e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:07:57 user nova-compute[75122]: INFO nova.compute.manager [None req-3858faad-abff-46e7-86d4-5b3629c80563 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 50aef80d-eff3-437a-8bee-b041e49b463e] Terminating instance
Nov 15 10:07:57 user nova-compute[75122]: DEBUG nova.compute.manager [None req-3858faad-abff-46e7-86d4-5b3629c80563 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 50aef80d-eff3-437a-8bee-b041e49b463e] Start destroying the instance on the hypervisor. {{(pid=75122) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 10:07:57 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:07:57 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:07:57 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:07:57 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:07:57 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:07:57 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:07:57 user nova-compute[75122]: INFO nova.virt.libvirt.driver [-] [instance: 50aef80d-eff3-437a-8bee-b041e49b463e] Instance destroyed successfully.
Nov 15 10:07:57 user nova-compute[75122]: DEBUG nova.objects.instance [None req-3858faad-abff-46e7-86d4-5b3629c80563 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Lazy-loading 'resources' on Instance uuid 50aef80d-eff3-437a-8bee-b041e49b463e {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 10:07:57 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-3858faad-abff-46e7-86d4-5b3629c80563 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T10:06:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1773217522',display_name='tempest-TestVolumeBootPattern-server-1773217522',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1773217522',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKHlpBGjgQO8WCWtscnQGPLWQNzcwgXW54O9CXzl/Z/CZ497o/Fb/9rP8/a86D2H+G6HyOK+OZYAd3QjjsdbXOlrlce1txRdWXFLkzlkbTs2rp1mYOku0vjKWQDJeaVaVQ==',key_name='tempest-TestVolumeBootPattern-2035754115',keypairs=<?>,launch_index=0,launched_at=2023-11-15T10:06:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c7941f36c30b49408ae5709a1b75346d',ramdisk_id='',reservation_id='r-rqn6uuq3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-296749341',owner_user_name='tempest-TestVolumeBootPattern-296749341-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T10:06:16Z,user_data=None,user_id='00f5cc88e43c434c8a061dcec472a16b',uuid=50aef80d-eff3-437a-8bee-b041e49b463e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "baef0235-e700-4ba9-b048-ec663bf64a37", "address": "fa:16:3e:f0:a0:d3", "network": {"id": "03073971-5253-4f06-a46a-94840841fd6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2056706757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7941f36c30b49408ae5709a1b75346d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbaef0235-e7", "ovs_interfaceid": "baef0235-e700-4ba9-b048-ec663bf64a37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 10:07:57 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-3858faad-abff-46e7-86d4-5b3629c80563 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Converting VIF {"id": "baef0235-e700-4ba9-b048-ec663bf64a37", "address": "fa:16:3e:f0:a0:d3", "network": {"id": "03073971-5253-4f06-a46a-94840841fd6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2056706757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7941f36c30b49408ae5709a1b75346d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbaef0235-e7", "ovs_interfaceid": "baef0235-e700-4ba9-b048-ec663bf64a37", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 10:07:57 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-3858faad-abff-46e7-86d4-5b3629c80563 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:a0:d3,bridge_name='br-int',has_traffic_filtering=True,id=baef0235-e700-4ba9-b048-ec663bf64a37,network=Network(03073971-5253-4f06-a46a-94840841fd6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbaef0235-e7') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 10:07:57 user nova-compute[75122]: DEBUG os_vif [None req-3858faad-abff-46e7-86d4-5b3629c80563 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:a0:d3,bridge_name='br-int',has_traffic_filtering=True,id=baef0235-e700-4ba9-b048-ec663bf64a37,network=Network(03073971-5253-4f06-a46a-94840841fd6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbaef0235-e7') {{(pid=75122) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 10:07:57 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:07:57 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbaef0235-e7, bridge=br-int, if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 10:07:57 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:07:57 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:07:57 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:07:57 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9883d6c4-927c-46e1-ae62-4b7af92280f0) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 10:07:57 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:07:57 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:07:57 user nova-compute[75122]: INFO os_vif [None req-3858faad-abff-46e7-86d4-5b3629c80563 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:a0:d3,bridge_name='br-int',has_traffic_filtering=True,id=baef0235-e700-4ba9-b048-ec663bf64a37,network=Network(03073971-5253-4f06-a46a-94840841fd6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbaef0235-e7')
Nov 15 10:07:57 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3858faad-abff-46e7-86d4-5b3629c80563 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 50aef80d-eff3-437a-8bee-b041e49b463e] calling os-brick to detach iSCSI Volume {{(pid=75122) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 10:07:57 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-3858faad-abff-46e7-86d4-5b3629c80563 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffa04060b80>, {'target_iqn': 'iqn.2010-10.org.openstack:59ca9506-19c1-4a17-a495-28601cdadf8b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bYFsTknz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 10:07:57 user nova-compute[75122]: WARNING os_brick.initiator.connectors.base [None req-3858faad-abff-46e7-86d4-5b3629c80563 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 10:07:57 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-3858faad-abff-46e7-86d4-5b3629c80563 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 10:07:57 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-3858faad-abff-46e7-86d4-5b3629c80563 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 10:07:57 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:07:57 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:07:57 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[50ef9571-0c7d-41ec-963c-25a5ab21fd06]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:59ca9506-19c1-4a17-a495-28601cdadf8b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8ee79db2-27c2-4d0f-8ee6-5b03e05ebba5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:07:57 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-3858faad-abff-46e7-86d4-5b3629c80563 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 10:07:57 user nova-compute[75122]: No targets found.
Nov 15 10:07:57 user nova-compute[75122]: iSNS:
Nov 15 10:07:57 user nova-compute[75122]: No targets found.
Nov 15 10:07:57 user nova-compute[75122]: STATIC:
Nov 15 10:07:57 user nova-compute[75122]: Target: iqn.2010-10.org.openstack:59ca9506-19c1-4a17-a495-28601cdadf8b
Nov 15 10:07:57 user nova-compute[75122]:         Portal: 172.16.0.220:3260,-1
Nov 15 10:07:57 user nova-compute[75122]:                 Iface Name: default
Nov 15 10:07:57 user nova-compute[75122]: Target: iqn.2010-10.org.openstack:8ee79db2-27c2-4d0f-8ee6-5b03e05ebba5
Nov 15 10:07:57 user nova-compute[75122]:         Portal: 172.16.0.220:3260,-1
Nov 15 10:07:57 user nova-compute[75122]:                 Iface Name: default
Nov 15 10:07:57 user nova-compute[75122]: FIRMWARE:
Nov 15 10:07:57 user nova-compute[75122]: No targets found.
Nov 15 10:07:57 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 10:07:57 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-3858faad-abff-46e7-86d4-5b3629c80563 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 10:07:57 user nova-compute[75122]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 10:07:57 user nova-compute[75122]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75122) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 10:07:57 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-3858faad-abff-46e7-86d4-5b3629c80563 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:59ca9506-19c1-4a17-a495-28601cdadf8b', 0)] {{(pid=75122) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 10:07:57 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:07:57 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:07:57 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[68d2d53c-6a69-4129-b8e0-929b814730ee]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:59ca9506-19c1-4a17-a495-28601cdadf8b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8ee79db2-27c2-4d0f-8ee6-5b03e05ebba5\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:07:57 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:07:58 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:07:58 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7acb8c2-235c-4190-a841-82226a7f4ac2]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee79db2-27c2-4d0f-8ee6-5b03e05ebba5 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59ca9506-19c1-4a17-a495-28601cdadf8b (non-flash)\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:07:58 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-3858faad-abff-46e7-86d4-5b3629c80563 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee79db2-27c2-4d0f-8ee6-5b03e05ebba5 (non-flash)
Nov 15 10:07:58 user nova-compute[75122]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59ca9506-19c1-4a17-a495-28601cdadf8b (non-flash)
Nov 15 10:07:58 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 10:07:58 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-3858faad-abff-46e7-86d4-5b3629c80563 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee79db2-27c2-4d0f-8ee6-5b03e05ebba5 (non-flash)
Nov 15 10:07:58 user nova-compute[75122]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59ca9506-19c1-4a17-a495-28601cdadf8b (non-flash)
Nov 15 10:07:58 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 10:07:58 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-3858faad-abff-46e7-86d4-5b3629c80563 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ffa041b9360>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:59ca9506-19c1-4a17-a495-28601cdadf8b'): ({'sdc'}, set())}) {{(pid=75122) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 10:07:58 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-3858faad-abff-46e7-86d4-5b3629c80563 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Removing single pathed devices sdc {{(pid=75122) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 10:07:58 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:07:58 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:07:58 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[737aa7a7-110d-4f52-80c8-e23125513b72]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:07:58 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:07:58 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:07:58 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[72c29b9e-0489-4c56-af5c-1f7b8df0050b]: (4, ('ok\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:07:58 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-3858faad-abff-46e7-86d4-5b3629c80563 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Flushing IO for device /dev/sdc {{(pid=75122) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 10:07:58 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:07:58 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:07:58 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e33fca3-6733-4002-8546-01e6ddd3f28a]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:07:58 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-3858faad-abff-46e7-86d4-5b3629c80563 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75122) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 10:07:58 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:07:58 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.046s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:07:58 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f8a8f33-20d8-48db-8760-828c8caf8070]: (4, ('1', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:07:58 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-3858faad-abff-46e7-86d4-5b3629c80563 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75122) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 10:07:58 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-3858faad-abff-46e7-86d4-5b3629c80563 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] SCSI volumes sdc have been removed. {{(pid=75122) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 10:07:58 user nova-compute[75122]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23664656631313830', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_29b1ae9d', '/dev/disk/by-id/scsi-1SCST_BIO29b1ae9d-6def118064c32bd7') {{(pid=85998) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 15 10:07:58 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab18cfe4-805f-4cca-8290-9fc2a2bed4ef]: (4, None) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:07:58 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-3858faad-abff-46e7-86d4-5b3629c80563 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:59ca9506-19c1-4a17-a495-28601cdadf8b')] {{(pid=75122) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 10:07:58 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59ca9506-19c1-4a17-a495-28601cdadf8b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:07:58 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59ca9506-19c1-4a17-a495-28601cdadf8b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:07:58 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d07044c-37f4-4516-89cf-8d8763067c8f]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:07:58 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-3858faad-abff-46e7-86d4-5b3629c80563 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 10:07:58 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59ca9506-19c1-4a17-a495-28601cdadf8b -p 172.16.0.220:3260 --logout {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:07:58 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59ca9506-19c1-4a17-a495-28601cdadf8b -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:07:58 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[33b1ac71-21ee-40d2-818e-8d259d36bb8f]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:59ca9506-19c1-4a17-a495-28601cdadf8b, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:59ca9506-19c1-4a17-a495-28601cdadf8b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:07:58 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-3858faad-abff-46e7-86d4-5b3629c80563 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:59ca9506-19c1-4a17-a495-28601cdadf8b, portal: 172.16.0.220,3260]
Nov 15 10:07:58 user nova-compute[75122]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:59ca9506-19c1-4a17-a495-28601cdadf8b, portal: 172.16.0.220,3260] successful.
Nov 15 10:07:58 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 10:07:58 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59ca9506-19c1-4a17-a495-28601cdadf8b -p 172.16.0.220:3260 --op delete {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:07:58 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59ca9506-19c1-4a17-a495-28601cdadf8b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:07:58 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[82759191-3bff-4499-853d-db29d3745eb8]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:07:58 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-3858faad-abff-46e7-86d4-5b3629c80563 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 10:07:58 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-3858faad-abff-46e7-86d4-5b3629c80563 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.290s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 10:07:58 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-3858faad-abff-46e7-86d4-5b3629c80563 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] <== disconnect_volume: return (292ms) None {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 10:07:58 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3858faad-abff-46e7-86d4-5b3629c80563 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 50aef80d-eff3-437a-8bee-b041e49b463e] Disconnected iSCSI Volume {{(pid=75122) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 10:07:58 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-3858faad-abff-46e7-86d4-5b3629c80563 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 50aef80d-eff3-437a-8bee-b041e49b463e] Deleting instance files /opt/stack/data/nova/instances/50aef80d-eff3-437a-8bee-b041e49b463e_del
Nov 15 10:07:58 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-3858faad-abff-46e7-86d4-5b3629c80563 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 50aef80d-eff3-437a-8bee-b041e49b463e] Deletion of /opt/stack/data/nova/instances/50aef80d-eff3-437a-8bee-b041e49b463e_del complete
Nov 15 10:07:58 user nova-compute[75122]: INFO nova.compute.manager [None req-3858faad-abff-46e7-86d4-5b3629c80563 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 50aef80d-eff3-437a-8bee-b041e49b463e] Took 1.17 seconds to destroy the instance on the hypervisor.
Nov 15 10:07:58 user nova-compute[75122]: DEBUG oslo.service.loopingcall [None req-3858faad-abff-46e7-86d4-5b3629c80563 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75122) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 10:07:58 user nova-compute[75122]: DEBUG nova.compute.manager [-] [instance: 50aef80d-eff3-437a-8bee-b041e49b463e] Deallocating network for instance {{(pid=75122) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 10:07:58 user nova-compute[75122]: DEBUG nova.network.neutron [-] [instance: 50aef80d-eff3-437a-8bee-b041e49b463e] deallocate_for_instance() {{(pid=75122) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 10:07:58 user nova-compute[75122]: DEBUG nova.compute.manager [req-c43440bc-74eb-4b2e-8883-076ff1bf8f53 req-a18615d2-407b-46bb-bc8c-5bc05b6dd8df service nova] [instance: 50aef80d-eff3-437a-8bee-b041e49b463e] Received event network-vif-unplugged-baef0235-e700-4ba9-b048-ec663bf64a37 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 10:07:58 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-c43440bc-74eb-4b2e-8883-076ff1bf8f53 req-a18615d2-407b-46bb-bc8c-5bc05b6dd8df service nova] Acquiring lock "50aef80d-eff3-437a-8bee-b041e49b463e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:07:58 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-c43440bc-74eb-4b2e-8883-076ff1bf8f53 req-a18615d2-407b-46bb-bc8c-5bc05b6dd8df service nova] Lock "50aef80d-eff3-437a-8bee-b041e49b463e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:07:58 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-c43440bc-74eb-4b2e-8883-076ff1bf8f53 req-a18615d2-407b-46bb-bc8c-5bc05b6dd8df service nova] Lock "50aef80d-eff3-437a-8bee-b041e49b463e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:07:58 user nova-compute[75122]: DEBUG nova.compute.manager [req-c43440bc-74eb-4b2e-8883-076ff1bf8f53 req-a18615d2-407b-46bb-bc8c-5bc05b6dd8df service nova] [instance: 50aef80d-eff3-437a-8bee-b041e49b463e] No waiting events found dispatching network-vif-unplugged-baef0235-e700-4ba9-b048-ec663bf64a37 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 10:07:58 user nova-compute[75122]: DEBUG nova.compute.manager [req-c43440bc-74eb-4b2e-8883-076ff1bf8f53 req-a18615d2-407b-46bb-bc8c-5bc05b6dd8df service nova] [instance: 50aef80d-eff3-437a-8bee-b041e49b463e] Received event network-vif-unplugged-baef0235-e700-4ba9-b048-ec663bf64a37 for instance with task_state deleting. {{(pid=75122) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 10:07:58 user nova-compute[75122]: DEBUG nova.compute.manager [req-c43440bc-74eb-4b2e-8883-076ff1bf8f53 req-a18615d2-407b-46bb-bc8c-5bc05b6dd8df service nova] [instance: 50aef80d-eff3-437a-8bee-b041e49b463e] Received event network-vif-plugged-baef0235-e700-4ba9-b048-ec663bf64a37 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 10:07:58 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-c43440bc-74eb-4b2e-8883-076ff1bf8f53 req-a18615d2-407b-46bb-bc8c-5bc05b6dd8df service nova] Acquiring lock "50aef80d-eff3-437a-8bee-b041e49b463e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:07:58 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-c43440bc-74eb-4b2e-8883-076ff1bf8f53 req-a18615d2-407b-46bb-bc8c-5bc05b6dd8df service nova] Lock "50aef80d-eff3-437a-8bee-b041e49b463e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:07:58 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-c43440bc-74eb-4b2e-8883-076ff1bf8f53 req-a18615d2-407b-46bb-bc8c-5bc05b6dd8df service nova] Lock "50aef80d-eff3-437a-8bee-b041e49b463e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:07:58 user nova-compute[75122]: DEBUG nova.compute.manager [req-c43440bc-74eb-4b2e-8883-076ff1bf8f53 req-a18615d2-407b-46bb-bc8c-5bc05b6dd8df service nova] [instance: 50aef80d-eff3-437a-8bee-b041e49b463e] No waiting events found dispatching network-vif-plugged-baef0235-e700-4ba9-b048-ec663bf64a37 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 10:07:58 user nova-compute[75122]: WARNING nova.compute.manager [req-c43440bc-74eb-4b2e-8883-076ff1bf8f53 req-a18615d2-407b-46bb-bc8c-5bc05b6dd8df service nova] [instance: 50aef80d-eff3-437a-8bee-b041e49b463e] Received unexpected event network-vif-plugged-baef0235-e700-4ba9-b048-ec663bf64a37 for instance with vm_state active and task_state deleting.
Nov 15 10:07:59 user nova-compute[75122]: DEBUG nova.network.neutron [-] [instance: 50aef80d-eff3-437a-8bee-b041e49b463e] Updating instance_info_cache with network_info: [] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 10:07:59 user nova-compute[75122]: INFO nova.compute.manager [-] [instance: 50aef80d-eff3-437a-8bee-b041e49b463e] Took 0.80 seconds to deallocate network for instance.
Nov 15 10:07:59 user nova-compute[75122]: DEBUG nova.compute.manager [req-3099de29-b943-4f81-94c1-a89ddf7618ce req-ebff5179-74e6-4ff2-babc-cfc5c40a9801 service nova] [instance: 50aef80d-eff3-437a-8bee-b041e49b463e] Received event network-vif-deleted-baef0235-e700-4ba9-b048-ec663bf64a37 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 10:07:59 user nova-compute[75122]: INFO nova.compute.manager [req-3099de29-b943-4f81-94c1-a89ddf7618ce req-ebff5179-74e6-4ff2-babc-cfc5c40a9801 service nova] [instance: 50aef80d-eff3-437a-8bee-b041e49b463e] Neutron deleted interface baef0235-e700-4ba9-b048-ec663bf64a37; detaching it from the instance and deleting it from the info cache
Nov 15 10:07:59 user nova-compute[75122]: DEBUG nova.network.neutron [req-3099de29-b943-4f81-94c1-a89ddf7618ce req-ebff5179-74e6-4ff2-babc-cfc5c40a9801 service nova] [instance: 50aef80d-eff3-437a-8bee-b041e49b463e] Updating instance_info_cache with network_info: [] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 10:07:59 user nova-compute[75122]: DEBUG nova.compute.manager [req-3099de29-b943-4f81-94c1-a89ddf7618ce req-ebff5179-74e6-4ff2-babc-cfc5c40a9801 service nova] [instance: 50aef80d-eff3-437a-8bee-b041e49b463e] Detach interface failed, port_id=baef0235-e700-4ba9-b048-ec663bf64a37, reason: Instance 50aef80d-eff3-437a-8bee-b041e49b463e could not be found. {{(pid=75122) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 10:08:00 user nova-compute[75122]: INFO nova.compute.manager [None req-3858faad-abff-46e7-86d4-5b3629c80563 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 50aef80d-eff3-437a-8bee-b041e49b463e] Took 0.90 seconds to detach 1 volumes for instance.
Nov 15 10:08:00 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-3858faad-abff-46e7-86d4-5b3629c80563 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:08:00 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-3858faad-abff-46e7-86d4-5b3629c80563 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:08:00 user nova-compute[75122]: DEBUG nova.compute.provider_tree [None req-3858faad-abff-46e7-86d4-5b3629c80563 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Inventory has not changed in ProviderTree for provider: 69a3da65-47be-44c6-b67c-c692b58284ef {{(pid=75122) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 10:08:00 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-3858faad-abff-46e7-86d4-5b3629c80563 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Inventory has not changed for provider 69a3da65-47be-44c6-b67c-c692b58284ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 10:08:00 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-3858faad-abff-46e7-86d4-5b3629c80563 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.275s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:08:00 user nova-compute[75122]: INFO nova.scheduler.client.report [None req-3858faad-abff-46e7-86d4-5b3629c80563 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Deleted allocations for instance 50aef80d-eff3-437a-8bee-b041e49b463e
Nov 15 10:08:00 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-3858faad-abff-46e7-86d4-5b3629c80563 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Lock "50aef80d-eff3-437a-8bee-b041e49b463e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.324s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:08:01 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-5fe2355f-7d08-4dc9-b033-c0c6432fd95e tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Acquiring lock "4c8b3a13-761f-4491-a367-64e74f038629" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:08:01 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-5fe2355f-7d08-4dc9-b033-c0c6432fd95e tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Lock "4c8b3a13-761f-4491-a367-64e74f038629" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:08:01 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-5fe2355f-7d08-4dc9-b033-c0c6432fd95e tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Acquiring lock "4c8b3a13-761f-4491-a367-64e74f038629-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:08:01 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-5fe2355f-7d08-4dc9-b033-c0c6432fd95e tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Lock "4c8b3a13-761f-4491-a367-64e74f038629-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:08:01 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-5fe2355f-7d08-4dc9-b033-c0c6432fd95e tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Lock "4c8b3a13-761f-4491-a367-64e74f038629-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:08:01 user nova-compute[75122]: INFO nova.compute.manager [None req-5fe2355f-7d08-4dc9-b033-c0c6432fd95e tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: 4c8b3a13-761f-4491-a367-64e74f038629] Terminating instance
Nov 15 10:08:01 user nova-compute[75122]: DEBUG nova.compute.manager [None req-5fe2355f-7d08-4dc9-b033-c0c6432fd95e tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: 4c8b3a13-761f-4491-a367-64e74f038629] Start destroying the instance on the hypervisor. {{(pid=75122) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 10:08:01 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:08:01 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:08:01 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:08:01 user nova-compute[75122]: DEBUG nova.compute.manager [req-59d37adc-1e21-4b05-8529-4b09d29a7398 req-5b67a00f-71ae-44e5-aa4f-fe484a757eaa service nova] [instance: 4c8b3a13-761f-4491-a367-64e74f038629] Received event network-vif-unplugged-e514c549-93ff-4c5e-88ef-2b3301f91069 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 10:08:01 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-59d37adc-1e21-4b05-8529-4b09d29a7398 req-5b67a00f-71ae-44e5-aa4f-fe484a757eaa service nova] Acquiring lock "4c8b3a13-761f-4491-a367-64e74f038629-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:08:01 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-59d37adc-1e21-4b05-8529-4b09d29a7398 req-5b67a00f-71ae-44e5-aa4f-fe484a757eaa service nova] Lock "4c8b3a13-761f-4491-a367-64e74f038629-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:08:01 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-59d37adc-1e21-4b05-8529-4b09d29a7398 req-5b67a00f-71ae-44e5-aa4f-fe484a757eaa service nova] Lock "4c8b3a13-761f-4491-a367-64e74f038629-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:08:01 user nova-compute[75122]: DEBUG nova.compute.manager [req-59d37adc-1e21-4b05-8529-4b09d29a7398 req-5b67a00f-71ae-44e5-aa4f-fe484a757eaa service nova] [instance: 4c8b3a13-761f-4491-a367-64e74f038629] No waiting events found dispatching network-vif-unplugged-e514c549-93ff-4c5e-88ef-2b3301f91069 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 10:08:01 user nova-compute[75122]: DEBUG nova.compute.manager [req-59d37adc-1e21-4b05-8529-4b09d29a7398 req-5b67a00f-71ae-44e5-aa4f-fe484a757eaa service nova] [instance: 4c8b3a13-761f-4491-a367-64e74f038629] Received event network-vif-unplugged-e514c549-93ff-4c5e-88ef-2b3301f91069 for instance with task_state deleting. {{(pid=75122) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 10:08:01 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:08:01 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-780f153a-e634-4387-bf2f-775b2be8ef74 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Acquiring lock "5bb980be-c2eb-42eb-a84b-5d29592259a4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:08:01 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-780f153a-e634-4387-bf2f-775b2be8ef74 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Lock "5bb980be-c2eb-42eb-a84b-5d29592259a4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:08:01 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:08:02 user nova-compute[75122]: DEBUG nova.compute.manager [None req-780f153a-e634-4387-bf2f-775b2be8ef74 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] [instance: 5bb980be-c2eb-42eb-a84b-5d29592259a4] Starting instance... {{(pid=75122) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 10:08:02 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-780f153a-e634-4387-bf2f-775b2be8ef74 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:08:02 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-780f153a-e634-4387-bf2f-775b2be8ef74 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:08:02 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-780f153a-e634-4387-bf2f-775b2be8ef74 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75122) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 10:08:02 user nova-compute[75122]: INFO nova.compute.claims [None req-780f153a-e634-4387-bf2f-775b2be8ef74 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] [instance: 5bb980be-c2eb-42eb-a84b-5d29592259a4] Claim successful on node user
Nov 15 10:08:02 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:08:02 user nova-compute[75122]: INFO nova.virt.libvirt.driver [-] [instance: 4c8b3a13-761f-4491-a367-64e74f038629] Instance destroyed successfully.
Nov 15 10:08:02 user nova-compute[75122]: DEBUG nova.objects.instance [None req-5fe2355f-7d08-4dc9-b033-c0c6432fd95e tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Lazy-loading 'resources' on Instance uuid 4c8b3a13-761f-4491-a367-64e74f038629 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 10:08:02 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-5fe2355f-7d08-4dc9-b033-c0c6432fd95e tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T09:58:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1482513896',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1482513896',id=43,image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T09:58:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c046170a2ad44ebba5d2de236d940be0',ramdisk_id='',reservation_id='r-544eo77i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1545444983',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T10:00:36Z,user_data=None,user_id='53d187e2a07b4437a02f65fb47a003ee',uuid=4c8b3a13-761f-4491-a367-64e74f038629,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e514c549-93ff-4c5e-88ef-2b3301f91069", "address": "fa:16:3e:75:23:6d", "network": {"id": "b780d5c1-a549-4b49-a036-5a272697d4b6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-229344021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c046170a2ad44ebba5d2de236d940be0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape514c549-93", "ovs_interfaceid": "e514c549-93ff-4c5e-88ef-2b3301f91069", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 10:08:02 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-5fe2355f-7d08-4dc9-b033-c0c6432fd95e tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Converting VIF {"id": "e514c549-93ff-4c5e-88ef-2b3301f91069", "address": "fa:16:3e:75:23:6d", "network": {"id": "b780d5c1-a549-4b49-a036-5a272697d4b6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-229344021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c046170a2ad44ebba5d2de236d940be0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape514c549-93", "ovs_interfaceid": "e514c549-93ff-4c5e-88ef-2b3301f91069", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 10:08:02 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-5fe2355f-7d08-4dc9-b033-c0c6432fd95e tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:75:23:6d,bridge_name='br-int',has_traffic_filtering=True,id=e514c549-93ff-4c5e-88ef-2b3301f91069,network=Network(b780d5c1-a549-4b49-a036-5a272697d4b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape514c549-93') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 10:08:02 user nova-compute[75122]: DEBUG os_vif [None req-5fe2355f-7d08-4dc9-b033-c0c6432fd95e tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:75:23:6d,bridge_name='br-int',has_traffic_filtering=True,id=e514c549-93ff-4c5e-88ef-2b3301f91069,network=Network(b780d5c1-a549-4b49-a036-5a272697d4b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape514c549-93') {{(pid=75122) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 10:08:02 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:08:02 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape514c549-93, bridge=br-int, if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 10:08:02 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:08:02 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:08:02 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:08:02 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=66275f32-699f-4c42-bbbd-7c7265e70800) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 10:08:02 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:08:02 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:08:02 user nova-compute[75122]: INFO os_vif [None req-5fe2355f-7d08-4dc9-b033-c0c6432fd95e tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:75:23:6d,bridge_name='br-int',has_traffic_filtering=True,id=e514c549-93ff-4c5e-88ef-2b3301f91069,network=Network(b780d5c1-a549-4b49-a036-5a272697d4b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape514c549-93')
Nov 15 10:08:02 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-5fe2355f-7d08-4dc9-b033-c0c6432fd95e tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: 4c8b3a13-761f-4491-a367-64e74f038629] Deleting instance files /opt/stack/data/nova/instances/4c8b3a13-761f-4491-a367-64e74f038629_del
Nov 15 10:08:02 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-5fe2355f-7d08-4dc9-b033-c0c6432fd95e tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: 4c8b3a13-761f-4491-a367-64e74f038629] Deletion of /opt/stack/data/nova/instances/4c8b3a13-761f-4491-a367-64e74f038629_del complete
Nov 15 10:08:02 user nova-compute[75122]: DEBUG nova.compute.provider_tree [None req-780f153a-e634-4387-bf2f-775b2be8ef74 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Inventory has not changed in ProviderTree for provider: 69a3da65-47be-44c6-b67c-c692b58284ef {{(pid=75122) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 10:08:02 user nova-compute[75122]: INFO nova.compute.manager [None req-5fe2355f-7d08-4dc9-b033-c0c6432fd95e tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: 4c8b3a13-761f-4491-a367-64e74f038629] Took 0.68 seconds to destroy the instance on the hypervisor.
Nov 15 10:08:02 user nova-compute[75122]: DEBUG oslo.service.loopingcall [None req-5fe2355f-7d08-4dc9-b033-c0c6432fd95e tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75122) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 10:08:02 user nova-compute[75122]: DEBUG nova.compute.manager [-] [instance: 4c8b3a13-761f-4491-a367-64e74f038629] Deallocating network for instance {{(pid=75122) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 10:08:02 user nova-compute[75122]: DEBUG nova.network.neutron [-] [instance: 4c8b3a13-761f-4491-a367-64e74f038629] deallocate_for_instance() {{(pid=75122) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 10:08:02 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-780f153a-e634-4387-bf2f-775b2be8ef74 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Inventory has not changed for provider 69a3da65-47be-44c6-b67c-c692b58284ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 10:08:02 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-780f153a-e634-4387-bf2f-775b2be8ef74 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.316s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:08:02 user nova-compute[75122]: DEBUG nova.compute.manager [None req-780f153a-e634-4387-bf2f-775b2be8ef74 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] [instance: 5bb980be-c2eb-42eb-a84b-5d29592259a4] Start building networks asynchronously for instance. {{(pid=75122) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 10:08:02 user nova-compute[75122]: DEBUG nova.compute.manager [None req-780f153a-e634-4387-bf2f-775b2be8ef74 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] [instance: 5bb980be-c2eb-42eb-a84b-5d29592259a4] Allocating IP information in the background. {{(pid=75122) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 10:08:02 user nova-compute[75122]: DEBUG nova.network.neutron [None req-780f153a-e634-4387-bf2f-775b2be8ef74 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] [instance: 5bb980be-c2eb-42eb-a84b-5d29592259a4] allocate_for_instance() {{(pid=75122) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 10:08:02 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-780f153a-e634-4387-bf2f-775b2be8ef74 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] [instance: 5bb980be-c2eb-42eb-a84b-5d29592259a4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 10:08:02 user nova-compute[75122]: DEBUG nova.compute.manager [None req-780f153a-e634-4387-bf2f-775b2be8ef74 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] [instance: 5bb980be-c2eb-42eb-a84b-5d29592259a4] Start building block device mappings for instance. {{(pid=75122) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 10:08:02 user nova-compute[75122]: DEBUG nova.policy [None req-780f153a-e634-4387-bf2f-775b2be8ef74 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f18eb706375c4b2e9e7de793cd2950ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab6afbe7809a4ad3921cbc18145d1816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75122) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 10:08:02 user nova-compute[75122]: DEBUG nova.compute.manager [None req-780f153a-e634-4387-bf2f-775b2be8ef74 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] [instance: 5bb980be-c2eb-42eb-a84b-5d29592259a4] Start spawning the instance on the hypervisor. {{(pid=75122) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 10:08:02 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-780f153a-e634-4387-bf2f-775b2be8ef74 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] [instance: 5bb980be-c2eb-42eb-a84b-5d29592259a4] Creating instance directory {{(pid=75122) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 10:08:02 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-780f153a-e634-4387-bf2f-775b2be8ef74 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] [instance: 5bb980be-c2eb-42eb-a84b-5d29592259a4] Creating image(s)
Nov 15 10:08:02 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-780f153a-e634-4387-bf2f-775b2be8ef74 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Acquiring lock "/opt/stack/data/nova/instances/5bb980be-c2eb-42eb-a84b-5d29592259a4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:08:02 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-780f153a-e634-4387-bf2f-775b2be8ef74 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Lock "/opt/stack/data/nova/instances/5bb980be-c2eb-42eb-a84b-5d29592259a4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:08:02 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-780f153a-e634-4387-bf2f-775b2be8ef74 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Lock "/opt/stack/data/nova/instances/5bb980be-c2eb-42eb-a84b-5d29592259a4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:08:02 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-780f153a-e634-4387-bf2f-775b2be8ef74 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:08:02 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-780f153a-e634-4387-bf2f-775b2be8ef74 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json" returned: 0 in 0.171s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:08:02 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-780f153a-e634-4387-bf2f-775b2be8ef74 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Acquiring lock "95d6e29f74d5408f818e32f3bc29bc8270a4c665" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:08:02 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-780f153a-e634-4387-bf2f-775b2be8ef74 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Lock "95d6e29f74d5408f818e32f3bc29bc8270a4c665" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:08:02 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-780f153a-e634-4387-bf2f-775b2be8ef74 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:08:02 user nova-compute[75122]: DEBUG nova.network.neutron [-] [instance: 4c8b3a13-761f-4491-a367-64e74f038629] Updating instance_info_cache with network_info: [] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 10:08:02 user nova-compute[75122]: DEBUG nova.compute.manager [req-84eb6482-7438-4370-93c3-6c0d69d85522 req-1f4804bf-53db-4f92-a2cb-6cee9de091f2 service nova] [instance: 4c8b3a13-761f-4491-a367-64e74f038629] Received event network-vif-deleted-e514c549-93ff-4c5e-88ef-2b3301f91069 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 10:08:02 user nova-compute[75122]: INFO nova.compute.manager [req-84eb6482-7438-4370-93c3-6c0d69d85522 req-1f4804bf-53db-4f92-a2cb-6cee9de091f2 service nova] [instance: 4c8b3a13-761f-4491-a367-64e74f038629] Neutron deleted interface e514c549-93ff-4c5e-88ef-2b3301f91069; detaching it from the instance and deleting it from the info cache
Nov 15 10:08:02 user nova-compute[75122]: DEBUG nova.network.neutron [req-84eb6482-7438-4370-93c3-6c0d69d85522 req-1f4804bf-53db-4f92-a2cb-6cee9de091f2 service nova] [instance: 4c8b3a13-761f-4491-a367-64e74f038629] Updating instance_info_cache with network_info: [] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 10:08:02 user nova-compute[75122]: INFO nova.compute.manager [-] [instance: 4c8b3a13-761f-4491-a367-64e74f038629] Took 0.54 seconds to deallocate network for instance.
Nov 15 10:08:02 user nova-compute[75122]: DEBUG nova.compute.manager [req-84eb6482-7438-4370-93c3-6c0d69d85522 req-1f4804bf-53db-4f92-a2cb-6cee9de091f2 service nova] [instance: 4c8b3a13-761f-4491-a367-64e74f038629] Detach interface failed, port_id=e514c549-93ff-4c5e-88ef-2b3301f91069, reason: Instance 4c8b3a13-761f-4491-a367-64e74f038629 could not be found. {{(pid=75122) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 10:08:02 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-5fe2355f-7d08-4dc9-b033-c0c6432fd95e tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:08:02 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-5fe2355f-7d08-4dc9-b033-c0c6432fd95e tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:08:03 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-780f153a-e634-4387-bf2f-775b2be8ef74 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json" returned: 0 in 0.173s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:08:03 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-780f153a-e634-4387-bf2f-775b2be8ef74 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665,backing_fmt=raw /opt/stack/data/nova/instances/5bb980be-c2eb-42eb-a84b-5d29592259a4/disk 1073741824 {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:08:03 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-780f153a-e634-4387-bf2f-775b2be8ef74 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665,backing_fmt=raw /opt/stack/data/nova/instances/5bb980be-c2eb-42eb-a84b-5d29592259a4/disk 1073741824" returned: 0 in 0.053s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:08:03 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-780f153a-e634-4387-bf2f-775b2be8ef74 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Lock "95d6e29f74d5408f818e32f3bc29bc8270a4c665" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.230s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:08:03 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-780f153a-e634-4387-bf2f-775b2be8ef74 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:08:03 user nova-compute[75122]: DEBUG nova.network.neutron [None req-780f153a-e634-4387-bf2f-775b2be8ef74 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] [instance: 5bb980be-c2eb-42eb-a84b-5d29592259a4] Successfully created port: 5dcdd286-bee6-43e0-96d4-a42d060b6158 {{(pid=75122) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 10:08:03 user nova-compute[75122]: DEBUG nova.compute.provider_tree [None req-5fe2355f-7d08-4dc9-b033-c0c6432fd95e tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Inventory has not changed in ProviderTree for provider: 69a3da65-47be-44c6-b67c-c692b58284ef {{(pid=75122) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 10:08:03 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-5fe2355f-7d08-4dc9-b033-c0c6432fd95e tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Inventory has not changed for provider 69a3da65-47be-44c6-b67c-c692b58284ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 10:08:03 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-780f153a-e634-4387-bf2f-775b2be8ef74 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json" returned: 0 in 0.190s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:08:03 user nova-compute[75122]: DEBUG nova.virt.disk.api [None req-780f153a-e634-4387-bf2f-775b2be8ef74 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5bb980be-c2eb-42eb-a84b-5d29592259a4/disk. size=1073741824 {{(pid=75122) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 10:08:03 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-780f153a-e634-4387-bf2f-775b2be8ef74 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bb980be-c2eb-42eb-a84b-5d29592259a4/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:08:03 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-5fe2355f-7d08-4dc9-b033-c0c6432fd95e tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.317s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:08:03 user nova-compute[75122]: INFO nova.scheduler.client.report [None req-5fe2355f-7d08-4dc9-b033-c0c6432fd95e tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Deleted allocations for instance 4c8b3a13-761f-4491-a367-64e74f038629
Nov 15 10:08:03 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-780f153a-e634-4387-bf2f-775b2be8ef74 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bb980be-c2eb-42eb-a84b-5d29592259a4/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:08:03 user nova-compute[75122]: DEBUG nova.virt.disk.api [None req-780f153a-e634-4387-bf2f-775b2be8ef74 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Cannot resize image /opt/stack/data/nova/instances/5bb980be-c2eb-42eb-a84b-5d29592259a4/disk to a smaller size. {{(pid=75122) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 10:08:03 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-780f153a-e634-4387-bf2f-775b2be8ef74 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] [instance: 5bb980be-c2eb-42eb-a84b-5d29592259a4] Created local disks {{(pid=75122) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 10:08:03 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-780f153a-e634-4387-bf2f-775b2be8ef74 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] [instance: 5bb980be-c2eb-42eb-a84b-5d29592259a4] Ensure instance console log exists: /opt/stack/data/nova/instances/5bb980be-c2eb-42eb-a84b-5d29592259a4/console.log {{(pid=75122) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 10:08:03 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-780f153a-e634-4387-bf2f-775b2be8ef74 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:08:03 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-780f153a-e634-4387-bf2f-775b2be8ef74 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:08:03 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-780f153a-e634-4387-bf2f-775b2be8ef74 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:08:03 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-5fe2355f-7d08-4dc9-b033-c0c6432fd95e tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Lock "4c8b3a13-761f-4491-a367-64e74f038629" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.775s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:08:03 user nova-compute[75122]: DEBUG nova.network.neutron [None req-780f153a-e634-4387-bf2f-775b2be8ef74 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] [instance: 5bb980be-c2eb-42eb-a84b-5d29592259a4] Successfully updated port: 5dcdd286-bee6-43e0-96d4-a42d060b6158 {{(pid=75122) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 10:08:03 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-780f153a-e634-4387-bf2f-775b2be8ef74 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Acquiring lock "refresh_cache-5bb980be-c2eb-42eb-a84b-5d29592259a4" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 10:08:03 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-780f153a-e634-4387-bf2f-775b2be8ef74 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Acquired lock "refresh_cache-5bb980be-c2eb-42eb-a84b-5d29592259a4" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 10:08:03 user nova-compute[75122]: DEBUG nova.network.neutron [None req-780f153a-e634-4387-bf2f-775b2be8ef74 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] [instance: 5bb980be-c2eb-42eb-a84b-5d29592259a4] Building network info cache for instance {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 10:08:03 user nova-compute[75122]: DEBUG nova.compute.manager [req-83b81c1a-a959-4f89-b45d-fdd5ef9246cc req-1f6dadd5-9954-41ea-945c-e93e0206e028 service nova] [instance: 5bb980be-c2eb-42eb-a84b-5d29592259a4] Received event network-changed-5dcdd286-bee6-43e0-96d4-a42d060b6158 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 10:08:03 user nova-compute[75122]: DEBUG nova.compute.manager [req-83b81c1a-a959-4f89-b45d-fdd5ef9246cc req-1f6dadd5-9954-41ea-945c-e93e0206e028 service nova] [instance: 5bb980be-c2eb-42eb-a84b-5d29592259a4] Refreshing instance network info cache due to event network-changed-5dcdd286-bee6-43e0-96d4-a42d060b6158. {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 10:08:03 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-83b81c1a-a959-4f89-b45d-fdd5ef9246cc req-1f6dadd5-9954-41ea-945c-e93e0206e028 service nova] Acquiring lock "refresh_cache-5bb980be-c2eb-42eb-a84b-5d29592259a4" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 10:08:03 user nova-compute[75122]: DEBUG nova.network.neutron [None req-780f153a-e634-4387-bf2f-775b2be8ef74 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] [instance: 5bb980be-c2eb-42eb-a84b-5d29592259a4] Instance cache missing network info. {{(pid=75122) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 10:08:03 user nova-compute[75122]: DEBUG nova.compute.manager [req-6e7c72ad-1f64-4a8d-b7b1-c25c22158ff8 req-adea2ae2-c1bc-4b0e-af1c-86b464a98f51 service nova] [instance: 4c8b3a13-761f-4491-a367-64e74f038629] Received event network-vif-plugged-e514c549-93ff-4c5e-88ef-2b3301f91069 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 10:08:03 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-6e7c72ad-1f64-4a8d-b7b1-c25c22158ff8 req-adea2ae2-c1bc-4b0e-af1c-86b464a98f51 service nova] Acquiring lock "4c8b3a13-761f-4491-a367-64e74f038629-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:08:03 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-6e7c72ad-1f64-4a8d-b7b1-c25c22158ff8 req-adea2ae2-c1bc-4b0e-af1c-86b464a98f51 service nova] Lock "4c8b3a13-761f-4491-a367-64e74f038629-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:08:03 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-6e7c72ad-1f64-4a8d-b7b1-c25c22158ff8 req-adea2ae2-c1bc-4b0e-af1c-86b464a98f51 service nova] Lock "4c8b3a13-761f-4491-a367-64e74f038629-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:08:03 user nova-compute[75122]: DEBUG nova.compute.manager [req-6e7c72ad-1f64-4a8d-b7b1-c25c22158ff8 req-adea2ae2-c1bc-4b0e-af1c-86b464a98f51 service nova] [instance: 4c8b3a13-761f-4491-a367-64e74f038629] No waiting events found dispatching network-vif-plugged-e514c549-93ff-4c5e-88ef-2b3301f91069 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 10:08:03 user nova-compute[75122]: WARNING nova.compute.manager [req-6e7c72ad-1f64-4a8d-b7b1-c25c22158ff8 req-adea2ae2-c1bc-4b0e-af1c-86b464a98f51 service nova] [instance: 4c8b3a13-761f-4491-a367-64e74f038629] Received unexpected event network-vif-plugged-e514c549-93ff-4c5e-88ef-2b3301f91069 for instance with vm_state deleted and task_state None.
Nov 15 10:08:04 user nova-compute[75122]: DEBUG nova.network.neutron [None req-780f153a-e634-4387-bf2f-775b2be8ef74 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] [instance: 5bb980be-c2eb-42eb-a84b-5d29592259a4] Updating instance_info_cache with network_info: [{"id": "5dcdd286-bee6-43e0-96d4-a42d060b6158", "address": "fa:16:3e:67:41:8c", "network": {"id": "8c1491a5-d5c6-4a22-84fd-bdeca00bbaad", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1848328203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab6afbe7809a4ad3921cbc18145d1816", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5dcdd286-be", "ovs_interfaceid": "5dcdd286-bee6-43e0-96d4-a42d060b6158", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 10:08:04 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-780f153a-e634-4387-bf2f-775b2be8ef74 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Releasing lock "refresh_cache-5bb980be-c2eb-42eb-a84b-5d29592259a4" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 10:08:04 user nova-compute[75122]: DEBUG nova.compute.manager [None req-780f153a-e634-4387-bf2f-775b2be8ef74 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] [instance: 5bb980be-c2eb-42eb-a84b-5d29592259a4] Instance network_info: |[{"id": "5dcdd286-bee6-43e0-96d4-a42d060b6158", "address": "fa:16:3e:67:41:8c", "network": {"id": "8c1491a5-d5c6-4a22-84fd-bdeca00bbaad", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1848328203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab6afbe7809a4ad3921cbc18145d1816", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5dcdd286-be", "ovs_interfaceid": "5dcdd286-bee6-43e0-96d4-a42d060b6158", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75122) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 10:08:04 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-83b81c1a-a959-4f89-b45d-fdd5ef9246cc req-1f6dadd5-9954-41ea-945c-e93e0206e028 service nova] Acquired lock "refresh_cache-5bb980be-c2eb-42eb-a84b-5d29592259a4" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 10:08:04 user nova-compute[75122]: DEBUG nova.network.neutron [req-83b81c1a-a959-4f89-b45d-fdd5ef9246cc req-1f6dadd5-9954-41ea-945c-e93e0206e028 service nova] [instance: 5bb980be-c2eb-42eb-a84b-5d29592259a4] Refreshing network info cache for port 5dcdd286-bee6-43e0-96d4-a42d060b6158 {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 10:08:04 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-780f153a-e634-4387-bf2f-775b2be8ef74 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] [instance: 5bb980be-c2eb-42eb-a84b-5d29592259a4] Start _get_guest_xml network_info=[{"id": "5dcdd286-bee6-43e0-96d4-a42d060b6158", "address": "fa:16:3e:67:41:8c", "network": {"id": "8c1491a5-d5c6-4a22-84fd-bdeca00bbaad", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1848328203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab6afbe7809a4ad3921cbc18145d1816", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5dcdd286-be", "ovs_interfaceid": "5dcdd286-bee6-43e0-96d4-a42d060b6158", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T09:26:31Z,direct_url=<?>,disk_format='qcow2',id=5e862cfe-47b8-4725-8292-65761ee6d0f5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9c57733cb41847c0b4ad31519c382e5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T09:26:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '5e862cfe-47b8-4725-8292-65761ee6d0f5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75122) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 10:08:04 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-780f153a-e634-4387-bf2f-775b2be8ef74 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 10:08:04 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-780f153a-e634-4387-bf2f-775b2be8ef74 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 10:08:04 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-780f153a-e634-4387-bf2f-775b2be8ef74 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75122) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 10:08:04 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-780f153a-e634-4387-bf2f-775b2be8ef74 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] CPU controller missing on host. {{(pid=75122) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 10:08:04 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-780f153a-e634-4387-bf2f-775b2be8ef74 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75122) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 10:08:04 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-780f153a-e634-4387-bf2f-775b2be8ef74 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] CPU controller found on host. {{(pid=75122) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 10:08:04 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-780f153a-e634-4387-bf2f-775b2be8ef74 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75122) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 10:08:04 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-780f153a-e634-4387-bf2f-775b2be8ef74 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T09:26:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T09:26:31Z,direct_url=<?>,disk_format='qcow2',id=5e862cfe-47b8-4725-8292-65761ee6d0f5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9c57733cb41847c0b4ad31519c382e5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T09:26:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 10:08:04 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-780f153a-e634-4387-bf2f-775b2be8ef74 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Flavor limits 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 10:08:04 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-780f153a-e634-4387-bf2f-775b2be8ef74 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Image limits 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 10:08:04 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-780f153a-e634-4387-bf2f-775b2be8ef74 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Flavor pref 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 10:08:04 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-780f153a-e634-4387-bf2f-775b2be8ef74 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Image pref 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 10:08:04 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-780f153a-e634-4387-bf2f-775b2be8ef74 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 10:08:04 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-780f153a-e634-4387-bf2f-775b2be8ef74 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 10:08:04 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-780f153a-e634-4387-bf2f-775b2be8ef74 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75122) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 10:08:04 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-780f153a-e634-4387-bf2f-775b2be8ef74 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Got 1 possible topologies {{(pid=75122) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 10:08:04 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-780f153a-e634-4387-bf2f-775b2be8ef74 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 10:08:04 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-780f153a-e634-4387-bf2f-775b2be8ef74 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 10:08:04 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-780f153a-e634-4387-bf2f-775b2be8ef74 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T10:08:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-716738267',display_name='tempest-AttachVolumeTestJSON-server-716738267',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-716738267',id=48,image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFNMLN60iC9zm0eXgYrt/2ZOYIdFM0zYPdvgy9CkgfgPFYhDFMiaNQO1hgRpLRJLq17W8ByxSNmXXsftwgPbQ7WjM9by/qT37FU72/cZjHmmc7Gjx75jRxuQxyNmhU5VYQ==',key_name='tempest-keypair-1984152566',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ab6afbe7809a4ad3921cbc18145d1816',ramdisk_id='',reservation_id='r-rs2dv38e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-970815916',owner_user_name='tempest-AttachVolumeTestJSON-970815916-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T10:08:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f18eb706375c4b2e9e7de793cd2950ad',uuid=5bb980be-c2eb-42eb-a84b-5d29592259a4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5dcdd286-bee6-43e0-96d4-a42d060b6158", "address": "fa:16:3e:67:41:8c", "network": {"id": "8c1491a5-d5c6-4a22-84fd-bdeca00bbaad", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1848328203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab6afbe7809a4ad3921cbc18145d1816", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5dcdd286-be", "ovs_interfaceid": "5dcdd286-bee6-43e0-96d4-a42d060b6158", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75122) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 10:08:04 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-780f153a-e634-4387-bf2f-775b2be8ef74 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Converting VIF {"id": "5dcdd286-bee6-43e0-96d4-a42d060b6158", "address": "fa:16:3e:67:41:8c", "network": {"id": "8c1491a5-d5c6-4a22-84fd-bdeca00bbaad", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1848328203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab6afbe7809a4ad3921cbc18145d1816", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5dcdd286-be", "ovs_interfaceid": "5dcdd286-bee6-43e0-96d4-a42d060b6158", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 10:08:04 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-780f153a-e634-4387-bf2f-775b2be8ef74 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:67:41:8c,bridge_name='br-int',has_traffic_filtering=True,id=5dcdd286-bee6-43e0-96d4-a42d060b6158,network=Network(8c1491a5-d5c6-4a22-84fd-bdeca00bbaad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5dcdd286-be') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 10:08:04 user nova-compute[75122]: DEBUG nova.objects.instance [None req-780f153a-e634-4387-bf2f-775b2be8ef74 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Lazy-loading 'pci_devices' on Instance uuid 5bb980be-c2eb-42eb-a84b-5d29592259a4 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 10:08:04 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-780f153a-e634-4387-bf2f-775b2be8ef74 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] [instance: 5bb980be-c2eb-42eb-a84b-5d29592259a4] End _get_guest_xml xml=<domain type="kvm">
Nov 15 10:08:04 user nova-compute[75122]:   <uuid>5bb980be-c2eb-42eb-a84b-5d29592259a4</uuid>
Nov 15 10:08:04 user nova-compute[75122]:   <name>instance-00000030</name>
Nov 15 10:08:04 user nova-compute[75122]:   <memory>524288</memory>
Nov 15 10:08:04 user nova-compute[75122]:   <vcpu>1</vcpu>
Nov 15 10:08:04 user nova-compute[75122]:   <metadata>
Nov 15 10:08:04 user nova-compute[75122]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 10:08:04 user nova-compute[75122]:       <nova:package version="0.0.0"/>
Nov 15 10:08:04 user nova-compute[75122]:       <nova:name>tempest-AttachVolumeTestJSON-server-716738267</nova:name>
Nov 15 10:08:04 user nova-compute[75122]:       <nova:creationTime>2023-11-15 10:08:04</nova:creationTime>
Nov 15 10:08:04 user nova-compute[75122]:       <nova:flavor name="m1.tiny">
Nov 15 10:08:04 user nova-compute[75122]:         <nova:memory>512</nova:memory>
Nov 15 10:08:04 user nova-compute[75122]:         <nova:disk>1</nova:disk>
Nov 15 10:08:04 user nova-compute[75122]:         <nova:swap>0</nova:swap>
Nov 15 10:08:04 user nova-compute[75122]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 10:08:04 user nova-compute[75122]:         <nova:vcpus>1</nova:vcpus>
Nov 15 10:08:04 user nova-compute[75122]:       </nova:flavor>
Nov 15 10:08:04 user nova-compute[75122]:       <nova:owner>
Nov 15 10:08:04 user nova-compute[75122]:         <nova:user uuid="f18eb706375c4b2e9e7de793cd2950ad">tempest-AttachVolumeTestJSON-970815916-project-member</nova:user>
Nov 15 10:08:04 user nova-compute[75122]:         <nova:project uuid="ab6afbe7809a4ad3921cbc18145d1816">tempest-AttachVolumeTestJSON-970815916</nova:project>
Nov 15 10:08:04 user nova-compute[75122]:       </nova:owner>
Nov 15 10:08:04 user nova-compute[75122]:       <nova:root type="image" uuid="5e862cfe-47b8-4725-8292-65761ee6d0f5"/>
Nov 15 10:08:04 user nova-compute[75122]:       <nova:ports>
Nov 15 10:08:04 user nova-compute[75122]:         <nova:port uuid="5dcdd286-bee6-43e0-96d4-a42d060b6158">
Nov 15 10:08:04 user nova-compute[75122]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 15 10:08:04 user nova-compute[75122]:         </nova:port>
Nov 15 10:08:04 user nova-compute[75122]:       </nova:ports>
Nov 15 10:08:04 user nova-compute[75122]:     </nova:instance>
Nov 15 10:08:04 user nova-compute[75122]:   </metadata>
Nov 15 10:08:04 user nova-compute[75122]:   <sysinfo type="smbios">
Nov 15 10:08:04 user nova-compute[75122]:     <system>
Nov 15 10:08:04 user nova-compute[75122]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 10:08:04 user nova-compute[75122]:       <entry name="product">OpenStack Nova</entry>
Nov 15 10:08:04 user nova-compute[75122]:       <entry name="version">0.0.0</entry>
Nov 15 10:08:04 user nova-compute[75122]:       <entry name="serial">5bb980be-c2eb-42eb-a84b-5d29592259a4</entry>
Nov 15 10:08:04 user nova-compute[75122]:       <entry name="uuid">5bb980be-c2eb-42eb-a84b-5d29592259a4</entry>
Nov 15 10:08:04 user nova-compute[75122]:       <entry name="family">Virtual Machine</entry>
Nov 15 10:08:04 user nova-compute[75122]:     </system>
Nov 15 10:08:04 user nova-compute[75122]:   </sysinfo>
Nov 15 10:08:04 user nova-compute[75122]:   <os>
Nov 15 10:08:04 user nova-compute[75122]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 10:08:04 user nova-compute[75122]:     <boot dev="hd"/>
Nov 15 10:08:04 user nova-compute[75122]:     <smbios mode="sysinfo"/>
Nov 15 10:08:04 user nova-compute[75122]:   </os>
Nov 15 10:08:04 user nova-compute[75122]:   <features>
Nov 15 10:08:04 user nova-compute[75122]:     <acpi/>
Nov 15 10:08:04 user nova-compute[75122]:     <apic/>
Nov 15 10:08:04 user nova-compute[75122]:     <vmcoreinfo/>
Nov 15 10:08:04 user nova-compute[75122]:   </features>
Nov 15 10:08:04 user nova-compute[75122]:   <clock offset="utc">
Nov 15 10:08:04 user nova-compute[75122]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 10:08:04 user nova-compute[75122]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 10:08:04 user nova-compute[75122]:     <timer name="hpet" present="no"/>
Nov 15 10:08:04 user nova-compute[75122]:   </clock>
Nov 15 10:08:04 user nova-compute[75122]:   <cpu mode="custom" match="exact">
Nov 15 10:08:04 user nova-compute[75122]:     <model>Nehalem</model>
Nov 15 10:08:04 user nova-compute[75122]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 10:08:04 user nova-compute[75122]:   </cpu>
Nov 15 10:08:04 user nova-compute[75122]:   <devices>
Nov 15 10:08:04 user nova-compute[75122]:     <disk type="file" device="disk">
Nov 15 10:08:04 user nova-compute[75122]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 10:08:04 user nova-compute[75122]:       <source file="/opt/stack/data/nova/instances/5bb980be-c2eb-42eb-a84b-5d29592259a4/disk"/>
Nov 15 10:08:04 user nova-compute[75122]:       <target dev="vda" bus="virtio"/>
Nov 15 10:08:04 user nova-compute[75122]:     </disk>
Nov 15 10:08:04 user nova-compute[75122]:     <interface type="ethernet">
Nov 15 10:08:04 user nova-compute[75122]:       <mac address="fa:16:3e:67:41:8c"/>
Nov 15 10:08:04 user nova-compute[75122]:       <model type="virtio"/>
Nov 15 10:08:04 user nova-compute[75122]:       <mtu size="1442"/>
Nov 15 10:08:04 user nova-compute[75122]:       <target dev="tap5dcdd286-be"/>
Nov 15 10:08:04 user nova-compute[75122]:     </interface>
Nov 15 10:08:04 user nova-compute[75122]:     <serial type="pty">
Nov 15 10:08:04 user nova-compute[75122]:       <log file="/opt/stack/data/nova/instances/5bb980be-c2eb-42eb-a84b-5d29592259a4/console.log" append="off"/>
Nov 15 10:08:04 user nova-compute[75122]:     </serial>
Nov 15 10:08:04 user nova-compute[75122]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 10:08:04 user nova-compute[75122]:     <video>
Nov 15 10:08:04 user nova-compute[75122]:       <model type="virtio"/>
Nov 15 10:08:04 user nova-compute[75122]:     </video>
Nov 15 10:08:04 user nova-compute[75122]:     <rng model="virtio">
Nov 15 10:08:04 user nova-compute[75122]:       <backend model="random">/dev/urandom</backend>
Nov 15 10:08:04 user nova-compute[75122]:     </rng>
Nov 15 10:08:04 user nova-compute[75122]:     <controller type="usb" index="0" model="none"/>
Nov 15 10:08:04 user nova-compute[75122]:     <memballoon model="virtio">
Nov 15 10:08:04 user nova-compute[75122]:       <stats period="10"/>
Nov 15 10:08:04 user nova-compute[75122]:     </memballoon>
Nov 15 10:08:04 user nova-compute[75122]:   </devices>
Nov 15 10:08:04 user nova-compute[75122]: </domain>
Nov 15 10:08:04 user nova-compute[75122]:  {{(pid=75122) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 10:08:04 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-780f153a-e634-4387-bf2f-775b2be8ef74 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T10:08:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-716738267',display_name='tempest-AttachVolumeTestJSON-server-716738267',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-716738267',id=48,image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFNMLN60iC9zm0eXgYrt/2ZOYIdFM0zYPdvgy9CkgfgPFYhDFMiaNQO1hgRpLRJLq17W8ByxSNmXXsftwgPbQ7WjM9by/qT37FU72/cZjHmmc7Gjx75jRxuQxyNmhU5VYQ==',key_name='tempest-keypair-1984152566',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ab6afbe7809a4ad3921cbc18145d1816',ramdisk_id='',reservation_id='r-rs2dv38e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-970815916',owner_user_name='tempest-AttachVolumeTestJSON-970815916-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T10:08:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f18eb706375c4b2e9e7de793cd2950ad',uuid=5bb980be-c2eb-42eb-a84b-5d29592259a4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5dcdd286-bee6-43e0-96d4-a42d060b6158", "address": "fa:16:3e:67:41:8c", "network": {"id": "8c1491a5-d5c6-4a22-84fd-bdeca00bbaad", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1848328203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab6afbe7809a4ad3921cbc18145d1816", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5dcdd286-be", "ovs_interfaceid": "5dcdd286-bee6-43e0-96d4-a42d060b6158", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 10:08:04 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-780f153a-e634-4387-bf2f-775b2be8ef74 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Converting VIF {"id": "5dcdd286-bee6-43e0-96d4-a42d060b6158", "address": "fa:16:3e:67:41:8c", "network": {"id": "8c1491a5-d5c6-4a22-84fd-bdeca00bbaad", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1848328203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab6afbe7809a4ad3921cbc18145d1816", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5dcdd286-be", "ovs_interfaceid": "5dcdd286-bee6-43e0-96d4-a42d060b6158", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 10:08:04 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-780f153a-e634-4387-bf2f-775b2be8ef74 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:67:41:8c,bridge_name='br-int',has_traffic_filtering=True,id=5dcdd286-bee6-43e0-96d4-a42d060b6158,network=Network(8c1491a5-d5c6-4a22-84fd-bdeca00bbaad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5dcdd286-be') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 10:08:04 user nova-compute[75122]: DEBUG os_vif [None req-780f153a-e634-4387-bf2f-775b2be8ef74 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:41:8c,bridge_name='br-int',has_traffic_filtering=True,id=5dcdd286-bee6-43e0-96d4-a42d060b6158,network=Network(8c1491a5-d5c6-4a22-84fd-bdeca00bbaad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5dcdd286-be') {{(pid=75122) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 10:08:04 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:08:04 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 10:08:04 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 10:08:04 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:08:04 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '99a6bc21-af0a-5df8-8519-f2ae9b7b012e', '_type': 'linux-noop'}}, row=False) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 10:08:04 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:08:04 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:08:04 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:08:04 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5dcdd286-be, may_exist=True, interface_attrs={}) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 10:08:04 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5dcdd286-be, col_values=(('qos', UUID('7a89f388-18db-4fd6-86e4-0fdca6c95e31')),), if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 10:08:04 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5dcdd286-be, col_values=(('external_ids', {'iface-id': '5dcdd286-bee6-43e0-96d4-a42d060b6158', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:67:41:8c', 'vm-uuid': '5bb980be-c2eb-42eb-a84b-5d29592259a4'}),), if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 10:08:04 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:08:04 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:08:04 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:08:04 user nova-compute[75122]: INFO os_vif [None req-780f153a-e634-4387-bf2f-775b2be8ef74 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:41:8c,bridge_name='br-int',has_traffic_filtering=True,id=5dcdd286-bee6-43e0-96d4-a42d060b6158,network=Network(8c1491a5-d5c6-4a22-84fd-bdeca00bbaad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5dcdd286-be')
Nov 15 10:08:04 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-780f153a-e634-4387-bf2f-775b2be8ef74 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] No BDM found with device name vda, not building metadata. {{(pid=75122) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 10:08:04 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-780f153a-e634-4387-bf2f-775b2be8ef74 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] No VIF found with MAC fa:16:3e:67:41:8c, not building metadata {{(pid=75122) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 10:08:04 user nova-compute[75122]: DEBUG nova.network.neutron [req-83b81c1a-a959-4f89-b45d-fdd5ef9246cc req-1f6dadd5-9954-41ea-945c-e93e0206e028 service nova] [instance: 5bb980be-c2eb-42eb-a84b-5d29592259a4] Updated VIF entry in instance network info cache for port 5dcdd286-bee6-43e0-96d4-a42d060b6158. {{(pid=75122) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 10:08:04 user nova-compute[75122]: DEBUG nova.network.neutron [req-83b81c1a-a959-4f89-b45d-fdd5ef9246cc req-1f6dadd5-9954-41ea-945c-e93e0206e028 service nova] [instance: 5bb980be-c2eb-42eb-a84b-5d29592259a4] Updating instance_info_cache with network_info: [{"id": "5dcdd286-bee6-43e0-96d4-a42d060b6158", "address": "fa:16:3e:67:41:8c", "network": {"id": "8c1491a5-d5c6-4a22-84fd-bdeca00bbaad", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1848328203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab6afbe7809a4ad3921cbc18145d1816", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5dcdd286-be", "ovs_interfaceid": "5dcdd286-bee6-43e0-96d4-a42d060b6158", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 10:08:04 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-83b81c1a-a959-4f89-b45d-fdd5ef9246cc req-1f6dadd5-9954-41ea-945c-e93e0206e028 service nova] Releasing lock "refresh_cache-5bb980be-c2eb-42eb-a84b-5d29592259a4" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 10:08:05 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:08:05 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:08:06 user nova-compute[75122]: DEBUG nova.compute.manager [req-06ed9a29-e5d1-4fb1-8cfe-d2e7e4add13d req-ade7754a-bfc3-4c3f-9b52-509fbdad71d2 service nova] [instance: 5bb980be-c2eb-42eb-a84b-5d29592259a4] Received event network-vif-plugged-5dcdd286-bee6-43e0-96d4-a42d060b6158 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 10:08:06 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-06ed9a29-e5d1-4fb1-8cfe-d2e7e4add13d req-ade7754a-bfc3-4c3f-9b52-509fbdad71d2 service nova] Acquiring lock "5bb980be-c2eb-42eb-a84b-5d29592259a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:08:06 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-06ed9a29-e5d1-4fb1-8cfe-d2e7e4add13d req-ade7754a-bfc3-4c3f-9b52-509fbdad71d2 service nova] Lock "5bb980be-c2eb-42eb-a84b-5d29592259a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:08:06 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-06ed9a29-e5d1-4fb1-8cfe-d2e7e4add13d req-ade7754a-bfc3-4c3f-9b52-509fbdad71d2 service nova] Lock "5bb980be-c2eb-42eb-a84b-5d29592259a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:08:06 user nova-compute[75122]: DEBUG nova.compute.manager [req-06ed9a29-e5d1-4fb1-8cfe-d2e7e4add13d req-ade7754a-bfc3-4c3f-9b52-509fbdad71d2 service nova] [instance: 5bb980be-c2eb-42eb-a84b-5d29592259a4] No waiting events found dispatching network-vif-plugged-5dcdd286-bee6-43e0-96d4-a42d060b6158 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 10:08:06 user nova-compute[75122]: WARNING nova.compute.manager [req-06ed9a29-e5d1-4fb1-8cfe-d2e7e4add13d req-ade7754a-bfc3-4c3f-9b52-509fbdad71d2 service nova] [instance: 5bb980be-c2eb-42eb-a84b-5d29592259a4] Received unexpected event network-vif-plugged-5dcdd286-bee6-43e0-96d4-a42d060b6158 for instance with vm_state building and task_state spawning.
Nov 15 10:08:06 user nova-compute[75122]: DEBUG nova.compute.manager [req-06ed9a29-e5d1-4fb1-8cfe-d2e7e4add13d req-ade7754a-bfc3-4c3f-9b52-509fbdad71d2 service nova] [instance: 5bb980be-c2eb-42eb-a84b-5d29592259a4] Received event network-vif-plugged-5dcdd286-bee6-43e0-96d4-a42d060b6158 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 10:08:06 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-06ed9a29-e5d1-4fb1-8cfe-d2e7e4add13d req-ade7754a-bfc3-4c3f-9b52-509fbdad71d2 service nova] Acquiring lock "5bb980be-c2eb-42eb-a84b-5d29592259a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:08:06 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-06ed9a29-e5d1-4fb1-8cfe-d2e7e4add13d req-ade7754a-bfc3-4c3f-9b52-509fbdad71d2 service nova] Lock "5bb980be-c2eb-42eb-a84b-5d29592259a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:08:06 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-06ed9a29-e5d1-4fb1-8cfe-d2e7e4add13d req-ade7754a-bfc3-4c3f-9b52-509fbdad71d2 service nova] Lock "5bb980be-c2eb-42eb-a84b-5d29592259a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:08:06 user nova-compute[75122]: DEBUG nova.compute.manager [req-06ed9a29-e5d1-4fb1-8cfe-d2e7e4add13d req-ade7754a-bfc3-4c3f-9b52-509fbdad71d2 service nova] [instance: 5bb980be-c2eb-42eb-a84b-5d29592259a4] No waiting events found dispatching network-vif-plugged-5dcdd286-bee6-43e0-96d4-a42d060b6158 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 10:08:06 user nova-compute[75122]: WARNING nova.compute.manager [req-06ed9a29-e5d1-4fb1-8cfe-d2e7e4add13d req-ade7754a-bfc3-4c3f-9b52-509fbdad71d2 service nova] [instance: 5bb980be-c2eb-42eb-a84b-5d29592259a4] Received unexpected event network-vif-plugged-5dcdd286-bee6-43e0-96d4-a42d060b6158 for instance with vm_state building and task_state spawning.
Nov 15 10:08:06 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:08:06 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:08:06 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:08:06 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:08:07 user nova-compute[75122]: DEBUG nova.compute.manager [None req-780f153a-e634-4387-bf2f-775b2be8ef74 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] [instance: 5bb980be-c2eb-42eb-a84b-5d29592259a4] Instance event wait completed in 0 seconds for  {{(pid=75122) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 10:08:07 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-780f153a-e634-4387-bf2f-775b2be8ef74 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] [instance: 5bb980be-c2eb-42eb-a84b-5d29592259a4] Guest created on hypervisor {{(pid=75122) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 10:08:07 user nova-compute[75122]: INFO nova.virt.libvirt.driver [-] [instance: 5bb980be-c2eb-42eb-a84b-5d29592259a4] Instance spawned successfully.
Nov 15 10:08:07 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-780f153a-e634-4387-bf2f-775b2be8ef74 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] [instance: 5bb980be-c2eb-42eb-a84b-5d29592259a4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 10:08:07 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-780f153a-e634-4387-bf2f-775b2be8ef74 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] [instance: 5bb980be-c2eb-42eb-a84b-5d29592259a4] Found default for hw_cdrom_bus of ide {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 10:08:07 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-780f153a-e634-4387-bf2f-775b2be8ef74 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] [instance: 5bb980be-c2eb-42eb-a84b-5d29592259a4] Found default for hw_disk_bus of virtio {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 10:08:07 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-780f153a-e634-4387-bf2f-775b2be8ef74 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] [instance: 5bb980be-c2eb-42eb-a84b-5d29592259a4] Found default for hw_input_bus of None {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 10:08:07 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-780f153a-e634-4387-bf2f-775b2be8ef74 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] [instance: 5bb980be-c2eb-42eb-a84b-5d29592259a4] Found default for hw_pointer_model of None {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 10:08:07 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-780f153a-e634-4387-bf2f-775b2be8ef74 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] [instance: 5bb980be-c2eb-42eb-a84b-5d29592259a4] Found default for hw_video_model of virtio {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 10:08:07 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-780f153a-e634-4387-bf2f-775b2be8ef74 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] [instance: 5bb980be-c2eb-42eb-a84b-5d29592259a4] Found default for hw_vif_model of virtio {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 10:08:07 user nova-compute[75122]: INFO nova.compute.manager [None req-780f153a-e634-4387-bf2f-775b2be8ef74 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] [instance: 5bb980be-c2eb-42eb-a84b-5d29592259a4] Took 5.28 seconds to spawn the instance on the hypervisor.
Nov 15 10:08:07 user nova-compute[75122]: DEBUG nova.compute.manager [None req-780f153a-e634-4387-bf2f-775b2be8ef74 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] [instance: 5bb980be-c2eb-42eb-a84b-5d29592259a4] Checking state {{(pid=75122) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 10:08:08 user nova-compute[75122]: INFO nova.compute.manager [None req-780f153a-e634-4387-bf2f-775b2be8ef74 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] [instance: 5bb980be-c2eb-42eb-a84b-5d29592259a4] Took 5.93 seconds to build instance.
Nov 15 10:08:08 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-780f153a-e634-4387-bf2f-775b2be8ef74 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Lock "5bb980be-c2eb-42eb-a84b-5d29592259a4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.026s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:08:09 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:08:11 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:08:14 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:08:19 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:08:19 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:08:19 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75122) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 10:08:19 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75122) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 10:08:19 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75122) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 10:08:19 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:08:21 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:08:24 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:08:26 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:08:29 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:08:31 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:08:34 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:08:36 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:08:39 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:08:40 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:08:43 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:08:44 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:08:44 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:08:44 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:08:44 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:08:44 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:08:44 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75122) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 10:08:44 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/001d589e-1bee-42da-8422-233ba796fbab/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:08:44 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:08:44 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/001d589e-1bee-42da-8422-233ba796fbab/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:08:44 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/001d589e-1bee-42da-8422-233ba796fbab/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:08:44 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/001d589e-1bee-42da-8422-233ba796fbab/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:08:44 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bb980be-c2eb-42eb-a84b-5d29592259a4/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:08:44 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bb980be-c2eb-42eb-a84b-5d29592259a4/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:08:44 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bb980be-c2eb-42eb-a84b-5d29592259a4/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:08:45 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bb980be-c2eb-42eb-a84b-5d29592259a4/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:08:45 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75122) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 10:08:45 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 10:08:45 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 10:08:45 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Hypervisor/Node resource view: name=user free_ram=8824MB free_disk=25.029735565185547GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75122) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 10:08:45 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:08:45 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:08:45 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance 001d589e-1bee-42da-8422-233ba796fbab actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 10:08:45 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance db848537-676f-464a-806d-febb14d920a6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 10:08:45 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance 5bb980be-c2eb-42eb-a84b-5d29592259a4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 10:08:45 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75122) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 10:08:45 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75122) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 10:08:45 user nova-compute[75122]: DEBUG nova.compute.provider_tree [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Inventory has not changed in ProviderTree for provider: 69a3da65-47be-44c6-b67c-c692b58284ef {{(pid=75122) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 10:08:45 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Inventory has not changed for provider 69a3da65-47be-44c6-b67c-c692b58284ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 10:08:45 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Compute_service record updated for user:user {{(pid=75122) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 10:08:45 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.242s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:08:48 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-2e00ab02-056e-47fa-bb04-b04f16e72b37 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Acquiring lock "968c4c12-9c56-4bb5-9b98-d526c67cd7d7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:08:48 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-2e00ab02-056e-47fa-bb04-b04f16e72b37 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Lock "968c4c12-9c56-4bb5-9b98-d526c67cd7d7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:08:48 user nova-compute[75122]: DEBUG nova.compute.manager [None req-2e00ab02-056e-47fa-bb04-b04f16e72b37 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 968c4c12-9c56-4bb5-9b98-d526c67cd7d7] Starting instance... {{(pid=75122) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 10:08:48 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-2e00ab02-056e-47fa-bb04-b04f16e72b37 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:08:48 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-2e00ab02-056e-47fa-bb04-b04f16e72b37 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:08:49 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-2e00ab02-056e-47fa-bb04-b04f16e72b37 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75122) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 10:08:49 user nova-compute[75122]: INFO nova.compute.claims [None req-2e00ab02-056e-47fa-bb04-b04f16e72b37 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 968c4c12-9c56-4bb5-9b98-d526c67cd7d7] Claim successful on node user
Nov 15 10:08:49 user nova-compute[75122]: DEBUG nova.compute.provider_tree [None req-2e00ab02-056e-47fa-bb04-b04f16e72b37 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Inventory has not changed in ProviderTree for provider: 69a3da65-47be-44c6-b67c-c692b58284ef {{(pid=75122) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 10:08:49 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-2e00ab02-056e-47fa-bb04-b04f16e72b37 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Inventory has not changed for provider 69a3da65-47be-44c6-b67c-c692b58284ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 10:08:49 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-2e00ab02-056e-47fa-bb04-b04f16e72b37 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.285s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:08:49 user nova-compute[75122]: DEBUG nova.compute.manager [None req-2e00ab02-056e-47fa-bb04-b04f16e72b37 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 968c4c12-9c56-4bb5-9b98-d526c67cd7d7] Start building networks asynchronously for instance. {{(pid=75122) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 10:08:49 user nova-compute[75122]: DEBUG nova.compute.manager [None req-2e00ab02-056e-47fa-bb04-b04f16e72b37 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 968c4c12-9c56-4bb5-9b98-d526c67cd7d7] Allocating IP information in the background. {{(pid=75122) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 10:08:49 user nova-compute[75122]: DEBUG nova.network.neutron [None req-2e00ab02-056e-47fa-bb04-b04f16e72b37 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 968c4c12-9c56-4bb5-9b98-d526c67cd7d7] allocate_for_instance() {{(pid=75122) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 10:08:49 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-2e00ab02-056e-47fa-bb04-b04f16e72b37 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 968c4c12-9c56-4bb5-9b98-d526c67cd7d7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 10:08:49 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:08:49 user nova-compute[75122]: DEBUG nova.compute.manager [None req-2e00ab02-056e-47fa-bb04-b04f16e72b37 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 968c4c12-9c56-4bb5-9b98-d526c67cd7d7] Start building block device mappings for instance. {{(pid=75122) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 10:08:49 user nova-compute[75122]: DEBUG nova.policy [None req-2e00ab02-056e-47fa-bb04-b04f16e72b37 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '00f5cc88e43c434c8a061dcec472a16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7941f36c30b49408ae5709a1b75346d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75122) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 10:08:49 user nova-compute[75122]: INFO nova.virt.block_device [None req-2e00ab02-056e-47fa-bb04-b04f16e72b37 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 968c4c12-9c56-4bb5-9b98-d526c67cd7d7] Booting with volume 59ca9506-19c1-4a17-a495-28601cdadf8b at /dev/vda
Nov 15 10:08:49 user nova-compute[75122]: DEBUG os_brick.utils [None req-2e00ab02-056e-47fa-bb04-b04f16e72b37 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 10:08:49 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:08:49 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:08:49 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dc49fa3-0b57-40cc-8656-e38123734cdf]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:742fb64b3587\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:08:49 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:08:49 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:08:49 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[94b366d3-19a0-4b7e-ab68-77b548edf4c8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:08:49 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:08:49 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:08:49 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[c16203cb-46b5-4472-9693-87f49c1327f2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:08:49 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[8019916c-0645-424d-9d99-a5c843101b3f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:08:49 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-2e00ab02-056e-47fa-bb04-b04f16e72b37 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Running cmd (subprocess): nvme version {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:08:49 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-2e00ab02-056e-47fa-bb04-b04f16e72b37 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] 'nvme version' failed. Not Retrying. {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 10:08:49 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2e00ab02-056e-47fa-bb04-b04f16e72b37 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] nvme not present on system {{(pid=75122) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 10:08:49 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:08:49 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 10:08:49 user nova-compute[75122]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 10:08:49 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eaa3441-ccbb-4331-a682-51d1f7c05dbb]: (4, '') {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:08:49 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.lightos [None req-2e00ab02-056e-47fa-bb04-b04f16e72b37 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75122) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 10:08:49 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.lightos [None req-2e00ab02-056e-47fa-bb04-b04f16e72b37 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75122) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 10:08:49 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.lightos [None req-2e00ab02-056e-47fa-bb04-b04f16e72b37 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] LIGHTOS: no hostnqn found. {{(pid=75122) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 10:08:49 user nova-compute[75122]: DEBUG os_brick.utils [None req-2e00ab02-056e-47fa-bb04-b04f16e72b37 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:742fb64b3587', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 10:08:49 user nova-compute[75122]: DEBUG nova.virt.block_device [None req-2e00ab02-056e-47fa-bb04-b04f16e72b37 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 968c4c12-9c56-4bb5-9b98-d526c67cd7d7] Updating existing volume attachment record: faa9cb68-c22a-4377-8e6d-a3eb79e41d83 {{(pid=75122) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 10:08:50 user nova-compute[75122]: DEBUG nova.network.neutron [None req-2e00ab02-056e-47fa-bb04-b04f16e72b37 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 968c4c12-9c56-4bb5-9b98-d526c67cd7d7] Successfully created port: 6a965453-1ab7-4987-bcfc-307d082e1e90 {{(pid=75122) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 10:08:50 user nova-compute[75122]: DEBUG nova.network.neutron [None req-2e00ab02-056e-47fa-bb04-b04f16e72b37 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 968c4c12-9c56-4bb5-9b98-d526c67cd7d7] Successfully updated port: 6a965453-1ab7-4987-bcfc-307d082e1e90 {{(pid=75122) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 10:08:50 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:08:50 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-2e00ab02-056e-47fa-bb04-b04f16e72b37 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Acquiring lock "refresh_cache-968c4c12-9c56-4bb5-9b98-d526c67cd7d7" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 10:08:50 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-2e00ab02-056e-47fa-bb04-b04f16e72b37 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Acquired lock "refresh_cache-968c4c12-9c56-4bb5-9b98-d526c67cd7d7" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 10:08:50 user nova-compute[75122]: DEBUG nova.network.neutron [None req-2e00ab02-056e-47fa-bb04-b04f16e72b37 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 968c4c12-9c56-4bb5-9b98-d526c67cd7d7] Building network info cache for instance {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 10:08:50 user nova-compute[75122]: DEBUG nova.compute.manager [req-cdc16359-74c6-4abe-b6e1-b0fd503904b3 req-ae1c5d20-9027-4088-b19e-38a09c18d1c8 service nova] [instance: 968c4c12-9c56-4bb5-9b98-d526c67cd7d7] Received event network-changed-6a965453-1ab7-4987-bcfc-307d082e1e90 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 10:08:50 user nova-compute[75122]: DEBUG nova.compute.manager [req-cdc16359-74c6-4abe-b6e1-b0fd503904b3 req-ae1c5d20-9027-4088-b19e-38a09c18d1c8 service nova] [instance: 968c4c12-9c56-4bb5-9b98-d526c67cd7d7] Refreshing instance network info cache due to event network-changed-6a965453-1ab7-4987-bcfc-307d082e1e90. {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 10:08:50 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-cdc16359-74c6-4abe-b6e1-b0fd503904b3 req-ae1c5d20-9027-4088-b19e-38a09c18d1c8 service nova] Acquiring lock "refresh_cache-968c4c12-9c56-4bb5-9b98-d526c67cd7d7" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 10:08:50 user nova-compute[75122]: DEBUG nova.network.neutron [None req-2e00ab02-056e-47fa-bb04-b04f16e72b37 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 968c4c12-9c56-4bb5-9b98-d526c67cd7d7] Instance cache missing network info. {{(pid=75122) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 10:08:50 user nova-compute[75122]: DEBUG nova.network.neutron [None req-2e00ab02-056e-47fa-bb04-b04f16e72b37 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 968c4c12-9c56-4bb5-9b98-d526c67cd7d7] Updating instance_info_cache with network_info: [{"id": "6a965453-1ab7-4987-bcfc-307d082e1e90", "address": "fa:16:3e:7a:69:23", "network": {"id": "03073971-5253-4f06-a46a-94840841fd6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2056706757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7941f36c30b49408ae5709a1b75346d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a965453-1a", "ovs_interfaceid": "6a965453-1ab7-4987-bcfc-307d082e1e90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 10:08:51 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-2e00ab02-056e-47fa-bb04-b04f16e72b37 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Releasing lock "refresh_cache-968c4c12-9c56-4bb5-9b98-d526c67cd7d7" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 10:08:51 user nova-compute[75122]: DEBUG nova.compute.manager [None req-2e00ab02-056e-47fa-bb04-b04f16e72b37 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 968c4c12-9c56-4bb5-9b98-d526c67cd7d7] Instance network_info: |[{"id": "6a965453-1ab7-4987-bcfc-307d082e1e90", "address": "fa:16:3e:7a:69:23", "network": {"id": "03073971-5253-4f06-a46a-94840841fd6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2056706757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7941f36c30b49408ae5709a1b75346d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a965453-1a", "ovs_interfaceid": "6a965453-1ab7-4987-bcfc-307d082e1e90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75122) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 10:08:51 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-cdc16359-74c6-4abe-b6e1-b0fd503904b3 req-ae1c5d20-9027-4088-b19e-38a09c18d1c8 service nova] Acquired lock "refresh_cache-968c4c12-9c56-4bb5-9b98-d526c67cd7d7" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 10:08:51 user nova-compute[75122]: DEBUG nova.network.neutron [req-cdc16359-74c6-4abe-b6e1-b0fd503904b3 req-ae1c5d20-9027-4088-b19e-38a09c18d1c8 service nova] [instance: 968c4c12-9c56-4bb5-9b98-d526c67cd7d7] Refreshing network info cache for port 6a965453-1ab7-4987-bcfc-307d082e1e90 {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 10:08:51 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:08:51 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:08:51 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:08:51 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Starting heal instance info cache {{(pid=75122) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 10:08:51 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Didn't find any instances for network info cache update. {{(pid=75122) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 15 10:08:51 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:08:51 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:08:51 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75122) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 10:08:51 user nova-compute[75122]: DEBUG nova.network.neutron [req-cdc16359-74c6-4abe-b6e1-b0fd503904b3 req-ae1c5d20-9027-4088-b19e-38a09c18d1c8 service nova] [instance: 968c4c12-9c56-4bb5-9b98-d526c67cd7d7] Updated VIF entry in instance network info cache for port 6a965453-1ab7-4987-bcfc-307d082e1e90. {{(pid=75122) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 10:08:51 user nova-compute[75122]: DEBUG nova.network.neutron [req-cdc16359-74c6-4abe-b6e1-b0fd503904b3 req-ae1c5d20-9027-4088-b19e-38a09c18d1c8 service nova] [instance: 968c4c12-9c56-4bb5-9b98-d526c67cd7d7] Updating instance_info_cache with network_info: [{"id": "6a965453-1ab7-4987-bcfc-307d082e1e90", "address": "fa:16:3e:7a:69:23", "network": {"id": "03073971-5253-4f06-a46a-94840841fd6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2056706757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7941f36c30b49408ae5709a1b75346d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a965453-1a", "ovs_interfaceid": "6a965453-1ab7-4987-bcfc-307d082e1e90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 10:08:51 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-cdc16359-74c6-4abe-b6e1-b0fd503904b3 req-ae1c5d20-9027-4088-b19e-38a09c18d1c8 service nova] Releasing lock "refresh_cache-968c4c12-9c56-4bb5-9b98-d526c67cd7d7" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 10:08:52 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-9cba06ad-7877-413e-be45-354bc28a6904 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Acquiring lock "db848537-676f-464a-806d-febb14d920a6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:08:52 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-9cba06ad-7877-413e-be45-354bc28a6904 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Lock "db848537-676f-464a-806d-febb14d920a6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:08:52 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-9cba06ad-7877-413e-be45-354bc28a6904 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Acquiring lock "db848537-676f-464a-806d-febb14d920a6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:08:52 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-9cba06ad-7877-413e-be45-354bc28a6904 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Lock "db848537-676f-464a-806d-febb14d920a6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:08:52 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-9cba06ad-7877-413e-be45-354bc28a6904 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Lock "db848537-676f-464a-806d-febb14d920a6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:08:52 user nova-compute[75122]: INFO nova.compute.manager [None req-9cba06ad-7877-413e-be45-354bc28a6904 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: db848537-676f-464a-806d-febb14d920a6] Terminating instance
Nov 15 10:08:52 user nova-compute[75122]: DEBUG nova.compute.manager [None req-9cba06ad-7877-413e-be45-354bc28a6904 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: db848537-676f-464a-806d-febb14d920a6] Start destroying the instance on the hypervisor. {{(pid=75122) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 10:08:52 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:08:52 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:08:52 user nova-compute[75122]: DEBUG nova.compute.manager [req-3712bc3b-6cd1-49de-8dea-6f3f7cfeec16 req-01e0d90c-fb99-4223-bfde-b106c8aa25ca service nova] [instance: db848537-676f-464a-806d-febb14d920a6] Received event network-vif-unplugged-93bbff2d-1d5c-47db-b436-43796849be51 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 10:08:52 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-3712bc3b-6cd1-49de-8dea-6f3f7cfeec16 req-01e0d90c-fb99-4223-bfde-b106c8aa25ca service nova] Acquiring lock "db848537-676f-464a-806d-febb14d920a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:08:52 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-3712bc3b-6cd1-49de-8dea-6f3f7cfeec16 req-01e0d90c-fb99-4223-bfde-b106c8aa25ca service nova] Lock "db848537-676f-464a-806d-febb14d920a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:08:52 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-3712bc3b-6cd1-49de-8dea-6f3f7cfeec16 req-01e0d90c-fb99-4223-bfde-b106c8aa25ca service nova] Lock "db848537-676f-464a-806d-febb14d920a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:08:52 user nova-compute[75122]: DEBUG nova.compute.manager [req-3712bc3b-6cd1-49de-8dea-6f3f7cfeec16 req-01e0d90c-fb99-4223-bfde-b106c8aa25ca service nova] [instance: db848537-676f-464a-806d-febb14d920a6] No waiting events found dispatching network-vif-unplugged-93bbff2d-1d5c-47db-b436-43796849be51 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 10:08:52 user nova-compute[75122]: DEBUG nova.compute.manager [req-3712bc3b-6cd1-49de-8dea-6f3f7cfeec16 req-01e0d90c-fb99-4223-bfde-b106c8aa25ca service nova] [instance: db848537-676f-464a-806d-febb14d920a6] Received event network-vif-unplugged-93bbff2d-1d5c-47db-b436-43796849be51 for instance with task_state deleting. {{(pid=75122) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 10:08:52 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:08:52 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:08:52 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:08:52 user nova-compute[75122]: INFO nova.virt.libvirt.driver [-] [instance: db848537-676f-464a-806d-febb14d920a6] Instance destroyed successfully.
Nov 15 10:08:52 user nova-compute[75122]: DEBUG nova.objects.instance [None req-9cba06ad-7877-413e-be45-354bc28a6904 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Lazy-loading 'resources' on Instance uuid db848537-676f-464a-806d-febb14d920a6 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 10:08:52 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-9cba06ad-7877-413e-be45-354bc28a6904 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T09:53:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2092457370',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2092457370',id=38,image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T09:55:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c046170a2ad44ebba5d2de236d940be0',ramdisk_id='',reservation_id='r-dk2qzsg4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1545444983',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T09:56:52Z,user_data=None,user_id='53d187e2a07b4437a02f65fb47a003ee',uuid=db848537-676f-464a-806d-febb14d920a6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "93bbff2d-1d5c-47db-b436-43796849be51", "address": "fa:16:3e:eb:e9:ca", "network": {"id": "b780d5c1-a549-4b49-a036-5a272697d4b6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-229344021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c046170a2ad44ebba5d2de236d940be0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93bbff2d-1d", "ovs_interfaceid": "93bbff2d-1d5c-47db-b436-43796849be51", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 10:08:52 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-9cba06ad-7877-413e-be45-354bc28a6904 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Converting VIF {"id": "93bbff2d-1d5c-47db-b436-43796849be51", "address": "fa:16:3e:eb:e9:ca", "network": {"id": "b780d5c1-a549-4b49-a036-5a272697d4b6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-229344021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c046170a2ad44ebba5d2de236d940be0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap93bbff2d-1d", "ovs_interfaceid": "93bbff2d-1d5c-47db-b436-43796849be51", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 10:08:52 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-9cba06ad-7877-413e-be45-354bc28a6904 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:eb:e9:ca,bridge_name='br-int',has_traffic_filtering=True,id=93bbff2d-1d5c-47db-b436-43796849be51,network=Network(b780d5c1-a549-4b49-a036-5a272697d4b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93bbff2d-1d') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 10:08:52 user nova-compute[75122]: DEBUG os_vif [None req-9cba06ad-7877-413e-be45-354bc28a6904 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:eb:e9:ca,bridge_name='br-int',has_traffic_filtering=True,id=93bbff2d-1d5c-47db-b436-43796849be51,network=Network(b780d5c1-a549-4b49-a036-5a272697d4b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93bbff2d-1d') {{(pid=75122) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 10:08:52 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:08:52 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap93bbff2d-1d, bridge=br-int, if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 10:08:52 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:08:52 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:08:52 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:08:52 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ead01721-ae48-4e90-bade-0b30230f5585) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 10:08:52 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:08:52 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:08:52 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:08:52 user nova-compute[75122]: INFO os_vif [None req-9cba06ad-7877-413e-be45-354bc28a6904 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:eb:e9:ca,bridge_name='br-int',has_traffic_filtering=True,id=93bbff2d-1d5c-47db-b436-43796849be51,network=Network(b780d5c1-a549-4b49-a036-5a272697d4b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93bbff2d-1d')
Nov 15 10:08:52 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9cba06ad-7877-413e-be45-354bc28a6904 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: db848537-676f-464a-806d-febb14d920a6] calling os-brick to detach iSCSI Volume {{(pid=75122) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 10:08:52 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cba06ad-7877-413e-be45-354bc28a6904 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffa04060b80>, {'target_iqn': 'iqn.2010-10.org.openstack:8ee79db2-27c2-4d0f-8ee6-5b03e05ebba5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RHSYjytT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 10:08:52 user nova-compute[75122]: WARNING os_brick.initiator.connectors.base [None req-9cba06ad-7877-413e-be45-354bc28a6904 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 10:08:52 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-9cba06ad-7877-413e-be45-354bc28a6904 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 10:08:52 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-9cba06ad-7877-413e-be45-354bc28a6904 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 10:08:52 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:08:52 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:08:52 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[62fbae5a-c1a4-4df1-906a-98491ebddb1e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8ee79db2-27c2-4d0f-8ee6-5b03e05ebba5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:08:52 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cba06ad-7877-413e-be45-354bc28a6904 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 10:08:52 user nova-compute[75122]: No targets found.
Nov 15 10:08:52 user nova-compute[75122]: iSNS:
Nov 15 10:08:52 user nova-compute[75122]: No targets found.
Nov 15 10:08:52 user nova-compute[75122]: STATIC:
Nov 15 10:08:52 user nova-compute[75122]: Target: iqn.2010-10.org.openstack:8ee79db2-27c2-4d0f-8ee6-5b03e05ebba5
Nov 15 10:08:52 user nova-compute[75122]:         Portal: 172.16.0.220:3260,-1
Nov 15 10:08:52 user nova-compute[75122]:                 Iface Name: default
Nov 15 10:08:52 user nova-compute[75122]: FIRMWARE:
Nov 15 10:08:52 user nova-compute[75122]: No targets found.
Nov 15 10:08:52 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 10:08:52 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cba06ad-7877-413e-be45-354bc28a6904 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 10:08:52 user nova-compute[75122]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 10:08:52 user nova-compute[75122]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75122) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 10:08:52 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cba06ad-7877-413e-be45-354bc28a6904 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8ee79db2-27c2-4d0f-8ee6-5b03e05ebba5', 0)] {{(pid=75122) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 10:08:52 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:08:53 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:08:53 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[16986a59-623a-4204-9c69-7dc504aa1d14]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8ee79db2-27c2-4d0f-8ee6-5b03e05ebba5\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:08:53 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:08:53 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:08:53 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cc0d338-e4e4-4c52-9890-9c67f4957740]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee79db2-27c2-4d0f-8ee6-5b03e05ebba5 (non-flash)\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:08:53 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cba06ad-7877-413e-be45-354bc28a6904 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee79db2-27c2-4d0f-8ee6-5b03e05ebba5 (non-flash)
Nov 15 10:08:53 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 10:08:53 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cba06ad-7877-413e-be45-354bc28a6904 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8ee79db2-27c2-4d0f-8ee6-5b03e05ebba5 (non-flash)
Nov 15 10:08:53 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 10:08:53 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cba06ad-7877-413e-be45-354bc28a6904 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ffa042b08b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8ee79db2-27c2-4d0f-8ee6-5b03e05ebba5'): ({'sdb'}, set())}) {{(pid=75122) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 10:08:53 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-9cba06ad-7877-413e-be45-354bc28a6904 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Removing single pathed devices sdb {{(pid=75122) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 10:08:53 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:08:53 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:08:53 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[c132f8f4-acef-4f69-a8c9-183527972286]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:08:53 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:08:53 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:08:53 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ecf2a0a-daa2-4026-bd6c-646db3aad2d9]: (4, ('ok\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:08:53 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-9cba06ad-7877-413e-be45-354bc28a6904 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Flushing IO for device /dev/sdb {{(pid=75122) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 10:08:53 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:08:53 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:08:53 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eee0b77-f7c9-43c4-a5c8-9c60663c2b3d]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:08:53 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-9cba06ad-7877-413e-be45-354bc28a6904 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75122) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 10:08:53 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:08:53 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:08:53 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[75d0a32e-1fc4-4d19-b6b6-7c059f3ffc24]: (4, ('1', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:08:53 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-9cba06ad-7877-413e-be45-354bc28a6904 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75122) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 10:08:53 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-9cba06ad-7877-413e-be45-354bc28a6904 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] SCSI volumes sdb have been removed. {{(pid=75122) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 10:08:53 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cba06ad-7877-413e-be45-354bc28a6904 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8ee79db2-27c2-4d0f-8ee6-5b03e05ebba5')] {{(pid=75122) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 10:08:53 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ee79db2-27c2-4d0f-8ee6-5b03e05ebba5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:08:53 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ee79db2-27c2-4d0f-8ee6-5b03e05ebba5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:08:53 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[b513f4e7-02f5-4416-bfd2-19ca1765edce]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:08:53 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cba06ad-7877-413e-be45-354bc28a6904 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 10:08:53 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ee79db2-27c2-4d0f-8ee6-5b03e05ebba5 -p 172.16.0.220:3260 --logout {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:08:53 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ee79db2-27c2-4d0f-8ee6-5b03e05ebba5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:08:53 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[176271db-d487-4c66-af12-7fb6564209fc]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:8ee79db2-27c2-4d0f-8ee6-5b03e05ebba5, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:8ee79db2-27c2-4d0f-8ee6-5b03e05ebba5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:08:53 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cba06ad-7877-413e-be45-354bc28a6904 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:8ee79db2-27c2-4d0f-8ee6-5b03e05ebba5, portal: 172.16.0.220,3260]
Nov 15 10:08:53 user nova-compute[75122]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:8ee79db2-27c2-4d0f-8ee6-5b03e05ebba5, portal: 172.16.0.220,3260] successful.
Nov 15 10:08:53 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 10:08:53 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8ee79db2-27c2-4d0f-8ee6-5b03e05ebba5 -p 172.16.0.220:3260 --op delete {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:08:53 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8ee79db2-27c2-4d0f-8ee6-5b03e05ebba5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:08:53 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e4970ec-3d53-42aa-bb2d-4d895f44022b]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:08:53 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cba06ad-7877-413e-be45-354bc28a6904 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 10:08:53 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-9cba06ad-7877-413e-be45-354bc28a6904 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.311s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 10:08:53 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cba06ad-7877-413e-be45-354bc28a6904 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] <== disconnect_volume: return (313ms) None {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 10:08:53 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9cba06ad-7877-413e-be45-354bc28a6904 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: db848537-676f-464a-806d-febb14d920a6] Disconnected iSCSI Volume {{(pid=75122) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 10:08:53 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-9cba06ad-7877-413e-be45-354bc28a6904 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: db848537-676f-464a-806d-febb14d920a6] Deleting instance files /opt/stack/data/nova/instances/db848537-676f-464a-806d-febb14d920a6_del
Nov 15 10:08:53 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-9cba06ad-7877-413e-be45-354bc28a6904 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: db848537-676f-464a-806d-febb14d920a6] Deletion of /opt/stack/data/nova/instances/db848537-676f-464a-806d-febb14d920a6_del complete
Nov 15 10:08:53 user nova-compute[75122]: INFO nova.compute.manager [None req-9cba06ad-7877-413e-be45-354bc28a6904 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: db848537-676f-464a-806d-febb14d920a6] Took 1.17 seconds to destroy the instance on the hypervisor.
Nov 15 10:08:53 user nova-compute[75122]: DEBUG oslo.service.loopingcall [None req-9cba06ad-7877-413e-be45-354bc28a6904 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75122) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 10:08:53 user nova-compute[75122]: DEBUG nova.compute.manager [-] [instance: db848537-676f-464a-806d-febb14d920a6] Deallocating network for instance {{(pid=75122) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 10:08:53 user nova-compute[75122]: DEBUG nova.network.neutron [-] [instance: db848537-676f-464a-806d-febb14d920a6] deallocate_for_instance() {{(pid=75122) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 10:08:54 user nova-compute[75122]: DEBUG nova.network.neutron [-] [instance: db848537-676f-464a-806d-febb14d920a6] Updating instance_info_cache with network_info: [] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 10:08:54 user nova-compute[75122]: INFO nova.compute.manager [-] [instance: db848537-676f-464a-806d-febb14d920a6] Took 0.85 seconds to deallocate network for instance.
Nov 15 10:08:54 user nova-compute[75122]: DEBUG nova.compute.manager [req-22c102a3-204e-431f-8702-28524694825d req-68569656-babd-4cba-a8b7-42d45d89e07a service nova] [instance: db848537-676f-464a-806d-febb14d920a6] Received event network-vif-deleted-93bbff2d-1d5c-47db-b436-43796849be51 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 10:08:54 user nova-compute[75122]: INFO nova.compute.manager [req-22c102a3-204e-431f-8702-28524694825d req-68569656-babd-4cba-a8b7-42d45d89e07a service nova] [instance: db848537-676f-464a-806d-febb14d920a6] Neutron deleted interface 93bbff2d-1d5c-47db-b436-43796849be51; detaching it from the instance and deleting it from the info cache
Nov 15 10:08:54 user nova-compute[75122]: DEBUG nova.network.neutron [req-22c102a3-204e-431f-8702-28524694825d req-68569656-babd-4cba-a8b7-42d45d89e07a service nova] [instance: db848537-676f-464a-806d-febb14d920a6] Updating instance_info_cache with network_info: [] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 10:08:54 user nova-compute[75122]: DEBUG nova.compute.manager [req-22c102a3-204e-431f-8702-28524694825d req-68569656-babd-4cba-a8b7-42d45d89e07a service nova] [instance: db848537-676f-464a-806d-febb14d920a6] Detach interface failed, port_id=93bbff2d-1d5c-47db-b436-43796849be51, reason: Instance db848537-676f-464a-806d-febb14d920a6 could not be found. {{(pid=75122) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 10:08:54 user nova-compute[75122]: DEBUG nova.compute.manager [req-ef701d19-94bd-4136-8381-b4e8871b1157 req-9a2e82ed-a299-4cd2-80ab-a4010228ff3e service nova] [instance: db848537-676f-464a-806d-febb14d920a6] Received event network-vif-plugged-93bbff2d-1d5c-47db-b436-43796849be51 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 10:08:54 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-ef701d19-94bd-4136-8381-b4e8871b1157 req-9a2e82ed-a299-4cd2-80ab-a4010228ff3e service nova] Acquiring lock "db848537-676f-464a-806d-febb14d920a6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:08:54 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-ef701d19-94bd-4136-8381-b4e8871b1157 req-9a2e82ed-a299-4cd2-80ab-a4010228ff3e service nova] Lock "db848537-676f-464a-806d-febb14d920a6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:08:54 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-ef701d19-94bd-4136-8381-b4e8871b1157 req-9a2e82ed-a299-4cd2-80ab-a4010228ff3e service nova] Lock "db848537-676f-464a-806d-febb14d920a6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:08:54 user nova-compute[75122]: DEBUG nova.compute.manager [req-ef701d19-94bd-4136-8381-b4e8871b1157 req-9a2e82ed-a299-4cd2-80ab-a4010228ff3e service nova] [instance: db848537-676f-464a-806d-febb14d920a6] No waiting events found dispatching network-vif-plugged-93bbff2d-1d5c-47db-b436-43796849be51 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 10:08:54 user nova-compute[75122]: WARNING nova.compute.manager [req-ef701d19-94bd-4136-8381-b4e8871b1157 req-9a2e82ed-a299-4cd2-80ab-a4010228ff3e service nova] [instance: db848537-676f-464a-806d-febb14d920a6] Received unexpected event network-vif-plugged-93bbff2d-1d5c-47db-b436-43796849be51 for instance with vm_state active and task_state deleting.
Nov 15 10:08:54 user nova-compute[75122]: DEBUG nova.compute.manager [None req-2e00ab02-056e-47fa-bb04-b04f16e72b37 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 968c4c12-9c56-4bb5-9b98-d526c67cd7d7] Start spawning the instance on the hypervisor. {{(pid=75122) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 10:08:54 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-2e00ab02-056e-47fa-bb04-b04f16e72b37 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 968c4c12-9c56-4bb5-9b98-d526c67cd7d7] Creating instance directory {{(pid=75122) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 10:08:54 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-2e00ab02-056e-47fa-bb04-b04f16e72b37 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 968c4c12-9c56-4bb5-9b98-d526c67cd7d7] Creating image(s)
Nov 15 10:08:54 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-2e00ab02-056e-47fa-bb04-b04f16e72b37 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 968c4c12-9c56-4bb5-9b98-d526c67cd7d7] Did not create local disks {{(pid=75122) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 10:08:54 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-2e00ab02-056e-47fa-bb04-b04f16e72b37 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 968c4c12-9c56-4bb5-9b98-d526c67cd7d7] Ensure instance console log exists: /opt/stack/data/nova/instances/968c4c12-9c56-4bb5-9b98-d526c67cd7d7/console.log {{(pid=75122) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 10:08:54 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-2e00ab02-056e-47fa-bb04-b04f16e72b37 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:08:54 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-2e00ab02-056e-47fa-bb04-b04f16e72b37 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:08:54 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-2e00ab02-056e-47fa-bb04-b04f16e72b37 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:08:54 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-2e00ab02-056e-47fa-bb04-b04f16e72b37 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 968c4c12-9c56-4bb5-9b98-d526c67cd7d7] Start _get_guest_xml network_info=[{"id": "6a965453-1ab7-4987-bcfc-307d082e1e90", "address": "fa:16:3e:7a:69:23", "network": {"id": "03073971-5253-4f06-a46a-94840841fd6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2056706757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7941f36c30b49408ae5709a1b75346d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a965453-1a", "ovs_interfaceid": "6a965453-1ab7-4987-bcfc-307d082e1e90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:59ca9506-19c1-4a17-a495-28601cdadf8b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bYFsTknz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '968c4c12-9c56-4bb5-9b98-d526c67cd7d7', 'attached_at': '', 'detached_at': '', 'volume_id': '59ca9506-19c1-4a17-a495-28601cdadf8b', 'serial': '59ca9506-19c1-4a17-a495-28601cdadf8b'}, 'guest_format': None, 'delete_on_termination': False, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vda', 'attachment_id': 'faa9cb68-c22a-4377-8e6d-a3eb79e41d83', 'volume_type': None} {{(pid=75122) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 10:08:54 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-2e00ab02-056e-47fa-bb04-b04f16e72b37 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 10:08:54 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-2e00ab02-056e-47fa-bb04-b04f16e72b37 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 10:08:54 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-2e00ab02-056e-47fa-bb04-b04f16e72b37 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75122) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 10:08:54 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-2e00ab02-056e-47fa-bb04-b04f16e72b37 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] CPU controller missing on host. {{(pid=75122) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 10:08:54 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-2e00ab02-056e-47fa-bb04-b04f16e72b37 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75122) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 10:08:54 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-2e00ab02-056e-47fa-bb04-b04f16e72b37 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] CPU controller found on host. {{(pid=75122) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 10:08:54 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-2e00ab02-056e-47fa-bb04-b04f16e72b37 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75122) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 10:08:54 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-2e00ab02-056e-47fa-bb04-b04f16e72b37 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T09:26:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 10:08:54 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-2e00ab02-056e-47fa-bb04-b04f16e72b37 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Flavor limits 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 10:08:54 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-2e00ab02-056e-47fa-bb04-b04f16e72b37 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Image limits 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 10:08:54 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-2e00ab02-056e-47fa-bb04-b04f16e72b37 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Flavor pref 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 10:08:54 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-2e00ab02-056e-47fa-bb04-b04f16e72b37 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Image pref 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 10:08:54 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-2e00ab02-056e-47fa-bb04-b04f16e72b37 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 10:08:54 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-2e00ab02-056e-47fa-bb04-b04f16e72b37 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 10:08:54 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-2e00ab02-056e-47fa-bb04-b04f16e72b37 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75122) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 10:08:54 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-2e00ab02-056e-47fa-bb04-b04f16e72b37 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Got 1 possible topologies {{(pid=75122) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 10:08:54 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-2e00ab02-056e-47fa-bb04-b04f16e72b37 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 10:08:54 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-2e00ab02-056e-47fa-bb04-b04f16e72b37 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 10:08:54 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e00ab02-056e-47fa-bb04-b04f16e72b37 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 968c4c12-9c56-4bb5-9b98-d526c67cd7d7] Calling os-brick to attach iSCSI Volume {{(pid=75122) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 10:08:54 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e00ab02-056e-47fa-bb04-b04f16e72b37 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffa04060b80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:59ca9506-19c1-4a17-a495-28601cdadf8b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bYFsTknz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 10:08:54 user nova-compute[75122]: WARNING os_brick.initiator.connectors.base [None req-2e00ab02-056e-47fa-bb04-b04f16e72b37 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 10:08:54 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-2e00ab02-056e-47fa-bb04-b04f16e72b37 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 10:08:54 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-2e00ab02-056e-47fa-bb04-b04f16e72b37 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 10:08:54 user nova-compute[75122]: WARNING os_brick.initiator.connectors.base [None req-2e00ab02-056e-47fa-bb04-b04f16e72b37 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 10:08:54 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-2e00ab02-056e-47fa-bb04-b04f16e72b37 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:59ca9506-19c1-4a17-a495-28601cdadf8b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 10:08:54 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-2e00ab02-056e-47fa-bb04-b04f16e72b37 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:59ca9506-19c1-4a17-a495-28601cdadf8b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 10:08:54 user nova-compute[75122]: INFO os_brick.initiator.connectors.iscsi [None req-2e00ab02-056e-47fa-bb04-b04f16e72b37 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 10:08:54 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59ca9506-19c1-4a17-a495-28601cdadf8b -p 172.16.0.220:3260 {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:08:54 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59ca9506-19c1-4a17-a495-28601cdadf8b -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:08:54 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[69baffa0-5591-4d3d-a142-2622468c3d73]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:08:54 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e00ab02-056e-47fa-bb04-b04f16e72b37 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 10:08:54 user nova-compute[75122]:  {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 10:08:54 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59ca9506-19c1-4a17-a495-28601cdadf8b -p 172.16.0.220:3260 --interface default --op new {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:08:54 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59ca9506-19c1-4a17-a495-28601cdadf8b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:08:54 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[db0ef9e0-d703-4c7e-a6a3-cd63288cdba5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:59ca9506-19c1-4a17-a495-28601cdadf8b] added\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:08:54 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e00ab02-056e-47fa-bb04-b04f16e72b37 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:59ca9506-19c1-4a17-a495-28601cdadf8b] added
Nov 15 10:08:54 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 10:08:54 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59ca9506-19c1-4a17-a495-28601cdadf8b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:08:54 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59ca9506-19c1-4a17-a495-28601cdadf8b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:08:54 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[2db27c91-0c08-4af1-a852-974140667f38]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:08:54 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e00ab02-056e-47fa-bb04-b04f16e72b37 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 10:08:54 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59ca9506-19c1-4a17-a495-28601cdadf8b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:08:54 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59ca9506-19c1-4a17-a495-28601cdadf8b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:08:54 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8970430-cd22-4543-bf0e-3f7e46d75a5b]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:08:54 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e00ab02-056e-47fa-bb04-b04f16e72b37 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 10:08:54 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59ca9506-19c1-4a17-a495-28601cdadf8b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bYFsTknz {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:08:54 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59ca9506-19c1-4a17-a495-28601cdadf8b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bYFsTknz" returned: 0 in 0.017s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:08:54 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[b05ddabd-6eee-431d-ace8-99d63416694c]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:08:54 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e00ab02-056e-47fa-bb04-b04f16e72b37 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bYFsTknz'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 10:08:54 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59ca9506-19c1-4a17-a495-28601cdadf8b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:08:54 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59ca9506-19c1-4a17-a495-28601cdadf8b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:08:54 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[e456fe74-08fb-469b-b61b-744c19842636]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:08:54 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e00ab02-056e-47fa-bb04-b04f16e72b37 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 10:08:54 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:08:54 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:08:54 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f45bd67-c754-43df-a9c8-6780c22de4a9]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:08:54 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e00ab02-056e-47fa-bb04-b04f16e72b37 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 15 10:08:54 user nova-compute[75122]:  {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 10:08:54 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e00ab02-056e-47fa-bb04-b04f16e72b37 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 15 10:08:54 user nova-compute[75122]:  {{(pid=75122) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 10:08:54 user nova-compute[75122]: WARNING os_brick.initiator.connectors.iscsi [None req-2e00ab02-056e-47fa-bb04-b04f16e72b37 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 15 10:08:54 user nova-compute[75122]: 
Nov 15 10:08:54 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59ca9506-19c1-4a17-a495-28601cdadf8b -p 172.16.0.220:3260 --login {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:08:54 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59ca9506-19c1-4a17-a495-28601cdadf8b -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:08:54 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[a50c5d18-56d9-4f87-842d-a7cc0e61319a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:59ca9506-19c1-4a17-a495-28601cdadf8b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:59ca9506-19c1-4a17-a495-28601cdadf8b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:08:54 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e00ab02-056e-47fa-bb04-b04f16e72b37 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:59ca9506-19c1-4a17-a495-28601cdadf8b, portal: 172.16.0.220,3260]
Nov 15 10:08:54 user nova-compute[75122]: Login to [iface: default, target: iqn.2010-10.org.openstack:59ca9506-19c1-4a17-a495-28601cdadf8b, portal: 172.16.0.220,3260] successful.
Nov 15 10:08:54 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 10:08:54 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59ca9506-19c1-4a17-a495-28601cdadf8b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:08:54 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59ca9506-19c1-4a17-a495-28601cdadf8b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:08:54 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[139a45c6-b489-42fd-b7bf-6fbd5870b477]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:08:54 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e00ab02-056e-47fa-bb04-b04f16e72b37 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 10:08:54 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:08:54 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:08:54 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[6292180d-de2c-498d-93cf-8fc9cdd8c737]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59ca9506-19c1-4a17-a495-28601cdadf8b (non-flash)\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:08:54 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e00ab02-056e-47fa-bb04-b04f16e72b37 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59ca9506-19c1-4a17-a495-28601cdadf8b (non-flash)
Nov 15 10:08:54 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 10:08:54 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e00ab02-056e-47fa-bb04-b04f16e72b37 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59ca9506-19c1-4a17-a495-28601cdadf8b (non-flash)
Nov 15 10:08:54 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 10:08:54 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-2e00ab02-056e-47fa-bb04-b04f16e72b37 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:59ca9506-19c1-4a17-a495-28601cdadf8b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.240s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 10:08:54 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e00ab02-056e-47fa-bb04-b04f16e72b37 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Connected to 172.16.0.220:3260 {{(pid=75122) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 10:08:54 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-2e00ab02-056e-47fa-bb04-b04f16e72b37 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] HCTL ('33', '-', '-', 0) found on session 57 with lun 0 {{(pid=75122) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 10:08:54 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-2e00ab02-056e-47fa-bb04-b04f16e72b37 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75122) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 10:08:54 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:08:54 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:08:54 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c10503c-2f98-4109-8485-33771a36582d]: (4, ('- - 0', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:08:54 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-2e00ab02-056e-47fa-bb04-b04f16e72b37 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Searching for a device in session 57 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75122) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 10:08:54 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e00ab02-056e-47fa-bb04-b04f16e72b37 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:59ca9506-19c1-4a17-a495-28601cdadf8b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bYFsTknz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75122) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 10:08:54 user nova-compute[75122]: INFO nova.compute.manager [None req-9cba06ad-7877-413e-be45-354bc28a6904 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: db848537-676f-464a-806d-febb14d920a6] Took 0.80 seconds to detach 1 volumes for instance.
Nov 15 10:08:55 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-9cba06ad-7877-413e-be45-354bc28a6904 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:08:55 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-9cba06ad-7877-413e-be45-354bc28a6904 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:08:55 user nova-compute[75122]: DEBUG nova.compute.provider_tree [None req-9cba06ad-7877-413e-be45-354bc28a6904 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Inventory has not changed in ProviderTree for provider: 69a3da65-47be-44c6-b67c-c692b58284ef {{(pid=75122) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 10:08:55 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-9cba06ad-7877-413e-be45-354bc28a6904 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Inventory has not changed for provider 69a3da65-47be-44c6-b67c-c692b58284ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 10:08:55 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-9cba06ad-7877-413e-be45-354bc28a6904 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.223s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:08:55 user nova-compute[75122]: INFO nova.scheduler.client.report [None req-9cba06ad-7877-413e-be45-354bc28a6904 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Deleted allocations for instance db848537-676f-464a-806d-febb14d920a6
Nov 15 10:08:55 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-9cba06ad-7877-413e-be45-354bc28a6904 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Lock "db848537-676f-464a-806d-febb14d920a6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.215s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:08:55 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-2e00ab02-056e-47fa-bb04-b04f16e72b37 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.271s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 10:08:55 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e00ab02-056e-47fa-bb04-b04f16e72b37 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] <== connect_volume: return (1272ms) {'type': 'block', 'scsi_wwn': '23664656631313830', 'path': '/dev/sdb'} {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 10:08:55 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e00ab02-056e-47fa-bb04-b04f16e72b37 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 968c4c12-9c56-4bb5-9b98-d526c67cd7d7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23664656631313830', 'path': '/dev/sdb'} {{(pid=75122) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 10:08:55 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-2e00ab02-056e-47fa-bb04-b04f16e72b37 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T10:08:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1421472375',display_name='tempest-TestVolumeBootPattern-server-1421472375',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1421472375',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKHlpBGjgQO8WCWtscnQGPLWQNzcwgXW54O9CXzl/Z/CZ497o/Fb/9rP8/a86D2H+G6HyOK+OZYAd3QjjsdbXOlrlce1txRdWXFLkzlkbTs2rp1mYOku0vjKWQDJeaVaVQ==',key_name='tempest-TestVolumeBootPattern-2035754115',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c7941f36c30b49408ae5709a1b75346d',ramdisk_id='',reservation_id='r-68fbohas',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-296749341',owner_user_name='tempest-TestVolumeBootPattern-296749341-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T10:08:49Z,user_data=None,user_id='00f5cc88e43c434c8a061dcec472a16b',uuid=968c4c12-9c56-4bb5-9b98-d526c67cd7d7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6a965453-1ab7-4987-bcfc-307d082e1e90", "address": "fa:16:3e:7a:69:23", "network": {"id": "03073971-5253-4f06-a46a-94840841fd6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2056706757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7941f36c30b49408ae5709a1b75346d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a965453-1a", "ovs_interfaceid": "6a965453-1ab7-4987-bcfc-307d082e1e90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75122) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 10:08:55 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-2e00ab02-056e-47fa-bb04-b04f16e72b37 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Converting VIF {"id": "6a965453-1ab7-4987-bcfc-307d082e1e90", "address": "fa:16:3e:7a:69:23", "network": {"id": "03073971-5253-4f06-a46a-94840841fd6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2056706757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7941f36c30b49408ae5709a1b75346d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a965453-1a", "ovs_interfaceid": "6a965453-1ab7-4987-bcfc-307d082e1e90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 10:08:55 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-2e00ab02-056e-47fa-bb04-b04f16e72b37 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:69:23,bridge_name='br-int',has_traffic_filtering=True,id=6a965453-1ab7-4987-bcfc-307d082e1e90,network=Network(03073971-5253-4f06-a46a-94840841fd6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a965453-1a') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 10:08:55 user nova-compute[75122]: DEBUG nova.objects.instance [None req-2e00ab02-056e-47fa-bb04-b04f16e72b37 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Lazy-loading 'pci_devices' on Instance uuid 968c4c12-9c56-4bb5-9b98-d526c67cd7d7 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 10:08:55 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-2e00ab02-056e-47fa-bb04-b04f16e72b37 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 968c4c12-9c56-4bb5-9b98-d526c67cd7d7] End _get_guest_xml xml=<domain type="kvm">
Nov 15 10:08:55 user nova-compute[75122]:   <uuid>968c4c12-9c56-4bb5-9b98-d526c67cd7d7</uuid>
Nov 15 10:08:55 user nova-compute[75122]:   <name>instance-00000031</name>
Nov 15 10:08:55 user nova-compute[75122]:   <memory>524288</memory>
Nov 15 10:08:55 user nova-compute[75122]:   <vcpu>1</vcpu>
Nov 15 10:08:55 user nova-compute[75122]:   <metadata>
Nov 15 10:08:55 user nova-compute[75122]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 10:08:55 user nova-compute[75122]:       <nova:package version="0.0.0"/>
Nov 15 10:08:55 user nova-compute[75122]:       <nova:name>tempest-TestVolumeBootPattern-server-1421472375</nova:name>
Nov 15 10:08:55 user nova-compute[75122]:       <nova:creationTime>2023-11-15 10:08:54</nova:creationTime>
Nov 15 10:08:55 user nova-compute[75122]:       <nova:flavor name="m1.tiny">
Nov 15 10:08:55 user nova-compute[75122]:         <nova:memory>512</nova:memory>
Nov 15 10:08:55 user nova-compute[75122]:         <nova:disk>1</nova:disk>
Nov 15 10:08:55 user nova-compute[75122]:         <nova:swap>0</nova:swap>
Nov 15 10:08:55 user nova-compute[75122]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 10:08:55 user nova-compute[75122]:         <nova:vcpus>1</nova:vcpus>
Nov 15 10:08:55 user nova-compute[75122]:       </nova:flavor>
Nov 15 10:08:55 user nova-compute[75122]:       <nova:owner>
Nov 15 10:08:55 user nova-compute[75122]:         <nova:user uuid="00f5cc88e43c434c8a061dcec472a16b">tempest-TestVolumeBootPattern-296749341-project-member</nova:user>
Nov 15 10:08:55 user nova-compute[75122]:         <nova:project uuid="c7941f36c30b49408ae5709a1b75346d">tempest-TestVolumeBootPattern-296749341</nova:project>
Nov 15 10:08:55 user nova-compute[75122]:       </nova:owner>
Nov 15 10:08:55 user nova-compute[75122]:       <nova:ports>
Nov 15 10:08:55 user nova-compute[75122]:         <nova:port uuid="6a965453-1ab7-4987-bcfc-307d082e1e90">
Nov 15 10:08:55 user nova-compute[75122]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 15 10:08:55 user nova-compute[75122]:         </nova:port>
Nov 15 10:08:55 user nova-compute[75122]:       </nova:ports>
Nov 15 10:08:55 user nova-compute[75122]:     </nova:instance>
Nov 15 10:08:55 user nova-compute[75122]:   </metadata>
Nov 15 10:08:55 user nova-compute[75122]:   <sysinfo type="smbios">
Nov 15 10:08:55 user nova-compute[75122]:     <system>
Nov 15 10:08:55 user nova-compute[75122]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 10:08:55 user nova-compute[75122]:       <entry name="product">OpenStack Nova</entry>
Nov 15 10:08:55 user nova-compute[75122]:       <entry name="version">0.0.0</entry>
Nov 15 10:08:55 user nova-compute[75122]:       <entry name="serial">968c4c12-9c56-4bb5-9b98-d526c67cd7d7</entry>
Nov 15 10:08:55 user nova-compute[75122]:       <entry name="uuid">968c4c12-9c56-4bb5-9b98-d526c67cd7d7</entry>
Nov 15 10:08:55 user nova-compute[75122]:       <entry name="family">Virtual Machine</entry>
Nov 15 10:08:55 user nova-compute[75122]:     </system>
Nov 15 10:08:55 user nova-compute[75122]:   </sysinfo>
Nov 15 10:08:55 user nova-compute[75122]:   <os>
Nov 15 10:08:55 user nova-compute[75122]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 10:08:55 user nova-compute[75122]:     <boot dev="hd"/>
Nov 15 10:08:55 user nova-compute[75122]:     <smbios mode="sysinfo"/>
Nov 15 10:08:55 user nova-compute[75122]:   </os>
Nov 15 10:08:55 user nova-compute[75122]:   <features>
Nov 15 10:08:55 user nova-compute[75122]:     <acpi/>
Nov 15 10:08:55 user nova-compute[75122]:     <apic/>
Nov 15 10:08:55 user nova-compute[75122]:     <vmcoreinfo/>
Nov 15 10:08:55 user nova-compute[75122]:   </features>
Nov 15 10:08:55 user nova-compute[75122]:   <clock offset="utc">
Nov 15 10:08:55 user nova-compute[75122]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 10:08:55 user nova-compute[75122]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 10:08:55 user nova-compute[75122]:     <timer name="hpet" present="no"/>
Nov 15 10:08:55 user nova-compute[75122]:   </clock>
Nov 15 10:08:55 user nova-compute[75122]:   <cpu mode="custom" match="exact">
Nov 15 10:08:55 user nova-compute[75122]:     <model>Nehalem</model>
Nov 15 10:08:55 user nova-compute[75122]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 10:08:55 user nova-compute[75122]:   </cpu>
Nov 15 10:08:55 user nova-compute[75122]:   <devices>
Nov 15 10:08:55 user nova-compute[75122]:     <disk type="block" device="disk">
Nov 15 10:08:55 user nova-compute[75122]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 10:08:55 user nova-compute[75122]:       <source dev="/dev/sdb"/>
Nov 15 10:08:55 user nova-compute[75122]:       <target dev="vda" bus="virtio"/>
Nov 15 10:08:55 user nova-compute[75122]:       <serial>59ca9506-19c1-4a17-a495-28601cdadf8b</serial>
Nov 15 10:08:55 user nova-compute[75122]:     </disk>
Nov 15 10:08:55 user nova-compute[75122]:     <interface type="ethernet">
Nov 15 10:08:55 user nova-compute[75122]:       <mac address="fa:16:3e:7a:69:23"/>
Nov 15 10:08:55 user nova-compute[75122]:       <model type="virtio"/>
Nov 15 10:08:55 user nova-compute[75122]:       <mtu size="1442"/>
Nov 15 10:08:55 user nova-compute[75122]:       <target dev="tap6a965453-1a"/>
Nov 15 10:08:55 user nova-compute[75122]:     </interface>
Nov 15 10:08:55 user nova-compute[75122]:     <serial type="pty">
Nov 15 10:08:55 user nova-compute[75122]:       <log file="/opt/stack/data/nova/instances/968c4c12-9c56-4bb5-9b98-d526c67cd7d7/console.log" append="off"/>
Nov 15 10:08:55 user nova-compute[75122]:     </serial>
Nov 15 10:08:55 user nova-compute[75122]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 10:08:55 user nova-compute[75122]:     <video>
Nov 15 10:08:55 user nova-compute[75122]:       <model type="virtio"/>
Nov 15 10:08:55 user nova-compute[75122]:     </video>
Nov 15 10:08:55 user nova-compute[75122]:     <rng model="virtio">
Nov 15 10:08:55 user nova-compute[75122]:       <backend model="random">/dev/urandom</backend>
Nov 15 10:08:55 user nova-compute[75122]:     </rng>
Nov 15 10:08:55 user nova-compute[75122]:     <controller type="usb" index="0" model="none"/>
Nov 15 10:08:55 user nova-compute[75122]:     <memballoon model="virtio">
Nov 15 10:08:55 user nova-compute[75122]:       <stats period="10"/>
Nov 15 10:08:55 user nova-compute[75122]:     </memballoon>
Nov 15 10:08:55 user nova-compute[75122]:   </devices>
Nov 15 10:08:55 user nova-compute[75122]: </domain>
Nov 15 10:08:55 user nova-compute[75122]:  {{(pid=75122) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 10:08:55 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-2e00ab02-056e-47fa-bb04-b04f16e72b37 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T10:08:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1421472375',display_name='tempest-TestVolumeBootPattern-server-1421472375',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1421472375',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKHlpBGjgQO8WCWtscnQGPLWQNzcwgXW54O9CXzl/Z/CZ497o/Fb/9rP8/a86D2H+G6HyOK+OZYAd3QjjsdbXOlrlce1txRdWXFLkzlkbTs2rp1mYOku0vjKWQDJeaVaVQ==',key_name='tempest-TestVolumeBootPattern-2035754115',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c7941f36c30b49408ae5709a1b75346d',ramdisk_id='',reservation_id='r-68fbohas',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-296749341',owner_user_name='tempest-TestVolumeBootPattern-296749341-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T10:08:49Z,user_data=None,user_id='00f5cc88e43c434c8a061dcec472a16b',uuid=968c4c12-9c56-4bb5-9b98-d526c67cd7d7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6a965453-1ab7-4987-bcfc-307d082e1e90", "address": "fa:16:3e:7a:69:23", "network": {"id": "03073971-5253-4f06-a46a-94840841fd6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2056706757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7941f36c30b49408ae5709a1b75346d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a965453-1a", "ovs_interfaceid": "6a965453-1ab7-4987-bcfc-307d082e1e90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 10:08:55 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-2e00ab02-056e-47fa-bb04-b04f16e72b37 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Converting VIF {"id": "6a965453-1ab7-4987-bcfc-307d082e1e90", "address": "fa:16:3e:7a:69:23", "network": {"id": "03073971-5253-4f06-a46a-94840841fd6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2056706757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7941f36c30b49408ae5709a1b75346d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a965453-1a", "ovs_interfaceid": "6a965453-1ab7-4987-bcfc-307d082e1e90", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 10:08:55 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-2e00ab02-056e-47fa-bb04-b04f16e72b37 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:69:23,bridge_name='br-int',has_traffic_filtering=True,id=6a965453-1ab7-4987-bcfc-307d082e1e90,network=Network(03073971-5253-4f06-a46a-94840841fd6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a965453-1a') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 10:08:55 user nova-compute[75122]: DEBUG os_vif [None req-2e00ab02-056e-47fa-bb04-b04f16e72b37 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:69:23,bridge_name='br-int',has_traffic_filtering=True,id=6a965453-1ab7-4987-bcfc-307d082e1e90,network=Network(03073971-5253-4f06-a46a-94840841fd6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a965453-1a') {{(pid=75122) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 10:08:55 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:08:55 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 10:08:55 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 10:08:55 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:08:55 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1f9edcaf-7f86-5082-b057-b8978b576ea4', '_type': 'linux-noop'}}, row=False) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 10:08:55 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:08:55 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:08:55 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:08:55 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6a965453-1a, may_exist=True, interface_attrs={}) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 10:08:55 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6a965453-1a, col_values=(('qos', UUID('e6646545-8203-4ad2-837d-c0ed55312c0b')),), if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 10:08:55 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6a965453-1a, col_values=(('external_ids', {'iface-id': '6a965453-1ab7-4987-bcfc-307d082e1e90', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7a:69:23', 'vm-uuid': '968c4c12-9c56-4bb5-9b98-d526c67cd7d7'}),), if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 10:08:55 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:08:55 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:08:55 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:08:55 user nova-compute[75122]: INFO os_vif [None req-2e00ab02-056e-47fa-bb04-b04f16e72b37 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:69:23,bridge_name='br-int',has_traffic_filtering=True,id=6a965453-1ab7-4987-bcfc-307d082e1e90,network=Network(03073971-5253-4f06-a46a-94840841fd6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a965453-1a')
Nov 15 10:08:56 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-2e00ab02-056e-47fa-bb04-b04f16e72b37 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] No BDM found with device name vda, not building metadata. {{(pid=75122) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 10:08:56 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-2e00ab02-056e-47fa-bb04-b04f16e72b37 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] No VIF found with MAC fa:16:3e:7a:69:23, not building metadata {{(pid=75122) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 10:08:57 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:08:57 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:08:57 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:08:57 user nova-compute[75122]: DEBUG nova.compute.manager [req-8e04637a-b692-4f44-a249-76543d458169 req-6bc42658-9e50-4107-8be6-5ee34facee68 service nova] [instance: 968c4c12-9c56-4bb5-9b98-d526c67cd7d7] Received event network-vif-plugged-6a965453-1ab7-4987-bcfc-307d082e1e90 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 10:08:57 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-8e04637a-b692-4f44-a249-76543d458169 req-6bc42658-9e50-4107-8be6-5ee34facee68 service nova] Acquiring lock "968c4c12-9c56-4bb5-9b98-d526c67cd7d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:08:57 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-8e04637a-b692-4f44-a249-76543d458169 req-6bc42658-9e50-4107-8be6-5ee34facee68 service nova] Lock "968c4c12-9c56-4bb5-9b98-d526c67cd7d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:08:57 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-8e04637a-b692-4f44-a249-76543d458169 req-6bc42658-9e50-4107-8be6-5ee34facee68 service nova] Lock "968c4c12-9c56-4bb5-9b98-d526c67cd7d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:08:57 user nova-compute[75122]: DEBUG nova.compute.manager [req-8e04637a-b692-4f44-a249-76543d458169 req-6bc42658-9e50-4107-8be6-5ee34facee68 service nova] [instance: 968c4c12-9c56-4bb5-9b98-d526c67cd7d7] No waiting events found dispatching network-vif-plugged-6a965453-1ab7-4987-bcfc-307d082e1e90 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 10:08:57 user nova-compute[75122]: WARNING nova.compute.manager [req-8e04637a-b692-4f44-a249-76543d458169 req-6bc42658-9e50-4107-8be6-5ee34facee68 service nova] [instance: 968c4c12-9c56-4bb5-9b98-d526c67cd7d7] Received unexpected event network-vif-plugged-6a965453-1ab7-4987-bcfc-307d082e1e90 for instance with vm_state building and task_state spawning.
Nov 15 10:08:57 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:08:57 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:08:57 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:08:59 user nova-compute[75122]: DEBUG nova.compute.manager [None req-2e00ab02-056e-47fa-bb04-b04f16e72b37 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 968c4c12-9c56-4bb5-9b98-d526c67cd7d7] Instance event wait completed in 0 seconds for  {{(pid=75122) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 10:08:59 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-2e00ab02-056e-47fa-bb04-b04f16e72b37 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 968c4c12-9c56-4bb5-9b98-d526c67cd7d7] Guest created on hypervisor {{(pid=75122) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 10:08:59 user nova-compute[75122]: INFO nova.virt.libvirt.driver [-] [instance: 968c4c12-9c56-4bb5-9b98-d526c67cd7d7] Instance spawned successfully.
Nov 15 10:08:59 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-2e00ab02-056e-47fa-bb04-b04f16e72b37 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 968c4c12-9c56-4bb5-9b98-d526c67cd7d7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 10:08:59 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-2e00ab02-056e-47fa-bb04-b04f16e72b37 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 968c4c12-9c56-4bb5-9b98-d526c67cd7d7] Found default for hw_cdrom_bus of ide {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 10:08:59 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-2e00ab02-056e-47fa-bb04-b04f16e72b37 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 968c4c12-9c56-4bb5-9b98-d526c67cd7d7] Found default for hw_disk_bus of virtio {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 10:08:59 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-2e00ab02-056e-47fa-bb04-b04f16e72b37 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 968c4c12-9c56-4bb5-9b98-d526c67cd7d7] Found default for hw_input_bus of None {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 10:08:59 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-2e00ab02-056e-47fa-bb04-b04f16e72b37 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 968c4c12-9c56-4bb5-9b98-d526c67cd7d7] Found default for hw_pointer_model of None {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 10:08:59 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-2e00ab02-056e-47fa-bb04-b04f16e72b37 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 968c4c12-9c56-4bb5-9b98-d526c67cd7d7] Found default for hw_video_model of virtio {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 10:08:59 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-2e00ab02-056e-47fa-bb04-b04f16e72b37 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 968c4c12-9c56-4bb5-9b98-d526c67cd7d7] Found default for hw_vif_model of virtio {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 10:08:59 user nova-compute[75122]: DEBUG nova.compute.manager [req-2a4c34ac-be97-42b5-8145-5802acfcfc57 req-2c3aabf3-869a-44f2-9e41-c430e55286d7 service nova] [instance: 968c4c12-9c56-4bb5-9b98-d526c67cd7d7] Received event network-vif-plugged-6a965453-1ab7-4987-bcfc-307d082e1e90 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 10:08:59 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-2a4c34ac-be97-42b5-8145-5802acfcfc57 req-2c3aabf3-869a-44f2-9e41-c430e55286d7 service nova] Acquiring lock "968c4c12-9c56-4bb5-9b98-d526c67cd7d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:08:59 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-2a4c34ac-be97-42b5-8145-5802acfcfc57 req-2c3aabf3-869a-44f2-9e41-c430e55286d7 service nova] Lock "968c4c12-9c56-4bb5-9b98-d526c67cd7d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:08:59 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-2a4c34ac-be97-42b5-8145-5802acfcfc57 req-2c3aabf3-869a-44f2-9e41-c430e55286d7 service nova] Lock "968c4c12-9c56-4bb5-9b98-d526c67cd7d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:08:59 user nova-compute[75122]: DEBUG nova.compute.manager [req-2a4c34ac-be97-42b5-8145-5802acfcfc57 req-2c3aabf3-869a-44f2-9e41-c430e55286d7 service nova] [instance: 968c4c12-9c56-4bb5-9b98-d526c67cd7d7] No waiting events found dispatching network-vif-plugged-6a965453-1ab7-4987-bcfc-307d082e1e90 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 10:08:59 user nova-compute[75122]: WARNING nova.compute.manager [req-2a4c34ac-be97-42b5-8145-5802acfcfc57 req-2c3aabf3-869a-44f2-9e41-c430e55286d7 service nova] [instance: 968c4c12-9c56-4bb5-9b98-d526c67cd7d7] Received unexpected event network-vif-plugged-6a965453-1ab7-4987-bcfc-307d082e1e90 for instance with vm_state building and task_state spawning.
Nov 15 10:08:59 user nova-compute[75122]: INFO nova.compute.manager [None req-2e00ab02-056e-47fa-bb04-b04f16e72b37 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 968c4c12-9c56-4bb5-9b98-d526c67cd7d7] Took 4.97 seconds to spawn the instance on the hypervisor.
Nov 15 10:08:59 user nova-compute[75122]: DEBUG nova.compute.manager [None req-2e00ab02-056e-47fa-bb04-b04f16e72b37 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 968c4c12-9c56-4bb5-9b98-d526c67cd7d7] Checking state {{(pid=75122) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 10:08:59 user nova-compute[75122]: INFO nova.compute.manager [None req-2e00ab02-056e-47fa-bb04-b04f16e72b37 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 968c4c12-9c56-4bb5-9b98-d526c67cd7d7] Took 10.64 seconds to build instance.
Nov 15 10:08:59 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-2e00ab02-056e-47fa-bb04-b04f16e72b37 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Lock "968c4c12-9c56-4bb5-9b98-d526c67cd7d7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.739s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:09:00 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:09:01 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:09:05 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:09:10 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:09:15 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:09:16 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:09:20 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:09:21 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:09:25 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:09:26 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:09:30 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:09:31 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:09:35 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:09:40 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:09:42 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:09:42 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-c5ee038a-36a0-461f-bbe6-1bbfb73aa6f0 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Acquiring lock "001d589e-1bee-42da-8422-233ba796fbab" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:09:42 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-c5ee038a-36a0-461f-bbe6-1bbfb73aa6f0 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Lock "001d589e-1bee-42da-8422-233ba796fbab" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:09:42 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-c5ee038a-36a0-461f-bbe6-1bbfb73aa6f0 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Acquiring lock "001d589e-1bee-42da-8422-233ba796fbab-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:09:42 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-c5ee038a-36a0-461f-bbe6-1bbfb73aa6f0 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Lock "001d589e-1bee-42da-8422-233ba796fbab-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:09:42 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-c5ee038a-36a0-461f-bbe6-1bbfb73aa6f0 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Lock "001d589e-1bee-42da-8422-233ba796fbab-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:09:42 user nova-compute[75122]: INFO nova.compute.manager [None req-c5ee038a-36a0-461f-bbe6-1bbfb73aa6f0 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: 001d589e-1bee-42da-8422-233ba796fbab] Terminating instance
Nov 15 10:09:42 user nova-compute[75122]: DEBUG nova.compute.manager [None req-c5ee038a-36a0-461f-bbe6-1bbfb73aa6f0 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: 001d589e-1bee-42da-8422-233ba796fbab] Start destroying the instance on the hypervisor. {{(pid=75122) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 10:09:43 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:09:43 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:09:43 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:09:43 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:09:43 user nova-compute[75122]: DEBUG nova.compute.manager [req-9138f339-3e40-4f1e-b903-23e9a94de337 req-aa997bbd-4cbe-4e6f-842d-60c262a3bdd6 service nova] [instance: 001d589e-1bee-42da-8422-233ba796fbab] Received event network-vif-unplugged-6a77f68d-d3da-47c6-a3de-09bd69399762 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 10:09:43 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-9138f339-3e40-4f1e-b903-23e9a94de337 req-aa997bbd-4cbe-4e6f-842d-60c262a3bdd6 service nova] Acquiring lock "001d589e-1bee-42da-8422-233ba796fbab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:09:43 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-9138f339-3e40-4f1e-b903-23e9a94de337 req-aa997bbd-4cbe-4e6f-842d-60c262a3bdd6 service nova] Lock "001d589e-1bee-42da-8422-233ba796fbab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:09:43 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-9138f339-3e40-4f1e-b903-23e9a94de337 req-aa997bbd-4cbe-4e6f-842d-60c262a3bdd6 service nova] Lock "001d589e-1bee-42da-8422-233ba796fbab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:09:43 user nova-compute[75122]: DEBUG nova.compute.manager [req-9138f339-3e40-4f1e-b903-23e9a94de337 req-aa997bbd-4cbe-4e6f-842d-60c262a3bdd6 service nova] [instance: 001d589e-1bee-42da-8422-233ba796fbab] No waiting events found dispatching network-vif-unplugged-6a77f68d-d3da-47c6-a3de-09bd69399762 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 10:09:43 user nova-compute[75122]: DEBUG nova.compute.manager [req-9138f339-3e40-4f1e-b903-23e9a94de337 req-aa997bbd-4cbe-4e6f-842d-60c262a3bdd6 service nova] [instance: 001d589e-1bee-42da-8422-233ba796fbab] Received event network-vif-unplugged-6a77f68d-d3da-47c6-a3de-09bd69399762 for instance with task_state deleting. {{(pid=75122) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 10:09:43 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:09:43 user nova-compute[75122]: INFO nova.virt.libvirt.driver [-] [instance: 001d589e-1bee-42da-8422-233ba796fbab] Instance destroyed successfully.
Nov 15 10:09:43 user nova-compute[75122]: DEBUG nova.objects.instance [None req-c5ee038a-36a0-461f-bbe6-1bbfb73aa6f0 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Lazy-loading 'resources' on Instance uuid 001d589e-1bee-42da-8422-233ba796fbab {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 10:09:43 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-c5ee038a-36a0-461f-bbe6-1bbfb73aa6f0 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T09:50:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1100516819',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1100516819',id=35,image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T09:50:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c046170a2ad44ebba5d2de236d940be0',ramdisk_id='',reservation_id='r-aenl36am',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1545444983',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T09:52:03Z,user_data=None,user_id='53d187e2a07b4437a02f65fb47a003ee',uuid=001d589e-1bee-42da-8422-233ba796fbab,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6a77f68d-d3da-47c6-a3de-09bd69399762", "address": "fa:16:3e:87:a0:de", "network": {"id": "b780d5c1-a549-4b49-a036-5a272697d4b6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-229344021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c046170a2ad44ebba5d2de236d940be0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a77f68d-d3", "ovs_interfaceid": "6a77f68d-d3da-47c6-a3de-09bd69399762", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 10:09:43 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-c5ee038a-36a0-461f-bbe6-1bbfb73aa6f0 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Converting VIF {"id": "6a77f68d-d3da-47c6-a3de-09bd69399762", "address": "fa:16:3e:87:a0:de", "network": {"id": "b780d5c1-a549-4b49-a036-5a272697d4b6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-229344021-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c046170a2ad44ebba5d2de236d940be0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a77f68d-d3", "ovs_interfaceid": "6a77f68d-d3da-47c6-a3de-09bd69399762", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 10:09:43 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-c5ee038a-36a0-461f-bbe6-1bbfb73aa6f0 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:87:a0:de,bridge_name='br-int',has_traffic_filtering=True,id=6a77f68d-d3da-47c6-a3de-09bd69399762,network=Network(b780d5c1-a549-4b49-a036-5a272697d4b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a77f68d-d3') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 10:09:43 user nova-compute[75122]: DEBUG os_vif [None req-c5ee038a-36a0-461f-bbe6-1bbfb73aa6f0 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:87:a0:de,bridge_name='br-int',has_traffic_filtering=True,id=6a77f68d-d3da-47c6-a3de-09bd69399762,network=Network(b780d5c1-a549-4b49-a036-5a272697d4b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a77f68d-d3') {{(pid=75122) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 10:09:43 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:09:43 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6a77f68d-d3, bridge=br-int, if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 10:09:43 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:09:43 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:09:43 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:09:43 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=22078380-9f76-4de7-a8ca-65426f731101) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 10:09:43 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:09:43 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:09:43 user nova-compute[75122]: INFO os_vif [None req-c5ee038a-36a0-461f-bbe6-1bbfb73aa6f0 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:87:a0:de,bridge_name='br-int',has_traffic_filtering=True,id=6a77f68d-d3da-47c6-a3de-09bd69399762,network=Network(b780d5c1-a549-4b49-a036-5a272697d4b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a77f68d-d3')
Nov 15 10:09:43 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-c5ee038a-36a0-461f-bbe6-1bbfb73aa6f0 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: 001d589e-1bee-42da-8422-233ba796fbab] Deleting instance files /opt/stack/data/nova/instances/001d589e-1bee-42da-8422-233ba796fbab_del
Nov 15 10:09:43 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-c5ee038a-36a0-461f-bbe6-1bbfb73aa6f0 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: 001d589e-1bee-42da-8422-233ba796fbab] Deletion of /opt/stack/data/nova/instances/001d589e-1bee-42da-8422-233ba796fbab_del complete
Nov 15 10:09:43 user nova-compute[75122]: INFO nova.compute.manager [None req-c5ee038a-36a0-461f-bbe6-1bbfb73aa6f0 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] [instance: 001d589e-1bee-42da-8422-233ba796fbab] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 15 10:09:43 user nova-compute[75122]: DEBUG oslo.service.loopingcall [None req-c5ee038a-36a0-461f-bbe6-1bbfb73aa6f0 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75122) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 10:09:43 user nova-compute[75122]: DEBUG nova.compute.manager [-] [instance: 001d589e-1bee-42da-8422-233ba796fbab] Deallocating network for instance {{(pid=75122) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 10:09:43 user nova-compute[75122]: DEBUG nova.network.neutron [-] [instance: 001d589e-1bee-42da-8422-233ba796fbab] deallocate_for_instance() {{(pid=75122) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 10:09:44 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:09:44 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:09:44 user nova-compute[75122]: DEBUG nova.network.neutron [-] [instance: 001d589e-1bee-42da-8422-233ba796fbab] Updating instance_info_cache with network_info: [] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 10:09:44 user nova-compute[75122]: INFO nova.compute.manager [-] [instance: 001d589e-1bee-42da-8422-233ba796fbab] Took 0.49 seconds to deallocate network for instance.
Nov 15 10:09:44 user nova-compute[75122]: DEBUG nova.compute.manager [req-5e7b46c1-d11a-4a7e-aa75-9b1ef5574bbe req-a25ea926-8803-40d3-94e3-6a065ea5440c service nova] [instance: 001d589e-1bee-42da-8422-233ba796fbab] Received event network-vif-deleted-6a77f68d-d3da-47c6-a3de-09bd69399762 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 10:09:44 user nova-compute[75122]: INFO nova.compute.manager [req-5e7b46c1-d11a-4a7e-aa75-9b1ef5574bbe req-a25ea926-8803-40d3-94e3-6a065ea5440c service nova] [instance: 001d589e-1bee-42da-8422-233ba796fbab] Neutron deleted interface 6a77f68d-d3da-47c6-a3de-09bd69399762; detaching it from the instance and deleting it from the info cache
Nov 15 10:09:44 user nova-compute[75122]: DEBUG nova.network.neutron [req-5e7b46c1-d11a-4a7e-aa75-9b1ef5574bbe req-a25ea926-8803-40d3-94e3-6a065ea5440c service nova] [instance: 001d589e-1bee-42da-8422-233ba796fbab] Updating instance_info_cache with network_info: [] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 10:09:44 user nova-compute[75122]: DEBUG nova.compute.manager [req-5e7b46c1-d11a-4a7e-aa75-9b1ef5574bbe req-a25ea926-8803-40d3-94e3-6a065ea5440c service nova] [instance: 001d589e-1bee-42da-8422-233ba796fbab] Detach interface failed, port_id=6a77f68d-d3da-47c6-a3de-09bd69399762, reason: Instance 001d589e-1bee-42da-8422-233ba796fbab could not be found. {{(pid=75122) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 10:09:44 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-c5ee038a-36a0-461f-bbe6-1bbfb73aa6f0 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:09:44 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-c5ee038a-36a0-461f-bbe6-1bbfb73aa6f0 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:09:44 user nova-compute[75122]: DEBUG nova.compute.provider_tree [None req-c5ee038a-36a0-461f-bbe6-1bbfb73aa6f0 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Inventory has not changed in ProviderTree for provider: 69a3da65-47be-44c6-b67c-c692b58284ef {{(pid=75122) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 10:09:44 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-c5ee038a-36a0-461f-bbe6-1bbfb73aa6f0 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Inventory has not changed for provider 69a3da65-47be-44c6-b67c-c692b58284ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 10:09:44 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-c5ee038a-36a0-461f-bbe6-1bbfb73aa6f0 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.194s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:09:44 user nova-compute[75122]: INFO nova.scheduler.client.report [None req-c5ee038a-36a0-461f-bbe6-1bbfb73aa6f0 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Deleted allocations for instance 001d589e-1bee-42da-8422-233ba796fbab
Nov 15 10:09:44 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-c5ee038a-36a0-461f-bbe6-1bbfb73aa6f0 tempest-ServerBootFromVolumeStableRescueTest-1545444983 tempest-ServerBootFromVolumeStableRescueTest-1545444983-project-member] Lock "001d589e-1bee-42da-8422-233ba796fbab" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.735s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:09:45 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:09:45 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:09:45 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:09:45 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:09:45 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75122) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 10:09:45 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75122) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 10:09:45 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bb980be-c2eb-42eb-a84b-5d29592259a4/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:09:45 user nova-compute[75122]: DEBUG nova.compute.manager [req-9aef68e6-5cbc-4175-ac3f-af2d604ffdd9 req-abf76805-b1c5-4546-a86a-7c46641b51d7 service nova] [instance: 001d589e-1bee-42da-8422-233ba796fbab] Received event network-vif-plugged-6a77f68d-d3da-47c6-a3de-09bd69399762 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 10:09:45 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-9aef68e6-5cbc-4175-ac3f-af2d604ffdd9 req-abf76805-b1c5-4546-a86a-7c46641b51d7 service nova] Acquiring lock "001d589e-1bee-42da-8422-233ba796fbab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:09:45 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-9aef68e6-5cbc-4175-ac3f-af2d604ffdd9 req-abf76805-b1c5-4546-a86a-7c46641b51d7 service nova] Lock "001d589e-1bee-42da-8422-233ba796fbab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:09:45 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-9aef68e6-5cbc-4175-ac3f-af2d604ffdd9 req-abf76805-b1c5-4546-a86a-7c46641b51d7 service nova] Lock "001d589e-1bee-42da-8422-233ba796fbab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:09:45 user nova-compute[75122]: DEBUG nova.compute.manager [req-9aef68e6-5cbc-4175-ac3f-af2d604ffdd9 req-abf76805-b1c5-4546-a86a-7c46641b51d7 service nova] [instance: 001d589e-1bee-42da-8422-233ba796fbab] No waiting events found dispatching network-vif-plugged-6a77f68d-d3da-47c6-a3de-09bd69399762 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 10:09:45 user nova-compute[75122]: WARNING nova.compute.manager [req-9aef68e6-5cbc-4175-ac3f-af2d604ffdd9 req-abf76805-b1c5-4546-a86a-7c46641b51d7 service nova] [instance: 001d589e-1bee-42da-8422-233ba796fbab] Received unexpected event network-vif-plugged-6a77f68d-d3da-47c6-a3de-09bd69399762 for instance with vm_state deleted and task_state None.
Nov 15 10:09:45 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bb980be-c2eb-42eb-a84b-5d29592259a4/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:09:45 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bb980be-c2eb-42eb-a84b-5d29592259a4/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:09:45 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bb980be-c2eb-42eb-a84b-5d29592259a4/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:09:46 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 10:09:46 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 10:09:46 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Hypervisor/Node resource view: name=user free_ram=8817MB free_disk=25.145183563232422GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75122) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 10:09:46 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:09:46 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:09:46 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance 5bb980be-c2eb-42eb-a84b-5d29592259a4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 10:09:46 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance 968c4c12-9c56-4bb5-9b98-d526c67cd7d7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 10:09:46 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75122) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 10:09:46 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75122) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 10:09:46 user nova-compute[75122]: DEBUG nova.compute.provider_tree [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Inventory has not changed in ProviderTree for provider: 69a3da65-47be-44c6-b67c-c692b58284ef {{(pid=75122) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 10:09:46 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Inventory has not changed for provider 69a3da65-47be-44c6-b67c-c692b58284ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 10:09:46 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Compute_service record updated for user:user {{(pid=75122) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 10:09:46 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.229s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:09:48 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:09:52 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:09:52 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:09:52 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Starting heal instance info cache {{(pid=75122) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 10:09:52 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Rebuilding the list of instances to heal {{(pid=75122) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 10:09:52 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "refresh_cache-5bb980be-c2eb-42eb-a84b-5d29592259a4" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 10:09:52 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquired lock "refresh_cache-5bb980be-c2eb-42eb-a84b-5d29592259a4" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 10:09:52 user nova-compute[75122]: DEBUG nova.network.neutron [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] [instance: 5bb980be-c2eb-42eb-a84b-5d29592259a4] Forcefully refreshing network info cache for instance {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 10:09:52 user nova-compute[75122]: DEBUG nova.objects.instance [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lazy-loading 'info_cache' on Instance uuid 5bb980be-c2eb-42eb-a84b-5d29592259a4 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 10:09:52 user nova-compute[75122]: DEBUG nova.network.neutron [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] [instance: 5bb980be-c2eb-42eb-a84b-5d29592259a4] Updating instance_info_cache with network_info: [{"id": "5dcdd286-bee6-43e0-96d4-a42d060b6158", "address": "fa:16:3e:67:41:8c", "network": {"id": "8c1491a5-d5c6-4a22-84fd-bdeca00bbaad", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1848328203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab6afbe7809a4ad3921cbc18145d1816", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5dcdd286-be", "ovs_interfaceid": "5dcdd286-bee6-43e0-96d4-a42d060b6158", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 10:09:52 user nova-compute[75122]: DEBUG nova.compute.manager [req-23cf44df-29df-407d-8b77-56ec3881c5c4 req-d4786151-673e-469f-8cb9-40c8e5320d7f service nova] [instance: 5bb980be-c2eb-42eb-a84b-5d29592259a4] Received event network-changed-5dcdd286-bee6-43e0-96d4-a42d060b6158 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 10:09:52 user nova-compute[75122]: DEBUG nova.compute.manager [req-23cf44df-29df-407d-8b77-56ec3881c5c4 req-d4786151-673e-469f-8cb9-40c8e5320d7f service nova] [instance: 5bb980be-c2eb-42eb-a84b-5d29592259a4] Refreshing instance network info cache due to event network-changed-5dcdd286-bee6-43e0-96d4-a42d060b6158. {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 10:09:52 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-23cf44df-29df-407d-8b77-56ec3881c5c4 req-d4786151-673e-469f-8cb9-40c8e5320d7f service nova] Acquiring lock "refresh_cache-5bb980be-c2eb-42eb-a84b-5d29592259a4" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 10:09:52 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Releasing lock "refresh_cache-5bb980be-c2eb-42eb-a84b-5d29592259a4" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 10:09:52 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] [instance: 5bb980be-c2eb-42eb-a84b-5d29592259a4] Updated the network info_cache for instance {{(pid=75122) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 10:09:52 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-23cf44df-29df-407d-8b77-56ec3881c5c4 req-d4786151-673e-469f-8cb9-40c8e5320d7f service nova] Acquired lock "refresh_cache-5bb980be-c2eb-42eb-a84b-5d29592259a4" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 10:09:52 user nova-compute[75122]: DEBUG nova.network.neutron [req-23cf44df-29df-407d-8b77-56ec3881c5c4 req-d4786151-673e-469f-8cb9-40c8e5320d7f service nova] [instance: 5bb980be-c2eb-42eb-a84b-5d29592259a4] Refreshing network info cache for port 5dcdd286-bee6-43e0-96d4-a42d060b6158 {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 10:09:52 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:09:52 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:09:52 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:09:52 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75122) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 10:09:53 user nova-compute[75122]: DEBUG nova.network.neutron [req-23cf44df-29df-407d-8b77-56ec3881c5c4 req-d4786151-673e-469f-8cb9-40c8e5320d7f service nova] [instance: 5bb980be-c2eb-42eb-a84b-5d29592259a4] Updated VIF entry in instance network info cache for port 5dcdd286-bee6-43e0-96d4-a42d060b6158. {{(pid=75122) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 10:09:53 user nova-compute[75122]: DEBUG nova.network.neutron [req-23cf44df-29df-407d-8b77-56ec3881c5c4 req-d4786151-673e-469f-8cb9-40c8e5320d7f service nova] [instance: 5bb980be-c2eb-42eb-a84b-5d29592259a4] Updating instance_info_cache with network_info: [{"id": "5dcdd286-bee6-43e0-96d4-a42d060b6158", "address": "fa:16:3e:67:41:8c", "network": {"id": "8c1491a5-d5c6-4a22-84fd-bdeca00bbaad", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1848328203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab6afbe7809a4ad3921cbc18145d1816", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5dcdd286-be", "ovs_interfaceid": "5dcdd286-bee6-43e0-96d4-a42d060b6158", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 10:09:53 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-23cf44df-29df-407d-8b77-56ec3881c5c4 req-d4786151-673e-469f-8cb9-40c8e5320d7f service nova] Releasing lock "refresh_cache-5bb980be-c2eb-42eb-a84b-5d29592259a4" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 10:09:53 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:09:54 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0092b9b7-c4c4-46d3-ad0c-e8bd25bf5e65 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Acquiring lock "5bb980be-c2eb-42eb-a84b-5d29592259a4" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:09:54 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0092b9b7-c4c4-46d3-ad0c-e8bd25bf5e65 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Lock "5bb980be-c2eb-42eb-a84b-5d29592259a4" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:09:54 user nova-compute[75122]: DEBUG nova.objects.instance [None req-0092b9b7-c4c4-46d3-ad0c-e8bd25bf5e65 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Lazy-loading 'flavor' on Instance uuid 5bb980be-c2eb-42eb-a84b-5d29592259a4 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 10:09:54 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0092b9b7-c4c4-46d3-ad0c-e8bd25bf5e65 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Lock "5bb980be-c2eb-42eb-a84b-5d29592259a4" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:09:54 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0092b9b7-c4c4-46d3-ad0c-e8bd25bf5e65 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Acquiring lock "5bb980be-c2eb-42eb-a84b-5d29592259a4" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:09:54 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0092b9b7-c4c4-46d3-ad0c-e8bd25bf5e65 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Lock "5bb980be-c2eb-42eb-a84b-5d29592259a4" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:09:54 user nova-compute[75122]: INFO nova.compute.manager [None req-0092b9b7-c4c4-46d3-ad0c-e8bd25bf5e65 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] [instance: 5bb980be-c2eb-42eb-a84b-5d29592259a4] Attaching volume 605fdadf-44dc-4b8b-960a-b5734967c090 to /dev/vdb
Nov 15 10:09:54 user nova-compute[75122]: DEBUG os_brick.utils [None req-0092b9b7-c4c4-46d3-ad0c-e8bd25bf5e65 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 10:09:54 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:09:54 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:09:54 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c5700f8-3a37-4de0-99c8-e2d3c61229b8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:742fb64b3587\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:09:54 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:09:54 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:09:54 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[41787476-0049-4344-a9f4-eb406b3bf09e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:09:54 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:09:54 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:09:54 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[31c7a96a-d9f1-4c34-a09e-492eca21c2a6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:09:54 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3e1fc01-ff28-45a7-b3b0-7c6690927621]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:09:54 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0092b9b7-c4c4-46d3-ad0c-e8bd25bf5e65 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Running cmd (subprocess): nvme version {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:09:54 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0092b9b7-c4c4-46d3-ad0c-e8bd25bf5e65 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] 'nvme version' failed. Not Retrying. {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 10:09:54 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0092b9b7-c4c4-46d3-ad0c-e8bd25bf5e65 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] nvme not present on system {{(pid=75122) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 10:09:54 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:09:54 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 10:09:54 user nova-compute[75122]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 10:09:54 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fd828e6-9b17-485d-b038-9303fb6cdb02]: (4, '') {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:09:55 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.lightos [None req-0092b9b7-c4c4-46d3-ad0c-e8bd25bf5e65 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75122) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 10:09:55 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.lightos [None req-0092b9b7-c4c4-46d3-ad0c-e8bd25bf5e65 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75122) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 10:09:55 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.lightos [None req-0092b9b7-c4c4-46d3-ad0c-e8bd25bf5e65 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] LIGHTOS: no hostnqn found. {{(pid=75122) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 10:09:55 user nova-compute[75122]: DEBUG os_brick.utils [None req-0092b9b7-c4c4-46d3-ad0c-e8bd25bf5e65 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:742fb64b3587', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 10:09:55 user nova-compute[75122]: DEBUG nova.virt.block_device [None req-0092b9b7-c4c4-46d3-ad0c-e8bd25bf5e65 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] [instance: 5bb980be-c2eb-42eb-a84b-5d29592259a4] Updating existing volume attachment record: 1afc84d5-922c-460d-b363-72dfa8f598bf {{(pid=75122) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 10:09:56 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:09:58 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:09:59 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0092b9b7-c4c4-46d3-ad0c-e8bd25bf5e65 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] [instance: 5bb980be-c2eb-42eb-a84b-5d29592259a4] Calling os-brick to attach iSCSI Volume {{(pid=75122) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 10:09:59 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-0092b9b7-c4c4-46d3-ad0c-e8bd25bf5e65 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffa04060b80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:605fdadf-44dc-4b8b-960a-b5734967c090', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oaJkUfQh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 10:09:59 user nova-compute[75122]: WARNING os_brick.initiator.connectors.base [None req-0092b9b7-c4c4-46d3-ad0c-e8bd25bf5e65 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 10:09:59 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-0092b9b7-c4c4-46d3-ad0c-e8bd25bf5e65 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 10:09:59 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-0092b9b7-c4c4-46d3-ad0c-e8bd25bf5e65 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 10:09:59 user nova-compute[75122]: WARNING os_brick.initiator.connectors.base [None req-0092b9b7-c4c4-46d3-ad0c-e8bd25bf5e65 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 10:09:59 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-0092b9b7-c4c4-46d3-ad0c-e8bd25bf5e65 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:605fdadf-44dc-4b8b-960a-b5734967c090" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 10:09:59 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-0092b9b7-c4c4-46d3-ad0c-e8bd25bf5e65 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:605fdadf-44dc-4b8b-960a-b5734967c090" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 10:09:59 user nova-compute[75122]: INFO os_brick.initiator.connectors.iscsi [None req-0092b9b7-c4c4-46d3-ad0c-e8bd25bf5e65 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 10:09:59 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:605fdadf-44dc-4b8b-960a-b5734967c090 -p 172.16.0.220:3260 {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:09:59 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:605fdadf-44dc-4b8b-960a-b5734967c090 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:09:59 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[22767edb-be39-4831-a6eb-3b58cff74124]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:09:59 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-0092b9b7-c4c4-46d3-ad0c-e8bd25bf5e65 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 10:09:59 user nova-compute[75122]:  {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 10:09:59 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:605fdadf-44dc-4b8b-960a-b5734967c090 -p 172.16.0.220:3260 --interface default --op new {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:09:59 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:605fdadf-44dc-4b8b-960a-b5734967c090 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:09:59 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[debdae0e-8c42-4aaa-b831-ea01bfe78eb9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:605fdadf-44dc-4b8b-960a-b5734967c090] added\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:09:59 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-0092b9b7-c4c4-46d3-ad0c-e8bd25bf5e65 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:605fdadf-44dc-4b8b-960a-b5734967c090] added
Nov 15 10:09:59 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 10:09:59 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:605fdadf-44dc-4b8b-960a-b5734967c090 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:09:59 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:605fdadf-44dc-4b8b-960a-b5734967c090 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:09:59 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[620ff110-a482-4b9a-a70e-8f7928373446]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:09:59 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-0092b9b7-c4c4-46d3-ad0c-e8bd25bf5e65 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 10:09:59 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:605fdadf-44dc-4b8b-960a-b5734967c090 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:09:59 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:605fdadf-44dc-4b8b-960a-b5734967c090 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:09:59 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[440f9cd0-921e-47d0-b02d-4fd3801eff6b]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:09:59 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-0092b9b7-c4c4-46d3-ad0c-e8bd25bf5e65 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 10:09:59 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:605fdadf-44dc-4b8b-960a-b5734967c090 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oaJkUfQh {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:09:59 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:605fdadf-44dc-4b8b-960a-b5734967c090 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oaJkUfQh" returned: 0 in 0.017s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:09:59 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ee1ad51-cded-440f-8b31-6430267a9a7d]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:09:59 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-0092b9b7-c4c4-46d3-ad0c-e8bd25bf5e65 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oaJkUfQh'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 10:09:59 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:605fdadf-44dc-4b8b-960a-b5734967c090 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:09:59 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:605fdadf-44dc-4b8b-960a-b5734967c090 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:09:59 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[455eb943-6a32-4810-97be-bf465e7504ce]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:09:59 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-0092b9b7-c4c4-46d3-ad0c-e8bd25bf5e65 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 10:09:59 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:09:59 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:09:59 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[373bda4f-ac16-4ddf-be57-eb3c30233cf9]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59ca9506-19c1-4a17-a495-28601cdadf8b (non-flash)\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:09:59 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-0092b9b7-c4c4-46d3-ad0c-e8bd25bf5e65 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59ca9506-19c1-4a17-a495-28601cdadf8b (non-flash)
Nov 15 10:09:59 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 10:09:59 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-0092b9b7-c4c4-46d3-ad0c-e8bd25bf5e65 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59ca9506-19c1-4a17-a495-28601cdadf8b (non-flash)
Nov 15 10:09:59 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 10:09:59 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:605fdadf-44dc-4b8b-960a-b5734967c090 -p 172.16.0.220:3260 --login {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:09:59 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:605fdadf-44dc-4b8b-960a-b5734967c090 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:09:59 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[defdf742-0095-4641-a7b0-b81c7edca292]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:605fdadf-44dc-4b8b-960a-b5734967c090, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:605fdadf-44dc-4b8b-960a-b5734967c090, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:09:59 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-0092b9b7-c4c4-46d3-ad0c-e8bd25bf5e65 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:605fdadf-44dc-4b8b-960a-b5734967c090, portal: 172.16.0.220,3260]
Nov 15 10:09:59 user nova-compute[75122]: Login to [iface: default, target: iqn.2010-10.org.openstack:605fdadf-44dc-4b8b-960a-b5734967c090, portal: 172.16.0.220,3260] successful.
Nov 15 10:09:59 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 10:09:59 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:605fdadf-44dc-4b8b-960a-b5734967c090 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:09:59 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:605fdadf-44dc-4b8b-960a-b5734967c090 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:09:59 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3a0e67d-cb1c-4be7-9f80-c751e23a8f7c]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:09:59 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-0092b9b7-c4c4-46d3-ad0c-e8bd25bf5e65 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 10:09:59 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:09:59 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:09:59 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[937e01a3-470e-4344-8b6f-18c218b29baa]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59ca9506-19c1-4a17-a495-28601cdadf8b (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:605fdadf-44dc-4b8b-960a-b5734967c090 (non-flash)\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:09:59 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-0092b9b7-c4c4-46d3-ad0c-e8bd25bf5e65 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59ca9506-19c1-4a17-a495-28601cdadf8b (non-flash)
Nov 15 10:09:59 user nova-compute[75122]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:605fdadf-44dc-4b8b-960a-b5734967c090 (non-flash)
Nov 15 10:09:59 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 10:09:59 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-0092b9b7-c4c4-46d3-ad0c-e8bd25bf5e65 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59ca9506-19c1-4a17-a495-28601cdadf8b (non-flash)
Nov 15 10:09:59 user nova-compute[75122]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:605fdadf-44dc-4b8b-960a-b5734967c090 (non-flash)
Nov 15 10:09:59 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 10:09:59 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-0092b9b7-c4c4-46d3-ad0c-e8bd25bf5e65 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:605fdadf-44dc-4b8b-960a-b5734967c090" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.273s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 10:09:59 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-0092b9b7-c4c4-46d3-ad0c-e8bd25bf5e65 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Connected to 172.16.0.220:3260 {{(pid=75122) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 10:09:59 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-0092b9b7-c4c4-46d3-ad0c-e8bd25bf5e65 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] HCTL ('34', '-', '-', 0) found on session 58 with lun 0 {{(pid=75122) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 10:09:59 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-0092b9b7-c4c4-46d3-ad0c-e8bd25bf5e65 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75122) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 10:09:59 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:09:59 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:09:59 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4b3c06f-711f-400c-aa8a-8a327657d131]: (4, ('- - 0', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:09:59 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-0092b9b7-c4c4-46d3-ad0c-e8bd25bf5e65 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Searching for a device in session 58 and hctl ['34', '*', '*', 0] yield: None {{(pid=75122) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 10:10:00 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-0092b9b7-c4c4-46d3-ad0c-e8bd25bf5e65 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Searching for a device in session 58 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75122) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 10:10:00 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-0092b9b7-c4c4-46d3-ad0c-e8bd25bf5e65 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:605fdadf-44dc-4b8b-960a-b5734967c090', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oaJkUfQh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75122) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 10:10:00 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-0092b9b7-c4c4-46d3-ad0c-e8bd25bf5e65 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.303s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 10:10:00 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-0092b9b7-c4c4-46d3-ad0c-e8bd25bf5e65 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] <== connect_volume: return (1305ms) {'type': 'block', 'scsi_wwn': '23233303863656434', 'path': '/dev/sdc'} {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 10:10:00 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0092b9b7-c4c4-46d3-ad0c-e8bd25bf5e65 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] [instance: 5bb980be-c2eb-42eb-a84b-5d29592259a4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23233303863656434', 'path': '/dev/sdc'} {{(pid=75122) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 10:10:00 user nova-compute[75122]: DEBUG nova.objects.instance [None req-0092b9b7-c4c4-46d3-ad0c-e8bd25bf5e65 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Lazy-loading 'flavor' on Instance uuid 5bb980be-c2eb-42eb-a84b-5d29592259a4 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 10:10:00 user nova-compute[75122]: DEBUG nova.virt.libvirt.guest [None req-0092b9b7-c4c4-46d3-ad0c-e8bd25bf5e65 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 10:10:00 user nova-compute[75122]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 10:10:00 user nova-compute[75122]:   <source dev="/dev/sdc"/>
Nov 15 10:10:00 user nova-compute[75122]:   <target dev="vdb" bus="virtio"/>
Nov 15 10:10:00 user nova-compute[75122]:   <serial>605fdadf-44dc-4b8b-960a-b5734967c090</serial>
Nov 15 10:10:00 user nova-compute[75122]: </disk>
Nov 15 10:10:00 user nova-compute[75122]:  {{(pid=75122) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 10:10:01 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-0092b9b7-c4c4-46d3-ad0c-e8bd25bf5e65 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] No BDM found with device name vda, not building metadata. {{(pid=75122) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 10:10:01 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-0092b9b7-c4c4-46d3-ad0c-e8bd25bf5e65 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75122) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 10:10:01 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-0092b9b7-c4c4-46d3-ad0c-e8bd25bf5e65 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] No VIF found with MAC fa:16:3e:67:41:8c, not building metadata {{(pid=75122) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 10:10:01 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0092b9b7-c4c4-46d3-ad0c-e8bd25bf5e65 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Lock "5bb980be-c2eb-42eb-a84b-5d29592259a4" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.478s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:10:01 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:10:03 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:10:03 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-f27a0038-1fe6-4d85-af08-9b8f3fe2a932 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Acquiring lock "5bb980be-c2eb-42eb-a84b-5d29592259a4" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:10:03 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-f27a0038-1fe6-4d85-af08-9b8f3fe2a932 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Lock "5bb980be-c2eb-42eb-a84b-5d29592259a4" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:10:03 user nova-compute[75122]: DEBUG nova.objects.instance [None req-f27a0038-1fe6-4d85-af08-9b8f3fe2a932 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Lazy-loading 'flavor' on Instance uuid 5bb980be-c2eb-42eb-a84b-5d29592259a4 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 10:10:03 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-f27a0038-1fe6-4d85-af08-9b8f3fe2a932 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Lock "5bb980be-c2eb-42eb-a84b-5d29592259a4" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:10:04 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-f27a0038-1fe6-4d85-af08-9b8f3fe2a932 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Acquiring lock "5bb980be-c2eb-42eb-a84b-5d29592259a4" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:10:04 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-f27a0038-1fe6-4d85-af08-9b8f3fe2a932 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Lock "5bb980be-c2eb-42eb-a84b-5d29592259a4" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:10:04 user nova-compute[75122]: INFO nova.compute.manager [None req-f27a0038-1fe6-4d85-af08-9b8f3fe2a932 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] [instance: 5bb980be-c2eb-42eb-a84b-5d29592259a4] Attaching volume a4146b89-df53-44df-bd77-afa4b334b4ef to /dev/vdc
Nov 15 10:10:04 user nova-compute[75122]: DEBUG os_brick.utils [None req-f27a0038-1fe6-4d85-af08-9b8f3fe2a932 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 10:10:04 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:10:04 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:10:04 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a56c93c-3a90-4476-b85b-cb1b2955d50d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:742fb64b3587\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:10:04 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:10:04 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:10:04 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[7415654a-2751-4283-85de-bf103eca965a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:10:04 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:10:04 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:10:04 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebd18e4c-7fc5-4b79-8695-5fb9028948bf]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:10:04 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[c97c32a0-8cba-477b-8330-e5446cb4a836]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:10:04 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-f27a0038-1fe6-4d85-af08-9b8f3fe2a932 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Running cmd (subprocess): nvme version {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:10:04 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-f27a0038-1fe6-4d85-af08-9b8f3fe2a932 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] 'nvme version' failed. Not Retrying. {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 10:10:04 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f27a0038-1fe6-4d85-af08-9b8f3fe2a932 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] nvme not present on system {{(pid=75122) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 10:10:04 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:10:04 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 10:10:04 user nova-compute[75122]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 10:10:04 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[0541bdfd-03f5-4cf9-a861-3731a2454b5d]: (4, '') {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:10:04 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.lightos [None req-f27a0038-1fe6-4d85-af08-9b8f3fe2a932 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75122) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 10:10:04 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.lightos [None req-f27a0038-1fe6-4d85-af08-9b8f3fe2a932 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75122) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 10:10:04 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.lightos [None req-f27a0038-1fe6-4d85-af08-9b8f3fe2a932 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] LIGHTOS: no hostnqn found. {{(pid=75122) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 10:10:04 user nova-compute[75122]: DEBUG os_brick.utils [None req-f27a0038-1fe6-4d85-af08-9b8f3fe2a932 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] <== get_connector_properties: return (111ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:742fb64b3587', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 10:10:04 user nova-compute[75122]: DEBUG nova.virt.block_device [None req-f27a0038-1fe6-4d85-af08-9b8f3fe2a932 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] [instance: 5bb980be-c2eb-42eb-a84b-5d29592259a4] Updating existing volume attachment record: 0ca304fc-370b-449b-aab4-26fd99332239 {{(pid=75122) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 10:10:08 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:10:08 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f27a0038-1fe6-4d85-af08-9b8f3fe2a932 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] [instance: 5bb980be-c2eb-42eb-a84b-5d29592259a4] Calling os-brick to attach iSCSI Volume {{(pid=75122) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 10:10:08 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-f27a0038-1fe6-4d85-af08-9b8f3fe2a932 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffa04060b80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a4146b89-df53-44df-bd77-afa4b334b4ef', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aNOADoxg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 10:10:08 user nova-compute[75122]: WARNING os_brick.initiator.connectors.base [None req-f27a0038-1fe6-4d85-af08-9b8f3fe2a932 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 10:10:08 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-f27a0038-1fe6-4d85-af08-9b8f3fe2a932 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 10:10:08 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-f27a0038-1fe6-4d85-af08-9b8f3fe2a932 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 10:10:08 user nova-compute[75122]: WARNING os_brick.initiator.connectors.base [None req-f27a0038-1fe6-4d85-af08-9b8f3fe2a932 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 10:10:08 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-f27a0038-1fe6-4d85-af08-9b8f3fe2a932 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a4146b89-df53-44df-bd77-afa4b334b4ef" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 10:10:08 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-f27a0038-1fe6-4d85-af08-9b8f3fe2a932 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a4146b89-df53-44df-bd77-afa4b334b4ef" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 10:10:08 user nova-compute[75122]: INFO os_brick.initiator.connectors.iscsi [None req-f27a0038-1fe6-4d85-af08-9b8f3fe2a932 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 10:10:08 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4146b89-df53-44df-bd77-afa4b334b4ef -p 172.16.0.220:3260 {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:10:08 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4146b89-df53-44df-bd77-afa4b334b4ef -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:10:08 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[94e54aa7-42bf-4e55-ab1d-a445ffc01180]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:10:08 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-f27a0038-1fe6-4d85-af08-9b8f3fe2a932 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 10:10:08 user nova-compute[75122]:  {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 10:10:08 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4146b89-df53-44df-bd77-afa4b334b4ef -p 172.16.0.220:3260 --interface default --op new {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:10:08 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4146b89-df53-44df-bd77-afa4b334b4ef -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:10:08 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf0d55d2-5cb9-46af-8b17-b6671e38009d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a4146b89-df53-44df-bd77-afa4b334b4ef] added\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:10:08 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-f27a0038-1fe6-4d85-af08-9b8f3fe2a932 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a4146b89-df53-44df-bd77-afa4b334b4ef] added
Nov 15 10:10:08 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 10:10:08 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4146b89-df53-44df-bd77-afa4b334b4ef -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:10:08 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4146b89-df53-44df-bd77-afa4b334b4ef -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:10:08 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c601c1b-fce2-4d66-8032-15a8e8a0f0c4]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:10:08 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-f27a0038-1fe6-4d85-af08-9b8f3fe2a932 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 10:10:08 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4146b89-df53-44df-bd77-afa4b334b4ef -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:10:08 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4146b89-df53-44df-bd77-afa4b334b4ef -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:10:08 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[1392d309-c048-43d2-a4ad-40176d901497]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:10:08 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-f27a0038-1fe6-4d85-af08-9b8f3fe2a932 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 10:10:08 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4146b89-df53-44df-bd77-afa4b334b4ef -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aNOADoxg {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:10:08 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4146b89-df53-44df-bd77-afa4b334b4ef -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aNOADoxg" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:10:08 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[75540a1c-9a42-42ac-ad67-65e732ec68e6]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:10:08 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-f27a0038-1fe6-4d85-af08-9b8f3fe2a932 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'aNOADoxg'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 10:10:08 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4146b89-df53-44df-bd77-afa4b334b4ef -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:10:08 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4146b89-df53-44df-bd77-afa4b334b4ef -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:10:08 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[4493e4ff-5754-4c66-9d56-bb32ea7d479f]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:10:08 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-f27a0038-1fe6-4d85-af08-9b8f3fe2a932 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 10:10:08 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:10:09 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:10:09 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a6a9815-888e-4a24-bedd-8d834cbd1eda]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59ca9506-19c1-4a17-a495-28601cdadf8b (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:605fdadf-44dc-4b8b-960a-b5734967c090 (non-flash)\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:10:09 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-f27a0038-1fe6-4d85-af08-9b8f3fe2a932 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59ca9506-19c1-4a17-a495-28601cdadf8b (non-flash)
Nov 15 10:10:09 user nova-compute[75122]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:605fdadf-44dc-4b8b-960a-b5734967c090 (non-flash)
Nov 15 10:10:09 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 10:10:09 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-f27a0038-1fe6-4d85-af08-9b8f3fe2a932 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59ca9506-19c1-4a17-a495-28601cdadf8b (non-flash)
Nov 15 10:10:09 user nova-compute[75122]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:605fdadf-44dc-4b8b-960a-b5734967c090 (non-flash)
Nov 15 10:10:09 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 10:10:09 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4146b89-df53-44df-bd77-afa4b334b4ef -p 172.16.0.220:3260 --login {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:10:09 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4146b89-df53-44df-bd77-afa4b334b4ef -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:10:09 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[4db02171-c55d-459d-a06a-5f86e6846eb4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a4146b89-df53-44df-bd77-afa4b334b4ef, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a4146b89-df53-44df-bd77-afa4b334b4ef, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:10:09 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-f27a0038-1fe6-4d85-af08-9b8f3fe2a932 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a4146b89-df53-44df-bd77-afa4b334b4ef, portal: 172.16.0.220,3260]
Nov 15 10:10:09 user nova-compute[75122]: Login to [iface: default, target: iqn.2010-10.org.openstack:a4146b89-df53-44df-bd77-afa4b334b4ef, portal: 172.16.0.220,3260] successful.
Nov 15 10:10:09 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 10:10:09 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4146b89-df53-44df-bd77-afa4b334b4ef -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:10:09 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4146b89-df53-44df-bd77-afa4b334b4ef -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:10:09 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b7a7d14-3c0d-4332-a914-b242e97e430c]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:10:09 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-f27a0038-1fe6-4d85-af08-9b8f3fe2a932 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 10:10:09 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:10:09 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:10:09 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[15b17c0c-b159-4998-a020-1d4cf535dab6]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59ca9506-19c1-4a17-a495-28601cdadf8b (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:605fdadf-44dc-4b8b-960a-b5734967c090 (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4146b89-df53-44df-bd77-afa4b334b4ef (non-flash)\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:10:09 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-f27a0038-1fe6-4d85-af08-9b8f3fe2a932 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59ca9506-19c1-4a17-a495-28601cdadf8b (non-flash)
Nov 15 10:10:09 user nova-compute[75122]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:605fdadf-44dc-4b8b-960a-b5734967c090 (non-flash)
Nov 15 10:10:09 user nova-compute[75122]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4146b89-df53-44df-bd77-afa4b334b4ef (non-flash)
Nov 15 10:10:09 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 10:10:09 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-f27a0038-1fe6-4d85-af08-9b8f3fe2a932 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59ca9506-19c1-4a17-a495-28601cdadf8b (non-flash)
Nov 15 10:10:09 user nova-compute[75122]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:605fdadf-44dc-4b8b-960a-b5734967c090 (non-flash)
Nov 15 10:10:09 user nova-compute[75122]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4146b89-df53-44df-bd77-afa4b334b4ef (non-flash)
Nov 15 10:10:09 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 10:10:09 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-f27a0038-1fe6-4d85-af08-9b8f3fe2a932 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a4146b89-df53-44df-bd77-afa4b334b4ef" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.266s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 10:10:09 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-f27a0038-1fe6-4d85-af08-9b8f3fe2a932 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Connected to 172.16.0.220:3260 {{(pid=75122) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 10:10:09 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-f27a0038-1fe6-4d85-af08-9b8f3fe2a932 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] HCTL ('35', '-', '-', 0) found on session 59 with lun 0 {{(pid=75122) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 10:10:09 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-f27a0038-1fe6-4d85-af08-9b8f3fe2a932 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75122) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 10:10:09 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:10:09 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:10:09 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d7c8583-bd4c-4c1d-8d7c-d281326abaee]: (4, ('- - 0', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:10:09 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-f27a0038-1fe6-4d85-af08-9b8f3fe2a932 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Searching for a device in session 59 and hctl ['35', '*', '*', 0] yield: None {{(pid=75122) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 10:10:10 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-f27a0038-1fe6-4d85-af08-9b8f3fe2a932 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Searching for a device in session 59 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75122) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 10:10:10 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-f27a0038-1fe6-4d85-af08-9b8f3fe2a932 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:a4146b89-df53-44df-bd77-afa4b334b4ef', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aNOADoxg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75122) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 10:10:10 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-f27a0038-1fe6-4d85-af08-9b8f3fe2a932 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.295s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 10:10:10 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-f27a0038-1fe6-4d85-af08-9b8f3fe2a932 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] <== connect_volume: return (1296ms) {'type': 'block', 'scsi_wwn': '26138323038303363', 'path': '/dev/sdd'} {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 10:10:10 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f27a0038-1fe6-4d85-af08-9b8f3fe2a932 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] [instance: 5bb980be-c2eb-42eb-a84b-5d29592259a4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26138323038303363', 'path': '/dev/sdd'} {{(pid=75122) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 10:10:10 user nova-compute[75122]: DEBUG nova.objects.instance [None req-f27a0038-1fe6-4d85-af08-9b8f3fe2a932 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Lazy-loading 'flavor' on Instance uuid 5bb980be-c2eb-42eb-a84b-5d29592259a4 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 10:10:10 user nova-compute[75122]: DEBUG nova.virt.libvirt.guest [None req-f27a0038-1fe6-4d85-af08-9b8f3fe2a932 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 10:10:10 user nova-compute[75122]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 10:10:10 user nova-compute[75122]:   <source dev="/dev/sdd"/>
Nov 15 10:10:10 user nova-compute[75122]:   <target dev="vdc" bus="virtio"/>
Nov 15 10:10:10 user nova-compute[75122]:   <serial>a4146b89-df53-44df-bd77-afa4b334b4ef</serial>
Nov 15 10:10:10 user nova-compute[75122]: </disk>
Nov 15 10:10:10 user nova-compute[75122]:  {{(pid=75122) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 10:10:10 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-f27a0038-1fe6-4d85-af08-9b8f3fe2a932 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] No BDM found with device name vda, not building metadata. {{(pid=75122) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 10:10:10 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-f27a0038-1fe6-4d85-af08-9b8f3fe2a932 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75122) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 10:10:10 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-f27a0038-1fe6-4d85-af08-9b8f3fe2a932 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75122) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 10:10:10 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-f27a0038-1fe6-4d85-af08-9b8f3fe2a932 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] No VIF found with MAC fa:16:3e:67:41:8c, not building metadata {{(pid=75122) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 10:10:10 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-f27a0038-1fe6-4d85-af08-9b8f3fe2a932 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Lock "5bb980be-c2eb-42eb-a84b-5d29592259a4" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.628s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:10:11 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:10:12 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-f1a8cd59-5458-4d07-a757-41046ef99229 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Acquiring lock "5bb980be-c2eb-42eb-a84b-5d29592259a4" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:10:12 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-f1a8cd59-5458-4d07-a757-41046ef99229 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Lock "5bb980be-c2eb-42eb-a84b-5d29592259a4" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:10:12 user nova-compute[75122]: INFO nova.compute.manager [None req-f1a8cd59-5458-4d07-a757-41046ef99229 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] [instance: 5bb980be-c2eb-42eb-a84b-5d29592259a4] Detaching volume 605fdadf-44dc-4b8b-960a-b5734967c090
Nov 15 10:10:12 user nova-compute[75122]: INFO nova.virt.block_device [None req-f1a8cd59-5458-4d07-a757-41046ef99229 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] [instance: 5bb980be-c2eb-42eb-a84b-5d29592259a4] Attempting to driver detach volume 605fdadf-44dc-4b8b-960a-b5734967c090 from mountpoint /dev/vdb
Nov 15 10:10:12 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-f1a8cd59-5458-4d07-a757-41046ef99229 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Attempting to detach device vdb from instance 5bb980be-c2eb-42eb-a84b-5d29592259a4 from the persistent domain config. {{(pid=75122) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 10:10:12 user nova-compute[75122]: DEBUG nova.virt.libvirt.guest [None req-f1a8cd59-5458-4d07-a757-41046ef99229 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 10:10:12 user nova-compute[75122]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 10:10:12 user nova-compute[75122]:   <source dev="/dev/sdc"/>
Nov 15 10:10:12 user nova-compute[75122]:   <target dev="vdb" bus="virtio"/>
Nov 15 10:10:12 user nova-compute[75122]:   <serial>605fdadf-44dc-4b8b-960a-b5734967c090</serial>
Nov 15 10:10:12 user nova-compute[75122]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 10:10:12 user nova-compute[75122]: </disk>
Nov 15 10:10:12 user nova-compute[75122]:  {{(pid=75122) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 10:10:12 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-f1a8cd59-5458-4d07-a757-41046ef99229 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Successfully detached device vdb from instance 5bb980be-c2eb-42eb-a84b-5d29592259a4 from the persistent domain config.
Nov 15 10:10:12 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-f1a8cd59-5458-4d07-a757-41046ef99229 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5bb980be-c2eb-42eb-a84b-5d29592259a4 from the live domain config. {{(pid=75122) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 10:10:12 user nova-compute[75122]: DEBUG nova.virt.libvirt.guest [None req-f1a8cd59-5458-4d07-a757-41046ef99229 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 10:10:12 user nova-compute[75122]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 10:10:12 user nova-compute[75122]:   <source dev="/dev/sdc"/>
Nov 15 10:10:12 user nova-compute[75122]:   <target dev="vdb" bus="virtio"/>
Nov 15 10:10:12 user nova-compute[75122]:   <serial>605fdadf-44dc-4b8b-960a-b5734967c090</serial>
Nov 15 10:10:12 user nova-compute[75122]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 10:10:12 user nova-compute[75122]: </disk>
Nov 15 10:10:12 user nova-compute[75122]:  {{(pid=75122) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 10:10:12 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-f1a8cd59-5458-4d07-a757-41046ef99229 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5bb980be-c2eb-42eb-a84b-5d29592259a4 {{(pid=75122) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 10:10:13 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:10:16 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:10:18 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:10:23 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:10:26 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:10:28 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:10:32 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-f1a8cd59-5458-4d07-a757-41046ef99229 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 5bb980be-c2eb-42eb-a84b-5d29592259a4 is timed out.
Nov 15 10:10:32 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-f1a8cd59-5458-4d07-a757-41046ef99229 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Successfully detached device vdb from instance 5bb980be-c2eb-42eb-a84b-5d29592259a4 from the live domain config.
Nov 15 10:10:32 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f1a8cd59-5458-4d07-a757-41046ef99229 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] [instance: 5bb980be-c2eb-42eb-a84b-5d29592259a4] calling os-brick to detach iSCSI Volume {{(pid=75122) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 10:10:32 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1a8cd59-5458-4d07-a757-41046ef99229 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffa04060b80>, {'target_iqn': 'iqn.2010-10.org.openstack:605fdadf-44dc-4b8b-960a-b5734967c090', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oaJkUfQh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 10:10:32 user nova-compute[75122]: WARNING os_brick.initiator.connectors.base [None req-f1a8cd59-5458-4d07-a757-41046ef99229 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 10:10:32 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-f1a8cd59-5458-4d07-a757-41046ef99229 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 10:10:32 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-f1a8cd59-5458-4d07-a757-41046ef99229 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 10:10:32 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:10:32 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:10:32 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[d02d3e5f-5666-4651-a0f5-591c23cdee43]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:59ca9506-19c1-4a17-a495-28601cdadf8b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a4146b89-df53-44df-bd77-afa4b334b4ef\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:605fdadf-44dc-4b8b-960a-b5734967c090\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:10:32 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1a8cd59-5458-4d07-a757-41046ef99229 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 10:10:32 user nova-compute[75122]: No targets found.
Nov 15 10:10:32 user nova-compute[75122]: iSNS:
Nov 15 10:10:32 user nova-compute[75122]: No targets found.
Nov 15 10:10:32 user nova-compute[75122]: STATIC:
Nov 15 10:10:32 user nova-compute[75122]: Target: iqn.2010-10.org.openstack:59ca9506-19c1-4a17-a495-28601cdadf8b
Nov 15 10:10:32 user nova-compute[75122]:         Portal: 172.16.0.220:3260,-1
Nov 15 10:10:32 user nova-compute[75122]:                 Iface Name: default
Nov 15 10:10:32 user nova-compute[75122]: Target: iqn.2010-10.org.openstack:a4146b89-df53-44df-bd77-afa4b334b4ef
Nov 15 10:10:32 user nova-compute[75122]:         Portal: 172.16.0.220:3260,-1
Nov 15 10:10:32 user nova-compute[75122]:                 Iface Name: default
Nov 15 10:10:32 user nova-compute[75122]: Target: iqn.2010-10.org.openstack:605fdadf-44dc-4b8b-960a-b5734967c090
Nov 15 10:10:32 user nova-compute[75122]:         Portal: 172.16.0.220:3260,-1
Nov 15 10:10:32 user nova-compute[75122]:                 Iface Name: default
Nov 15 10:10:32 user nova-compute[75122]: FIRMWARE:
Nov 15 10:10:32 user nova-compute[75122]: No targets found.
Nov 15 10:10:32 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 10:10:32 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1a8cd59-5458-4d07-a757-41046ef99229 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 10:10:32 user nova-compute[75122]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 10:10:32 user nova-compute[75122]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75122) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 10:10:32 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1a8cd59-5458-4d07-a757-41046ef99229 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:605fdadf-44dc-4b8b-960a-b5734967c090', 0)] {{(pid=75122) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 10:10:32 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:10:32 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:10:32 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc06a26c-468d-4033-88b4-c9a85333b60d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:59ca9506-19c1-4a17-a495-28601cdadf8b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:605fdadf-44dc-4b8b-960a-b5734967c090\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a4146b89-df53-44df-bd77-afa4b334b4ef\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:10:32 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:10:32 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:10:32 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b9c8c56-7945-4c05-b19f-8c4aeb9363b5]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59ca9506-19c1-4a17-a495-28601cdadf8b (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:605fdadf-44dc-4b8b-960a-b5734967c090 (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4146b89-df53-44df-bd77-afa4b334b4ef (non-flash)\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:10:32 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1a8cd59-5458-4d07-a757-41046ef99229 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59ca9506-19c1-4a17-a495-28601cdadf8b (non-flash)
Nov 15 10:10:32 user nova-compute[75122]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:605fdadf-44dc-4b8b-960a-b5734967c090 (non-flash)
Nov 15 10:10:32 user nova-compute[75122]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4146b89-df53-44df-bd77-afa4b334b4ef (non-flash)
Nov 15 10:10:32 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 10:10:32 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1a8cd59-5458-4d07-a757-41046ef99229 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59ca9506-19c1-4a17-a495-28601cdadf8b (non-flash)
Nov 15 10:10:32 user nova-compute[75122]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:605fdadf-44dc-4b8b-960a-b5734967c090 (non-flash)
Nov 15 10:10:32 user nova-compute[75122]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4146b89-df53-44df-bd77-afa4b334b4ef (non-flash)
Nov 15 10:10:32 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 10:10:32 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1a8cd59-5458-4d07-a757-41046ef99229 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff9fc3a45e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:605fdadf-44dc-4b8b-960a-b5734967c090'): ({'sdc'}, set())}) {{(pid=75122) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 10:10:32 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-f1a8cd59-5458-4d07-a757-41046ef99229 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Removing single pathed devices sdc {{(pid=75122) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 10:10:32 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:10:32 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:10:32 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2185555-df7e-41a4-9654-8e536b825b5e]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:10:32 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:10:32 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.025s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:10:32 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[7979b793-697c-4cc7-a7e5-2f960619020a]: (4, ('ok\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:10:32 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-f1a8cd59-5458-4d07-a757-41046ef99229 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Flushing IO for device /dev/sdc {{(pid=75122) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 10:10:32 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:10:32 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:10:32 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fc98e42-dc54-4624-bf08-80ebb03a05e6]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:10:32 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-f1a8cd59-5458-4d07-a757-41046ef99229 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75122) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 10:10:32 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:10:32 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.043s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:10:32 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[f50ff1d8-4198-40d4-9d08-6bbbf022e055]: (4, ('1', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:10:32 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-f1a8cd59-5458-4d07-a757-41046ef99229 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75122) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 10:10:32 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-f1a8cd59-5458-4d07-a757-41046ef99229 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] SCSI volumes sdc have been removed. {{(pid=75122) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 10:10:32 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1a8cd59-5458-4d07-a757-41046ef99229 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:605fdadf-44dc-4b8b-960a-b5734967c090')] {{(pid=75122) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 10:10:32 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:605fdadf-44dc-4b8b-960a-b5734967c090 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:10:32 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:605fdadf-44dc-4b8b-960a-b5734967c090 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:10:32 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[c76b6335-67fe-4da4-a458-b05061e434a3]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:10:32 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1a8cd59-5458-4d07-a757-41046ef99229 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 10:10:32 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:605fdadf-44dc-4b8b-960a-b5734967c090 -p 172.16.0.220:3260 --logout {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:10:32 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:605fdadf-44dc-4b8b-960a-b5734967c090 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:10:32 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f41fee1-4ac0-4a29-9fdb-ecf77aaf7b74]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:605fdadf-44dc-4b8b-960a-b5734967c090, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:605fdadf-44dc-4b8b-960a-b5734967c090, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:10:32 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1a8cd59-5458-4d07-a757-41046ef99229 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:605fdadf-44dc-4b8b-960a-b5734967c090, portal: 172.16.0.220,3260]
Nov 15 10:10:32 user nova-compute[75122]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:605fdadf-44dc-4b8b-960a-b5734967c090, portal: 172.16.0.220,3260] successful.
Nov 15 10:10:32 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 10:10:32 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:605fdadf-44dc-4b8b-960a-b5734967c090 -p 172.16.0.220:3260 --op delete {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:10:32 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:605fdadf-44dc-4b8b-960a-b5734967c090 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:10:32 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[208b99c2-3863-41c9-bdcd-60945d2aed1f]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:10:32 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1a8cd59-5458-4d07-a757-41046ef99229 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 10:10:32 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-f1a8cd59-5458-4d07-a757-41046ef99229 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.314s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 10:10:32 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1a8cd59-5458-4d07-a757-41046ef99229 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] <== disconnect_volume: return (315ms) None {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 10:10:32 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f1a8cd59-5458-4d07-a757-41046ef99229 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] [instance: 5bb980be-c2eb-42eb-a84b-5d29592259a4] Disconnected iSCSI Volume {{(pid=75122) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 10:10:33 user nova-compute[75122]: DEBUG nova.objects.instance [None req-f1a8cd59-5458-4d07-a757-41046ef99229 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Lazy-loading 'flavor' on Instance uuid 5bb980be-c2eb-42eb-a84b-5d29592259a4 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 10:10:33 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-f1a8cd59-5458-4d07-a757-41046ef99229 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Lock "5bb980be-c2eb-42eb-a84b-5d29592259a4" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.671s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:10:33 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:10:34 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-c0992d26-fb1b-45a6-a445-8f116ed17d2e tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Acquiring lock "5bb980be-c2eb-42eb-a84b-5d29592259a4" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:10:34 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-c0992d26-fb1b-45a6-a445-8f116ed17d2e tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Lock "5bb980be-c2eb-42eb-a84b-5d29592259a4" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:10:34 user nova-compute[75122]: INFO nova.compute.manager [None req-c0992d26-fb1b-45a6-a445-8f116ed17d2e tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] [instance: 5bb980be-c2eb-42eb-a84b-5d29592259a4] Detaching volume a4146b89-df53-44df-bd77-afa4b334b4ef
Nov 15 10:10:34 user nova-compute[75122]: INFO nova.virt.block_device [None req-c0992d26-fb1b-45a6-a445-8f116ed17d2e tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] [instance: 5bb980be-c2eb-42eb-a84b-5d29592259a4] Attempting to driver detach volume a4146b89-df53-44df-bd77-afa4b334b4ef from mountpoint /dev/vdc
Nov 15 10:10:34 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-c0992d26-fb1b-45a6-a445-8f116ed17d2e tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Attempting to detach device vdc from instance 5bb980be-c2eb-42eb-a84b-5d29592259a4 from the persistent domain config. {{(pid=75122) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 10:10:34 user nova-compute[75122]: DEBUG nova.virt.libvirt.guest [None req-c0992d26-fb1b-45a6-a445-8f116ed17d2e tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 10:10:34 user nova-compute[75122]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 10:10:34 user nova-compute[75122]:   <source dev="/dev/sdd"/>
Nov 15 10:10:34 user nova-compute[75122]:   <target dev="vdc" bus="virtio"/>
Nov 15 10:10:34 user nova-compute[75122]:   <serial>a4146b89-df53-44df-bd77-afa4b334b4ef</serial>
Nov 15 10:10:34 user nova-compute[75122]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 15 10:10:34 user nova-compute[75122]: </disk>
Nov 15 10:10:34 user nova-compute[75122]:  {{(pid=75122) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 10:10:34 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-c0992d26-fb1b-45a6-a445-8f116ed17d2e tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Successfully detached device vdc from instance 5bb980be-c2eb-42eb-a84b-5d29592259a4 from the persistent domain config.
Nov 15 10:10:34 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-c0992d26-fb1b-45a6-a445-8f116ed17d2e tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 5bb980be-c2eb-42eb-a84b-5d29592259a4 from the live domain config. {{(pid=75122) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 10:10:34 user nova-compute[75122]: DEBUG nova.virt.libvirt.guest [None req-c0992d26-fb1b-45a6-a445-8f116ed17d2e tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 10:10:34 user nova-compute[75122]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 10:10:34 user nova-compute[75122]:   <source dev="/dev/sdd"/>
Nov 15 10:10:34 user nova-compute[75122]:   <target dev="vdc" bus="virtio"/>
Nov 15 10:10:34 user nova-compute[75122]:   <serial>a4146b89-df53-44df-bd77-afa4b334b4ef</serial>
Nov 15 10:10:34 user nova-compute[75122]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 15 10:10:34 user nova-compute[75122]: </disk>
Nov 15 10:10:34 user nova-compute[75122]:  {{(pid=75122) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 10:10:35 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-c0992d26-fb1b-45a6-a445-8f116ed17d2e tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 5bb980be-c2eb-42eb-a84b-5d29592259a4 {{(pid=75122) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 10:10:35 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:10:36 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:10:38 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:10:40 user nova-compute[75122]: DEBUG nova.compute.manager [req-7a77e871-cd46-4533-8adf-3ba31bb93148 req-846ba493-d6be-45db-81ca-9d78adfba079 service nova] [instance: 968c4c12-9c56-4bb5-9b98-d526c67cd7d7] Received event network-changed-6a965453-1ab7-4987-bcfc-307d082e1e90 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 10:10:40 user nova-compute[75122]: DEBUG nova.compute.manager [req-7a77e871-cd46-4533-8adf-3ba31bb93148 req-846ba493-d6be-45db-81ca-9d78adfba079 service nova] [instance: 968c4c12-9c56-4bb5-9b98-d526c67cd7d7] Refreshing instance network info cache due to event network-changed-6a965453-1ab7-4987-bcfc-307d082e1e90. {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 10:10:40 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-7a77e871-cd46-4533-8adf-3ba31bb93148 req-846ba493-d6be-45db-81ca-9d78adfba079 service nova] Acquiring lock "refresh_cache-968c4c12-9c56-4bb5-9b98-d526c67cd7d7" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 10:10:40 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-7a77e871-cd46-4533-8adf-3ba31bb93148 req-846ba493-d6be-45db-81ca-9d78adfba079 service nova] Acquired lock "refresh_cache-968c4c12-9c56-4bb5-9b98-d526c67cd7d7" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 10:10:40 user nova-compute[75122]: DEBUG nova.network.neutron [req-7a77e871-cd46-4533-8adf-3ba31bb93148 req-846ba493-d6be-45db-81ca-9d78adfba079 service nova] [instance: 968c4c12-9c56-4bb5-9b98-d526c67cd7d7] Refreshing network info cache for port 6a965453-1ab7-4987-bcfc-307d082e1e90 {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 10:10:40 user nova-compute[75122]: DEBUG nova.network.neutron [req-7a77e871-cd46-4533-8adf-3ba31bb93148 req-846ba493-d6be-45db-81ca-9d78adfba079 service nova] [instance: 968c4c12-9c56-4bb5-9b98-d526c67cd7d7] Updated VIF entry in instance network info cache for port 6a965453-1ab7-4987-bcfc-307d082e1e90. {{(pid=75122) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 10:10:40 user nova-compute[75122]: DEBUG nova.network.neutron [req-7a77e871-cd46-4533-8adf-3ba31bb93148 req-846ba493-d6be-45db-81ca-9d78adfba079 service nova] [instance: 968c4c12-9c56-4bb5-9b98-d526c67cd7d7] Updating instance_info_cache with network_info: [{"id": "6a965453-1ab7-4987-bcfc-307d082e1e90", "address": "fa:16:3e:7a:69:23", "network": {"id": "03073971-5253-4f06-a46a-94840841fd6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2056706757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7941f36c30b49408ae5709a1b75346d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a965453-1a", "ovs_interfaceid": "6a965453-1ab7-4987-bcfc-307d082e1e90", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 10:10:40 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-7a77e871-cd46-4533-8adf-3ba31bb93148 req-846ba493-d6be-45db-81ca-9d78adfba079 service nova] Releasing lock "refresh_cache-968c4c12-9c56-4bb5-9b98-d526c67cd7d7" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 10:10:41 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:10:43 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:10:43 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:10:45 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:10:45 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:10:45 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:10:45 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:10:45 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.002s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:10:45 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75122) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 10:10:45 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75122) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 10:10:45 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bb980be-c2eb-42eb-a84b-5d29592259a4/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:10:45 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bb980be-c2eb-42eb-a84b-5d29592259a4/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:10:45 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bb980be-c2eb-42eb-a84b-5d29592259a4/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:10:45 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bb980be-c2eb-42eb-a84b-5d29592259a4/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:10:46 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-1e13ba19-e7de-481b-9c9d-270b79881562 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Acquiring lock "a534665a-90e4-47dc-b081-47a44a975b64" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:10:46 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-1e13ba19-e7de-481b-9c9d-270b79881562 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Lock "a534665a-90e4-47dc-b081-47a44a975b64" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:10:46 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 10:10:46 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 10:10:46 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Hypervisor/Node resource view: name=user free_ram=8834MB free_disk=25.142860412597656GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75122) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 10:10:46 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:10:46 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:10:46 user nova-compute[75122]: DEBUG nova.compute.manager [None req-1e13ba19-e7de-481b-9c9d-270b79881562 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: a534665a-90e4-47dc-b081-47a44a975b64] Starting instance... {{(pid=75122) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 10:10:46 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance 5bb980be-c2eb-42eb-a84b-5d29592259a4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 10:10:46 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance 968c4c12-9c56-4bb5-9b98-d526c67cd7d7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 10:10:46 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance a534665a-90e4-47dc-b081-47a44a975b64 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 15 10:10:46 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75122) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 10:10:46 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75122) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 10:10:46 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-1e13ba19-e7de-481b-9c9d-270b79881562 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:10:46 user nova-compute[75122]: DEBUG nova.compute.provider_tree [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Inventory has not changed in ProviderTree for provider: 69a3da65-47be-44c6-b67c-c692b58284ef {{(pid=75122) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 10:10:46 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Inventory has not changed for provider 69a3da65-47be-44c6-b67c-c692b58284ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 10:10:46 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Compute_service record updated for user:user {{(pid=75122) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 10:10:46 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.275s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:10:46 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-1e13ba19-e7de-481b-9c9d-270b79881562 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.109s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:10:46 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-1e13ba19-e7de-481b-9c9d-270b79881562 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75122) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 10:10:46 user nova-compute[75122]: INFO nova.compute.claims [None req-1e13ba19-e7de-481b-9c9d-270b79881562 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: a534665a-90e4-47dc-b081-47a44a975b64] Claim successful on node user
Nov 15 10:10:46 user nova-compute[75122]: DEBUG nova.compute.provider_tree [None req-1e13ba19-e7de-481b-9c9d-270b79881562 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Inventory has not changed in ProviderTree for provider: 69a3da65-47be-44c6-b67c-c692b58284ef {{(pid=75122) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 10:10:46 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-1e13ba19-e7de-481b-9c9d-270b79881562 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Inventory has not changed for provider 69a3da65-47be-44c6-b67c-c692b58284ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 10:10:46 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-1e13ba19-e7de-481b-9c9d-270b79881562 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.245s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:10:46 user nova-compute[75122]: DEBUG nova.compute.manager [None req-1e13ba19-e7de-481b-9c9d-270b79881562 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: a534665a-90e4-47dc-b081-47a44a975b64] Start building networks asynchronously for instance. {{(pid=75122) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 10:10:46 user nova-compute[75122]: DEBUG nova.compute.manager [None req-1e13ba19-e7de-481b-9c9d-270b79881562 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: a534665a-90e4-47dc-b081-47a44a975b64] Allocating IP information in the background. {{(pid=75122) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 10:10:46 user nova-compute[75122]: DEBUG nova.network.neutron [None req-1e13ba19-e7de-481b-9c9d-270b79881562 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: a534665a-90e4-47dc-b081-47a44a975b64] allocate_for_instance() {{(pid=75122) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 10:10:46 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-1e13ba19-e7de-481b-9c9d-270b79881562 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: a534665a-90e4-47dc-b081-47a44a975b64] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 10:10:46 user nova-compute[75122]: DEBUG nova.compute.manager [None req-1e13ba19-e7de-481b-9c9d-270b79881562 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: a534665a-90e4-47dc-b081-47a44a975b64] Start building block device mappings for instance. {{(pid=75122) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 10:10:46 user nova-compute[75122]: DEBUG nova.policy [None req-1e13ba19-e7de-481b-9c9d-270b79881562 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '00f5cc88e43c434c8a061dcec472a16b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7941f36c30b49408ae5709a1b75346d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75122) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 10:10:46 user nova-compute[75122]: INFO nova.virt.block_device [None req-1e13ba19-e7de-481b-9c9d-270b79881562 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: a534665a-90e4-47dc-b081-47a44a975b64] Booting with volume 9be886d5-d605-4139-bf9a-a8bce1cd6ddc at /dev/vda
Nov 15 10:10:46 user nova-compute[75122]: DEBUG os_brick.utils [None req-1e13ba19-e7de-481b-9c9d-270b79881562 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 10:10:46 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:10:46 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:10:46 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:10:46 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f2ff749-33ec-4b06-999e-ebf9ce0f6a92]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:742fb64b3587\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:10:46 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:10:46 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:10:46 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[68f89abb-a535-4ae6-97dc-b8dd86a65036]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:10:46 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:10:46 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:10:46 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b363fdb-bbf7-4340-a783-822ced1aae00]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:10:46 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[7711415f-b597-48a8-859a-fc6ee2bbe18c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:10:46 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-1e13ba19-e7de-481b-9c9d-270b79881562 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Running cmd (subprocess): nvme version {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:10:46 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-1e13ba19-e7de-481b-9c9d-270b79881562 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] 'nvme version' failed. Not Retrying. {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 10:10:46 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1e13ba19-e7de-481b-9c9d-270b79881562 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] nvme not present on system {{(pid=75122) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 10:10:47 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:10:47 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 10:10:47 user nova-compute[75122]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 10:10:47 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3871fa8-fc68-4a98-b73d-98315effb13a]: (4, '') {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:10:47 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.lightos [None req-1e13ba19-e7de-481b-9c9d-270b79881562 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75122) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 10:10:47 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.lightos [None req-1e13ba19-e7de-481b-9c9d-270b79881562 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75122) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 10:10:47 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.lightos [None req-1e13ba19-e7de-481b-9c9d-270b79881562 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] LIGHTOS: no hostnqn found. {{(pid=75122) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 10:10:47 user nova-compute[75122]: DEBUG os_brick.utils [None req-1e13ba19-e7de-481b-9c9d-270b79881562 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:742fb64b3587', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 10:10:47 user nova-compute[75122]: DEBUG nova.virt.block_device [None req-1e13ba19-e7de-481b-9c9d-270b79881562 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: a534665a-90e4-47dc-b081-47a44a975b64] Updating existing volume attachment record: 2c01248c-a525-4c5f-90f1-be08039382e9 {{(pid=75122) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 10:10:47 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:10:47 user nova-compute[75122]: DEBUG nova.network.neutron [None req-1e13ba19-e7de-481b-9c9d-270b79881562 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: a534665a-90e4-47dc-b081-47a44a975b64] Successfully created port: ba4e0f89-75c3-4eeb-8b28-4ea10bb61909 {{(pid=75122) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 10:10:48 user nova-compute[75122]: DEBUG nova.network.neutron [None req-1e13ba19-e7de-481b-9c9d-270b79881562 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: a534665a-90e4-47dc-b081-47a44a975b64] Successfully updated port: ba4e0f89-75c3-4eeb-8b28-4ea10bb61909 {{(pid=75122) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 10:10:48 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-1e13ba19-e7de-481b-9c9d-270b79881562 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Acquiring lock "refresh_cache-a534665a-90e4-47dc-b081-47a44a975b64" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 10:10:48 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-1e13ba19-e7de-481b-9c9d-270b79881562 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Acquired lock "refresh_cache-a534665a-90e4-47dc-b081-47a44a975b64" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 10:10:48 user nova-compute[75122]: DEBUG nova.network.neutron [None req-1e13ba19-e7de-481b-9c9d-270b79881562 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: a534665a-90e4-47dc-b081-47a44a975b64] Building network info cache for instance {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 10:10:48 user nova-compute[75122]: DEBUG nova.compute.manager [req-d2b2fabc-c1b0-4053-bbeb-392c928f32a1 req-afa5aac8-4715-4ab2-b803-b421b2106190 service nova] [instance: a534665a-90e4-47dc-b081-47a44a975b64] Received event network-changed-ba4e0f89-75c3-4eeb-8b28-4ea10bb61909 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 10:10:48 user nova-compute[75122]: DEBUG nova.compute.manager [req-d2b2fabc-c1b0-4053-bbeb-392c928f32a1 req-afa5aac8-4715-4ab2-b803-b421b2106190 service nova] [instance: a534665a-90e4-47dc-b081-47a44a975b64] Refreshing instance network info cache due to event network-changed-ba4e0f89-75c3-4eeb-8b28-4ea10bb61909. {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 10:10:48 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-d2b2fabc-c1b0-4053-bbeb-392c928f32a1 req-afa5aac8-4715-4ab2-b803-b421b2106190 service nova] Acquiring lock "refresh_cache-a534665a-90e4-47dc-b081-47a44a975b64" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 10:10:48 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:10:48 user nova-compute[75122]: DEBUG nova.network.neutron [None req-1e13ba19-e7de-481b-9c9d-270b79881562 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: a534665a-90e4-47dc-b081-47a44a975b64] Instance cache missing network info. {{(pid=75122) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 10:10:49 user nova-compute[75122]: DEBUG nova.network.neutron [None req-1e13ba19-e7de-481b-9c9d-270b79881562 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: a534665a-90e4-47dc-b081-47a44a975b64] Updating instance_info_cache with network_info: [{"id": "ba4e0f89-75c3-4eeb-8b28-4ea10bb61909", "address": "fa:16:3e:af:8a:69", "network": {"id": "03073971-5253-4f06-a46a-94840841fd6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2056706757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7941f36c30b49408ae5709a1b75346d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba4e0f89-75", "ovs_interfaceid": "ba4e0f89-75c3-4eeb-8b28-4ea10bb61909", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 10:10:49 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-1e13ba19-e7de-481b-9c9d-270b79881562 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Releasing lock "refresh_cache-a534665a-90e4-47dc-b081-47a44a975b64" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 10:10:49 user nova-compute[75122]: DEBUG nova.compute.manager [None req-1e13ba19-e7de-481b-9c9d-270b79881562 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: a534665a-90e4-47dc-b081-47a44a975b64] Instance network_info: |[{"id": "ba4e0f89-75c3-4eeb-8b28-4ea10bb61909", "address": "fa:16:3e:af:8a:69", "network": {"id": "03073971-5253-4f06-a46a-94840841fd6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2056706757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7941f36c30b49408ae5709a1b75346d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba4e0f89-75", "ovs_interfaceid": "ba4e0f89-75c3-4eeb-8b28-4ea10bb61909", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75122) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 10:10:49 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-d2b2fabc-c1b0-4053-bbeb-392c928f32a1 req-afa5aac8-4715-4ab2-b803-b421b2106190 service nova] Acquired lock "refresh_cache-a534665a-90e4-47dc-b081-47a44a975b64" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 10:10:49 user nova-compute[75122]: DEBUG nova.network.neutron [req-d2b2fabc-c1b0-4053-bbeb-392c928f32a1 req-afa5aac8-4715-4ab2-b803-b421b2106190 service nova] [instance: a534665a-90e4-47dc-b081-47a44a975b64] Refreshing network info cache for port ba4e0f89-75c3-4eeb-8b28-4ea10bb61909 {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 10:10:49 user nova-compute[75122]: DEBUG nova.network.neutron [req-d2b2fabc-c1b0-4053-bbeb-392c928f32a1 req-afa5aac8-4715-4ab2-b803-b421b2106190 service nova] [instance: a534665a-90e4-47dc-b081-47a44a975b64] Updated VIF entry in instance network info cache for port ba4e0f89-75c3-4eeb-8b28-4ea10bb61909. {{(pid=75122) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 10:10:49 user nova-compute[75122]: DEBUG nova.network.neutron [req-d2b2fabc-c1b0-4053-bbeb-392c928f32a1 req-afa5aac8-4715-4ab2-b803-b421b2106190 service nova] [instance: a534665a-90e4-47dc-b081-47a44a975b64] Updating instance_info_cache with network_info: [{"id": "ba4e0f89-75c3-4eeb-8b28-4ea10bb61909", "address": "fa:16:3e:af:8a:69", "network": {"id": "03073971-5253-4f06-a46a-94840841fd6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2056706757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7941f36c30b49408ae5709a1b75346d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba4e0f89-75", "ovs_interfaceid": "ba4e0f89-75c3-4eeb-8b28-4ea10bb61909", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 10:10:49 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-d2b2fabc-c1b0-4053-bbeb-392c928f32a1 req-afa5aac8-4715-4ab2-b803-b421b2106190 service nova] Releasing lock "refresh_cache-a534665a-90e4-47dc-b081-47a44a975b64" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 10:10:51 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:10:51 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Starting heal instance info cache {{(pid=75122) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 10:10:51 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "refresh_cache-968c4c12-9c56-4bb5-9b98-d526c67cd7d7" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 10:10:51 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquired lock "refresh_cache-968c4c12-9c56-4bb5-9b98-d526c67cd7d7" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 10:10:51 user nova-compute[75122]: DEBUG nova.network.neutron [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] [instance: 968c4c12-9c56-4bb5-9b98-d526c67cd7d7] Forcefully refreshing network info cache for instance {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 10:10:51 user nova-compute[75122]: DEBUG nova.network.neutron [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] [instance: 968c4c12-9c56-4bb5-9b98-d526c67cd7d7] Updating instance_info_cache with network_info: [{"id": "6a965453-1ab7-4987-bcfc-307d082e1e90", "address": "fa:16:3e:7a:69:23", "network": {"id": "03073971-5253-4f06-a46a-94840841fd6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2056706757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7941f36c30b49408ae5709a1b75346d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a965453-1a", "ovs_interfaceid": "6a965453-1ab7-4987-bcfc-307d082e1e90", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 10:10:51 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Releasing lock "refresh_cache-968c4c12-9c56-4bb5-9b98-d526c67cd7d7" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 10:10:51 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] [instance: 968c4c12-9c56-4bb5-9b98-d526c67cd7d7] Updated the network info_cache for instance {{(pid=75122) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 10:10:51 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:10:51 user nova-compute[75122]: DEBUG nova.compute.manager [None req-1e13ba19-e7de-481b-9c9d-270b79881562 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: a534665a-90e4-47dc-b081-47a44a975b64] Start spawning the instance on the hypervisor. {{(pid=75122) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 10:10:51 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-1e13ba19-e7de-481b-9c9d-270b79881562 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: a534665a-90e4-47dc-b081-47a44a975b64] Creating instance directory {{(pid=75122) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 10:10:51 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-1e13ba19-e7de-481b-9c9d-270b79881562 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: a534665a-90e4-47dc-b081-47a44a975b64] Creating image(s)
Nov 15 10:10:51 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-1e13ba19-e7de-481b-9c9d-270b79881562 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: a534665a-90e4-47dc-b081-47a44a975b64] Did not create local disks {{(pid=75122) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 10:10:51 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-1e13ba19-e7de-481b-9c9d-270b79881562 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: a534665a-90e4-47dc-b081-47a44a975b64] Ensure instance console log exists: /opt/stack/data/nova/instances/a534665a-90e4-47dc-b081-47a44a975b64/console.log {{(pid=75122) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 10:10:51 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-1e13ba19-e7de-481b-9c9d-270b79881562 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:10:51 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-1e13ba19-e7de-481b-9c9d-270b79881562 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:10:51 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-1e13ba19-e7de-481b-9c9d-270b79881562 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:10:51 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-1e13ba19-e7de-481b-9c9d-270b79881562 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: a534665a-90e4-47dc-b081-47a44a975b64] Start _get_guest_xml network_info=[{"id": "ba4e0f89-75c3-4eeb-8b28-4ea10bb61909", "address": "fa:16:3e:af:8a:69", "network": {"id": "03073971-5253-4f06-a46a-94840841fd6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2056706757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7941f36c30b49408ae5709a1b75346d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba4e0f89-75", "ovs_interfaceid": "ba4e0f89-75c3-4eeb-8b28-4ea10bb61909", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9be886d5-d605-4139-bf9a-a8bce1cd6ddc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HgoqPCtp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a534665a-90e4-47dc-b081-47a44a975b64', 'attached_at': '', 'detached_at': '', 'volume_id': '9be886d5-d605-4139-bf9a-a8bce1cd6ddc', 'serial': '9be886d5-d605-4139-bf9a-a8bce1cd6ddc'}, 'guest_format': None, 'delete_on_termination': False, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vda', 'attachment_id': '2c01248c-a525-4c5f-90f1-be08039382e9', 'volume_type': None} {{(pid=75122) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 10:10:51 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-1e13ba19-e7de-481b-9c9d-270b79881562 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 10:10:51 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-1e13ba19-e7de-481b-9c9d-270b79881562 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 10:10:51 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-1e13ba19-e7de-481b-9c9d-270b79881562 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75122) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 10:10:51 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-1e13ba19-e7de-481b-9c9d-270b79881562 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] CPU controller missing on host. {{(pid=75122) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 10:10:51 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-1e13ba19-e7de-481b-9c9d-270b79881562 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75122) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 10:10:51 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-1e13ba19-e7de-481b-9c9d-270b79881562 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] CPU controller found on host. {{(pid=75122) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 10:10:51 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-1e13ba19-e7de-481b-9c9d-270b79881562 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75122) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 10:10:51 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-1e13ba19-e7de-481b-9c9d-270b79881562 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T09:26:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 10:10:51 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-1e13ba19-e7de-481b-9c9d-270b79881562 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Flavor limits 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 10:10:51 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-1e13ba19-e7de-481b-9c9d-270b79881562 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Image limits 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 10:10:51 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-1e13ba19-e7de-481b-9c9d-270b79881562 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Flavor pref 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 10:10:51 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-1e13ba19-e7de-481b-9c9d-270b79881562 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Image pref 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 10:10:51 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-1e13ba19-e7de-481b-9c9d-270b79881562 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 10:10:51 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-1e13ba19-e7de-481b-9c9d-270b79881562 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 10:10:51 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-1e13ba19-e7de-481b-9c9d-270b79881562 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75122) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 10:10:51 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-1e13ba19-e7de-481b-9c9d-270b79881562 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Got 1 possible topologies {{(pid=75122) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 10:10:51 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-1e13ba19-e7de-481b-9c9d-270b79881562 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 10:10:51 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-1e13ba19-e7de-481b-9c9d-270b79881562 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 10:10:51 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1e13ba19-e7de-481b-9c9d-270b79881562 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: a534665a-90e4-47dc-b081-47a44a975b64] Calling os-brick to attach iSCSI Volume {{(pid=75122) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 10:10:51 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e13ba19-e7de-481b-9c9d-270b79881562 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffa04060b80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9be886d5-d605-4139-bf9a-a8bce1cd6ddc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HgoqPCtp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 10:10:51 user nova-compute[75122]: WARNING os_brick.initiator.connectors.base [None req-1e13ba19-e7de-481b-9c9d-270b79881562 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 10:10:51 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-1e13ba19-e7de-481b-9c9d-270b79881562 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 10:10:51 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-1e13ba19-e7de-481b-9c9d-270b79881562 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 10:10:51 user nova-compute[75122]: WARNING os_brick.initiator.connectors.base [None req-1e13ba19-e7de-481b-9c9d-270b79881562 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 10:10:51 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-1e13ba19-e7de-481b-9c9d-270b79881562 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9be886d5-d605-4139-bf9a-a8bce1cd6ddc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 10:10:51 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-1e13ba19-e7de-481b-9c9d-270b79881562 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9be886d5-d605-4139-bf9a-a8bce1cd6ddc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 10:10:51 user nova-compute[75122]: INFO os_brick.initiator.connectors.iscsi [None req-1e13ba19-e7de-481b-9c9d-270b79881562 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 10:10:51 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:10:51 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9be886d5-d605-4139-bf9a-a8bce1cd6ddc -p 172.16.0.220:3260 {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:10:51 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9be886d5-d605-4139-bf9a-a8bce1cd6ddc -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:10:51 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[62d8a4fa-ab9e-466b-bb65-87e29e830e96]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:10:51 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e13ba19-e7de-481b-9c9d-270b79881562 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 10:10:51 user nova-compute[75122]:  {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 10:10:51 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9be886d5-d605-4139-bf9a-a8bce1cd6ddc -p 172.16.0.220:3260 --interface default --op new {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:10:51 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9be886d5-d605-4139-bf9a-a8bce1cd6ddc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:10:51 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[5822a7f3-479f-4fd5-b786-4670c4712c5e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9be886d5-d605-4139-bf9a-a8bce1cd6ddc] added\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:10:51 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e13ba19-e7de-481b-9c9d-270b79881562 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9be886d5-d605-4139-bf9a-a8bce1cd6ddc] added
Nov 15 10:10:51 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 10:10:51 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9be886d5-d605-4139-bf9a-a8bce1cd6ddc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:10:51 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9be886d5-d605-4139-bf9a-a8bce1cd6ddc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:10:51 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[b26d00aa-2e2b-4f67-a1a7-30ecefdda7da]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:10:51 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e13ba19-e7de-481b-9c9d-270b79881562 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 10:10:51 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9be886d5-d605-4139-bf9a-a8bce1cd6ddc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:10:52 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9be886d5-d605-4139-bf9a-a8bce1cd6ddc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:10:52 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[352cec6a-b618-4324-b3ef-d89b43d0a771]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:10:52 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e13ba19-e7de-481b-9c9d-270b79881562 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 10:10:52 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9be886d5-d605-4139-bf9a-a8bce1cd6ddc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HgoqPCtp {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:10:52 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9be886d5-d605-4139-bf9a-a8bce1cd6ddc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HgoqPCtp" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:10:52 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[a263e83d-6827-4fe9-ab56-9afcfecfc5f1]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:10:52 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e13ba19-e7de-481b-9c9d-270b79881562 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HgoqPCtp'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 10:10:52 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9be886d5-d605-4139-bf9a-a8bce1cd6ddc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:10:52 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9be886d5-d605-4139-bf9a-a8bce1cd6ddc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:10:52 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe319574-c092-41f4-9a3b-ebf3b3517d44]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:10:52 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e13ba19-e7de-481b-9c9d-270b79881562 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 10:10:52 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:10:52 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:10:52 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f322242-911a-440d-ad2b-d04e5837a095]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59ca9506-19c1-4a17-a495-28601cdadf8b (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4146b89-df53-44df-bd77-afa4b334b4ef (non-flash)\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:10:52 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e13ba19-e7de-481b-9c9d-270b79881562 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59ca9506-19c1-4a17-a495-28601cdadf8b (non-flash)
Nov 15 10:10:52 user nova-compute[75122]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4146b89-df53-44df-bd77-afa4b334b4ef (non-flash)
Nov 15 10:10:52 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 10:10:52 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e13ba19-e7de-481b-9c9d-270b79881562 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59ca9506-19c1-4a17-a495-28601cdadf8b (non-flash)
Nov 15 10:10:52 user nova-compute[75122]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4146b89-df53-44df-bd77-afa4b334b4ef (non-flash)
Nov 15 10:10:52 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 10:10:52 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9be886d5-d605-4139-bf9a-a8bce1cd6ddc -p 172.16.0.220:3260 --login {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:10:52 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9be886d5-d605-4139-bf9a-a8bce1cd6ddc -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:10:52 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[46caa8e2-5009-4f64-85ca-9ca27772d5fc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9be886d5-d605-4139-bf9a-a8bce1cd6ddc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9be886d5-d605-4139-bf9a-a8bce1cd6ddc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:10:52 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e13ba19-e7de-481b-9c9d-270b79881562 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9be886d5-d605-4139-bf9a-a8bce1cd6ddc, portal: 172.16.0.220,3260]
Nov 15 10:10:52 user nova-compute[75122]: Login to [iface: default, target: iqn.2010-10.org.openstack:9be886d5-d605-4139-bf9a-a8bce1cd6ddc, portal: 172.16.0.220,3260] successful.
Nov 15 10:10:52 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 10:10:52 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9be886d5-d605-4139-bf9a-a8bce1cd6ddc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:10:52 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9be886d5-d605-4139-bf9a-a8bce1cd6ddc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:10:52 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aaf7257-bdd8-4eb2-bca7-20ad3d045c86]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:10:52 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e13ba19-e7de-481b-9c9d-270b79881562 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 10:10:52 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:10:52 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:10:52 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:10:52 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[7914c165-56b1-4a77-9a6a-c4bab2d2ea94]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59ca9506-19c1-4a17-a495-28601cdadf8b (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4146b89-df53-44df-bd77-afa4b334b4ef (non-flash)\ntcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9be886d5-d605-4139-bf9a-a8bce1cd6ddc (non-flash)\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:10:52 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e13ba19-e7de-481b-9c9d-270b79881562 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59ca9506-19c1-4a17-a495-28601cdadf8b (non-flash)
Nov 15 10:10:52 user nova-compute[75122]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4146b89-df53-44df-bd77-afa4b334b4ef (non-flash)
Nov 15 10:10:52 user nova-compute[75122]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9be886d5-d605-4139-bf9a-a8bce1cd6ddc (non-flash)
Nov 15 10:10:52 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 10:10:52 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e13ba19-e7de-481b-9c9d-270b79881562 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59ca9506-19c1-4a17-a495-28601cdadf8b (non-flash)
Nov 15 10:10:52 user nova-compute[75122]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4146b89-df53-44df-bd77-afa4b334b4ef (non-flash)
Nov 15 10:10:52 user nova-compute[75122]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9be886d5-d605-4139-bf9a-a8bce1cd6ddc (non-flash)
Nov 15 10:10:52 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 10:10:52 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-1e13ba19-e7de-481b-9c9d-270b79881562 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9be886d5-d605-4139-bf9a-a8bce1cd6ddc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.261s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 10:10:52 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e13ba19-e7de-481b-9c9d-270b79881562 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Connected to 172.16.0.220:3260 {{(pid=75122) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 10:10:52 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-1e13ba19-e7de-481b-9c9d-270b79881562 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] HCTL ('34', '-', '-', 0) found on session 60 with lun 0 {{(pid=75122) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 10:10:52 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-1e13ba19-e7de-481b-9c9d-270b79881562 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75122) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 10:10:52 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:10:52 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:10:52 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5869152-4d49-4319-8441-8c6f9f700607]: (4, ('- - 0', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:10:52 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-1e13ba19-e7de-481b-9c9d-270b79881562 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Searching for a device in session 60 and hctl ['34', '*', '*', 0] yield: None {{(pid=75122) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 10:10:53 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:10:53 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-1e13ba19-e7de-481b-9c9d-270b79881562 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Searching for a device in session 60 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75122) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 10:10:53 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e13ba19-e7de-481b-9c9d-270b79881562 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:9be886d5-d605-4139-bf9a-a8bce1cd6ddc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HgoqPCtp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75122) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 10:10:53 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-1e13ba19-e7de-481b-9c9d-270b79881562 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.292s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 10:10:53 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e13ba19-e7de-481b-9c9d-270b79881562 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] <== connect_volume: return (1294ms) {'type': 'block', 'scsi_wwn': '26365393430353131', 'path': '/dev/sdc'} {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 10:10:53 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1e13ba19-e7de-481b-9c9d-270b79881562 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: a534665a-90e4-47dc-b081-47a44a975b64] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26365393430353131', 'path': '/dev/sdc'} {{(pid=75122) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 10:10:53 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-1e13ba19-e7de-481b-9c9d-270b79881562 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T10:10:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1841816478',display_name='tempest-TestVolumeBootPattern-server-1841816478',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1841816478',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKHlpBGjgQO8WCWtscnQGPLWQNzcwgXW54O9CXzl/Z/CZ497o/Fb/9rP8/a86D2H+G6HyOK+OZYAd3QjjsdbXOlrlce1txRdWXFLkzlkbTs2rp1mYOku0vjKWQDJeaVaVQ==',key_name='tempest-TestVolumeBootPattern-2035754115',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c7941f36c30b49408ae5709a1b75346d',ramdisk_id='',reservation_id='r-zzuznqcz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-296749341',owner_user_name='tempest-TestVolumeBootPattern-296749341-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T10:10:47Z,user_data=None,user_id='00f5cc88e43c434c8a061dcec472a16b',uuid=a534665a-90e4-47dc-b081-47a44a975b64,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ba4e0f89-75c3-4eeb-8b28-4ea10bb61909", "address": "fa:16:3e:af:8a:69", "network": {"id": "03073971-5253-4f06-a46a-94840841fd6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2056706757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7941f36c30b49408ae5709a1b75346d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba4e0f89-75", "ovs_interfaceid": "ba4e0f89-75c3-4eeb-8b28-4ea10bb61909", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75122) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 10:10:53 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-1e13ba19-e7de-481b-9c9d-270b79881562 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Converting VIF {"id": "ba4e0f89-75c3-4eeb-8b28-4ea10bb61909", "address": "fa:16:3e:af:8a:69", "network": {"id": "03073971-5253-4f06-a46a-94840841fd6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2056706757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7941f36c30b49408ae5709a1b75346d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba4e0f89-75", "ovs_interfaceid": "ba4e0f89-75c3-4eeb-8b28-4ea10bb61909", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 10:10:53 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-1e13ba19-e7de-481b-9c9d-270b79881562 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:af:8a:69,bridge_name='br-int',has_traffic_filtering=True,id=ba4e0f89-75c3-4eeb-8b28-4ea10bb61909,network=Network(03073971-5253-4f06-a46a-94840841fd6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba4e0f89-75') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 10:10:53 user nova-compute[75122]: DEBUG nova.objects.instance [None req-1e13ba19-e7de-481b-9c9d-270b79881562 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Lazy-loading 'pci_devices' on Instance uuid a534665a-90e4-47dc-b081-47a44a975b64 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 10:10:53 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-1e13ba19-e7de-481b-9c9d-270b79881562 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: a534665a-90e4-47dc-b081-47a44a975b64] End _get_guest_xml xml=<domain type="kvm">
Nov 15 10:10:53 user nova-compute[75122]:   <uuid>a534665a-90e4-47dc-b081-47a44a975b64</uuid>
Nov 15 10:10:53 user nova-compute[75122]:   <name>instance-00000032</name>
Nov 15 10:10:53 user nova-compute[75122]:   <memory>524288</memory>
Nov 15 10:10:53 user nova-compute[75122]:   <vcpu>1</vcpu>
Nov 15 10:10:53 user nova-compute[75122]:   <metadata>
Nov 15 10:10:53 user nova-compute[75122]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 10:10:53 user nova-compute[75122]:       <nova:package version="0.0.0"/>
Nov 15 10:10:53 user nova-compute[75122]:       <nova:name>tempest-TestVolumeBootPattern-server-1841816478</nova:name>
Nov 15 10:10:53 user nova-compute[75122]:       <nova:creationTime>2023-11-15 10:10:51</nova:creationTime>
Nov 15 10:10:53 user nova-compute[75122]:       <nova:flavor name="m1.tiny">
Nov 15 10:10:53 user nova-compute[75122]:         <nova:memory>512</nova:memory>
Nov 15 10:10:53 user nova-compute[75122]:         <nova:disk>1</nova:disk>
Nov 15 10:10:53 user nova-compute[75122]:         <nova:swap>0</nova:swap>
Nov 15 10:10:53 user nova-compute[75122]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 10:10:53 user nova-compute[75122]:         <nova:vcpus>1</nova:vcpus>
Nov 15 10:10:53 user nova-compute[75122]:       </nova:flavor>
Nov 15 10:10:53 user nova-compute[75122]:       <nova:owner>
Nov 15 10:10:53 user nova-compute[75122]:         <nova:user uuid="00f5cc88e43c434c8a061dcec472a16b">tempest-TestVolumeBootPattern-296749341-project-member</nova:user>
Nov 15 10:10:53 user nova-compute[75122]:         <nova:project uuid="c7941f36c30b49408ae5709a1b75346d">tempest-TestVolumeBootPattern-296749341</nova:project>
Nov 15 10:10:53 user nova-compute[75122]:       </nova:owner>
Nov 15 10:10:53 user nova-compute[75122]:       <nova:ports>
Nov 15 10:10:53 user nova-compute[75122]:         <nova:port uuid="ba4e0f89-75c3-4eeb-8b28-4ea10bb61909">
Nov 15 10:10:53 user nova-compute[75122]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 15 10:10:53 user nova-compute[75122]:         </nova:port>
Nov 15 10:10:53 user nova-compute[75122]:       </nova:ports>
Nov 15 10:10:53 user nova-compute[75122]:     </nova:instance>
Nov 15 10:10:53 user nova-compute[75122]:   </metadata>
Nov 15 10:10:53 user nova-compute[75122]:   <sysinfo type="smbios">
Nov 15 10:10:53 user nova-compute[75122]:     <system>
Nov 15 10:10:53 user nova-compute[75122]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 10:10:53 user nova-compute[75122]:       <entry name="product">OpenStack Nova</entry>
Nov 15 10:10:53 user nova-compute[75122]:       <entry name="version">0.0.0</entry>
Nov 15 10:10:53 user nova-compute[75122]:       <entry name="serial">a534665a-90e4-47dc-b081-47a44a975b64</entry>
Nov 15 10:10:53 user nova-compute[75122]:       <entry name="uuid">a534665a-90e4-47dc-b081-47a44a975b64</entry>
Nov 15 10:10:53 user nova-compute[75122]:       <entry name="family">Virtual Machine</entry>
Nov 15 10:10:53 user nova-compute[75122]:     </system>
Nov 15 10:10:53 user nova-compute[75122]:   </sysinfo>
Nov 15 10:10:53 user nova-compute[75122]:   <os>
Nov 15 10:10:53 user nova-compute[75122]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 10:10:53 user nova-compute[75122]:     <boot dev="hd"/>
Nov 15 10:10:53 user nova-compute[75122]:     <smbios mode="sysinfo"/>
Nov 15 10:10:53 user nova-compute[75122]:   </os>
Nov 15 10:10:53 user nova-compute[75122]:   <features>
Nov 15 10:10:53 user nova-compute[75122]:     <acpi/>
Nov 15 10:10:53 user nova-compute[75122]:     <apic/>
Nov 15 10:10:53 user nova-compute[75122]:     <vmcoreinfo/>
Nov 15 10:10:53 user nova-compute[75122]:   </features>
Nov 15 10:10:53 user nova-compute[75122]:   <clock offset="utc">
Nov 15 10:10:53 user nova-compute[75122]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 10:10:53 user nova-compute[75122]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 10:10:53 user nova-compute[75122]:     <timer name="hpet" present="no"/>
Nov 15 10:10:53 user nova-compute[75122]:   </clock>
Nov 15 10:10:53 user nova-compute[75122]:   <cpu mode="custom" match="exact">
Nov 15 10:10:53 user nova-compute[75122]:     <model>Nehalem</model>
Nov 15 10:10:53 user nova-compute[75122]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 10:10:53 user nova-compute[75122]:   </cpu>
Nov 15 10:10:53 user nova-compute[75122]:   <devices>
Nov 15 10:10:53 user nova-compute[75122]:     <disk type="block" device="disk">
Nov 15 10:10:53 user nova-compute[75122]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 10:10:53 user nova-compute[75122]:       <source dev="/dev/sdc"/>
Nov 15 10:10:53 user nova-compute[75122]:       <target dev="vda" bus="virtio"/>
Nov 15 10:10:53 user nova-compute[75122]:       <serial>9be886d5-d605-4139-bf9a-a8bce1cd6ddc</serial>
Nov 15 10:10:53 user nova-compute[75122]:     </disk>
Nov 15 10:10:53 user nova-compute[75122]:     <interface type="ethernet">
Nov 15 10:10:53 user nova-compute[75122]:       <mac address="fa:16:3e:af:8a:69"/>
Nov 15 10:10:53 user nova-compute[75122]:       <model type="virtio"/>
Nov 15 10:10:53 user nova-compute[75122]:       <mtu size="1442"/>
Nov 15 10:10:53 user nova-compute[75122]:       <target dev="tapba4e0f89-75"/>
Nov 15 10:10:53 user nova-compute[75122]:     </interface>
Nov 15 10:10:53 user nova-compute[75122]:     <serial type="pty">
Nov 15 10:10:53 user nova-compute[75122]:       <log file="/opt/stack/data/nova/instances/a534665a-90e4-47dc-b081-47a44a975b64/console.log" append="off"/>
Nov 15 10:10:53 user nova-compute[75122]:     </serial>
Nov 15 10:10:53 user nova-compute[75122]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 10:10:53 user nova-compute[75122]:     <video>
Nov 15 10:10:53 user nova-compute[75122]:       <model type="virtio"/>
Nov 15 10:10:53 user nova-compute[75122]:     </video>
Nov 15 10:10:53 user nova-compute[75122]:     <rng model="virtio">
Nov 15 10:10:53 user nova-compute[75122]:       <backend model="random">/dev/urandom</backend>
Nov 15 10:10:53 user nova-compute[75122]:     </rng>
Nov 15 10:10:53 user nova-compute[75122]:     <controller type="usb" index="0" model="none"/>
Nov 15 10:10:53 user nova-compute[75122]:     <memballoon model="virtio">
Nov 15 10:10:53 user nova-compute[75122]:       <stats period="10"/>
Nov 15 10:10:53 user nova-compute[75122]:     </memballoon>
Nov 15 10:10:53 user nova-compute[75122]:   </devices>
Nov 15 10:10:53 user nova-compute[75122]: </domain>
Nov 15 10:10:53 user nova-compute[75122]:  {{(pid=75122) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 10:10:53 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-1e13ba19-e7de-481b-9c9d-270b79881562 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T10:10:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1841816478',display_name='tempest-TestVolumeBootPattern-server-1841816478',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1841816478',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKHlpBGjgQO8WCWtscnQGPLWQNzcwgXW54O9CXzl/Z/CZ497o/Fb/9rP8/a86D2H+G6HyOK+OZYAd3QjjsdbXOlrlce1txRdWXFLkzlkbTs2rp1mYOku0vjKWQDJeaVaVQ==',key_name='tempest-TestVolumeBootPattern-2035754115',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c7941f36c30b49408ae5709a1b75346d',ramdisk_id='',reservation_id='r-zzuznqcz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-296749341',owner_user_name='tempest-TestVolumeBootPattern-296749341-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T10:10:47Z,user_data=None,user_id='00f5cc88e43c434c8a061dcec472a16b',uuid=a534665a-90e4-47dc-b081-47a44a975b64,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ba4e0f89-75c3-4eeb-8b28-4ea10bb61909", "address": "fa:16:3e:af:8a:69", "network": {"id": "03073971-5253-4f06-a46a-94840841fd6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2056706757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7941f36c30b49408ae5709a1b75346d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba4e0f89-75", "ovs_interfaceid": "ba4e0f89-75c3-4eeb-8b28-4ea10bb61909", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 10:10:53 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-1e13ba19-e7de-481b-9c9d-270b79881562 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Converting VIF {"id": "ba4e0f89-75c3-4eeb-8b28-4ea10bb61909", "address": "fa:16:3e:af:8a:69", "network": {"id": "03073971-5253-4f06-a46a-94840841fd6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2056706757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7941f36c30b49408ae5709a1b75346d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba4e0f89-75", "ovs_interfaceid": "ba4e0f89-75c3-4eeb-8b28-4ea10bb61909", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 10:10:53 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-1e13ba19-e7de-481b-9c9d-270b79881562 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:af:8a:69,bridge_name='br-int',has_traffic_filtering=True,id=ba4e0f89-75c3-4eeb-8b28-4ea10bb61909,network=Network(03073971-5253-4f06-a46a-94840841fd6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba4e0f89-75') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 10:10:53 user nova-compute[75122]: DEBUG os_vif [None req-1e13ba19-e7de-481b-9c9d-270b79881562 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:8a:69,bridge_name='br-int',has_traffic_filtering=True,id=ba4e0f89-75c3-4eeb-8b28-4ea10bb61909,network=Network(03073971-5253-4f06-a46a-94840841fd6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba4e0f89-75') {{(pid=75122) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 10:10:53 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:10:53 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 10:10:53 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 10:10:53 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:10:53 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0b6d957b-d6bc-587a-8878-00900d91b723', '_type': 'linux-noop'}}, row=False) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 10:10:53 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:10:53 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:10:53 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:10:53 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapba4e0f89-75, may_exist=True, interface_attrs={}) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 10:10:53 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapba4e0f89-75, col_values=(('qos', UUID('619a0bb1-0bee-4b70-bae2-2523f5c19f8e')),), if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 10:10:53 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapba4e0f89-75, col_values=(('external_ids', {'iface-id': 'ba4e0f89-75c3-4eeb-8b28-4ea10bb61909', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:af:8a:69', 'vm-uuid': 'a534665a-90e4-47dc-b081-47a44a975b64'}),), if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 10:10:53 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:10:53 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:10:53 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:10:53 user nova-compute[75122]: INFO os_vif [None req-1e13ba19-e7de-481b-9c9d-270b79881562 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:8a:69,bridge_name='br-int',has_traffic_filtering=True,id=ba4e0f89-75c3-4eeb-8b28-4ea10bb61909,network=Network(03073971-5253-4f06-a46a-94840841fd6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba4e0f89-75')
Nov 15 10:10:53 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-1e13ba19-e7de-481b-9c9d-270b79881562 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] No BDM found with device name vda, not building metadata. {{(pid=75122) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 10:10:53 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-1e13ba19-e7de-481b-9c9d-270b79881562 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] No VIF found with MAC fa:16:3e:af:8a:69, not building metadata {{(pid=75122) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 10:10:54 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:10:54 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75122) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 10:10:54 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:10:54 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:10:54 user nova-compute[75122]: DEBUG nova.compute.manager [req-bc4e3105-479c-42aa-a8bd-22aa9952f3a0 req-bdde8c7d-9921-43f1-8a5b-1b8e701b22a9 service nova] [instance: a534665a-90e4-47dc-b081-47a44a975b64] Received event network-vif-plugged-ba4e0f89-75c3-4eeb-8b28-4ea10bb61909 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 10:10:54 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-bc4e3105-479c-42aa-a8bd-22aa9952f3a0 req-bdde8c7d-9921-43f1-8a5b-1b8e701b22a9 service nova] Acquiring lock "a534665a-90e4-47dc-b081-47a44a975b64-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:10:54 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-bc4e3105-479c-42aa-a8bd-22aa9952f3a0 req-bdde8c7d-9921-43f1-8a5b-1b8e701b22a9 service nova] Lock "a534665a-90e4-47dc-b081-47a44a975b64-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:10:54 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-bc4e3105-479c-42aa-a8bd-22aa9952f3a0 req-bdde8c7d-9921-43f1-8a5b-1b8e701b22a9 service nova] Lock "a534665a-90e4-47dc-b081-47a44a975b64-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:10:54 user nova-compute[75122]: DEBUG nova.compute.manager [req-bc4e3105-479c-42aa-a8bd-22aa9952f3a0 req-bdde8c7d-9921-43f1-8a5b-1b8e701b22a9 service nova] [instance: a534665a-90e4-47dc-b081-47a44a975b64] No waiting events found dispatching network-vif-plugged-ba4e0f89-75c3-4eeb-8b28-4ea10bb61909 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 10:10:54 user nova-compute[75122]: WARNING nova.compute.manager [req-bc4e3105-479c-42aa-a8bd-22aa9952f3a0 req-bdde8c7d-9921-43f1-8a5b-1b8e701b22a9 service nova] [instance: a534665a-90e4-47dc-b081-47a44a975b64] Received unexpected event network-vif-plugged-ba4e0f89-75c3-4eeb-8b28-4ea10bb61909 for instance with vm_state building and task_state spawning.
Nov 15 10:10:54 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:10:54 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:10:55 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:10:55 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-c0992d26-fb1b-45a6-a445-8f116ed17d2e tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 5bb980be-c2eb-42eb-a84b-5d29592259a4 is timed out.
Nov 15 10:10:55 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-c0992d26-fb1b-45a6-a445-8f116ed17d2e tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Successfully detached device vdc from instance 5bb980be-c2eb-42eb-a84b-5d29592259a4 from the live domain config.
Nov 15 10:10:55 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c0992d26-fb1b-45a6-a445-8f116ed17d2e tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] [instance: 5bb980be-c2eb-42eb-a84b-5d29592259a4] calling os-brick to detach iSCSI Volume {{(pid=75122) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 10:10:55 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0992d26-fb1b-45a6-a445-8f116ed17d2e tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffa04060b80>, {'target_iqn': 'iqn.2010-10.org.openstack:a4146b89-df53-44df-bd77-afa4b334b4ef', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aNOADoxg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 10:10:55 user nova-compute[75122]: WARNING os_brick.initiator.connectors.base [None req-c0992d26-fb1b-45a6-a445-8f116ed17d2e tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 10:10:55 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-c0992d26-fb1b-45a6-a445-8f116ed17d2e tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 10:10:55 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-c0992d26-fb1b-45a6-a445-8f116ed17d2e tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 10:10:55 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:10:55 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:10:55 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[c25e5839-17c2-486d-8b16-b359ff5a674f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:59ca9506-19c1-4a17-a495-28601cdadf8b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a4146b89-df53-44df-bd77-afa4b334b4ef\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9be886d5-d605-4139-bf9a-a8bce1cd6ddc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:10:55 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0992d26-fb1b-45a6-a445-8f116ed17d2e tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 10:10:55 user nova-compute[75122]: No targets found.
Nov 15 10:10:55 user nova-compute[75122]: iSNS:
Nov 15 10:10:55 user nova-compute[75122]: No targets found.
Nov 15 10:10:55 user nova-compute[75122]: STATIC:
Nov 15 10:10:55 user nova-compute[75122]: Target: iqn.2010-10.org.openstack:59ca9506-19c1-4a17-a495-28601cdadf8b
Nov 15 10:10:55 user nova-compute[75122]:         Portal: 172.16.0.220:3260,-1
Nov 15 10:10:55 user nova-compute[75122]:                 Iface Name: default
Nov 15 10:10:55 user nova-compute[75122]: Target: iqn.2010-10.org.openstack:a4146b89-df53-44df-bd77-afa4b334b4ef
Nov 15 10:10:55 user nova-compute[75122]:         Portal: 172.16.0.220:3260,-1
Nov 15 10:10:55 user nova-compute[75122]:                 Iface Name: default
Nov 15 10:10:55 user nova-compute[75122]: Target: iqn.2010-10.org.openstack:9be886d5-d605-4139-bf9a-a8bce1cd6ddc
Nov 15 10:10:55 user nova-compute[75122]:         Portal: 172.16.0.220:3260,-1
Nov 15 10:10:55 user nova-compute[75122]:                 Iface Name: default
Nov 15 10:10:55 user nova-compute[75122]: FIRMWARE:
Nov 15 10:10:55 user nova-compute[75122]: No targets found.
Nov 15 10:10:55 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 10:10:55 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0992d26-fb1b-45a6-a445-8f116ed17d2e tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 10:10:55 user nova-compute[75122]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 10:10:55 user nova-compute[75122]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75122) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 10:10:55 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0992d26-fb1b-45a6-a445-8f116ed17d2e tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a4146b89-df53-44df-bd77-afa4b334b4ef', 0)] {{(pid=75122) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 10:10:55 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:10:55 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:10:55 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[879e1d98-3b83-4545-957e-60a9898fbd02]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:59ca9506-19c1-4a17-a495-28601cdadf8b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9be886d5-d605-4139-bf9a-a8bce1cd6ddc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a4146b89-df53-44df-bd77-afa4b334b4ef\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:10:55 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:10:55 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:10:55 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4bf863a-eabf-4f6c-adf1-02378bc1e46d]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59ca9506-19c1-4a17-a495-28601cdadf8b (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4146b89-df53-44df-bd77-afa4b334b4ef (non-flash)\ntcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9be886d5-d605-4139-bf9a-a8bce1cd6ddc (non-flash)\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:10:55 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0992d26-fb1b-45a6-a445-8f116ed17d2e tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59ca9506-19c1-4a17-a495-28601cdadf8b (non-flash)
Nov 15 10:10:55 user nova-compute[75122]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4146b89-df53-44df-bd77-afa4b334b4ef (non-flash)
Nov 15 10:10:55 user nova-compute[75122]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9be886d5-d605-4139-bf9a-a8bce1cd6ddc (non-flash)
Nov 15 10:10:55 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 10:10:55 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0992d26-fb1b-45a6-a445-8f116ed17d2e tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59ca9506-19c1-4a17-a495-28601cdadf8b (non-flash)
Nov 15 10:10:55 user nova-compute[75122]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4146b89-df53-44df-bd77-afa4b334b4ef (non-flash)
Nov 15 10:10:55 user nova-compute[75122]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9be886d5-d605-4139-bf9a-a8bce1cd6ddc (non-flash)
Nov 15 10:10:55 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 10:10:55 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0992d26-fb1b-45a6-a445-8f116ed17d2e tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff9fc304550>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a4146b89-df53-44df-bd77-afa4b334b4ef'): ({'sdd'}, set())}) {{(pid=75122) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 10:10:55 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-c0992d26-fb1b-45a6-a445-8f116ed17d2e tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Removing single pathed devices sdd {{(pid=75122) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 10:10:55 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:10:55 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:10:55 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[69f372e6-1893-4d59-8e9d-94bc7389be3f]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:10:55 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:10:55 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:10:55 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e10decc-c9dc-4f56-996d-4ab44a04ee46]: (4, ('ok\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:10:55 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-c0992d26-fb1b-45a6-a445-8f116ed17d2e tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Flushing IO for device /dev/sdd {{(pid=75122) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 10:10:55 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:10:55 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:10:55 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6ce17fa-bd3a-4152-b049-9455be878ed7]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:10:55 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-c0992d26-fb1b-45a6-a445-8f116ed17d2e tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75122) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 10:10:55 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:10:55 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.043s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:10:55 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7240622-df03-4dbd-96e8-91a82e772d17]: (4, ('1', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:10:55 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-c0992d26-fb1b-45a6-a445-8f116ed17d2e tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75122) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 10:10:55 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-c0992d26-fb1b-45a6-a445-8f116ed17d2e tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] SCSI volumes sdd have been removed. {{(pid=75122) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 10:10:55 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0992d26-fb1b-45a6-a445-8f116ed17d2e tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a4146b89-df53-44df-bd77-afa4b334b4ef')] {{(pid=75122) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 10:10:55 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4146b89-df53-44df-bd77-afa4b334b4ef -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:10:55 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4146b89-df53-44df-bd77-afa4b334b4ef -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:10:55 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[30d88e9e-7842-4b1f-82cf-fff8970ddb2f]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:10:55 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0992d26-fb1b-45a6-a445-8f116ed17d2e tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 10:10:55 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4146b89-df53-44df-bd77-afa4b334b4ef -p 172.16.0.220:3260 --logout {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:10:55 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4146b89-df53-44df-bd77-afa4b334b4ef -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:10:55 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[7df11d6b-d55e-4f8a-90f1-2394fa9573d4]: (4, ('Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:a4146b89-df53-44df-bd77-afa4b334b4ef, portal: 172.16.0.220,3260]\nLogout of [sid: 59, target: iqn.2010-10.org.openstack:a4146b89-df53-44df-bd77-afa4b334b4ef, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:10:55 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0992d26-fb1b-45a6-a445-8f116ed17d2e tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:a4146b89-df53-44df-bd77-afa4b334b4ef, portal: 172.16.0.220,3260]
Nov 15 10:10:55 user nova-compute[75122]: Logout of [sid: 59, target: iqn.2010-10.org.openstack:a4146b89-df53-44df-bd77-afa4b334b4ef, portal: 172.16.0.220,3260] successful.
Nov 15 10:10:55 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 10:10:55 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4146b89-df53-44df-bd77-afa4b334b4ef -p 172.16.0.220:3260 --op delete {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:10:55 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4146b89-df53-44df-bd77-afa4b334b4ef -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:10:55 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4814cdc-80c5-4e2a-abef-7a7dc5f092e2]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:10:55 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0992d26-fb1b-45a6-a445-8f116ed17d2e tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 10:10:55 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-c0992d26-fb1b-45a6-a445-8f116ed17d2e tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.285s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 10:10:55 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0992d26-fb1b-45a6-a445-8f116ed17d2e tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] <== disconnect_volume: return (286ms) None {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 10:10:55 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c0992d26-fb1b-45a6-a445-8f116ed17d2e tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] [instance: 5bb980be-c2eb-42eb-a84b-5d29592259a4] Disconnected iSCSI Volume {{(pid=75122) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 10:10:56 user nova-compute[75122]: DEBUG nova.compute.manager [None req-1e13ba19-e7de-481b-9c9d-270b79881562 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: a534665a-90e4-47dc-b081-47a44a975b64] Instance event wait completed in 0 seconds for  {{(pid=75122) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 10:10:56 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-1e13ba19-e7de-481b-9c9d-270b79881562 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: a534665a-90e4-47dc-b081-47a44a975b64] Guest created on hypervisor {{(pid=75122) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 10:10:56 user nova-compute[75122]: INFO nova.virt.libvirt.driver [-] [instance: a534665a-90e4-47dc-b081-47a44a975b64] Instance spawned successfully.
Nov 15 10:10:56 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-1e13ba19-e7de-481b-9c9d-270b79881562 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: a534665a-90e4-47dc-b081-47a44a975b64] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 10:10:56 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-1e13ba19-e7de-481b-9c9d-270b79881562 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: a534665a-90e4-47dc-b081-47a44a975b64] Found default for hw_cdrom_bus of ide {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 10:10:56 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-1e13ba19-e7de-481b-9c9d-270b79881562 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: a534665a-90e4-47dc-b081-47a44a975b64] Found default for hw_disk_bus of virtio {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 10:10:56 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-1e13ba19-e7de-481b-9c9d-270b79881562 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: a534665a-90e4-47dc-b081-47a44a975b64] Found default for hw_input_bus of None {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 10:10:56 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-1e13ba19-e7de-481b-9c9d-270b79881562 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: a534665a-90e4-47dc-b081-47a44a975b64] Found default for hw_pointer_model of None {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 10:10:56 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-1e13ba19-e7de-481b-9c9d-270b79881562 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: a534665a-90e4-47dc-b081-47a44a975b64] Found default for hw_video_model of virtio {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 10:10:56 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-1e13ba19-e7de-481b-9c9d-270b79881562 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: a534665a-90e4-47dc-b081-47a44a975b64] Found default for hw_vif_model of virtio {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 10:10:56 user nova-compute[75122]: INFO nova.compute.manager [None req-1e13ba19-e7de-481b-9c9d-270b79881562 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: a534665a-90e4-47dc-b081-47a44a975b64] Took 4.90 seconds to spawn the instance on the hypervisor.
Nov 15 10:10:56 user nova-compute[75122]: DEBUG nova.compute.manager [None req-1e13ba19-e7de-481b-9c9d-270b79881562 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: a534665a-90e4-47dc-b081-47a44a975b64] Checking state {{(pid=75122) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 10:10:56 user nova-compute[75122]: DEBUG nova.compute.manager [req-dbb48bec-b210-4603-bba1-c9b0f4baca57 req-b0725ee9-ad9d-4f75-8a45-60276bd67f38 service nova] [instance: a534665a-90e4-47dc-b081-47a44a975b64] Received event network-vif-plugged-ba4e0f89-75c3-4eeb-8b28-4ea10bb61909 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 10:10:56 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-dbb48bec-b210-4603-bba1-c9b0f4baca57 req-b0725ee9-ad9d-4f75-8a45-60276bd67f38 service nova] Acquiring lock "a534665a-90e4-47dc-b081-47a44a975b64-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:10:56 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-dbb48bec-b210-4603-bba1-c9b0f4baca57 req-b0725ee9-ad9d-4f75-8a45-60276bd67f38 service nova] Lock "a534665a-90e4-47dc-b081-47a44a975b64-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:10:56 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-dbb48bec-b210-4603-bba1-c9b0f4baca57 req-b0725ee9-ad9d-4f75-8a45-60276bd67f38 service nova] Lock "a534665a-90e4-47dc-b081-47a44a975b64-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:10:56 user nova-compute[75122]: DEBUG nova.compute.manager [req-dbb48bec-b210-4603-bba1-c9b0f4baca57 req-b0725ee9-ad9d-4f75-8a45-60276bd67f38 service nova] [instance: a534665a-90e4-47dc-b081-47a44a975b64] No waiting events found dispatching network-vif-plugged-ba4e0f89-75c3-4eeb-8b28-4ea10bb61909 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 10:10:56 user nova-compute[75122]: WARNING nova.compute.manager [req-dbb48bec-b210-4603-bba1-c9b0f4baca57 req-b0725ee9-ad9d-4f75-8a45-60276bd67f38 service nova] [instance: a534665a-90e4-47dc-b081-47a44a975b64] Received unexpected event network-vif-plugged-ba4e0f89-75c3-4eeb-8b28-4ea10bb61909 for instance with vm_state building and task_state spawning.
Nov 15 10:10:56 user nova-compute[75122]: INFO nova.compute.manager [None req-1e13ba19-e7de-481b-9c9d-270b79881562 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: a534665a-90e4-47dc-b081-47a44a975b64] Took 10.59 seconds to build instance.
Nov 15 10:10:56 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-1e13ba19-e7de-481b-9c9d-270b79881562 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Lock "a534665a-90e4-47dc-b081-47a44a975b64" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.751s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:10:56 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:10:57 user nova-compute[75122]: DEBUG nova.objects.instance [None req-c0992d26-fb1b-45a6-a445-8f116ed17d2e tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Lazy-loading 'flavor' on Instance uuid 5bb980be-c2eb-42eb-a84b-5d29592259a4 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 10:10:57 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-c0992d26-fb1b-45a6-a445-8f116ed17d2e tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Lock "5bb980be-c2eb-42eb-a84b-5d29592259a4" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.594s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:10:58 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:10:58 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-6ab51e23-38d0-469f-b2f0-1d8640c22041 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Acquiring lock "5bb980be-c2eb-42eb-a84b-5d29592259a4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:10:58 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-6ab51e23-38d0-469f-b2f0-1d8640c22041 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Lock "5bb980be-c2eb-42eb-a84b-5d29592259a4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:10:58 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-6ab51e23-38d0-469f-b2f0-1d8640c22041 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Acquiring lock "5bb980be-c2eb-42eb-a84b-5d29592259a4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:10:58 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-6ab51e23-38d0-469f-b2f0-1d8640c22041 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Lock "5bb980be-c2eb-42eb-a84b-5d29592259a4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:10:58 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-6ab51e23-38d0-469f-b2f0-1d8640c22041 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Lock "5bb980be-c2eb-42eb-a84b-5d29592259a4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:10:58 user nova-compute[75122]: INFO nova.compute.manager [None req-6ab51e23-38d0-469f-b2f0-1d8640c22041 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] [instance: 5bb980be-c2eb-42eb-a84b-5d29592259a4] Terminating instance
Nov 15 10:10:58 user nova-compute[75122]: DEBUG nova.compute.manager [None req-6ab51e23-38d0-469f-b2f0-1d8640c22041 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] [instance: 5bb980be-c2eb-42eb-a84b-5d29592259a4] Start destroying the instance on the hypervisor. {{(pid=75122) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 10:10:58 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:10:58 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:10:58 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:10:59 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:10:59 user nova-compute[75122]: DEBUG nova.compute.manager [req-88550aa0-77d8-43f5-a3a1-9309673df014 req-85c4b331-87fe-4a29-b192-6d8053849e91 service nova] [instance: 5bb980be-c2eb-42eb-a84b-5d29592259a4] Received event network-vif-unplugged-5dcdd286-bee6-43e0-96d4-a42d060b6158 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 10:10:59 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-88550aa0-77d8-43f5-a3a1-9309673df014 req-85c4b331-87fe-4a29-b192-6d8053849e91 service nova] Acquiring lock "5bb980be-c2eb-42eb-a84b-5d29592259a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:10:59 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-88550aa0-77d8-43f5-a3a1-9309673df014 req-85c4b331-87fe-4a29-b192-6d8053849e91 service nova] Lock "5bb980be-c2eb-42eb-a84b-5d29592259a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:10:59 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-88550aa0-77d8-43f5-a3a1-9309673df014 req-85c4b331-87fe-4a29-b192-6d8053849e91 service nova] Lock "5bb980be-c2eb-42eb-a84b-5d29592259a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:10:59 user nova-compute[75122]: DEBUG nova.compute.manager [req-88550aa0-77d8-43f5-a3a1-9309673df014 req-85c4b331-87fe-4a29-b192-6d8053849e91 service nova] [instance: 5bb980be-c2eb-42eb-a84b-5d29592259a4] No waiting events found dispatching network-vif-unplugged-5dcdd286-bee6-43e0-96d4-a42d060b6158 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 10:10:59 user nova-compute[75122]: DEBUG nova.compute.manager [req-88550aa0-77d8-43f5-a3a1-9309673df014 req-85c4b331-87fe-4a29-b192-6d8053849e91 service nova] [instance: 5bb980be-c2eb-42eb-a84b-5d29592259a4] Received event network-vif-unplugged-5dcdd286-bee6-43e0-96d4-a42d060b6158 for instance with task_state deleting. {{(pid=75122) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 10:10:59 user nova-compute[75122]: INFO nova.virt.libvirt.driver [-] [instance: 5bb980be-c2eb-42eb-a84b-5d29592259a4] Instance destroyed successfully.
Nov 15 10:10:59 user nova-compute[75122]: DEBUG nova.objects.instance [None req-6ab51e23-38d0-469f-b2f0-1d8640c22041 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Lazy-loading 'resources' on Instance uuid 5bb980be-c2eb-42eb-a84b-5d29592259a4 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 10:10:59 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-6ab51e23-38d0-469f-b2f0-1d8640c22041 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T10:08:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-716738267',display_name='tempest-AttachVolumeTestJSON-server-716738267',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-716738267',id=48,image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFNMLN60iC9zm0eXgYrt/2ZOYIdFM0zYPdvgy9CkgfgPFYhDFMiaNQO1hgRpLRJLq17W8ByxSNmXXsftwgPbQ7WjM9by/qT37FU72/cZjHmmc7Gjx75jRxuQxyNmhU5VYQ==',key_name='tempest-keypair-1984152566',keypairs=<?>,launch_index=0,launched_at=2023-11-15T10:08:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ab6afbe7809a4ad3921cbc18145d1816',ramdisk_id='',reservation_id='r-rs2dv38e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-970815916',owner_user_name='tempest-AttachVolumeTestJSON-970815916-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T10:08:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f18eb706375c4b2e9e7de793cd2950ad',uuid=5bb980be-c2eb-42eb-a84b-5d29592259a4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5dcdd286-bee6-43e0-96d4-a42d060b6158", "address": "fa:16:3e:67:41:8c", "network": {"id": "8c1491a5-d5c6-4a22-84fd-bdeca00bbaad", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1848328203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab6afbe7809a4ad3921cbc18145d1816", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5dcdd286-be", "ovs_interfaceid": "5dcdd286-bee6-43e0-96d4-a42d060b6158", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 10:10:59 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-6ab51e23-38d0-469f-b2f0-1d8640c22041 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Converting VIF {"id": "5dcdd286-bee6-43e0-96d4-a42d060b6158", "address": "fa:16:3e:67:41:8c", "network": {"id": "8c1491a5-d5c6-4a22-84fd-bdeca00bbaad", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1848328203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ab6afbe7809a4ad3921cbc18145d1816", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5dcdd286-be", "ovs_interfaceid": "5dcdd286-bee6-43e0-96d4-a42d060b6158", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 10:10:59 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-6ab51e23-38d0-469f-b2f0-1d8640c22041 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:67:41:8c,bridge_name='br-int',has_traffic_filtering=True,id=5dcdd286-bee6-43e0-96d4-a42d060b6158,network=Network(8c1491a5-d5c6-4a22-84fd-bdeca00bbaad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5dcdd286-be') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 10:10:59 user nova-compute[75122]: DEBUG os_vif [None req-6ab51e23-38d0-469f-b2f0-1d8640c22041 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:67:41:8c,bridge_name='br-int',has_traffic_filtering=True,id=5dcdd286-bee6-43e0-96d4-a42d060b6158,network=Network(8c1491a5-d5c6-4a22-84fd-bdeca00bbaad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5dcdd286-be') {{(pid=75122) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 10:10:59 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:10:59 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5dcdd286-be, bridge=br-int, if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 10:10:59 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:10:59 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:10:59 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:10:59 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7a89f388-18db-4fd6-86e4-0fdca6c95e31) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 10:10:59 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:10:59 user nova-compute[75122]: INFO os_vif [None req-6ab51e23-38d0-469f-b2f0-1d8640c22041 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:67:41:8c,bridge_name='br-int',has_traffic_filtering=True,id=5dcdd286-bee6-43e0-96d4-a42d060b6158,network=Network(8c1491a5-d5c6-4a22-84fd-bdeca00bbaad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5dcdd286-be')
Nov 15 10:10:59 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-6ab51e23-38d0-469f-b2f0-1d8640c22041 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] [instance: 5bb980be-c2eb-42eb-a84b-5d29592259a4] Deleting instance files /opt/stack/data/nova/instances/5bb980be-c2eb-42eb-a84b-5d29592259a4_del
Nov 15 10:10:59 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-6ab51e23-38d0-469f-b2f0-1d8640c22041 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] [instance: 5bb980be-c2eb-42eb-a84b-5d29592259a4] Deletion of /opt/stack/data/nova/instances/5bb980be-c2eb-42eb-a84b-5d29592259a4_del complete
Nov 15 10:10:59 user nova-compute[75122]: INFO nova.compute.manager [None req-6ab51e23-38d0-469f-b2f0-1d8640c22041 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] [instance: 5bb980be-c2eb-42eb-a84b-5d29592259a4] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 15 10:10:59 user nova-compute[75122]: DEBUG oslo.service.loopingcall [None req-6ab51e23-38d0-469f-b2f0-1d8640c22041 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75122) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 10:10:59 user nova-compute[75122]: DEBUG nova.compute.manager [-] [instance: 5bb980be-c2eb-42eb-a84b-5d29592259a4] Deallocating network for instance {{(pid=75122) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 10:10:59 user nova-compute[75122]: DEBUG nova.network.neutron [-] [instance: 5bb980be-c2eb-42eb-a84b-5d29592259a4] deallocate_for_instance() {{(pid=75122) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 10:11:00 user nova-compute[75122]: DEBUG nova.network.neutron [-] [instance: 5bb980be-c2eb-42eb-a84b-5d29592259a4] Updating instance_info_cache with network_info: [] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 10:11:00 user nova-compute[75122]: INFO nova.compute.manager [-] [instance: 5bb980be-c2eb-42eb-a84b-5d29592259a4] Took 1.11 seconds to deallocate network for instance.
Nov 15 10:11:00 user nova-compute[75122]: DEBUG nova.compute.manager [req-0519cca3-4e9f-4c8d-9bca-ef551b1370e2 req-212c18a0-ee84-42f0-abba-94462e58a706 service nova] [instance: 5bb980be-c2eb-42eb-a84b-5d29592259a4] Received event network-vif-deleted-5dcdd286-bee6-43e0-96d4-a42d060b6158 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 10:11:00 user nova-compute[75122]: INFO nova.compute.manager [req-0519cca3-4e9f-4c8d-9bca-ef551b1370e2 req-212c18a0-ee84-42f0-abba-94462e58a706 service nova] [instance: 5bb980be-c2eb-42eb-a84b-5d29592259a4] Neutron deleted interface 5dcdd286-bee6-43e0-96d4-a42d060b6158; detaching it from the instance and deleting it from the info cache
Nov 15 10:11:00 user nova-compute[75122]: DEBUG nova.network.neutron [req-0519cca3-4e9f-4c8d-9bca-ef551b1370e2 req-212c18a0-ee84-42f0-abba-94462e58a706 service nova] [instance: 5bb980be-c2eb-42eb-a84b-5d29592259a4] Updating instance_info_cache with network_info: [] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 10:11:00 user nova-compute[75122]: DEBUG nova.compute.manager [req-0519cca3-4e9f-4c8d-9bca-ef551b1370e2 req-212c18a0-ee84-42f0-abba-94462e58a706 service nova] [instance: 5bb980be-c2eb-42eb-a84b-5d29592259a4] Detach interface failed, port_id=5dcdd286-bee6-43e0-96d4-a42d060b6158, reason: Instance 5bb980be-c2eb-42eb-a84b-5d29592259a4 could not be found. {{(pid=75122) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 10:11:00 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-6ab51e23-38d0-469f-b2f0-1d8640c22041 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:11:00 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-6ab51e23-38d0-469f-b2f0-1d8640c22041 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:11:01 user nova-compute[75122]: DEBUG nova.compute.provider_tree [None req-6ab51e23-38d0-469f-b2f0-1d8640c22041 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Inventory has not changed in ProviderTree for provider: 69a3da65-47be-44c6-b67c-c692b58284ef {{(pid=75122) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 10:11:01 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-6ab51e23-38d0-469f-b2f0-1d8640c22041 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Inventory has not changed for provider 69a3da65-47be-44c6-b67c-c692b58284ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 10:11:01 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-6ab51e23-38d0-469f-b2f0-1d8640c22041 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.176s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:11:01 user nova-compute[75122]: INFO nova.scheduler.client.report [None req-6ab51e23-38d0-469f-b2f0-1d8640c22041 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Deleted allocations for instance 5bb980be-c2eb-42eb-a84b-5d29592259a4
Nov 15 10:11:01 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-6ab51e23-38d0-469f-b2f0-1d8640c22041 tempest-AttachVolumeTestJSON-970815916 tempest-AttachVolumeTestJSON-970815916-project-member] Lock "5bb980be-c2eb-42eb-a84b-5d29592259a4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.385s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:11:01 user nova-compute[75122]: DEBUG nova.compute.manager [req-26102522-425d-4b14-b2b5-e0408fd54e9e req-433eea6b-5910-416d-ae63-7ea01de74b02 service nova] [instance: 5bb980be-c2eb-42eb-a84b-5d29592259a4] Received event network-vif-plugged-5dcdd286-bee6-43e0-96d4-a42d060b6158 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 10:11:01 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-26102522-425d-4b14-b2b5-e0408fd54e9e req-433eea6b-5910-416d-ae63-7ea01de74b02 service nova] Acquiring lock "5bb980be-c2eb-42eb-a84b-5d29592259a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:11:01 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-26102522-425d-4b14-b2b5-e0408fd54e9e req-433eea6b-5910-416d-ae63-7ea01de74b02 service nova] Lock "5bb980be-c2eb-42eb-a84b-5d29592259a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:11:01 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-26102522-425d-4b14-b2b5-e0408fd54e9e req-433eea6b-5910-416d-ae63-7ea01de74b02 service nova] Lock "5bb980be-c2eb-42eb-a84b-5d29592259a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:11:01 user nova-compute[75122]: DEBUG nova.compute.manager [req-26102522-425d-4b14-b2b5-e0408fd54e9e req-433eea6b-5910-416d-ae63-7ea01de74b02 service nova] [instance: 5bb980be-c2eb-42eb-a84b-5d29592259a4] No waiting events found dispatching network-vif-plugged-5dcdd286-bee6-43e0-96d4-a42d060b6158 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 10:11:01 user nova-compute[75122]: WARNING nova.compute.manager [req-26102522-425d-4b14-b2b5-e0408fd54e9e req-433eea6b-5910-416d-ae63-7ea01de74b02 service nova] [instance: 5bb980be-c2eb-42eb-a84b-5d29592259a4] Received unexpected event network-vif-plugged-5dcdd286-bee6-43e0-96d4-a42d060b6158 for instance with vm_state deleted and task_state None.
Nov 15 10:11:04 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:11:09 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:11:11 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:11:14 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:11:16 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:11:19 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:11:21 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:11:24 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:11:26 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:11:29 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:11:34 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:11:38 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:11:39 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:11:42 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:11:44 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:11:44 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:11:45 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:11:45 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:11:46 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:11:46 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:11:46 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:11:46 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:11:46 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.002s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:11:46 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75122) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 10:11:46 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75122) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 10:11:46 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75122) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 10:11:46 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 10:11:46 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 10:11:46 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Hypervisor/Node resource view: name=user free_ram=8842MB free_disk=25.15798568725586GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75122) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 10:11:46 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:11:46 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:11:46 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:11:46 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance 968c4c12-9c56-4bb5-9b98-d526c67cd7d7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 10:11:46 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance a534665a-90e4-47dc-b081-47a44a975b64 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 10:11:46 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75122) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 10:11:46 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75122) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 10:11:46 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Refreshing inventories for resource provider 69a3da65-47be-44c6-b67c-c692b58284ef {{(pid=75122) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 15 10:11:47 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Updating ProviderTree inventory for provider 69a3da65-47be-44c6-b67c-c692b58284ef from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 15 10:11:47 user nova-compute[75122]: DEBUG nova.compute.provider_tree [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Updating inventory in ProviderTree for provider 69a3da65-47be-44c6-b67c-c692b58284ef with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 15 10:11:47 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Refreshing aggregate associations for resource provider 69a3da65-47be-44c6-b67c-c692b58284ef, aggregates: None {{(pid=75122) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 15 10:11:47 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Refreshing trait associations for resource provider 69a3da65-47be-44c6-b67c-c692b58284ef, traits: COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_RESCUE_BFV,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE,COMPUTE_NODE,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_ACCELERATORS,HW_CPU_X86_MMX {{(pid=75122) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 15 10:11:47 user nova-compute[75122]: DEBUG nova.compute.provider_tree [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Inventory has not changed in ProviderTree for provider: 69a3da65-47be-44c6-b67c-c692b58284ef {{(pid=75122) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 10:11:47 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Inventory has not changed for provider 69a3da65-47be-44c6-b67c-c692b58284ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 10:11:47 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Compute_service record updated for user:user {{(pid=75122) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 10:11:47 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.508s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:11:47 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:11:47 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Cleaning up deleted instances {{(pid=75122) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 15 10:11:47 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] There are 0 instances to clean {{(pid=75122) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 15 10:11:47 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:11:49 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:11:49 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:11:51 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:11:52 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:11:53 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-d7badf38-454f-42c2-ad63-c7e8e8a8f3f3 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Acquiring lock "f9aeb7a5-24fd-4620-b316-0c7cf61a1300" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:11:53 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-d7badf38-454f-42c2-ad63-c7e8e8a8f3f3 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Lock "f9aeb7a5-24fd-4620-b316-0c7cf61a1300" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:11:53 user nova-compute[75122]: DEBUG nova.compute.manager [None req-d7badf38-454f-42c2-ad63-c7e8e8a8f3f3 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] [instance: f9aeb7a5-24fd-4620-b316-0c7cf61a1300] Starting instance... {{(pid=75122) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 10:11:53 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:11:53 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Starting heal instance info cache {{(pid=75122) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 10:11:53 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Rebuilding the list of instances to heal {{(pid=75122) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 10:11:53 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "refresh_cache-968c4c12-9c56-4bb5-9b98-d526c67cd7d7" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 10:11:53 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquired lock "refresh_cache-968c4c12-9c56-4bb5-9b98-d526c67cd7d7" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 10:11:53 user nova-compute[75122]: DEBUG nova.network.neutron [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] [instance: 968c4c12-9c56-4bb5-9b98-d526c67cd7d7] Forcefully refreshing network info cache for instance {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 10:11:53 user nova-compute[75122]: DEBUG nova.objects.instance [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lazy-loading 'info_cache' on Instance uuid 968c4c12-9c56-4bb5-9b98-d526c67cd7d7 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 10:11:53 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-d7badf38-454f-42c2-ad63-c7e8e8a8f3f3 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:11:53 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-d7badf38-454f-42c2-ad63-c7e8e8a8f3f3 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:11:53 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-d7badf38-454f-42c2-ad63-c7e8e8a8f3f3 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75122) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 10:11:53 user nova-compute[75122]: INFO nova.compute.claims [None req-d7badf38-454f-42c2-ad63-c7e8e8a8f3f3 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] [instance: f9aeb7a5-24fd-4620-b316-0c7cf61a1300] Claim successful on node user
Nov 15 10:11:53 user nova-compute[75122]: DEBUG nova.compute.provider_tree [None req-d7badf38-454f-42c2-ad63-c7e8e8a8f3f3 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Inventory has not changed in ProviderTree for provider: 69a3da65-47be-44c6-b67c-c692b58284ef {{(pid=75122) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 10:11:53 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-d7badf38-454f-42c2-ad63-c7e8e8a8f3f3 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Inventory has not changed for provider 69a3da65-47be-44c6-b67c-c692b58284ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 10:11:53 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-d7badf38-454f-42c2-ad63-c7e8e8a8f3f3 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.330s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:11:53 user nova-compute[75122]: DEBUG nova.compute.manager [None req-d7badf38-454f-42c2-ad63-c7e8e8a8f3f3 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] [instance: f9aeb7a5-24fd-4620-b316-0c7cf61a1300] Start building networks asynchronously for instance. {{(pid=75122) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 10:11:53 user nova-compute[75122]: DEBUG nova.compute.manager [None req-d7badf38-454f-42c2-ad63-c7e8e8a8f3f3 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] [instance: f9aeb7a5-24fd-4620-b316-0c7cf61a1300] Allocating IP information in the background. {{(pid=75122) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 10:11:53 user nova-compute[75122]: DEBUG nova.network.neutron [None req-d7badf38-454f-42c2-ad63-c7e8e8a8f3f3 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] [instance: f9aeb7a5-24fd-4620-b316-0c7cf61a1300] allocate_for_instance() {{(pid=75122) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 10:11:53 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-d7badf38-454f-42c2-ad63-c7e8e8a8f3f3 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] [instance: f9aeb7a5-24fd-4620-b316-0c7cf61a1300] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 10:11:53 user nova-compute[75122]: DEBUG nova.compute.manager [None req-d7badf38-454f-42c2-ad63-c7e8e8a8f3f3 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] [instance: f9aeb7a5-24fd-4620-b316-0c7cf61a1300] Start building block device mappings for instance. {{(pid=75122) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 10:11:53 user nova-compute[75122]: DEBUG nova.policy [None req-d7badf38-454f-42c2-ad63-c7e8e8a8f3f3 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f3f4814249ab42d399b77e5b8040ec8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098415c1690e46c39d52c0fee2719175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75122) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 10:11:53 user nova-compute[75122]: DEBUG nova.compute.manager [None req-d7badf38-454f-42c2-ad63-c7e8e8a8f3f3 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] [instance: f9aeb7a5-24fd-4620-b316-0c7cf61a1300] Start spawning the instance on the hypervisor. {{(pid=75122) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 10:11:53 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-d7badf38-454f-42c2-ad63-c7e8e8a8f3f3 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] [instance: f9aeb7a5-24fd-4620-b316-0c7cf61a1300] Creating instance directory {{(pid=75122) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 10:11:53 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-d7badf38-454f-42c2-ad63-c7e8e8a8f3f3 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] [instance: f9aeb7a5-24fd-4620-b316-0c7cf61a1300] Creating image(s)
Nov 15 10:11:53 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-d7badf38-454f-42c2-ad63-c7e8e8a8f3f3 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Acquiring lock "/opt/stack/data/nova/instances/f9aeb7a5-24fd-4620-b316-0c7cf61a1300/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:11:53 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-d7badf38-454f-42c2-ad63-c7e8e8a8f3f3 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Lock "/opt/stack/data/nova/instances/f9aeb7a5-24fd-4620-b316-0c7cf61a1300/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:11:53 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-d7badf38-454f-42c2-ad63-c7e8e8a8f3f3 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Lock "/opt/stack/data/nova/instances/f9aeb7a5-24fd-4620-b316-0c7cf61a1300/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:11:53 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-d7badf38-454f-42c2-ad63-c7e8e8a8f3f3 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Acquiring lock "1ff43eb9a6daef8ff8d90f20106ff538059dfdd5" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:11:53 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-d7badf38-454f-42c2-ad63-c7e8e8a8f3f3 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Lock "1ff43eb9a6daef8ff8d90f20106ff538059dfdd5" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:11:53 user nova-compute[75122]: DEBUG nova.network.neutron [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] [instance: 968c4c12-9c56-4bb5-9b98-d526c67cd7d7] Updating instance_info_cache with network_info: [{"id": "6a965453-1ab7-4987-bcfc-307d082e1e90", "address": "fa:16:3e:7a:69:23", "network": {"id": "03073971-5253-4f06-a46a-94840841fd6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2056706757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7941f36c30b49408ae5709a1b75346d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a965453-1a", "ovs_interfaceid": "6a965453-1ab7-4987-bcfc-307d082e1e90", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 10:11:53 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Releasing lock "refresh_cache-968c4c12-9c56-4bb5-9b98-d526c67cd7d7" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 10:11:53 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] [instance: 968c4c12-9c56-4bb5-9b98-d526c67cd7d7] Updated the network info_cache for instance {{(pid=75122) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 10:11:54 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-d7badf38-454f-42c2-ad63-c7e8e8a8f3f3 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1ff43eb9a6daef8ff8d90f20106ff538059dfdd5.part --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:11:54 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:11:54 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:11:54 user nova-compute[75122]: DEBUG nova.network.neutron [None req-d7badf38-454f-42c2-ad63-c7e8e8a8f3f3 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] [instance: f9aeb7a5-24fd-4620-b316-0c7cf61a1300] Successfully created port: 0deeb35a-47e5-44fe-843c-ed90df673a6b {{(pid=75122) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 10:11:54 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:11:54 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-d7badf38-454f-42c2-ad63-c7e8e8a8f3f3 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1ff43eb9a6daef8ff8d90f20106ff538059dfdd5.part --force-share --output=json" returned: 0 in 0.195s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:11:54 user nova-compute[75122]: DEBUG nova.virt.images [None req-d7badf38-454f-42c2-ad63-c7e8e8a8f3f3 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] 02d0adab-5e82-436a-9cd3-600747b978f4 was qcow2, converting to raw {{(pid=75122) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 15 10:11:54 user nova-compute[75122]: DEBUG nova.privsep.utils [None req-d7badf38-454f-42c2-ad63-c7e8e8a8f3f3 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75122) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 10:11:54 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-d7badf38-454f-42c2-ad63-c7e8e8a8f3f3 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/1ff43eb9a6daef8ff8d90f20106ff538059dfdd5.part /opt/stack/data/nova/instances/_base/1ff43eb9a6daef8ff8d90f20106ff538059dfdd5.converted {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:11:54 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-d7badf38-454f-42c2-ad63-c7e8e8a8f3f3 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/1ff43eb9a6daef8ff8d90f20106ff538059dfdd5.part /opt/stack/data/nova/instances/_base/1ff43eb9a6daef8ff8d90f20106ff538059dfdd5.converted" returned: 0 in 0.269s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:11:54 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-d7badf38-454f-42c2-ad63-c7e8e8a8f3f3 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1ff43eb9a6daef8ff8d90f20106ff538059dfdd5.converted --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:11:55 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:11:55 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-d7badf38-454f-42c2-ad63-c7e8e8a8f3f3 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1ff43eb9a6daef8ff8d90f20106ff538059dfdd5.converted --force-share --output=json" returned: 0 in 0.196s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:11:55 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-d7badf38-454f-42c2-ad63-c7e8e8a8f3f3 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Lock "1ff43eb9a6daef8ff8d90f20106ff538059dfdd5" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.352s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:11:55 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-d7badf38-454f-42c2-ad63-c7e8e8a8f3f3 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1ff43eb9a6daef8ff8d90f20106ff538059dfdd5 --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:11:55 user nova-compute[75122]: DEBUG nova.network.neutron [None req-d7badf38-454f-42c2-ad63-c7e8e8a8f3f3 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] [instance: f9aeb7a5-24fd-4620-b316-0c7cf61a1300] Successfully updated port: 0deeb35a-47e5-44fe-843c-ed90df673a6b {{(pid=75122) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 10:11:55 user nova-compute[75122]: DEBUG nova.compute.manager [req-6d6c0e3f-53d8-49c2-b8a6-25f6b9a15fc8 req-aa3cc03e-cf17-4801-84d3-91433ef66cbd service nova] [instance: f9aeb7a5-24fd-4620-b316-0c7cf61a1300] Received event network-changed-0deeb35a-47e5-44fe-843c-ed90df673a6b {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 10:11:55 user nova-compute[75122]: DEBUG nova.compute.manager [req-6d6c0e3f-53d8-49c2-b8a6-25f6b9a15fc8 req-aa3cc03e-cf17-4801-84d3-91433ef66cbd service nova] [instance: f9aeb7a5-24fd-4620-b316-0c7cf61a1300] Refreshing instance network info cache due to event network-changed-0deeb35a-47e5-44fe-843c-ed90df673a6b. {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 10:11:55 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-6d6c0e3f-53d8-49c2-b8a6-25f6b9a15fc8 req-aa3cc03e-cf17-4801-84d3-91433ef66cbd service nova] Acquiring lock "refresh_cache-f9aeb7a5-24fd-4620-b316-0c7cf61a1300" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 10:11:55 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-6d6c0e3f-53d8-49c2-b8a6-25f6b9a15fc8 req-aa3cc03e-cf17-4801-84d3-91433ef66cbd service nova] Acquired lock "refresh_cache-f9aeb7a5-24fd-4620-b316-0c7cf61a1300" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 10:11:55 user nova-compute[75122]: DEBUG nova.network.neutron [req-6d6c0e3f-53d8-49c2-b8a6-25f6b9a15fc8 req-aa3cc03e-cf17-4801-84d3-91433ef66cbd service nova] [instance: f9aeb7a5-24fd-4620-b316-0c7cf61a1300] Refreshing network info cache for port 0deeb35a-47e5-44fe-843c-ed90df673a6b {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 10:11:55 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-d7badf38-454f-42c2-ad63-c7e8e8a8f3f3 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Acquiring lock "refresh_cache-f9aeb7a5-24fd-4620-b316-0c7cf61a1300" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 10:11:55 user nova-compute[75122]: DEBUG nova.network.neutron [req-6d6c0e3f-53d8-49c2-b8a6-25f6b9a15fc8 req-aa3cc03e-cf17-4801-84d3-91433ef66cbd service nova] [instance: f9aeb7a5-24fd-4620-b316-0c7cf61a1300] Instance cache missing network info. {{(pid=75122) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 10:11:55 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-d7badf38-454f-42c2-ad63-c7e8e8a8f3f3 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1ff43eb9a6daef8ff8d90f20106ff538059dfdd5 --force-share --output=json" returned: 0 in 0.201s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:11:55 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-d7badf38-454f-42c2-ad63-c7e8e8a8f3f3 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Acquiring lock "1ff43eb9a6daef8ff8d90f20106ff538059dfdd5" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:11:55 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-d7badf38-454f-42c2-ad63-c7e8e8a8f3f3 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Lock "1ff43eb9a6daef8ff8d90f20106ff538059dfdd5" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:11:55 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-d7badf38-454f-42c2-ad63-c7e8e8a8f3f3 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1ff43eb9a6daef8ff8d90f20106ff538059dfdd5 --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:11:55 user nova-compute[75122]: DEBUG nova.network.neutron [req-6d6c0e3f-53d8-49c2-b8a6-25f6b9a15fc8 req-aa3cc03e-cf17-4801-84d3-91433ef66cbd service nova] [instance: f9aeb7a5-24fd-4620-b316-0c7cf61a1300] Updating instance_info_cache with network_info: [] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 10:11:55 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-6d6c0e3f-53d8-49c2-b8a6-25f6b9a15fc8 req-aa3cc03e-cf17-4801-84d3-91433ef66cbd service nova] Releasing lock "refresh_cache-f9aeb7a5-24fd-4620-b316-0c7cf61a1300" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 10:11:55 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-d7badf38-454f-42c2-ad63-c7e8e8a8f3f3 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Acquired lock "refresh_cache-f9aeb7a5-24fd-4620-b316-0c7cf61a1300" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 10:11:55 user nova-compute[75122]: DEBUG nova.network.neutron [None req-d7badf38-454f-42c2-ad63-c7e8e8a8f3f3 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] [instance: f9aeb7a5-24fd-4620-b316-0c7cf61a1300] Building network info cache for instance {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 10:11:55 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-d7badf38-454f-42c2-ad63-c7e8e8a8f3f3 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1ff43eb9a6daef8ff8d90f20106ff538059dfdd5 --force-share --output=json" returned: 0 in 0.181s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:11:55 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-d7badf38-454f-42c2-ad63-c7e8e8a8f3f3 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1ff43eb9a6daef8ff8d90f20106ff538059dfdd5,backing_fmt=raw /opt/stack/data/nova/instances/f9aeb7a5-24fd-4620-b316-0c7cf61a1300/disk 1073741824 {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:11:55 user nova-compute[75122]: DEBUG nova.network.neutron [None req-d7badf38-454f-42c2-ad63-c7e8e8a8f3f3 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] [instance: f9aeb7a5-24fd-4620-b316-0c7cf61a1300] Instance cache missing network info. {{(pid=75122) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 10:11:55 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-d7badf38-454f-42c2-ad63-c7e8e8a8f3f3 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1ff43eb9a6daef8ff8d90f20106ff538059dfdd5,backing_fmt=raw /opt/stack/data/nova/instances/f9aeb7a5-24fd-4620-b316-0c7cf61a1300/disk 1073741824" returned: 0 in 0.052s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:11:55 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-d7badf38-454f-42c2-ad63-c7e8e8a8f3f3 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Lock "1ff43eb9a6daef8ff8d90f20106ff538059dfdd5" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.237s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:11:55 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-d7badf38-454f-42c2-ad63-c7e8e8a8f3f3 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1ff43eb9a6daef8ff8d90f20106ff538059dfdd5 --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:11:55 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-d7badf38-454f-42c2-ad63-c7e8e8a8f3f3 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1ff43eb9a6daef8ff8d90f20106ff538059dfdd5 --force-share --output=json" returned: 0 in 0.179s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:11:55 user nova-compute[75122]: DEBUG nova.virt.disk.api [None req-d7badf38-454f-42c2-ad63-c7e8e8a8f3f3 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f9aeb7a5-24fd-4620-b316-0c7cf61a1300/disk. size=1073741824 {{(pid=75122) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 10:11:55 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-d7badf38-454f-42c2-ad63-c7e8e8a8f3f3 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9aeb7a5-24fd-4620-b316-0c7cf61a1300/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:11:55 user nova-compute[75122]: DEBUG nova.network.neutron [None req-d7badf38-454f-42c2-ad63-c7e8e8a8f3f3 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] [instance: f9aeb7a5-24fd-4620-b316-0c7cf61a1300] Updating instance_info_cache with network_info: [{"id": "0deeb35a-47e5-44fe-843c-ed90df673a6b", "address": "fa:16:3e:1e:19:79", "network": {"id": "25afb78c-30e1-4fd7-a215-b5e73ba43057", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2008775745-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "098415c1690e46c39d52c0fee2719175", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0deeb35a-47", "ovs_interfaceid": "0deeb35a-47e5-44fe-843c-ed90df673a6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 10:11:55 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-d7badf38-454f-42c2-ad63-c7e8e8a8f3f3 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Releasing lock "refresh_cache-f9aeb7a5-24fd-4620-b316-0c7cf61a1300" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 10:11:55 user nova-compute[75122]: DEBUG nova.compute.manager [None req-d7badf38-454f-42c2-ad63-c7e8e8a8f3f3 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] [instance: f9aeb7a5-24fd-4620-b316-0c7cf61a1300] Instance network_info: |[{"id": "0deeb35a-47e5-44fe-843c-ed90df673a6b", "address": "fa:16:3e:1e:19:79", "network": {"id": "25afb78c-30e1-4fd7-a215-b5e73ba43057", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2008775745-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "098415c1690e46c39d52c0fee2719175", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0deeb35a-47", "ovs_interfaceid": "0deeb35a-47e5-44fe-843c-ed90df673a6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75122) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 10:11:56 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-d7badf38-454f-42c2-ad63-c7e8e8a8f3f3 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9aeb7a5-24fd-4620-b316-0c7cf61a1300/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:11:56 user nova-compute[75122]: DEBUG nova.virt.disk.api [None req-d7badf38-454f-42c2-ad63-c7e8e8a8f3f3 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Cannot resize image /opt/stack/data/nova/instances/f9aeb7a5-24fd-4620-b316-0c7cf61a1300/disk to a smaller size. {{(pid=75122) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 10:11:56 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-d7badf38-454f-42c2-ad63-c7e8e8a8f3f3 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] [instance: f9aeb7a5-24fd-4620-b316-0c7cf61a1300] Created local disks {{(pid=75122) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 10:11:56 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-d7badf38-454f-42c2-ad63-c7e8e8a8f3f3 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] [instance: f9aeb7a5-24fd-4620-b316-0c7cf61a1300] Ensure instance console log exists: /opt/stack/data/nova/instances/f9aeb7a5-24fd-4620-b316-0c7cf61a1300/console.log {{(pid=75122) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 10:11:56 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-d7badf38-454f-42c2-ad63-c7e8e8a8f3f3 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:11:56 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-d7badf38-454f-42c2-ad63-c7e8e8a8f3f3 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:11:56 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-d7badf38-454f-42c2-ad63-c7e8e8a8f3f3 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:11:56 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-d7badf38-454f-42c2-ad63-c7e8e8a8f3f3 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] [instance: f9aeb7a5-24fd-4620-b316-0c7cf61a1300] Start _get_guest_xml network_info=[{"id": "0deeb35a-47e5-44fe-843c-ed90df673a6b", "address": "fa:16:3e:1e:19:79", "network": {"id": "25afb78c-30e1-4fd7-a215-b5e73ba43057", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2008775745-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "098415c1690e46c39d52c0fee2719175", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0deeb35a-47", "ovs_interfaceid": "0deeb35a-47e5-44fe-843c-ed90df673a6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T10:11:50Z,direct_url=<?>,disk_format='qcow2',id=02d0adab-5e82-436a-9cd3-600747b978f4,min_disk=0,min_ram=0,name='tempest-scenario-img--512950164',owner='098415c1690e46c39d52c0fee2719175',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T10:11:52Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '02d0adab-5e82-436a-9cd3-600747b978f4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75122) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 10:11:56 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-d7badf38-454f-42c2-ad63-c7e8e8a8f3f3 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 10:11:56 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-d7badf38-454f-42c2-ad63-c7e8e8a8f3f3 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 10:11:56 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-d7badf38-454f-42c2-ad63-c7e8e8a8f3f3 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75122) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 10:11:56 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-d7badf38-454f-42c2-ad63-c7e8e8a8f3f3 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] CPU controller missing on host. {{(pid=75122) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 10:11:56 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-d7badf38-454f-42c2-ad63-c7e8e8a8f3f3 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75122) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 10:11:56 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-d7badf38-454f-42c2-ad63-c7e8e8a8f3f3 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] CPU controller found on host. {{(pid=75122) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 10:11:56 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-d7badf38-454f-42c2-ad63-c7e8e8a8f3f3 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75122) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 10:11:56 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-d7badf38-454f-42c2-ad63-c7e8e8a8f3f3 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T09:26:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T10:11:50Z,direct_url=<?>,disk_format='qcow2',id=02d0adab-5e82-436a-9cd3-600747b978f4,min_disk=0,min_ram=0,name='tempest-scenario-img--512950164',owner='098415c1690e46c39d52c0fee2719175',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T10:11:52Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 10:11:56 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-d7badf38-454f-42c2-ad63-c7e8e8a8f3f3 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Flavor limits 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 10:11:56 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-d7badf38-454f-42c2-ad63-c7e8e8a8f3f3 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Image limits 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 10:11:56 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-d7badf38-454f-42c2-ad63-c7e8e8a8f3f3 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Flavor pref 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 10:11:56 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-d7badf38-454f-42c2-ad63-c7e8e8a8f3f3 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Image pref 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 10:11:56 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-d7badf38-454f-42c2-ad63-c7e8e8a8f3f3 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 10:11:56 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-d7badf38-454f-42c2-ad63-c7e8e8a8f3f3 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 10:11:56 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-d7badf38-454f-42c2-ad63-c7e8e8a8f3f3 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75122) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 10:11:56 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-d7badf38-454f-42c2-ad63-c7e8e8a8f3f3 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Got 1 possible topologies {{(pid=75122) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 10:11:56 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-d7badf38-454f-42c2-ad63-c7e8e8a8f3f3 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 10:11:56 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-d7badf38-454f-42c2-ad63-c7e8e8a8f3f3 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 10:11:56 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-d7badf38-454f-42c2-ad63-c7e8e8a8f3f3 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T10:11:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-812380502',display_name='tempest-TestMinimumBasicScenario-server-812380502',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-812380502',id=51,image_ref='02d0adab-5e82-436a-9cd3-600747b978f4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHfJyCffkl4NUz9yhB8dcWwiE0TpZ4ni7aEudvjypqUXSPGrXr6WQ3j8fmAVohqqgwzb7kLVCC9xi7QRRWiHP0aiWrfZnwjyt08+MD7x45ML53V8AoefdnGpsiXlJlkf6Q==',key_name='tempest-TestMinimumBasicScenario-65289387',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='098415c1690e46c39d52c0fee2719175',ramdisk_id='',reservation_id='r-d1k6umut',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='02d0adab-5e82-436a-9cd3-600747b978f4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1402308121',owner_user_name='tempest-TestMinimumBasicScenario-1402308121-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T10:11:54Z,user_data=None,user_id='f3f4814249ab42d399b77e5b8040ec8b',uuid=f9aeb7a5-24fd-4620-b316-0c7cf61a1300,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0deeb35a-47e5-44fe-843c-ed90df673a6b", "address": "fa:16:3e:1e:19:79", "network": {"id": "25afb78c-30e1-4fd7-a215-b5e73ba43057", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2008775745-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "098415c1690e46c39d52c0fee2719175", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0deeb35a-47", "ovs_interfaceid": "0deeb35a-47e5-44fe-843c-ed90df673a6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75122) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 10:11:56 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-d7badf38-454f-42c2-ad63-c7e8e8a8f3f3 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Converting VIF {"id": "0deeb35a-47e5-44fe-843c-ed90df673a6b", "address": "fa:16:3e:1e:19:79", "network": {"id": "25afb78c-30e1-4fd7-a215-b5e73ba43057", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2008775745-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "098415c1690e46c39d52c0fee2719175", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0deeb35a-47", "ovs_interfaceid": "0deeb35a-47e5-44fe-843c-ed90df673a6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 10:11:56 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-d7badf38-454f-42c2-ad63-c7e8e8a8f3f3 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:19:79,bridge_name='br-int',has_traffic_filtering=True,id=0deeb35a-47e5-44fe-843c-ed90df673a6b,network=Network(25afb78c-30e1-4fd7-a215-b5e73ba43057),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0deeb35a-47') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 10:11:56 user nova-compute[75122]: DEBUG nova.objects.instance [None req-d7badf38-454f-42c2-ad63-c7e8e8a8f3f3 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Lazy-loading 'pci_devices' on Instance uuid f9aeb7a5-24fd-4620-b316-0c7cf61a1300 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 10:11:56 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-d7badf38-454f-42c2-ad63-c7e8e8a8f3f3 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] [instance: f9aeb7a5-24fd-4620-b316-0c7cf61a1300] End _get_guest_xml xml=<domain type="kvm">
Nov 15 10:11:56 user nova-compute[75122]:   <uuid>f9aeb7a5-24fd-4620-b316-0c7cf61a1300</uuid>
Nov 15 10:11:56 user nova-compute[75122]:   <name>instance-00000033</name>
Nov 15 10:11:56 user nova-compute[75122]:   <memory>524288</memory>
Nov 15 10:11:56 user nova-compute[75122]:   <vcpu>1</vcpu>
Nov 15 10:11:56 user nova-compute[75122]:   <metadata>
Nov 15 10:11:56 user nova-compute[75122]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 10:11:56 user nova-compute[75122]:       <nova:package version="0.0.0"/>
Nov 15 10:11:56 user nova-compute[75122]:       <nova:name>tempest-TestMinimumBasicScenario-server-812380502</nova:name>
Nov 15 10:11:56 user nova-compute[75122]:       <nova:creationTime>2023-11-15 10:11:56</nova:creationTime>
Nov 15 10:11:56 user nova-compute[75122]:       <nova:flavor name="m1.tiny">
Nov 15 10:11:56 user nova-compute[75122]:         <nova:memory>512</nova:memory>
Nov 15 10:11:56 user nova-compute[75122]:         <nova:disk>1</nova:disk>
Nov 15 10:11:56 user nova-compute[75122]:         <nova:swap>0</nova:swap>
Nov 15 10:11:56 user nova-compute[75122]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 10:11:56 user nova-compute[75122]:         <nova:vcpus>1</nova:vcpus>
Nov 15 10:11:56 user nova-compute[75122]:       </nova:flavor>
Nov 15 10:11:56 user nova-compute[75122]:       <nova:owner>
Nov 15 10:11:56 user nova-compute[75122]:         <nova:user uuid="f3f4814249ab42d399b77e5b8040ec8b">tempest-TestMinimumBasicScenario-1402308121-project-member</nova:user>
Nov 15 10:11:56 user nova-compute[75122]:         <nova:project uuid="098415c1690e46c39d52c0fee2719175">tempest-TestMinimumBasicScenario-1402308121</nova:project>
Nov 15 10:11:56 user nova-compute[75122]:       </nova:owner>
Nov 15 10:11:56 user nova-compute[75122]:       <nova:root type="image" uuid="02d0adab-5e82-436a-9cd3-600747b978f4"/>
Nov 15 10:11:56 user nova-compute[75122]:       <nova:ports>
Nov 15 10:11:56 user nova-compute[75122]:         <nova:port uuid="0deeb35a-47e5-44fe-843c-ed90df673a6b">
Nov 15 10:11:56 user nova-compute[75122]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 15 10:11:56 user nova-compute[75122]:         </nova:port>
Nov 15 10:11:56 user nova-compute[75122]:       </nova:ports>
Nov 15 10:11:56 user nova-compute[75122]:     </nova:instance>
Nov 15 10:11:56 user nova-compute[75122]:   </metadata>
Nov 15 10:11:56 user nova-compute[75122]:   <sysinfo type="smbios">
Nov 15 10:11:56 user nova-compute[75122]:     <system>
Nov 15 10:11:56 user nova-compute[75122]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 10:11:56 user nova-compute[75122]:       <entry name="product">OpenStack Nova</entry>
Nov 15 10:11:56 user nova-compute[75122]:       <entry name="version">0.0.0</entry>
Nov 15 10:11:56 user nova-compute[75122]:       <entry name="serial">f9aeb7a5-24fd-4620-b316-0c7cf61a1300</entry>
Nov 15 10:11:56 user nova-compute[75122]:       <entry name="uuid">f9aeb7a5-24fd-4620-b316-0c7cf61a1300</entry>
Nov 15 10:11:56 user nova-compute[75122]:       <entry name="family">Virtual Machine</entry>
Nov 15 10:11:56 user nova-compute[75122]:     </system>
Nov 15 10:11:56 user nova-compute[75122]:   </sysinfo>
Nov 15 10:11:56 user nova-compute[75122]:   <os>
Nov 15 10:11:56 user nova-compute[75122]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 10:11:56 user nova-compute[75122]:     <boot dev="hd"/>
Nov 15 10:11:56 user nova-compute[75122]:     <smbios mode="sysinfo"/>
Nov 15 10:11:56 user nova-compute[75122]:   </os>
Nov 15 10:11:56 user nova-compute[75122]:   <features>
Nov 15 10:11:56 user nova-compute[75122]:     <acpi/>
Nov 15 10:11:56 user nova-compute[75122]:     <apic/>
Nov 15 10:11:56 user nova-compute[75122]:     <vmcoreinfo/>
Nov 15 10:11:56 user nova-compute[75122]:   </features>
Nov 15 10:11:56 user nova-compute[75122]:   <clock offset="utc">
Nov 15 10:11:56 user nova-compute[75122]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 10:11:56 user nova-compute[75122]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 10:11:56 user nova-compute[75122]:     <timer name="hpet" present="no"/>
Nov 15 10:11:56 user nova-compute[75122]:   </clock>
Nov 15 10:11:56 user nova-compute[75122]:   <cpu mode="custom" match="exact">
Nov 15 10:11:56 user nova-compute[75122]:     <model>Nehalem</model>
Nov 15 10:11:56 user nova-compute[75122]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 10:11:56 user nova-compute[75122]:   </cpu>
Nov 15 10:11:56 user nova-compute[75122]:   <devices>
Nov 15 10:11:56 user nova-compute[75122]:     <disk type="file" device="disk">
Nov 15 10:11:56 user nova-compute[75122]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 10:11:56 user nova-compute[75122]:       <source file="/opt/stack/data/nova/instances/f9aeb7a5-24fd-4620-b316-0c7cf61a1300/disk"/>
Nov 15 10:11:56 user nova-compute[75122]:       <target dev="vda" bus="virtio"/>
Nov 15 10:11:56 user nova-compute[75122]:     </disk>
Nov 15 10:11:56 user nova-compute[75122]:     <interface type="ethernet">
Nov 15 10:11:56 user nova-compute[75122]:       <mac address="fa:16:3e:1e:19:79"/>
Nov 15 10:11:56 user nova-compute[75122]:       <model type="virtio"/>
Nov 15 10:11:56 user nova-compute[75122]:       <mtu size="1442"/>
Nov 15 10:11:56 user nova-compute[75122]:       <target dev="tap0deeb35a-47"/>
Nov 15 10:11:56 user nova-compute[75122]:     </interface>
Nov 15 10:11:56 user nova-compute[75122]:     <serial type="pty">
Nov 15 10:11:56 user nova-compute[75122]:       <log file="/opt/stack/data/nova/instances/f9aeb7a5-24fd-4620-b316-0c7cf61a1300/console.log" append="off"/>
Nov 15 10:11:56 user nova-compute[75122]:     </serial>
Nov 15 10:11:56 user nova-compute[75122]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 10:11:56 user nova-compute[75122]:     <video>
Nov 15 10:11:56 user nova-compute[75122]:       <model type="virtio"/>
Nov 15 10:11:56 user nova-compute[75122]:     </video>
Nov 15 10:11:56 user nova-compute[75122]:     <rng model="virtio">
Nov 15 10:11:56 user nova-compute[75122]:       <backend model="random">/dev/urandom</backend>
Nov 15 10:11:56 user nova-compute[75122]:     </rng>
Nov 15 10:11:56 user nova-compute[75122]:     <controller type="usb" index="0" model="none"/>
Nov 15 10:11:56 user nova-compute[75122]:     <memballoon model="virtio">
Nov 15 10:11:56 user nova-compute[75122]:       <stats period="10"/>
Nov 15 10:11:56 user nova-compute[75122]:     </memballoon>
Nov 15 10:11:56 user nova-compute[75122]:   </devices>
Nov 15 10:11:56 user nova-compute[75122]: </domain>
Nov 15 10:11:56 user nova-compute[75122]:  {{(pid=75122) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 10:11:56 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-d7badf38-454f-42c2-ad63-c7e8e8a8f3f3 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T10:11:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-812380502',display_name='tempest-TestMinimumBasicScenario-server-812380502',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-812380502',id=51,image_ref='02d0adab-5e82-436a-9cd3-600747b978f4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHfJyCffkl4NUz9yhB8dcWwiE0TpZ4ni7aEudvjypqUXSPGrXr6WQ3j8fmAVohqqgwzb7kLVCC9xi7QRRWiHP0aiWrfZnwjyt08+MD7x45ML53V8AoefdnGpsiXlJlkf6Q==',key_name='tempest-TestMinimumBasicScenario-65289387',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='098415c1690e46c39d52c0fee2719175',ramdisk_id='',reservation_id='r-d1k6umut',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='02d0adab-5e82-436a-9cd3-600747b978f4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1402308121',owner_user_name='tempest-TestMinimumBasicScenario-1402308121-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T10:11:54Z,user_data=None,user_id='f3f4814249ab42d399b77e5b8040ec8b',uuid=f9aeb7a5-24fd-4620-b316-0c7cf61a1300,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0deeb35a-47e5-44fe-843c-ed90df673a6b", "address": "fa:16:3e:1e:19:79", "network": {"id": "25afb78c-30e1-4fd7-a215-b5e73ba43057", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2008775745-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "098415c1690e46c39d52c0fee2719175", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0deeb35a-47", "ovs_interfaceid": "0deeb35a-47e5-44fe-843c-ed90df673a6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 10:11:56 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-d7badf38-454f-42c2-ad63-c7e8e8a8f3f3 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Converting VIF {"id": "0deeb35a-47e5-44fe-843c-ed90df673a6b", "address": "fa:16:3e:1e:19:79", "network": {"id": "25afb78c-30e1-4fd7-a215-b5e73ba43057", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2008775745-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "098415c1690e46c39d52c0fee2719175", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0deeb35a-47", "ovs_interfaceid": "0deeb35a-47e5-44fe-843c-ed90df673a6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 10:11:56 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-d7badf38-454f-42c2-ad63-c7e8e8a8f3f3 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:19:79,bridge_name='br-int',has_traffic_filtering=True,id=0deeb35a-47e5-44fe-843c-ed90df673a6b,network=Network(25afb78c-30e1-4fd7-a215-b5e73ba43057),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0deeb35a-47') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 10:11:56 user nova-compute[75122]: DEBUG os_vif [None req-d7badf38-454f-42c2-ad63-c7e8e8a8f3f3 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:19:79,bridge_name='br-int',has_traffic_filtering=True,id=0deeb35a-47e5-44fe-843c-ed90df673a6b,network=Network(25afb78c-30e1-4fd7-a215-b5e73ba43057),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0deeb35a-47') {{(pid=75122) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 10:11:56 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:11:56 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 10:11:56 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 10:11:56 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:11:56 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '44441b24-3be9-5f2b-9326-f7a69075e85a', '_type': 'linux-noop'}}, row=False) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 10:11:56 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:11:56 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:11:56 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:11:56 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0deeb35a-47, may_exist=True, interface_attrs={}) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 10:11:56 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0deeb35a-47, col_values=(('qos', UUID('6911776f-29bd-4314-b727-44afdde0144d')),), if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 10:11:56 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0deeb35a-47, col_values=(('external_ids', {'iface-id': '0deeb35a-47e5-44fe-843c-ed90df673a6b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1e:19:79', 'vm-uuid': 'f9aeb7a5-24fd-4620-b316-0c7cf61a1300'}),), if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 10:11:56 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:11:56 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:11:56 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:11:56 user nova-compute[75122]: INFO os_vif [None req-d7badf38-454f-42c2-ad63-c7e8e8a8f3f3 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:19:79,bridge_name='br-int',has_traffic_filtering=True,id=0deeb35a-47e5-44fe-843c-ed90df673a6b,network=Network(25afb78c-30e1-4fd7-a215-b5e73ba43057),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0deeb35a-47')
Nov 15 10:11:56 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-d7badf38-454f-42c2-ad63-c7e8e8a8f3f3 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] No BDM found with device name vda, not building metadata. {{(pid=75122) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 10:11:56 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-d7badf38-454f-42c2-ad63-c7e8e8a8f3f3 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] No VIF found with MAC fa:16:3e:1e:19:79, not building metadata {{(pid=75122) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 10:11:56 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:11:56 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75122) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 10:11:56 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:11:57 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:11:57 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:11:57 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:11:57 user nova-compute[75122]: DEBUG nova.compute.manager [req-fae931d2-76fc-4082-af4d-a8d368545909 req-22599af5-6480-4d45-ac8f-a2151a80d91b service nova] [instance: f9aeb7a5-24fd-4620-b316-0c7cf61a1300] Received event network-vif-plugged-0deeb35a-47e5-44fe-843c-ed90df673a6b {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 10:11:57 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-fae931d2-76fc-4082-af4d-a8d368545909 req-22599af5-6480-4d45-ac8f-a2151a80d91b service nova] Acquiring lock "f9aeb7a5-24fd-4620-b316-0c7cf61a1300-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:11:57 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-fae931d2-76fc-4082-af4d-a8d368545909 req-22599af5-6480-4d45-ac8f-a2151a80d91b service nova] Lock "f9aeb7a5-24fd-4620-b316-0c7cf61a1300-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:11:57 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-fae931d2-76fc-4082-af4d-a8d368545909 req-22599af5-6480-4d45-ac8f-a2151a80d91b service nova] Lock "f9aeb7a5-24fd-4620-b316-0c7cf61a1300-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:11:57 user nova-compute[75122]: DEBUG nova.compute.manager [req-fae931d2-76fc-4082-af4d-a8d368545909 req-22599af5-6480-4d45-ac8f-a2151a80d91b service nova] [instance: f9aeb7a5-24fd-4620-b316-0c7cf61a1300] No waiting events found dispatching network-vif-plugged-0deeb35a-47e5-44fe-843c-ed90df673a6b {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 10:11:57 user nova-compute[75122]: WARNING nova.compute.manager [req-fae931d2-76fc-4082-af4d-a8d368545909 req-22599af5-6480-4d45-ac8f-a2151a80d91b service nova] [instance: f9aeb7a5-24fd-4620-b316-0c7cf61a1300] Received unexpected event network-vif-plugged-0deeb35a-47e5-44fe-843c-ed90df673a6b for instance with vm_state building and task_state spawning.
Nov 15 10:11:58 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:11:58 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:11:58 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:11:59 user nova-compute[75122]: DEBUG nova.compute.manager [None req-d7badf38-454f-42c2-ad63-c7e8e8a8f3f3 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] [instance: f9aeb7a5-24fd-4620-b316-0c7cf61a1300] Instance event wait completed in 0 seconds for  {{(pid=75122) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 10:11:59 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-d7badf38-454f-42c2-ad63-c7e8e8a8f3f3 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] [instance: f9aeb7a5-24fd-4620-b316-0c7cf61a1300] Guest created on hypervisor {{(pid=75122) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 10:11:59 user nova-compute[75122]: INFO nova.virt.libvirt.driver [-] [instance: f9aeb7a5-24fd-4620-b316-0c7cf61a1300] Instance spawned successfully.
Nov 15 10:11:59 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-d7badf38-454f-42c2-ad63-c7e8e8a8f3f3 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] [instance: f9aeb7a5-24fd-4620-b316-0c7cf61a1300] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 10:11:59 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-d7badf38-454f-42c2-ad63-c7e8e8a8f3f3 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] [instance: f9aeb7a5-24fd-4620-b316-0c7cf61a1300] Found default for hw_cdrom_bus of ide {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 10:11:59 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-d7badf38-454f-42c2-ad63-c7e8e8a8f3f3 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] [instance: f9aeb7a5-24fd-4620-b316-0c7cf61a1300] Found default for hw_disk_bus of virtio {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 10:11:59 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-d7badf38-454f-42c2-ad63-c7e8e8a8f3f3 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] [instance: f9aeb7a5-24fd-4620-b316-0c7cf61a1300] Found default for hw_input_bus of None {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 10:11:59 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-d7badf38-454f-42c2-ad63-c7e8e8a8f3f3 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] [instance: f9aeb7a5-24fd-4620-b316-0c7cf61a1300] Found default for hw_pointer_model of None {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 10:11:59 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-d7badf38-454f-42c2-ad63-c7e8e8a8f3f3 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] [instance: f9aeb7a5-24fd-4620-b316-0c7cf61a1300] Found default for hw_video_model of virtio {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 10:11:59 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-d7badf38-454f-42c2-ad63-c7e8e8a8f3f3 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] [instance: f9aeb7a5-24fd-4620-b316-0c7cf61a1300] Found default for hw_vif_model of virtio {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 10:11:59 user nova-compute[75122]: DEBUG nova.compute.manager [req-736b589a-b2f0-4c87-9d9b-598a0a48369d req-a7888a36-07e8-4e6c-94ce-569f35cb2c68 service nova] [instance: f9aeb7a5-24fd-4620-b316-0c7cf61a1300] Received event network-vif-plugged-0deeb35a-47e5-44fe-843c-ed90df673a6b {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 10:11:59 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-736b589a-b2f0-4c87-9d9b-598a0a48369d req-a7888a36-07e8-4e6c-94ce-569f35cb2c68 service nova] Acquiring lock "f9aeb7a5-24fd-4620-b316-0c7cf61a1300-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:11:59 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-736b589a-b2f0-4c87-9d9b-598a0a48369d req-a7888a36-07e8-4e6c-94ce-569f35cb2c68 service nova] Lock "f9aeb7a5-24fd-4620-b316-0c7cf61a1300-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:11:59 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-736b589a-b2f0-4c87-9d9b-598a0a48369d req-a7888a36-07e8-4e6c-94ce-569f35cb2c68 service nova] Lock "f9aeb7a5-24fd-4620-b316-0c7cf61a1300-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:11:59 user nova-compute[75122]: DEBUG nova.compute.manager [req-736b589a-b2f0-4c87-9d9b-598a0a48369d req-a7888a36-07e8-4e6c-94ce-569f35cb2c68 service nova] [instance: f9aeb7a5-24fd-4620-b316-0c7cf61a1300] No waiting events found dispatching network-vif-plugged-0deeb35a-47e5-44fe-843c-ed90df673a6b {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 10:11:59 user nova-compute[75122]: WARNING nova.compute.manager [req-736b589a-b2f0-4c87-9d9b-598a0a48369d req-a7888a36-07e8-4e6c-94ce-569f35cb2c68 service nova] [instance: f9aeb7a5-24fd-4620-b316-0c7cf61a1300] Received unexpected event network-vif-plugged-0deeb35a-47e5-44fe-843c-ed90df673a6b for instance with vm_state building and task_state spawning.
Nov 15 10:11:59 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:11:59 user nova-compute[75122]: INFO nova.compute.manager [None req-d7badf38-454f-42c2-ad63-c7e8e8a8f3f3 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] [instance: f9aeb7a5-24fd-4620-b316-0c7cf61a1300] Took 6.02 seconds to spawn the instance on the hypervisor.
Nov 15 10:11:59 user nova-compute[75122]: DEBUG nova.compute.manager [None req-d7badf38-454f-42c2-ad63-c7e8e8a8f3f3 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] [instance: f9aeb7a5-24fd-4620-b316-0c7cf61a1300] Checking state {{(pid=75122) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 10:11:59 user nova-compute[75122]: INFO nova.compute.manager [None req-d7badf38-454f-42c2-ad63-c7e8e8a8f3f3 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] [instance: f9aeb7a5-24fd-4620-b316-0c7cf61a1300] Took 6.71 seconds to build instance.
Nov 15 10:11:59 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-d7badf38-454f-42c2-ad63-c7e8e8a8f3f3 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Lock "f9aeb7a5-24fd-4620-b316-0c7cf61a1300" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.818s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:12:01 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:12:01 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:12:06 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:12:06 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:12:07 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:12:07 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75122) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 15 10:12:11 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:12:16 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:12:16 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:12:21 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:12:21 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:12:26 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:12:26 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:12:31 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:12:31 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:12:36 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:12:37 user nova-compute[75122]: DEBUG nova.compute.manager [req-485be187-51b6-453e-a3de-0f270b6f8d5f req-7cb12f84-4ec0-41d5-b193-b5ebf60f2d26 service nova] [instance: a534665a-90e4-47dc-b081-47a44a975b64] Received event network-changed-ba4e0f89-75c3-4eeb-8b28-4ea10bb61909 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 10:12:37 user nova-compute[75122]: DEBUG nova.compute.manager [req-485be187-51b6-453e-a3de-0f270b6f8d5f req-7cb12f84-4ec0-41d5-b193-b5ebf60f2d26 service nova] [instance: a534665a-90e4-47dc-b081-47a44a975b64] Refreshing instance network info cache due to event network-changed-ba4e0f89-75c3-4eeb-8b28-4ea10bb61909. {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 10:12:37 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-485be187-51b6-453e-a3de-0f270b6f8d5f req-7cb12f84-4ec0-41d5-b193-b5ebf60f2d26 service nova] Acquiring lock "refresh_cache-a534665a-90e4-47dc-b081-47a44a975b64" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 10:12:37 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-485be187-51b6-453e-a3de-0f270b6f8d5f req-7cb12f84-4ec0-41d5-b193-b5ebf60f2d26 service nova] Acquired lock "refresh_cache-a534665a-90e4-47dc-b081-47a44a975b64" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 10:12:37 user nova-compute[75122]: DEBUG nova.network.neutron [req-485be187-51b6-453e-a3de-0f270b6f8d5f req-7cb12f84-4ec0-41d5-b193-b5ebf60f2d26 service nova] [instance: a534665a-90e4-47dc-b081-47a44a975b64] Refreshing network info cache for port ba4e0f89-75c3-4eeb-8b28-4ea10bb61909 {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 10:12:38 user nova-compute[75122]: DEBUG nova.network.neutron [req-485be187-51b6-453e-a3de-0f270b6f8d5f req-7cb12f84-4ec0-41d5-b193-b5ebf60f2d26 service nova] [instance: a534665a-90e4-47dc-b081-47a44a975b64] Updated VIF entry in instance network info cache for port ba4e0f89-75c3-4eeb-8b28-4ea10bb61909. {{(pid=75122) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 10:12:38 user nova-compute[75122]: DEBUG nova.network.neutron [req-485be187-51b6-453e-a3de-0f270b6f8d5f req-7cb12f84-4ec0-41d5-b193-b5ebf60f2d26 service nova] [instance: a534665a-90e4-47dc-b081-47a44a975b64] Updating instance_info_cache with network_info: [{"id": "ba4e0f89-75c3-4eeb-8b28-4ea10bb61909", "address": "fa:16:3e:af:8a:69", "network": {"id": "03073971-5253-4f06-a46a-94840841fd6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2056706757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7941f36c30b49408ae5709a1b75346d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba4e0f89-75", "ovs_interfaceid": "ba4e0f89-75c3-4eeb-8b28-4ea10bb61909", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 10:12:38 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-485be187-51b6-453e-a3de-0f270b6f8d5f req-7cb12f84-4ec0-41d5-b193-b5ebf60f2d26 service nova] Releasing lock "refresh_cache-a534665a-90e4-47dc-b081-47a44a975b64" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 10:12:38 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:12:39 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-1fa18097-1fb9-4c98-89db-5314a434a192 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Acquiring lock "a534665a-90e4-47dc-b081-47a44a975b64" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:12:39 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-1fa18097-1fb9-4c98-89db-5314a434a192 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Lock "a534665a-90e4-47dc-b081-47a44a975b64" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:12:39 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-1fa18097-1fb9-4c98-89db-5314a434a192 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Acquiring lock "a534665a-90e4-47dc-b081-47a44a975b64-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:12:39 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-1fa18097-1fb9-4c98-89db-5314a434a192 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Lock "a534665a-90e4-47dc-b081-47a44a975b64-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:12:39 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-1fa18097-1fb9-4c98-89db-5314a434a192 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Lock "a534665a-90e4-47dc-b081-47a44a975b64-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:12:39 user nova-compute[75122]: INFO nova.compute.manager [None req-1fa18097-1fb9-4c98-89db-5314a434a192 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: a534665a-90e4-47dc-b081-47a44a975b64] Terminating instance
Nov 15 10:12:39 user nova-compute[75122]: DEBUG nova.compute.manager [None req-1fa18097-1fb9-4c98-89db-5314a434a192 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: a534665a-90e4-47dc-b081-47a44a975b64] Start destroying the instance on the hypervisor. {{(pid=75122) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 10:12:39 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:12:39 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:12:39 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:12:39 user nova-compute[75122]: DEBUG nova.compute.manager [req-51d5c2f6-f344-4529-a7ee-7d67134f3c7c req-0d399d28-8a93-469b-a1b7-e9c2ae0b3b74 service nova] [instance: a534665a-90e4-47dc-b081-47a44a975b64] Received event network-vif-unplugged-ba4e0f89-75c3-4eeb-8b28-4ea10bb61909 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 10:12:39 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-51d5c2f6-f344-4529-a7ee-7d67134f3c7c req-0d399d28-8a93-469b-a1b7-e9c2ae0b3b74 service nova] Acquiring lock "a534665a-90e4-47dc-b081-47a44a975b64-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:12:39 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-51d5c2f6-f344-4529-a7ee-7d67134f3c7c req-0d399d28-8a93-469b-a1b7-e9c2ae0b3b74 service nova] Lock "a534665a-90e4-47dc-b081-47a44a975b64-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:12:39 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-51d5c2f6-f344-4529-a7ee-7d67134f3c7c req-0d399d28-8a93-469b-a1b7-e9c2ae0b3b74 service nova] Lock "a534665a-90e4-47dc-b081-47a44a975b64-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:12:39 user nova-compute[75122]: DEBUG nova.compute.manager [req-51d5c2f6-f344-4529-a7ee-7d67134f3c7c req-0d399d28-8a93-469b-a1b7-e9c2ae0b3b74 service nova] [instance: a534665a-90e4-47dc-b081-47a44a975b64] No waiting events found dispatching network-vif-unplugged-ba4e0f89-75c3-4eeb-8b28-4ea10bb61909 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 10:12:39 user nova-compute[75122]: DEBUG nova.compute.manager [req-51d5c2f6-f344-4529-a7ee-7d67134f3c7c req-0d399d28-8a93-469b-a1b7-e9c2ae0b3b74 service nova] [instance: a534665a-90e4-47dc-b081-47a44a975b64] Received event network-vif-unplugged-ba4e0f89-75c3-4eeb-8b28-4ea10bb61909 for instance with task_state deleting. {{(pid=75122) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 10:12:39 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:12:39 user nova-compute[75122]: INFO nova.virt.libvirt.driver [-] [instance: a534665a-90e4-47dc-b081-47a44a975b64] Instance destroyed successfully.
Nov 15 10:12:39 user nova-compute[75122]: DEBUG nova.objects.instance [None req-1fa18097-1fb9-4c98-89db-5314a434a192 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Lazy-loading 'resources' on Instance uuid a534665a-90e4-47dc-b081-47a44a975b64 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 10:12:39 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-1fa18097-1fb9-4c98-89db-5314a434a192 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T10:10:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1841816478',display_name='tempest-TestVolumeBootPattern-server-1841816478',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1841816478',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKHlpBGjgQO8WCWtscnQGPLWQNzcwgXW54O9CXzl/Z/CZ497o/Fb/9rP8/a86D2H+G6HyOK+OZYAd3QjjsdbXOlrlce1txRdWXFLkzlkbTs2rp1mYOku0vjKWQDJeaVaVQ==',key_name='tempest-TestVolumeBootPattern-2035754115',keypairs=<?>,launch_index=0,launched_at=2023-11-15T10:10:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c7941f36c30b49408ae5709a1b75346d',ramdisk_id='',reservation_id='r-zzuznqcz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-296749341',owner_user_name='tempest-TestVolumeBootPattern-296749341-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T10:10:57Z,user_data=None,user_id='00f5cc88e43c434c8a061dcec472a16b',uuid=a534665a-90e4-47dc-b081-47a44a975b64,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ba4e0f89-75c3-4eeb-8b28-4ea10bb61909", "address": "fa:16:3e:af:8a:69", "network": {"id": "03073971-5253-4f06-a46a-94840841fd6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2056706757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7941f36c30b49408ae5709a1b75346d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba4e0f89-75", "ovs_interfaceid": "ba4e0f89-75c3-4eeb-8b28-4ea10bb61909", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 10:12:39 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-1fa18097-1fb9-4c98-89db-5314a434a192 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Converting VIF {"id": "ba4e0f89-75c3-4eeb-8b28-4ea10bb61909", "address": "fa:16:3e:af:8a:69", "network": {"id": "03073971-5253-4f06-a46a-94840841fd6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2056706757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7941f36c30b49408ae5709a1b75346d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba4e0f89-75", "ovs_interfaceid": "ba4e0f89-75c3-4eeb-8b28-4ea10bb61909", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 10:12:39 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-1fa18097-1fb9-4c98-89db-5314a434a192 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:af:8a:69,bridge_name='br-int',has_traffic_filtering=True,id=ba4e0f89-75c3-4eeb-8b28-4ea10bb61909,network=Network(03073971-5253-4f06-a46a-94840841fd6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba4e0f89-75') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 10:12:39 user nova-compute[75122]: DEBUG os_vif [None req-1fa18097-1fb9-4c98-89db-5314a434a192 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:af:8a:69,bridge_name='br-int',has_traffic_filtering=True,id=ba4e0f89-75c3-4eeb-8b28-4ea10bb61909,network=Network(03073971-5253-4f06-a46a-94840841fd6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba4e0f89-75') {{(pid=75122) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 10:12:39 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:12:39 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapba4e0f89-75, bridge=br-int, if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 10:12:39 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:12:39 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:12:39 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:12:39 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=619a0bb1-0bee-4b70-bae2-2523f5c19f8e) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 10:12:39 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:12:39 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:12:39 user nova-compute[75122]: INFO os_vif [None req-1fa18097-1fb9-4c98-89db-5314a434a192 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:af:8a:69,bridge_name='br-int',has_traffic_filtering=True,id=ba4e0f89-75c3-4eeb-8b28-4ea10bb61909,network=Network(03073971-5253-4f06-a46a-94840841fd6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba4e0f89-75')
Nov 15 10:12:39 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1fa18097-1fb9-4c98-89db-5314a434a192 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: a534665a-90e4-47dc-b081-47a44a975b64] calling os-brick to detach iSCSI Volume {{(pid=75122) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 10:12:39 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fa18097-1fb9-4c98-89db-5314a434a192 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffa04060b80>, {'target_iqn': 'iqn.2010-10.org.openstack:9be886d5-d605-4139-bf9a-a8bce1cd6ddc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HgoqPCtp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 10:12:39 user nova-compute[75122]: WARNING os_brick.initiator.connectors.base [None req-1fa18097-1fb9-4c98-89db-5314a434a192 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 10:12:39 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-1fa18097-1fb9-4c98-89db-5314a434a192 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 10:12:39 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-1fa18097-1fb9-4c98-89db-5314a434a192 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 10:12:39 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:12:39 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:12:39 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[d71d164d-4acd-480b-bdfc-35540be0bddc]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:59ca9506-19c1-4a17-a495-28601cdadf8b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9be886d5-d605-4139-bf9a-a8bce1cd6ddc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:12:39 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fa18097-1fb9-4c98-89db-5314a434a192 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 10:12:39 user nova-compute[75122]: No targets found.
Nov 15 10:12:39 user nova-compute[75122]: iSNS:
Nov 15 10:12:39 user nova-compute[75122]: No targets found.
Nov 15 10:12:39 user nova-compute[75122]: STATIC:
Nov 15 10:12:39 user nova-compute[75122]: Target: iqn.2010-10.org.openstack:59ca9506-19c1-4a17-a495-28601cdadf8b
Nov 15 10:12:39 user nova-compute[75122]:         Portal: 172.16.0.220:3260,-1
Nov 15 10:12:39 user nova-compute[75122]:                 Iface Name: default
Nov 15 10:12:39 user nova-compute[75122]: Target: iqn.2010-10.org.openstack:9be886d5-d605-4139-bf9a-a8bce1cd6ddc
Nov 15 10:12:39 user nova-compute[75122]:         Portal: 172.16.0.220:3260,-1
Nov 15 10:12:39 user nova-compute[75122]:                 Iface Name: default
Nov 15 10:12:39 user nova-compute[75122]: FIRMWARE:
Nov 15 10:12:39 user nova-compute[75122]: No targets found.
Nov 15 10:12:39 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 10:12:39 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fa18097-1fb9-4c98-89db-5314a434a192 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 10:12:39 user nova-compute[75122]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 10:12:39 user nova-compute[75122]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75122) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 10:12:39 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fa18097-1fb9-4c98-89db-5314a434a192 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9be886d5-d605-4139-bf9a-a8bce1cd6ddc', 0)] {{(pid=75122) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 10:12:39 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:12:39 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:12:39 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e5f536a-bfa0-4f5e-9b96-2d40b3e3701e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:59ca9506-19c1-4a17-a495-28601cdadf8b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9be886d5-d605-4139-bf9a-a8bce1cd6ddc\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:12:39 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:12:39 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:12:39 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[43d254b6-0f71-4255-94d7-c55049a618b5]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59ca9506-19c1-4a17-a495-28601cdadf8b (non-flash)\ntcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9be886d5-d605-4139-bf9a-a8bce1cd6ddc (non-flash)\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:12:39 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fa18097-1fb9-4c98-89db-5314a434a192 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59ca9506-19c1-4a17-a495-28601cdadf8b (non-flash)
Nov 15 10:12:39 user nova-compute[75122]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9be886d5-d605-4139-bf9a-a8bce1cd6ddc (non-flash)
Nov 15 10:12:39 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 10:12:39 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fa18097-1fb9-4c98-89db-5314a434a192 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59ca9506-19c1-4a17-a495-28601cdadf8b (non-flash)
Nov 15 10:12:39 user nova-compute[75122]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9be886d5-d605-4139-bf9a-a8bce1cd6ddc (non-flash)
Nov 15 10:12:39 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 10:12:39 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fa18097-1fb9-4c98-89db-5314a434a192 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff9fc3a5360>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9be886d5-d605-4139-bf9a-a8bce1cd6ddc'): ({'sdc'}, set())}) {{(pid=75122) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 10:12:39 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-1fa18097-1fb9-4c98-89db-5314a434a192 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Removing single pathed devices sdc {{(pid=75122) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 10:12:39 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:12:39 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:12:39 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cbcce25-78d3-4a9a-879b-d49258e691b6]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:12:39 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:12:39 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:12:39 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d8bfa58-4058-4050-a80e-c3f6eb0e9e7d]: (4, ('ok\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:12:39 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-1fa18097-1fb9-4c98-89db-5314a434a192 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Flushing IO for device /dev/sdc {{(pid=75122) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 10:12:39 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:12:39 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:12:39 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[55cccdd6-0805-4876-9c32-cbd631575e7d]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:12:39 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-1fa18097-1fb9-4c98-89db-5314a434a192 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75122) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 10:12:39 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:12:39 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.069s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:12:39 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[09191794-315b-4fe6-90b2-59fd1717dadf]: (4, ('1', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:12:39 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-1fa18097-1fb9-4c98-89db-5314a434a192 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75122) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 10:12:40 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-1fa18097-1fb9-4c98-89db-5314a434a192 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] SCSI volumes sdc have been removed. {{(pid=75122) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 10:12:40 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fa18097-1fb9-4c98-89db-5314a434a192 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9be886d5-d605-4139-bf9a-a8bce1cd6ddc')] {{(pid=75122) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 10:12:40 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9be886d5-d605-4139-bf9a-a8bce1cd6ddc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:12:40 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9be886d5-d605-4139-bf9a-a8bce1cd6ddc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:12:40 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[2195bffb-2f5d-457a-ba99-4e5a166f6720]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:12:40 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fa18097-1fb9-4c98-89db-5314a434a192 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 10:12:40 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9be886d5-d605-4139-bf9a-a8bce1cd6ddc -p 172.16.0.220:3260 --logout {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:12:40 user nova-compute[75122]: DEBUG nova.compute.manager [req-d2bf2cc2-2580-4873-88f0-aec96cd40335 req-1fa9fa07-6478-46fa-811e-6706a69a096d service nova] [instance: a534665a-90e4-47dc-b081-47a44a975b64] Received event network-changed-ba4e0f89-75c3-4eeb-8b28-4ea10bb61909 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 10:12:40 user nova-compute[75122]: DEBUG nova.compute.manager [req-d2bf2cc2-2580-4873-88f0-aec96cd40335 req-1fa9fa07-6478-46fa-811e-6706a69a096d service nova] [instance: a534665a-90e4-47dc-b081-47a44a975b64] Refreshing instance network info cache due to event network-changed-ba4e0f89-75c3-4eeb-8b28-4ea10bb61909. {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 10:12:40 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-d2bf2cc2-2580-4873-88f0-aec96cd40335 req-1fa9fa07-6478-46fa-811e-6706a69a096d service nova] Acquiring lock "refresh_cache-a534665a-90e4-47dc-b081-47a44a975b64" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 10:12:40 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-d2bf2cc2-2580-4873-88f0-aec96cd40335 req-1fa9fa07-6478-46fa-811e-6706a69a096d service nova] Acquired lock "refresh_cache-a534665a-90e4-47dc-b081-47a44a975b64" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 10:12:40 user nova-compute[75122]: DEBUG nova.network.neutron [req-d2bf2cc2-2580-4873-88f0-aec96cd40335 req-1fa9fa07-6478-46fa-811e-6706a69a096d service nova] [instance: a534665a-90e4-47dc-b081-47a44a975b64] Refreshing network info cache for port ba4e0f89-75c3-4eeb-8b28-4ea10bb61909 {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 10:12:40 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9be886d5-d605-4139-bf9a-a8bce1cd6ddc -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:12:40 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[60bc7a13-9847-4ec2-965a-2e4a189c5ded]: (4, ('Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:9be886d5-d605-4139-bf9a-a8bce1cd6ddc, portal: 172.16.0.220,3260]\nLogout of [sid: 60, target: iqn.2010-10.org.openstack:9be886d5-d605-4139-bf9a-a8bce1cd6ddc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:12:40 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fa18097-1fb9-4c98-89db-5314a434a192 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:9be886d5-d605-4139-bf9a-a8bce1cd6ddc, portal: 172.16.0.220,3260]
Nov 15 10:12:40 user nova-compute[75122]: Logout of [sid: 60, target: iqn.2010-10.org.openstack:9be886d5-d605-4139-bf9a-a8bce1cd6ddc, portal: 172.16.0.220,3260] successful.
Nov 15 10:12:40 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 10:12:40 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9be886d5-d605-4139-bf9a-a8bce1cd6ddc -p 172.16.0.220:3260 --op delete {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:12:40 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9be886d5-d605-4139-bf9a-a8bce1cd6ddc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:12:40 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d6455cb-57bd-47aa-ab2d-bcd3ef1c5a91]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:12:40 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fa18097-1fb9-4c98-89db-5314a434a192 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 10:12:40 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-1fa18097-1fb9-4c98-89db-5314a434a192 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.347s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 10:12:40 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fa18097-1fb9-4c98-89db-5314a434a192 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] <== disconnect_volume: return (349ms) None {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 10:12:40 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1fa18097-1fb9-4c98-89db-5314a434a192 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: a534665a-90e4-47dc-b081-47a44a975b64] Disconnected iSCSI Volume {{(pid=75122) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 10:12:40 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-1fa18097-1fb9-4c98-89db-5314a434a192 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: a534665a-90e4-47dc-b081-47a44a975b64] Deleting instance files /opt/stack/data/nova/instances/a534665a-90e4-47dc-b081-47a44a975b64_del
Nov 15 10:12:40 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-1fa18097-1fb9-4c98-89db-5314a434a192 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: a534665a-90e4-47dc-b081-47a44a975b64] Deletion of /opt/stack/data/nova/instances/a534665a-90e4-47dc-b081-47a44a975b64_del complete
Nov 15 10:12:40 user nova-compute[75122]: INFO nova.compute.manager [None req-1fa18097-1fb9-4c98-89db-5314a434a192 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: a534665a-90e4-47dc-b081-47a44a975b64] Took 1.18 seconds to destroy the instance on the hypervisor.
Nov 15 10:12:40 user nova-compute[75122]: DEBUG oslo.service.loopingcall [None req-1fa18097-1fb9-4c98-89db-5314a434a192 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75122) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 10:12:40 user nova-compute[75122]: DEBUG nova.compute.manager [-] [instance: a534665a-90e4-47dc-b081-47a44a975b64] Deallocating network for instance {{(pid=75122) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 10:12:40 user nova-compute[75122]: DEBUG nova.network.neutron [-] [instance: a534665a-90e4-47dc-b081-47a44a975b64] deallocate_for_instance() {{(pid=75122) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 10:12:40 user nova-compute[75122]: DEBUG nova.network.neutron [req-d2bf2cc2-2580-4873-88f0-aec96cd40335 req-1fa9fa07-6478-46fa-811e-6706a69a096d service nova] [instance: a534665a-90e4-47dc-b081-47a44a975b64] Updated VIF entry in instance network info cache for port ba4e0f89-75c3-4eeb-8b28-4ea10bb61909. {{(pid=75122) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 10:12:40 user nova-compute[75122]: DEBUG nova.network.neutron [req-d2bf2cc2-2580-4873-88f0-aec96cd40335 req-1fa9fa07-6478-46fa-811e-6706a69a096d service nova] [instance: a534665a-90e4-47dc-b081-47a44a975b64] Updating instance_info_cache with network_info: [{"id": "ba4e0f89-75c3-4eeb-8b28-4ea10bb61909", "address": "fa:16:3e:af:8a:69", "network": {"id": "03073971-5253-4f06-a46a-94840841fd6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2056706757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7941f36c30b49408ae5709a1b75346d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba4e0f89-75", "ovs_interfaceid": "ba4e0f89-75c3-4eeb-8b28-4ea10bb61909", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 10:12:40 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-d2bf2cc2-2580-4873-88f0-aec96cd40335 req-1fa9fa07-6478-46fa-811e-6706a69a096d service nova] Releasing lock "refresh_cache-a534665a-90e4-47dc-b081-47a44a975b64" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 10:12:40 user nova-compute[75122]: DEBUG nova.network.neutron [-] [instance: a534665a-90e4-47dc-b081-47a44a975b64] Updating instance_info_cache with network_info: [] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 10:12:40 user nova-compute[75122]: INFO nova.compute.manager [-] [instance: a534665a-90e4-47dc-b081-47a44a975b64] Took 0.46 seconds to deallocate network for instance.
Nov 15 10:12:41 user nova-compute[75122]: DEBUG nova.compute.manager [req-460df5ae-4e26-472e-a599-6c0e2a0e2831 req-7b8c6a53-59e3-4a49-962f-eb5c19689edb service nova] [instance: a534665a-90e4-47dc-b081-47a44a975b64] Received event network-vif-plugged-ba4e0f89-75c3-4eeb-8b28-4ea10bb61909 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 10:12:41 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-460df5ae-4e26-472e-a599-6c0e2a0e2831 req-7b8c6a53-59e3-4a49-962f-eb5c19689edb service nova] Acquiring lock "a534665a-90e4-47dc-b081-47a44a975b64-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:12:41 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-460df5ae-4e26-472e-a599-6c0e2a0e2831 req-7b8c6a53-59e3-4a49-962f-eb5c19689edb service nova] Lock "a534665a-90e4-47dc-b081-47a44a975b64-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:12:41 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-460df5ae-4e26-472e-a599-6c0e2a0e2831 req-7b8c6a53-59e3-4a49-962f-eb5c19689edb service nova] Lock "a534665a-90e4-47dc-b081-47a44a975b64-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:12:41 user nova-compute[75122]: DEBUG nova.compute.manager [req-460df5ae-4e26-472e-a599-6c0e2a0e2831 req-7b8c6a53-59e3-4a49-962f-eb5c19689edb service nova] [instance: a534665a-90e4-47dc-b081-47a44a975b64] No waiting events found dispatching network-vif-plugged-ba4e0f89-75c3-4eeb-8b28-4ea10bb61909 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 10:12:41 user nova-compute[75122]: WARNING nova.compute.manager [req-460df5ae-4e26-472e-a599-6c0e2a0e2831 req-7b8c6a53-59e3-4a49-962f-eb5c19689edb service nova] [instance: a534665a-90e4-47dc-b081-47a44a975b64] Received unexpected event network-vif-plugged-ba4e0f89-75c3-4eeb-8b28-4ea10bb61909 for instance with vm_state active and task_state deleting.
Nov 15 10:12:41 user nova-compute[75122]: DEBUG nova.compute.manager [req-460df5ae-4e26-472e-a599-6c0e2a0e2831 req-7b8c6a53-59e3-4a49-962f-eb5c19689edb service nova] [instance: a534665a-90e4-47dc-b081-47a44a975b64] Received event network-vif-deleted-ba4e0f89-75c3-4eeb-8b28-4ea10bb61909 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 10:12:41 user nova-compute[75122]: INFO nova.compute.manager [None req-1fa18097-1fb9-4c98-89db-5314a434a192 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: a534665a-90e4-47dc-b081-47a44a975b64] Took 0.85 seconds to detach 1 volumes for instance.
Nov 15 10:12:41 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-1fa18097-1fb9-4c98-89db-5314a434a192 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:12:41 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-1fa18097-1fb9-4c98-89db-5314a434a192 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:12:41 user nova-compute[75122]: DEBUG nova.compute.provider_tree [None req-1fa18097-1fb9-4c98-89db-5314a434a192 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Inventory has not changed in ProviderTree for provider: 69a3da65-47be-44c6-b67c-c692b58284ef {{(pid=75122) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 10:12:41 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-1fa18097-1fb9-4c98-89db-5314a434a192 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Inventory has not changed for provider 69a3da65-47be-44c6-b67c-c692b58284ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 10:12:41 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-1fa18097-1fb9-4c98-89db-5314a434a192 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.160s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:12:41 user nova-compute[75122]: INFO nova.scheduler.client.report [None req-1fa18097-1fb9-4c98-89db-5314a434a192 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Deleted allocations for instance a534665a-90e4-47dc-b081-47a44a975b64
Nov 15 10:12:41 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-1fa18097-1fb9-4c98-89db-5314a434a192 tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Lock "a534665a-90e4-47dc-b081-47a44a975b64" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.846s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:12:41 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:12:44 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:12:45 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:12:46 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:12:46 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:12:47 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:12:47 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:12:47 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:12:47 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:12:47 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75122) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 10:12:47 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75122) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 10:12:47 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9aeb7a5-24fd-4620-b316-0c7cf61a1300/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:12:47 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9aeb7a5-24fd-4620-b316-0c7cf61a1300/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:12:47 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9aeb7a5-24fd-4620-b316-0c7cf61a1300/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:12:47 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9aeb7a5-24fd-4620-b316-0c7cf61a1300/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:12:48 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 10:12:48 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 10:12:48 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Hypervisor/Node resource view: name=user free_ram=8768MB free_disk=25.056846618652344GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75122) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 10:12:48 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:12:48 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:12:48 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance 968c4c12-9c56-4bb5-9b98-d526c67cd7d7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 10:12:48 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance f9aeb7a5-24fd-4620-b316-0c7cf61a1300 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 10:12:48 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75122) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 10:12:48 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75122) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 10:12:48 user nova-compute[75122]: DEBUG nova.compute.provider_tree [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Inventory has not changed in ProviderTree for provider: 69a3da65-47be-44c6-b67c-c692b58284ef {{(pid=75122) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 10:12:48 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Inventory has not changed for provider 69a3da65-47be-44c6-b67c-c692b58284ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 10:12:48 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Compute_service record updated for user:user {{(pid=75122) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 10:12:48 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.300s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:12:49 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:12:52 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:12:53 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:12:53 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Starting heal instance info cache {{(pid=75122) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 10:12:53 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Didn't find any instances for network info cache update. {{(pid=75122) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 15 10:12:54 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:12:54 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:12:54 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75122) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 10:12:54 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75122) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 10:12:54 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75122) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 10:12:54 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:12:56 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:12:56 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:12:57 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:12:57 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:12:57 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75122) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 10:12:59 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:13:04 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:13:09 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:13:14 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:13:19 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:13:24 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:13:29 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:13:33 user nova-compute[75122]: DEBUG nova.compute.manager [req-67087252-0353-4919-83d4-fff70c080e93 req-e5d4eb66-527d-4568-add2-8471ddbadc46 service nova] [instance: 968c4c12-9c56-4bb5-9b98-d526c67cd7d7] Received event network-changed-6a965453-1ab7-4987-bcfc-307d082e1e90 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 10:13:33 user nova-compute[75122]: DEBUG nova.compute.manager [req-67087252-0353-4919-83d4-fff70c080e93 req-e5d4eb66-527d-4568-add2-8471ddbadc46 service nova] [instance: 968c4c12-9c56-4bb5-9b98-d526c67cd7d7] Refreshing instance network info cache due to event network-changed-6a965453-1ab7-4987-bcfc-307d082e1e90. {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 10:13:33 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-67087252-0353-4919-83d4-fff70c080e93 req-e5d4eb66-527d-4568-add2-8471ddbadc46 service nova] Acquiring lock "refresh_cache-968c4c12-9c56-4bb5-9b98-d526c67cd7d7" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 10:13:33 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-67087252-0353-4919-83d4-fff70c080e93 req-e5d4eb66-527d-4568-add2-8471ddbadc46 service nova] Acquired lock "refresh_cache-968c4c12-9c56-4bb5-9b98-d526c67cd7d7" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 10:13:33 user nova-compute[75122]: DEBUG nova.network.neutron [req-67087252-0353-4919-83d4-fff70c080e93 req-e5d4eb66-527d-4568-add2-8471ddbadc46 service nova] [instance: 968c4c12-9c56-4bb5-9b98-d526c67cd7d7] Refreshing network info cache for port 6a965453-1ab7-4987-bcfc-307d082e1e90 {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 10:13:33 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-7b92d358-6400-4f18-95d7-eb17cd96bbff tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Acquiring lock "968c4c12-9c56-4bb5-9b98-d526c67cd7d7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:13:33 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-7b92d358-6400-4f18-95d7-eb17cd96bbff tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Lock "968c4c12-9c56-4bb5-9b98-d526c67cd7d7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:13:33 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-7b92d358-6400-4f18-95d7-eb17cd96bbff tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Acquiring lock "968c4c12-9c56-4bb5-9b98-d526c67cd7d7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:13:33 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-7b92d358-6400-4f18-95d7-eb17cd96bbff tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Lock "968c4c12-9c56-4bb5-9b98-d526c67cd7d7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:13:33 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-7b92d358-6400-4f18-95d7-eb17cd96bbff tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Lock "968c4c12-9c56-4bb5-9b98-d526c67cd7d7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:13:33 user nova-compute[75122]: INFO nova.compute.manager [None req-7b92d358-6400-4f18-95d7-eb17cd96bbff tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 968c4c12-9c56-4bb5-9b98-d526c67cd7d7] Terminating instance
Nov 15 10:13:33 user nova-compute[75122]: DEBUG nova.compute.manager [None req-7b92d358-6400-4f18-95d7-eb17cd96bbff tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 968c4c12-9c56-4bb5-9b98-d526c67cd7d7] Start destroying the instance on the hypervisor. {{(pid=75122) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 10:13:33 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:13:33 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:13:33 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:13:33 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:13:33 user nova-compute[75122]: DEBUG nova.network.neutron [req-67087252-0353-4919-83d4-fff70c080e93 req-e5d4eb66-527d-4568-add2-8471ddbadc46 service nova] [instance: 968c4c12-9c56-4bb5-9b98-d526c67cd7d7] Updated VIF entry in instance network info cache for port 6a965453-1ab7-4987-bcfc-307d082e1e90. {{(pid=75122) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 10:13:33 user nova-compute[75122]: DEBUG nova.network.neutron [req-67087252-0353-4919-83d4-fff70c080e93 req-e5d4eb66-527d-4568-add2-8471ddbadc46 service nova] [instance: 968c4c12-9c56-4bb5-9b98-d526c67cd7d7] Updating instance_info_cache with network_info: [{"id": "6a965453-1ab7-4987-bcfc-307d082e1e90", "address": "fa:16:3e:7a:69:23", "network": {"id": "03073971-5253-4f06-a46a-94840841fd6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2056706757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7941f36c30b49408ae5709a1b75346d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a965453-1a", "ovs_interfaceid": "6a965453-1ab7-4987-bcfc-307d082e1e90", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 10:13:33 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-67087252-0353-4919-83d4-fff70c080e93 req-e5d4eb66-527d-4568-add2-8471ddbadc46 service nova] Releasing lock "refresh_cache-968c4c12-9c56-4bb5-9b98-d526c67cd7d7" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 10:13:34 user nova-compute[75122]: INFO nova.virt.libvirt.driver [-] [instance: 968c4c12-9c56-4bb5-9b98-d526c67cd7d7] Instance destroyed successfully.
Nov 15 10:13:34 user nova-compute[75122]: DEBUG nova.objects.instance [None req-7b92d358-6400-4f18-95d7-eb17cd96bbff tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Lazy-loading 'resources' on Instance uuid 968c4c12-9c56-4bb5-9b98-d526c67cd7d7 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 10:13:34 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-7b92d358-6400-4f18-95d7-eb17cd96bbff tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T10:08:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1421472375',display_name='tempest-TestVolumeBootPattern-server-1421472375',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1421472375',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKHlpBGjgQO8WCWtscnQGPLWQNzcwgXW54O9CXzl/Z/CZ497o/Fb/9rP8/a86D2H+G6HyOK+OZYAd3QjjsdbXOlrlce1txRdWXFLkzlkbTs2rp1mYOku0vjKWQDJeaVaVQ==',key_name='tempest-TestVolumeBootPattern-2035754115',keypairs=<?>,launch_index=0,launched_at=2023-11-15T10:08:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c7941f36c30b49408ae5709a1b75346d',ramdisk_id='',reservation_id='r-68fbohas',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-296749341',owner_user_name='tempest-TestVolumeBootPattern-296749341-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T10:09:00Z,user_data=None,user_id='00f5cc88e43c434c8a061dcec472a16b',uuid=968c4c12-9c56-4bb5-9b98-d526c67cd7d7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6a965453-1ab7-4987-bcfc-307d082e1e90", "address": "fa:16:3e:7a:69:23", "network": {"id": "03073971-5253-4f06-a46a-94840841fd6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2056706757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7941f36c30b49408ae5709a1b75346d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a965453-1a", "ovs_interfaceid": "6a965453-1ab7-4987-bcfc-307d082e1e90", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 10:13:34 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-7b92d358-6400-4f18-95d7-eb17cd96bbff tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Converting VIF {"id": "6a965453-1ab7-4987-bcfc-307d082e1e90", "address": "fa:16:3e:7a:69:23", "network": {"id": "03073971-5253-4f06-a46a-94840841fd6f", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2056706757-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c7941f36c30b49408ae5709a1b75346d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a965453-1a", "ovs_interfaceid": "6a965453-1ab7-4987-bcfc-307d082e1e90", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 10:13:34 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-7b92d358-6400-4f18-95d7-eb17cd96bbff tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7a:69:23,bridge_name='br-int',has_traffic_filtering=True,id=6a965453-1ab7-4987-bcfc-307d082e1e90,network=Network(03073971-5253-4f06-a46a-94840841fd6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a965453-1a') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 10:13:34 user nova-compute[75122]: DEBUG os_vif [None req-7b92d358-6400-4f18-95d7-eb17cd96bbff tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7a:69:23,bridge_name='br-int',has_traffic_filtering=True,id=6a965453-1ab7-4987-bcfc-307d082e1e90,network=Network(03073971-5253-4f06-a46a-94840841fd6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a965453-1a') {{(pid=75122) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 10:13:34 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:13:34 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6a965453-1a, bridge=br-int, if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 10:13:34 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:13:34 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:13:34 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:13:34 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e6646545-8203-4ad2-837d-c0ed55312c0b) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 10:13:34 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:13:34 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:13:34 user nova-compute[75122]: INFO os_vif [None req-7b92d358-6400-4f18-95d7-eb17cd96bbff tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7a:69:23,bridge_name='br-int',has_traffic_filtering=True,id=6a965453-1ab7-4987-bcfc-307d082e1e90,network=Network(03073971-5253-4f06-a46a-94840841fd6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a965453-1a')
Nov 15 10:13:34 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7b92d358-6400-4f18-95d7-eb17cd96bbff tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 968c4c12-9c56-4bb5-9b98-d526c67cd7d7] calling os-brick to detach iSCSI Volume {{(pid=75122) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 10:13:34 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b92d358-6400-4f18-95d7-eb17cd96bbff tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffa04060b80>, {'target_iqn': 'iqn.2010-10.org.openstack:59ca9506-19c1-4a17-a495-28601cdadf8b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bYFsTknz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 10:13:34 user nova-compute[75122]: WARNING os_brick.initiator.connectors.base [None req-7b92d358-6400-4f18-95d7-eb17cd96bbff tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 10:13:34 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-7b92d358-6400-4f18-95d7-eb17cd96bbff tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 10:13:34 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-7b92d358-6400-4f18-95d7-eb17cd96bbff tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 10:13:34 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:13:34 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:13:34 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b4684cc-13bd-4dd6-abe0-26ac4beec856]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:59ca9506-19c1-4a17-a495-28601cdadf8b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:13:34 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b92d358-6400-4f18-95d7-eb17cd96bbff tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 10:13:34 user nova-compute[75122]: No targets found.
Nov 15 10:13:34 user nova-compute[75122]: iSNS:
Nov 15 10:13:34 user nova-compute[75122]: No targets found.
Nov 15 10:13:34 user nova-compute[75122]: STATIC:
Nov 15 10:13:34 user nova-compute[75122]: Target: iqn.2010-10.org.openstack:59ca9506-19c1-4a17-a495-28601cdadf8b
Nov 15 10:13:34 user nova-compute[75122]:         Portal: 172.16.0.220:3260,-1
Nov 15 10:13:34 user nova-compute[75122]:                 Iface Name: default
Nov 15 10:13:34 user nova-compute[75122]: FIRMWARE:
Nov 15 10:13:34 user nova-compute[75122]: No targets found.
Nov 15 10:13:34 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 10:13:34 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b92d358-6400-4f18-95d7-eb17cd96bbff tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 10:13:34 user nova-compute[75122]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 10:13:34 user nova-compute[75122]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75122) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 10:13:34 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b92d358-6400-4f18-95d7-eb17cd96bbff tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:59ca9506-19c1-4a17-a495-28601cdadf8b', 0)] {{(pid=75122) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 10:13:34 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:13:34 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:13:34 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d90f487-3f45-45a9-89c8-b0a922881eac]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:59ca9506-19c1-4a17-a495-28601cdadf8b\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:13:34 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:13:34 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:13:34 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5d540cb-9eba-48a7-a3f3-9b3a72cb1342]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59ca9506-19c1-4a17-a495-28601cdadf8b (non-flash)\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:13:34 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b92d358-6400-4f18-95d7-eb17cd96bbff tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59ca9506-19c1-4a17-a495-28601cdadf8b (non-flash)
Nov 15 10:13:34 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 10:13:34 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b92d358-6400-4f18-95d7-eb17cd96bbff tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59ca9506-19c1-4a17-a495-28601cdadf8b (non-flash)
Nov 15 10:13:34 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 10:13:34 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b92d358-6400-4f18-95d7-eb17cd96bbff tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ffa0417ca60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:59ca9506-19c1-4a17-a495-28601cdadf8b'): ({'sdb'}, set())}) {{(pid=75122) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 10:13:34 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-7b92d358-6400-4f18-95d7-eb17cd96bbff tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Removing single pathed devices sdb {{(pid=75122) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 10:13:34 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:13:34 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:13:34 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[37ed5898-8ab8-42cb-88fc-5ab7121e8c5a]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:13:34 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:13:34 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:13:34 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[f70b2f31-c1fe-4495-a241-a8ec7aae1074]: (4, ('ok\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:13:34 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-7b92d358-6400-4f18-95d7-eb17cd96bbff tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Flushing IO for device /dev/sdb {{(pid=75122) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 10:13:34 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:13:34 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:13:34 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[8246685e-083d-4975-aeb5-723c78c31748]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:13:34 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-7b92d358-6400-4f18-95d7-eb17cd96bbff tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75122) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 10:13:34 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:13:34 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:13:34 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[83d3a01d-65b1-4199-8bcc-f702c94e3429]: (4, ('1', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:13:34 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-7b92d358-6400-4f18-95d7-eb17cd96bbff tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75122) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 10:13:34 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-7b92d358-6400-4f18-95d7-eb17cd96bbff tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] SCSI volumes sdb have been removed. {{(pid=75122) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 10:13:34 user nova-compute[75122]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23664656631313830', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_29b1ae9d', '/dev/disk/by-id/scsi-1SCST_BIO29b1ae9d-6def118064c32bd7') {{(pid=85998) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 15 10:13:34 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[324d1474-97f9-4ad9-8409-54d5b1397661]: (4, None) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:13:34 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b92d358-6400-4f18-95d7-eb17cd96bbff tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:59ca9506-19c1-4a17-a495-28601cdadf8b')] {{(pid=75122) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 10:13:34 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59ca9506-19c1-4a17-a495-28601cdadf8b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:13:34 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59ca9506-19c1-4a17-a495-28601cdadf8b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:13:34 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7d9b067-ebe5-4715-b51e-a78487c53aff]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:13:34 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b92d358-6400-4f18-95d7-eb17cd96bbff tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 10:13:34 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59ca9506-19c1-4a17-a495-28601cdadf8b -p 172.16.0.220:3260 --logout {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:13:34 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59ca9506-19c1-4a17-a495-28601cdadf8b -p 172.16.0.220:3260 --logout" returned: 0 in 0.046s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:13:34 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0665e1c-8929-40ea-a223-21957a0d3833]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:59ca9506-19c1-4a17-a495-28601cdadf8b, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:59ca9506-19c1-4a17-a495-28601cdadf8b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:13:34 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b92d358-6400-4f18-95d7-eb17cd96bbff tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:59ca9506-19c1-4a17-a495-28601cdadf8b, portal: 172.16.0.220,3260]
Nov 15 10:13:34 user nova-compute[75122]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:59ca9506-19c1-4a17-a495-28601cdadf8b, portal: 172.16.0.220,3260] successful.
Nov 15 10:13:34 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 10:13:34 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59ca9506-19c1-4a17-a495-28601cdadf8b -p 172.16.0.220:3260 --op delete {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:13:34 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59ca9506-19c1-4a17-a495-28601cdadf8b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:13:34 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[873a2316-d3ce-4ccf-85be-2f7596beb2b9]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:13:34 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b92d358-6400-4f18-95d7-eb17cd96bbff tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 10:13:34 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-7b92d358-6400-4f18-95d7-eb17cd96bbff tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.279s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 10:13:34 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b92d358-6400-4f18-95d7-eb17cd96bbff tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] <== disconnect_volume: return (281ms) None {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 10:13:34 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7b92d358-6400-4f18-95d7-eb17cd96bbff tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 968c4c12-9c56-4bb5-9b98-d526c67cd7d7] Disconnected iSCSI Volume {{(pid=75122) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 10:13:34 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-7b92d358-6400-4f18-95d7-eb17cd96bbff tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 968c4c12-9c56-4bb5-9b98-d526c67cd7d7] Deleting instance files /opt/stack/data/nova/instances/968c4c12-9c56-4bb5-9b98-d526c67cd7d7_del
Nov 15 10:13:34 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-7b92d358-6400-4f18-95d7-eb17cd96bbff tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 968c4c12-9c56-4bb5-9b98-d526c67cd7d7] Deletion of /opt/stack/data/nova/instances/968c4c12-9c56-4bb5-9b98-d526c67cd7d7_del complete
Nov 15 10:13:34 user nova-compute[75122]: INFO nova.compute.manager [None req-7b92d358-6400-4f18-95d7-eb17cd96bbff tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 968c4c12-9c56-4bb5-9b98-d526c67cd7d7] Took 1.12 seconds to destroy the instance on the hypervisor.
Nov 15 10:13:34 user nova-compute[75122]: DEBUG oslo.service.loopingcall [None req-7b92d358-6400-4f18-95d7-eb17cd96bbff tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75122) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 10:13:34 user nova-compute[75122]: DEBUG nova.compute.manager [-] [instance: 968c4c12-9c56-4bb5-9b98-d526c67cd7d7] Deallocating network for instance {{(pid=75122) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 10:13:34 user nova-compute[75122]: DEBUG nova.network.neutron [-] [instance: 968c4c12-9c56-4bb5-9b98-d526c67cd7d7] deallocate_for_instance() {{(pid=75122) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 10:13:35 user nova-compute[75122]: DEBUG nova.compute.manager [req-ec2b8822-6163-4055-9c97-a1acc511b46d req-7736339f-d0cc-4165-8529-6728908befc6 service nova] [instance: 968c4c12-9c56-4bb5-9b98-d526c67cd7d7] Received event network-vif-unplugged-6a965453-1ab7-4987-bcfc-307d082e1e90 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 10:13:35 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-ec2b8822-6163-4055-9c97-a1acc511b46d req-7736339f-d0cc-4165-8529-6728908befc6 service nova] Acquiring lock "968c4c12-9c56-4bb5-9b98-d526c67cd7d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:13:35 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-ec2b8822-6163-4055-9c97-a1acc511b46d req-7736339f-d0cc-4165-8529-6728908befc6 service nova] Lock "968c4c12-9c56-4bb5-9b98-d526c67cd7d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:13:35 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-ec2b8822-6163-4055-9c97-a1acc511b46d req-7736339f-d0cc-4165-8529-6728908befc6 service nova] Lock "968c4c12-9c56-4bb5-9b98-d526c67cd7d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:13:35 user nova-compute[75122]: DEBUG nova.compute.manager [req-ec2b8822-6163-4055-9c97-a1acc511b46d req-7736339f-d0cc-4165-8529-6728908befc6 service nova] [instance: 968c4c12-9c56-4bb5-9b98-d526c67cd7d7] No waiting events found dispatching network-vif-unplugged-6a965453-1ab7-4987-bcfc-307d082e1e90 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 10:13:35 user nova-compute[75122]: DEBUG nova.compute.manager [req-ec2b8822-6163-4055-9c97-a1acc511b46d req-7736339f-d0cc-4165-8529-6728908befc6 service nova] [instance: 968c4c12-9c56-4bb5-9b98-d526c67cd7d7] Received event network-vif-unplugged-6a965453-1ab7-4987-bcfc-307d082e1e90 for instance with task_state deleting. {{(pid=75122) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 10:13:35 user nova-compute[75122]: DEBUG nova.compute.manager [req-ec2b8822-6163-4055-9c97-a1acc511b46d req-7736339f-d0cc-4165-8529-6728908befc6 service nova] [instance: 968c4c12-9c56-4bb5-9b98-d526c67cd7d7] Received event network-vif-plugged-6a965453-1ab7-4987-bcfc-307d082e1e90 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 10:13:35 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-ec2b8822-6163-4055-9c97-a1acc511b46d req-7736339f-d0cc-4165-8529-6728908befc6 service nova] Acquiring lock "968c4c12-9c56-4bb5-9b98-d526c67cd7d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:13:35 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-ec2b8822-6163-4055-9c97-a1acc511b46d req-7736339f-d0cc-4165-8529-6728908befc6 service nova] Lock "968c4c12-9c56-4bb5-9b98-d526c67cd7d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:13:35 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-ec2b8822-6163-4055-9c97-a1acc511b46d req-7736339f-d0cc-4165-8529-6728908befc6 service nova] Lock "968c4c12-9c56-4bb5-9b98-d526c67cd7d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:13:35 user nova-compute[75122]: DEBUG nova.compute.manager [req-ec2b8822-6163-4055-9c97-a1acc511b46d req-7736339f-d0cc-4165-8529-6728908befc6 service nova] [instance: 968c4c12-9c56-4bb5-9b98-d526c67cd7d7] No waiting events found dispatching network-vif-plugged-6a965453-1ab7-4987-bcfc-307d082e1e90 {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 10:13:35 user nova-compute[75122]: WARNING nova.compute.manager [req-ec2b8822-6163-4055-9c97-a1acc511b46d req-7736339f-d0cc-4165-8529-6728908befc6 service nova] [instance: 968c4c12-9c56-4bb5-9b98-d526c67cd7d7] Received unexpected event network-vif-plugged-6a965453-1ab7-4987-bcfc-307d082e1e90 for instance with vm_state active and task_state deleting.
Nov 15 10:13:35 user nova-compute[75122]: DEBUG nova.network.neutron [-] [instance: 968c4c12-9c56-4bb5-9b98-d526c67cd7d7] Updating instance_info_cache with network_info: [] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 10:13:35 user nova-compute[75122]: INFO nova.compute.manager [-] [instance: 968c4c12-9c56-4bb5-9b98-d526c67cd7d7] Took 0.98 seconds to deallocate network for instance.
Nov 15 10:13:35 user nova-compute[75122]: DEBUG nova.compute.manager [req-5fa8f93f-69a5-4eb4-bda0-400d9de24c79 req-569269a2-4982-4dde-9d43-74038a35db46 service nova] [instance: 968c4c12-9c56-4bb5-9b98-d526c67cd7d7] Received event network-vif-deleted-6a965453-1ab7-4987-bcfc-307d082e1e90 {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 10:13:36 user nova-compute[75122]: INFO nova.compute.manager [None req-7b92d358-6400-4f18-95d7-eb17cd96bbff tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] [instance: 968c4c12-9c56-4bb5-9b98-d526c67cd7d7] Took 0.70 seconds to detach 1 volumes for instance.
Nov 15 10:13:36 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-7b92d358-6400-4f18-95d7-eb17cd96bbff tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:13:36 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-7b92d358-6400-4f18-95d7-eb17cd96bbff tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:13:36 user nova-compute[75122]: DEBUG nova.compute.provider_tree [None req-7b92d358-6400-4f18-95d7-eb17cd96bbff tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Inventory has not changed in ProviderTree for provider: 69a3da65-47be-44c6-b67c-c692b58284ef {{(pid=75122) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 10:13:36 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-7b92d358-6400-4f18-95d7-eb17cd96bbff tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Inventory has not changed for provider 69a3da65-47be-44c6-b67c-c692b58284ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 10:13:36 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-7b92d358-6400-4f18-95d7-eb17cd96bbff tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.140s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:13:36 user nova-compute[75122]: INFO nova.scheduler.client.report [None req-7b92d358-6400-4f18-95d7-eb17cd96bbff tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Deleted allocations for instance 968c4c12-9c56-4bb5-9b98-d526c67cd7d7
Nov 15 10:13:36 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-7b92d358-6400-4f18-95d7-eb17cd96bbff tempest-TestVolumeBootPattern-296749341 tempest-TestVolumeBootPattern-296749341-project-member] Lock "968c4c12-9c56-4bb5-9b98-d526c67cd7d7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.128s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:13:39 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:13:44 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:13:45 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-13ebe541-ebf8-480f-8f66-dd65a063a475 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Acquiring lock "f9aeb7a5-24fd-4620-b316-0c7cf61a1300" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:13:45 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-13ebe541-ebf8-480f-8f66-dd65a063a475 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Lock "f9aeb7a5-24fd-4620-b316-0c7cf61a1300" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:13:45 user nova-compute[75122]: DEBUG nova.objects.instance [None req-13ebe541-ebf8-480f-8f66-dd65a063a475 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Lazy-loading 'flavor' on Instance uuid f9aeb7a5-24fd-4620-b316-0c7cf61a1300 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 10:13:45 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-13ebe541-ebf8-480f-8f66-dd65a063a475 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Lock "f9aeb7a5-24fd-4620-b316-0c7cf61a1300" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.048s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:13:45 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-13ebe541-ebf8-480f-8f66-dd65a063a475 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Acquiring lock "f9aeb7a5-24fd-4620-b316-0c7cf61a1300" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:13:45 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-13ebe541-ebf8-480f-8f66-dd65a063a475 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Lock "f9aeb7a5-24fd-4620-b316-0c7cf61a1300" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:13:45 user nova-compute[75122]: INFO nova.compute.manager [None req-13ebe541-ebf8-480f-8f66-dd65a063a475 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] [instance: f9aeb7a5-24fd-4620-b316-0c7cf61a1300] Attaching volume a06f0d94-61c1-4bba-ad00-6cf16efdad55 to /dev/vdb
Nov 15 10:13:45 user nova-compute[75122]: DEBUG os_brick.utils [None req-13ebe541-ebf8-480f-8f66-dd65a063a475 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 10:13:45 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:13:45 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:13:45 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf1b2535-510b-4179-a4f7-7de0c0418384]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:742fb64b3587\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:13:45 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:13:45 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:13:45 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba9b708f-5d39-4208-9cc9-cdc6740f124a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:13:45 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:13:45 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:13:45 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[87a4d9c2-aba2-42b9-a45f-2a0a1a19cd3c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:13:45 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e8b7268-a3e6-4ce1-83c8-3c28ac5c4bca]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:13:45 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-13ebe541-ebf8-480f-8f66-dd65a063a475 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Running cmd (subprocess): nvme version {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:13:45 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-13ebe541-ebf8-480f-8f66-dd65a063a475 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] 'nvme version' failed. Not Retrying. {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 10:13:45 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.nvmeof [None req-13ebe541-ebf8-480f-8f66-dd65a063a475 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] nvme not present on system {{(pid=75122) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 10:13:45 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:13:45 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 10:13:45 user nova-compute[75122]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 10:13:45 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[c23f14f0-f7fa-43cc-952f-c6f4b0e443b3]: (4, '') {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:13:45 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.lightos [None req-13ebe541-ebf8-480f-8f66-dd65a063a475 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75122) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 10:13:45 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.lightos [None req-13ebe541-ebf8-480f-8f66-dd65a063a475 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75122) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 10:13:45 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.lightos [None req-13ebe541-ebf8-480f-8f66-dd65a063a475 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] LIGHTOS: no hostnqn found. {{(pid=75122) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 10:13:45 user nova-compute[75122]: DEBUG os_brick.utils [None req-13ebe541-ebf8-480f-8f66-dd65a063a475 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:742fb64b3587', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 10:13:45 user nova-compute[75122]: DEBUG nova.virt.block_device [None req-13ebe541-ebf8-480f-8f66-dd65a063a475 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] [instance: f9aeb7a5-24fd-4620-b316-0c7cf61a1300] Updating existing volume attachment record: 36fe0375-fa7c-41d3-82bd-04bb5cea7ed3 {{(pid=75122) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 10:13:46 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:13:46 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:13:47 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:13:49 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:13:49 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:13:49 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:13:49 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:13:49 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75122) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 10:13:49 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9aeb7a5-24fd-4620-b316-0c7cf61a1300/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:13:49 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:13:49 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9aeb7a5-24fd-4620-b316-0c7cf61a1300/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:13:49 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9aeb7a5-24fd-4620-b316-0c7cf61a1300/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:13:49 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9aeb7a5-24fd-4620-b316-0c7cf61a1300/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:13:50 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 10:13:50 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 10:13:50 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Hypervisor/Node resource view: name=user free_ram=8934MB free_disk=25.054607391357422GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75122) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 10:13:50 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:13:50 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:13:50 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance f9aeb7a5-24fd-4620-b316-0c7cf61a1300 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 10:13:50 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75122) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 10:13:50 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75122) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 10:13:50 user nova-compute[75122]: DEBUG nova.compute.provider_tree [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Inventory has not changed in ProviderTree for provider: 69a3da65-47be-44c6-b67c-c692b58284ef {{(pid=75122) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 10:13:50 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Inventory has not changed for provider 69a3da65-47be-44c6-b67c-c692b58284ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 10:13:50 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Compute_service record updated for user:user {{(pid=75122) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 10:13:50 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.198s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:13:50 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-13ebe541-ebf8-480f-8f66-dd65a063a475 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] [instance: f9aeb7a5-24fd-4620-b316-0c7cf61a1300] Calling os-brick to attach iSCSI Volume {{(pid=75122) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 10:13:50 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-13ebe541-ebf8-480f-8f66-dd65a063a475 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffa04060b80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a06f0d94-61c1-4bba-ad00-6cf16efdad55', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eVMrHjOL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 10:13:50 user nova-compute[75122]: WARNING os_brick.initiator.connectors.base [None req-13ebe541-ebf8-480f-8f66-dd65a063a475 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 10:13:50 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-13ebe541-ebf8-480f-8f66-dd65a063a475 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 10:13:50 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-13ebe541-ebf8-480f-8f66-dd65a063a475 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 10:13:50 user nova-compute[75122]: WARNING os_brick.initiator.connectors.base [None req-13ebe541-ebf8-480f-8f66-dd65a063a475 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 10:13:50 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-13ebe541-ebf8-480f-8f66-dd65a063a475 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a06f0d94-61c1-4bba-ad00-6cf16efdad55" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 10:13:50 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-13ebe541-ebf8-480f-8f66-dd65a063a475 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a06f0d94-61c1-4bba-ad00-6cf16efdad55" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 10:13:50 user nova-compute[75122]: INFO os_brick.initiator.connectors.iscsi [None req-13ebe541-ebf8-480f-8f66-dd65a063a475 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 10:13:50 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a06f0d94-61c1-4bba-ad00-6cf16efdad55 -p 172.16.0.220:3260 {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:13:50 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a06f0d94-61c1-4bba-ad00-6cf16efdad55 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:13:50 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[0da3bf56-4583-4e8f-8378-033469fc15cc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:13:50 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-13ebe541-ebf8-480f-8f66-dd65a063a475 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 10:13:50 user nova-compute[75122]:  {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 10:13:50 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a06f0d94-61c1-4bba-ad00-6cf16efdad55 -p 172.16.0.220:3260 --interface default --op new {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:13:50 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a06f0d94-61c1-4bba-ad00-6cf16efdad55 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:13:50 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee395ce9-d2b0-40c1-a6a2-27f11ea3b019]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a06f0d94-61c1-4bba-ad00-6cf16efdad55] added\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:13:50 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-13ebe541-ebf8-480f-8f66-dd65a063a475 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a06f0d94-61c1-4bba-ad00-6cf16efdad55] added
Nov 15 10:13:50 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 10:13:50 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a06f0d94-61c1-4bba-ad00-6cf16efdad55 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:13:50 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a06f0d94-61c1-4bba-ad00-6cf16efdad55 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:13:50 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[13a9d0ba-ee47-4e3b-ac7b-f4302f861997]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:13:50 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-13ebe541-ebf8-480f-8f66-dd65a063a475 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 10:13:50 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a06f0d94-61c1-4bba-ad00-6cf16efdad55 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:13:50 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a06f0d94-61c1-4bba-ad00-6cf16efdad55 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:13:50 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbd4286d-185e-47a3-9a30-ac25d03c4f9f]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:13:50 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-13ebe541-ebf8-480f-8f66-dd65a063a475 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 10:13:50 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a06f0d94-61c1-4bba-ad00-6cf16efdad55 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eVMrHjOL {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:13:50 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a06f0d94-61c1-4bba-ad00-6cf16efdad55 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eVMrHjOL" returned: 0 in 0.019s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:13:50 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf80bb46-2c1d-4b70-b0bc-d11235373186]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:13:50 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-13ebe541-ebf8-480f-8f66-dd65a063a475 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'eVMrHjOL'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 10:13:50 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a06f0d94-61c1-4bba-ad00-6cf16efdad55 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:13:50 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a06f0d94-61c1-4bba-ad00-6cf16efdad55 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:13:50 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cbd30b3-04fe-4eb3-b1ff-57ff88fc7f8e]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:13:50 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-13ebe541-ebf8-480f-8f66-dd65a063a475 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 10:13:50 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:13:50 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:13:50 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[94bca90a-7142-4f16-88c1-af8a8446ff10]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:13:50 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-13ebe541-ebf8-480f-8f66-dd65a063a475 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 15 10:13:50 user nova-compute[75122]:  {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 10:13:50 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-13ebe541-ebf8-480f-8f66-dd65a063a475 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 15 10:13:50 user nova-compute[75122]:  {{(pid=75122) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 10:13:50 user nova-compute[75122]: WARNING os_brick.initiator.connectors.iscsi [None req-13ebe541-ebf8-480f-8f66-dd65a063a475 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 15 10:13:50 user nova-compute[75122]: 
Nov 15 10:13:50 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a06f0d94-61c1-4bba-ad00-6cf16efdad55 -p 172.16.0.220:3260 --login {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:13:50 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a06f0d94-61c1-4bba-ad00-6cf16efdad55 -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:13:50 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[04b84047-0faf-41b5-a294-a155f6c80080]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a06f0d94-61c1-4bba-ad00-6cf16efdad55, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a06f0d94-61c1-4bba-ad00-6cf16efdad55, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:13:50 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-13ebe541-ebf8-480f-8f66-dd65a063a475 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a06f0d94-61c1-4bba-ad00-6cf16efdad55, portal: 172.16.0.220,3260]
Nov 15 10:13:50 user nova-compute[75122]: Login to [iface: default, target: iqn.2010-10.org.openstack:a06f0d94-61c1-4bba-ad00-6cf16efdad55, portal: 172.16.0.220,3260] successful.
Nov 15 10:13:50 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 10:13:50 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a06f0d94-61c1-4bba-ad00-6cf16efdad55 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:13:50 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a06f0d94-61c1-4bba-ad00-6cf16efdad55 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:13:50 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a9a10ac-132b-49af-bc42-36dd46092f4b]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:13:50 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-13ebe541-ebf8-480f-8f66-dd65a063a475 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 10:13:50 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:13:50 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:13:50 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[b087f59b-95ae-4291-96a9-3cb52ec8ebc8]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a06f0d94-61c1-4bba-ad00-6cf16efdad55 (non-flash)\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:13:50 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-13ebe541-ebf8-480f-8f66-dd65a063a475 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a06f0d94-61c1-4bba-ad00-6cf16efdad55 (non-flash)
Nov 15 10:13:50 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 10:13:50 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-13ebe541-ebf8-480f-8f66-dd65a063a475 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a06f0d94-61c1-4bba-ad00-6cf16efdad55 (non-flash)
Nov 15 10:13:50 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 10:13:50 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-13ebe541-ebf8-480f-8f66-dd65a063a475 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a06f0d94-61c1-4bba-ad00-6cf16efdad55" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.253s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 10:13:50 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-13ebe541-ebf8-480f-8f66-dd65a063a475 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Connected to 172.16.0.220:3260 {{(pid=75122) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 10:13:50 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-13ebe541-ebf8-480f-8f66-dd65a063a475 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] HCTL ('33', '-', '-', 0) found on session 61 with lun 0 {{(pid=75122) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 10:13:50 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-13ebe541-ebf8-480f-8f66-dd65a063a475 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75122) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 10:13:50 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:13:50 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:13:50 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[4873f988-e5d5-458f-99cc-46f109e06214]: (4, ('- - 0', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:13:50 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-13ebe541-ebf8-480f-8f66-dd65a063a475 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Searching for a device in session 61 and hctl ['33', '*', '*', 0] yield: None {{(pid=75122) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 10:13:51 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-13ebe541-ebf8-480f-8f66-dd65a063a475 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Searching for a device in session 61 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75122) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 10:13:51 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-13ebe541-ebf8-480f-8f66-dd65a063a475 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:a06f0d94-61c1-4bba-ad00-6cf16efdad55', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eVMrHjOL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75122) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 10:13:51 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-13ebe541-ebf8-480f-8f66-dd65a063a475 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.286s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 10:13:51 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-13ebe541-ebf8-480f-8f66-dd65a063a475 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] <== connect_volume: return (1287ms) {'type': 'block', 'scsi_wwn': '23931323162383762', 'path': '/dev/sdb'} {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 10:13:51 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-13ebe541-ebf8-480f-8f66-dd65a063a475 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] [instance: f9aeb7a5-24fd-4620-b316-0c7cf61a1300] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23931323162383762', 'path': '/dev/sdb'} {{(pid=75122) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 10:13:51 user nova-compute[75122]: DEBUG nova.objects.instance [None req-13ebe541-ebf8-480f-8f66-dd65a063a475 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Lazy-loading 'flavor' on Instance uuid f9aeb7a5-24fd-4620-b316-0c7cf61a1300 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 10:13:51 user nova-compute[75122]: DEBUG nova.virt.libvirt.guest [None req-13ebe541-ebf8-480f-8f66-dd65a063a475 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 10:13:51 user nova-compute[75122]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 10:13:51 user nova-compute[75122]:   <source dev="/dev/sdb"/>
Nov 15 10:13:51 user nova-compute[75122]:   <target dev="vdb" bus="virtio"/>
Nov 15 10:13:51 user nova-compute[75122]:   <serial>a06f0d94-61c1-4bba-ad00-6cf16efdad55</serial>
Nov 15 10:13:51 user nova-compute[75122]: </disk>
Nov 15 10:13:51 user nova-compute[75122]:  {{(pid=75122) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 10:13:52 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-13ebe541-ebf8-480f-8f66-dd65a063a475 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] No BDM found with device name vda, not building metadata. {{(pid=75122) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 10:13:52 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-13ebe541-ebf8-480f-8f66-dd65a063a475 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75122) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 10:13:52 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-13ebe541-ebf8-480f-8f66-dd65a063a475 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] No VIF found with MAC fa:16:3e:1e:19:79, not building metadata {{(pid=75122) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 10:13:52 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-13ebe541-ebf8-480f-8f66-dd65a063a475 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Lock "f9aeb7a5-24fd-4620-b316-0c7cf61a1300" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.645s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:13:54 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:13:54 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:13:54 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:13:54 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75122) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 10:13:54 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75122) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 10:13:54 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75122) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 10:13:54 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:13:55 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:13:55 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Starting heal instance info cache {{(pid=75122) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 10:13:55 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Rebuilding the list of instances to heal {{(pid=75122) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 10:13:55 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "refresh_cache-f9aeb7a5-24fd-4620-b316-0c7cf61a1300" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 10:13:55 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquired lock "refresh_cache-f9aeb7a5-24fd-4620-b316-0c7cf61a1300" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 10:13:55 user nova-compute[75122]: DEBUG nova.network.neutron [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] [instance: f9aeb7a5-24fd-4620-b316-0c7cf61a1300] Forcefully refreshing network info cache for instance {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 10:13:55 user nova-compute[75122]: DEBUG nova.objects.instance [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lazy-loading 'info_cache' on Instance uuid f9aeb7a5-24fd-4620-b316-0c7cf61a1300 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 10:13:55 user nova-compute[75122]: DEBUG nova.network.neutron [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] [instance: f9aeb7a5-24fd-4620-b316-0c7cf61a1300] Updating instance_info_cache with network_info: [{"id": "0deeb35a-47e5-44fe-843c-ed90df673a6b", "address": "fa:16:3e:1e:19:79", "network": {"id": "25afb78c-30e1-4fd7-a215-b5e73ba43057", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2008775745-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "098415c1690e46c39d52c0fee2719175", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0deeb35a-47", "ovs_interfaceid": "0deeb35a-47e5-44fe-843c-ed90df673a6b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 10:13:55 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Releasing lock "refresh_cache-f9aeb7a5-24fd-4620-b316-0c7cf61a1300" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 10:13:55 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] [instance: f9aeb7a5-24fd-4620-b316-0c7cf61a1300] Updated the network info_cache for instance {{(pid=75122) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 10:13:56 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:13:57 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:13:57 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:13:57 user nova-compute[75122]: DEBUG nova.compute.manager [req-da7fe5e7-6524-4d2e-88f2-34c8f7784e62 req-8f776245-da51-4fb5-b6e2-4188ac801cba service nova] [instance: f9aeb7a5-24fd-4620-b316-0c7cf61a1300] Received event network-changed-0deeb35a-47e5-44fe-843c-ed90df673a6b {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 10:13:57 user nova-compute[75122]: DEBUG nova.compute.manager [req-da7fe5e7-6524-4d2e-88f2-34c8f7784e62 req-8f776245-da51-4fb5-b6e2-4188ac801cba service nova] [instance: f9aeb7a5-24fd-4620-b316-0c7cf61a1300] Refreshing instance network info cache due to event network-changed-0deeb35a-47e5-44fe-843c-ed90df673a6b. {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 10:13:57 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-da7fe5e7-6524-4d2e-88f2-34c8f7784e62 req-8f776245-da51-4fb5-b6e2-4188ac801cba service nova] Acquiring lock "refresh_cache-f9aeb7a5-24fd-4620-b316-0c7cf61a1300" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 10:13:57 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-da7fe5e7-6524-4d2e-88f2-34c8f7784e62 req-8f776245-da51-4fb5-b6e2-4188ac801cba service nova] Acquired lock "refresh_cache-f9aeb7a5-24fd-4620-b316-0c7cf61a1300" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 10:13:57 user nova-compute[75122]: DEBUG nova.network.neutron [req-da7fe5e7-6524-4d2e-88f2-34c8f7784e62 req-8f776245-da51-4fb5-b6e2-4188ac801cba service nova] [instance: f9aeb7a5-24fd-4620-b316-0c7cf61a1300] Refreshing network info cache for port 0deeb35a-47e5-44fe-843c-ed90df673a6b {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 10:13:57 user nova-compute[75122]: DEBUG nova.network.neutron [req-da7fe5e7-6524-4d2e-88f2-34c8f7784e62 req-8f776245-da51-4fb5-b6e2-4188ac801cba service nova] [instance: f9aeb7a5-24fd-4620-b316-0c7cf61a1300] Updated VIF entry in instance network info cache for port 0deeb35a-47e5-44fe-843c-ed90df673a6b. {{(pid=75122) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 10:13:57 user nova-compute[75122]: DEBUG nova.network.neutron [req-da7fe5e7-6524-4d2e-88f2-34c8f7784e62 req-8f776245-da51-4fb5-b6e2-4188ac801cba service nova] [instance: f9aeb7a5-24fd-4620-b316-0c7cf61a1300] Updating instance_info_cache with network_info: [{"id": "0deeb35a-47e5-44fe-843c-ed90df673a6b", "address": "fa:16:3e:1e:19:79", "network": {"id": "25afb78c-30e1-4fd7-a215-b5e73ba43057", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2008775745-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "098415c1690e46c39d52c0fee2719175", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0deeb35a-47", "ovs_interfaceid": "0deeb35a-47e5-44fe-843c-ed90df673a6b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 10:13:57 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-da7fe5e7-6524-4d2e-88f2-34c8f7784e62 req-8f776245-da51-4fb5-b6e2-4188ac801cba service nova] Releasing lock "refresh_cache-f9aeb7a5-24fd-4620-b316-0c7cf61a1300" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 10:13:58 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:13:58 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75122) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 10:13:59 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:13:59 user nova-compute[75122]: DEBUG nova.compute.manager [req-6a45ed9a-eaae-45e2-9739-632e0c7c9371 req-93fa3300-d9c8-4e20-964a-602e4e4bdd6e service nova] [instance: f9aeb7a5-24fd-4620-b316-0c7cf61a1300] Received event network-changed-0deeb35a-47e5-44fe-843c-ed90df673a6b {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 10:13:59 user nova-compute[75122]: DEBUG nova.compute.manager [req-6a45ed9a-eaae-45e2-9739-632e0c7c9371 req-93fa3300-d9c8-4e20-964a-602e4e4bdd6e service nova] [instance: f9aeb7a5-24fd-4620-b316-0c7cf61a1300] Refreshing instance network info cache due to event network-changed-0deeb35a-47e5-44fe-843c-ed90df673a6b. {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 10:13:59 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-6a45ed9a-eaae-45e2-9739-632e0c7c9371 req-93fa3300-d9c8-4e20-964a-602e4e4bdd6e service nova] Acquiring lock "refresh_cache-f9aeb7a5-24fd-4620-b316-0c7cf61a1300" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 10:13:59 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-6a45ed9a-eaae-45e2-9739-632e0c7c9371 req-93fa3300-d9c8-4e20-964a-602e4e4bdd6e service nova] Acquired lock "refresh_cache-f9aeb7a5-24fd-4620-b316-0c7cf61a1300" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 10:13:59 user nova-compute[75122]: DEBUG nova.network.neutron [req-6a45ed9a-eaae-45e2-9739-632e0c7c9371 req-93fa3300-d9c8-4e20-964a-602e4e4bdd6e service nova] [instance: f9aeb7a5-24fd-4620-b316-0c7cf61a1300] Refreshing network info cache for port 0deeb35a-47e5-44fe-843c-ed90df673a6b {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 10:13:59 user nova-compute[75122]: DEBUG nova.network.neutron [req-6a45ed9a-eaae-45e2-9739-632e0c7c9371 req-93fa3300-d9c8-4e20-964a-602e4e4bdd6e service nova] [instance: f9aeb7a5-24fd-4620-b316-0c7cf61a1300] Updated VIF entry in instance network info cache for port 0deeb35a-47e5-44fe-843c-ed90df673a6b. {{(pid=75122) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 10:13:59 user nova-compute[75122]: DEBUG nova.network.neutron [req-6a45ed9a-eaae-45e2-9739-632e0c7c9371 req-93fa3300-d9c8-4e20-964a-602e4e4bdd6e service nova] [instance: f9aeb7a5-24fd-4620-b316-0c7cf61a1300] Updating instance_info_cache with network_info: [{"id": "0deeb35a-47e5-44fe-843c-ed90df673a6b", "address": "fa:16:3e:1e:19:79", "network": {"id": "25afb78c-30e1-4fd7-a215-b5e73ba43057", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2008775745-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "098415c1690e46c39d52c0fee2719175", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0deeb35a-47", "ovs_interfaceid": "0deeb35a-47e5-44fe-843c-ed90df673a6b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 10:13:59 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-6a45ed9a-eaae-45e2-9739-632e0c7c9371 req-93fa3300-d9c8-4e20-964a-602e4e4bdd6e service nova] Releasing lock "refresh_cache-f9aeb7a5-24fd-4620-b316-0c7cf61a1300" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 10:14:01 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:14:02 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-b8b9219e-ed1e-4079-af92-d83efe806080 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Acquiring lock "f9aeb7a5-24fd-4620-b316-0c7cf61a1300" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:14:02 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-b8b9219e-ed1e-4079-af92-d83efe806080 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Lock "f9aeb7a5-24fd-4620-b316-0c7cf61a1300" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:14:02 user nova-compute[75122]: INFO nova.compute.manager [None req-b8b9219e-ed1e-4079-af92-d83efe806080 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] [instance: f9aeb7a5-24fd-4620-b316-0c7cf61a1300] Rebooting instance
Nov 15 10:14:02 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-b8b9219e-ed1e-4079-af92-d83efe806080 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Acquiring lock "refresh_cache-f9aeb7a5-24fd-4620-b316-0c7cf61a1300" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 10:14:02 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-b8b9219e-ed1e-4079-af92-d83efe806080 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Acquired lock "refresh_cache-f9aeb7a5-24fd-4620-b316-0c7cf61a1300" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 10:14:02 user nova-compute[75122]: DEBUG nova.network.neutron [None req-b8b9219e-ed1e-4079-af92-d83efe806080 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] [instance: f9aeb7a5-24fd-4620-b316-0c7cf61a1300] Building network info cache for instance {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 10:14:02 user nova-compute[75122]: DEBUG nova.network.neutron [None req-b8b9219e-ed1e-4079-af92-d83efe806080 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] [instance: f9aeb7a5-24fd-4620-b316-0c7cf61a1300] Updating instance_info_cache with network_info: [{"id": "0deeb35a-47e5-44fe-843c-ed90df673a6b", "address": "fa:16:3e:1e:19:79", "network": {"id": "25afb78c-30e1-4fd7-a215-b5e73ba43057", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2008775745-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "098415c1690e46c39d52c0fee2719175", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0deeb35a-47", "ovs_interfaceid": "0deeb35a-47e5-44fe-843c-ed90df673a6b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 10:14:03 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-b8b9219e-ed1e-4079-af92-d83efe806080 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Releasing lock "refresh_cache-f9aeb7a5-24fd-4620-b316-0c7cf61a1300" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 10:14:03 user nova-compute[75122]: DEBUG nova.compute.manager [None req-b8b9219e-ed1e-4079-af92-d83efe806080 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] [instance: f9aeb7a5-24fd-4620-b316-0c7cf61a1300] Checking state {{(pid=75122) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 10:14:03 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:14:03 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:14:03 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:14:03 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:14:03 user nova-compute[75122]: DEBUG nova.compute.manager [req-135c4c11-1469-4de4-8569-5dbabd2c22f2 req-26e2df32-7b89-4ddc-864e-e168b6516b9f service nova] [instance: f9aeb7a5-24fd-4620-b316-0c7cf61a1300] Received event network-vif-unplugged-0deeb35a-47e5-44fe-843c-ed90df673a6b {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 10:14:03 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-135c4c11-1469-4de4-8569-5dbabd2c22f2 req-26e2df32-7b89-4ddc-864e-e168b6516b9f service nova] Acquiring lock "f9aeb7a5-24fd-4620-b316-0c7cf61a1300-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:14:03 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-135c4c11-1469-4de4-8569-5dbabd2c22f2 req-26e2df32-7b89-4ddc-864e-e168b6516b9f service nova] Lock "f9aeb7a5-24fd-4620-b316-0c7cf61a1300-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:14:03 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-135c4c11-1469-4de4-8569-5dbabd2c22f2 req-26e2df32-7b89-4ddc-864e-e168b6516b9f service nova] Lock "f9aeb7a5-24fd-4620-b316-0c7cf61a1300-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:14:03 user nova-compute[75122]: DEBUG nova.compute.manager [req-135c4c11-1469-4de4-8569-5dbabd2c22f2 req-26e2df32-7b89-4ddc-864e-e168b6516b9f service nova] [instance: f9aeb7a5-24fd-4620-b316-0c7cf61a1300] No waiting events found dispatching network-vif-unplugged-0deeb35a-47e5-44fe-843c-ed90df673a6b {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 10:14:03 user nova-compute[75122]: WARNING nova.compute.manager [req-135c4c11-1469-4de4-8569-5dbabd2c22f2 req-26e2df32-7b89-4ddc-864e-e168b6516b9f service nova] [instance: f9aeb7a5-24fd-4620-b316-0c7cf61a1300] Received unexpected event network-vif-unplugged-0deeb35a-47e5-44fe-843c-ed90df673a6b for instance with vm_state active and task_state reboot_started_hard.
Nov 15 10:14:03 user nova-compute[75122]: INFO nova.virt.libvirt.driver [-] [instance: f9aeb7a5-24fd-4620-b316-0c7cf61a1300] Instance destroyed successfully.
Nov 15 10:14:03 user nova-compute[75122]: DEBUG nova.objects.instance [None req-b8b9219e-ed1e-4079-af92-d83efe806080 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Lazy-loading 'resources' on Instance uuid f9aeb7a5-24fd-4620-b316-0c7cf61a1300 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 10:14:03 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-b8b9219e-ed1e-4079-af92-d83efe806080 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T10:11:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-812380502',display_name='tempest-TestMinimumBasicScenario-server-812380502',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-812380502',id=51,image_ref='02d0adab-5e82-436a-9cd3-600747b978f4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHfJyCffkl4NUz9yhB8dcWwiE0TpZ4ni7aEudvjypqUXSPGrXr6WQ3j8fmAVohqqgwzb7kLVCC9xi7QRRWiHP0aiWrfZnwjyt08+MD7x45ML53V8AoefdnGpsiXlJlkf6Q==',key_name='tempest-TestMinimumBasicScenario-65289387',keypairs=<?>,launch_index=0,launched_at=2023-11-15T10:11:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='098415c1690e46c39d52c0fee2719175',ramdisk_id='',reservation_id='r-d1k6umut',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='02d0adab-5e82-436a-9cd3-600747b978f4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1402308121',owner_user_name='tempest-TestMinimumBasicScenario-1402308121-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T10:14:03Z,user_data=None,user_id='f3f4814249ab42d399b77e5b8040ec8b',uuid=f9aeb7a5-24fd-4620-b316-0c7cf61a1300,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0deeb35a-47e5-44fe-843c-ed90df673a6b", "address": "fa:16:3e:1e:19:79", "network": {"id": "25afb78c-30e1-4fd7-a215-b5e73ba43057", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2008775745-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "098415c1690e46c39d52c0fee2719175", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0deeb35a-47", "ovs_interfaceid": "0deeb35a-47e5-44fe-843c-ed90df673a6b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 10:14:03 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-b8b9219e-ed1e-4079-af92-d83efe806080 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Converting VIF {"id": "0deeb35a-47e5-44fe-843c-ed90df673a6b", "address": "fa:16:3e:1e:19:79", "network": {"id": "25afb78c-30e1-4fd7-a215-b5e73ba43057", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2008775745-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "098415c1690e46c39d52c0fee2719175", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0deeb35a-47", "ovs_interfaceid": "0deeb35a-47e5-44fe-843c-ed90df673a6b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 10:14:03 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-b8b9219e-ed1e-4079-af92-d83efe806080 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1e:19:79,bridge_name='br-int',has_traffic_filtering=True,id=0deeb35a-47e5-44fe-843c-ed90df673a6b,network=Network(25afb78c-30e1-4fd7-a215-b5e73ba43057),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0deeb35a-47') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 10:14:03 user nova-compute[75122]: DEBUG os_vif [None req-b8b9219e-ed1e-4079-af92-d83efe806080 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1e:19:79,bridge_name='br-int',has_traffic_filtering=True,id=0deeb35a-47e5-44fe-843c-ed90df673a6b,network=Network(25afb78c-30e1-4fd7-a215-b5e73ba43057),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0deeb35a-47') {{(pid=75122) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 10:14:03 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:14:03 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0deeb35a-47, bridge=br-int, if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 10:14:03 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:14:03 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:14:03 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:14:03 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6911776f-29bd-4314-b727-44afdde0144d) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 10:14:03 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:14:03 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:14:03 user nova-compute[75122]: INFO os_vif [None req-b8b9219e-ed1e-4079-af92-d83efe806080 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1e:19:79,bridge_name='br-int',has_traffic_filtering=True,id=0deeb35a-47e5-44fe-843c-ed90df673a6b,network=Network(25afb78c-30e1-4fd7-a215-b5e73ba43057),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0deeb35a-47')
Nov 15 10:14:03 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b8b9219e-ed1e-4079-af92-d83efe806080 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] [instance: f9aeb7a5-24fd-4620-b316-0c7cf61a1300] calling os-brick to detach iSCSI Volume {{(pid=75122) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 10:14:03 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8b9219e-ed1e-4079-af92-d83efe806080 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffa04060b80>, {'target_iqn': 'iqn.2010-10.org.openstack:a06f0d94-61c1-4bba-ad00-6cf16efdad55', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eVMrHjOL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 10:14:03 user nova-compute[75122]: WARNING os_brick.initiator.connectors.base [None req-b8b9219e-ed1e-4079-af92-d83efe806080 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 10:14:03 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-b8b9219e-ed1e-4079-af92-d83efe806080 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 10:14:03 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-b8b9219e-ed1e-4079-af92-d83efe806080 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 10:14:03 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:14:03 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:14:03 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[943c16a1-654d-4b61-a74e-0d85e0a3b2de]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a06f0d94-61c1-4bba-ad00-6cf16efdad55\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:14:03 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8b9219e-ed1e-4079-af92-d83efe806080 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 10:14:03 user nova-compute[75122]: No targets found.
Nov 15 10:14:03 user nova-compute[75122]: iSNS:
Nov 15 10:14:03 user nova-compute[75122]: No targets found.
Nov 15 10:14:03 user nova-compute[75122]: STATIC:
Nov 15 10:14:03 user nova-compute[75122]: Target: iqn.2010-10.org.openstack:a06f0d94-61c1-4bba-ad00-6cf16efdad55
Nov 15 10:14:03 user nova-compute[75122]:         Portal: 172.16.0.220:3260,-1
Nov 15 10:14:03 user nova-compute[75122]:                 Iface Name: default
Nov 15 10:14:03 user nova-compute[75122]: FIRMWARE:
Nov 15 10:14:03 user nova-compute[75122]: No targets found.
Nov 15 10:14:03 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 10:14:03 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8b9219e-ed1e-4079-af92-d83efe806080 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 10:14:03 user nova-compute[75122]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 10:14:03 user nova-compute[75122]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75122) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 10:14:03 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8b9219e-ed1e-4079-af92-d83efe806080 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a06f0d94-61c1-4bba-ad00-6cf16efdad55', 0)] {{(pid=75122) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 10:14:03 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:14:04 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:14:04 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[01ca3731-7304-4312-8d8b-4f8700b51626]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a06f0d94-61c1-4bba-ad00-6cf16efdad55\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:14:04 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:14:04 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:14:04 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8710b49-2239-4074-8908-f85f6c71d49d]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a06f0d94-61c1-4bba-ad00-6cf16efdad55 (non-flash)\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:14:04 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8b9219e-ed1e-4079-af92-d83efe806080 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a06f0d94-61c1-4bba-ad00-6cf16efdad55 (non-flash)
Nov 15 10:14:04 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 10:14:04 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8b9219e-ed1e-4079-af92-d83efe806080 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a06f0d94-61c1-4bba-ad00-6cf16efdad55 (non-flash)
Nov 15 10:14:04 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 10:14:04 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8b9219e-ed1e-4079-af92-d83efe806080 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff9e44eecb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a06f0d94-61c1-4bba-ad00-6cf16efdad55'): ({'sdb'}, set())}) {{(pid=75122) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 10:14:04 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-b8b9219e-ed1e-4079-af92-d83efe806080 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Removing single pathed devices sdb {{(pid=75122) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 10:14:04 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:14:04 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:14:04 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[14c29282-de8d-4c60-920b-57cf2a150fba]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:14:04 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:14:04 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:14:04 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf9e8e4e-c0d8-4f10-b0e7-7255f7f5046d]: (4, ('ok\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:14:04 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-b8b9219e-ed1e-4079-af92-d83efe806080 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Flushing IO for device /dev/sdb {{(pid=75122) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 10:14:04 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:14:04 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:14:04 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[39e3e594-84d1-43ce-85c8-5e862b09cae8]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:14:04 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-b8b9219e-ed1e-4079-af92-d83efe806080 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75122) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 10:14:04 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:14:04 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.036s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:14:04 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[593fffbc-338a-44ac-9495-f877048dc339]: (4, ('1', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:14:04 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-b8b9219e-ed1e-4079-af92-d83efe806080 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75122) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 10:14:04 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-b8b9219e-ed1e-4079-af92-d83efe806080 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] SCSI volumes sdb have been removed. {{(pid=75122) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 10:14:04 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8b9219e-ed1e-4079-af92-d83efe806080 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a06f0d94-61c1-4bba-ad00-6cf16efdad55')] {{(pid=75122) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 10:14:04 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a06f0d94-61c1-4bba-ad00-6cf16efdad55 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:14:04 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a06f0d94-61c1-4bba-ad00-6cf16efdad55 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:14:04 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b5e95ad-d397-4273-966a-a535bd0bee81]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:14:04 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8b9219e-ed1e-4079-af92-d83efe806080 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 10:14:04 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a06f0d94-61c1-4bba-ad00-6cf16efdad55 -p 172.16.0.220:3260 --logout {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:14:04 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a06f0d94-61c1-4bba-ad00-6cf16efdad55 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:14:04 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0ab5fc5-0a9b-4732-a7a6-4b6cd41474fb]: (4, ('Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:a06f0d94-61c1-4bba-ad00-6cf16efdad55, portal: 172.16.0.220,3260]\nLogout of [sid: 61, target: iqn.2010-10.org.openstack:a06f0d94-61c1-4bba-ad00-6cf16efdad55, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:14:04 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8b9219e-ed1e-4079-af92-d83efe806080 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:a06f0d94-61c1-4bba-ad00-6cf16efdad55, portal: 172.16.0.220,3260]
Nov 15 10:14:04 user nova-compute[75122]: Logout of [sid: 61, target: iqn.2010-10.org.openstack:a06f0d94-61c1-4bba-ad00-6cf16efdad55, portal: 172.16.0.220,3260] successful.
Nov 15 10:14:04 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 10:14:04 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a06f0d94-61c1-4bba-ad00-6cf16efdad55 -p 172.16.0.220:3260 --op delete {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:14:04 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a06f0d94-61c1-4bba-ad00-6cf16efdad55 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:14:04 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aabf445-3b25-499d-bd70-b077a68e1598]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:14:04 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8b9219e-ed1e-4079-af92-d83efe806080 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 10:14:04 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-b8b9219e-ed1e-4079-af92-d83efe806080 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.284s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 10:14:04 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8b9219e-ed1e-4079-af92-d83efe806080 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] <== disconnect_volume: return (286ms) None {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 10:14:04 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b8b9219e-ed1e-4079-af92-d83efe806080 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] [instance: f9aeb7a5-24fd-4620-b316-0c7cf61a1300] Disconnected iSCSI Volume {{(pid=75122) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 10:14:04 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-b8b9219e-ed1e-4079-af92-d83efe806080 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] [instance: f9aeb7a5-24fd-4620-b316-0c7cf61a1300] Start _get_guest_xml network_info=[{"id": "0deeb35a-47e5-44fe-843c-ed90df673a6b", "address": "fa:16:3e:1e:19:79", "network": {"id": "25afb78c-30e1-4fd7-a215-b5e73ba43057", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2008775745-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "098415c1690e46c39d52c0fee2719175", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0deeb35a-47", "ovs_interfaceid": "0deeb35a-47e5-44fe-843c-ed90df673a6b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=02d0adab-5e82-436a-9cd3-600747b978f4,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '02d0adab-5e82-436a-9cd3-600747b978f4'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a06f0d94-61c1-4bba-ad00-6cf16efdad55', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eVMrHjOL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'f9aeb7a5-24fd-4620-b316-0c7cf61a1300', 'attached_at': '', 'detached_at': '', 'volume_id': 'a06f0d94-61c1-4bba-ad00-6cf16efdad55', 'serial': 'a06f0d94-61c1-4bba-ad00-6cf16efdad55'}, 'guest_format': None, 'delete_on_termination': False, 'boot_index': None, 'disk_bus': 'virtio', 'device_type': 'disk', 'mount_device': '/dev/vdb', 'attachment_id': '36fe0375-fa7c-41d3-82bd-04bb5cea7ed3', 'volume_type': None} {{(pid=75122) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 10:14:04 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-b8b9219e-ed1e-4079-af92-d83efe806080 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 10:14:04 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-b8b9219e-ed1e-4079-af92-d83efe806080 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 10:14:04 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-b8b9219e-ed1e-4079-af92-d83efe806080 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75122) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 10:14:04 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-b8b9219e-ed1e-4079-af92-d83efe806080 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] CPU controller missing on host. {{(pid=75122) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 10:14:04 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-b8b9219e-ed1e-4079-af92-d83efe806080 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75122) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 10:14:04 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-b8b9219e-ed1e-4079-af92-d83efe806080 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] CPU controller found on host. {{(pid=75122) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 10:14:04 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-b8b9219e-ed1e-4079-af92-d83efe806080 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75122) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 10:14:04 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-b8b9219e-ed1e-4079-af92-d83efe806080 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T09:26:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=02d0adab-5e82-436a-9cd3-600747b978f4,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 10:14:04 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-b8b9219e-ed1e-4079-af92-d83efe806080 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Flavor limits 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 10:14:04 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-b8b9219e-ed1e-4079-af92-d83efe806080 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Image limits 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 10:14:04 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-b8b9219e-ed1e-4079-af92-d83efe806080 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Flavor pref 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 10:14:04 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-b8b9219e-ed1e-4079-af92-d83efe806080 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Image pref 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 10:14:04 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-b8b9219e-ed1e-4079-af92-d83efe806080 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 10:14:04 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-b8b9219e-ed1e-4079-af92-d83efe806080 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 10:14:04 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-b8b9219e-ed1e-4079-af92-d83efe806080 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75122) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 10:14:04 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-b8b9219e-ed1e-4079-af92-d83efe806080 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Got 1 possible topologies {{(pid=75122) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 10:14:04 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-b8b9219e-ed1e-4079-af92-d83efe806080 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 10:14:04 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-b8b9219e-ed1e-4079-af92-d83efe806080 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 10:14:04 user nova-compute[75122]: DEBUG nova.objects.instance [None req-b8b9219e-ed1e-4079-af92-d83efe806080 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Lazy-loading 'vcpu_model' on Instance uuid f9aeb7a5-24fd-4620-b316-0c7cf61a1300 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 10:14:04 user nova-compute[75122]: DEBUG nova.objects.base [None req-b8b9219e-ed1e-4079-af92-d83efe806080 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Object Instance<f9aeb7a5-24fd-4620-b316-0c7cf61a1300> lazy-loaded attributes: resources,vcpu_model {{(pid=75122) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 10:14:04 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b8b9219e-ed1e-4079-af92-d83efe806080 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] [instance: f9aeb7a5-24fd-4620-b316-0c7cf61a1300] Calling os-brick to attach iSCSI Volume {{(pid=75122) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 10:14:04 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8b9219e-ed1e-4079-af92-d83efe806080 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffa04060b80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a06f0d94-61c1-4bba-ad00-6cf16efdad55', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eVMrHjOL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 10:14:04 user nova-compute[75122]: WARNING os_brick.initiator.connectors.base [None req-b8b9219e-ed1e-4079-af92-d83efe806080 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 10:14:04 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-b8b9219e-ed1e-4079-af92-d83efe806080 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 10:14:04 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-b8b9219e-ed1e-4079-af92-d83efe806080 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 10:14:04 user nova-compute[75122]: WARNING os_brick.initiator.connectors.base [None req-b8b9219e-ed1e-4079-af92-d83efe806080 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 10:14:04 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-b8b9219e-ed1e-4079-af92-d83efe806080 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a06f0d94-61c1-4bba-ad00-6cf16efdad55" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 10:14:04 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-b8b9219e-ed1e-4079-af92-d83efe806080 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a06f0d94-61c1-4bba-ad00-6cf16efdad55" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 10:14:04 user nova-compute[75122]: INFO os_brick.initiator.connectors.iscsi [None req-b8b9219e-ed1e-4079-af92-d83efe806080 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 10:14:04 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a06f0d94-61c1-4bba-ad00-6cf16efdad55 -p 172.16.0.220:3260 {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:14:04 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a06f0d94-61c1-4bba-ad00-6cf16efdad55 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:14:04 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f8ae3e4-e11e-4238-a8ed-fe5fe903de7e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:14:04 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8b9219e-ed1e-4079-af92-d83efe806080 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 10:14:04 user nova-compute[75122]:  {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 10:14:04 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a06f0d94-61c1-4bba-ad00-6cf16efdad55 -p 172.16.0.220:3260 --interface default --op new {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:14:04 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a06f0d94-61c1-4bba-ad00-6cf16efdad55 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:14:04 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[2601c44b-a16c-4984-9469-f97d35fa2678]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a06f0d94-61c1-4bba-ad00-6cf16efdad55] added\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:14:04 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8b9219e-ed1e-4079-af92-d83efe806080 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a06f0d94-61c1-4bba-ad00-6cf16efdad55] added
Nov 15 10:14:04 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 10:14:04 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a06f0d94-61c1-4bba-ad00-6cf16efdad55 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:14:04 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a06f0d94-61c1-4bba-ad00-6cf16efdad55 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:14:04 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[b332aa27-7b0e-4c7e-b862-f95e13e3af69]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:14:04 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8b9219e-ed1e-4079-af92-d83efe806080 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 10:14:04 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a06f0d94-61c1-4bba-ad00-6cf16efdad55 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:14:04 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a06f0d94-61c1-4bba-ad00-6cf16efdad55 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:14:04 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[178f4ced-11b4-4d23-8884-72adb52f5cb2]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:14:04 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8b9219e-ed1e-4079-af92-d83efe806080 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 10:14:04 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a06f0d94-61c1-4bba-ad00-6cf16efdad55 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eVMrHjOL {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:14:04 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a06f0d94-61c1-4bba-ad00-6cf16efdad55 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eVMrHjOL" returned: 0 in 0.020s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:14:04 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e656fc7-f52c-4640-86a3-f6d96b14a7b2]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:14:04 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8b9219e-ed1e-4079-af92-d83efe806080 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'eVMrHjOL'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 10:14:04 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a06f0d94-61c1-4bba-ad00-6cf16efdad55 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:14:04 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a06f0d94-61c1-4bba-ad00-6cf16efdad55 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:14:04 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[64b627e7-35f1-4930-b318-b22acee76c02]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:14:04 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8b9219e-ed1e-4079-af92-d83efe806080 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 10:14:04 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:14:04 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:14:04 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac306471-950b-40bc-8f5f-f29616dac406]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:14:04 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8b9219e-ed1e-4079-af92-d83efe806080 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 15 10:14:04 user nova-compute[75122]:  {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 10:14:04 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8b9219e-ed1e-4079-af92-d83efe806080 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 15 10:14:04 user nova-compute[75122]:  {{(pid=75122) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 10:14:04 user nova-compute[75122]: WARNING os_brick.initiator.connectors.iscsi [None req-b8b9219e-ed1e-4079-af92-d83efe806080 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 15 10:14:04 user nova-compute[75122]: 
Nov 15 10:14:04 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a06f0d94-61c1-4bba-ad00-6cf16efdad55 -p 172.16.0.220:3260 --login {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:14:04 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a06f0d94-61c1-4bba-ad00-6cf16efdad55 -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:14:04 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[012923c6-3777-4bd5-b7ce-9630d92891da]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a06f0d94-61c1-4bba-ad00-6cf16efdad55, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a06f0d94-61c1-4bba-ad00-6cf16efdad55, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:14:04 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8b9219e-ed1e-4079-af92-d83efe806080 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a06f0d94-61c1-4bba-ad00-6cf16efdad55, portal: 172.16.0.220,3260]
Nov 15 10:14:04 user nova-compute[75122]: Login to [iface: default, target: iqn.2010-10.org.openstack:a06f0d94-61c1-4bba-ad00-6cf16efdad55, portal: 172.16.0.220,3260] successful.
Nov 15 10:14:04 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 10:14:04 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a06f0d94-61c1-4bba-ad00-6cf16efdad55 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:14:04 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a06f0d94-61c1-4bba-ad00-6cf16efdad55 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:14:04 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[79722679-f882-4a0c-b925-13004c4dfdee]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:14:04 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8b9219e-ed1e-4079-af92-d83efe806080 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 10:14:04 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:14:04 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:14:04 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[da02e8b6-7c23-4e11-bcfc-3b499e715b4c]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a06f0d94-61c1-4bba-ad00-6cf16efdad55 (non-flash)\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:14:04 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8b9219e-ed1e-4079-af92-d83efe806080 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a06f0d94-61c1-4bba-ad00-6cf16efdad55 (non-flash)
Nov 15 10:14:04 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 10:14:04 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8b9219e-ed1e-4079-af92-d83efe806080 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a06f0d94-61c1-4bba-ad00-6cf16efdad55 (non-flash)
Nov 15 10:14:04 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 10:14:04 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-b8b9219e-ed1e-4079-af92-d83efe806080 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a06f0d94-61c1-4bba-ad00-6cf16efdad55" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.266s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 10:14:04 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8b9219e-ed1e-4079-af92-d83efe806080 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Connected to 172.16.0.220:3260 {{(pid=75122) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 10:14:04 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-b8b9219e-ed1e-4079-af92-d83efe806080 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] HCTL ('33', '-', '-', 0) found on session 62 with lun 0 {{(pid=75122) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 10:14:04 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-b8b9219e-ed1e-4079-af92-d83efe806080 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75122) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 10:14:04 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:14:04 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:14:04 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[62bcd8a1-7f36-4dab-8a17-6a30287a59be]: (4, ('- - 0', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:14:04 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-b8b9219e-ed1e-4079-af92-d83efe806080 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Searching for a device in session 62 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75122) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 10:14:04 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8b9219e-ed1e-4079-af92-d83efe806080 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:a06f0d94-61c1-4bba-ad00-6cf16efdad55', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eVMrHjOL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75122) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 10:14:05 user nova-compute[75122]: DEBUG nova.compute.manager [req-10c4b04b-07fe-423e-b0df-2da4d01c8715 req-871b594a-1e66-4509-9c0b-d9cf57777679 service nova] [instance: f9aeb7a5-24fd-4620-b316-0c7cf61a1300] Received event network-vif-plugged-0deeb35a-47e5-44fe-843c-ed90df673a6b {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 10:14:05 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-10c4b04b-07fe-423e-b0df-2da4d01c8715 req-871b594a-1e66-4509-9c0b-d9cf57777679 service nova] Acquiring lock "f9aeb7a5-24fd-4620-b316-0c7cf61a1300-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:14:05 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-10c4b04b-07fe-423e-b0df-2da4d01c8715 req-871b594a-1e66-4509-9c0b-d9cf57777679 service nova] Lock "f9aeb7a5-24fd-4620-b316-0c7cf61a1300-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:14:05 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-10c4b04b-07fe-423e-b0df-2da4d01c8715 req-871b594a-1e66-4509-9c0b-d9cf57777679 service nova] Lock "f9aeb7a5-24fd-4620-b316-0c7cf61a1300-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:14:05 user nova-compute[75122]: DEBUG nova.compute.manager [req-10c4b04b-07fe-423e-b0df-2da4d01c8715 req-871b594a-1e66-4509-9c0b-d9cf57777679 service nova] [instance: f9aeb7a5-24fd-4620-b316-0c7cf61a1300] No waiting events found dispatching network-vif-plugged-0deeb35a-47e5-44fe-843c-ed90df673a6b {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 10:14:05 user nova-compute[75122]: WARNING nova.compute.manager [req-10c4b04b-07fe-423e-b0df-2da4d01c8715 req-871b594a-1e66-4509-9c0b-d9cf57777679 service nova] [instance: f9aeb7a5-24fd-4620-b316-0c7cf61a1300] Received unexpected event network-vif-plugged-0deeb35a-47e5-44fe-843c-ed90df673a6b for instance with vm_state active and task_state reboot_started_hard.
Nov 15 10:14:05 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-b8b9219e-ed1e-4079-af92-d83efe806080 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.298s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 10:14:05 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-b8b9219e-ed1e-4079-af92-d83efe806080 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] <== connect_volume: return (1299ms) {'type': 'block', 'scsi_wwn': '23931323162383762', 'path': '/dev/sdb'} {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 10:14:05 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b8b9219e-ed1e-4079-af92-d83efe806080 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] [instance: f9aeb7a5-24fd-4620-b316-0c7cf61a1300] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23931323162383762', 'path': '/dev/sdb'} {{(pid=75122) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 10:14:05 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-b8b9219e-ed1e-4079-af92-d83efe806080 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T10:11:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-812380502',display_name='tempest-TestMinimumBasicScenario-server-812380502',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-812380502',id=51,image_ref='02d0adab-5e82-436a-9cd3-600747b978f4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHfJyCffkl4NUz9yhB8dcWwiE0TpZ4ni7aEudvjypqUXSPGrXr6WQ3j8fmAVohqqgwzb7kLVCC9xi7QRRWiHP0aiWrfZnwjyt08+MD7x45ML53V8AoefdnGpsiXlJlkf6Q==',key_name='tempest-TestMinimumBasicScenario-65289387',keypairs=<?>,launch_index=0,launched_at=2023-11-15T10:11:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='098415c1690e46c39d52c0fee2719175',ramdisk_id='',reservation_id='r-d1k6umut',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='02d0adab-5e82-436a-9cd3-600747b978f4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1402308121',owner_user_name='tempest-TestMinimumBasicScenario-1402308121-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T10:14:03Z,user_data=None,user_id='f3f4814249ab42d399b77e5b8040ec8b',uuid=f9aeb7a5-24fd-4620-b316-0c7cf61a1300,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0deeb35a-47e5-44fe-843c-ed90df673a6b", "address": "fa:16:3e:1e:19:79", "network": {"id": "25afb78c-30e1-4fd7-a215-b5e73ba43057", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2008775745-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "098415c1690e46c39d52c0fee2719175", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0deeb35a-47", "ovs_interfaceid": "0deeb35a-47e5-44fe-843c-ed90df673a6b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75122) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 10:14:05 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-b8b9219e-ed1e-4079-af92-d83efe806080 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Converting VIF {"id": "0deeb35a-47e5-44fe-843c-ed90df673a6b", "address": "fa:16:3e:1e:19:79", "network": {"id": "25afb78c-30e1-4fd7-a215-b5e73ba43057", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2008775745-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "098415c1690e46c39d52c0fee2719175", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0deeb35a-47", "ovs_interfaceid": "0deeb35a-47e5-44fe-843c-ed90df673a6b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 10:14:05 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-b8b9219e-ed1e-4079-af92-d83efe806080 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1e:19:79,bridge_name='br-int',has_traffic_filtering=True,id=0deeb35a-47e5-44fe-843c-ed90df673a6b,network=Network(25afb78c-30e1-4fd7-a215-b5e73ba43057),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0deeb35a-47') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 10:14:05 user nova-compute[75122]: DEBUG nova.objects.instance [None req-b8b9219e-ed1e-4079-af92-d83efe806080 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Lazy-loading 'pci_devices' on Instance uuid f9aeb7a5-24fd-4620-b316-0c7cf61a1300 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 10:14:05 user nova-compute[75122]: DEBUG nova.objects.base [None req-b8b9219e-ed1e-4079-af92-d83efe806080 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Object Instance<f9aeb7a5-24fd-4620-b316-0c7cf61a1300> lazy-loaded attributes: resources,vcpu_model,pci_devices {{(pid=75122) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 10:14:05 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-b8b9219e-ed1e-4079-af92-d83efe806080 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] [instance: f9aeb7a5-24fd-4620-b316-0c7cf61a1300] End _get_guest_xml xml=<domain type="kvm">
Nov 15 10:14:05 user nova-compute[75122]:   <uuid>f9aeb7a5-24fd-4620-b316-0c7cf61a1300</uuid>
Nov 15 10:14:05 user nova-compute[75122]:   <name>instance-00000033</name>
Nov 15 10:14:05 user nova-compute[75122]:   <memory>524288</memory>
Nov 15 10:14:05 user nova-compute[75122]:   <vcpu>1</vcpu>
Nov 15 10:14:05 user nova-compute[75122]:   <metadata>
Nov 15 10:14:05 user nova-compute[75122]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 10:14:05 user nova-compute[75122]:       <nova:package version="0.0.0"/>
Nov 15 10:14:05 user nova-compute[75122]:       <nova:name>tempest-TestMinimumBasicScenario-server-812380502</nova:name>
Nov 15 10:14:05 user nova-compute[75122]:       <nova:creationTime>2023-11-15 10:14:04</nova:creationTime>
Nov 15 10:14:05 user nova-compute[75122]:       <nova:flavor name="m1.tiny">
Nov 15 10:14:05 user nova-compute[75122]:         <nova:memory>512</nova:memory>
Nov 15 10:14:05 user nova-compute[75122]:         <nova:disk>1</nova:disk>
Nov 15 10:14:05 user nova-compute[75122]:         <nova:swap>0</nova:swap>
Nov 15 10:14:05 user nova-compute[75122]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 10:14:05 user nova-compute[75122]:         <nova:vcpus>1</nova:vcpus>
Nov 15 10:14:05 user nova-compute[75122]:       </nova:flavor>
Nov 15 10:14:05 user nova-compute[75122]:       <nova:owner>
Nov 15 10:14:05 user nova-compute[75122]:         <nova:user uuid="f3f4814249ab42d399b77e5b8040ec8b">tempest-TestMinimumBasicScenario-1402308121-project-member</nova:user>
Nov 15 10:14:05 user nova-compute[75122]:         <nova:project uuid="098415c1690e46c39d52c0fee2719175">tempest-TestMinimumBasicScenario-1402308121</nova:project>
Nov 15 10:14:05 user nova-compute[75122]:       </nova:owner>
Nov 15 10:14:05 user nova-compute[75122]:       <nova:root type="image" uuid="02d0adab-5e82-436a-9cd3-600747b978f4"/>
Nov 15 10:14:05 user nova-compute[75122]:       <nova:ports>
Nov 15 10:14:05 user nova-compute[75122]:         <nova:port uuid="0deeb35a-47e5-44fe-843c-ed90df673a6b">
Nov 15 10:14:05 user nova-compute[75122]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 15 10:14:05 user nova-compute[75122]:         </nova:port>
Nov 15 10:14:05 user nova-compute[75122]:       </nova:ports>
Nov 15 10:14:05 user nova-compute[75122]:     </nova:instance>
Nov 15 10:14:05 user nova-compute[75122]:   </metadata>
Nov 15 10:14:05 user nova-compute[75122]:   <sysinfo type="smbios">
Nov 15 10:14:05 user nova-compute[75122]:     <system>
Nov 15 10:14:05 user nova-compute[75122]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 10:14:05 user nova-compute[75122]:       <entry name="product">OpenStack Nova</entry>
Nov 15 10:14:05 user nova-compute[75122]:       <entry name="version">0.0.0</entry>
Nov 15 10:14:05 user nova-compute[75122]:       <entry name="serial">f9aeb7a5-24fd-4620-b316-0c7cf61a1300</entry>
Nov 15 10:14:05 user nova-compute[75122]:       <entry name="uuid">f9aeb7a5-24fd-4620-b316-0c7cf61a1300</entry>
Nov 15 10:14:05 user nova-compute[75122]:       <entry name="family">Virtual Machine</entry>
Nov 15 10:14:05 user nova-compute[75122]:     </system>
Nov 15 10:14:05 user nova-compute[75122]:   </sysinfo>
Nov 15 10:14:05 user nova-compute[75122]:   <os>
Nov 15 10:14:05 user nova-compute[75122]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 10:14:05 user nova-compute[75122]:     <boot dev="hd"/>
Nov 15 10:14:05 user nova-compute[75122]:     <smbios mode="sysinfo"/>
Nov 15 10:14:05 user nova-compute[75122]:   </os>
Nov 15 10:14:05 user nova-compute[75122]:   <features>
Nov 15 10:14:05 user nova-compute[75122]:     <acpi/>
Nov 15 10:14:05 user nova-compute[75122]:     <apic/>
Nov 15 10:14:05 user nova-compute[75122]:     <vmcoreinfo/>
Nov 15 10:14:05 user nova-compute[75122]:   </features>
Nov 15 10:14:05 user nova-compute[75122]:   <clock offset="utc">
Nov 15 10:14:05 user nova-compute[75122]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 10:14:05 user nova-compute[75122]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 10:14:05 user nova-compute[75122]:     <timer name="hpet" present="no"/>
Nov 15 10:14:05 user nova-compute[75122]:   </clock>
Nov 15 10:14:05 user nova-compute[75122]:   <cpu mode="custom" match="exact">
Nov 15 10:14:05 user nova-compute[75122]:     <model>Nehalem</model>
Nov 15 10:14:05 user nova-compute[75122]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 10:14:05 user nova-compute[75122]:   </cpu>
Nov 15 10:14:05 user nova-compute[75122]:   <devices>
Nov 15 10:14:05 user nova-compute[75122]:     <disk type="file" device="disk">
Nov 15 10:14:05 user nova-compute[75122]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 10:14:05 user nova-compute[75122]:       <source file="/opt/stack/data/nova/instances/f9aeb7a5-24fd-4620-b316-0c7cf61a1300/disk"/>
Nov 15 10:14:05 user nova-compute[75122]:       <target dev="vda" bus="virtio"/>
Nov 15 10:14:05 user nova-compute[75122]:     </disk>
Nov 15 10:14:05 user nova-compute[75122]:     <disk type="block" device="disk">
Nov 15 10:14:05 user nova-compute[75122]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 10:14:05 user nova-compute[75122]:       <source dev="/dev/sdb"/>
Nov 15 10:14:05 user nova-compute[75122]:       <target dev="vdb" bus="virtio"/>
Nov 15 10:14:05 user nova-compute[75122]:       <serial>a06f0d94-61c1-4bba-ad00-6cf16efdad55</serial>
Nov 15 10:14:05 user nova-compute[75122]:     </disk>
Nov 15 10:14:05 user nova-compute[75122]:     <interface type="ethernet">
Nov 15 10:14:05 user nova-compute[75122]:       <mac address="fa:16:3e:1e:19:79"/>
Nov 15 10:14:05 user nova-compute[75122]:       <model type="virtio"/>
Nov 15 10:14:05 user nova-compute[75122]:       <mtu size="1442"/>
Nov 15 10:14:05 user nova-compute[75122]:       <target dev="tap0deeb35a-47"/>
Nov 15 10:14:05 user nova-compute[75122]:     </interface>
Nov 15 10:14:05 user nova-compute[75122]:     <serial type="pty">
Nov 15 10:14:05 user nova-compute[75122]:       <log file="/opt/stack/data/nova/instances/f9aeb7a5-24fd-4620-b316-0c7cf61a1300/console.log" append="off"/>
Nov 15 10:14:05 user nova-compute[75122]:     </serial>
Nov 15 10:14:05 user nova-compute[75122]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 10:14:05 user nova-compute[75122]:     <video>
Nov 15 10:14:05 user nova-compute[75122]:       <model type="virtio"/>
Nov 15 10:14:05 user nova-compute[75122]:     </video>
Nov 15 10:14:05 user nova-compute[75122]:     <rng model="virtio">
Nov 15 10:14:05 user nova-compute[75122]:       <backend model="random">/dev/urandom</backend>
Nov 15 10:14:05 user nova-compute[75122]:     </rng>
Nov 15 10:14:05 user nova-compute[75122]:     <controller type="usb" index="0" model="none"/>
Nov 15 10:14:05 user nova-compute[75122]:     <memballoon model="virtio">
Nov 15 10:14:05 user nova-compute[75122]:       <stats period="10"/>
Nov 15 10:14:05 user nova-compute[75122]:     </memballoon>
Nov 15 10:14:05 user nova-compute[75122]:   </devices>
Nov 15 10:14:05 user nova-compute[75122]: </domain>
Nov 15 10:14:05 user nova-compute[75122]:  {{(pid=75122) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 10:14:05 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-b8b9219e-ed1e-4079-af92-d83efe806080 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9aeb7a5-24fd-4620-b316-0c7cf61a1300/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:14:05 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-b8b9219e-ed1e-4079-af92-d83efe806080 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9aeb7a5-24fd-4620-b316-0c7cf61a1300/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:14:05 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-b8b9219e-ed1e-4079-af92-d83efe806080 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9aeb7a5-24fd-4620-b316-0c7cf61a1300/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:14:06 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-b8b9219e-ed1e-4079-af92-d83efe806080 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9aeb7a5-24fd-4620-b316-0c7cf61a1300/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:14:06 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-b8b9219e-ed1e-4079-af92-d83efe806080 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75122) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 10:14:06 user nova-compute[75122]: DEBUG nova.objects.instance [None req-b8b9219e-ed1e-4079-af92-d83efe806080 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Lazy-loading 'trusted_certs' on Instance uuid f9aeb7a5-24fd-4620-b316-0c7cf61a1300 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 10:14:06 user nova-compute[75122]: DEBUG nova.objects.base [None req-b8b9219e-ed1e-4079-af92-d83efe806080 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Object Instance<f9aeb7a5-24fd-4620-b316-0c7cf61a1300> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs {{(pid=75122) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 10:14:06 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-b8b9219e-ed1e-4079-af92-d83efe806080 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1ff43eb9a6daef8ff8d90f20106ff538059dfdd5 --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:14:06 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-b8b9219e-ed1e-4079-af92-d83efe806080 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1ff43eb9a6daef8ff8d90f20106ff538059dfdd5 --force-share --output=json" returned: 0 in 0.193s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:14:06 user nova-compute[75122]: DEBUG nova.virt.disk.api [None req-b8b9219e-ed1e-4079-af92-d83efe806080 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f9aeb7a5-24fd-4620-b316-0c7cf61a1300/disk. size=1073741824 {{(pid=75122) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 10:14:06 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-b8b9219e-ed1e-4079-af92-d83efe806080 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9aeb7a5-24fd-4620-b316-0c7cf61a1300/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:14:06 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-b8b9219e-ed1e-4079-af92-d83efe806080 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9aeb7a5-24fd-4620-b316-0c7cf61a1300/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:14:06 user nova-compute[75122]: DEBUG nova.virt.disk.api [None req-b8b9219e-ed1e-4079-af92-d83efe806080 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Cannot resize image /opt/stack/data/nova/instances/f9aeb7a5-24fd-4620-b316-0c7cf61a1300/disk to a smaller size. {{(pid=75122) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 10:14:06 user nova-compute[75122]: DEBUG nova.objects.instance [None req-b8b9219e-ed1e-4079-af92-d83efe806080 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Lazy-loading 'migration_context' on Instance uuid f9aeb7a5-24fd-4620-b316-0c7cf61a1300 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 10:14:06 user nova-compute[75122]: DEBUG nova.objects.base [None req-b8b9219e-ed1e-4079-af92-d83efe806080 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Object Instance<f9aeb7a5-24fd-4620-b316-0c7cf61a1300> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75122) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 10:14:06 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-b8b9219e-ed1e-4079-af92-d83efe806080 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T10:11:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-812380502',display_name='tempest-TestMinimumBasicScenario-server-812380502',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-812380502',id=51,image_ref='02d0adab-5e82-436a-9cd3-600747b978f4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHfJyCffkl4NUz9yhB8dcWwiE0TpZ4ni7aEudvjypqUXSPGrXr6WQ3j8fmAVohqqgwzb7kLVCC9xi7QRRWiHP0aiWrfZnwjyt08+MD7x45ML53V8AoefdnGpsiXlJlkf6Q==',key_name='tempest-TestMinimumBasicScenario-65289387',keypairs=<?>,launch_index=0,launched_at=2023-11-15T10:11:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='098415c1690e46c39d52c0fee2719175',ramdisk_id='',reservation_id='r-d1k6umut',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='02d0adab-5e82-436a-9cd3-600747b978f4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1402308121',owner_user_name='tempest-TestMinimumBasicScenario-1402308121-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T10:14:03Z,user_data=None,user_id='f3f4814249ab42d399b77e5b8040ec8b',uuid=f9aeb7a5-24fd-4620-b316-0c7cf61a1300,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0deeb35a-47e5-44fe-843c-ed90df673a6b", "address": "fa:16:3e:1e:19:79", "network": {"id": "25afb78c-30e1-4fd7-a215-b5e73ba43057", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2008775745-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "098415c1690e46c39d52c0fee2719175", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0deeb35a-47", "ovs_interfaceid": "0deeb35a-47e5-44fe-843c-ed90df673a6b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 10:14:06 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-b8b9219e-ed1e-4079-af92-d83efe806080 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Converting VIF {"id": "0deeb35a-47e5-44fe-843c-ed90df673a6b", "address": "fa:16:3e:1e:19:79", "network": {"id": "25afb78c-30e1-4fd7-a215-b5e73ba43057", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2008775745-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "098415c1690e46c39d52c0fee2719175", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0deeb35a-47", "ovs_interfaceid": "0deeb35a-47e5-44fe-843c-ed90df673a6b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 10:14:06 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-b8b9219e-ed1e-4079-af92-d83efe806080 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1e:19:79,bridge_name='br-int',has_traffic_filtering=True,id=0deeb35a-47e5-44fe-843c-ed90df673a6b,network=Network(25afb78c-30e1-4fd7-a215-b5e73ba43057),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0deeb35a-47') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 10:14:06 user nova-compute[75122]: DEBUG os_vif [None req-b8b9219e-ed1e-4079-af92-d83efe806080 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1e:19:79,bridge_name='br-int',has_traffic_filtering=True,id=0deeb35a-47e5-44fe-843c-ed90df673a6b,network=Network(25afb78c-30e1-4fd7-a215-b5e73ba43057),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0deeb35a-47') {{(pid=75122) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 10:14:06 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:14:06 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 10:14:06 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 10:14:06 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:14:06 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '44441b24-3be9-5f2b-9326-f7a69075e85a', '_type': 'linux-noop'}}, row=False) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 10:14:06 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:14:06 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:14:06 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:14:06 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0deeb35a-47, may_exist=True, interface_attrs={}) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 10:14:06 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0deeb35a-47, col_values=(('qos', UUID('9bb1d416-bb52-4375-ad14-2a53fba1f7d2')),), if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 10:14:06 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0deeb35a-47, col_values=(('external_ids', {'iface-id': '0deeb35a-47e5-44fe-843c-ed90df673a6b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1e:19:79', 'vm-uuid': 'f9aeb7a5-24fd-4620-b316-0c7cf61a1300'}),), if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 10:14:06 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:14:06 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:14:06 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:14:06 user nova-compute[75122]: INFO os_vif [None req-b8b9219e-ed1e-4079-af92-d83efe806080 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1e:19:79,bridge_name='br-int',has_traffic_filtering=True,id=0deeb35a-47e5-44fe-843c-ed90df673a6b,network=Network(25afb78c-30e1-4fd7-a215-b5e73ba43057),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0deeb35a-47')
Nov 15 10:14:06 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:14:07 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:14:07 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:14:07 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:14:07 user nova-compute[75122]: DEBUG nova.compute.manager [req-6898f036-5316-4047-b4ce-cac524ca5cd1 req-62843b09-4c24-4a11-91c1-d1375d6687de service nova] [instance: f9aeb7a5-24fd-4620-b316-0c7cf61a1300] Received event network-vif-plugged-0deeb35a-47e5-44fe-843c-ed90df673a6b {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 10:14:07 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-6898f036-5316-4047-b4ce-cac524ca5cd1 req-62843b09-4c24-4a11-91c1-d1375d6687de service nova] Acquiring lock "f9aeb7a5-24fd-4620-b316-0c7cf61a1300-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:14:07 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-6898f036-5316-4047-b4ce-cac524ca5cd1 req-62843b09-4c24-4a11-91c1-d1375d6687de service nova] Lock "f9aeb7a5-24fd-4620-b316-0c7cf61a1300-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:14:07 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-6898f036-5316-4047-b4ce-cac524ca5cd1 req-62843b09-4c24-4a11-91c1-d1375d6687de service nova] Lock "f9aeb7a5-24fd-4620-b316-0c7cf61a1300-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:14:07 user nova-compute[75122]: DEBUG nova.compute.manager [req-6898f036-5316-4047-b4ce-cac524ca5cd1 req-62843b09-4c24-4a11-91c1-d1375d6687de service nova] [instance: f9aeb7a5-24fd-4620-b316-0c7cf61a1300] No waiting events found dispatching network-vif-plugged-0deeb35a-47e5-44fe-843c-ed90df673a6b {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 10:14:07 user nova-compute[75122]: WARNING nova.compute.manager [req-6898f036-5316-4047-b4ce-cac524ca5cd1 req-62843b09-4c24-4a11-91c1-d1375d6687de service nova] [instance: f9aeb7a5-24fd-4620-b316-0c7cf61a1300] Received unexpected event network-vif-plugged-0deeb35a-47e5-44fe-843c-ed90df673a6b for instance with vm_state active and task_state reboot_started_hard.
Nov 15 10:14:08 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:14:08 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:14:08 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:14:08 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:14:09 user nova-compute[75122]: DEBUG nova.compute.manager [None req-b8b9219e-ed1e-4079-af92-d83efe806080 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] [instance: f9aeb7a5-24fd-4620-b316-0c7cf61a1300] Instance event wait completed in 0 seconds for  {{(pid=75122) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 10:14:09 user nova-compute[75122]: INFO nova.virt.libvirt.driver [-] [instance: f9aeb7a5-24fd-4620-b316-0c7cf61a1300] Instance rebooted successfully.
Nov 15 10:14:09 user nova-compute[75122]: DEBUG nova.compute.manager [None req-b8b9219e-ed1e-4079-af92-d83efe806080 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] [instance: f9aeb7a5-24fd-4620-b316-0c7cf61a1300] Checking state {{(pid=75122) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 10:14:09 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-b8b9219e-ed1e-4079-af92-d83efe806080 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Lock "f9aeb7a5-24fd-4620-b316-0c7cf61a1300" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.631s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:14:10 user nova-compute[75122]: DEBUG nova.compute.manager [req-fba0500f-b7de-4a0d-9860-e58398eca83f req-b08a36b1-bbeb-4732-b285-6b7207612d80 service nova] [instance: f9aeb7a5-24fd-4620-b316-0c7cf61a1300] Received event network-vif-plugged-0deeb35a-47e5-44fe-843c-ed90df673a6b {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 10:14:10 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-fba0500f-b7de-4a0d-9860-e58398eca83f req-b08a36b1-bbeb-4732-b285-6b7207612d80 service nova] Acquiring lock "f9aeb7a5-24fd-4620-b316-0c7cf61a1300-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:14:10 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-fba0500f-b7de-4a0d-9860-e58398eca83f req-b08a36b1-bbeb-4732-b285-6b7207612d80 service nova] Lock "f9aeb7a5-24fd-4620-b316-0c7cf61a1300-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:14:10 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-fba0500f-b7de-4a0d-9860-e58398eca83f req-b08a36b1-bbeb-4732-b285-6b7207612d80 service nova] Lock "f9aeb7a5-24fd-4620-b316-0c7cf61a1300-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:14:10 user nova-compute[75122]: DEBUG nova.compute.manager [req-fba0500f-b7de-4a0d-9860-e58398eca83f req-b08a36b1-bbeb-4732-b285-6b7207612d80 service nova] [instance: f9aeb7a5-24fd-4620-b316-0c7cf61a1300] No waiting events found dispatching network-vif-plugged-0deeb35a-47e5-44fe-843c-ed90df673a6b {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 10:14:10 user nova-compute[75122]: WARNING nova.compute.manager [req-fba0500f-b7de-4a0d-9860-e58398eca83f req-b08a36b1-bbeb-4732-b285-6b7207612d80 service nova] [instance: f9aeb7a5-24fd-4620-b316-0c7cf61a1300] Received unexpected event network-vif-plugged-0deeb35a-47e5-44fe-843c-ed90df673a6b for instance with vm_state active and task_state None.
Nov 15 10:14:11 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:14:11 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:14:16 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:14:21 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:14:21 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:14:21 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75122) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 10:14:21 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75122) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 10:14:21 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75122) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 10:14:21 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:14:26 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:14:26 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:14:26 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75122) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 10:14:26 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75122) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 10:14:26 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75122) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 10:14:26 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:14:26 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:14:29 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:14:31 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:14:31 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:14:32 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:14:36 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:14:36 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:14:41 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:14:41 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:14:46 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:14:46 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:14:47 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:14:48 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:14:50 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:14:50 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:14:50 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:14:50 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:14:50 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75122) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 10:14:50 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9aeb7a5-24fd-4620-b316-0c7cf61a1300/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:14:50 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9aeb7a5-24fd-4620-b316-0c7cf61a1300/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:14:50 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9aeb7a5-24fd-4620-b316-0c7cf61a1300/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:14:50 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9aeb7a5-24fd-4620-b316-0c7cf61a1300/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:14:50 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75122) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 10:14:51 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 10:14:51 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 10:14:51 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Hypervisor/Node resource view: name=user free_ram=9004MB free_disk=25.051841735839844GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75122) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 10:14:51 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:14:51 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:14:51 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance f9aeb7a5-24fd-4620-b316-0c7cf61a1300 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 10:14:51 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75122) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 10:14:51 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75122) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 10:14:51 user nova-compute[75122]: DEBUG nova.compute.provider_tree [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Inventory has not changed in ProviderTree for provider: 69a3da65-47be-44c6-b67c-c692b58284ef {{(pid=75122) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 10:14:51 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Inventory has not changed for provider 69a3da65-47be-44c6-b67c-c692b58284ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 10:14:51 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Compute_service record updated for user:user {{(pid=75122) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 10:14:51 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.181s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:14:51 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:14:54 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:14:55 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:14:55 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Starting heal instance info cache {{(pid=75122) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 10:14:55 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Rebuilding the list of instances to heal {{(pid=75122) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 10:14:55 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "refresh_cache-f9aeb7a5-24fd-4620-b316-0c7cf61a1300" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 10:14:55 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquired lock "refresh_cache-f9aeb7a5-24fd-4620-b316-0c7cf61a1300" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 10:14:55 user nova-compute[75122]: DEBUG nova.network.neutron [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] [instance: f9aeb7a5-24fd-4620-b316-0c7cf61a1300] Forcefully refreshing network info cache for instance {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 10:14:55 user nova-compute[75122]: DEBUG nova.objects.instance [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lazy-loading 'info_cache' on Instance uuid f9aeb7a5-24fd-4620-b316-0c7cf61a1300 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 10:14:55 user nova-compute[75122]: DEBUG nova.network.neutron [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] [instance: f9aeb7a5-24fd-4620-b316-0c7cf61a1300] Updating instance_info_cache with network_info: [{"id": "0deeb35a-47e5-44fe-843c-ed90df673a6b", "address": "fa:16:3e:1e:19:79", "network": {"id": "25afb78c-30e1-4fd7-a215-b5e73ba43057", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2008775745-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "098415c1690e46c39d52c0fee2719175", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0deeb35a-47", "ovs_interfaceid": "0deeb35a-47e5-44fe-843c-ed90df673a6b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 10:14:55 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Releasing lock "refresh_cache-f9aeb7a5-24fd-4620-b316-0c7cf61a1300" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 10:14:55 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] [instance: f9aeb7a5-24fd-4620-b316-0c7cf61a1300] Updated the network info_cache for instance {{(pid=75122) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 10:14:56 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:14:56 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:14:56 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75122) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 10:14:56 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75122) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 10:14:56 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75122) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 10:14:56 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:14:57 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:14:57 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:14:58 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:14:58 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75122) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 10:15:00 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:15:01 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:15:06 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:15:06 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:15:06 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75122) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 10:15:06 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75122) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 10:15:06 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75122) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 10:15:06 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:15:11 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:15:16 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:15:21 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:15:26 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:15:31 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:15:31 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:15:31 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75122) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 10:15:31 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75122) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 10:15:31 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75122) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 10:15:31 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:15:36 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:15:41 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:15:46 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:15:46 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:15:46 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75122) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 10:15:46 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75122) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 10:15:46 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75122) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 10:15:46 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:15:48 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:15:48 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:15:50 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:15:50 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:15:50 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:15:50 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:15:50 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:15:50 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75122) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 10:15:50 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9aeb7a5-24fd-4620-b316-0c7cf61a1300/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:15:50 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9aeb7a5-24fd-4620-b316-0c7cf61a1300/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:15:50 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9aeb7a5-24fd-4620-b316-0c7cf61a1300/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:15:50 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f9aeb7a5-24fd-4620-b316-0c7cf61a1300/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:15:50 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75122) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 10:15:51 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 10:15:51 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 10:15:51 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Hypervisor/Node resource view: name=user free_ram=9021MB free_disk=25.05129623413086GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75122) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 10:15:51 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:15:51 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:15:51 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance f9aeb7a5-24fd-4620-b316-0c7cf61a1300 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 10:15:51 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75122) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 10:15:51 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75122) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 10:15:51 user nova-compute[75122]: DEBUG nova.compute.provider_tree [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Inventory has not changed in ProviderTree for provider: 69a3da65-47be-44c6-b67c-c692b58284ef {{(pid=75122) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 10:15:51 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Inventory has not changed for provider 69a3da65-47be-44c6-b67c-c692b58284ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 10:15:51 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Compute_service record updated for user:user {{(pid=75122) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 10:15:51 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.172s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:15:51 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:15:51 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:15:51 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75122) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 10:15:51 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75122) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 10:15:51 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75122) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 10:15:51 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:15:54 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:15:54 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:15:54 user nova-compute[75122]: DEBUG nova.compute.manager [req-d4e796ff-918f-40c2-94a7-ed479ebfa2f4 req-bebf9f9d-ec0e-40a1-aa4e-59aa1eaa4db2 service nova] [instance: f9aeb7a5-24fd-4620-b316-0c7cf61a1300] Received event network-changed-0deeb35a-47e5-44fe-843c-ed90df673a6b {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 10:15:54 user nova-compute[75122]: DEBUG nova.compute.manager [req-d4e796ff-918f-40c2-94a7-ed479ebfa2f4 req-bebf9f9d-ec0e-40a1-aa4e-59aa1eaa4db2 service nova] [instance: f9aeb7a5-24fd-4620-b316-0c7cf61a1300] Refreshing instance network info cache due to event network-changed-0deeb35a-47e5-44fe-843c-ed90df673a6b. {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 10:15:54 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-d4e796ff-918f-40c2-94a7-ed479ebfa2f4 req-bebf9f9d-ec0e-40a1-aa4e-59aa1eaa4db2 service nova] Acquiring lock "refresh_cache-f9aeb7a5-24fd-4620-b316-0c7cf61a1300" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 10:15:54 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-d4e796ff-918f-40c2-94a7-ed479ebfa2f4 req-bebf9f9d-ec0e-40a1-aa4e-59aa1eaa4db2 service nova] Acquired lock "refresh_cache-f9aeb7a5-24fd-4620-b316-0c7cf61a1300" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 10:15:54 user nova-compute[75122]: DEBUG nova.network.neutron [req-d4e796ff-918f-40c2-94a7-ed479ebfa2f4 req-bebf9f9d-ec0e-40a1-aa4e-59aa1eaa4db2 service nova] [instance: f9aeb7a5-24fd-4620-b316-0c7cf61a1300] Refreshing network info cache for port 0deeb35a-47e5-44fe-843c-ed90df673a6b {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 10:15:54 user nova-compute[75122]: DEBUG nova.network.neutron [req-d4e796ff-918f-40c2-94a7-ed479ebfa2f4 req-bebf9f9d-ec0e-40a1-aa4e-59aa1eaa4db2 service nova] [instance: f9aeb7a5-24fd-4620-b316-0c7cf61a1300] Updated VIF entry in instance network info cache for port 0deeb35a-47e5-44fe-843c-ed90df673a6b. {{(pid=75122) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 10:15:54 user nova-compute[75122]: DEBUG nova.network.neutron [req-d4e796ff-918f-40c2-94a7-ed479ebfa2f4 req-bebf9f9d-ec0e-40a1-aa4e-59aa1eaa4db2 service nova] [instance: f9aeb7a5-24fd-4620-b316-0c7cf61a1300] Updating instance_info_cache with network_info: [{"id": "0deeb35a-47e5-44fe-843c-ed90df673a6b", "address": "fa:16:3e:1e:19:79", "network": {"id": "25afb78c-30e1-4fd7-a215-b5e73ba43057", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2008775745-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.246", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "098415c1690e46c39d52c0fee2719175", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0deeb35a-47", "ovs_interfaceid": "0deeb35a-47e5-44fe-843c-ed90df673a6b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 10:15:54 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-d4e796ff-918f-40c2-94a7-ed479ebfa2f4 req-bebf9f9d-ec0e-40a1-aa4e-59aa1eaa4db2 service nova] Releasing lock "refresh_cache-f9aeb7a5-24fd-4620-b316-0c7cf61a1300" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 10:15:55 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:15:55 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Starting heal instance info cache {{(pid=75122) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 10:15:55 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Rebuilding the list of instances to heal {{(pid=75122) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 10:15:55 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "refresh_cache-f9aeb7a5-24fd-4620-b316-0c7cf61a1300" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 10:15:55 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquired lock "refresh_cache-f9aeb7a5-24fd-4620-b316-0c7cf61a1300" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 10:15:55 user nova-compute[75122]: DEBUG nova.network.neutron [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] [instance: f9aeb7a5-24fd-4620-b316-0c7cf61a1300] Forcefully refreshing network info cache for instance {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 10:15:55 user nova-compute[75122]: DEBUG nova.objects.instance [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lazy-loading 'info_cache' on Instance uuid f9aeb7a5-24fd-4620-b316-0c7cf61a1300 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 10:15:55 user nova-compute[75122]: DEBUG nova.network.neutron [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] [instance: f9aeb7a5-24fd-4620-b316-0c7cf61a1300] Updating instance_info_cache with network_info: [{"id": "0deeb35a-47e5-44fe-843c-ed90df673a6b", "address": "fa:16:3e:1e:19:79", "network": {"id": "25afb78c-30e1-4fd7-a215-b5e73ba43057", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2008775745-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "098415c1690e46c39d52c0fee2719175", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0deeb35a-47", "ovs_interfaceid": "0deeb35a-47e5-44fe-843c-ed90df673a6b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 10:15:55 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Releasing lock "refresh_cache-f9aeb7a5-24fd-4620-b316-0c7cf61a1300" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 10:15:55 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] [instance: f9aeb7a5-24fd-4620-b316-0c7cf61a1300] Updated the network info_cache for instance {{(pid=75122) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 10:15:55 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-74c13bb3-621b-4ce3-89e5-3937a783609a tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Acquiring lock "f9aeb7a5-24fd-4620-b316-0c7cf61a1300" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:15:55 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-74c13bb3-621b-4ce3-89e5-3937a783609a tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Lock "f9aeb7a5-24fd-4620-b316-0c7cf61a1300" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:15:55 user nova-compute[75122]: INFO nova.compute.manager [None req-74c13bb3-621b-4ce3-89e5-3937a783609a tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] [instance: f9aeb7a5-24fd-4620-b316-0c7cf61a1300] Detaching volume a06f0d94-61c1-4bba-ad00-6cf16efdad55
Nov 15 10:15:55 user nova-compute[75122]: INFO nova.virt.block_device [None req-74c13bb3-621b-4ce3-89e5-3937a783609a tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] [instance: f9aeb7a5-24fd-4620-b316-0c7cf61a1300] Attempting to driver detach volume a06f0d94-61c1-4bba-ad00-6cf16efdad55 from mountpoint /dev/vdb
Nov 15 10:15:55 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-74c13bb3-621b-4ce3-89e5-3937a783609a tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Attempting to detach device vdb from instance f9aeb7a5-24fd-4620-b316-0c7cf61a1300 from the persistent domain config. {{(pid=75122) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 10:15:55 user nova-compute[75122]: DEBUG nova.virt.libvirt.guest [None req-74c13bb3-621b-4ce3-89e5-3937a783609a tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 10:15:55 user nova-compute[75122]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 10:15:55 user nova-compute[75122]:   <source dev="/dev/sdb"/>
Nov 15 10:15:55 user nova-compute[75122]:   <target dev="vdb" bus="virtio"/>
Nov 15 10:15:55 user nova-compute[75122]:   <serial>a06f0d94-61c1-4bba-ad00-6cf16efdad55</serial>
Nov 15 10:15:55 user nova-compute[75122]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 15 10:15:55 user nova-compute[75122]: </disk>
Nov 15 10:15:55 user nova-compute[75122]:  {{(pid=75122) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 10:15:55 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-74c13bb3-621b-4ce3-89e5-3937a783609a tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Successfully detached device vdb from instance f9aeb7a5-24fd-4620-b316-0c7cf61a1300 from the persistent domain config.
Nov 15 10:15:55 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-74c13bb3-621b-4ce3-89e5-3937a783609a tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f9aeb7a5-24fd-4620-b316-0c7cf61a1300 from the live domain config. {{(pid=75122) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 10:15:55 user nova-compute[75122]: DEBUG nova.virt.libvirt.guest [None req-74c13bb3-621b-4ce3-89e5-3937a783609a tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 10:15:55 user nova-compute[75122]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 10:15:55 user nova-compute[75122]:   <source dev="/dev/sdb"/>
Nov 15 10:15:55 user nova-compute[75122]:   <target dev="vdb" bus="virtio"/>
Nov 15 10:15:55 user nova-compute[75122]:   <serial>a06f0d94-61c1-4bba-ad00-6cf16efdad55</serial>
Nov 15 10:15:55 user nova-compute[75122]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 15 10:15:55 user nova-compute[75122]: </disk>
Nov 15 10:15:55 user nova-compute[75122]:  {{(pid=75122) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 10:15:56 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-74c13bb3-621b-4ce3-89e5-3937a783609a tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f9aeb7a5-24fd-4620-b316-0c7cf61a1300 {{(pid=75122) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 10:15:56 user nova-compute[75122]: DEBUG nova.compute.manager [req-8271f0ea-a5c2-4476-a732-ad9fec9bfee4 req-7d993096-8aa1-41d5-9e5d-cb93ddbc9b22 service nova] [instance: f9aeb7a5-24fd-4620-b316-0c7cf61a1300] Received event network-changed-0deeb35a-47e5-44fe-843c-ed90df673a6b {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 10:15:56 user nova-compute[75122]: DEBUG nova.compute.manager [req-8271f0ea-a5c2-4476-a732-ad9fec9bfee4 req-7d993096-8aa1-41d5-9e5d-cb93ddbc9b22 service nova] [instance: f9aeb7a5-24fd-4620-b316-0c7cf61a1300] Refreshing instance network info cache due to event network-changed-0deeb35a-47e5-44fe-843c-ed90df673a6b. {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 10:15:56 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-8271f0ea-a5c2-4476-a732-ad9fec9bfee4 req-7d993096-8aa1-41d5-9e5d-cb93ddbc9b22 service nova] Acquiring lock "refresh_cache-f9aeb7a5-24fd-4620-b316-0c7cf61a1300" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 10:15:56 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-8271f0ea-a5c2-4476-a732-ad9fec9bfee4 req-7d993096-8aa1-41d5-9e5d-cb93ddbc9b22 service nova] Acquired lock "refresh_cache-f9aeb7a5-24fd-4620-b316-0c7cf61a1300" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 10:15:56 user nova-compute[75122]: DEBUG nova.network.neutron [req-8271f0ea-a5c2-4476-a732-ad9fec9bfee4 req-7d993096-8aa1-41d5-9e5d-cb93ddbc9b22 service nova] [instance: f9aeb7a5-24fd-4620-b316-0c7cf61a1300] Refreshing network info cache for port 0deeb35a-47e5-44fe-843c-ed90df673a6b {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 10:15:56 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:15:56 user nova-compute[75122]: DEBUG nova.network.neutron [req-8271f0ea-a5c2-4476-a732-ad9fec9bfee4 req-7d993096-8aa1-41d5-9e5d-cb93ddbc9b22 service nova] [instance: f9aeb7a5-24fd-4620-b316-0c7cf61a1300] Updated VIF entry in instance network info cache for port 0deeb35a-47e5-44fe-843c-ed90df673a6b. {{(pid=75122) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 10:15:56 user nova-compute[75122]: DEBUG nova.network.neutron [req-8271f0ea-a5c2-4476-a732-ad9fec9bfee4 req-7d993096-8aa1-41d5-9e5d-cb93ddbc9b22 service nova] [instance: f9aeb7a5-24fd-4620-b316-0c7cf61a1300] Updating instance_info_cache with network_info: [{"id": "0deeb35a-47e5-44fe-843c-ed90df673a6b", "address": "fa:16:3e:1e:19:79", "network": {"id": "25afb78c-30e1-4fd7-a215-b5e73ba43057", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2008775745-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "098415c1690e46c39d52c0fee2719175", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0deeb35a-47", "ovs_interfaceid": "0deeb35a-47e5-44fe-843c-ed90df673a6b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 10:15:56 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-8271f0ea-a5c2-4476-a732-ad9fec9bfee4 req-7d993096-8aa1-41d5-9e5d-cb93ddbc9b22 service nova] Releasing lock "refresh_cache-f9aeb7a5-24fd-4620-b316-0c7cf61a1300" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 10:15:56 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:15:58 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:15:59 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:16:00 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:16:00 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75122) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 10:16:01 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:16:06 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:16:06 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:16:06 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75122) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 10:16:06 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75122) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 10:16:06 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75122) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 10:16:06 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:16:11 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:16:16 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-74c13bb3-621b-4ce3-89e5-3937a783609a tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance f9aeb7a5-24fd-4620-b316-0c7cf61a1300 is timed out.
Nov 15 10:16:16 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-74c13bb3-621b-4ce3-89e5-3937a783609a tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Successfully detached device vdb from instance f9aeb7a5-24fd-4620-b316-0c7cf61a1300 from the live domain config.
Nov 15 10:16:16 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-74c13bb3-621b-4ce3-89e5-3937a783609a tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] [instance: f9aeb7a5-24fd-4620-b316-0c7cf61a1300] calling os-brick to detach iSCSI Volume {{(pid=75122) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 10:16:16 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-74c13bb3-621b-4ce3-89e5-3937a783609a tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffa04060b80>, {'target_iqn': 'iqn.2010-10.org.openstack:a06f0d94-61c1-4bba-ad00-6cf16efdad55', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eVMrHjOL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 10:16:16 user nova-compute[75122]: WARNING os_brick.initiator.connectors.base [None req-74c13bb3-621b-4ce3-89e5-3937a783609a tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 10:16:16 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-74c13bb3-621b-4ce3-89e5-3937a783609a tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 10:16:16 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-74c13bb3-621b-4ce3-89e5-3937a783609a tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 10:16:16 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:16:16 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:16:16 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8c69d09-f366-45f4-8bcc-e903ec0d3495]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a06f0d94-61c1-4bba-ad00-6cf16efdad55\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:16:16 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-74c13bb3-621b-4ce3-89e5-3937a783609a tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 10:16:16 user nova-compute[75122]: No targets found.
Nov 15 10:16:16 user nova-compute[75122]: iSNS:
Nov 15 10:16:16 user nova-compute[75122]: No targets found.
Nov 15 10:16:16 user nova-compute[75122]: STATIC:
Nov 15 10:16:16 user nova-compute[75122]: Target: iqn.2010-10.org.openstack:a06f0d94-61c1-4bba-ad00-6cf16efdad55
Nov 15 10:16:16 user nova-compute[75122]:         Portal: 172.16.0.220:3260,-1
Nov 15 10:16:16 user nova-compute[75122]:                 Iface Name: default
Nov 15 10:16:16 user nova-compute[75122]: FIRMWARE:
Nov 15 10:16:16 user nova-compute[75122]: No targets found.
Nov 15 10:16:16 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 10:16:16 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-74c13bb3-621b-4ce3-89e5-3937a783609a tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 10:16:16 user nova-compute[75122]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 10:16:16 user nova-compute[75122]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75122) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 10:16:16 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-74c13bb3-621b-4ce3-89e5-3937a783609a tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a06f0d94-61c1-4bba-ad00-6cf16efdad55', 0)] {{(pid=75122) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 10:16:16 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:16:16 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:16:16 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[69d10fef-3d48-4891-a2b5-7587b7860706]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a06f0d94-61c1-4bba-ad00-6cf16efdad55\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:16:16 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:16:16 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:16:16 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[f872a2ba-3adf-487d-a905-e5cfcb841e75]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a06f0d94-61c1-4bba-ad00-6cf16efdad55 (non-flash)\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:16:16 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-74c13bb3-621b-4ce3-89e5-3937a783609a tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a06f0d94-61c1-4bba-ad00-6cf16efdad55 (non-flash)
Nov 15 10:16:16 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 10:16:16 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-74c13bb3-621b-4ce3-89e5-3937a783609a tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a06f0d94-61c1-4bba-ad00-6cf16efdad55 (non-flash)
Nov 15 10:16:16 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 10:16:16 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-74c13bb3-621b-4ce3-89e5-3937a783609a tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff9fc3d6290>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a06f0d94-61c1-4bba-ad00-6cf16efdad55'): ({'sdb'}, set())}) {{(pid=75122) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 10:16:16 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-74c13bb3-621b-4ce3-89e5-3937a783609a tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Removing single pathed devices sdb {{(pid=75122) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 10:16:16 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:16:16 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:16:16 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[440efffd-0a8a-438a-9a0a-8c112d0740f7]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:16:16 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:16:16 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:16:16 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b2340ea-a42b-4446-9af0-b736bbf12d5b]: (4, ('ok\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:16:16 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-74c13bb3-621b-4ce3-89e5-3937a783609a tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Flushing IO for device /dev/sdb {{(pid=75122) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 10:16:16 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:16:16 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:16:16 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f56680f-b89c-4445-a1e2-267535a332d5]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:16:16 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-74c13bb3-621b-4ce3-89e5-3937a783609a tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75122) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 10:16:16 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:16:16 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.033s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:16:16 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd368dc7-9ec8-49db-a9d3-2a6b9b32d44e]: (4, ('1', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:16:16 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-74c13bb3-621b-4ce3-89e5-3937a783609a tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75122) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 10:16:16 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-74c13bb3-621b-4ce3-89e5-3937a783609a tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] SCSI volumes sdb have been removed. {{(pid=75122) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 10:16:16 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-74c13bb3-621b-4ce3-89e5-3937a783609a tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a06f0d94-61c1-4bba-ad00-6cf16efdad55')] {{(pid=75122) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 10:16:16 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a06f0d94-61c1-4bba-ad00-6cf16efdad55 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:16:16 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a06f0d94-61c1-4bba-ad00-6cf16efdad55 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:16:16 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9a2f813-77e2-4bed-8797-b95beddca1e8]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:16:16 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-74c13bb3-621b-4ce3-89e5-3937a783609a tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 10:16:16 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a06f0d94-61c1-4bba-ad00-6cf16efdad55 -p 172.16.0.220:3260 --logout {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:16:16 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a06f0d94-61c1-4bba-ad00-6cf16efdad55 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:16:16 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd692102-9151-4ec9-9a1a-2291688fe777]: (4, ('Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:a06f0d94-61c1-4bba-ad00-6cf16efdad55, portal: 172.16.0.220,3260]\nLogout of [sid: 62, target: iqn.2010-10.org.openstack:a06f0d94-61c1-4bba-ad00-6cf16efdad55, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:16:16 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-74c13bb3-621b-4ce3-89e5-3937a783609a tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:a06f0d94-61c1-4bba-ad00-6cf16efdad55, portal: 172.16.0.220,3260]
Nov 15 10:16:16 user nova-compute[75122]: Logout of [sid: 62, target: iqn.2010-10.org.openstack:a06f0d94-61c1-4bba-ad00-6cf16efdad55, portal: 172.16.0.220,3260] successful.
Nov 15 10:16:16 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 10:16:16 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a06f0d94-61c1-4bba-ad00-6cf16efdad55 -p 172.16.0.220:3260 --op delete {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:16:16 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a06f0d94-61c1-4bba-ad00-6cf16efdad55 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:16:16 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b13eb1e-3ff0-45ce-90d2-beed2d882eab]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:16:16 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-74c13bb3-621b-4ce3-89e5-3937a783609a tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 10:16:16 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-74c13bb3-621b-4ce3-89e5-3937a783609a tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.257s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 10:16:16 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-74c13bb3-621b-4ce3-89e5-3937a783609a tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] <== disconnect_volume: return (258ms) None {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 10:16:16 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-74c13bb3-621b-4ce3-89e5-3937a783609a tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] [instance: f9aeb7a5-24fd-4620-b316-0c7cf61a1300] Disconnected iSCSI Volume {{(pid=75122) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 10:16:16 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:16:16 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:16:16 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75122) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 10:16:16 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75122) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 10:16:16 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75122) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 10:16:16 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:16:17 user nova-compute[75122]: DEBUG nova.objects.instance [None req-74c13bb3-621b-4ce3-89e5-3937a783609a tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Lazy-loading 'flavor' on Instance uuid f9aeb7a5-24fd-4620-b316-0c7cf61a1300 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 10:16:17 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-74c13bb3-621b-4ce3-89e5-3937a783609a tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Lock "f9aeb7a5-24fd-4620-b316-0c7cf61a1300" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.534s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:16:21 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:16:21 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:16:21 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5005 ms, sending inactivity probe {{(pid=75122) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 10:16:21 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75122) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 10:16:21 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75122) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 10:16:21 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:16:26 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:16:31 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:16:31 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:16:31 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75122) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 10:16:31 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75122) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 10:16:31 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75122) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 10:16:31 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:16:36 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:16:41 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:16:41 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:16:41 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75122) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 10:16:41 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75122) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 10:16:41 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75122) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 10:16:41 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:16:46 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:16:46 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:16:46 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=75122) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 10:16:46 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75122) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 10:16:46 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75122) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 10:16:46 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:16:48 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:16:48 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:16:49 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-8674305f-8941-4b91-ba87-3ea72e23a874 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Acquiring lock "f9aeb7a5-24fd-4620-b316-0c7cf61a1300" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:16:49 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-8674305f-8941-4b91-ba87-3ea72e23a874 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Lock "f9aeb7a5-24fd-4620-b316-0c7cf61a1300" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:16:49 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-8674305f-8941-4b91-ba87-3ea72e23a874 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Acquiring lock "f9aeb7a5-24fd-4620-b316-0c7cf61a1300-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:16:49 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-8674305f-8941-4b91-ba87-3ea72e23a874 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Lock "f9aeb7a5-24fd-4620-b316-0c7cf61a1300-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:16:49 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-8674305f-8941-4b91-ba87-3ea72e23a874 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Lock "f9aeb7a5-24fd-4620-b316-0c7cf61a1300-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:16:49 user nova-compute[75122]: INFO nova.compute.manager [None req-8674305f-8941-4b91-ba87-3ea72e23a874 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] [instance: f9aeb7a5-24fd-4620-b316-0c7cf61a1300] Terminating instance
Nov 15 10:16:49 user nova-compute[75122]: DEBUG nova.compute.manager [None req-8674305f-8941-4b91-ba87-3ea72e23a874 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] [instance: f9aeb7a5-24fd-4620-b316-0c7cf61a1300] Start destroying the instance on the hypervisor. {{(pid=75122) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 10:16:49 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:16:49 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:16:49 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:16:49 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:16:49 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:16:49 user nova-compute[75122]: DEBUG nova.compute.manager [req-26622e26-e2e4-4945-8d3b-3185ff2dad4e req-5aef05d7-698d-4318-99ce-6f134ab7f9a4 service nova] [instance: f9aeb7a5-24fd-4620-b316-0c7cf61a1300] Received event network-vif-unplugged-0deeb35a-47e5-44fe-843c-ed90df673a6b {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 10:16:49 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-26622e26-e2e4-4945-8d3b-3185ff2dad4e req-5aef05d7-698d-4318-99ce-6f134ab7f9a4 service nova] Acquiring lock "f9aeb7a5-24fd-4620-b316-0c7cf61a1300-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:16:49 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-26622e26-e2e4-4945-8d3b-3185ff2dad4e req-5aef05d7-698d-4318-99ce-6f134ab7f9a4 service nova] Lock "f9aeb7a5-24fd-4620-b316-0c7cf61a1300-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:16:49 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-26622e26-e2e4-4945-8d3b-3185ff2dad4e req-5aef05d7-698d-4318-99ce-6f134ab7f9a4 service nova] Lock "f9aeb7a5-24fd-4620-b316-0c7cf61a1300-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:16:49 user nova-compute[75122]: DEBUG nova.compute.manager [req-26622e26-e2e4-4945-8d3b-3185ff2dad4e req-5aef05d7-698d-4318-99ce-6f134ab7f9a4 service nova] [instance: f9aeb7a5-24fd-4620-b316-0c7cf61a1300] No waiting events found dispatching network-vif-unplugged-0deeb35a-47e5-44fe-843c-ed90df673a6b {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 10:16:49 user nova-compute[75122]: DEBUG nova.compute.manager [req-26622e26-e2e4-4945-8d3b-3185ff2dad4e req-5aef05d7-698d-4318-99ce-6f134ab7f9a4 service nova] [instance: f9aeb7a5-24fd-4620-b316-0c7cf61a1300] Received event network-vif-unplugged-0deeb35a-47e5-44fe-843c-ed90df673a6b for instance with task_state deleting. {{(pid=75122) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 10:16:50 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:16:50 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:16:50 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:16:50 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:16:50 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:16:50 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:16:50 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75122) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 10:16:50 user nova-compute[75122]: INFO nova.virt.libvirt.driver [-] [instance: f9aeb7a5-24fd-4620-b316-0c7cf61a1300] Instance destroyed successfully.
Nov 15 10:16:50 user nova-compute[75122]: DEBUG nova.objects.instance [None req-8674305f-8941-4b91-ba87-3ea72e23a874 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Lazy-loading 'resources' on Instance uuid f9aeb7a5-24fd-4620-b316-0c7cf61a1300 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 10:16:50 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-8674305f-8941-4b91-ba87-3ea72e23a874 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T10:11:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-812380502',display_name='tempest-TestMinimumBasicScenario-server-812380502',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-812380502',id=51,image_ref='02d0adab-5e82-436a-9cd3-600747b978f4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHfJyCffkl4NUz9yhB8dcWwiE0TpZ4ni7aEudvjypqUXSPGrXr6WQ3j8fmAVohqqgwzb7kLVCC9xi7QRRWiHP0aiWrfZnwjyt08+MD7x45ML53V8AoefdnGpsiXlJlkf6Q==',key_name='tempest-TestMinimumBasicScenario-65289387',keypairs=<?>,launch_index=0,launched_at=2023-11-15T10:11:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='098415c1690e46c39d52c0fee2719175',ramdisk_id='',reservation_id='r-d1k6umut',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='02d0adab-5e82-436a-9cd3-600747b978f4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1402308121',owner_user_name='tempest-TestMinimumBasicScenario-1402308121-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T10:14:10Z,user_data=None,user_id='f3f4814249ab42d399b77e5b8040ec8b',uuid=f9aeb7a5-24fd-4620-b316-0c7cf61a1300,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0deeb35a-47e5-44fe-843c-ed90df673a6b", "address": "fa:16:3e:1e:19:79", "network": {"id": "25afb78c-30e1-4fd7-a215-b5e73ba43057", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2008775745-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "098415c1690e46c39d52c0fee2719175", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0deeb35a-47", "ovs_interfaceid": "0deeb35a-47e5-44fe-843c-ed90df673a6b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 10:16:50 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-8674305f-8941-4b91-ba87-3ea72e23a874 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Converting VIF {"id": "0deeb35a-47e5-44fe-843c-ed90df673a6b", "address": "fa:16:3e:1e:19:79", "network": {"id": "25afb78c-30e1-4fd7-a215-b5e73ba43057", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2008775745-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "098415c1690e46c39d52c0fee2719175", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0deeb35a-47", "ovs_interfaceid": "0deeb35a-47e5-44fe-843c-ed90df673a6b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 10:16:50 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-8674305f-8941-4b91-ba87-3ea72e23a874 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1e:19:79,bridge_name='br-int',has_traffic_filtering=True,id=0deeb35a-47e5-44fe-843c-ed90df673a6b,network=Network(25afb78c-30e1-4fd7-a215-b5e73ba43057),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0deeb35a-47') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 10:16:50 user nova-compute[75122]: DEBUG os_vif [None req-8674305f-8941-4b91-ba87-3ea72e23a874 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1e:19:79,bridge_name='br-int',has_traffic_filtering=True,id=0deeb35a-47e5-44fe-843c-ed90df673a6b,network=Network(25afb78c-30e1-4fd7-a215-b5e73ba43057),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0deeb35a-47') {{(pid=75122) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 10:16:50 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:16:50 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0deeb35a-47, bridge=br-int, if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 10:16:50 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:16:50 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:16:50 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:16:50 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9bb1d416-bb52-4375-ad14-2a53fba1f7d2) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 10:16:50 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:16:50 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:16:50 user nova-compute[75122]: INFO os_vif [None req-8674305f-8941-4b91-ba87-3ea72e23a874 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1e:19:79,bridge_name='br-int',has_traffic_filtering=True,id=0deeb35a-47e5-44fe-843c-ed90df673a6b,network=Network(25afb78c-30e1-4fd7-a215-b5e73ba43057),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0deeb35a-47')
Nov 15 10:16:50 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-8674305f-8941-4b91-ba87-3ea72e23a874 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] [instance: f9aeb7a5-24fd-4620-b316-0c7cf61a1300] Deleting instance files /opt/stack/data/nova/instances/f9aeb7a5-24fd-4620-b316-0c7cf61a1300_del
Nov 15 10:16:50 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-8674305f-8941-4b91-ba87-3ea72e23a874 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] [instance: f9aeb7a5-24fd-4620-b316-0c7cf61a1300] Deletion of /opt/stack/data/nova/instances/f9aeb7a5-24fd-4620-b316-0c7cf61a1300_del complete
Nov 15 10:16:50 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Periodic task is updating the host stats, it is trying to get disk info for instance-00000033, but the backing disk storage was removed by a concurrent operation such as resize. Error: No disk at /opt/stack/data/nova/instances/f9aeb7a5-24fd-4620-b316-0c7cf61a1300/disk: nova.exception.DiskNotFound: No disk at /opt/stack/data/nova/instances/f9aeb7a5-24fd-4620-b316-0c7cf61a1300/disk
Nov 15 10:16:50 user nova-compute[75122]: INFO nova.compute.manager [None req-8674305f-8941-4b91-ba87-3ea72e23a874 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] [instance: f9aeb7a5-24fd-4620-b316-0c7cf61a1300] Took 1.22 seconds to destroy the instance on the hypervisor.
Nov 15 10:16:50 user nova-compute[75122]: DEBUG oslo.service.loopingcall [None req-8674305f-8941-4b91-ba87-3ea72e23a874 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75122) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 10:16:50 user nova-compute[75122]: DEBUG nova.compute.manager [-] [instance: f9aeb7a5-24fd-4620-b316-0c7cf61a1300] Deallocating network for instance {{(pid=75122) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 10:16:50 user nova-compute[75122]: DEBUG nova.network.neutron [-] [instance: f9aeb7a5-24fd-4620-b316-0c7cf61a1300] deallocate_for_instance() {{(pid=75122) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 10:16:50 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 10:16:50 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 10:16:50 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Hypervisor/Node resource view: name=user free_ram=9134MB free_disk=25.042552947998047GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75122) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 10:16:50 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:16:50 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:16:51 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance f9aeb7a5-24fd-4620-b316-0c7cf61a1300 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 10:16:51 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75122) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 10:16:51 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75122) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 10:16:51 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Refreshing inventories for resource provider 69a3da65-47be-44c6-b67c-c692b58284ef {{(pid=75122) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 15 10:16:51 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Updating ProviderTree inventory for provider 69a3da65-47be-44c6-b67c-c692b58284ef from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 15 10:16:51 user nova-compute[75122]: DEBUG nova.compute.provider_tree [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Updating inventory in ProviderTree for provider 69a3da65-47be-44c6-b67c-c692b58284ef with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 15 10:16:51 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Refreshing aggregate associations for resource provider 69a3da65-47be-44c6-b67c-c692b58284ef, aggregates: None {{(pid=75122) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 15 10:16:51 user nova-compute[75122]: DEBUG nova.network.neutron [-] [instance: f9aeb7a5-24fd-4620-b316-0c7cf61a1300] Updating instance_info_cache with network_info: [] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 10:16:51 user nova-compute[75122]: INFO nova.compute.manager [-] [instance: f9aeb7a5-24fd-4620-b316-0c7cf61a1300] Took 0.44 seconds to deallocate network for instance.
Nov 15 10:16:51 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Refreshing trait associations for resource provider 69a3da65-47be-44c6-b67c-c692b58284ef, traits: COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_RESCUE_BFV,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE,COMPUTE_NODE,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_ACCELERATORS,HW_CPU_X86_MMX {{(pid=75122) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 15 10:16:51 user nova-compute[75122]: DEBUG nova.compute.manager [req-d3a8b505-9440-46a8-afeb-e0f185db9e3d req-536d0424-460e-4c63-9b8b-fac07ac7889b service nova] [instance: f9aeb7a5-24fd-4620-b316-0c7cf61a1300] Received event network-vif-deleted-0deeb35a-47e5-44fe-843c-ed90df673a6b {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 10:16:51 user nova-compute[75122]: DEBUG nova.compute.provider_tree [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Inventory has not changed in ProviderTree for provider: 69a3da65-47be-44c6-b67c-c692b58284ef {{(pid=75122) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 10:16:51 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Inventory has not changed for provider 69a3da65-47be-44c6-b67c-c692b58284ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 10:16:51 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-8674305f-8941-4b91-ba87-3ea72e23a874 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:16:51 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Compute_service record updated for user:user {{(pid=75122) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 10:16:51 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.654s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:16:51 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-8674305f-8941-4b91-ba87-3ea72e23a874 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.054s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:16:51 user nova-compute[75122]: DEBUG nova.compute.provider_tree [None req-8674305f-8941-4b91-ba87-3ea72e23a874 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Inventory has not changed in ProviderTree for provider: 69a3da65-47be-44c6-b67c-c692b58284ef {{(pid=75122) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 10:16:51 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-8674305f-8941-4b91-ba87-3ea72e23a874 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Inventory has not changed for provider 69a3da65-47be-44c6-b67c-c692b58284ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 10:16:51 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-8674305f-8941-4b91-ba87-3ea72e23a874 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.137s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:16:51 user nova-compute[75122]: INFO nova.scheduler.client.report [None req-8674305f-8941-4b91-ba87-3ea72e23a874 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Deleted allocations for instance f9aeb7a5-24fd-4620-b316-0c7cf61a1300
Nov 15 10:16:51 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-8674305f-8941-4b91-ba87-3ea72e23a874 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Lock "f9aeb7a5-24fd-4620-b316-0c7cf61a1300" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.167s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:16:52 user nova-compute[75122]: DEBUG nova.compute.manager [req-be04aca6-c329-48b7-a190-7c06b4b3a218 req-87b2583d-6d83-456f-bc67-f3191701aab1 service nova] [instance: f9aeb7a5-24fd-4620-b316-0c7cf61a1300] Received event network-vif-plugged-0deeb35a-47e5-44fe-843c-ed90df673a6b {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 10:16:52 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-be04aca6-c329-48b7-a190-7c06b4b3a218 req-87b2583d-6d83-456f-bc67-f3191701aab1 service nova] Acquiring lock "f9aeb7a5-24fd-4620-b316-0c7cf61a1300-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:16:52 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-be04aca6-c329-48b7-a190-7c06b4b3a218 req-87b2583d-6d83-456f-bc67-f3191701aab1 service nova] Lock "f9aeb7a5-24fd-4620-b316-0c7cf61a1300-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:16:52 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-be04aca6-c329-48b7-a190-7c06b4b3a218 req-87b2583d-6d83-456f-bc67-f3191701aab1 service nova] Lock "f9aeb7a5-24fd-4620-b316-0c7cf61a1300-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:16:52 user nova-compute[75122]: DEBUG nova.compute.manager [req-be04aca6-c329-48b7-a190-7c06b4b3a218 req-87b2583d-6d83-456f-bc67-f3191701aab1 service nova] [instance: f9aeb7a5-24fd-4620-b316-0c7cf61a1300] No waiting events found dispatching network-vif-plugged-0deeb35a-47e5-44fe-843c-ed90df673a6b {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 10:16:52 user nova-compute[75122]: WARNING nova.compute.manager [req-be04aca6-c329-48b7-a190-7c06b4b3a218 req-87b2583d-6d83-456f-bc67-f3191701aab1 service nova] [instance: f9aeb7a5-24fd-4620-b316-0c7cf61a1300] Received unexpected event network-vif-plugged-0deeb35a-47e5-44fe-843c-ed90df673a6b for instance with vm_state deleted and task_state None.
Nov 15 10:16:53 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:16:53 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Cleaning up deleted instances {{(pid=75122) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 15 10:16:53 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] There are 0 instances to clean {{(pid=75122) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 15 10:16:55 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:16:55 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Starting heal instance info cache {{(pid=75122) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 10:16:55 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Rebuilding the list of instances to heal {{(pid=75122) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 10:16:55 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Didn't find any instances for network info cache update. {{(pid=75122) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 15 10:16:55 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:16:55 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:16:58 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:16:59 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:17:00 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:17:00 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75122) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 10:17:00 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:17:00 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:17:00 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75122) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 10:17:00 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75122) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 10:17:00 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75122) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 10:17:00 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:17:05 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:17:05 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:17:06 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:17:10 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:17:13 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:17:13 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75122) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 15 10:17:15 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:17:15 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:17:15 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75122) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 10:17:15 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75122) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 10:17:15 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75122) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 10:17:15 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:17:20 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:17:20 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:17:20 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75122) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 10:17:20 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75122) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 10:17:20 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75122) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 10:17:20 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:17:25 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4996-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:17:25 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:17:25 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75122) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 10:17:25 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75122) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 10:17:25 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75122) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 10:17:25 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:17:30 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:17:30 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:17:30 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75122) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 10:17:30 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75122) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 10:17:30 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75122) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 10:17:30 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:17:35 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:17:40 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:17:43 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-b2e68345-660b-43ca-877a-210983a51c33 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Acquiring lock "b727b2b6-0315-4a01-a67c-c485a862b518" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:17:43 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-b2e68345-660b-43ca-877a-210983a51c33 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Lock "b727b2b6-0315-4a01-a67c-c485a862b518" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:17:43 user nova-compute[75122]: DEBUG nova.compute.manager [None req-b2e68345-660b-43ca-877a-210983a51c33 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] [instance: b727b2b6-0315-4a01-a67c-c485a862b518] Starting instance... {{(pid=75122) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 10:17:43 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-b2e68345-660b-43ca-877a-210983a51c33 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:17:43 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-b2e68345-660b-43ca-877a-210983a51c33 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:17:43 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-b2e68345-660b-43ca-877a-210983a51c33 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75122) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 10:17:43 user nova-compute[75122]: INFO nova.compute.claims [None req-b2e68345-660b-43ca-877a-210983a51c33 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] [instance: b727b2b6-0315-4a01-a67c-c485a862b518] Claim successful on node user
Nov 15 10:17:43 user nova-compute[75122]: DEBUG nova.compute.provider_tree [None req-b2e68345-660b-43ca-877a-210983a51c33 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Inventory has not changed in ProviderTree for provider: 69a3da65-47be-44c6-b67c-c692b58284ef {{(pid=75122) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 10:17:43 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-b2e68345-660b-43ca-877a-210983a51c33 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Inventory has not changed for provider 69a3da65-47be-44c6-b67c-c692b58284ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 10:17:43 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-b2e68345-660b-43ca-877a-210983a51c33 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.184s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:17:43 user nova-compute[75122]: DEBUG nova.compute.manager [None req-b2e68345-660b-43ca-877a-210983a51c33 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] [instance: b727b2b6-0315-4a01-a67c-c485a862b518] Start building networks asynchronously for instance. {{(pid=75122) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 10:17:43 user nova-compute[75122]: DEBUG nova.compute.manager [None req-b2e68345-660b-43ca-877a-210983a51c33 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] [instance: b727b2b6-0315-4a01-a67c-c485a862b518] Allocating IP information in the background. {{(pid=75122) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 10:17:43 user nova-compute[75122]: DEBUG nova.network.neutron [None req-b2e68345-660b-43ca-877a-210983a51c33 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] [instance: b727b2b6-0315-4a01-a67c-c485a862b518] allocate_for_instance() {{(pid=75122) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 10:17:43 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-b2e68345-660b-43ca-877a-210983a51c33 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] [instance: b727b2b6-0315-4a01-a67c-c485a862b518] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 10:17:43 user nova-compute[75122]: DEBUG nova.compute.manager [None req-b2e68345-660b-43ca-877a-210983a51c33 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] [instance: b727b2b6-0315-4a01-a67c-c485a862b518] Start building block device mappings for instance. {{(pid=75122) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 10:17:43 user nova-compute[75122]: DEBUG nova.policy [None req-b2e68345-660b-43ca-877a-210983a51c33 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f3f4814249ab42d399b77e5b8040ec8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '098415c1690e46c39d52c0fee2719175', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75122) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 10:17:44 user nova-compute[75122]: DEBUG nova.compute.manager [None req-b2e68345-660b-43ca-877a-210983a51c33 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] [instance: b727b2b6-0315-4a01-a67c-c485a862b518] Start spawning the instance on the hypervisor. {{(pid=75122) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 10:17:44 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-b2e68345-660b-43ca-877a-210983a51c33 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] [instance: b727b2b6-0315-4a01-a67c-c485a862b518] Creating instance directory {{(pid=75122) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 10:17:44 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-b2e68345-660b-43ca-877a-210983a51c33 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] [instance: b727b2b6-0315-4a01-a67c-c485a862b518] Creating image(s)
Nov 15 10:17:44 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-b2e68345-660b-43ca-877a-210983a51c33 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Acquiring lock "/opt/stack/data/nova/instances/b727b2b6-0315-4a01-a67c-c485a862b518/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:17:44 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-b2e68345-660b-43ca-877a-210983a51c33 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Lock "/opt/stack/data/nova/instances/b727b2b6-0315-4a01-a67c-c485a862b518/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:17:44 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-b2e68345-660b-43ca-877a-210983a51c33 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Lock "/opt/stack/data/nova/instances/b727b2b6-0315-4a01-a67c-c485a862b518/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:17:44 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-b2e68345-660b-43ca-877a-210983a51c33 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Acquiring lock "09fe6a3d090ea306ec1c165f7b5ab48343ff2158" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:17:44 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-b2e68345-660b-43ca-877a-210983a51c33 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Lock "09fe6a3d090ea306ec1c165f7b5ab48343ff2158" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:17:44 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-b2e68345-660b-43ca-877a-210983a51c33 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09fe6a3d090ea306ec1c165f7b5ab48343ff2158.part --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:17:44 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:17:44 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-b2e68345-660b-43ca-877a-210983a51c33 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09fe6a3d090ea306ec1c165f7b5ab48343ff2158.part --force-share --output=json" returned: 0 in 0.197s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:17:44 user nova-compute[75122]: DEBUG nova.virt.images [None req-b2e68345-660b-43ca-877a-210983a51c33 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] 428766b1-9088-495e-89f1-92ef8fc1491d was qcow2, converting to raw {{(pid=75122) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 15 10:17:44 user nova-compute[75122]: DEBUG nova.privsep.utils [None req-b2e68345-660b-43ca-877a-210983a51c33 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75122) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 10:17:44 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-b2e68345-660b-43ca-877a-210983a51c33 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/09fe6a3d090ea306ec1c165f7b5ab48343ff2158.part /opt/stack/data/nova/instances/_base/09fe6a3d090ea306ec1c165f7b5ab48343ff2158.converted {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:17:44 user nova-compute[75122]: DEBUG nova.network.neutron [None req-b2e68345-660b-43ca-877a-210983a51c33 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] [instance: b727b2b6-0315-4a01-a67c-c485a862b518] Successfully created port: 13d07e07-3d6e-465d-a21f-94afa7418d3b {{(pid=75122) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 10:17:44 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-b2e68345-660b-43ca-877a-210983a51c33 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/09fe6a3d090ea306ec1c165f7b5ab48343ff2158.part /opt/stack/data/nova/instances/_base/09fe6a3d090ea306ec1c165f7b5ab48343ff2158.converted" returned: 0 in 0.150s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:17:44 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-b2e68345-660b-43ca-877a-210983a51c33 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09fe6a3d090ea306ec1c165f7b5ab48343ff2158.converted --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:17:44 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-b2e68345-660b-43ca-877a-210983a51c33 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09fe6a3d090ea306ec1c165f7b5ab48343ff2158.converted --force-share --output=json" returned: 0 in 0.170s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:17:44 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-b2e68345-660b-43ca-877a-210983a51c33 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Lock "09fe6a3d090ea306ec1c165f7b5ab48343ff2158" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.936s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:17:44 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-b2e68345-660b-43ca-877a-210983a51c33 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09fe6a3d090ea306ec1c165f7b5ab48343ff2158 --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:17:45 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-b2e68345-660b-43ca-877a-210983a51c33 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09fe6a3d090ea306ec1c165f7b5ab48343ff2158 --force-share --output=json" returned: 0 in 0.174s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:17:45 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-b2e68345-660b-43ca-877a-210983a51c33 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Acquiring lock "09fe6a3d090ea306ec1c165f7b5ab48343ff2158" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:17:45 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-b2e68345-660b-43ca-877a-210983a51c33 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Lock "09fe6a3d090ea306ec1c165f7b5ab48343ff2158" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:17:45 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-b2e68345-660b-43ca-877a-210983a51c33 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09fe6a3d090ea306ec1c165f7b5ab48343ff2158 --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:17:45 user nova-compute[75122]: DEBUG nova.network.neutron [None req-b2e68345-660b-43ca-877a-210983a51c33 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] [instance: b727b2b6-0315-4a01-a67c-c485a862b518] Successfully updated port: 13d07e07-3d6e-465d-a21f-94afa7418d3b {{(pid=75122) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 10:17:45 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-b2e68345-660b-43ca-877a-210983a51c33 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Acquiring lock "refresh_cache-b727b2b6-0315-4a01-a67c-c485a862b518" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 10:17:45 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-b2e68345-660b-43ca-877a-210983a51c33 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Acquired lock "refresh_cache-b727b2b6-0315-4a01-a67c-c485a862b518" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 10:17:45 user nova-compute[75122]: DEBUG nova.network.neutron [None req-b2e68345-660b-43ca-877a-210983a51c33 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] [instance: b727b2b6-0315-4a01-a67c-c485a862b518] Building network info cache for instance {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 10:17:45 user nova-compute[75122]: DEBUG nova.compute.manager [req-35cecc2f-41c1-46fb-83db-d16f24367fc6 req-86ff008a-51ed-48a7-87bf-d4598833804b service nova] [instance: b727b2b6-0315-4a01-a67c-c485a862b518] Received event network-changed-13d07e07-3d6e-465d-a21f-94afa7418d3b {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 10:17:45 user nova-compute[75122]: DEBUG nova.compute.manager [req-35cecc2f-41c1-46fb-83db-d16f24367fc6 req-86ff008a-51ed-48a7-87bf-d4598833804b service nova] [instance: b727b2b6-0315-4a01-a67c-c485a862b518] Refreshing instance network info cache due to event network-changed-13d07e07-3d6e-465d-a21f-94afa7418d3b. {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 10:17:45 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-35cecc2f-41c1-46fb-83db-d16f24367fc6 req-86ff008a-51ed-48a7-87bf-d4598833804b service nova] Acquiring lock "refresh_cache-b727b2b6-0315-4a01-a67c-c485a862b518" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 10:17:45 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-b2e68345-660b-43ca-877a-210983a51c33 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09fe6a3d090ea306ec1c165f7b5ab48343ff2158 --force-share --output=json" returned: 0 in 0.171s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:17:45 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-b2e68345-660b-43ca-877a-210983a51c33 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/09fe6a3d090ea306ec1c165f7b5ab48343ff2158,backing_fmt=raw /opt/stack/data/nova/instances/b727b2b6-0315-4a01-a67c-c485a862b518/disk 1073741824 {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:17:45 user nova-compute[75122]: DEBUG nova.network.neutron [None req-b2e68345-660b-43ca-877a-210983a51c33 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] [instance: b727b2b6-0315-4a01-a67c-c485a862b518] Instance cache missing network info. {{(pid=75122) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 10:17:45 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-b2e68345-660b-43ca-877a-210983a51c33 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/09fe6a3d090ea306ec1c165f7b5ab48343ff2158,backing_fmt=raw /opt/stack/data/nova/instances/b727b2b6-0315-4a01-a67c-c485a862b518/disk 1073741824" returned: 0 in 0.096s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:17:45 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-b2e68345-660b-43ca-877a-210983a51c33 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Lock "09fe6a3d090ea306ec1c165f7b5ab48343ff2158" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.270s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:17:45 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-b2e68345-660b-43ca-877a-210983a51c33 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09fe6a3d090ea306ec1c165f7b5ab48343ff2158 --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:17:45 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:17:45 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-b2e68345-660b-43ca-877a-210983a51c33 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/09fe6a3d090ea306ec1c165f7b5ab48343ff2158 --force-share --output=json" returned: 0 in 0.173s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:17:45 user nova-compute[75122]: DEBUG nova.virt.disk.api [None req-b2e68345-660b-43ca-877a-210983a51c33 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b727b2b6-0315-4a01-a67c-c485a862b518/disk. size=1073741824 {{(pid=75122) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 10:17:45 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-b2e68345-660b-43ca-877a-210983a51c33 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b727b2b6-0315-4a01-a67c-c485a862b518/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:17:45 user nova-compute[75122]: DEBUG nova.network.neutron [None req-b2e68345-660b-43ca-877a-210983a51c33 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] [instance: b727b2b6-0315-4a01-a67c-c485a862b518] Updating instance_info_cache with network_info: [{"id": "13d07e07-3d6e-465d-a21f-94afa7418d3b", "address": "fa:16:3e:a5:63:98", "network": {"id": "25afb78c-30e1-4fd7-a215-b5e73ba43057", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2008775745-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "098415c1690e46c39d52c0fee2719175", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13d07e07-3d", "ovs_interfaceid": "13d07e07-3d6e-465d-a21f-94afa7418d3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 10:17:45 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-b2e68345-660b-43ca-877a-210983a51c33 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Releasing lock "refresh_cache-b727b2b6-0315-4a01-a67c-c485a862b518" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 10:17:45 user nova-compute[75122]: DEBUG nova.compute.manager [None req-b2e68345-660b-43ca-877a-210983a51c33 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] [instance: b727b2b6-0315-4a01-a67c-c485a862b518] Instance network_info: |[{"id": "13d07e07-3d6e-465d-a21f-94afa7418d3b", "address": "fa:16:3e:a5:63:98", "network": {"id": "25afb78c-30e1-4fd7-a215-b5e73ba43057", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2008775745-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "098415c1690e46c39d52c0fee2719175", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13d07e07-3d", "ovs_interfaceid": "13d07e07-3d6e-465d-a21f-94afa7418d3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75122) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 10:17:45 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-35cecc2f-41c1-46fb-83db-d16f24367fc6 req-86ff008a-51ed-48a7-87bf-d4598833804b service nova] Acquired lock "refresh_cache-b727b2b6-0315-4a01-a67c-c485a862b518" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 10:17:45 user nova-compute[75122]: DEBUG nova.network.neutron [req-35cecc2f-41c1-46fb-83db-d16f24367fc6 req-86ff008a-51ed-48a7-87bf-d4598833804b service nova] [instance: b727b2b6-0315-4a01-a67c-c485a862b518] Refreshing network info cache for port 13d07e07-3d6e-465d-a21f-94afa7418d3b {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 10:17:45 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-b2e68345-660b-43ca-877a-210983a51c33 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b727b2b6-0315-4a01-a67c-c485a862b518/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:17:45 user nova-compute[75122]: DEBUG nova.virt.disk.api [None req-b2e68345-660b-43ca-877a-210983a51c33 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Cannot resize image /opt/stack/data/nova/instances/b727b2b6-0315-4a01-a67c-c485a862b518/disk to a smaller size. {{(pid=75122) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 10:17:45 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-b2e68345-660b-43ca-877a-210983a51c33 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] [instance: b727b2b6-0315-4a01-a67c-c485a862b518] Created local disks {{(pid=75122) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 10:17:45 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-b2e68345-660b-43ca-877a-210983a51c33 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] [instance: b727b2b6-0315-4a01-a67c-c485a862b518] Ensure instance console log exists: /opt/stack/data/nova/instances/b727b2b6-0315-4a01-a67c-c485a862b518/console.log {{(pid=75122) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 10:17:45 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-b2e68345-660b-43ca-877a-210983a51c33 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:17:45 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-b2e68345-660b-43ca-877a-210983a51c33 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:17:45 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-b2e68345-660b-43ca-877a-210983a51c33 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:17:45 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-b2e68345-660b-43ca-877a-210983a51c33 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] [instance: b727b2b6-0315-4a01-a67c-c485a862b518] Start _get_guest_xml network_info=[{"id": "13d07e07-3d6e-465d-a21f-94afa7418d3b", "address": "fa:16:3e:a5:63:98", "network": {"id": "25afb78c-30e1-4fd7-a215-b5e73ba43057", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2008775745-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "098415c1690e46c39d52c0fee2719175", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13d07e07-3d", "ovs_interfaceid": "13d07e07-3d6e-465d-a21f-94afa7418d3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T10:17:41Z,direct_url=<?>,disk_format='qcow2',id=428766b1-9088-495e-89f1-92ef8fc1491d,min_disk=0,min_ram=0,name='tempest-scenario-img--1409536877',owner='098415c1690e46c39d52c0fee2719175',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T10:17:42Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '428766b1-9088-495e-89f1-92ef8fc1491d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75122) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 10:17:45 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-b2e68345-660b-43ca-877a-210983a51c33 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 10:17:45 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-b2e68345-660b-43ca-877a-210983a51c33 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 10:17:45 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-b2e68345-660b-43ca-877a-210983a51c33 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75122) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 10:17:45 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-b2e68345-660b-43ca-877a-210983a51c33 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] CPU controller missing on host. {{(pid=75122) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 10:17:45 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-b2e68345-660b-43ca-877a-210983a51c33 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75122) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 10:17:45 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-b2e68345-660b-43ca-877a-210983a51c33 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] CPU controller found on host. {{(pid=75122) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 10:17:45 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-b2e68345-660b-43ca-877a-210983a51c33 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75122) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 10:17:45 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-b2e68345-660b-43ca-877a-210983a51c33 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T09:26:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T10:17:41Z,direct_url=<?>,disk_format='qcow2',id=428766b1-9088-495e-89f1-92ef8fc1491d,min_disk=0,min_ram=0,name='tempest-scenario-img--1409536877',owner='098415c1690e46c39d52c0fee2719175',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T10:17:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 10:17:45 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-b2e68345-660b-43ca-877a-210983a51c33 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Flavor limits 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 10:17:45 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-b2e68345-660b-43ca-877a-210983a51c33 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Image limits 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 10:17:45 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-b2e68345-660b-43ca-877a-210983a51c33 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Flavor pref 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 10:17:45 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-b2e68345-660b-43ca-877a-210983a51c33 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Image pref 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 10:17:45 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-b2e68345-660b-43ca-877a-210983a51c33 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 10:17:45 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-b2e68345-660b-43ca-877a-210983a51c33 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 10:17:45 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-b2e68345-660b-43ca-877a-210983a51c33 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75122) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 10:17:45 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-b2e68345-660b-43ca-877a-210983a51c33 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Got 1 possible topologies {{(pid=75122) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 10:17:45 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-b2e68345-660b-43ca-877a-210983a51c33 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 10:17:45 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-b2e68345-660b-43ca-877a-210983a51c33 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 10:17:45 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-b2e68345-660b-43ca-877a-210983a51c33 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T10:17:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1221964987',display_name='tempest-TestMinimumBasicScenario-server-1221964987',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1221964987',id=52,image_ref='428766b1-9088-495e-89f1-92ef8fc1491d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIIao4cKQZ/qF9BJAw+PIejTq5Tu8IleCz5F04hvUMLIUR8OkIUF1KrNvYwt5zvDX7U3TgJJLHEmqMOBxs4ZtbMupNtDqew2ZGAXT/Q/BaP+2R8Y/PSrG4Z3oRyNvg+Sbg==',key_name='tempest-TestMinimumBasicScenario-1276638919',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='098415c1690e46c39d52c0fee2719175',ramdisk_id='',reservation_id='r-c9z6bsi0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='428766b1-9088-495e-89f1-92ef8fc1491d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1402308121',owner_user_name='tempest-TestMinimumBasicScenario-1402308121-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T10:17:44Z,user_data=None,user_id='f3f4814249ab42d399b77e5b8040ec8b',uuid=b727b2b6-0315-4a01-a67c-c485a862b518,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "13d07e07-3d6e-465d-a21f-94afa7418d3b", "address": "fa:16:3e:a5:63:98", "network": {"id": "25afb78c-30e1-4fd7-a215-b5e73ba43057", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2008775745-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "098415c1690e46c39d52c0fee2719175", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13d07e07-3d", "ovs_interfaceid": "13d07e07-3d6e-465d-a21f-94afa7418d3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75122) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 10:17:45 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-b2e68345-660b-43ca-877a-210983a51c33 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Converting VIF {"id": "13d07e07-3d6e-465d-a21f-94afa7418d3b", "address": "fa:16:3e:a5:63:98", "network": {"id": "25afb78c-30e1-4fd7-a215-b5e73ba43057", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2008775745-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "098415c1690e46c39d52c0fee2719175", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13d07e07-3d", "ovs_interfaceid": "13d07e07-3d6e-465d-a21f-94afa7418d3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 10:17:45 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-b2e68345-660b-43ca-877a-210983a51c33 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a5:63:98,bridge_name='br-int',has_traffic_filtering=True,id=13d07e07-3d6e-465d-a21f-94afa7418d3b,network=Network(25afb78c-30e1-4fd7-a215-b5e73ba43057),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13d07e07-3d') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 10:17:45 user nova-compute[75122]: DEBUG nova.objects.instance [None req-b2e68345-660b-43ca-877a-210983a51c33 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Lazy-loading 'pci_devices' on Instance uuid b727b2b6-0315-4a01-a67c-c485a862b518 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 10:17:45 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-b2e68345-660b-43ca-877a-210983a51c33 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] [instance: b727b2b6-0315-4a01-a67c-c485a862b518] End _get_guest_xml xml=<domain type="kvm">
Nov 15 10:17:45 user nova-compute[75122]:   <uuid>b727b2b6-0315-4a01-a67c-c485a862b518</uuid>
Nov 15 10:17:45 user nova-compute[75122]:   <name>instance-00000034</name>
Nov 15 10:17:45 user nova-compute[75122]:   <memory>524288</memory>
Nov 15 10:17:45 user nova-compute[75122]:   <vcpu>1</vcpu>
Nov 15 10:17:45 user nova-compute[75122]:   <metadata>
Nov 15 10:17:45 user nova-compute[75122]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 10:17:45 user nova-compute[75122]:       <nova:package version="0.0.0"/>
Nov 15 10:17:45 user nova-compute[75122]:       <nova:name>tempest-TestMinimumBasicScenario-server-1221964987</nova:name>
Nov 15 10:17:45 user nova-compute[75122]:       <nova:creationTime>2023-11-15 10:17:45</nova:creationTime>
Nov 15 10:17:45 user nova-compute[75122]:       <nova:flavor name="m1.tiny">
Nov 15 10:17:45 user nova-compute[75122]:         <nova:memory>512</nova:memory>
Nov 15 10:17:45 user nova-compute[75122]:         <nova:disk>1</nova:disk>
Nov 15 10:17:45 user nova-compute[75122]:         <nova:swap>0</nova:swap>
Nov 15 10:17:45 user nova-compute[75122]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 10:17:45 user nova-compute[75122]:         <nova:vcpus>1</nova:vcpus>
Nov 15 10:17:45 user nova-compute[75122]:       </nova:flavor>
Nov 15 10:17:45 user nova-compute[75122]:       <nova:owner>
Nov 15 10:17:45 user nova-compute[75122]:         <nova:user uuid="f3f4814249ab42d399b77e5b8040ec8b">tempest-TestMinimumBasicScenario-1402308121-project-member</nova:user>
Nov 15 10:17:45 user nova-compute[75122]:         <nova:project uuid="098415c1690e46c39d52c0fee2719175">tempest-TestMinimumBasicScenario-1402308121</nova:project>
Nov 15 10:17:45 user nova-compute[75122]:       </nova:owner>
Nov 15 10:17:45 user nova-compute[75122]:       <nova:root type="image" uuid="428766b1-9088-495e-89f1-92ef8fc1491d"/>
Nov 15 10:17:45 user nova-compute[75122]:       <nova:ports>
Nov 15 10:17:45 user nova-compute[75122]:         <nova:port uuid="13d07e07-3d6e-465d-a21f-94afa7418d3b">
Nov 15 10:17:45 user nova-compute[75122]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 15 10:17:45 user nova-compute[75122]:         </nova:port>
Nov 15 10:17:45 user nova-compute[75122]:       </nova:ports>
Nov 15 10:17:45 user nova-compute[75122]:     </nova:instance>
Nov 15 10:17:45 user nova-compute[75122]:   </metadata>
Nov 15 10:17:45 user nova-compute[75122]:   <sysinfo type="smbios">
Nov 15 10:17:45 user nova-compute[75122]:     <system>
Nov 15 10:17:45 user nova-compute[75122]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 10:17:45 user nova-compute[75122]:       <entry name="product">OpenStack Nova</entry>
Nov 15 10:17:45 user nova-compute[75122]:       <entry name="version">0.0.0</entry>
Nov 15 10:17:45 user nova-compute[75122]:       <entry name="serial">b727b2b6-0315-4a01-a67c-c485a862b518</entry>
Nov 15 10:17:45 user nova-compute[75122]:       <entry name="uuid">b727b2b6-0315-4a01-a67c-c485a862b518</entry>
Nov 15 10:17:45 user nova-compute[75122]:       <entry name="family">Virtual Machine</entry>
Nov 15 10:17:45 user nova-compute[75122]:     </system>
Nov 15 10:17:45 user nova-compute[75122]:   </sysinfo>
Nov 15 10:17:45 user nova-compute[75122]:   <os>
Nov 15 10:17:45 user nova-compute[75122]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 10:17:45 user nova-compute[75122]:     <boot dev="hd"/>
Nov 15 10:17:45 user nova-compute[75122]:     <smbios mode="sysinfo"/>
Nov 15 10:17:45 user nova-compute[75122]:   </os>
Nov 15 10:17:45 user nova-compute[75122]:   <features>
Nov 15 10:17:45 user nova-compute[75122]:     <acpi/>
Nov 15 10:17:45 user nova-compute[75122]:     <apic/>
Nov 15 10:17:45 user nova-compute[75122]:     <vmcoreinfo/>
Nov 15 10:17:45 user nova-compute[75122]:   </features>
Nov 15 10:17:45 user nova-compute[75122]:   <clock offset="utc">
Nov 15 10:17:45 user nova-compute[75122]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 10:17:45 user nova-compute[75122]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 10:17:45 user nova-compute[75122]:     <timer name="hpet" present="no"/>
Nov 15 10:17:45 user nova-compute[75122]:   </clock>
Nov 15 10:17:45 user nova-compute[75122]:   <cpu mode="custom" match="exact">
Nov 15 10:17:45 user nova-compute[75122]:     <model>Nehalem</model>
Nov 15 10:17:45 user nova-compute[75122]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 10:17:45 user nova-compute[75122]:   </cpu>
Nov 15 10:17:45 user nova-compute[75122]:   <devices>
Nov 15 10:17:45 user nova-compute[75122]:     <disk type="file" device="disk">
Nov 15 10:17:45 user nova-compute[75122]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 10:17:45 user nova-compute[75122]:       <source file="/opt/stack/data/nova/instances/b727b2b6-0315-4a01-a67c-c485a862b518/disk"/>
Nov 15 10:17:45 user nova-compute[75122]:       <target dev="vda" bus="virtio"/>
Nov 15 10:17:45 user nova-compute[75122]:     </disk>
Nov 15 10:17:45 user nova-compute[75122]:     <interface type="ethernet">
Nov 15 10:17:45 user nova-compute[75122]:       <mac address="fa:16:3e:a5:63:98"/>
Nov 15 10:17:45 user nova-compute[75122]:       <model type="virtio"/>
Nov 15 10:17:45 user nova-compute[75122]:       <mtu size="1442"/>
Nov 15 10:17:45 user nova-compute[75122]:       <target dev="tap13d07e07-3d"/>
Nov 15 10:17:45 user nova-compute[75122]:     </interface>
Nov 15 10:17:45 user nova-compute[75122]:     <serial type="pty">
Nov 15 10:17:45 user nova-compute[75122]:       <log file="/opt/stack/data/nova/instances/b727b2b6-0315-4a01-a67c-c485a862b518/console.log" append="off"/>
Nov 15 10:17:45 user nova-compute[75122]:     </serial>
Nov 15 10:17:45 user nova-compute[75122]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 10:17:45 user nova-compute[75122]:     <video>
Nov 15 10:17:45 user nova-compute[75122]:       <model type="virtio"/>
Nov 15 10:17:45 user nova-compute[75122]:     </video>
Nov 15 10:17:45 user nova-compute[75122]:     <rng model="virtio">
Nov 15 10:17:45 user nova-compute[75122]:       <backend model="random">/dev/urandom</backend>
Nov 15 10:17:45 user nova-compute[75122]:     </rng>
Nov 15 10:17:45 user nova-compute[75122]:     <controller type="usb" index="0" model="none"/>
Nov 15 10:17:45 user nova-compute[75122]:     <memballoon model="virtio">
Nov 15 10:17:45 user nova-compute[75122]:       <stats period="10"/>
Nov 15 10:17:45 user nova-compute[75122]:     </memballoon>
Nov 15 10:17:45 user nova-compute[75122]:   </devices>
Nov 15 10:17:45 user nova-compute[75122]: </domain>
Nov 15 10:17:45 user nova-compute[75122]:  {{(pid=75122) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 10:17:45 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-b2e68345-660b-43ca-877a-210983a51c33 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T10:17:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1221964987',display_name='tempest-TestMinimumBasicScenario-server-1221964987',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1221964987',id=52,image_ref='428766b1-9088-495e-89f1-92ef8fc1491d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIIao4cKQZ/qF9BJAw+PIejTq5Tu8IleCz5F04hvUMLIUR8OkIUF1KrNvYwt5zvDX7U3TgJJLHEmqMOBxs4ZtbMupNtDqew2ZGAXT/Q/BaP+2R8Y/PSrG4Z3oRyNvg+Sbg==',key_name='tempest-TestMinimumBasicScenario-1276638919',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='098415c1690e46c39d52c0fee2719175',ramdisk_id='',reservation_id='r-c9z6bsi0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='428766b1-9088-495e-89f1-92ef8fc1491d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1402308121',owner_user_name='tempest-TestMinimumBasicScenario-1402308121-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T10:17:44Z,user_data=None,user_id='f3f4814249ab42d399b77e5b8040ec8b',uuid=b727b2b6-0315-4a01-a67c-c485a862b518,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "13d07e07-3d6e-465d-a21f-94afa7418d3b", "address": "fa:16:3e:a5:63:98", "network": {"id": "25afb78c-30e1-4fd7-a215-b5e73ba43057", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2008775745-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "098415c1690e46c39d52c0fee2719175", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13d07e07-3d", "ovs_interfaceid": "13d07e07-3d6e-465d-a21f-94afa7418d3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 10:17:45 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-b2e68345-660b-43ca-877a-210983a51c33 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Converting VIF {"id": "13d07e07-3d6e-465d-a21f-94afa7418d3b", "address": "fa:16:3e:a5:63:98", "network": {"id": "25afb78c-30e1-4fd7-a215-b5e73ba43057", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2008775745-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "098415c1690e46c39d52c0fee2719175", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13d07e07-3d", "ovs_interfaceid": "13d07e07-3d6e-465d-a21f-94afa7418d3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 10:17:45 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-b2e68345-660b-43ca-877a-210983a51c33 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a5:63:98,bridge_name='br-int',has_traffic_filtering=True,id=13d07e07-3d6e-465d-a21f-94afa7418d3b,network=Network(25afb78c-30e1-4fd7-a215-b5e73ba43057),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13d07e07-3d') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 10:17:45 user nova-compute[75122]: DEBUG os_vif [None req-b2e68345-660b-43ca-877a-210983a51c33 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:63:98,bridge_name='br-int',has_traffic_filtering=True,id=13d07e07-3d6e-465d-a21f-94afa7418d3b,network=Network(25afb78c-30e1-4fd7-a215-b5e73ba43057),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13d07e07-3d') {{(pid=75122) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 10:17:45 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:17:45 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 10:17:45 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 10:17:45 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:17:45 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '32fe3692-dd49-556e-86bc-6ae9c544f39f', '_type': 'linux-noop'}}, row=False) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 10:17:45 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:17:45 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:17:45 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:17:45 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap13d07e07-3d, may_exist=True, interface_attrs={}) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 10:17:45 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap13d07e07-3d, col_values=(('qos', UUID('d36920a4-71ce-4a8c-b25d-79ab90bf6618')),), if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 10:17:45 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap13d07e07-3d, col_values=(('external_ids', {'iface-id': '13d07e07-3d6e-465d-a21f-94afa7418d3b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a5:63:98', 'vm-uuid': 'b727b2b6-0315-4a01-a67c-c485a862b518'}),), if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 10:17:45 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:17:45 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:17:45 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:17:45 user nova-compute[75122]: INFO os_vif [None req-b2e68345-660b-43ca-877a-210983a51c33 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:63:98,bridge_name='br-int',has_traffic_filtering=True,id=13d07e07-3d6e-465d-a21f-94afa7418d3b,network=Network(25afb78c-30e1-4fd7-a215-b5e73ba43057),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13d07e07-3d')
Nov 15 10:17:45 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-b2e68345-660b-43ca-877a-210983a51c33 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] No BDM found with device name vda, not building metadata. {{(pid=75122) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 10:17:45 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-b2e68345-660b-43ca-877a-210983a51c33 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] No VIF found with MAC fa:16:3e:a5:63:98, not building metadata {{(pid=75122) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 10:17:46 user nova-compute[75122]: DEBUG nova.network.neutron [req-35cecc2f-41c1-46fb-83db-d16f24367fc6 req-86ff008a-51ed-48a7-87bf-d4598833804b service nova] [instance: b727b2b6-0315-4a01-a67c-c485a862b518] Updated VIF entry in instance network info cache for port 13d07e07-3d6e-465d-a21f-94afa7418d3b. {{(pid=75122) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 10:17:46 user nova-compute[75122]: DEBUG nova.network.neutron [req-35cecc2f-41c1-46fb-83db-d16f24367fc6 req-86ff008a-51ed-48a7-87bf-d4598833804b service nova] [instance: b727b2b6-0315-4a01-a67c-c485a862b518] Updating instance_info_cache with network_info: [{"id": "13d07e07-3d6e-465d-a21f-94afa7418d3b", "address": "fa:16:3e:a5:63:98", "network": {"id": "25afb78c-30e1-4fd7-a215-b5e73ba43057", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2008775745-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "098415c1690e46c39d52c0fee2719175", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13d07e07-3d", "ovs_interfaceid": "13d07e07-3d6e-465d-a21f-94afa7418d3b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 10:17:46 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-35cecc2f-41c1-46fb-83db-d16f24367fc6 req-86ff008a-51ed-48a7-87bf-d4598833804b service nova] Releasing lock "refresh_cache-b727b2b6-0315-4a01-a67c-c485a862b518" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 10:17:47 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:17:47 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:17:47 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:17:47 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:17:47 user nova-compute[75122]: DEBUG nova.compute.manager [req-9dd3753a-d325-48fb-af0f-9f0102193713 req-477671ef-c49a-4e51-ae34-5ac7bdceb55d service nova] [instance: b727b2b6-0315-4a01-a67c-c485a862b518] Received event network-vif-plugged-13d07e07-3d6e-465d-a21f-94afa7418d3b {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 10:17:47 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-9dd3753a-d325-48fb-af0f-9f0102193713 req-477671ef-c49a-4e51-ae34-5ac7bdceb55d service nova] Acquiring lock "b727b2b6-0315-4a01-a67c-c485a862b518-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:17:47 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-9dd3753a-d325-48fb-af0f-9f0102193713 req-477671ef-c49a-4e51-ae34-5ac7bdceb55d service nova] Lock "b727b2b6-0315-4a01-a67c-c485a862b518-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:17:47 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-9dd3753a-d325-48fb-af0f-9f0102193713 req-477671ef-c49a-4e51-ae34-5ac7bdceb55d service nova] Lock "b727b2b6-0315-4a01-a67c-c485a862b518-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:17:47 user nova-compute[75122]: DEBUG nova.compute.manager [req-9dd3753a-d325-48fb-af0f-9f0102193713 req-477671ef-c49a-4e51-ae34-5ac7bdceb55d service nova] [instance: b727b2b6-0315-4a01-a67c-c485a862b518] No waiting events found dispatching network-vif-plugged-13d07e07-3d6e-465d-a21f-94afa7418d3b {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 10:17:47 user nova-compute[75122]: WARNING nova.compute.manager [req-9dd3753a-d325-48fb-af0f-9f0102193713 req-477671ef-c49a-4e51-ae34-5ac7bdceb55d service nova] [instance: b727b2b6-0315-4a01-a67c-c485a862b518] Received unexpected event network-vif-plugged-13d07e07-3d6e-465d-a21f-94afa7418d3b for instance with vm_state building and task_state spawning.
Nov 15 10:17:47 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:17:47 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:17:47 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:17:49 user nova-compute[75122]: DEBUG nova.compute.manager [None req-b2e68345-660b-43ca-877a-210983a51c33 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] [instance: b727b2b6-0315-4a01-a67c-c485a862b518] Instance event wait completed in 0 seconds for  {{(pid=75122) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 10:17:49 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-b2e68345-660b-43ca-877a-210983a51c33 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] [instance: b727b2b6-0315-4a01-a67c-c485a862b518] Guest created on hypervisor {{(pid=75122) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 10:17:49 user nova-compute[75122]: INFO nova.virt.libvirt.driver [-] [instance: b727b2b6-0315-4a01-a67c-c485a862b518] Instance spawned successfully.
Nov 15 10:17:49 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-b2e68345-660b-43ca-877a-210983a51c33 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] [instance: b727b2b6-0315-4a01-a67c-c485a862b518] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 10:17:49 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-b2e68345-660b-43ca-877a-210983a51c33 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] [instance: b727b2b6-0315-4a01-a67c-c485a862b518] Found default for hw_cdrom_bus of ide {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 10:17:49 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-b2e68345-660b-43ca-877a-210983a51c33 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] [instance: b727b2b6-0315-4a01-a67c-c485a862b518] Found default for hw_disk_bus of virtio {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 10:17:49 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-b2e68345-660b-43ca-877a-210983a51c33 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] [instance: b727b2b6-0315-4a01-a67c-c485a862b518] Found default for hw_input_bus of None {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 10:17:49 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-b2e68345-660b-43ca-877a-210983a51c33 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] [instance: b727b2b6-0315-4a01-a67c-c485a862b518] Found default for hw_pointer_model of None {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 10:17:49 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-b2e68345-660b-43ca-877a-210983a51c33 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] [instance: b727b2b6-0315-4a01-a67c-c485a862b518] Found default for hw_video_model of virtio {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 10:17:49 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-b2e68345-660b-43ca-877a-210983a51c33 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] [instance: b727b2b6-0315-4a01-a67c-c485a862b518] Found default for hw_vif_model of virtio {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 10:17:49 user nova-compute[75122]: INFO nova.compute.manager [None req-b2e68345-660b-43ca-877a-210983a51c33 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] [instance: b727b2b6-0315-4a01-a67c-c485a862b518] Took 5.34 seconds to spawn the instance on the hypervisor.
Nov 15 10:17:49 user nova-compute[75122]: DEBUG nova.compute.manager [None req-b2e68345-660b-43ca-877a-210983a51c33 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] [instance: b727b2b6-0315-4a01-a67c-c485a862b518] Checking state {{(pid=75122) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 10:17:49 user nova-compute[75122]: INFO nova.compute.manager [None req-b2e68345-660b-43ca-877a-210983a51c33 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] [instance: b727b2b6-0315-4a01-a67c-c485a862b518] Took 5.85 seconds to build instance.
Nov 15 10:17:49 user nova-compute[75122]: DEBUG nova.compute.manager [req-72370d20-5d10-409b-8f32-99e99e070190 req-e773462f-6dad-46d0-aae0-0c91fa2aee7f service nova] [instance: b727b2b6-0315-4a01-a67c-c485a862b518] Received event network-vif-plugged-13d07e07-3d6e-465d-a21f-94afa7418d3b {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 10:17:49 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-72370d20-5d10-409b-8f32-99e99e070190 req-e773462f-6dad-46d0-aae0-0c91fa2aee7f service nova] Acquiring lock "b727b2b6-0315-4a01-a67c-c485a862b518-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:17:49 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-72370d20-5d10-409b-8f32-99e99e070190 req-e773462f-6dad-46d0-aae0-0c91fa2aee7f service nova] Lock "b727b2b6-0315-4a01-a67c-c485a862b518-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:17:49 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-72370d20-5d10-409b-8f32-99e99e070190 req-e773462f-6dad-46d0-aae0-0c91fa2aee7f service nova] Lock "b727b2b6-0315-4a01-a67c-c485a862b518-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:17:49 user nova-compute[75122]: DEBUG nova.compute.manager [req-72370d20-5d10-409b-8f32-99e99e070190 req-e773462f-6dad-46d0-aae0-0c91fa2aee7f service nova] [instance: b727b2b6-0315-4a01-a67c-c485a862b518] No waiting events found dispatching network-vif-plugged-13d07e07-3d6e-465d-a21f-94afa7418d3b {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 10:17:49 user nova-compute[75122]: WARNING nova.compute.manager [req-72370d20-5d10-409b-8f32-99e99e070190 req-e773462f-6dad-46d0-aae0-0c91fa2aee7f service nova] [instance: b727b2b6-0315-4a01-a67c-c485a862b518] Received unexpected event network-vif-plugged-13d07e07-3d6e-465d-a21f-94afa7418d3b for instance with vm_state active and task_state None.
Nov 15 10:17:49 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-b2e68345-660b-43ca-877a-210983a51c33 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Lock "b727b2b6-0315-4a01-a67c-c485a862b518" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.954s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:17:50 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:17:50 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:17:50 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:17:52 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:17:52 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:17:52 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:17:52 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:17:52 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:17:52 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:17:52 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75122) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 10:17:52 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b727b2b6-0315-4a01-a67c-c485a862b518/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:17:52 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b727b2b6-0315-4a01-a67c-c485a862b518/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:17:52 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b727b2b6-0315-4a01-a67c-c485a862b518/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:17:52 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b727b2b6-0315-4a01-a67c-c485a862b518/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:17:53 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 10:17:53 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 10:17:53 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Hypervisor/Node resource view: name=user free_ram=9067MB free_disk=25.047992706298828GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75122) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 10:17:53 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:17:53 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:17:53 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance b727b2b6-0315-4a01-a67c-c485a862b518 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 10:17:53 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75122) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 10:17:53 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75122) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 10:17:53 user nova-compute[75122]: DEBUG nova.compute.provider_tree [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Inventory has not changed in ProviderTree for provider: 69a3da65-47be-44c6-b67c-c692b58284ef {{(pid=75122) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 10:17:53 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Inventory has not changed for provider 69a3da65-47be-44c6-b67c-c692b58284ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 10:17:53 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Compute_service record updated for user:user {{(pid=75122) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 10:17:53 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.187s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:17:55 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:17:57 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:17:57 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Starting heal instance info cache {{(pid=75122) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 10:17:57 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Rebuilding the list of instances to heal {{(pid=75122) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 10:17:57 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "refresh_cache-b727b2b6-0315-4a01-a67c-c485a862b518" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 10:17:57 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquired lock "refresh_cache-b727b2b6-0315-4a01-a67c-c485a862b518" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 10:17:57 user nova-compute[75122]: DEBUG nova.network.neutron [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] [instance: b727b2b6-0315-4a01-a67c-c485a862b518] Forcefully refreshing network info cache for instance {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 10:17:57 user nova-compute[75122]: DEBUG nova.objects.instance [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lazy-loading 'info_cache' on Instance uuid b727b2b6-0315-4a01-a67c-c485a862b518 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 10:17:57 user nova-compute[75122]: DEBUG nova.network.neutron [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] [instance: b727b2b6-0315-4a01-a67c-c485a862b518] Updating instance_info_cache with network_info: [{"id": "13d07e07-3d6e-465d-a21f-94afa7418d3b", "address": "fa:16:3e:a5:63:98", "network": {"id": "25afb78c-30e1-4fd7-a215-b5e73ba43057", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2008775745-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "098415c1690e46c39d52c0fee2719175", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13d07e07-3d", "ovs_interfaceid": "13d07e07-3d6e-465d-a21f-94afa7418d3b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 10:17:57 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Releasing lock "refresh_cache-b727b2b6-0315-4a01-a67c-c485a862b518" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 10:17:57 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] [instance: b727b2b6-0315-4a01-a67c-c485a862b518] Updated the network info_cache for instance {{(pid=75122) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 10:17:57 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:17:59 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:18:00 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:18:00 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:18:02 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:18:02 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75122) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 10:18:03 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:18:03 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Triggering sync for uuid b727b2b6-0315-4a01-a67c-c485a862b518 {{(pid=75122) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 10:18:03 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "b727b2b6-0315-4a01-a67c-c485a862b518" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:18:03 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "b727b2b6-0315-4a01-a67c-c485a862b518" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:18:03 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "b727b2b6-0315-4a01-a67c-c485a862b518" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.024s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:18:05 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:18:07 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:18:10 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:18:12 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:18:15 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:18:17 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:18:20 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:18:22 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:18:25 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:18:30 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:18:35 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:18:35 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:18:35 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75122) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 10:18:35 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75122) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 10:18:35 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75122) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 10:18:35 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:18:40 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:18:45 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:18:50 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:18:50 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:18:50 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:18:53 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:18:53 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:18:53 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:18:53 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:18:53 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:18:53 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75122) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 10:18:53 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b727b2b6-0315-4a01-a67c-c485a862b518/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:18:53 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b727b2b6-0315-4a01-a67c-c485a862b518/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:18:53 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b727b2b6-0315-4a01-a67c-c485a862b518/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:18:53 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b727b2b6-0315-4a01-a67c-c485a862b518/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:18:53 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 10:18:53 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 10:18:54 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Hypervisor/Node resource view: name=user free_ram=9020MB free_disk=25.019607543945312GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75122) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 10:18:54 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:18:54 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:18:54 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance b727b2b6-0315-4a01-a67c-c485a862b518 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 10:18:54 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75122) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 10:18:54 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75122) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 10:18:54 user nova-compute[75122]: DEBUG nova.compute.provider_tree [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Inventory has not changed in ProviderTree for provider: 69a3da65-47be-44c6-b67c-c692b58284ef {{(pid=75122) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 10:18:54 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Inventory has not changed for provider 69a3da65-47be-44c6-b67c-c692b58284ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 10:18:54 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Compute_service record updated for user:user {{(pid=75122) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 10:18:54 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.179s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:18:55 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:18:59 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:18:59 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:18:59 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Starting heal instance info cache {{(pid=75122) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 10:18:59 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Rebuilding the list of instances to heal {{(pid=75122) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 10:18:59 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "refresh_cache-b727b2b6-0315-4a01-a67c-c485a862b518" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 10:18:59 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquired lock "refresh_cache-b727b2b6-0315-4a01-a67c-c485a862b518" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 10:18:59 user nova-compute[75122]: DEBUG nova.network.neutron [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] [instance: b727b2b6-0315-4a01-a67c-c485a862b518] Forcefully refreshing network info cache for instance {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 10:18:59 user nova-compute[75122]: DEBUG nova.objects.instance [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lazy-loading 'info_cache' on Instance uuid b727b2b6-0315-4a01-a67c-c485a862b518 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 10:18:59 user nova-compute[75122]: DEBUG nova.network.neutron [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] [instance: b727b2b6-0315-4a01-a67c-c485a862b518] Updating instance_info_cache with network_info: [{"id": "13d07e07-3d6e-465d-a21f-94afa7418d3b", "address": "fa:16:3e:a5:63:98", "network": {"id": "25afb78c-30e1-4fd7-a215-b5e73ba43057", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2008775745-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "098415c1690e46c39d52c0fee2719175", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13d07e07-3d", "ovs_interfaceid": "13d07e07-3d6e-465d-a21f-94afa7418d3b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 10:18:59 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Releasing lock "refresh_cache-b727b2b6-0315-4a01-a67c-c485a862b518" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 10:18:59 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] [instance: b727b2b6-0315-4a01-a67c-c485a862b518] Updated the network info_cache for instance {{(pid=75122) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 10:18:59 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:19:00 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:19:00 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:19:00 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75122) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 10:19:00 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75122) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 10:19:00 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75122) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 10:19:00 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:19:02 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:19:02 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:19:02 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75122) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 10:19:05 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:19:06 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:19:10 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:19:15 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:19:20 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:19:25 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:19:30 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:19:30 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:19:30 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75122) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 10:19:30 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75122) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 10:19:30 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75122) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 10:19:30 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:19:35 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-f8594a9d-49c1-412f-8d86-d7e0cde6c33f tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Acquiring lock "b727b2b6-0315-4a01-a67c-c485a862b518" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:19:35 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-f8594a9d-49c1-412f-8d86-d7e0cde6c33f tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Lock "b727b2b6-0315-4a01-a67c-c485a862b518" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:19:35 user nova-compute[75122]: DEBUG nova.objects.instance [None req-f8594a9d-49c1-412f-8d86-d7e0cde6c33f tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Lazy-loading 'flavor' on Instance uuid b727b2b6-0315-4a01-a67c-c485a862b518 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 10:19:35 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-f8594a9d-49c1-412f-8d86-d7e0cde6c33f tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Lock "b727b2b6-0315-4a01-a67c-c485a862b518" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:19:35 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:19:35 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-f8594a9d-49c1-412f-8d86-d7e0cde6c33f tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Acquiring lock "b727b2b6-0315-4a01-a67c-c485a862b518" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:19:35 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-f8594a9d-49c1-412f-8d86-d7e0cde6c33f tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Lock "b727b2b6-0315-4a01-a67c-c485a862b518" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:19:35 user nova-compute[75122]: INFO nova.compute.manager [None req-f8594a9d-49c1-412f-8d86-d7e0cde6c33f tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] [instance: b727b2b6-0315-4a01-a67c-c485a862b518] Attaching volume 74080876-a54d-4b0f-b394-15f97311594d to /dev/vdb
Nov 15 10:19:36 user nova-compute[75122]: DEBUG os_brick.utils [None req-f8594a9d-49c1-412f-8d86-d7e0cde6c33f tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 10:19:36 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:19:36 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:19:36 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[df0b087b-541e-4f5e-9435-78511f415a2d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:742fb64b3587\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:19:36 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:19:36 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:19:36 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[e27495c9-47b4-4803-9f04-b527d67319ba]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:19:36 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:19:36 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:19:36 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a6ae8a1-4ef3-43bc-ae0b-864b97844f34]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:19:36 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[62e82b83-d160-4afe-8c5e-e35d29a45fdb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:19:36 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-f8594a9d-49c1-412f-8d86-d7e0cde6c33f tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Running cmd (subprocess): nvme version {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:19:36 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-f8594a9d-49c1-412f-8d86-d7e0cde6c33f tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] 'nvme version' failed. Not Retrying. {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 10:19:36 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f8594a9d-49c1-412f-8d86-d7e0cde6c33f tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] nvme not present on system {{(pid=75122) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 10:19:36 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:19:36 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 10:19:36 user nova-compute[75122]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 10:19:36 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf38008b-010e-4b68-95d2-1ed68f9848e9]: (4, '') {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:19:36 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.lightos [None req-f8594a9d-49c1-412f-8d86-d7e0cde6c33f tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75122) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 10:19:36 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.lightos [None req-f8594a9d-49c1-412f-8d86-d7e0cde6c33f tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75122) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 10:19:36 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.lightos [None req-f8594a9d-49c1-412f-8d86-d7e0cde6c33f tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] LIGHTOS: no hostnqn found. {{(pid=75122) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 10:19:36 user nova-compute[75122]: DEBUG os_brick.utils [None req-f8594a9d-49c1-412f-8d86-d7e0cde6c33f tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:742fb64b3587', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 10:19:36 user nova-compute[75122]: DEBUG nova.virt.block_device [None req-f8594a9d-49c1-412f-8d86-d7e0cde6c33f tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] [instance: b727b2b6-0315-4a01-a67c-c485a862b518] Updating existing volume attachment record: d31556ac-0363-4634-bf36-200f049085c5 {{(pid=75122) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 10:19:40 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f8594a9d-49c1-412f-8d86-d7e0cde6c33f tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] [instance: b727b2b6-0315-4a01-a67c-c485a862b518] Calling os-brick to attach iSCSI Volume {{(pid=75122) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 10:19:40 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8594a9d-49c1-412f-8d86-d7e0cde6c33f tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffa04060b80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:74080876-a54d-4b0f-b394-15f97311594d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PHVImFUx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 10:19:40 user nova-compute[75122]: WARNING os_brick.initiator.connectors.base [None req-f8594a9d-49c1-412f-8d86-d7e0cde6c33f tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 10:19:40 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-f8594a9d-49c1-412f-8d86-d7e0cde6c33f tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 10:19:40 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-f8594a9d-49c1-412f-8d86-d7e0cde6c33f tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 10:19:40 user nova-compute[75122]: WARNING os_brick.initiator.connectors.base [None req-f8594a9d-49c1-412f-8d86-d7e0cde6c33f tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 10:19:40 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-f8594a9d-49c1-412f-8d86-d7e0cde6c33f tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:74080876-a54d-4b0f-b394-15f97311594d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 10:19:40 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-f8594a9d-49c1-412f-8d86-d7e0cde6c33f tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:74080876-a54d-4b0f-b394-15f97311594d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 10:19:40 user nova-compute[75122]: INFO os_brick.initiator.connectors.iscsi [None req-f8594a9d-49c1-412f-8d86-d7e0cde6c33f tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 10:19:40 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74080876-a54d-4b0f-b394-15f97311594d -p 172.16.0.220:3260 {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:19:40 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74080876-a54d-4b0f-b394-15f97311594d -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:19:40 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b5c6f66-7d29-4b2d-a446-11542e438f03]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:19:40 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8594a9d-49c1-412f-8d86-d7e0cde6c33f tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 10:19:40 user nova-compute[75122]:  {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 10:19:40 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74080876-a54d-4b0f-b394-15f97311594d -p 172.16.0.220:3260 --interface default --op new {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:19:40 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74080876-a54d-4b0f-b394-15f97311594d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:19:40 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[4acedd11-d942-415a-b3a7-559ff54df2b6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:74080876-a54d-4b0f-b394-15f97311594d] added\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:19:40 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8594a9d-49c1-412f-8d86-d7e0cde6c33f tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:74080876-a54d-4b0f-b394-15f97311594d] added
Nov 15 10:19:40 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 10:19:40 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74080876-a54d-4b0f-b394-15f97311594d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:19:40 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74080876-a54d-4b0f-b394-15f97311594d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:19:40 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[851978a2-f57a-4b7e-b974-9e6cb91dbe28]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:19:40 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8594a9d-49c1-412f-8d86-d7e0cde6c33f tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 10:19:40 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74080876-a54d-4b0f-b394-15f97311594d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:19:40 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74080876-a54d-4b0f-b394-15f97311594d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:19:40 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[806f0e17-11f0-40d5-891f-d9fac8a7c9ec]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:19:40 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8594a9d-49c1-412f-8d86-d7e0cde6c33f tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 10:19:40 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74080876-a54d-4b0f-b394-15f97311594d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PHVImFUx {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:19:40 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74080876-a54d-4b0f-b394-15f97311594d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PHVImFUx" returned: 0 in 0.016s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:19:40 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6e8de3a-48a6-4651-88e9-afcfa97ef436]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:19:40 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8594a9d-49c1-412f-8d86-d7e0cde6c33f tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PHVImFUx'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 10:19:40 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74080876-a54d-4b0f-b394-15f97311594d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:19:40 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74080876-a54d-4b0f-b394-15f97311594d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:19:40 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cea3f2d-6220-4483-9e5a-7bacb0bd532e]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:19:40 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8594a9d-49c1-412f-8d86-d7e0cde6c33f tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 10:19:40 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:19:40 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:19:40 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[2323dac1-335b-408e-a3dd-d71fb1788a94]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:19:40 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8594a9d-49c1-412f-8d86-d7e0cde6c33f tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 15 10:19:40 user nova-compute[75122]:  {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 10:19:40 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8594a9d-49c1-412f-8d86-d7e0cde6c33f tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 15 10:19:40 user nova-compute[75122]:  {{(pid=75122) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 10:19:40 user nova-compute[75122]: WARNING os_brick.initiator.connectors.iscsi [None req-f8594a9d-49c1-412f-8d86-d7e0cde6c33f tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 15 10:19:40 user nova-compute[75122]: 
Nov 15 10:19:40 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74080876-a54d-4b0f-b394-15f97311594d -p 172.16.0.220:3260 --login {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:19:40 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74080876-a54d-4b0f-b394-15f97311594d -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:19:40 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[14bc08dc-9692-4674-86b5-f9b1f8793b50]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:74080876-a54d-4b0f-b394-15f97311594d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:74080876-a54d-4b0f-b394-15f97311594d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:19:40 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8594a9d-49c1-412f-8d86-d7e0cde6c33f tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:74080876-a54d-4b0f-b394-15f97311594d, portal: 172.16.0.220,3260]
Nov 15 10:19:40 user nova-compute[75122]: Login to [iface: default, target: iqn.2010-10.org.openstack:74080876-a54d-4b0f-b394-15f97311594d, portal: 172.16.0.220,3260] successful.
Nov 15 10:19:40 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 10:19:40 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74080876-a54d-4b0f-b394-15f97311594d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:19:40 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74080876-a54d-4b0f-b394-15f97311594d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:19:40 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[e62aee44-4521-4fa6-8e55-2f126ac7e998]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:19:40 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8594a9d-49c1-412f-8d86-d7e0cde6c33f tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 10:19:40 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:19:40 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:19:40 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2c5ee0e-4286-441b-859d-a1cc8d6ad5b8]: (4, ('tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74080876-a54d-4b0f-b394-15f97311594d (non-flash)\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:19:40 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8594a9d-49c1-412f-8d86-d7e0cde6c33f tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74080876-a54d-4b0f-b394-15f97311594d (non-flash)
Nov 15 10:19:40 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 10:19:40 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8594a9d-49c1-412f-8d86-d7e0cde6c33f tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] iscsi session list stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74080876-a54d-4b0f-b394-15f97311594d (non-flash)
Nov 15 10:19:40 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 10:19:40 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-f8594a9d-49c1-412f-8d86-d7e0cde6c33f tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:74080876-a54d-4b0f-b394-15f97311594d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.229s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 10:19:40 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8594a9d-49c1-412f-8d86-d7e0cde6c33f tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Connected to 172.16.0.220:3260 {{(pid=75122) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 10:19:40 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-f8594a9d-49c1-412f-8d86-d7e0cde6c33f tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] HCTL ('33', '-', '-', 0) found on session 63 with lun 0 {{(pid=75122) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 10:19:40 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-f8594a9d-49c1-412f-8d86-d7e0cde6c33f tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75122) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 10:19:40 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:19:40 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:19:40 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[da96c939-1799-4d64-8f69-980ec4cea6e4]: (4, ('- - 0', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:19:40 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-f8594a9d-49c1-412f-8d86-d7e0cde6c33f tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Searching for a device in session 63 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75122) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 10:19:40 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8594a9d-49c1-412f-8d86-d7e0cde6c33f tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:74080876-a54d-4b0f-b394-15f97311594d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PHVImFUx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75122) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 10:19:40 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:19:41 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-f8594a9d-49c1-412f-8d86-d7e0cde6c33f tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.259s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 10:19:41 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8594a9d-49c1-412f-8d86-d7e0cde6c33f tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] <== connect_volume: return (1262ms) {'type': 'block', 'scsi_wwn': '23336346432306235', 'path': '/dev/sdb'} {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 10:19:41 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f8594a9d-49c1-412f-8d86-d7e0cde6c33f tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] [instance: b727b2b6-0315-4a01-a67c-c485a862b518] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23336346432306235', 'path': '/dev/sdb'} {{(pid=75122) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 10:19:41 user nova-compute[75122]: DEBUG nova.objects.instance [None req-f8594a9d-49c1-412f-8d86-d7e0cde6c33f tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Lazy-loading 'flavor' on Instance uuid b727b2b6-0315-4a01-a67c-c485a862b518 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 10:19:41 user nova-compute[75122]: DEBUG nova.virt.libvirt.guest [None req-f8594a9d-49c1-412f-8d86-d7e0cde6c33f tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 10:19:41 user nova-compute[75122]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 10:19:41 user nova-compute[75122]:   <source dev="/dev/sdb"/>
Nov 15 10:19:41 user nova-compute[75122]:   <target dev="vdb" bus="virtio"/>
Nov 15 10:19:41 user nova-compute[75122]:   <serial>74080876-a54d-4b0f-b394-15f97311594d</serial>
Nov 15 10:19:41 user nova-compute[75122]: </disk>
Nov 15 10:19:41 user nova-compute[75122]:  {{(pid=75122) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 10:19:42 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-f8594a9d-49c1-412f-8d86-d7e0cde6c33f tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] No BDM found with device name vda, not building metadata. {{(pid=75122) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 10:19:42 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-f8594a9d-49c1-412f-8d86-d7e0cde6c33f tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75122) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 10:19:42 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-f8594a9d-49c1-412f-8d86-d7e0cde6c33f tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] No VIF found with MAC fa:16:3e:a5:63:98, not building metadata {{(pid=75122) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 10:19:42 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-f8594a9d-49c1-412f-8d86-d7e0cde6c33f tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Lock "b727b2b6-0315-4a01-a67c-c485a862b518" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.471s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:19:44 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:19:45 user nova-compute[75122]: DEBUG nova.compute.manager [req-e9169b39-3cff-4718-927d-5138352fc7d1 req-cd7826d0-781a-4195-b318-50ca4a485924 service nova] [instance: b727b2b6-0315-4a01-a67c-c485a862b518] Received event network-changed-13d07e07-3d6e-465d-a21f-94afa7418d3b {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 10:19:45 user nova-compute[75122]: DEBUG nova.compute.manager [req-e9169b39-3cff-4718-927d-5138352fc7d1 req-cd7826d0-781a-4195-b318-50ca4a485924 service nova] [instance: b727b2b6-0315-4a01-a67c-c485a862b518] Refreshing instance network info cache due to event network-changed-13d07e07-3d6e-465d-a21f-94afa7418d3b. {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 10:19:45 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-e9169b39-3cff-4718-927d-5138352fc7d1 req-cd7826d0-781a-4195-b318-50ca4a485924 service nova] Acquiring lock "refresh_cache-b727b2b6-0315-4a01-a67c-c485a862b518" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 10:19:45 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-e9169b39-3cff-4718-927d-5138352fc7d1 req-cd7826d0-781a-4195-b318-50ca4a485924 service nova] Acquired lock "refresh_cache-b727b2b6-0315-4a01-a67c-c485a862b518" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 10:19:45 user nova-compute[75122]: DEBUG nova.network.neutron [req-e9169b39-3cff-4718-927d-5138352fc7d1 req-cd7826d0-781a-4195-b318-50ca4a485924 service nova] [instance: b727b2b6-0315-4a01-a67c-c485a862b518] Refreshing network info cache for port 13d07e07-3d6e-465d-a21f-94afa7418d3b {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 10:19:45 user nova-compute[75122]: DEBUG nova.network.neutron [req-e9169b39-3cff-4718-927d-5138352fc7d1 req-cd7826d0-781a-4195-b318-50ca4a485924 service nova] [instance: b727b2b6-0315-4a01-a67c-c485a862b518] Updated VIF entry in instance network info cache for port 13d07e07-3d6e-465d-a21f-94afa7418d3b. {{(pid=75122) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 10:19:45 user nova-compute[75122]: DEBUG nova.network.neutron [req-e9169b39-3cff-4718-927d-5138352fc7d1 req-cd7826d0-781a-4195-b318-50ca4a485924 service nova] [instance: b727b2b6-0315-4a01-a67c-c485a862b518] Updating instance_info_cache with network_info: [{"id": "13d07e07-3d6e-465d-a21f-94afa7418d3b", "address": "fa:16:3e:a5:63:98", "network": {"id": "25afb78c-30e1-4fd7-a215-b5e73ba43057", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2008775745-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "098415c1690e46c39d52c0fee2719175", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13d07e07-3d", "ovs_interfaceid": "13d07e07-3d6e-465d-a21f-94afa7418d3b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 10:19:45 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:19:45 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-e9169b39-3cff-4718-927d-5138352fc7d1 req-cd7826d0-781a-4195-b318-50ca4a485924 service nova] Releasing lock "refresh_cache-b727b2b6-0315-4a01-a67c-c485a862b518" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 10:19:47 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:19:47 user nova-compute[75122]: DEBUG nova.compute.manager [req-a363a1eb-a485-4483-92fc-0bc37f872d8d req-fa2e25f9-afad-432e-ba9e-8d06f8ff405b service nova] [instance: b727b2b6-0315-4a01-a67c-c485a862b518] Received event network-changed-13d07e07-3d6e-465d-a21f-94afa7418d3b {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 10:19:47 user nova-compute[75122]: DEBUG nova.compute.manager [req-a363a1eb-a485-4483-92fc-0bc37f872d8d req-fa2e25f9-afad-432e-ba9e-8d06f8ff405b service nova] [instance: b727b2b6-0315-4a01-a67c-c485a862b518] Refreshing instance network info cache due to event network-changed-13d07e07-3d6e-465d-a21f-94afa7418d3b. {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 10:19:47 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-a363a1eb-a485-4483-92fc-0bc37f872d8d req-fa2e25f9-afad-432e-ba9e-8d06f8ff405b service nova] Acquiring lock "refresh_cache-b727b2b6-0315-4a01-a67c-c485a862b518" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 10:19:47 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-a363a1eb-a485-4483-92fc-0bc37f872d8d req-fa2e25f9-afad-432e-ba9e-8d06f8ff405b service nova] Acquired lock "refresh_cache-b727b2b6-0315-4a01-a67c-c485a862b518" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 10:19:47 user nova-compute[75122]: DEBUG nova.network.neutron [req-a363a1eb-a485-4483-92fc-0bc37f872d8d req-fa2e25f9-afad-432e-ba9e-8d06f8ff405b service nova] [instance: b727b2b6-0315-4a01-a67c-c485a862b518] Refreshing network info cache for port 13d07e07-3d6e-465d-a21f-94afa7418d3b {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 10:19:47 user nova-compute[75122]: DEBUG nova.network.neutron [req-a363a1eb-a485-4483-92fc-0bc37f872d8d req-fa2e25f9-afad-432e-ba9e-8d06f8ff405b service nova] [instance: b727b2b6-0315-4a01-a67c-c485a862b518] Updated VIF entry in instance network info cache for port 13d07e07-3d6e-465d-a21f-94afa7418d3b. {{(pid=75122) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 10:19:47 user nova-compute[75122]: DEBUG nova.network.neutron [req-a363a1eb-a485-4483-92fc-0bc37f872d8d req-fa2e25f9-afad-432e-ba9e-8d06f8ff405b service nova] [instance: b727b2b6-0315-4a01-a67c-c485a862b518] Updating instance_info_cache with network_info: [{"id": "13d07e07-3d6e-465d-a21f-94afa7418d3b", "address": "fa:16:3e:a5:63:98", "network": {"id": "25afb78c-30e1-4fd7-a215-b5e73ba43057", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2008775745-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "098415c1690e46c39d52c0fee2719175", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13d07e07-3d", "ovs_interfaceid": "13d07e07-3d6e-465d-a21f-94afa7418d3b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 10:19:47 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-a363a1eb-a485-4483-92fc-0bc37f872d8d req-fa2e25f9-afad-432e-ba9e-8d06f8ff405b service nova] Releasing lock "refresh_cache-b727b2b6-0315-4a01-a67c-c485a862b518" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 10:19:47 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0b1448fe-d007-43fd-9ae0-4a034ced3a02 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Acquiring lock "b727b2b6-0315-4a01-a67c-c485a862b518" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:19:47 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0b1448fe-d007-43fd-9ae0-4a034ced3a02 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Lock "b727b2b6-0315-4a01-a67c-c485a862b518" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:19:47 user nova-compute[75122]: INFO nova.compute.manager [None req-0b1448fe-d007-43fd-9ae0-4a034ced3a02 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] [instance: b727b2b6-0315-4a01-a67c-c485a862b518] Rebooting instance
Nov 15 10:19:47 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0b1448fe-d007-43fd-9ae0-4a034ced3a02 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Acquiring lock "refresh_cache-b727b2b6-0315-4a01-a67c-c485a862b518" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 10:19:47 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0b1448fe-d007-43fd-9ae0-4a034ced3a02 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Acquired lock "refresh_cache-b727b2b6-0315-4a01-a67c-c485a862b518" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 10:19:47 user nova-compute[75122]: DEBUG nova.network.neutron [None req-0b1448fe-d007-43fd-9ae0-4a034ced3a02 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] [instance: b727b2b6-0315-4a01-a67c-c485a862b518] Building network info cache for instance {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 10:19:48 user nova-compute[75122]: DEBUG nova.network.neutron [None req-0b1448fe-d007-43fd-9ae0-4a034ced3a02 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] [instance: b727b2b6-0315-4a01-a67c-c485a862b518] Updating instance_info_cache with network_info: [{"id": "13d07e07-3d6e-465d-a21f-94afa7418d3b", "address": "fa:16:3e:a5:63:98", "network": {"id": "25afb78c-30e1-4fd7-a215-b5e73ba43057", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2008775745-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "098415c1690e46c39d52c0fee2719175", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13d07e07-3d", "ovs_interfaceid": "13d07e07-3d6e-465d-a21f-94afa7418d3b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 10:19:48 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0b1448fe-d007-43fd-9ae0-4a034ced3a02 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Releasing lock "refresh_cache-b727b2b6-0315-4a01-a67c-c485a862b518" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 10:19:48 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0b1448fe-d007-43fd-9ae0-4a034ced3a02 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] [instance: b727b2b6-0315-4a01-a67c-c485a862b518] Checking state {{(pid=75122) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 10:19:50 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:19:50 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:19:50 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:19:50 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:19:50 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:19:50 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:19:50 user nova-compute[75122]: DEBUG nova.compute.manager [req-33717d62-ed1f-4087-a0a9-1965ae0ea55d req-6bb9b1e8-e88d-40ef-b21b-5c1b0e464dd1 service nova] [instance: b727b2b6-0315-4a01-a67c-c485a862b518] Received event network-vif-unplugged-13d07e07-3d6e-465d-a21f-94afa7418d3b {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 10:19:50 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-33717d62-ed1f-4087-a0a9-1965ae0ea55d req-6bb9b1e8-e88d-40ef-b21b-5c1b0e464dd1 service nova] Acquiring lock "b727b2b6-0315-4a01-a67c-c485a862b518-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:19:50 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-33717d62-ed1f-4087-a0a9-1965ae0ea55d req-6bb9b1e8-e88d-40ef-b21b-5c1b0e464dd1 service nova] Lock "b727b2b6-0315-4a01-a67c-c485a862b518-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:19:50 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-33717d62-ed1f-4087-a0a9-1965ae0ea55d req-6bb9b1e8-e88d-40ef-b21b-5c1b0e464dd1 service nova] Lock "b727b2b6-0315-4a01-a67c-c485a862b518-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:19:50 user nova-compute[75122]: DEBUG nova.compute.manager [req-33717d62-ed1f-4087-a0a9-1965ae0ea55d req-6bb9b1e8-e88d-40ef-b21b-5c1b0e464dd1 service nova] [instance: b727b2b6-0315-4a01-a67c-c485a862b518] No waiting events found dispatching network-vif-unplugged-13d07e07-3d6e-465d-a21f-94afa7418d3b {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 10:19:50 user nova-compute[75122]: WARNING nova.compute.manager [req-33717d62-ed1f-4087-a0a9-1965ae0ea55d req-6bb9b1e8-e88d-40ef-b21b-5c1b0e464dd1 service nova] [instance: b727b2b6-0315-4a01-a67c-c485a862b518] Received unexpected event network-vif-unplugged-13d07e07-3d6e-465d-a21f-94afa7418d3b for instance with vm_state active and task_state reboot_started.
Nov 15 10:19:51 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:19:51 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-0b1448fe-d007-43fd-9ae0-4a034ced3a02 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] [instance: b727b2b6-0315-4a01-a67c-c485a862b518] Instance shutdown successfully.
Nov 15 10:19:52 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:19:52 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:19:52 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:19:52 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:19:53 user nova-compute[75122]: DEBUG nova.compute.manager [req-2d21547d-d7d1-412d-ae3a-f601bfcf28a4 req-5faf37e0-1324-48df-9a79-d597f962a47d service nova] [instance: b727b2b6-0315-4a01-a67c-c485a862b518] Received event network-vif-plugged-13d07e07-3d6e-465d-a21f-94afa7418d3b {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 10:19:53 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-2d21547d-d7d1-412d-ae3a-f601bfcf28a4 req-5faf37e0-1324-48df-9a79-d597f962a47d service nova] Acquiring lock "b727b2b6-0315-4a01-a67c-c485a862b518-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:19:53 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-2d21547d-d7d1-412d-ae3a-f601bfcf28a4 req-5faf37e0-1324-48df-9a79-d597f962a47d service nova] Lock "b727b2b6-0315-4a01-a67c-c485a862b518-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:19:53 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-2d21547d-d7d1-412d-ae3a-f601bfcf28a4 req-5faf37e0-1324-48df-9a79-d597f962a47d service nova] Lock "b727b2b6-0315-4a01-a67c-c485a862b518-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:19:53 user nova-compute[75122]: DEBUG nova.compute.manager [req-2d21547d-d7d1-412d-ae3a-f601bfcf28a4 req-5faf37e0-1324-48df-9a79-d597f962a47d service nova] [instance: b727b2b6-0315-4a01-a67c-c485a862b518] No waiting events found dispatching network-vif-plugged-13d07e07-3d6e-465d-a21f-94afa7418d3b {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 10:19:53 user nova-compute[75122]: WARNING nova.compute.manager [req-2d21547d-d7d1-412d-ae3a-f601bfcf28a4 req-5faf37e0-1324-48df-9a79-d597f962a47d service nova] [instance: b727b2b6-0315-4a01-a67c-c485a862b518] Received unexpected event network-vif-plugged-13d07e07-3d6e-465d-a21f-94afa7418d3b for instance with vm_state active and task_state reboot_started.
Nov 15 10:19:53 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:19:53 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:19:53 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:19:53 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:19:53 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:19:54 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:19:54 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:19:54 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:19:54 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:19:54 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75122) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 10:19:54 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b727b2b6-0315-4a01-a67c-c485a862b518/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:19:54 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b727b2b6-0315-4a01-a67c-c485a862b518/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:19:54 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b727b2b6-0315-4a01-a67c-c485a862b518/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:19:54 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b727b2b6-0315-4a01-a67c-c485a862b518/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:19:54 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75122) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 10:19:55 user nova-compute[75122]: INFO nova.virt.libvirt.driver [-] [instance: b727b2b6-0315-4a01-a67c-c485a862b518] Instance running successfully.
Nov 15 10:19:55 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 10:19:55 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 10:19:55 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Hypervisor/Node resource view: name=user free_ram=9077MB free_disk=25.018020629882812GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75122) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 10:19:55 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:19:55 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:19:55 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-0b1448fe-d007-43fd-9ae0-4a034ced3a02 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] [instance: b727b2b6-0315-4a01-a67c-c485a862b518] Instance soft rebooted successfully.
Nov 15 10:19:55 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0b1448fe-d007-43fd-9ae0-4a034ced3a02 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] [instance: b727b2b6-0315-4a01-a67c-c485a862b518] Checking state {{(pid=75122) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 10:19:55 user nova-compute[75122]: DEBUG nova.compute.manager [req-42ab1801-de07-49c3-9f65-bcb82e534134 req-b5edf7dc-d5f1-42b7-b3fd-c0a5a3640f65 service nova] [instance: b727b2b6-0315-4a01-a67c-c485a862b518] Received event network-vif-plugged-13d07e07-3d6e-465d-a21f-94afa7418d3b {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 10:19:55 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-42ab1801-de07-49c3-9f65-bcb82e534134 req-b5edf7dc-d5f1-42b7-b3fd-c0a5a3640f65 service nova] Acquiring lock "b727b2b6-0315-4a01-a67c-c485a862b518-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:19:55 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-42ab1801-de07-49c3-9f65-bcb82e534134 req-b5edf7dc-d5f1-42b7-b3fd-c0a5a3640f65 service nova] Lock "b727b2b6-0315-4a01-a67c-c485a862b518-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:19:55 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-42ab1801-de07-49c3-9f65-bcb82e534134 req-b5edf7dc-d5f1-42b7-b3fd-c0a5a3640f65 service nova] Lock "b727b2b6-0315-4a01-a67c-c485a862b518-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:19:55 user nova-compute[75122]: DEBUG nova.compute.manager [req-42ab1801-de07-49c3-9f65-bcb82e534134 req-b5edf7dc-d5f1-42b7-b3fd-c0a5a3640f65 service nova] [instance: b727b2b6-0315-4a01-a67c-c485a862b518] No waiting events found dispatching network-vif-plugged-13d07e07-3d6e-465d-a21f-94afa7418d3b {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 10:19:55 user nova-compute[75122]: WARNING nova.compute.manager [req-42ab1801-de07-49c3-9f65-bcb82e534134 req-b5edf7dc-d5f1-42b7-b3fd-c0a5a3640f65 service nova] [instance: b727b2b6-0315-4a01-a67c-c485a862b518] Received unexpected event network-vif-plugged-13d07e07-3d6e-465d-a21f-94afa7418d3b for instance with vm_state active and task_state reboot_started.
Nov 15 10:19:55 user nova-compute[75122]: DEBUG nova.compute.manager [req-42ab1801-de07-49c3-9f65-bcb82e534134 req-b5edf7dc-d5f1-42b7-b3fd-c0a5a3640f65 service nova] [instance: b727b2b6-0315-4a01-a67c-c485a862b518] Received event network-vif-plugged-13d07e07-3d6e-465d-a21f-94afa7418d3b {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 10:19:55 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-42ab1801-de07-49c3-9f65-bcb82e534134 req-b5edf7dc-d5f1-42b7-b3fd-c0a5a3640f65 service nova] Acquiring lock "b727b2b6-0315-4a01-a67c-c485a862b518-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:19:55 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-42ab1801-de07-49c3-9f65-bcb82e534134 req-b5edf7dc-d5f1-42b7-b3fd-c0a5a3640f65 service nova] Lock "b727b2b6-0315-4a01-a67c-c485a862b518-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:19:55 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-42ab1801-de07-49c3-9f65-bcb82e534134 req-b5edf7dc-d5f1-42b7-b3fd-c0a5a3640f65 service nova] Lock "b727b2b6-0315-4a01-a67c-c485a862b518-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:19:55 user nova-compute[75122]: DEBUG nova.compute.manager [req-42ab1801-de07-49c3-9f65-bcb82e534134 req-b5edf7dc-d5f1-42b7-b3fd-c0a5a3640f65 service nova] [instance: b727b2b6-0315-4a01-a67c-c485a862b518] No waiting events found dispatching network-vif-plugged-13d07e07-3d6e-465d-a21f-94afa7418d3b {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 10:19:55 user nova-compute[75122]: WARNING nova.compute.manager [req-42ab1801-de07-49c3-9f65-bcb82e534134 req-b5edf7dc-d5f1-42b7-b3fd-c0a5a3640f65 service nova] [instance: b727b2b6-0315-4a01-a67c-c485a862b518] Received unexpected event network-vif-plugged-13d07e07-3d6e-465d-a21f-94afa7418d3b for instance with vm_state active and task_state reboot_started.
Nov 15 10:19:55 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance b727b2b6-0315-4a01-a67c-c485a862b518 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 10:19:55 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75122) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 10:19:55 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75122) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 10:19:55 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0b1448fe-d007-43fd-9ae0-4a034ced3a02 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Lock "b727b2b6-0315-4a01-a67c-c485a862b518" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.221s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:19:55 user nova-compute[75122]: DEBUG nova.compute.provider_tree [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Inventory has not changed in ProviderTree for provider: 69a3da65-47be-44c6-b67c-c692b58284ef {{(pid=75122) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 10:19:55 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Inventory has not changed for provider 69a3da65-47be-44c6-b67c-c692b58284ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 10:19:55 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Compute_service record updated for user:user {{(pid=75122) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 10:19:55 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.193s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:19:55 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:19:57 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:19:59 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:19:59 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:19:59 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Starting heal instance info cache {{(pid=75122) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 10:19:59 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Rebuilding the list of instances to heal {{(pid=75122) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 10:19:59 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "refresh_cache-b727b2b6-0315-4a01-a67c-c485a862b518" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 10:19:59 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquired lock "refresh_cache-b727b2b6-0315-4a01-a67c-c485a862b518" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 10:19:59 user nova-compute[75122]: DEBUG nova.network.neutron [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] [instance: b727b2b6-0315-4a01-a67c-c485a862b518] Forcefully refreshing network info cache for instance {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 10:19:59 user nova-compute[75122]: DEBUG nova.objects.instance [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lazy-loading 'info_cache' on Instance uuid b727b2b6-0315-4a01-a67c-c485a862b518 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 10:19:59 user nova-compute[75122]: DEBUG nova.network.neutron [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] [instance: b727b2b6-0315-4a01-a67c-c485a862b518] Updating instance_info_cache with network_info: [{"id": "13d07e07-3d6e-465d-a21f-94afa7418d3b", "address": "fa:16:3e:a5:63:98", "network": {"id": "25afb78c-30e1-4fd7-a215-b5e73ba43057", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2008775745-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "098415c1690e46c39d52c0fee2719175", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13d07e07-3d", "ovs_interfaceid": "13d07e07-3d6e-465d-a21f-94afa7418d3b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 10:19:59 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Releasing lock "refresh_cache-b727b2b6-0315-4a01-a67c-c485a862b518" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 10:19:59 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] [instance: b727b2b6-0315-4a01-a67c-c485a862b518] Updated the network info_cache for instance {{(pid=75122) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 10:19:59 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:20:00 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:20:02 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:20:02 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:20:04 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:20:04 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75122) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 10:20:05 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:20:10 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:20:10 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:20:10 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75122) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 10:20:10 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75122) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 10:20:10 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75122) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 10:20:10 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:20:12 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:20:15 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:20:17 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:20:20 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:20:22 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:20:25 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:20:27 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:20:30 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:20:35 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:20:35 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:20:35 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75122) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 10:20:35 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75122) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 10:20:35 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75122) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 10:20:35 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:20:40 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:20:45 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:20:45 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:20:45 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75122) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 10:20:45 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75122) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 10:20:45 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75122) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 10:20:45 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:20:50 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:20:50 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:20:53 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:20:54 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:20:55 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:20:55 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:20:55 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:20:55 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:20:55 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75122) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 10:20:55 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b727b2b6-0315-4a01-a67c-c485a862b518/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:20:55 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b727b2b6-0315-4a01-a67c-c485a862b518/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:20:55 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b727b2b6-0315-4a01-a67c-c485a862b518/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:20:55 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b727b2b6-0315-4a01-a67c-c485a862b518/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:20:55 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75122) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 10:20:56 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:20:56 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 10:20:56 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 10:20:56 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Hypervisor/Node resource view: name=user free_ram=9001MB free_disk=25.017009735107422GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75122) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 10:20:56 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:20:56 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:20:56 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance b727b2b6-0315-4a01-a67c-c485a862b518 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 10:20:56 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75122) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 10:20:56 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75122) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 10:20:56 user nova-compute[75122]: DEBUG nova.compute.provider_tree [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Inventory has not changed in ProviderTree for provider: 69a3da65-47be-44c6-b67c-c692b58284ef {{(pid=75122) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 10:20:56 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Inventory has not changed for provider 69a3da65-47be-44c6-b67c-c692b58284ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 10:20:56 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Compute_service record updated for user:user {{(pid=75122) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 10:20:56 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.220s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:20:59 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:21:00 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:21:00 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:21:00 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Starting heal instance info cache {{(pid=75122) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 10:21:00 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Rebuilding the list of instances to heal {{(pid=75122) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 10:21:00 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "refresh_cache-b727b2b6-0315-4a01-a67c-c485a862b518" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 10:21:00 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquired lock "refresh_cache-b727b2b6-0315-4a01-a67c-c485a862b518" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 10:21:00 user nova-compute[75122]: DEBUG nova.network.neutron [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] [instance: b727b2b6-0315-4a01-a67c-c485a862b518] Forcefully refreshing network info cache for instance {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 10:21:00 user nova-compute[75122]: DEBUG nova.objects.instance [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lazy-loading 'info_cache' on Instance uuid b727b2b6-0315-4a01-a67c-c485a862b518 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 10:21:00 user nova-compute[75122]: DEBUG nova.network.neutron [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] [instance: b727b2b6-0315-4a01-a67c-c485a862b518] Updating instance_info_cache with network_info: [{"id": "13d07e07-3d6e-465d-a21f-94afa7418d3b", "address": "fa:16:3e:a5:63:98", "network": {"id": "25afb78c-30e1-4fd7-a215-b5e73ba43057", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2008775745-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "098415c1690e46c39d52c0fee2719175", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13d07e07-3d", "ovs_interfaceid": "13d07e07-3d6e-465d-a21f-94afa7418d3b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 10:21:00 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Releasing lock "refresh_cache-b727b2b6-0315-4a01-a67c-c485a862b518" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 10:21:00 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] [instance: b727b2b6-0315-4a01-a67c-c485a862b518] Updated the network info_cache for instance {{(pid=75122) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 10:21:01 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:21:02 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:21:04 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:21:04 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75122) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 10:21:06 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:21:10 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:21:11 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:21:16 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:21:21 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:21:26 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:21:26 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:21:26 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75122) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 10:21:26 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75122) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 10:21:26 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75122) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 10:21:26 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:21:31 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:21:36 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:21:39 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:21:39 user nova-compute[75122]: DEBUG nova.compute.manager [req-4a2a34b1-4d7c-4eff-90bf-df096315613c req-4f6ab56d-0ef7-48a3-8252-3f913be466fe service nova] [instance: b727b2b6-0315-4a01-a67c-c485a862b518] Received event network-changed-13d07e07-3d6e-465d-a21f-94afa7418d3b {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 10:21:39 user nova-compute[75122]: DEBUG nova.compute.manager [req-4a2a34b1-4d7c-4eff-90bf-df096315613c req-4f6ab56d-0ef7-48a3-8252-3f913be466fe service nova] [instance: b727b2b6-0315-4a01-a67c-c485a862b518] Refreshing instance network info cache due to event network-changed-13d07e07-3d6e-465d-a21f-94afa7418d3b. {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 10:21:39 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-4a2a34b1-4d7c-4eff-90bf-df096315613c req-4f6ab56d-0ef7-48a3-8252-3f913be466fe service nova] Acquiring lock "refresh_cache-b727b2b6-0315-4a01-a67c-c485a862b518" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 10:21:39 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-4a2a34b1-4d7c-4eff-90bf-df096315613c req-4f6ab56d-0ef7-48a3-8252-3f913be466fe service nova] Acquired lock "refresh_cache-b727b2b6-0315-4a01-a67c-c485a862b518" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 10:21:39 user nova-compute[75122]: DEBUG nova.network.neutron [req-4a2a34b1-4d7c-4eff-90bf-df096315613c req-4f6ab56d-0ef7-48a3-8252-3f913be466fe service nova] [instance: b727b2b6-0315-4a01-a67c-c485a862b518] Refreshing network info cache for port 13d07e07-3d6e-465d-a21f-94afa7418d3b {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 10:21:40 user nova-compute[75122]: DEBUG nova.network.neutron [req-4a2a34b1-4d7c-4eff-90bf-df096315613c req-4f6ab56d-0ef7-48a3-8252-3f913be466fe service nova] [instance: b727b2b6-0315-4a01-a67c-c485a862b518] Updated VIF entry in instance network info cache for port 13d07e07-3d6e-465d-a21f-94afa7418d3b. {{(pid=75122) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 10:21:40 user nova-compute[75122]: DEBUG nova.network.neutron [req-4a2a34b1-4d7c-4eff-90bf-df096315613c req-4f6ab56d-0ef7-48a3-8252-3f913be466fe service nova] [instance: b727b2b6-0315-4a01-a67c-c485a862b518] Updating instance_info_cache with network_info: [{"id": "13d07e07-3d6e-465d-a21f-94afa7418d3b", "address": "fa:16:3e:a5:63:98", "network": {"id": "25afb78c-30e1-4fd7-a215-b5e73ba43057", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2008775745-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "098415c1690e46c39d52c0fee2719175", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13d07e07-3d", "ovs_interfaceid": "13d07e07-3d6e-465d-a21f-94afa7418d3b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 10:21:40 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-4a2a34b1-4d7c-4eff-90bf-df096315613c req-4f6ab56d-0ef7-48a3-8252-3f913be466fe service nova] Releasing lock "refresh_cache-b727b2b6-0315-4a01-a67c-c485a862b518" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 10:21:40 user nova-compute[75122]: DEBUG nova.compute.manager [req-b9b71f41-1b1e-4d29-b501-4db5547776e0 req-c828bdcc-1a61-4954-a697-02751639b7b8 service nova] [instance: b727b2b6-0315-4a01-a67c-c485a862b518] Received event network-changed-13d07e07-3d6e-465d-a21f-94afa7418d3b {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 10:21:40 user nova-compute[75122]: DEBUG nova.compute.manager [req-b9b71f41-1b1e-4d29-b501-4db5547776e0 req-c828bdcc-1a61-4954-a697-02751639b7b8 service nova] [instance: b727b2b6-0315-4a01-a67c-c485a862b518] Refreshing instance network info cache due to event network-changed-13d07e07-3d6e-465d-a21f-94afa7418d3b. {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 10:21:40 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-b9b71f41-1b1e-4d29-b501-4db5547776e0 req-c828bdcc-1a61-4954-a697-02751639b7b8 service nova] Acquiring lock "refresh_cache-b727b2b6-0315-4a01-a67c-c485a862b518" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 10:21:40 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-b9b71f41-1b1e-4d29-b501-4db5547776e0 req-c828bdcc-1a61-4954-a697-02751639b7b8 service nova] Acquired lock "refresh_cache-b727b2b6-0315-4a01-a67c-c485a862b518" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 10:21:40 user nova-compute[75122]: DEBUG nova.network.neutron [req-b9b71f41-1b1e-4d29-b501-4db5547776e0 req-c828bdcc-1a61-4954-a697-02751639b7b8 service nova] [instance: b727b2b6-0315-4a01-a67c-c485a862b518] Refreshing network info cache for port 13d07e07-3d6e-465d-a21f-94afa7418d3b {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 10:21:40 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-a0df9bdf-b6e4-45c0-8341-7e0c674711f5 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Acquiring lock "b727b2b6-0315-4a01-a67c-c485a862b518" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:21:40 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-a0df9bdf-b6e4-45c0-8341-7e0c674711f5 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Lock "b727b2b6-0315-4a01-a67c-c485a862b518" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:21:40 user nova-compute[75122]: INFO nova.compute.manager [None req-a0df9bdf-b6e4-45c0-8341-7e0c674711f5 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] [instance: b727b2b6-0315-4a01-a67c-c485a862b518] Detaching volume 74080876-a54d-4b0f-b394-15f97311594d
Nov 15 10:21:40 user nova-compute[75122]: INFO nova.virt.block_device [None req-a0df9bdf-b6e4-45c0-8341-7e0c674711f5 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] [instance: b727b2b6-0315-4a01-a67c-c485a862b518] Attempting to driver detach volume 74080876-a54d-4b0f-b394-15f97311594d from mountpoint /dev/vdb
Nov 15 10:21:40 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-a0df9bdf-b6e4-45c0-8341-7e0c674711f5 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Attempting to detach device vdb from instance b727b2b6-0315-4a01-a67c-c485a862b518 from the persistent domain config. {{(pid=75122) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 10:21:40 user nova-compute[75122]: DEBUG nova.virt.libvirt.guest [None req-a0df9bdf-b6e4-45c0-8341-7e0c674711f5 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 10:21:40 user nova-compute[75122]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 10:21:40 user nova-compute[75122]:   <source dev="/dev/sdb"/>
Nov 15 10:21:40 user nova-compute[75122]:   <target dev="vdb" bus="virtio"/>
Nov 15 10:21:40 user nova-compute[75122]:   <serial>74080876-a54d-4b0f-b394-15f97311594d</serial>
Nov 15 10:21:40 user nova-compute[75122]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 10:21:40 user nova-compute[75122]: </disk>
Nov 15 10:21:40 user nova-compute[75122]:  {{(pid=75122) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 10:21:40 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-a0df9bdf-b6e4-45c0-8341-7e0c674711f5 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Successfully detached device vdb from instance b727b2b6-0315-4a01-a67c-c485a862b518 from the persistent domain config.
Nov 15 10:21:40 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-a0df9bdf-b6e4-45c0-8341-7e0c674711f5 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b727b2b6-0315-4a01-a67c-c485a862b518 from the live domain config. {{(pid=75122) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 10:21:40 user nova-compute[75122]: DEBUG nova.virt.libvirt.guest [None req-a0df9bdf-b6e4-45c0-8341-7e0c674711f5 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 10:21:40 user nova-compute[75122]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 10:21:40 user nova-compute[75122]:   <source dev="/dev/sdb"/>
Nov 15 10:21:40 user nova-compute[75122]:   <target dev="vdb" bus="virtio"/>
Nov 15 10:21:40 user nova-compute[75122]:   <serial>74080876-a54d-4b0f-b394-15f97311594d</serial>
Nov 15 10:21:40 user nova-compute[75122]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 10:21:40 user nova-compute[75122]: </disk>
Nov 15 10:21:40 user nova-compute[75122]:  {{(pid=75122) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 10:21:40 user nova-compute[75122]: DEBUG nova.network.neutron [req-b9b71f41-1b1e-4d29-b501-4db5547776e0 req-c828bdcc-1a61-4954-a697-02751639b7b8 service nova] [instance: b727b2b6-0315-4a01-a67c-c485a862b518] Updated VIF entry in instance network info cache for port 13d07e07-3d6e-465d-a21f-94afa7418d3b. {{(pid=75122) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 10:21:40 user nova-compute[75122]: DEBUG nova.network.neutron [req-b9b71f41-1b1e-4d29-b501-4db5547776e0 req-c828bdcc-1a61-4954-a697-02751639b7b8 service nova] [instance: b727b2b6-0315-4a01-a67c-c485a862b518] Updating instance_info_cache with network_info: [{"id": "13d07e07-3d6e-465d-a21f-94afa7418d3b", "address": "fa:16:3e:a5:63:98", "network": {"id": "25afb78c-30e1-4fd7-a215-b5e73ba43057", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2008775745-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "098415c1690e46c39d52c0fee2719175", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13d07e07-3d", "ovs_interfaceid": "13d07e07-3d6e-465d-a21f-94afa7418d3b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 10:21:40 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-b9b71f41-1b1e-4d29-b501-4db5547776e0 req-c828bdcc-1a61-4954-a697-02751639b7b8 service nova] Releasing lock "refresh_cache-b727b2b6-0315-4a01-a67c-c485a862b518" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 10:21:41 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:21:41 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-a0df9bdf-b6e4-45c0-8341-7e0c674711f5 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b727b2b6-0315-4a01-a67c-c485a862b518 {{(pid=75122) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 10:21:42 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:21:46 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:21:50 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:21:51 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:21:51 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:21:51 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75122) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 10:21:51 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75122) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 10:21:51 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75122) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 10:21:51 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:21:54 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:21:55 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:21:56 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:21:56 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:21:56 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75122) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 10:21:56 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75122) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 10:21:56 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75122) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 10:21:56 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:21:56 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:21:56 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:21:56 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:21:56 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:21:56 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75122) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 10:21:56 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b727b2b6-0315-4a01-a67c-c485a862b518/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:21:56 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b727b2b6-0315-4a01-a67c-c485a862b518/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:21:56 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b727b2b6-0315-4a01-a67c-c485a862b518/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:21:56 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b727b2b6-0315-4a01-a67c-c485a862b518/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:21:57 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 10:21:57 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 10:21:57 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Hypervisor/Node resource view: name=user free_ram=9009MB free_disk=25.016292572021484GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75122) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 10:21:57 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:21:57 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:21:57 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance b727b2b6-0315-4a01-a67c-c485a862b518 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 10:21:57 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75122) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 10:21:57 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75122) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 10:21:57 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Refreshing inventories for resource provider 69a3da65-47be-44c6-b67c-c692b58284ef {{(pid=75122) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 15 10:21:57 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Updating ProviderTree inventory for provider 69a3da65-47be-44c6-b67c-c692b58284ef from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 15 10:21:57 user nova-compute[75122]: DEBUG nova.compute.provider_tree [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Updating inventory in ProviderTree for provider 69a3da65-47be-44c6-b67c-c692b58284ef with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 15 10:21:57 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Refreshing aggregate associations for resource provider 69a3da65-47be-44c6-b67c-c692b58284ef, aggregates: None {{(pid=75122) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 15 10:21:57 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Refreshing trait associations for resource provider 69a3da65-47be-44c6-b67c-c692b58284ef, traits: COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_RESCUE_BFV,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE,COMPUTE_NODE,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_ACCELERATORS,HW_CPU_X86_MMX {{(pid=75122) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 15 10:21:57 user nova-compute[75122]: DEBUG nova.compute.provider_tree [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Inventory has not changed in ProviderTree for provider: 69a3da65-47be-44c6-b67c-c692b58284ef {{(pid=75122) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 10:21:57 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Inventory has not changed for provider 69a3da65-47be-44c6-b67c-c692b58284ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 10:21:57 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Compute_service record updated for user:user {{(pid=75122) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 10:21:57 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.394s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:21:57 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:21:57 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Cleaning up deleted instances {{(pid=75122) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 15 10:21:57 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] There are 0 instances to clean {{(pid=75122) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 15 10:21:59 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:22:00 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:22:01 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:22:01 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:22:01 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Starting heal instance info cache {{(pid=75122) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 10:22:01 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Rebuilding the list of instances to heal {{(pid=75122) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 10:22:01 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-a0df9bdf-b6e4-45c0-8341-7e0c674711f5 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance b727b2b6-0315-4a01-a67c-c485a862b518 is timed out.
Nov 15 10:22:01 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-a0df9bdf-b6e4-45c0-8341-7e0c674711f5 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Successfully detached device vdb from instance b727b2b6-0315-4a01-a67c-c485a862b518 from the live domain config.
Nov 15 10:22:01 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a0df9bdf-b6e4-45c0-8341-7e0c674711f5 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] [instance: b727b2b6-0315-4a01-a67c-c485a862b518] calling os-brick to detach iSCSI Volume {{(pid=75122) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 10:22:01 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0df9bdf-b6e4-45c0-8341-7e0c674711f5 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffa04060b80>, {'target_iqn': 'iqn.2010-10.org.openstack:74080876-a54d-4b0f-b394-15f97311594d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PHVImFUx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 10:22:01 user nova-compute[75122]: WARNING os_brick.initiator.connectors.base [None req-a0df9bdf-b6e4-45c0-8341-7e0c674711f5 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 10:22:01 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-a0df9bdf-b6e4-45c0-8341-7e0c674711f5 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 10:22:01 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-a0df9bdf-b6e4-45c0-8341-7e0c674711f5 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 10:22:01 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:22:01 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:22:01 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[c83b1c23-39b8-477b-81e9-053faaf00c23]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:74080876-a54d-4b0f-b394-15f97311594d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:22:01 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0df9bdf-b6e4-45c0-8341-7e0c674711f5 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 10:22:01 user nova-compute[75122]: No targets found.
Nov 15 10:22:01 user nova-compute[75122]: iSNS:
Nov 15 10:22:01 user nova-compute[75122]: No targets found.
Nov 15 10:22:01 user nova-compute[75122]: STATIC:
Nov 15 10:22:01 user nova-compute[75122]: Target: iqn.2010-10.org.openstack:74080876-a54d-4b0f-b394-15f97311594d
Nov 15 10:22:01 user nova-compute[75122]:         Portal: 172.16.0.220:3260,-1
Nov 15 10:22:01 user nova-compute[75122]:                 Iface Name: default
Nov 15 10:22:01 user nova-compute[75122]: FIRMWARE:
Nov 15 10:22:01 user nova-compute[75122]: No targets found.
Nov 15 10:22:01 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 10:22:01 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0df9bdf-b6e4-45c0-8341-7e0c674711f5 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 10:22:01 user nova-compute[75122]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 10:22:01 user nova-compute[75122]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75122) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 10:22:01 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0df9bdf-b6e4-45c0-8341-7e0c674711f5 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:74080876-a54d-4b0f-b394-15f97311594d', 0)] {{(pid=75122) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 10:22:01 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:22:01 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "refresh_cache-b727b2b6-0315-4a01-a67c-c485a862b518" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 10:22:01 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquired lock "refresh_cache-b727b2b6-0315-4a01-a67c-c485a862b518" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 10:22:01 user nova-compute[75122]: DEBUG nova.network.neutron [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] [instance: b727b2b6-0315-4a01-a67c-c485a862b518] Forcefully refreshing network info cache for instance {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 10:22:01 user nova-compute[75122]: DEBUG nova.objects.instance [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lazy-loading 'info_cache' on Instance uuid b727b2b6-0315-4a01-a67c-c485a862b518 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 10:22:01 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:22:01 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea54e7ec-444d-43ed-a6b4-4cbb35cf1075]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:74080876-a54d-4b0f-b394-15f97311594d\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:22:01 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:22:01 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:22:01 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[77e670e7-c755-4907-a9a0-cf8cadf07202]: (4, ('tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74080876-a54d-4b0f-b394-15f97311594d (non-flash)\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:22:01 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0df9bdf-b6e4-45c0-8341-7e0c674711f5 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74080876-a54d-4b0f-b394-15f97311594d (non-flash)
Nov 15 10:22:01 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 10:22:01 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0df9bdf-b6e4-45c0-8341-7e0c674711f5 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] iscsi session list stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:74080876-a54d-4b0f-b394-15f97311594d (non-flash)
Nov 15 10:22:01 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 10:22:01 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0df9bdf-b6e4-45c0-8341-7e0c674711f5 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff9e4216680>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:74080876-a54d-4b0f-b394-15f97311594d'): ({'sdb'}, set())}) {{(pid=75122) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 10:22:01 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-a0df9bdf-b6e4-45c0-8341-7e0c674711f5 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Removing single pathed devices sdb {{(pid=75122) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 10:22:01 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:22:01 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:22:01 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[428c54cd-0b52-41f5-a138-2807e5b0ab0d]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:22:01 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:22:01 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:22:01 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[3937fbd1-db63-4666-8458-ed72ec005eb5]: (4, ('ok\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:22:01 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-a0df9bdf-b6e4-45c0-8341-7e0c674711f5 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Flushing IO for device /dev/sdb {{(pid=75122) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 10:22:01 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:22:01 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:22:01 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfc9f7c5-7431-4a4d-b85c-0781ae903ece]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:22:01 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-a0df9bdf-b6e4-45c0-8341-7e0c674711f5 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75122) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 10:22:01 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:22:01 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.049s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:22:01 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[86b7512b-9c19-4dd8-8b91-d3f2563c6ac8]: (4, ('1', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:22:01 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-a0df9bdf-b6e4-45c0-8341-7e0c674711f5 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75122) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 10:22:01 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-a0df9bdf-b6e4-45c0-8341-7e0c674711f5 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] SCSI volumes sdb have been removed. {{(pid=75122) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 10:22:01 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0df9bdf-b6e4-45c0-8341-7e0c674711f5 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:74080876-a54d-4b0f-b394-15f97311594d')] {{(pid=75122) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 10:22:01 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74080876-a54d-4b0f-b394-15f97311594d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:22:01 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74080876-a54d-4b0f-b394-15f97311594d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.068s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:22:01 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[84108742-c9d9-413d-8390-57ca8241f101]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:22:01 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0df9bdf-b6e4-45c0-8341-7e0c674711f5 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 10:22:01 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74080876-a54d-4b0f-b394-15f97311594d -p 172.16.0.220:3260 --logout {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:22:01 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74080876-a54d-4b0f-b394-15f97311594d -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:22:01 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[7539a91d-30bc-4a97-b5b0-cd854584dcea]: (4, ('Logging out of session [sid: 63, target: iqn.2010-10.org.openstack:74080876-a54d-4b0f-b394-15f97311594d, portal: 172.16.0.220,3260]\nLogout of [sid: 63, target: iqn.2010-10.org.openstack:74080876-a54d-4b0f-b394-15f97311594d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:22:01 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0df9bdf-b6e4-45c0-8341-7e0c674711f5 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 63, target: iqn.2010-10.org.openstack:74080876-a54d-4b0f-b394-15f97311594d, portal: 172.16.0.220,3260]
Nov 15 10:22:01 user nova-compute[75122]: Logout of [sid: 63, target: iqn.2010-10.org.openstack:74080876-a54d-4b0f-b394-15f97311594d, portal: 172.16.0.220,3260] successful.
Nov 15 10:22:01 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 10:22:01 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:74080876-a54d-4b0f-b394-15f97311594d -p 172.16.0.220:3260 --op delete {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:22:01 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:74080876-a54d-4b0f-b394-15f97311594d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:22:01 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3f27043-b77b-4502-bf81-3c34615fabc7]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:22:01 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0df9bdf-b6e4-45c0-8341-7e0c674711f5 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 10:22:01 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-a0df9bdf-b6e4-45c0-8341-7e0c674711f5 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.338s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 10:22:01 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0df9bdf-b6e4-45c0-8341-7e0c674711f5 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] <== disconnect_volume: return (339ms) None {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 10:22:01 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a0df9bdf-b6e4-45c0-8341-7e0c674711f5 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] [instance: b727b2b6-0315-4a01-a67c-c485a862b518] Disconnected iSCSI Volume {{(pid=75122) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 10:22:01 user nova-compute[75122]: DEBUG nova.network.neutron [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] [instance: b727b2b6-0315-4a01-a67c-c485a862b518] Updating instance_info_cache with network_info: [{"id": "13d07e07-3d6e-465d-a21f-94afa7418d3b", "address": "fa:16:3e:a5:63:98", "network": {"id": "25afb78c-30e1-4fd7-a215-b5e73ba43057", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2008775745-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "098415c1690e46c39d52c0fee2719175", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13d07e07-3d", "ovs_interfaceid": "13d07e07-3d6e-465d-a21f-94afa7418d3b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 10:22:01 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Releasing lock "refresh_cache-b727b2b6-0315-4a01-a67c-c485a862b518" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 10:22:01 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] [instance: b727b2b6-0315-4a01-a67c-c485a862b518] Updated the network info_cache for instance {{(pid=75122) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 10:22:02 user nova-compute[75122]: DEBUG nova.objects.instance [None req-a0df9bdf-b6e4-45c0-8341-7e0c674711f5 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Lazy-loading 'flavor' on Instance uuid b727b2b6-0315-4a01-a67c-c485a862b518 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 10:22:02 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-a0df9bdf-b6e4-45c0-8341-7e0c674711f5 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Lock "b727b2b6-0315-4a01-a67c-c485a862b518" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.836s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:22:04 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:22:04 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:22:04 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75122) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 10:22:06 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:22:11 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:22:11 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:22:11 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75122) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 10:22:11 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75122) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 10:22:11 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75122) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 10:22:11 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:22:13 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:22:16 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:22:21 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:22:21 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:22:21 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75122) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 10:22:21 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75122) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 10:22:21 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75122) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 10:22:21 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:22:21 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:22:21 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75122) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 15 10:22:26 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:22:26 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:22:26 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75122) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 10:22:26 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75122) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 10:22:26 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75122) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 10:22:26 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:22:31 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:22:31 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:22:31 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75122) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 10:22:31 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75122) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 10:22:31 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75122) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 10:22:31 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:22:33 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-67da5399-8dd8-4934-95f5-a5ae2e8c4a52 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Acquiring lock "b727b2b6-0315-4a01-a67c-c485a862b518" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:22:33 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-67da5399-8dd8-4934-95f5-a5ae2e8c4a52 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Lock "b727b2b6-0315-4a01-a67c-c485a862b518" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:22:33 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-67da5399-8dd8-4934-95f5-a5ae2e8c4a52 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Acquiring lock "b727b2b6-0315-4a01-a67c-c485a862b518-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:22:33 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-67da5399-8dd8-4934-95f5-a5ae2e8c4a52 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Lock "b727b2b6-0315-4a01-a67c-c485a862b518-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:22:33 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-67da5399-8dd8-4934-95f5-a5ae2e8c4a52 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Lock "b727b2b6-0315-4a01-a67c-c485a862b518-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:22:33 user nova-compute[75122]: INFO nova.compute.manager [None req-67da5399-8dd8-4934-95f5-a5ae2e8c4a52 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] [instance: b727b2b6-0315-4a01-a67c-c485a862b518] Terminating instance
Nov 15 10:22:33 user nova-compute[75122]: DEBUG nova.compute.manager [None req-67da5399-8dd8-4934-95f5-a5ae2e8c4a52 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] [instance: b727b2b6-0315-4a01-a67c-c485a862b518] Start destroying the instance on the hypervisor. {{(pid=75122) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 10:22:33 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:22:33 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:22:33 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:22:33 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:22:33 user nova-compute[75122]: DEBUG nova.compute.manager [req-6f6ada2d-50b6-49b8-a64e-478ad6afc458 req-def2a5a0-5988-4d92-b318-978eda2e6c83 service nova] [instance: b727b2b6-0315-4a01-a67c-c485a862b518] Received event network-vif-unplugged-13d07e07-3d6e-465d-a21f-94afa7418d3b {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 10:22:33 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-6f6ada2d-50b6-49b8-a64e-478ad6afc458 req-def2a5a0-5988-4d92-b318-978eda2e6c83 service nova] Acquiring lock "b727b2b6-0315-4a01-a67c-c485a862b518-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:22:33 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-6f6ada2d-50b6-49b8-a64e-478ad6afc458 req-def2a5a0-5988-4d92-b318-978eda2e6c83 service nova] Lock "b727b2b6-0315-4a01-a67c-c485a862b518-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:22:33 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-6f6ada2d-50b6-49b8-a64e-478ad6afc458 req-def2a5a0-5988-4d92-b318-978eda2e6c83 service nova] Lock "b727b2b6-0315-4a01-a67c-c485a862b518-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:22:33 user nova-compute[75122]: DEBUG nova.compute.manager [req-6f6ada2d-50b6-49b8-a64e-478ad6afc458 req-def2a5a0-5988-4d92-b318-978eda2e6c83 service nova] [instance: b727b2b6-0315-4a01-a67c-c485a862b518] No waiting events found dispatching network-vif-unplugged-13d07e07-3d6e-465d-a21f-94afa7418d3b {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 10:22:33 user nova-compute[75122]: DEBUG nova.compute.manager [req-6f6ada2d-50b6-49b8-a64e-478ad6afc458 req-def2a5a0-5988-4d92-b318-978eda2e6c83 service nova] [instance: b727b2b6-0315-4a01-a67c-c485a862b518] Received event network-vif-unplugged-13d07e07-3d6e-465d-a21f-94afa7418d3b for instance with task_state deleting. {{(pid=75122) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 10:22:34 user nova-compute[75122]: INFO nova.virt.libvirt.driver [-] [instance: b727b2b6-0315-4a01-a67c-c485a862b518] Instance destroyed successfully.
Nov 15 10:22:34 user nova-compute[75122]: DEBUG nova.objects.instance [None req-67da5399-8dd8-4934-95f5-a5ae2e8c4a52 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Lazy-loading 'resources' on Instance uuid b727b2b6-0315-4a01-a67c-c485a862b518 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 10:22:34 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-67da5399-8dd8-4934-95f5-a5ae2e8c4a52 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T10:17:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1221964987',display_name='tempest-TestMinimumBasicScenario-server-1221964987',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1221964987',id=52,image_ref='428766b1-9088-495e-89f1-92ef8fc1491d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIIao4cKQZ/qF9BJAw+PIejTq5Tu8IleCz5F04hvUMLIUR8OkIUF1KrNvYwt5zvDX7U3TgJJLHEmqMOBxs4ZtbMupNtDqew2ZGAXT/Q/BaP+2R8Y/PSrG4Z3oRyNvg+Sbg==',key_name='tempest-TestMinimumBasicScenario-1276638919',keypairs=<?>,launch_index=0,launched_at=2023-11-15T10:17:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='098415c1690e46c39d52c0fee2719175',ramdisk_id='',reservation_id='r-c9z6bsi0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='428766b1-9088-495e-89f1-92ef8fc1491d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1402308121',owner_user_name='tempest-TestMinimumBasicScenario-1402308121-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T10:19:55Z,user_data=None,user_id='f3f4814249ab42d399b77e5b8040ec8b',uuid=b727b2b6-0315-4a01-a67c-c485a862b518,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "13d07e07-3d6e-465d-a21f-94afa7418d3b", "address": "fa:16:3e:a5:63:98", "network": {"id": "25afb78c-30e1-4fd7-a215-b5e73ba43057", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2008775745-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "098415c1690e46c39d52c0fee2719175", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13d07e07-3d", "ovs_interfaceid": "13d07e07-3d6e-465d-a21f-94afa7418d3b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 10:22:34 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-67da5399-8dd8-4934-95f5-a5ae2e8c4a52 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Converting VIF {"id": "13d07e07-3d6e-465d-a21f-94afa7418d3b", "address": "fa:16:3e:a5:63:98", "network": {"id": "25afb78c-30e1-4fd7-a215-b5e73ba43057", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2008775745-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "098415c1690e46c39d52c0fee2719175", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13d07e07-3d", "ovs_interfaceid": "13d07e07-3d6e-465d-a21f-94afa7418d3b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 10:22:34 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-67da5399-8dd8-4934-95f5-a5ae2e8c4a52 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a5:63:98,bridge_name='br-int',has_traffic_filtering=True,id=13d07e07-3d6e-465d-a21f-94afa7418d3b,network=Network(25afb78c-30e1-4fd7-a215-b5e73ba43057),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13d07e07-3d') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 10:22:34 user nova-compute[75122]: DEBUG os_vif [None req-67da5399-8dd8-4934-95f5-a5ae2e8c4a52 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a5:63:98,bridge_name='br-int',has_traffic_filtering=True,id=13d07e07-3d6e-465d-a21f-94afa7418d3b,network=Network(25afb78c-30e1-4fd7-a215-b5e73ba43057),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13d07e07-3d') {{(pid=75122) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 10:22:34 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:22:34 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap13d07e07-3d, bridge=br-int, if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 10:22:34 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:22:34 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:22:34 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:22:34 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d36920a4-71ce-4a8c-b25d-79ab90bf6618) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 10:22:34 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:22:34 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:22:34 user nova-compute[75122]: INFO os_vif [None req-67da5399-8dd8-4934-95f5-a5ae2e8c4a52 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a5:63:98,bridge_name='br-int',has_traffic_filtering=True,id=13d07e07-3d6e-465d-a21f-94afa7418d3b,network=Network(25afb78c-30e1-4fd7-a215-b5e73ba43057),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13d07e07-3d')
Nov 15 10:22:34 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-67da5399-8dd8-4934-95f5-a5ae2e8c4a52 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] [instance: b727b2b6-0315-4a01-a67c-c485a862b518] Deleting instance files /opt/stack/data/nova/instances/b727b2b6-0315-4a01-a67c-c485a862b518_del
Nov 15 10:22:34 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-67da5399-8dd8-4934-95f5-a5ae2e8c4a52 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] [instance: b727b2b6-0315-4a01-a67c-c485a862b518] Deletion of /opt/stack/data/nova/instances/b727b2b6-0315-4a01-a67c-c485a862b518_del complete
Nov 15 10:22:34 user nova-compute[75122]: INFO nova.compute.manager [None req-67da5399-8dd8-4934-95f5-a5ae2e8c4a52 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] [instance: b727b2b6-0315-4a01-a67c-c485a862b518] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 15 10:22:34 user nova-compute[75122]: DEBUG oslo.service.loopingcall [None req-67da5399-8dd8-4934-95f5-a5ae2e8c4a52 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75122) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 10:22:34 user nova-compute[75122]: DEBUG nova.compute.manager [-] [instance: b727b2b6-0315-4a01-a67c-c485a862b518] Deallocating network for instance {{(pid=75122) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 10:22:34 user nova-compute[75122]: DEBUG nova.network.neutron [-] [instance: b727b2b6-0315-4a01-a67c-c485a862b518] deallocate_for_instance() {{(pid=75122) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 10:22:34 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:22:34 user nova-compute[75122]: DEBUG nova.network.neutron [-] [instance: b727b2b6-0315-4a01-a67c-c485a862b518] Updating instance_info_cache with network_info: [] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 10:22:34 user nova-compute[75122]: INFO nova.compute.manager [-] [instance: b727b2b6-0315-4a01-a67c-c485a862b518] Took 0.49 seconds to deallocate network for instance.
Nov 15 10:22:34 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-67da5399-8dd8-4934-95f5-a5ae2e8c4a52 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:22:34 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-67da5399-8dd8-4934-95f5-a5ae2e8c4a52 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:22:34 user nova-compute[75122]: DEBUG nova.compute.manager [req-c2731551-3a3c-4a84-aa69-6639b0271e6a req-b9bb94d5-7a68-47e1-8814-07f2cdfaab13 service nova] [instance: b727b2b6-0315-4a01-a67c-c485a862b518] Received event network-vif-deleted-13d07e07-3d6e-465d-a21f-94afa7418d3b {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 10:22:34 user nova-compute[75122]: DEBUG nova.compute.provider_tree [None req-67da5399-8dd8-4934-95f5-a5ae2e8c4a52 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Inventory has not changed in ProviderTree for provider: 69a3da65-47be-44c6-b67c-c692b58284ef {{(pid=75122) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 10:22:34 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-67da5399-8dd8-4934-95f5-a5ae2e8c4a52 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Inventory has not changed for provider 69a3da65-47be-44c6-b67c-c692b58284ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 10:22:34 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-67da5399-8dd8-4934-95f5-a5ae2e8c4a52 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.111s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:22:34 user nova-compute[75122]: INFO nova.scheduler.client.report [None req-67da5399-8dd8-4934-95f5-a5ae2e8c4a52 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Deleted allocations for instance b727b2b6-0315-4a01-a67c-c485a862b518
Nov 15 10:22:34 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-67da5399-8dd8-4934-95f5-a5ae2e8c4a52 tempest-TestMinimumBasicScenario-1402308121 tempest-TestMinimumBasicScenario-1402308121-project-member] Lock "b727b2b6-0315-4a01-a67c-c485a862b518" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.625s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:22:36 user nova-compute[75122]: DEBUG nova.compute.manager [req-de8b977a-6b17-4896-9ebb-d3cc1c8e0054 req-065d9495-6cca-46cc-9515-7887675808a3 service nova] [instance: b727b2b6-0315-4a01-a67c-c485a862b518] Received event network-vif-plugged-13d07e07-3d6e-465d-a21f-94afa7418d3b {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 10:22:36 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-de8b977a-6b17-4896-9ebb-d3cc1c8e0054 req-065d9495-6cca-46cc-9515-7887675808a3 service nova] Acquiring lock "b727b2b6-0315-4a01-a67c-c485a862b518-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:22:36 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-de8b977a-6b17-4896-9ebb-d3cc1c8e0054 req-065d9495-6cca-46cc-9515-7887675808a3 service nova] Lock "b727b2b6-0315-4a01-a67c-c485a862b518-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:22:36 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-de8b977a-6b17-4896-9ebb-d3cc1c8e0054 req-065d9495-6cca-46cc-9515-7887675808a3 service nova] Lock "b727b2b6-0315-4a01-a67c-c485a862b518-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:22:36 user nova-compute[75122]: DEBUG nova.compute.manager [req-de8b977a-6b17-4896-9ebb-d3cc1c8e0054 req-065d9495-6cca-46cc-9515-7887675808a3 service nova] [instance: b727b2b6-0315-4a01-a67c-c485a862b518] No waiting events found dispatching network-vif-plugged-13d07e07-3d6e-465d-a21f-94afa7418d3b {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 10:22:36 user nova-compute[75122]: WARNING nova.compute.manager [req-de8b977a-6b17-4896-9ebb-d3cc1c8e0054 req-065d9495-6cca-46cc-9515-7887675808a3 service nova] [instance: b727b2b6-0315-4a01-a67c-c485a862b518] Received unexpected event network-vif-plugged-13d07e07-3d6e-465d-a21f-94afa7418d3b for instance with vm_state deleted and task_state None.
Nov 15 10:22:39 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:22:44 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:22:49 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:22:51 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:22:54 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:22:55 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:22:56 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:22:56 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:22:56 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:22:56 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:22:56 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:22:56 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75122) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 10:22:56 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 10:22:56 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 10:22:56 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Hypervisor/Node resource view: name=user free_ram=9142MB free_disk=25.043563842773438GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75122) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 10:22:56 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:22:56 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:22:56 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75122) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 10:22:56 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75122) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 10:22:56 user nova-compute[75122]: DEBUG nova.compute.provider_tree [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Inventory has not changed in ProviderTree for provider: 69a3da65-47be-44c6-b67c-c692b58284ef {{(pid=75122) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 10:22:56 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Inventory has not changed for provider 69a3da65-47be-44c6-b67c-c692b58284ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 10:22:56 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Compute_service record updated for user:user {{(pid=75122) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 10:22:56 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.170s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:22:59 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:22:59 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:22:59 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75122) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 10:22:59 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75122) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 10:22:59 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75122) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 10:22:59 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:23:00 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:23:01 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:23:01 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Starting heal instance info cache {{(pid=75122) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 10:23:01 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Rebuilding the list of instances to heal {{(pid=75122) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 10:23:01 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Didn't find any instances for network info cache update. {{(pid=75122) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 15 10:23:02 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:23:04 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:23:05 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:23:06 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:23:06 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75122) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 10:23:09 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:23:14 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:23:15 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:23:19 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:23:24 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:23:25 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:23:26 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:23:29 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:23:30 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:23:34 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:23:39 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:23:44 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:23:44 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:23:44 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75122) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 10:23:44 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75122) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 10:23:44 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75122) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 10:23:44 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:23:49 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:23:51 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:23:54 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:23:55 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:23:56 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:23:57 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:23:57 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:23:57 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:23:57 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:23:57 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75122) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 10:23:57 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 10:23:57 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 10:23:57 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Hypervisor/Node resource view: name=user free_ram=9181MB free_disk=25.075641632080078GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75122) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 10:23:57 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:23:57 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:23:57 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75122) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 10:23:57 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75122) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 10:23:57 user nova-compute[75122]: DEBUG nova.compute.provider_tree [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Inventory has not changed in ProviderTree for provider: 69a3da65-47be-44c6-b67c-c692b58284ef {{(pid=75122) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 10:23:57 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Inventory has not changed for provider 69a3da65-47be-44c6-b67c-c692b58284ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 10:23:57 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Compute_service record updated for user:user {{(pid=75122) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 10:23:57 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.153s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:23:59 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:23:59 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:23:59 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75122) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 10:23:59 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75122) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 10:23:59 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75122) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 10:23:59 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:24:01 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:24:02 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:24:02 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:24:02 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Starting heal instance info cache {{(pid=75122) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 10:24:02 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Rebuilding the list of instances to heal {{(pid=75122) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 10:24:02 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Didn't find any instances for network info cache update. {{(pid=75122) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 15 10:24:04 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:24:06 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:24:08 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:24:08 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75122) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 10:24:09 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:24:09 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:24:09 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75122) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 10:24:09 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75122) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 10:24:09 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75122) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 10:24:09 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:24:11 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:24:12 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:24:14 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:24:14 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:24:17 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:24:19 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:24:19 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:24:21 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:24:22 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:24:24 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:24:27 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:24:27 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-1c7e28ce-b27d-43d9-9aeb-21962872f6da tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Acquiring lock "2a337f4a-327c-4f68-b57b-ced92c9f0785" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:24:27 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-1c7e28ce-b27d-43d9-9aeb-21962872f6da tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Lock "2a337f4a-327c-4f68-b57b-ced92c9f0785" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:24:27 user nova-compute[75122]: DEBUG nova.compute.manager [None req-1c7e28ce-b27d-43d9-9aeb-21962872f6da tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] [instance: 2a337f4a-327c-4f68-b57b-ced92c9f0785] Starting instance... {{(pid=75122) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 10:24:27 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-1c7e28ce-b27d-43d9-9aeb-21962872f6da tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:24:27 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-1c7e28ce-b27d-43d9-9aeb-21962872f6da tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:24:27 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-1c7e28ce-b27d-43d9-9aeb-21962872f6da tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75122) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 10:24:27 user nova-compute[75122]: INFO nova.compute.claims [None req-1c7e28ce-b27d-43d9-9aeb-21962872f6da tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] [instance: 2a337f4a-327c-4f68-b57b-ced92c9f0785] Claim successful on node user
Nov 15 10:24:27 user nova-compute[75122]: DEBUG nova.compute.provider_tree [None req-1c7e28ce-b27d-43d9-9aeb-21962872f6da tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Inventory has not changed in ProviderTree for provider: 69a3da65-47be-44c6-b67c-c692b58284ef {{(pid=75122) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 10:24:27 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-1c7e28ce-b27d-43d9-9aeb-21962872f6da tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Inventory has not changed for provider 69a3da65-47be-44c6-b67c-c692b58284ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 10:24:27 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-1c7e28ce-b27d-43d9-9aeb-21962872f6da tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.284s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:24:27 user nova-compute[75122]: DEBUG nova.compute.manager [None req-1c7e28ce-b27d-43d9-9aeb-21962872f6da tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] [instance: 2a337f4a-327c-4f68-b57b-ced92c9f0785] Start building networks asynchronously for instance. {{(pid=75122) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 10:24:27 user nova-compute[75122]: DEBUG nova.compute.manager [None req-1c7e28ce-b27d-43d9-9aeb-21962872f6da tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] [instance: 2a337f4a-327c-4f68-b57b-ced92c9f0785] Allocating IP information in the background. {{(pid=75122) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 10:24:27 user nova-compute[75122]: DEBUG nova.network.neutron [None req-1c7e28ce-b27d-43d9-9aeb-21962872f6da tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] [instance: 2a337f4a-327c-4f68-b57b-ced92c9f0785] allocate_for_instance() {{(pid=75122) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 10:24:27 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-1c7e28ce-b27d-43d9-9aeb-21962872f6da tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] [instance: 2a337f4a-327c-4f68-b57b-ced92c9f0785] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 10:24:28 user nova-compute[75122]: DEBUG nova.compute.manager [None req-1c7e28ce-b27d-43d9-9aeb-21962872f6da tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] [instance: 2a337f4a-327c-4f68-b57b-ced92c9f0785] Start building block device mappings for instance. {{(pid=75122) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 10:24:28 user nova-compute[75122]: DEBUG nova.policy [None req-1c7e28ce-b27d-43d9-9aeb-21962872f6da tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8e22523c23164b828594d1c514ac3e7a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9dc6ab7d6975429083681f5807a78f08', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75122) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 10:24:28 user nova-compute[75122]: DEBUG nova.compute.manager [None req-1c7e28ce-b27d-43d9-9aeb-21962872f6da tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] [instance: 2a337f4a-327c-4f68-b57b-ced92c9f0785] Start spawning the instance on the hypervisor. {{(pid=75122) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 10:24:28 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-1c7e28ce-b27d-43d9-9aeb-21962872f6da tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] [instance: 2a337f4a-327c-4f68-b57b-ced92c9f0785] Creating instance directory {{(pid=75122) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 10:24:28 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-1c7e28ce-b27d-43d9-9aeb-21962872f6da tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] [instance: 2a337f4a-327c-4f68-b57b-ced92c9f0785] Creating image(s)
Nov 15 10:24:28 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-1c7e28ce-b27d-43d9-9aeb-21962872f6da tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Acquiring lock "/opt/stack/data/nova/instances/2a337f4a-327c-4f68-b57b-ced92c9f0785/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:24:28 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-1c7e28ce-b27d-43d9-9aeb-21962872f6da tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Lock "/opt/stack/data/nova/instances/2a337f4a-327c-4f68-b57b-ced92c9f0785/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:24:28 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-1c7e28ce-b27d-43d9-9aeb-21962872f6da tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Lock "/opt/stack/data/nova/instances/2a337f4a-327c-4f68-b57b-ced92c9f0785/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:24:28 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-1c7e28ce-b27d-43d9-9aeb-21962872f6da tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:24:28 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-1c7e28ce-b27d-43d9-9aeb-21962872f6da tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json" returned: 0 in 0.214s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:24:28 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-1c7e28ce-b27d-43d9-9aeb-21962872f6da tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Acquiring lock "95d6e29f74d5408f818e32f3bc29bc8270a4c665" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:24:28 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-1c7e28ce-b27d-43d9-9aeb-21962872f6da tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Lock "95d6e29f74d5408f818e32f3bc29bc8270a4c665" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:24:28 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-1c7e28ce-b27d-43d9-9aeb-21962872f6da tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:24:28 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-1c7e28ce-b27d-43d9-9aeb-21962872f6da tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json" returned: 0 in 0.188s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:24:28 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-1c7e28ce-b27d-43d9-9aeb-21962872f6da tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665,backing_fmt=raw /opt/stack/data/nova/instances/2a337f4a-327c-4f68-b57b-ced92c9f0785/disk 1073741824 {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:24:28 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-1c7e28ce-b27d-43d9-9aeb-21962872f6da tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665,backing_fmt=raw /opt/stack/data/nova/instances/2a337f4a-327c-4f68-b57b-ced92c9f0785/disk 1073741824" returned: 0 in 0.068s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:24:28 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-1c7e28ce-b27d-43d9-9aeb-21962872f6da tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Lock "95d6e29f74d5408f818e32f3bc29bc8270a4c665" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.264s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:24:28 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-1c7e28ce-b27d-43d9-9aeb-21962872f6da tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:24:28 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-1c7e28ce-b27d-43d9-9aeb-21962872f6da tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/95d6e29f74d5408f818e32f3bc29bc8270a4c665 --force-share --output=json" returned: 0 in 0.180s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:24:28 user nova-compute[75122]: DEBUG nova.virt.disk.api [None req-1c7e28ce-b27d-43d9-9aeb-21962872f6da tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2a337f4a-327c-4f68-b57b-ced92c9f0785/disk. size=1073741824 {{(pid=75122) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 10:24:28 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-1c7e28ce-b27d-43d9-9aeb-21962872f6da tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a337f4a-327c-4f68-b57b-ced92c9f0785/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:24:29 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-1c7e28ce-b27d-43d9-9aeb-21962872f6da tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a337f4a-327c-4f68-b57b-ced92c9f0785/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:24:29 user nova-compute[75122]: DEBUG nova.virt.disk.api [None req-1c7e28ce-b27d-43d9-9aeb-21962872f6da tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Cannot resize image /opt/stack/data/nova/instances/2a337f4a-327c-4f68-b57b-ced92c9f0785/disk to a smaller size. {{(pid=75122) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 10:24:29 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-1c7e28ce-b27d-43d9-9aeb-21962872f6da tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] [instance: 2a337f4a-327c-4f68-b57b-ced92c9f0785] Created local disks {{(pid=75122) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 10:24:29 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-1c7e28ce-b27d-43d9-9aeb-21962872f6da tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] [instance: 2a337f4a-327c-4f68-b57b-ced92c9f0785] Ensure instance console log exists: /opt/stack/data/nova/instances/2a337f4a-327c-4f68-b57b-ced92c9f0785/console.log {{(pid=75122) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 10:24:29 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-1c7e28ce-b27d-43d9-9aeb-21962872f6da tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:24:29 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-1c7e28ce-b27d-43d9-9aeb-21962872f6da tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:24:29 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-1c7e28ce-b27d-43d9-9aeb-21962872f6da tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:24:29 user nova-compute[75122]: DEBUG nova.network.neutron [None req-1c7e28ce-b27d-43d9-9aeb-21962872f6da tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] [instance: 2a337f4a-327c-4f68-b57b-ced92c9f0785] Successfully created port: e85cb1cf-cfb8-41cb-8337-52586061c47c {{(pid=75122) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 10:24:29 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:24:29 user nova-compute[75122]: DEBUG nova.network.neutron [None req-1c7e28ce-b27d-43d9-9aeb-21962872f6da tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] [instance: 2a337f4a-327c-4f68-b57b-ced92c9f0785] Successfully updated port: e85cb1cf-cfb8-41cb-8337-52586061c47c {{(pid=75122) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 10:24:29 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-1c7e28ce-b27d-43d9-9aeb-21962872f6da tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Acquiring lock "refresh_cache-2a337f4a-327c-4f68-b57b-ced92c9f0785" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 10:24:29 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-1c7e28ce-b27d-43d9-9aeb-21962872f6da tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Acquired lock "refresh_cache-2a337f4a-327c-4f68-b57b-ced92c9f0785" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 10:24:29 user nova-compute[75122]: DEBUG nova.network.neutron [None req-1c7e28ce-b27d-43d9-9aeb-21962872f6da tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] [instance: 2a337f4a-327c-4f68-b57b-ced92c9f0785] Building network info cache for instance {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 10:24:29 user nova-compute[75122]: DEBUG nova.compute.manager [req-ecd6c661-e9a5-4fe6-a9f1-95bc7db2ca08 req-eb1a6b1f-b758-4267-8732-34e17f94ff59 service nova] [instance: 2a337f4a-327c-4f68-b57b-ced92c9f0785] Received event network-changed-e85cb1cf-cfb8-41cb-8337-52586061c47c {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 10:24:29 user nova-compute[75122]: DEBUG nova.compute.manager [req-ecd6c661-e9a5-4fe6-a9f1-95bc7db2ca08 req-eb1a6b1f-b758-4267-8732-34e17f94ff59 service nova] [instance: 2a337f4a-327c-4f68-b57b-ced92c9f0785] Refreshing instance network info cache due to event network-changed-e85cb1cf-cfb8-41cb-8337-52586061c47c. {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 10:24:29 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-ecd6c661-e9a5-4fe6-a9f1-95bc7db2ca08 req-eb1a6b1f-b758-4267-8732-34e17f94ff59 service nova] Acquiring lock "refresh_cache-2a337f4a-327c-4f68-b57b-ced92c9f0785" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 10:24:29 user nova-compute[75122]: DEBUG nova.network.neutron [None req-1c7e28ce-b27d-43d9-9aeb-21962872f6da tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] [instance: 2a337f4a-327c-4f68-b57b-ced92c9f0785] Instance cache missing network info. {{(pid=75122) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 10:24:30 user nova-compute[75122]: DEBUG nova.network.neutron [None req-1c7e28ce-b27d-43d9-9aeb-21962872f6da tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] [instance: 2a337f4a-327c-4f68-b57b-ced92c9f0785] Updating instance_info_cache with network_info: [{"id": "e85cb1cf-cfb8-41cb-8337-52586061c47c", "address": "fa:16:3e:c5:79:7a", "network": {"id": "1c3d3d85-5e15-4b5a-9671-acca5de739d8", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-413087253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dc6ab7d6975429083681f5807a78f08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape85cb1cf-cf", "ovs_interfaceid": "e85cb1cf-cfb8-41cb-8337-52586061c47c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 10:24:30 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-1c7e28ce-b27d-43d9-9aeb-21962872f6da tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Releasing lock "refresh_cache-2a337f4a-327c-4f68-b57b-ced92c9f0785" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 10:24:30 user nova-compute[75122]: DEBUG nova.compute.manager [None req-1c7e28ce-b27d-43d9-9aeb-21962872f6da tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] [instance: 2a337f4a-327c-4f68-b57b-ced92c9f0785] Instance network_info: |[{"id": "e85cb1cf-cfb8-41cb-8337-52586061c47c", "address": "fa:16:3e:c5:79:7a", "network": {"id": "1c3d3d85-5e15-4b5a-9671-acca5de739d8", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-413087253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dc6ab7d6975429083681f5807a78f08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape85cb1cf-cf", "ovs_interfaceid": "e85cb1cf-cfb8-41cb-8337-52586061c47c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75122) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 10:24:30 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-ecd6c661-e9a5-4fe6-a9f1-95bc7db2ca08 req-eb1a6b1f-b758-4267-8732-34e17f94ff59 service nova] Acquired lock "refresh_cache-2a337f4a-327c-4f68-b57b-ced92c9f0785" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 10:24:30 user nova-compute[75122]: DEBUG nova.network.neutron [req-ecd6c661-e9a5-4fe6-a9f1-95bc7db2ca08 req-eb1a6b1f-b758-4267-8732-34e17f94ff59 service nova] [instance: 2a337f4a-327c-4f68-b57b-ced92c9f0785] Refreshing network info cache for port e85cb1cf-cfb8-41cb-8337-52586061c47c {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 10:24:30 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-1c7e28ce-b27d-43d9-9aeb-21962872f6da tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] [instance: 2a337f4a-327c-4f68-b57b-ced92c9f0785] Start _get_guest_xml network_info=[{"id": "e85cb1cf-cfb8-41cb-8337-52586061c47c", "address": "fa:16:3e:c5:79:7a", "network": {"id": "1c3d3d85-5e15-4b5a-9671-acca5de739d8", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-413087253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dc6ab7d6975429083681f5807a78f08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape85cb1cf-cf", "ovs_interfaceid": "e85cb1cf-cfb8-41cb-8337-52586061c47c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T09:26:31Z,direct_url=<?>,disk_format='qcow2',id=5e862cfe-47b8-4725-8292-65761ee6d0f5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9c57733cb41847c0b4ad31519c382e5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T09:26:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'device_type': 'disk', 'encryption_format': None, 'size': 0, 'encrypted': False, 'device_name': '/dev/vda', 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '5e862cfe-47b8-4725-8292-65761ee6d0f5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75122) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 10:24:30 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-1c7e28ce-b27d-43d9-9aeb-21962872f6da tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 10:24:30 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-1c7e28ce-b27d-43d9-9aeb-21962872f6da tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 10:24:30 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-1c7e28ce-b27d-43d9-9aeb-21962872f6da tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75122) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 10:24:30 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-1c7e28ce-b27d-43d9-9aeb-21962872f6da tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] CPU controller missing on host. {{(pid=75122) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 10:24:30 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-1c7e28ce-b27d-43d9-9aeb-21962872f6da tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75122) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 10:24:30 user nova-compute[75122]: DEBUG nova.virt.libvirt.host [None req-1c7e28ce-b27d-43d9-9aeb-21962872f6da tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] CPU controller found on host. {{(pid=75122) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 10:24:30 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-1c7e28ce-b27d-43d9-9aeb-21962872f6da tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75122) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 10:24:30 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-1c7e28ce-b27d-43d9-9aeb-21962872f6da tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T09:26:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T09:26:31Z,direct_url=<?>,disk_format='qcow2',id=5e862cfe-47b8-4725-8292-65761ee6d0f5,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='9c57733cb41847c0b4ad31519c382e5a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T09:26:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 10:24:30 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-1c7e28ce-b27d-43d9-9aeb-21962872f6da tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Flavor limits 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 10:24:30 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-1c7e28ce-b27d-43d9-9aeb-21962872f6da tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Image limits 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 10:24:30 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-1c7e28ce-b27d-43d9-9aeb-21962872f6da tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Flavor pref 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 10:24:30 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-1c7e28ce-b27d-43d9-9aeb-21962872f6da tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Image pref 0:0:0 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 10:24:30 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-1c7e28ce-b27d-43d9-9aeb-21962872f6da tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 10:24:30 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-1c7e28ce-b27d-43d9-9aeb-21962872f6da tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 10:24:30 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-1c7e28ce-b27d-43d9-9aeb-21962872f6da tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75122) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 10:24:30 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-1c7e28ce-b27d-43d9-9aeb-21962872f6da tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Got 1 possible topologies {{(pid=75122) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 10:24:30 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-1c7e28ce-b27d-43d9-9aeb-21962872f6da tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 10:24:30 user nova-compute[75122]: DEBUG nova.virt.hardware [None req-1c7e28ce-b27d-43d9-9aeb-21962872f6da tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75122) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 10:24:30 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-1c7e28ce-b27d-43d9-9aeb-21962872f6da tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T10:24:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-2014063672',display_name='tempest-SnapshotDataIntegrityTests-server-2014063672',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-2014063672',id=53,image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJUtfyo0aLhuo4kTNVogxz3oqC4DtLpQf9Yh4q8xNV4S98WK3o0ZK7/uQXV0GwTuddBKbuB/gYU8ewzEyv6yxd6mY53lC8c8l/biLd0FtLPnUBzalGGss/Sra5vvFs0/lw==',key_name='tempest-keypair-1856492247',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9dc6ab7d6975429083681f5807a78f08',ramdisk_id='',reservation_id='r-fc2lkv4x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1201504109',owner_user_name='tempest-SnapshotDataIntegrityTests-1201504109-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T10:24:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8e22523c23164b828594d1c514ac3e7a',uuid=2a337f4a-327c-4f68-b57b-ced92c9f0785,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e85cb1cf-cfb8-41cb-8337-52586061c47c", "address": "fa:16:3e:c5:79:7a", "network": {"id": "1c3d3d85-5e15-4b5a-9671-acca5de739d8", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-413087253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dc6ab7d6975429083681f5807a78f08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape85cb1cf-cf", "ovs_interfaceid": "e85cb1cf-cfb8-41cb-8337-52586061c47c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75122) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 10:24:30 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-1c7e28ce-b27d-43d9-9aeb-21962872f6da tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Converting VIF {"id": "e85cb1cf-cfb8-41cb-8337-52586061c47c", "address": "fa:16:3e:c5:79:7a", "network": {"id": "1c3d3d85-5e15-4b5a-9671-acca5de739d8", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-413087253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dc6ab7d6975429083681f5807a78f08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape85cb1cf-cf", "ovs_interfaceid": "e85cb1cf-cfb8-41cb-8337-52586061c47c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 10:24:30 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-1c7e28ce-b27d-43d9-9aeb-21962872f6da tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:79:7a,bridge_name='br-int',has_traffic_filtering=True,id=e85cb1cf-cfb8-41cb-8337-52586061c47c,network=Network(1c3d3d85-5e15-4b5a-9671-acca5de739d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape85cb1cf-cf') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 10:24:30 user nova-compute[75122]: DEBUG nova.objects.instance [None req-1c7e28ce-b27d-43d9-9aeb-21962872f6da tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Lazy-loading 'pci_devices' on Instance uuid 2a337f4a-327c-4f68-b57b-ced92c9f0785 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 10:24:30 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-1c7e28ce-b27d-43d9-9aeb-21962872f6da tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] [instance: 2a337f4a-327c-4f68-b57b-ced92c9f0785] End _get_guest_xml xml=<domain type="kvm">
Nov 15 10:24:30 user nova-compute[75122]:   <uuid>2a337f4a-327c-4f68-b57b-ced92c9f0785</uuid>
Nov 15 10:24:30 user nova-compute[75122]:   <name>instance-00000035</name>
Nov 15 10:24:30 user nova-compute[75122]:   <memory>524288</memory>
Nov 15 10:24:30 user nova-compute[75122]:   <vcpu>1</vcpu>
Nov 15 10:24:30 user nova-compute[75122]:   <metadata>
Nov 15 10:24:30 user nova-compute[75122]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 10:24:30 user nova-compute[75122]:       <nova:package version="0.0.0"/>
Nov 15 10:24:30 user nova-compute[75122]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-2014063672</nova:name>
Nov 15 10:24:30 user nova-compute[75122]:       <nova:creationTime>2023-11-15 10:24:30</nova:creationTime>
Nov 15 10:24:30 user nova-compute[75122]:       <nova:flavor name="m1.tiny">
Nov 15 10:24:30 user nova-compute[75122]:         <nova:memory>512</nova:memory>
Nov 15 10:24:30 user nova-compute[75122]:         <nova:disk>1</nova:disk>
Nov 15 10:24:30 user nova-compute[75122]:         <nova:swap>0</nova:swap>
Nov 15 10:24:30 user nova-compute[75122]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 10:24:30 user nova-compute[75122]:         <nova:vcpus>1</nova:vcpus>
Nov 15 10:24:30 user nova-compute[75122]:       </nova:flavor>
Nov 15 10:24:30 user nova-compute[75122]:       <nova:owner>
Nov 15 10:24:30 user nova-compute[75122]:         <nova:user uuid="8e22523c23164b828594d1c514ac3e7a">tempest-SnapshotDataIntegrityTests-1201504109-project-member</nova:user>
Nov 15 10:24:30 user nova-compute[75122]:         <nova:project uuid="9dc6ab7d6975429083681f5807a78f08">tempest-SnapshotDataIntegrityTests-1201504109</nova:project>
Nov 15 10:24:30 user nova-compute[75122]:       </nova:owner>
Nov 15 10:24:30 user nova-compute[75122]:       <nova:root type="image" uuid="5e862cfe-47b8-4725-8292-65761ee6d0f5"/>
Nov 15 10:24:30 user nova-compute[75122]:       <nova:ports>
Nov 15 10:24:30 user nova-compute[75122]:         <nova:port uuid="e85cb1cf-cfb8-41cb-8337-52586061c47c">
Nov 15 10:24:30 user nova-compute[75122]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 15 10:24:30 user nova-compute[75122]:         </nova:port>
Nov 15 10:24:30 user nova-compute[75122]:       </nova:ports>
Nov 15 10:24:30 user nova-compute[75122]:     </nova:instance>
Nov 15 10:24:30 user nova-compute[75122]:   </metadata>
Nov 15 10:24:30 user nova-compute[75122]:   <sysinfo type="smbios">
Nov 15 10:24:30 user nova-compute[75122]:     <system>
Nov 15 10:24:30 user nova-compute[75122]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 10:24:30 user nova-compute[75122]:       <entry name="product">OpenStack Nova</entry>
Nov 15 10:24:30 user nova-compute[75122]:       <entry name="version">0.0.0</entry>
Nov 15 10:24:30 user nova-compute[75122]:       <entry name="serial">2a337f4a-327c-4f68-b57b-ced92c9f0785</entry>
Nov 15 10:24:30 user nova-compute[75122]:       <entry name="uuid">2a337f4a-327c-4f68-b57b-ced92c9f0785</entry>
Nov 15 10:24:30 user nova-compute[75122]:       <entry name="family">Virtual Machine</entry>
Nov 15 10:24:30 user nova-compute[75122]:     </system>
Nov 15 10:24:30 user nova-compute[75122]:   </sysinfo>
Nov 15 10:24:30 user nova-compute[75122]:   <os>
Nov 15 10:24:30 user nova-compute[75122]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 10:24:30 user nova-compute[75122]:     <boot dev="hd"/>
Nov 15 10:24:30 user nova-compute[75122]:     <smbios mode="sysinfo"/>
Nov 15 10:24:30 user nova-compute[75122]:   </os>
Nov 15 10:24:30 user nova-compute[75122]:   <features>
Nov 15 10:24:30 user nova-compute[75122]:     <acpi/>
Nov 15 10:24:30 user nova-compute[75122]:     <apic/>
Nov 15 10:24:30 user nova-compute[75122]:     <vmcoreinfo/>
Nov 15 10:24:30 user nova-compute[75122]:   </features>
Nov 15 10:24:30 user nova-compute[75122]:   <clock offset="utc">
Nov 15 10:24:30 user nova-compute[75122]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 10:24:30 user nova-compute[75122]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 10:24:30 user nova-compute[75122]:     <timer name="hpet" present="no"/>
Nov 15 10:24:30 user nova-compute[75122]:   </clock>
Nov 15 10:24:30 user nova-compute[75122]:   <cpu mode="custom" match="exact">
Nov 15 10:24:30 user nova-compute[75122]:     <model>Nehalem</model>
Nov 15 10:24:30 user nova-compute[75122]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 10:24:30 user nova-compute[75122]:   </cpu>
Nov 15 10:24:30 user nova-compute[75122]:   <devices>
Nov 15 10:24:30 user nova-compute[75122]:     <disk type="file" device="disk">
Nov 15 10:24:30 user nova-compute[75122]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 10:24:30 user nova-compute[75122]:       <source file="/opt/stack/data/nova/instances/2a337f4a-327c-4f68-b57b-ced92c9f0785/disk"/>
Nov 15 10:24:30 user nova-compute[75122]:       <target dev="vda" bus="virtio"/>
Nov 15 10:24:30 user nova-compute[75122]:     </disk>
Nov 15 10:24:30 user nova-compute[75122]:     <interface type="ethernet">
Nov 15 10:24:30 user nova-compute[75122]:       <mac address="fa:16:3e:c5:79:7a"/>
Nov 15 10:24:30 user nova-compute[75122]:       <model type="virtio"/>
Nov 15 10:24:30 user nova-compute[75122]:       <mtu size="1442"/>
Nov 15 10:24:30 user nova-compute[75122]:       <target dev="tape85cb1cf-cf"/>
Nov 15 10:24:30 user nova-compute[75122]:     </interface>
Nov 15 10:24:30 user nova-compute[75122]:     <serial type="pty">
Nov 15 10:24:30 user nova-compute[75122]:       <log file="/opt/stack/data/nova/instances/2a337f4a-327c-4f68-b57b-ced92c9f0785/console.log" append="off"/>
Nov 15 10:24:30 user nova-compute[75122]:     </serial>
Nov 15 10:24:30 user nova-compute[75122]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 10:24:30 user nova-compute[75122]:     <video>
Nov 15 10:24:30 user nova-compute[75122]:       <model type="virtio"/>
Nov 15 10:24:30 user nova-compute[75122]:     </video>
Nov 15 10:24:30 user nova-compute[75122]:     <rng model="virtio">
Nov 15 10:24:30 user nova-compute[75122]:       <backend model="random">/dev/urandom</backend>
Nov 15 10:24:30 user nova-compute[75122]:     </rng>
Nov 15 10:24:30 user nova-compute[75122]:     <controller type="usb" index="0" model="none"/>
Nov 15 10:24:30 user nova-compute[75122]:     <memballoon model="virtio">
Nov 15 10:24:30 user nova-compute[75122]:       <stats period="10"/>
Nov 15 10:24:30 user nova-compute[75122]:     </memballoon>
Nov 15 10:24:30 user nova-compute[75122]:   </devices>
Nov 15 10:24:30 user nova-compute[75122]: </domain>
Nov 15 10:24:30 user nova-compute[75122]:  {{(pid=75122) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 10:24:30 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-1c7e28ce-b27d-43d9-9aeb-21962872f6da tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T10:24:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-2014063672',display_name='tempest-SnapshotDataIntegrityTests-server-2014063672',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-2014063672',id=53,image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJUtfyo0aLhuo4kTNVogxz3oqC4DtLpQf9Yh4q8xNV4S98WK3o0ZK7/uQXV0GwTuddBKbuB/gYU8ewzEyv6yxd6mY53lC8c8l/biLd0FtLPnUBzalGGss/Sra5vvFs0/lw==',key_name='tempest-keypair-1856492247',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9dc6ab7d6975429083681f5807a78f08',ramdisk_id='',reservation_id='r-fc2lkv4x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1201504109',owner_user_name='tempest-SnapshotDataIntegrityTests-1201504109-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T10:24:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8e22523c23164b828594d1c514ac3e7a',uuid=2a337f4a-327c-4f68-b57b-ced92c9f0785,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e85cb1cf-cfb8-41cb-8337-52586061c47c", "address": "fa:16:3e:c5:79:7a", "network": {"id": "1c3d3d85-5e15-4b5a-9671-acca5de739d8", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-413087253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dc6ab7d6975429083681f5807a78f08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape85cb1cf-cf", "ovs_interfaceid": "e85cb1cf-cfb8-41cb-8337-52586061c47c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 10:24:30 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-1c7e28ce-b27d-43d9-9aeb-21962872f6da tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Converting VIF {"id": "e85cb1cf-cfb8-41cb-8337-52586061c47c", "address": "fa:16:3e:c5:79:7a", "network": {"id": "1c3d3d85-5e15-4b5a-9671-acca5de739d8", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-413087253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dc6ab7d6975429083681f5807a78f08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape85cb1cf-cf", "ovs_interfaceid": "e85cb1cf-cfb8-41cb-8337-52586061c47c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 10:24:30 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-1c7e28ce-b27d-43d9-9aeb-21962872f6da tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:79:7a,bridge_name='br-int',has_traffic_filtering=True,id=e85cb1cf-cfb8-41cb-8337-52586061c47c,network=Network(1c3d3d85-5e15-4b5a-9671-acca5de739d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape85cb1cf-cf') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 10:24:30 user nova-compute[75122]: DEBUG os_vif [None req-1c7e28ce-b27d-43d9-9aeb-21962872f6da tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:79:7a,bridge_name='br-int',has_traffic_filtering=True,id=e85cb1cf-cfb8-41cb-8337-52586061c47c,network=Network(1c3d3d85-5e15-4b5a-9671-acca5de739d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape85cb1cf-cf') {{(pid=75122) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 10:24:30 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:24:30 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 10:24:30 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 10:24:30 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:24:30 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '891430b8-3d36-5e03-b39c-6f545eb86c54', '_type': 'linux-noop'}}, row=False) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 10:24:30 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:24:30 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:24:30 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:24:30 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape85cb1cf-cf, may_exist=True, interface_attrs={}) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 10:24:30 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape85cb1cf-cf, col_values=(('qos', UUID('71dd949e-43c4-4f87-957a-53053e31e716')),), if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 10:24:30 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape85cb1cf-cf, col_values=(('external_ids', {'iface-id': 'e85cb1cf-cfb8-41cb-8337-52586061c47c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c5:79:7a', 'vm-uuid': '2a337f4a-327c-4f68-b57b-ced92c9f0785'}),), if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 10:24:30 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:24:30 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:24:30 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:24:30 user nova-compute[75122]: INFO os_vif [None req-1c7e28ce-b27d-43d9-9aeb-21962872f6da tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:79:7a,bridge_name='br-int',has_traffic_filtering=True,id=e85cb1cf-cfb8-41cb-8337-52586061c47c,network=Network(1c3d3d85-5e15-4b5a-9671-acca5de739d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape85cb1cf-cf')
Nov 15 10:24:30 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-1c7e28ce-b27d-43d9-9aeb-21962872f6da tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] No BDM found with device name vda, not building metadata. {{(pid=75122) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 10:24:30 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-1c7e28ce-b27d-43d9-9aeb-21962872f6da tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] No VIF found with MAC fa:16:3e:c5:79:7a, not building metadata {{(pid=75122) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 10:24:30 user nova-compute[75122]: DEBUG nova.network.neutron [req-ecd6c661-e9a5-4fe6-a9f1-95bc7db2ca08 req-eb1a6b1f-b758-4267-8732-34e17f94ff59 service nova] [instance: 2a337f4a-327c-4f68-b57b-ced92c9f0785] Updated VIF entry in instance network info cache for port e85cb1cf-cfb8-41cb-8337-52586061c47c. {{(pid=75122) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 10:24:30 user nova-compute[75122]: DEBUG nova.network.neutron [req-ecd6c661-e9a5-4fe6-a9f1-95bc7db2ca08 req-eb1a6b1f-b758-4267-8732-34e17f94ff59 service nova] [instance: 2a337f4a-327c-4f68-b57b-ced92c9f0785] Updating instance_info_cache with network_info: [{"id": "e85cb1cf-cfb8-41cb-8337-52586061c47c", "address": "fa:16:3e:c5:79:7a", "network": {"id": "1c3d3d85-5e15-4b5a-9671-acca5de739d8", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-413087253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dc6ab7d6975429083681f5807a78f08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape85cb1cf-cf", "ovs_interfaceid": "e85cb1cf-cfb8-41cb-8337-52586061c47c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 10:24:30 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-ecd6c661-e9a5-4fe6-a9f1-95bc7db2ca08 req-eb1a6b1f-b758-4267-8732-34e17f94ff59 service nova] Releasing lock "refresh_cache-2a337f4a-327c-4f68-b57b-ced92c9f0785" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 10:24:31 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:24:31 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:24:31 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:24:32 user nova-compute[75122]: DEBUG nova.compute.manager [req-be999716-b46d-4ac5-8a5a-d0d89dfc2aad req-b384e40e-1ed6-4ec8-b2cb-9fcf10ef12b4 service nova] [instance: 2a337f4a-327c-4f68-b57b-ced92c9f0785] Received event network-vif-plugged-e85cb1cf-cfb8-41cb-8337-52586061c47c {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 10:24:32 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-be999716-b46d-4ac5-8a5a-d0d89dfc2aad req-b384e40e-1ed6-4ec8-b2cb-9fcf10ef12b4 service nova] Acquiring lock "2a337f4a-327c-4f68-b57b-ced92c9f0785-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:24:32 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-be999716-b46d-4ac5-8a5a-d0d89dfc2aad req-b384e40e-1ed6-4ec8-b2cb-9fcf10ef12b4 service nova] Lock "2a337f4a-327c-4f68-b57b-ced92c9f0785-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:24:32 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-be999716-b46d-4ac5-8a5a-d0d89dfc2aad req-b384e40e-1ed6-4ec8-b2cb-9fcf10ef12b4 service nova] Lock "2a337f4a-327c-4f68-b57b-ced92c9f0785-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:24:32 user nova-compute[75122]: DEBUG nova.compute.manager [req-be999716-b46d-4ac5-8a5a-d0d89dfc2aad req-b384e40e-1ed6-4ec8-b2cb-9fcf10ef12b4 service nova] [instance: 2a337f4a-327c-4f68-b57b-ced92c9f0785] No waiting events found dispatching network-vif-plugged-e85cb1cf-cfb8-41cb-8337-52586061c47c {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 10:24:32 user nova-compute[75122]: WARNING nova.compute.manager [req-be999716-b46d-4ac5-8a5a-d0d89dfc2aad req-b384e40e-1ed6-4ec8-b2cb-9fcf10ef12b4 service nova] [instance: 2a337f4a-327c-4f68-b57b-ced92c9f0785] Received unexpected event network-vif-plugged-e85cb1cf-cfb8-41cb-8337-52586061c47c for instance with vm_state building and task_state spawning.
Nov 15 10:24:32 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:24:32 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:24:33 user nova-compute[75122]: DEBUG nova.compute.manager [None req-1c7e28ce-b27d-43d9-9aeb-21962872f6da tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] [instance: 2a337f4a-327c-4f68-b57b-ced92c9f0785] Instance event wait completed in 0 seconds for  {{(pid=75122) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 10:24:33 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-1c7e28ce-b27d-43d9-9aeb-21962872f6da tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] [instance: 2a337f4a-327c-4f68-b57b-ced92c9f0785] Guest created on hypervisor {{(pid=75122) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 10:24:34 user nova-compute[75122]: INFO nova.virt.libvirt.driver [-] [instance: 2a337f4a-327c-4f68-b57b-ced92c9f0785] Instance spawned successfully.
Nov 15 10:24:34 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-1c7e28ce-b27d-43d9-9aeb-21962872f6da tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] [instance: 2a337f4a-327c-4f68-b57b-ced92c9f0785] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 10:24:34 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-1c7e28ce-b27d-43d9-9aeb-21962872f6da tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] [instance: 2a337f4a-327c-4f68-b57b-ced92c9f0785] Found default for hw_cdrom_bus of ide {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 10:24:34 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-1c7e28ce-b27d-43d9-9aeb-21962872f6da tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] [instance: 2a337f4a-327c-4f68-b57b-ced92c9f0785] Found default for hw_disk_bus of virtio {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 10:24:34 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-1c7e28ce-b27d-43d9-9aeb-21962872f6da tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] [instance: 2a337f4a-327c-4f68-b57b-ced92c9f0785] Found default for hw_input_bus of None {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 10:24:34 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-1c7e28ce-b27d-43d9-9aeb-21962872f6da tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] [instance: 2a337f4a-327c-4f68-b57b-ced92c9f0785] Found default for hw_pointer_model of None {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 10:24:34 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-1c7e28ce-b27d-43d9-9aeb-21962872f6da tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] [instance: 2a337f4a-327c-4f68-b57b-ced92c9f0785] Found default for hw_video_model of virtio {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 10:24:34 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-1c7e28ce-b27d-43d9-9aeb-21962872f6da tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] [instance: 2a337f4a-327c-4f68-b57b-ced92c9f0785] Found default for hw_vif_model of virtio {{(pid=75122) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 10:24:34 user nova-compute[75122]: INFO nova.compute.manager [None req-1c7e28ce-b27d-43d9-9aeb-21962872f6da tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] [instance: 2a337f4a-327c-4f68-b57b-ced92c9f0785] Took 5.93 seconds to spawn the instance on the hypervisor.
Nov 15 10:24:34 user nova-compute[75122]: DEBUG nova.compute.manager [None req-1c7e28ce-b27d-43d9-9aeb-21962872f6da tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] [instance: 2a337f4a-327c-4f68-b57b-ced92c9f0785] Checking state {{(pid=75122) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 10:24:34 user nova-compute[75122]: DEBUG nova.compute.manager [req-bbd52e54-76fe-4b1b-a14c-3e9daf4d43a5 req-44e5df0b-a6d6-49c3-9298-84f8c1ea1c8e service nova] [instance: 2a337f4a-327c-4f68-b57b-ced92c9f0785] Received event network-vif-plugged-e85cb1cf-cfb8-41cb-8337-52586061c47c {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 10:24:34 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-bbd52e54-76fe-4b1b-a14c-3e9daf4d43a5 req-44e5df0b-a6d6-49c3-9298-84f8c1ea1c8e service nova] Acquiring lock "2a337f4a-327c-4f68-b57b-ced92c9f0785-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:24:34 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-bbd52e54-76fe-4b1b-a14c-3e9daf4d43a5 req-44e5df0b-a6d6-49c3-9298-84f8c1ea1c8e service nova] Lock "2a337f4a-327c-4f68-b57b-ced92c9f0785-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:24:34 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-bbd52e54-76fe-4b1b-a14c-3e9daf4d43a5 req-44e5df0b-a6d6-49c3-9298-84f8c1ea1c8e service nova] Lock "2a337f4a-327c-4f68-b57b-ced92c9f0785-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:24:34 user nova-compute[75122]: DEBUG nova.compute.manager [req-bbd52e54-76fe-4b1b-a14c-3e9daf4d43a5 req-44e5df0b-a6d6-49c3-9298-84f8c1ea1c8e service nova] [instance: 2a337f4a-327c-4f68-b57b-ced92c9f0785] No waiting events found dispatching network-vif-plugged-e85cb1cf-cfb8-41cb-8337-52586061c47c {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 10:24:34 user nova-compute[75122]: WARNING nova.compute.manager [req-bbd52e54-76fe-4b1b-a14c-3e9daf4d43a5 req-44e5df0b-a6d6-49c3-9298-84f8c1ea1c8e service nova] [instance: 2a337f4a-327c-4f68-b57b-ced92c9f0785] Received unexpected event network-vif-plugged-e85cb1cf-cfb8-41cb-8337-52586061c47c for instance with vm_state building and task_state spawning.
Nov 15 10:24:34 user nova-compute[75122]: INFO nova.compute.manager [None req-1c7e28ce-b27d-43d9-9aeb-21962872f6da tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] [instance: 2a337f4a-327c-4f68-b57b-ced92c9f0785] Took 6.92 seconds to build instance.
Nov 15 10:24:34 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-1c7e28ce-b27d-43d9-9aeb-21962872f6da tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Lock "2a337f4a-327c-4f68-b57b-ced92c9f0785" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.023s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:24:35 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:24:37 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:24:40 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:24:45 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:24:47 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:24:50 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:24:52 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:24:52 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:24:55 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:24:57 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:24:57 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:24:57 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:24:57 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:24:57 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:24:57 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:24:57 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:24:57 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75122) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 10:24:57 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a337f4a-327c-4f68-b57b-ced92c9f0785/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:24:57 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a337f4a-327c-4f68-b57b-ced92c9f0785/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:24:57 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a337f4a-327c-4f68-b57b-ced92c9f0785/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:24:57 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a337f4a-327c-4f68-b57b-ced92c9f0785/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:24:58 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 10:24:58 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 10:24:58 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Hypervisor/Node resource view: name=user free_ram=8891MB free_disk=25.039230346679688GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75122) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 10:24:58 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:24:58 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:24:58 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance 2a337f4a-327c-4f68-b57b-ced92c9f0785 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 10:24:58 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75122) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 10:24:58 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75122) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 10:24:58 user nova-compute[75122]: DEBUG nova.compute.provider_tree [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Inventory has not changed in ProviderTree for provider: 69a3da65-47be-44c6-b67c-c692b58284ef {{(pid=75122) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 10:24:58 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Inventory has not changed for provider 69a3da65-47be-44c6-b67c-c692b58284ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 10:24:58 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Compute_service record updated for user:user {{(pid=75122) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 10:24:58 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.217s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:25:00 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:25:02 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:25:02 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:25:02 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:25:03 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:25:03 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Starting heal instance info cache {{(pid=75122) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 10:25:03 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Rebuilding the list of instances to heal {{(pid=75122) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 10:25:03 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "refresh_cache-2a337f4a-327c-4f68-b57b-ced92c9f0785" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 10:25:03 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquired lock "refresh_cache-2a337f4a-327c-4f68-b57b-ced92c9f0785" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 10:25:03 user nova-compute[75122]: DEBUG nova.network.neutron [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] [instance: 2a337f4a-327c-4f68-b57b-ced92c9f0785] Forcefully refreshing network info cache for instance {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 10:25:03 user nova-compute[75122]: DEBUG nova.objects.instance [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lazy-loading 'info_cache' on Instance uuid 2a337f4a-327c-4f68-b57b-ced92c9f0785 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 10:25:03 user nova-compute[75122]: DEBUG nova.network.neutron [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] [instance: 2a337f4a-327c-4f68-b57b-ced92c9f0785] Updating instance_info_cache with network_info: [{"id": "e85cb1cf-cfb8-41cb-8337-52586061c47c", "address": "fa:16:3e:c5:79:7a", "network": {"id": "1c3d3d85-5e15-4b5a-9671-acca5de739d8", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-413087253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dc6ab7d6975429083681f5807a78f08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape85cb1cf-cf", "ovs_interfaceid": "e85cb1cf-cfb8-41cb-8337-52586061c47c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 10:25:03 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Releasing lock "refresh_cache-2a337f4a-327c-4f68-b57b-ced92c9f0785" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 10:25:03 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] [instance: 2a337f4a-327c-4f68-b57b-ced92c9f0785] Updated the network info_cache for instance {{(pid=75122) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 10:25:05 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:25:07 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:25:07 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:25:10 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:25:10 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75122) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 10:25:10 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:25:15 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:25:17 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:25:20 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:25:20 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:25:20 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75122) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 10:25:20 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75122) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 10:25:20 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75122) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 10:25:20 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:25:25 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:25:30 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:25:35 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:25:35 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:25:35 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75122) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 10:25:35 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75122) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 10:25:35 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75122) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 10:25:35 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:25:40 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:25:40 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:25:40 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75122) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 10:25:40 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75122) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 10:25:40 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75122) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 10:25:40 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:25:45 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:25:50 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:25:52 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:25:55 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:25:58 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:25:58 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:25:59 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:25:59 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:25:59 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:25:59 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:25:59 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75122) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 10:25:59 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a337f4a-327c-4f68-b57b-ced92c9f0785/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:25:59 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a337f4a-327c-4f68-b57b-ced92c9f0785/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:25:59 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a337f4a-327c-4f68-b57b-ced92c9f0785/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:25:59 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a337f4a-327c-4f68-b57b-ced92c9f0785/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:26:00 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 10:26:00 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 10:26:00 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Hypervisor/Node resource view: name=user free_ram=8989MB free_disk=25.036666870117188GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75122) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 10:26:00 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:26:00 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:26:00 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance 2a337f4a-327c-4f68-b57b-ced92c9f0785 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 10:26:00 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75122) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 10:26:00 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75122) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 10:26:00 user nova-compute[75122]: DEBUG nova.compute.provider_tree [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Inventory has not changed in ProviderTree for provider: 69a3da65-47be-44c6-b67c-c692b58284ef {{(pid=75122) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 10:26:00 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Inventory has not changed for provider 69a3da65-47be-44c6-b67c-c692b58284ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 10:26:00 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Compute_service record updated for user:user {{(pid=75122) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 10:26:00 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.210s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:26:00 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:26:02 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:26:02 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:26:03 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_shelved_instances {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:26:04 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:26:04 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Starting heal instance info cache {{(pid=75122) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 10:26:04 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Rebuilding the list of instances to heal {{(pid=75122) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 10:26:04 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "refresh_cache-2a337f4a-327c-4f68-b57b-ced92c9f0785" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 10:26:04 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquired lock "refresh_cache-2a337f4a-327c-4f68-b57b-ced92c9f0785" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 10:26:04 user nova-compute[75122]: DEBUG nova.network.neutron [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] [instance: 2a337f4a-327c-4f68-b57b-ced92c9f0785] Forcefully refreshing network info cache for instance {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 10:26:04 user nova-compute[75122]: DEBUG nova.objects.instance [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lazy-loading 'info_cache' on Instance uuid 2a337f4a-327c-4f68-b57b-ced92c9f0785 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 10:26:04 user nova-compute[75122]: DEBUG nova.network.neutron [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] [instance: 2a337f4a-327c-4f68-b57b-ced92c9f0785] Updating instance_info_cache with network_info: [{"id": "e85cb1cf-cfb8-41cb-8337-52586061c47c", "address": "fa:16:3e:c5:79:7a", "network": {"id": "1c3d3d85-5e15-4b5a-9671-acca5de739d8", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-413087253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dc6ab7d6975429083681f5807a78f08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape85cb1cf-cf", "ovs_interfaceid": "e85cb1cf-cfb8-41cb-8337-52586061c47c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 10:26:04 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Releasing lock "refresh_cache-2a337f4a-327c-4f68-b57b-ced92c9f0785" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 10:26:04 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] [instance: 2a337f4a-327c-4f68-b57b-ced92c9f0785] Updated the network info_cache for instance {{(pid=75122) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 10:26:05 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:26:08 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:26:10 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:26:12 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:26:12 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75122) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 10:26:15 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:26:18 user nova-compute[75122]: DEBUG nova.compute.manager [req-7a2f17aa-9f17-4dcc-9cb2-c299d4325738 req-f1ec1efa-2fd1-4229-86f9-57222878480d service nova] [instance: 2a337f4a-327c-4f68-b57b-ced92c9f0785] Received event network-changed-e85cb1cf-cfb8-41cb-8337-52586061c47c {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 10:26:18 user nova-compute[75122]: DEBUG nova.compute.manager [req-7a2f17aa-9f17-4dcc-9cb2-c299d4325738 req-f1ec1efa-2fd1-4229-86f9-57222878480d service nova] [instance: 2a337f4a-327c-4f68-b57b-ced92c9f0785] Refreshing instance network info cache due to event network-changed-e85cb1cf-cfb8-41cb-8337-52586061c47c. {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 10:26:18 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-7a2f17aa-9f17-4dcc-9cb2-c299d4325738 req-f1ec1efa-2fd1-4229-86f9-57222878480d service nova] Acquiring lock "refresh_cache-2a337f4a-327c-4f68-b57b-ced92c9f0785" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 10:26:18 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-7a2f17aa-9f17-4dcc-9cb2-c299d4325738 req-f1ec1efa-2fd1-4229-86f9-57222878480d service nova] Acquired lock "refresh_cache-2a337f4a-327c-4f68-b57b-ced92c9f0785" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 10:26:18 user nova-compute[75122]: DEBUG nova.network.neutron [req-7a2f17aa-9f17-4dcc-9cb2-c299d4325738 req-f1ec1efa-2fd1-4229-86f9-57222878480d service nova] [instance: 2a337f4a-327c-4f68-b57b-ced92c9f0785] Refreshing network info cache for port e85cb1cf-cfb8-41cb-8337-52586061c47c {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 10:26:18 user nova-compute[75122]: DEBUG nova.network.neutron [req-7a2f17aa-9f17-4dcc-9cb2-c299d4325738 req-f1ec1efa-2fd1-4229-86f9-57222878480d service nova] [instance: 2a337f4a-327c-4f68-b57b-ced92c9f0785] Updated VIF entry in instance network info cache for port e85cb1cf-cfb8-41cb-8337-52586061c47c. {{(pid=75122) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 10:26:18 user nova-compute[75122]: DEBUG nova.network.neutron [req-7a2f17aa-9f17-4dcc-9cb2-c299d4325738 req-f1ec1efa-2fd1-4229-86f9-57222878480d service nova] [instance: 2a337f4a-327c-4f68-b57b-ced92c9f0785] Updating instance_info_cache with network_info: [{"id": "e85cb1cf-cfb8-41cb-8337-52586061c47c", "address": "fa:16:3e:c5:79:7a", "network": {"id": "1c3d3d85-5e15-4b5a-9671-acca5de739d8", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-413087253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dc6ab7d6975429083681f5807a78f08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape85cb1cf-cf", "ovs_interfaceid": "e85cb1cf-cfb8-41cb-8337-52586061c47c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 10:26:18 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-7a2f17aa-9f17-4dcc-9cb2-c299d4325738 req-f1ec1efa-2fd1-4229-86f9-57222878480d service nova] Releasing lock "refresh_cache-2a337f4a-327c-4f68-b57b-ced92c9f0785" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 10:26:20 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:26:20 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-9e2e8bcd-29f5-442c-abe8-40a71ddf08a6 tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Acquiring lock "2a337f4a-327c-4f68-b57b-ced92c9f0785" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:26:20 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-9e2e8bcd-29f5-442c-abe8-40a71ddf08a6 tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Lock "2a337f4a-327c-4f68-b57b-ced92c9f0785" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:26:20 user nova-compute[75122]: DEBUG nova.objects.instance [None req-9e2e8bcd-29f5-442c-abe8-40a71ddf08a6 tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Lazy-loading 'flavor' on Instance uuid 2a337f4a-327c-4f68-b57b-ced92c9f0785 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 10:26:20 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-9e2e8bcd-29f5-442c-abe8-40a71ddf08a6 tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Lock "2a337f4a-327c-4f68-b57b-ced92c9f0785" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:26:21 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-9e2e8bcd-29f5-442c-abe8-40a71ddf08a6 tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Acquiring lock "2a337f4a-327c-4f68-b57b-ced92c9f0785" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:26:21 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-9e2e8bcd-29f5-442c-abe8-40a71ddf08a6 tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Lock "2a337f4a-327c-4f68-b57b-ced92c9f0785" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:26:21 user nova-compute[75122]: INFO nova.compute.manager [None req-9e2e8bcd-29f5-442c-abe8-40a71ddf08a6 tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] [instance: 2a337f4a-327c-4f68-b57b-ced92c9f0785] Attaching volume a700adde-8961-420a-989c-8db94ea1a66d to /dev/vdb
Nov 15 10:26:21 user nova-compute[75122]: DEBUG os_brick.utils [None req-9e2e8bcd-29f5-442c-abe8-40a71ddf08a6 tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 10:26:21 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:26:21 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:26:21 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[68d44001-e2f6-45a5-8008-bdf20319c8ac]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:742fb64b3587\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:26:21 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:26:21 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:26:21 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb487a12-f055-4b90-88bb-a0b7d4ea2218]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:26:21 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:26:21 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:26:21 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[68df14a7-1bdc-460f-8f84-86b8e0f6763d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:26:21 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fff4d12-5879-4643-a576-9c351a830ebd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:26:21 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-9e2e8bcd-29f5-442c-abe8-40a71ddf08a6 tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Running cmd (subprocess): nvme version {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:26:21 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-9e2e8bcd-29f5-442c-abe8-40a71ddf08a6 tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] 'nvme version' failed. Not Retrying. {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 10:26:21 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9e2e8bcd-29f5-442c-abe8-40a71ddf08a6 tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] nvme not present on system {{(pid=75122) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 10:26:21 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:26:21 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 10:26:21 user nova-compute[75122]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 10:26:21 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[eea6ebe3-586d-4ec2-8f0e-fd6de1c246bb]: (4, '') {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:26:21 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.lightos [None req-9e2e8bcd-29f5-442c-abe8-40a71ddf08a6 tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75122) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 10:26:21 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.lightos [None req-9e2e8bcd-29f5-442c-abe8-40a71ddf08a6 tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75122) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 10:26:21 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.lightos [None req-9e2e8bcd-29f5-442c-abe8-40a71ddf08a6 tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] LIGHTOS: no hostnqn found. {{(pid=75122) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 10:26:21 user nova-compute[75122]: DEBUG os_brick.utils [None req-9e2e8bcd-29f5-442c-abe8-40a71ddf08a6 tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:742fb64b3587', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 10:26:21 user nova-compute[75122]: DEBUG nova.virt.block_device [None req-9e2e8bcd-29f5-442c-abe8-40a71ddf08a6 tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] [instance: 2a337f4a-327c-4f68-b57b-ced92c9f0785] Updating existing volume attachment record: 0b23be33-0775-46b6-9ad6-04b9f6b4a447 {{(pid=75122) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 10:26:22 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:26:25 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:26:25 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9e2e8bcd-29f5-442c-abe8-40a71ddf08a6 tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] [instance: 2a337f4a-327c-4f68-b57b-ced92c9f0785] Calling os-brick to attach iSCSI Volume {{(pid=75122) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 10:26:25 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e2e8bcd-29f5-442c-abe8-40a71ddf08a6 tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffa04060b80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a700adde-8961-420a-989c-8db94ea1a66d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WucdGwFg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 10:26:25 user nova-compute[75122]: WARNING os_brick.initiator.connectors.base [None req-9e2e8bcd-29f5-442c-abe8-40a71ddf08a6 tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 10:26:25 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-9e2e8bcd-29f5-442c-abe8-40a71ddf08a6 tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 10:26:25 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-9e2e8bcd-29f5-442c-abe8-40a71ddf08a6 tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 10:26:25 user nova-compute[75122]: WARNING os_brick.initiator.connectors.base [None req-9e2e8bcd-29f5-442c-abe8-40a71ddf08a6 tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 10:26:25 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-9e2e8bcd-29f5-442c-abe8-40a71ddf08a6 tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a700adde-8961-420a-989c-8db94ea1a66d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 10:26:25 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-9e2e8bcd-29f5-442c-abe8-40a71ddf08a6 tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a700adde-8961-420a-989c-8db94ea1a66d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 10:26:25 user nova-compute[75122]: INFO os_brick.initiator.connectors.iscsi [None req-9e2e8bcd-29f5-442c-abe8-40a71ddf08a6 tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 10:26:25 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a700adde-8961-420a-989c-8db94ea1a66d -p 172.16.0.220:3260 {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:26:25 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a700adde-8961-420a-989c-8db94ea1a66d -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:26:25 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba9b78da-f5e3-4836-9f70-ecc95d333696]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:26:25 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e2e8bcd-29f5-442c-abe8-40a71ddf08a6 tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 10:26:25 user nova-compute[75122]:  {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 10:26:25 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a700adde-8961-420a-989c-8db94ea1a66d -p 172.16.0.220:3260 --interface default --op new {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:26:25 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a700adde-8961-420a-989c-8db94ea1a66d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:26:25 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3f9c65b-42b7-4300-b70e-c2a4e5970515]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a700adde-8961-420a-989c-8db94ea1a66d] added\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:26:25 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e2e8bcd-29f5-442c-abe8-40a71ddf08a6 tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a700adde-8961-420a-989c-8db94ea1a66d] added
Nov 15 10:26:25 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 10:26:25 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a700adde-8961-420a-989c-8db94ea1a66d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:26:25 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a700adde-8961-420a-989c-8db94ea1a66d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:26:25 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f3ef4cd-07f2-44a0-b916-5f27834605d0]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:26:25 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e2e8bcd-29f5-442c-abe8-40a71ddf08a6 tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 10:26:25 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a700adde-8961-420a-989c-8db94ea1a66d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:26:25 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a700adde-8961-420a-989c-8db94ea1a66d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:26:25 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[2add0e97-10d9-4182-92a5-5dec8637170a]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:26:25 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e2e8bcd-29f5-442c-abe8-40a71ddf08a6 tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 10:26:25 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a700adde-8961-420a-989c-8db94ea1a66d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WucdGwFg {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:26:25 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a700adde-8961-420a-989c-8db94ea1a66d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WucdGwFg" returned: 0 in 0.017s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:26:25 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a2d2c47-f7b0-4239-b08e-7e1260a27fbe]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:26:25 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e2e8bcd-29f5-442c-abe8-40a71ddf08a6 tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WucdGwFg'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 10:26:25 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a700adde-8961-420a-989c-8db94ea1a66d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:26:25 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a700adde-8961-420a-989c-8db94ea1a66d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:26:25 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[cac25a6f-6461-4db5-b160-ac8bd7b0488b]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:26:25 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e2e8bcd-29f5-442c-abe8-40a71ddf08a6 tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 10:26:25 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:26:25 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:26:25 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d13cd26-3aff-435e-a723-b372cd9c8a52]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:26:25 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e2e8bcd-29f5-442c-abe8-40a71ddf08a6 tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 15 10:26:25 user nova-compute[75122]:  {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 10:26:25 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e2e8bcd-29f5-442c-abe8-40a71ddf08a6 tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 15 10:26:25 user nova-compute[75122]:  {{(pid=75122) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 10:26:25 user nova-compute[75122]: WARNING os_brick.initiator.connectors.iscsi [None req-9e2e8bcd-29f5-442c-abe8-40a71ddf08a6 tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 15 10:26:25 user nova-compute[75122]: 
Nov 15 10:26:25 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a700adde-8961-420a-989c-8db94ea1a66d -p 172.16.0.220:3260 --login {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:26:25 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a700adde-8961-420a-989c-8db94ea1a66d -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:26:25 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ae4a7ee-44cb-4f67-b273-2522d4331e2c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a700adde-8961-420a-989c-8db94ea1a66d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a700adde-8961-420a-989c-8db94ea1a66d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:26:25 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e2e8bcd-29f5-442c-abe8-40a71ddf08a6 tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a700adde-8961-420a-989c-8db94ea1a66d, portal: 172.16.0.220,3260]
Nov 15 10:26:25 user nova-compute[75122]: Login to [iface: default, target: iqn.2010-10.org.openstack:a700adde-8961-420a-989c-8db94ea1a66d, portal: 172.16.0.220,3260] successful.
Nov 15 10:26:25 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 10:26:25 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a700adde-8961-420a-989c-8db94ea1a66d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:26:25 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a700adde-8961-420a-989c-8db94ea1a66d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:26:25 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3bd8f16-9722-4697-bc7d-e3b40daf71e8]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:26:25 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e2e8bcd-29f5-442c-abe8-40a71ddf08a6 tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 10:26:25 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:26:25 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:26:25 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[58668db2-2abb-44ca-988c-4cf8cbf3db82]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a700adde-8961-420a-989c-8db94ea1a66d (non-flash)\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:26:25 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e2e8bcd-29f5-442c-abe8-40a71ddf08a6 tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a700adde-8961-420a-989c-8db94ea1a66d (non-flash)
Nov 15 10:26:25 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 10:26:25 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e2e8bcd-29f5-442c-abe8-40a71ddf08a6 tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a700adde-8961-420a-989c-8db94ea1a66d (non-flash)
Nov 15 10:26:25 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 10:26:25 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-9e2e8bcd-29f5-442c-abe8-40a71ddf08a6 tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a700adde-8961-420a-989c-8db94ea1a66d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.237s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 10:26:25 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e2e8bcd-29f5-442c-abe8-40a71ddf08a6 tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Connected to 172.16.0.220:3260 {{(pid=75122) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 10:26:25 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-9e2e8bcd-29f5-442c-abe8-40a71ddf08a6 tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] HCTL ('33', '-', '-', 0) found on session 67 with lun 0 {{(pid=75122) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 10:26:25 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-9e2e8bcd-29f5-442c-abe8-40a71ddf08a6 tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75122) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 10:26:25 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:26:26 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:26:26 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2eb5698-ad6c-4535-b40b-d4f9c11065e9]: (4, ('- - 0', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:26:26 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-9e2e8bcd-29f5-442c-abe8-40a71ddf08a6 tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Searching for a device in session 67 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75122) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 10:26:26 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e2e8bcd-29f5-442c-abe8-40a71ddf08a6 tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:a700adde-8961-420a-989c-8db94ea1a66d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WucdGwFg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75122) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 10:26:27 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-9e2e8bcd-29f5-442c-abe8-40a71ddf08a6 tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.267s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 10:26:27 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e2e8bcd-29f5-442c-abe8-40a71ddf08a6 tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] <== connect_volume: return (1269ms) {'type': 'block', 'scsi_wwn': '26362313835343532', 'path': '/dev/sdb'} {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 10:26:27 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9e2e8bcd-29f5-442c-abe8-40a71ddf08a6 tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] [instance: 2a337f4a-327c-4f68-b57b-ced92c9f0785] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26362313835343532', 'path': '/dev/sdb'} {{(pid=75122) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 10:26:27 user nova-compute[75122]: DEBUG nova.objects.instance [None req-9e2e8bcd-29f5-442c-abe8-40a71ddf08a6 tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Lazy-loading 'flavor' on Instance uuid 2a337f4a-327c-4f68-b57b-ced92c9f0785 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 10:26:27 user nova-compute[75122]: DEBUG nova.virt.libvirt.guest [None req-9e2e8bcd-29f5-442c-abe8-40a71ddf08a6 tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 10:26:27 user nova-compute[75122]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 10:26:27 user nova-compute[75122]:   <source dev="/dev/sdb"/>
Nov 15 10:26:27 user nova-compute[75122]:   <target dev="vdb" bus="virtio"/>
Nov 15 10:26:27 user nova-compute[75122]:   <serial>a700adde-8961-420a-989c-8db94ea1a66d</serial>
Nov 15 10:26:27 user nova-compute[75122]: </disk>
Nov 15 10:26:27 user nova-compute[75122]:  {{(pid=75122) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 10:26:27 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:26:27 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-9e2e8bcd-29f5-442c-abe8-40a71ddf08a6 tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] No BDM found with device name vda, not building metadata. {{(pid=75122) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 10:26:27 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-9e2e8bcd-29f5-442c-abe8-40a71ddf08a6 tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75122) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 10:26:27 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-9e2e8bcd-29f5-442c-abe8-40a71ddf08a6 tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] No VIF found with MAC fa:16:3e:c5:79:7a, not building metadata {{(pid=75122) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 10:26:27 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-9e2e8bcd-29f5-442c-abe8-40a71ddf08a6 tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Lock "2a337f4a-327c-4f68-b57b-ced92c9f0785" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.577s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:26:30 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:26:32 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:26:35 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:26:37 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:26:38 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-dfab0ca0-8787-4e8e-a8f9-bc62e64a22cd tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Acquiring lock "2a337f4a-327c-4f68-b57b-ced92c9f0785" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:26:38 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-dfab0ca0-8787-4e8e-a8f9-bc62e64a22cd tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Lock "2a337f4a-327c-4f68-b57b-ced92c9f0785" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:26:38 user nova-compute[75122]: INFO nova.compute.manager [None req-dfab0ca0-8787-4e8e-a8f9-bc62e64a22cd tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] [instance: 2a337f4a-327c-4f68-b57b-ced92c9f0785] Detaching volume a700adde-8961-420a-989c-8db94ea1a66d
Nov 15 10:26:39 user nova-compute[75122]: INFO nova.virt.block_device [None req-dfab0ca0-8787-4e8e-a8f9-bc62e64a22cd tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] [instance: 2a337f4a-327c-4f68-b57b-ced92c9f0785] Attempting to driver detach volume a700adde-8961-420a-989c-8db94ea1a66d from mountpoint /dev/vdb
Nov 15 10:26:39 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-dfab0ca0-8787-4e8e-a8f9-bc62e64a22cd tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Attempting to detach device vdb from instance 2a337f4a-327c-4f68-b57b-ced92c9f0785 from the persistent domain config. {{(pid=75122) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 10:26:39 user nova-compute[75122]: DEBUG nova.virt.libvirt.guest [None req-dfab0ca0-8787-4e8e-a8f9-bc62e64a22cd tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 10:26:39 user nova-compute[75122]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 10:26:39 user nova-compute[75122]:   <source dev="/dev/sdb"/>
Nov 15 10:26:39 user nova-compute[75122]:   <target dev="vdb" bus="virtio"/>
Nov 15 10:26:39 user nova-compute[75122]:   <serial>a700adde-8961-420a-989c-8db94ea1a66d</serial>
Nov 15 10:26:39 user nova-compute[75122]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 10:26:39 user nova-compute[75122]: </disk>
Nov 15 10:26:39 user nova-compute[75122]:  {{(pid=75122) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 10:26:39 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-dfab0ca0-8787-4e8e-a8f9-bc62e64a22cd tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Successfully detached device vdb from instance 2a337f4a-327c-4f68-b57b-ced92c9f0785 from the persistent domain config.
Nov 15 10:26:39 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-dfab0ca0-8787-4e8e-a8f9-bc62e64a22cd tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2a337f4a-327c-4f68-b57b-ced92c9f0785 from the live domain config. {{(pid=75122) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 10:26:39 user nova-compute[75122]: DEBUG nova.virt.libvirt.guest [None req-dfab0ca0-8787-4e8e-a8f9-bc62e64a22cd tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 10:26:39 user nova-compute[75122]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 10:26:39 user nova-compute[75122]:   <source dev="/dev/sdb"/>
Nov 15 10:26:39 user nova-compute[75122]:   <target dev="vdb" bus="virtio"/>
Nov 15 10:26:39 user nova-compute[75122]:   <serial>a700adde-8961-420a-989c-8db94ea1a66d</serial>
Nov 15 10:26:39 user nova-compute[75122]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 10:26:39 user nova-compute[75122]: </disk>
Nov 15 10:26:39 user nova-compute[75122]:  {{(pid=75122) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 10:26:39 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-dfab0ca0-8787-4e8e-a8f9-bc62e64a22cd tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2a337f4a-327c-4f68-b57b-ced92c9f0785 {{(pid=75122) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 10:26:40 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:26:45 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:26:50 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:26:52 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:26:52 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:26:55 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:26:58 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:26:59 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:26:59 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-dfab0ca0-8787-4e8e-a8f9-bc62e64a22cd tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 2a337f4a-327c-4f68-b57b-ced92c9f0785 is timed out.
Nov 15 10:26:59 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-dfab0ca0-8787-4e8e-a8f9-bc62e64a22cd tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Successfully detached device vdb from instance 2a337f4a-327c-4f68-b57b-ced92c9f0785 from the live domain config.
Nov 15 10:26:59 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dfab0ca0-8787-4e8e-a8f9-bc62e64a22cd tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] [instance: 2a337f4a-327c-4f68-b57b-ced92c9f0785] calling os-brick to detach iSCSI Volume {{(pid=75122) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 10:26:59 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfab0ca0-8787-4e8e-a8f9-bc62e64a22cd tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffa04060b80>, {'target_iqn': 'iqn.2010-10.org.openstack:a700adde-8961-420a-989c-8db94ea1a66d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WucdGwFg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 10:26:59 user nova-compute[75122]: WARNING os_brick.initiator.connectors.base [None req-dfab0ca0-8787-4e8e-a8f9-bc62e64a22cd tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 10:26:59 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-dfab0ca0-8787-4e8e-a8f9-bc62e64a22cd tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 10:26:59 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-dfab0ca0-8787-4e8e-a8f9-bc62e64a22cd tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 10:26:59 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:26:59 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:26:59 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[df04e87c-ef1f-49cc-954c-ebcf6d8d7be4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a700adde-8961-420a-989c-8db94ea1a66d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:26:59 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfab0ca0-8787-4e8e-a8f9-bc62e64a22cd tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 10:26:59 user nova-compute[75122]: No targets found.
Nov 15 10:26:59 user nova-compute[75122]: iSNS:
Nov 15 10:26:59 user nova-compute[75122]: No targets found.
Nov 15 10:26:59 user nova-compute[75122]: STATIC:
Nov 15 10:26:59 user nova-compute[75122]: Target: iqn.2010-10.org.openstack:a700adde-8961-420a-989c-8db94ea1a66d
Nov 15 10:26:59 user nova-compute[75122]:         Portal: 172.16.0.220:3260,-1
Nov 15 10:26:59 user nova-compute[75122]:                 Iface Name: default
Nov 15 10:26:59 user nova-compute[75122]: FIRMWARE:
Nov 15 10:26:59 user nova-compute[75122]: No targets found.
Nov 15 10:26:59 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 10:26:59 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfab0ca0-8787-4e8e-a8f9-bc62e64a22cd tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 10:26:59 user nova-compute[75122]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 10:26:59 user nova-compute[75122]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75122) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 10:26:59 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfab0ca0-8787-4e8e-a8f9-bc62e64a22cd tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a700adde-8961-420a-989c-8db94ea1a66d', 0)] {{(pid=75122) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 10:26:59 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:26:59 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:26:59 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fea8242-8988-4422-81dc-1365f88e47e8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a700adde-8961-420a-989c-8db94ea1a66d\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:26:59 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:26:59 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:26:59 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[00b64db7-b860-45a5-9a68-838ac2977a5b]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a700adde-8961-420a-989c-8db94ea1a66d (non-flash)\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:26:59 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfab0ca0-8787-4e8e-a8f9-bc62e64a22cd tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a700adde-8961-420a-989c-8db94ea1a66d (non-flash)
Nov 15 10:26:59 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 10:26:59 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfab0ca0-8787-4e8e-a8f9-bc62e64a22cd tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a700adde-8961-420a-989c-8db94ea1a66d (non-flash)
Nov 15 10:26:59 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 10:26:59 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfab0ca0-8787-4e8e-a8f9-bc62e64a22cd tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff9fc3d43a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a700adde-8961-420a-989c-8db94ea1a66d'): ({'sdb'}, set())}) {{(pid=75122) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 10:26:59 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-dfab0ca0-8787-4e8e-a8f9-bc62e64a22cd tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Removing single pathed devices sdb {{(pid=75122) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 10:26:59 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:26:59 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:26:59 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3cc6cd8-3426-4ca7-a17b-35e57b80cfd3]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:26:59 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:26:59 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:26:59 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f3a4e77-0195-44d9-9c8c-ac754018e363]: (4, ('ok\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:26:59 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-dfab0ca0-8787-4e8e-a8f9-bc62e64a22cd tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Flushing IO for device /dev/sdb {{(pid=75122) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 10:26:59 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:26:59 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:26:59 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b8e34c7-4724-4715-ae10-1528c3652350]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:26:59 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-dfab0ca0-8787-4e8e-a8f9-bc62e64a22cd tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75122) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 10:26:59 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:26:59 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:26:59 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef36bfd3-d542-44ad-9c05-02cb5df53bc3]: (4, ('1', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:26:59 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-dfab0ca0-8787-4e8e-a8f9-bc62e64a22cd tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75122) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 10:26:59 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-dfab0ca0-8787-4e8e-a8f9-bc62e64a22cd tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] SCSI volumes sdb have been removed. {{(pid=75122) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 10:26:59 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfab0ca0-8787-4e8e-a8f9-bc62e64a22cd tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a700adde-8961-420a-989c-8db94ea1a66d')] {{(pid=75122) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 10:26:59 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a700adde-8961-420a-989c-8db94ea1a66d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:26:59 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a700adde-8961-420a-989c-8db94ea1a66d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:26:59 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[a241d00a-dbeb-4227-bab4-03d2fc4fa797]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:26:59 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfab0ca0-8787-4e8e-a8f9-bc62e64a22cd tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 10:26:59 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a700adde-8961-420a-989c-8db94ea1a66d -p 172.16.0.220:3260 --logout {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:26:59 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a700adde-8961-420a-989c-8db94ea1a66d -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:26:59 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[46868b0d-ae42-4111-b205-d4f45dc848d0]: (4, ('Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:a700adde-8961-420a-989c-8db94ea1a66d, portal: 172.16.0.220,3260]\nLogout of [sid: 67, target: iqn.2010-10.org.openstack:a700adde-8961-420a-989c-8db94ea1a66d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:26:59 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfab0ca0-8787-4e8e-a8f9-bc62e64a22cd tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:a700adde-8961-420a-989c-8db94ea1a66d, portal: 172.16.0.220,3260]
Nov 15 10:26:59 user nova-compute[75122]: Logout of [sid: 67, target: iqn.2010-10.org.openstack:a700adde-8961-420a-989c-8db94ea1a66d, portal: 172.16.0.220,3260] successful.
Nov 15 10:26:59 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 10:26:59 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a700adde-8961-420a-989c-8db94ea1a66d -p 172.16.0.220:3260 --op delete {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:26:59 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a700adde-8961-420a-989c-8db94ea1a66d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:26:59 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[da40880a-a4e3-4c81-8630-e6426246944a]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:26:59 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfab0ca0-8787-4e8e-a8f9-bc62e64a22cd tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 10:26:59 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-dfab0ca0-8787-4e8e-a8f9-bc62e64a22cd tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.265s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 10:26:59 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfab0ca0-8787-4e8e-a8f9-bc62e64a22cd tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] <== disconnect_volume: return (267ms) None {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 10:26:59 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dfab0ca0-8787-4e8e-a8f9-bc62e64a22cd tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] [instance: 2a337f4a-327c-4f68-b57b-ced92c9f0785] Disconnected iSCSI Volume {{(pid=75122) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 10:27:00 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:27:00 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:27:00 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:27:00 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:27:00 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75122) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 10:27:00 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a337f4a-327c-4f68-b57b-ced92c9f0785/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:27:00 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:27:00 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a337f4a-327c-4f68-b57b-ced92c9f0785/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:27:00 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a337f4a-327c-4f68-b57b-ced92c9f0785/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:27:00 user nova-compute[75122]: DEBUG nova.objects.instance [None req-dfab0ca0-8787-4e8e-a8f9-bc62e64a22cd tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Lazy-loading 'flavor' on Instance uuid 2a337f4a-327c-4f68-b57b-ced92c9f0785 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 10:27:00 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-dfab0ca0-8787-4e8e-a8f9-bc62e64a22cd tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Lock "2a337f4a-327c-4f68-b57b-ced92c9f0785" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.628s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:27:00 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a337f4a-327c-4f68-b57b-ced92c9f0785/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:27:00 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 10:27:00 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 10:27:00 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Hypervisor/Node resource view: name=user free_ram=8971MB free_disk=25.02752685546875GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75122) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 10:27:00 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:27:00 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:27:01 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance 2a337f4a-327c-4f68-b57b-ced92c9f0785 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 10:27:01 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75122) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 10:27:01 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75122) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 10:27:01 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Refreshing inventories for resource provider 69a3da65-47be-44c6-b67c-c692b58284ef {{(pid=75122) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 15 10:27:01 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Updating ProviderTree inventory for provider 69a3da65-47be-44c6-b67c-c692b58284ef from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 15 10:27:01 user nova-compute[75122]: DEBUG nova.compute.provider_tree [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Updating inventory in ProviderTree for provider 69a3da65-47be-44c6-b67c-c692b58284ef with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 15 10:27:01 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Refreshing aggregate associations for resource provider 69a3da65-47be-44c6-b67c-c692b58284ef, aggregates: None {{(pid=75122) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 15 10:27:01 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Refreshing trait associations for resource provider 69a3da65-47be-44c6-b67c-c692b58284ef, traits: COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_RESCUE_BFV,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE,COMPUTE_NODE,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_ACCELERATORS,HW_CPU_X86_MMX {{(pid=75122) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 15 10:27:01 user nova-compute[75122]: DEBUG nova.compute.provider_tree [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Inventory has not changed in ProviderTree for provider: 69a3da65-47be-44c6-b67c-c692b58284ef {{(pid=75122) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 10:27:01 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Inventory has not changed for provider 69a3da65-47be-44c6-b67c-c692b58284ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 10:27:01 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Compute_service record updated for user:user {{(pid=75122) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 10:27:01 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.290s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:27:02 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:27:04 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:27:05 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:27:05 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:27:05 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75122) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 10:27:05 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75122) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 10:27:05 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75122) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 10:27:05 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:27:06 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:27:06 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Starting heal instance info cache {{(pid=75122) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 10:27:06 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Rebuilding the list of instances to heal {{(pid=75122) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 10:27:06 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "refresh_cache-2a337f4a-327c-4f68-b57b-ced92c9f0785" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 10:27:06 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquired lock "refresh_cache-2a337f4a-327c-4f68-b57b-ced92c9f0785" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 10:27:06 user nova-compute[75122]: DEBUG nova.network.neutron [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] [instance: 2a337f4a-327c-4f68-b57b-ced92c9f0785] Forcefully refreshing network info cache for instance {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 10:27:06 user nova-compute[75122]: DEBUG nova.objects.instance [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lazy-loading 'info_cache' on Instance uuid 2a337f4a-327c-4f68-b57b-ced92c9f0785 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 10:27:06 user nova-compute[75122]: DEBUG nova.network.neutron [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] [instance: 2a337f4a-327c-4f68-b57b-ced92c9f0785] Updating instance_info_cache with network_info: [{"id": "e85cb1cf-cfb8-41cb-8337-52586061c47c", "address": "fa:16:3e:c5:79:7a", "network": {"id": "1c3d3d85-5e15-4b5a-9671-acca5de739d8", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-413087253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dc6ab7d6975429083681f5807a78f08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape85cb1cf-cf", "ovs_interfaceid": "e85cb1cf-cfb8-41cb-8337-52586061c47c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 10:27:06 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Releasing lock "refresh_cache-2a337f4a-327c-4f68-b57b-ced92c9f0785" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 10:27:06 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] [instance: 2a337f4a-327c-4f68-b57b-ced92c9f0785] Updated the network info_cache for instance {{(pid=75122) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 10:27:08 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:27:08 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:27:08 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Cleaning up deleted instances {{(pid=75122) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 15 10:27:08 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] There are 0 instances to clean {{(pid=75122) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 15 10:27:10 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:27:10 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:27:10 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:27:10 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75122) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 10:27:10 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75122) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 10:27:10 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75122) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 10:27:10 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:27:13 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:27:13 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75122) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 10:27:15 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:27:16 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:27:20 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:27:21 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:27:22 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:27:22 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75122) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 15 10:27:25 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:27:30 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:27:30 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:27:30 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75122) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 10:27:30 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75122) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 10:27:30 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75122) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 10:27:30 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:27:30 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-4d8c266a-ff1b-40b4-8bc9-9e692e537eed tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Acquiring lock "2a337f4a-327c-4f68-b57b-ced92c9f0785" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:27:30 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-4d8c266a-ff1b-40b4-8bc9-9e692e537eed tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Lock "2a337f4a-327c-4f68-b57b-ced92c9f0785" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:27:30 user nova-compute[75122]: DEBUG nova.objects.instance [None req-4d8c266a-ff1b-40b4-8bc9-9e692e537eed tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Lazy-loading 'flavor' on Instance uuid 2a337f4a-327c-4f68-b57b-ced92c9f0785 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 10:27:31 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-4d8c266a-ff1b-40b4-8bc9-9e692e537eed tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Lock "2a337f4a-327c-4f68-b57b-ced92c9f0785" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:27:31 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-4d8c266a-ff1b-40b4-8bc9-9e692e537eed tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Acquiring lock "2a337f4a-327c-4f68-b57b-ced92c9f0785" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:27:31 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-4d8c266a-ff1b-40b4-8bc9-9e692e537eed tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Lock "2a337f4a-327c-4f68-b57b-ced92c9f0785" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:27:31 user nova-compute[75122]: INFO nova.compute.manager [None req-4d8c266a-ff1b-40b4-8bc9-9e692e537eed tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] [instance: 2a337f4a-327c-4f68-b57b-ced92c9f0785] Attaching volume 50695d0c-f3a7-4319-a032-868b9540dc3c to /dev/vdb
Nov 15 10:27:31 user nova-compute[75122]: DEBUG os_brick.utils [None req-4d8c266a-ff1b-40b4-8bc9-9e692e537eed tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 10:27:31 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:27:31 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:27:31 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd5c43ff-5f5c-4de4-a118-388c8b39ae9a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:742fb64b3587\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:27:31 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:27:31 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:27:31 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ff274b7-f08c-4978-a2d4-83aa100c5df3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:27:31 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:27:31 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.025s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:27:31 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[18d5d7ba-c932-493f-938d-9690fe4a8c93]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:27:31 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[f46cf5f2-3da3-41ab-a2c0-95f6b2a2a5c5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:27:31 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-4d8c266a-ff1b-40b4-8bc9-9e692e537eed tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Running cmd (subprocess): nvme version {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:27:31 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-4d8c266a-ff1b-40b4-8bc9-9e692e537eed tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] 'nvme version' failed. Not Retrying. {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 10:27:31 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4d8c266a-ff1b-40b4-8bc9-9e692e537eed tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] nvme not present on system {{(pid=75122) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 10:27:31 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:27:31 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 10:27:31 user nova-compute[75122]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 10:27:31 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[357fe065-3466-4cac-9f72-f7e611d15913]: (4, '') {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:27:31 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.lightos [None req-4d8c266a-ff1b-40b4-8bc9-9e692e537eed tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75122) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 10:27:31 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.lightos [None req-4d8c266a-ff1b-40b4-8bc9-9e692e537eed tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75122) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 10:27:31 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.lightos [None req-4d8c266a-ff1b-40b4-8bc9-9e692e537eed tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] LIGHTOS: no hostnqn found. {{(pid=75122) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 10:27:31 user nova-compute[75122]: DEBUG os_brick.utils [None req-4d8c266a-ff1b-40b4-8bc9-9e692e537eed tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:742fb64b3587', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 10:27:31 user nova-compute[75122]: DEBUG nova.virt.block_device [None req-4d8c266a-ff1b-40b4-8bc9-9e692e537eed tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] [instance: 2a337f4a-327c-4f68-b57b-ced92c9f0785] Updating existing volume attachment record: 8e45de82-68dd-458a-8c68-74b9a023d081 {{(pid=75122) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 10:27:32 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:27:35 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:27:35 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d8c266a-ff1b-40b4-8bc9-9e692e537eed tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] [instance: 2a337f4a-327c-4f68-b57b-ced92c9f0785] Calling os-brick to attach iSCSI Volume {{(pid=75122) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 10:27:35 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d8c266a-ff1b-40b4-8bc9-9e692e537eed tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffa04060b80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:50695d0c-f3a7-4319-a032-868b9540dc3c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lukoFdUi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 10:27:35 user nova-compute[75122]: WARNING os_brick.initiator.connectors.base [None req-4d8c266a-ff1b-40b4-8bc9-9e692e537eed tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 10:27:35 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-4d8c266a-ff1b-40b4-8bc9-9e692e537eed tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 10:27:35 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-4d8c266a-ff1b-40b4-8bc9-9e692e537eed tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 10:27:35 user nova-compute[75122]: WARNING os_brick.initiator.connectors.base [None req-4d8c266a-ff1b-40b4-8bc9-9e692e537eed tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 10:27:35 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-4d8c266a-ff1b-40b4-8bc9-9e692e537eed tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:50695d0c-f3a7-4319-a032-868b9540dc3c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 10:27:35 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-4d8c266a-ff1b-40b4-8bc9-9e692e537eed tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:50695d0c-f3a7-4319-a032-868b9540dc3c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 10:27:35 user nova-compute[75122]: INFO os_brick.initiator.connectors.iscsi [None req-4d8c266a-ff1b-40b4-8bc9-9e692e537eed tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 10:27:35 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50695d0c-f3a7-4319-a032-868b9540dc3c -p 172.16.0.220:3260 {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:27:35 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50695d0c-f3a7-4319-a032-868b9540dc3c -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:27:35 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[dab8e0c6-e9fe-4e3c-ad29-458c07942d38]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:27:35 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d8c266a-ff1b-40b4-8bc9-9e692e537eed tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 10:27:35 user nova-compute[75122]:  {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 10:27:35 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50695d0c-f3a7-4319-a032-868b9540dc3c -p 172.16.0.220:3260 --interface default --op new {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:27:35 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50695d0c-f3a7-4319-a032-868b9540dc3c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:27:35 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[257b9b81-028c-4418-9253-cc4825b547fa]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:50695d0c-f3a7-4319-a032-868b9540dc3c] added\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:27:35 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d8c266a-ff1b-40b4-8bc9-9e692e537eed tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:50695d0c-f3a7-4319-a032-868b9540dc3c] added
Nov 15 10:27:35 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 10:27:35 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50695d0c-f3a7-4319-a032-868b9540dc3c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:27:35 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50695d0c-f3a7-4319-a032-868b9540dc3c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:27:35 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[a395217f-f9f3-42ec-9f38-0206a3018fa1]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:27:35 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d8c266a-ff1b-40b4-8bc9-9e692e537eed tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 10:27:35 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50695d0c-f3a7-4319-a032-868b9540dc3c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:27:35 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50695d0c-f3a7-4319-a032-868b9540dc3c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:27:35 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb8bd796-e39f-415e-8694-1aeabb6f878a]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:27:35 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d8c266a-ff1b-40b4-8bc9-9e692e537eed tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 10:27:35 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50695d0c-f3a7-4319-a032-868b9540dc3c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lukoFdUi {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:27:35 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50695d0c-f3a7-4319-a032-868b9540dc3c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lukoFdUi" returned: 0 in 0.016s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:27:35 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab2a0b48-49c0-4113-b4da-8d20ee6a3686]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:27:35 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d8c266a-ff1b-40b4-8bc9-9e692e537eed tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lukoFdUi'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 10:27:35 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50695d0c-f3a7-4319-a032-868b9540dc3c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:27:35 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50695d0c-f3a7-4319-a032-868b9540dc3c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:27:35 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[754afbfc-1dc0-42e2-9fd3-1eec3442b1e8]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:27:35 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d8c266a-ff1b-40b4-8bc9-9e692e537eed tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 10:27:35 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:27:35 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:27:35 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[65907fb6-da3c-4c5b-883a-532971fc2199]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:27:35 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d8c266a-ff1b-40b4-8bc9-9e692e537eed tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 15 10:27:35 user nova-compute[75122]:  {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 10:27:35 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d8c266a-ff1b-40b4-8bc9-9e692e537eed tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 15 10:27:35 user nova-compute[75122]:  {{(pid=75122) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 10:27:35 user nova-compute[75122]: WARNING os_brick.initiator.connectors.iscsi [None req-4d8c266a-ff1b-40b4-8bc9-9e692e537eed tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 15 10:27:35 user nova-compute[75122]: 
Nov 15 10:27:35 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50695d0c-f3a7-4319-a032-868b9540dc3c -p 172.16.0.220:3260 --login {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:27:35 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50695d0c-f3a7-4319-a032-868b9540dc3c -p 172.16.0.220:3260 --login" returned: 0 in 0.041s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:27:35 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6079147-6ec1-4297-864c-90967cfcb4ba]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:50695d0c-f3a7-4319-a032-868b9540dc3c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:50695d0c-f3a7-4319-a032-868b9540dc3c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:27:35 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d8c266a-ff1b-40b4-8bc9-9e692e537eed tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:50695d0c-f3a7-4319-a032-868b9540dc3c, portal: 172.16.0.220,3260]
Nov 15 10:27:35 user nova-compute[75122]: Login to [iface: default, target: iqn.2010-10.org.openstack:50695d0c-f3a7-4319-a032-868b9540dc3c, portal: 172.16.0.220,3260] successful.
Nov 15 10:27:35 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 10:27:35 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50695d0c-f3a7-4319-a032-868b9540dc3c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:27:35 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50695d0c-f3a7-4319-a032-868b9540dc3c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:27:35 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[db417145-8234-4a13-bdf0-51c1ec698815]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:27:35 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d8c266a-ff1b-40b4-8bc9-9e692e537eed tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 10:27:35 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:27:35 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:27:35 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[71049384-2d82-4b36-89e5-b6c2b93fbe8f]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50695d0c-f3a7-4319-a032-868b9540dc3c (non-flash)\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:27:35 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d8c266a-ff1b-40b4-8bc9-9e692e537eed tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50695d0c-f3a7-4319-a032-868b9540dc3c (non-flash)
Nov 15 10:27:35 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 10:27:35 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d8c266a-ff1b-40b4-8bc9-9e692e537eed tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50695d0c-f3a7-4319-a032-868b9540dc3c (non-flash)
Nov 15 10:27:35 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 10:27:35 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-4d8c266a-ff1b-40b4-8bc9-9e692e537eed tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:50695d0c-f3a7-4319-a032-868b9540dc3c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.225s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 10:27:35 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d8c266a-ff1b-40b4-8bc9-9e692e537eed tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Connected to 172.16.0.220:3260 {{(pid=75122) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 10:27:35 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-4d8c266a-ff1b-40b4-8bc9-9e692e537eed tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] HCTL ('33', '-', '-', 0) found on session 68 with lun 0 {{(pid=75122) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 10:27:35 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-4d8c266a-ff1b-40b4-8bc9-9e692e537eed tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75122) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 10:27:35 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:27:35 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:27:35 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cb89a27-4c2e-4f71-a4ab-7653c12e0dd8]: (4, ('- - 0', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:27:35 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-4d8c266a-ff1b-40b4-8bc9-9e692e537eed tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Searching for a device in session 68 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75122) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 10:27:35 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d8c266a-ff1b-40b4-8bc9-9e692e537eed tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:50695d0c-f3a7-4319-a032-868b9540dc3c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lukoFdUi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75122) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 10:27:36 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-4d8c266a-ff1b-40b4-8bc9-9e692e537eed tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.255s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 10:27:36 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d8c266a-ff1b-40b4-8bc9-9e692e537eed tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] <== connect_volume: return (1258ms) {'type': 'block', 'scsi_wwn': '23830346634366531', 'path': '/dev/sdb'} {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 10:27:36 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d8c266a-ff1b-40b4-8bc9-9e692e537eed tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] [instance: 2a337f4a-327c-4f68-b57b-ced92c9f0785] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23830346634366531', 'path': '/dev/sdb'} {{(pid=75122) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 10:27:37 user nova-compute[75122]: DEBUG nova.objects.instance [None req-4d8c266a-ff1b-40b4-8bc9-9e692e537eed tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Lazy-loading 'flavor' on Instance uuid 2a337f4a-327c-4f68-b57b-ced92c9f0785 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 10:27:37 user nova-compute[75122]: DEBUG nova.virt.libvirt.guest [None req-4d8c266a-ff1b-40b4-8bc9-9e692e537eed tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 10:27:37 user nova-compute[75122]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 10:27:37 user nova-compute[75122]:   <source dev="/dev/sdb"/>
Nov 15 10:27:37 user nova-compute[75122]:   <target dev="vdb" bus="virtio"/>
Nov 15 10:27:37 user nova-compute[75122]:   <serial>50695d0c-f3a7-4319-a032-868b9540dc3c</serial>
Nov 15 10:27:37 user nova-compute[75122]: </disk>
Nov 15 10:27:37 user nova-compute[75122]:  {{(pid=75122) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 10:27:37 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-4d8c266a-ff1b-40b4-8bc9-9e692e537eed tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] No BDM found with device name vda, not building metadata. {{(pid=75122) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 10:27:37 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-4d8c266a-ff1b-40b4-8bc9-9e692e537eed tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75122) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 10:27:37 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-4d8c266a-ff1b-40b4-8bc9-9e692e537eed tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] No VIF found with MAC fa:16:3e:c5:79:7a, not building metadata {{(pid=75122) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 10:27:37 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-4d8c266a-ff1b-40b4-8bc9-9e692e537eed tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Lock "2a337f4a-327c-4f68-b57b-ced92c9f0785" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.386s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:27:39 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-3d0c78ab-0a86-43e0-9136-41cab934a3bc tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Acquiring lock "2a337f4a-327c-4f68-b57b-ced92c9f0785" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:27:39 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-3d0c78ab-0a86-43e0-9136-41cab934a3bc tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Lock "2a337f4a-327c-4f68-b57b-ced92c9f0785" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:27:39 user nova-compute[75122]: INFO nova.compute.manager [None req-3d0c78ab-0a86-43e0-9136-41cab934a3bc tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] [instance: 2a337f4a-327c-4f68-b57b-ced92c9f0785] Detaching volume 50695d0c-f3a7-4319-a032-868b9540dc3c
Nov 15 10:27:39 user nova-compute[75122]: INFO nova.virt.block_device [None req-3d0c78ab-0a86-43e0-9136-41cab934a3bc tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] [instance: 2a337f4a-327c-4f68-b57b-ced92c9f0785] Attempting to driver detach volume 50695d0c-f3a7-4319-a032-868b9540dc3c from mountpoint /dev/vdb
Nov 15 10:27:39 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-3d0c78ab-0a86-43e0-9136-41cab934a3bc tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Attempting to detach device vdb from instance 2a337f4a-327c-4f68-b57b-ced92c9f0785 from the persistent domain config. {{(pid=75122) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 10:27:39 user nova-compute[75122]: DEBUG nova.virt.libvirt.guest [None req-3d0c78ab-0a86-43e0-9136-41cab934a3bc tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 10:27:39 user nova-compute[75122]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 10:27:39 user nova-compute[75122]:   <source dev="/dev/sdb"/>
Nov 15 10:27:39 user nova-compute[75122]:   <target dev="vdb" bus="virtio"/>
Nov 15 10:27:39 user nova-compute[75122]:   <serial>50695d0c-f3a7-4319-a032-868b9540dc3c</serial>
Nov 15 10:27:39 user nova-compute[75122]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 10:27:39 user nova-compute[75122]: </disk>
Nov 15 10:27:39 user nova-compute[75122]:  {{(pid=75122) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 10:27:39 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-3d0c78ab-0a86-43e0-9136-41cab934a3bc tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Successfully detached device vdb from instance 2a337f4a-327c-4f68-b57b-ced92c9f0785 from the persistent domain config.
Nov 15 10:27:39 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-3d0c78ab-0a86-43e0-9136-41cab934a3bc tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2a337f4a-327c-4f68-b57b-ced92c9f0785 from the live domain config. {{(pid=75122) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 10:27:39 user nova-compute[75122]: DEBUG nova.virt.libvirt.guest [None req-3d0c78ab-0a86-43e0-9136-41cab934a3bc tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 10:27:39 user nova-compute[75122]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 10:27:39 user nova-compute[75122]:   <source dev="/dev/sdb"/>
Nov 15 10:27:39 user nova-compute[75122]:   <target dev="vdb" bus="virtio"/>
Nov 15 10:27:39 user nova-compute[75122]:   <serial>50695d0c-f3a7-4319-a032-868b9540dc3c</serial>
Nov 15 10:27:39 user nova-compute[75122]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 10:27:39 user nova-compute[75122]: </disk>
Nov 15 10:27:39 user nova-compute[75122]:  {{(pid=75122) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 10:27:39 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-3d0c78ab-0a86-43e0-9136-41cab934a3bc tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2a337f4a-327c-4f68-b57b-ced92c9f0785 {{(pid=75122) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 10:27:40 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:27:42 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:27:45 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:27:50 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:27:54 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:27:55 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:27:59 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:27:59 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-3d0c78ab-0a86-43e0-9136-41cab934a3bc tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 2a337f4a-327c-4f68-b57b-ced92c9f0785 is timed out.
Nov 15 10:27:59 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-3d0c78ab-0a86-43e0-9136-41cab934a3bc tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Successfully detached device vdb from instance 2a337f4a-327c-4f68-b57b-ced92c9f0785 from the live domain config.
Nov 15 10:27:59 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3d0c78ab-0a86-43e0-9136-41cab934a3bc tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] [instance: 2a337f4a-327c-4f68-b57b-ced92c9f0785] calling os-brick to detach iSCSI Volume {{(pid=75122) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 10:27:59 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d0c78ab-0a86-43e0-9136-41cab934a3bc tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffa04060b80>, {'target_iqn': 'iqn.2010-10.org.openstack:50695d0c-f3a7-4319-a032-868b9540dc3c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lukoFdUi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 10:27:59 user nova-compute[75122]: WARNING os_brick.initiator.connectors.base [None req-3d0c78ab-0a86-43e0-9136-41cab934a3bc tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 10:27:59 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-3d0c78ab-0a86-43e0-9136-41cab934a3bc tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 10:27:59 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-3d0c78ab-0a86-43e0-9136-41cab934a3bc tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 10:27:59 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:27:59 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:27:59 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f519cc1-e5fc-4ad7-adbc-f3a1b1d4ce22]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:50695d0c-f3a7-4319-a032-868b9540dc3c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:27:59 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d0c78ab-0a86-43e0-9136-41cab934a3bc tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 10:27:59 user nova-compute[75122]: No targets found.
Nov 15 10:27:59 user nova-compute[75122]: iSNS:
Nov 15 10:27:59 user nova-compute[75122]: No targets found.
Nov 15 10:27:59 user nova-compute[75122]: STATIC:
Nov 15 10:27:59 user nova-compute[75122]: Target: iqn.2010-10.org.openstack:50695d0c-f3a7-4319-a032-868b9540dc3c
Nov 15 10:27:59 user nova-compute[75122]:         Portal: 172.16.0.220:3260,-1
Nov 15 10:27:59 user nova-compute[75122]:                 Iface Name: default
Nov 15 10:27:59 user nova-compute[75122]: FIRMWARE:
Nov 15 10:27:59 user nova-compute[75122]: No targets found.
Nov 15 10:27:59 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 10:27:59 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d0c78ab-0a86-43e0-9136-41cab934a3bc tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 10:27:59 user nova-compute[75122]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 10:27:59 user nova-compute[75122]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75122) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 10:27:59 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d0c78ab-0a86-43e0-9136-41cab934a3bc tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:50695d0c-f3a7-4319-a032-868b9540dc3c', 0)] {{(pid=75122) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 10:27:59 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:27:59 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:27:59 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[714db6c1-d6dd-4894-be53-e913267fa7f2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:50695d0c-f3a7-4319-a032-868b9540dc3c\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:27:59 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:27:59 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:27:59 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b6101e8-5621-428c-9e05-b93213504416]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50695d0c-f3a7-4319-a032-868b9540dc3c (non-flash)\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:27:59 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d0c78ab-0a86-43e0-9136-41cab934a3bc tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50695d0c-f3a7-4319-a032-868b9540dc3c (non-flash)
Nov 15 10:27:59 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 10:27:59 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d0c78ab-0a86-43e0-9136-41cab934a3bc tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50695d0c-f3a7-4319-a032-868b9540dc3c (non-flash)
Nov 15 10:27:59 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 10:27:59 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d0c78ab-0a86-43e0-9136-41cab934a3bc tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ffa04413d00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:50695d0c-f3a7-4319-a032-868b9540dc3c'): ({'sdb'}, set())}) {{(pid=75122) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 10:27:59 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-3d0c78ab-0a86-43e0-9136-41cab934a3bc tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Removing single pathed devices sdb {{(pid=75122) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 10:27:59 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:27:59 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:27:59 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab4ee45d-34c6-49a9-9fba-47eb2e091d2b]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:27:59 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:27:59 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:27:59 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[183837e0-e558-4619-8e2f-3efd94ce1261]: (4, ('ok\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:27:59 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-3d0c78ab-0a86-43e0-9136-41cab934a3bc tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Flushing IO for device /dev/sdb {{(pid=75122) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 10:27:59 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:27:59 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:27:59 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e134ebe-9ef4-44bd-9366-968da3b4f7de]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:27:59 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-3d0c78ab-0a86-43e0-9136-41cab934a3bc tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75122) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 10:27:59 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:27:59 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:27:59 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[59bfe052-3a10-4971-9ce7-1db9860de88f]: (4, ('1', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:27:59 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-3d0c78ab-0a86-43e0-9136-41cab934a3bc tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75122) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 10:27:59 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-3d0c78ab-0a86-43e0-9136-41cab934a3bc tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] SCSI volumes sdb have been removed. {{(pid=75122) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 10:27:59 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d0c78ab-0a86-43e0-9136-41cab934a3bc tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:50695d0c-f3a7-4319-a032-868b9540dc3c')] {{(pid=75122) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 10:27:59 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50695d0c-f3a7-4319-a032-868b9540dc3c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:27:59 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50695d0c-f3a7-4319-a032-868b9540dc3c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:27:59 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd158a68-8b93-4d77-9d88-a0db79fd7f65]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:27:59 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d0c78ab-0a86-43e0-9136-41cab934a3bc tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 10:27:59 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50695d0c-f3a7-4319-a032-868b9540dc3c -p 172.16.0.220:3260 --logout {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:28:00 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50695d0c-f3a7-4319-a032-868b9540dc3c -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:28:00 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ddade46-5aa7-4414-b1f7-cf73dab42ceb]: (4, ('Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:50695d0c-f3a7-4319-a032-868b9540dc3c, portal: 172.16.0.220,3260]\nLogout of [sid: 68, target: iqn.2010-10.org.openstack:50695d0c-f3a7-4319-a032-868b9540dc3c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:28:00 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d0c78ab-0a86-43e0-9136-41cab934a3bc tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:50695d0c-f3a7-4319-a032-868b9540dc3c, portal: 172.16.0.220,3260]
Nov 15 10:28:00 user nova-compute[75122]: Logout of [sid: 68, target: iqn.2010-10.org.openstack:50695d0c-f3a7-4319-a032-868b9540dc3c, portal: 172.16.0.220,3260] successful.
Nov 15 10:28:00 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 10:28:00 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50695d0c-f3a7-4319-a032-868b9540dc3c -p 172.16.0.220:3260 --op delete {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:28:00 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50695d0c-f3a7-4319-a032-868b9540dc3c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:28:00 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[777cf35a-3888-4ca0-b4bb-4c35a12419d1]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:28:00 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d0c78ab-0a86-43e0-9136-41cab934a3bc tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 10:28:00 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-3d0c78ab-0a86-43e0-9136-41cab934a3bc tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.287s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 10:28:00 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d0c78ab-0a86-43e0-9136-41cab934a3bc tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] <== disconnect_volume: return (289ms) None {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 10:28:00 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3d0c78ab-0a86-43e0-9136-41cab934a3bc tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] [instance: 2a337f4a-327c-4f68-b57b-ced92c9f0785] Disconnected iSCSI Volume {{(pid=75122) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 10:28:00 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:28:00 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:28:00 user nova-compute[75122]: DEBUG nova.objects.instance [None req-3d0c78ab-0a86-43e0-9136-41cab934a3bc tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Lazy-loading 'flavor' on Instance uuid 2a337f4a-327c-4f68-b57b-ced92c9f0785 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 10:28:00 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-3d0c78ab-0a86-43e0-9136-41cab934a3bc tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Lock "2a337f4a-327c-4f68-b57b-ced92c9f0785" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.581s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:28:02 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:28:02 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:28:02 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:28:02 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:28:02 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75122) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 10:28:02 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a337f4a-327c-4f68-b57b-ced92c9f0785/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:28:02 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a337f4a-327c-4f68-b57b-ced92c9f0785/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:28:02 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a337f4a-327c-4f68-b57b-ced92c9f0785/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:28:02 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a337f4a-327c-4f68-b57b-ced92c9f0785/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:28:02 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 10:28:02 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 10:28:02 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Hypervisor/Node resource view: name=user free_ram=8978MB free_disk=25.026596069335938GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75122) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 10:28:02 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:28:02 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:28:03 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance 2a337f4a-327c-4f68-b57b-ced92c9f0785 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 10:28:03 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75122) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 10:28:03 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75122) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 10:28:03 user nova-compute[75122]: DEBUG nova.compute.provider_tree [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Inventory has not changed in ProviderTree for provider: 69a3da65-47be-44c6-b67c-c692b58284ef {{(pid=75122) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 10:28:03 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Inventory has not changed for provider 69a3da65-47be-44c6-b67c-c692b58284ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 10:28:03 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Compute_service record updated for user:user {{(pid=75122) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 10:28:03 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.157s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:28:04 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:28:05 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:28:05 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:28:07 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:28:07 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Starting heal instance info cache {{(pid=75122) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 10:28:07 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Rebuilding the list of instances to heal {{(pid=75122) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 10:28:07 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "refresh_cache-2a337f4a-327c-4f68-b57b-ced92c9f0785" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 10:28:07 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquired lock "refresh_cache-2a337f4a-327c-4f68-b57b-ced92c9f0785" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 10:28:07 user nova-compute[75122]: DEBUG nova.network.neutron [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] [instance: 2a337f4a-327c-4f68-b57b-ced92c9f0785] Forcefully refreshing network info cache for instance {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 10:28:07 user nova-compute[75122]: DEBUG nova.objects.instance [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lazy-loading 'info_cache' on Instance uuid 2a337f4a-327c-4f68-b57b-ced92c9f0785 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 10:28:07 user nova-compute[75122]: DEBUG nova.network.neutron [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] [instance: 2a337f4a-327c-4f68-b57b-ced92c9f0785] Updating instance_info_cache with network_info: [{"id": "e85cb1cf-cfb8-41cb-8337-52586061c47c", "address": "fa:16:3e:c5:79:7a", "network": {"id": "1c3d3d85-5e15-4b5a-9671-acca5de739d8", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-413087253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dc6ab7d6975429083681f5807a78f08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape85cb1cf-cf", "ovs_interfaceid": "e85cb1cf-cfb8-41cb-8337-52586061c47c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 10:28:07 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Releasing lock "refresh_cache-2a337f4a-327c-4f68-b57b-ced92c9f0785" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 10:28:07 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] [instance: 2a337f4a-327c-4f68-b57b-ced92c9f0785] Updated the network info_cache for instance {{(pid=75122) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 10:28:10 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:28:10 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:28:14 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:28:14 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75122) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 10:28:15 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:28:20 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:28:24 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:28:24 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Triggering sync for uuid 2a337f4a-327c-4f68-b57b-ced92c9f0785 {{(pid=75122) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 10:28:24 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "2a337f4a-327c-4f68-b57b-ced92c9f0785" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:28:24 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "2a337f4a-327c-4f68-b57b-ced92c9f0785" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:28:24 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "2a337f4a-327c-4f68-b57b-ced92c9f0785" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.026s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:28:25 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:28:30 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:28:31 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-e8394cd5-ac48-4b50-9f69-da5d661ceb97 tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Acquiring lock "2a337f4a-327c-4f68-b57b-ced92c9f0785" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:28:31 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-e8394cd5-ac48-4b50-9f69-da5d661ceb97 tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Lock "2a337f4a-327c-4f68-b57b-ced92c9f0785" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:28:31 user nova-compute[75122]: DEBUG nova.objects.instance [None req-e8394cd5-ac48-4b50-9f69-da5d661ceb97 tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Lazy-loading 'flavor' on Instance uuid 2a337f4a-327c-4f68-b57b-ced92c9f0785 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 10:28:31 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-e8394cd5-ac48-4b50-9f69-da5d661ceb97 tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Lock "2a337f4a-327c-4f68-b57b-ced92c9f0785" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.049s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:28:31 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-e8394cd5-ac48-4b50-9f69-da5d661ceb97 tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Acquiring lock "2a337f4a-327c-4f68-b57b-ced92c9f0785" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:28:31 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-e8394cd5-ac48-4b50-9f69-da5d661ceb97 tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Lock "2a337f4a-327c-4f68-b57b-ced92c9f0785" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:28:31 user nova-compute[75122]: INFO nova.compute.manager [None req-e8394cd5-ac48-4b50-9f69-da5d661ceb97 tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] [instance: 2a337f4a-327c-4f68-b57b-ced92c9f0785] Attaching volume 3c1fd083-d30e-4e6d-b2e3-adf03f9891bf to /dev/vdb
Nov 15 10:28:31 user nova-compute[75122]: DEBUG os_brick.utils [None req-e8394cd5-ac48-4b50-9f69-da5d661ceb97 tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 10:28:31 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:28:31 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:28:31 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[eafcd563-ee45-4210-a6a6-3251eea70d29]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:742fb64b3587\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:28:31 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:28:31 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:28:31 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[fce75345-0e29-4602-a08a-6076b0dc59c6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:28:31 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:28:31 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:28:31 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[845b04fd-3850-45ef-ac85-1df74020e58d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:28:31 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb17600a-0655-4d45-9856-5aec25150e39]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:28:31 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-e8394cd5-ac48-4b50-9f69-da5d661ceb97 tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Running cmd (subprocess): nvme version {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:28:32 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-e8394cd5-ac48-4b50-9f69-da5d661ceb97 tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] 'nvme version' failed. Not Retrying. {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 10:28:32 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e8394cd5-ac48-4b50-9f69-da5d661ceb97 tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] nvme not present on system {{(pid=75122) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 10:28:32 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:28:32 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 10:28:32 user nova-compute[75122]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 10:28:32 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[a262be77-b028-43ca-b02a-58c7e0a21f86]: (4, '') {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:28:32 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.lightos [None req-e8394cd5-ac48-4b50-9f69-da5d661ceb97 tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75122) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 10:28:32 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.lightos [None req-e8394cd5-ac48-4b50-9f69-da5d661ceb97 tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75122) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 10:28:32 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.lightos [None req-e8394cd5-ac48-4b50-9f69-da5d661ceb97 tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] LIGHTOS: no hostnqn found. {{(pid=75122) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 10:28:32 user nova-compute[75122]: DEBUG os_brick.utils [None req-e8394cd5-ac48-4b50-9f69-da5d661ceb97 tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] <== get_connector_properties: return (112ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:742fb64b3587', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 10:28:32 user nova-compute[75122]: DEBUG nova.virt.block_device [None req-e8394cd5-ac48-4b50-9f69-da5d661ceb97 tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] [instance: 2a337f4a-327c-4f68-b57b-ced92c9f0785] Updating existing volume attachment record: 3dcc23d5-f513-42ec-a922-6a55f25a7982 {{(pid=75122) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 10:28:32 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:28:35 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:28:36 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e8394cd5-ac48-4b50-9f69-da5d661ceb97 tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] [instance: 2a337f4a-327c-4f68-b57b-ced92c9f0785] Calling os-brick to attach iSCSI Volume {{(pid=75122) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 10:28:36 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8394cd5-ac48-4b50-9f69-da5d661ceb97 tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffa04060b80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3c1fd083-d30e-4e6d-b2e3-adf03f9891bf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TsmBvqgn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 10:28:36 user nova-compute[75122]: WARNING os_brick.initiator.connectors.base [None req-e8394cd5-ac48-4b50-9f69-da5d661ceb97 tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 10:28:36 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-e8394cd5-ac48-4b50-9f69-da5d661ceb97 tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 10:28:36 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-e8394cd5-ac48-4b50-9f69-da5d661ceb97 tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 10:28:36 user nova-compute[75122]: WARNING os_brick.initiator.connectors.base [None req-e8394cd5-ac48-4b50-9f69-da5d661ceb97 tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 10:28:36 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-e8394cd5-ac48-4b50-9f69-da5d661ceb97 tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3c1fd083-d30e-4e6d-b2e3-adf03f9891bf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 10:28:36 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-e8394cd5-ac48-4b50-9f69-da5d661ceb97 tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3c1fd083-d30e-4e6d-b2e3-adf03f9891bf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 10:28:36 user nova-compute[75122]: INFO os_brick.initiator.connectors.iscsi [None req-e8394cd5-ac48-4b50-9f69-da5d661ceb97 tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 10:28:36 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c1fd083-d30e-4e6d-b2e3-adf03f9891bf -p 172.16.0.220:3260 {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:28:36 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c1fd083-d30e-4e6d-b2e3-adf03f9891bf -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:28:36 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[af7892cc-9ac4-476c-8f5e-25ef6342a6d3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:28:36 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8394cd5-ac48-4b50-9f69-da5d661ceb97 tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 10:28:36 user nova-compute[75122]:  {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 10:28:36 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c1fd083-d30e-4e6d-b2e3-adf03f9891bf -p 172.16.0.220:3260 --interface default --op new {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:28:36 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c1fd083-d30e-4e6d-b2e3-adf03f9891bf -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:28:36 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fc72d32-4e36-47d4-bd4e-c3f8b41cc297]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3c1fd083-d30e-4e6d-b2e3-adf03f9891bf] added\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:28:36 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8394cd5-ac48-4b50-9f69-da5d661ceb97 tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3c1fd083-d30e-4e6d-b2e3-adf03f9891bf] added
Nov 15 10:28:36 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 10:28:36 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c1fd083-d30e-4e6d-b2e3-adf03f9891bf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:28:36 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c1fd083-d30e-4e6d-b2e3-adf03f9891bf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:28:36 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f67feac-f27d-4620-b91f-9bc121a29d6c]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:28:36 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8394cd5-ac48-4b50-9f69-da5d661ceb97 tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 10:28:36 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c1fd083-d30e-4e6d-b2e3-adf03f9891bf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:28:36 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c1fd083-d30e-4e6d-b2e3-adf03f9891bf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:28:36 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[53eb53a3-7e0f-45a5-a401-53c8df92fc2e]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:28:36 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8394cd5-ac48-4b50-9f69-da5d661ceb97 tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 10:28:36 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c1fd083-d30e-4e6d-b2e3-adf03f9891bf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TsmBvqgn {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:28:36 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c1fd083-d30e-4e6d-b2e3-adf03f9891bf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TsmBvqgn" returned: 0 in 0.017s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:28:36 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[d17ee874-b8d4-4580-ae10-2df62b3aa6bf]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:28:36 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8394cd5-ac48-4b50-9f69-da5d661ceb97 tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TsmBvqgn'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 10:28:36 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c1fd083-d30e-4e6d-b2e3-adf03f9891bf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:28:36 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c1fd083-d30e-4e6d-b2e3-adf03f9891bf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:28:36 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[1928fa9e-6918-4b7e-80f8-419f7c3164c0]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:28:36 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8394cd5-ac48-4b50-9f69-da5d661ceb97 tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 10:28:36 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:28:36 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:28:36 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[a59f2767-5ab9-4f9c-a496-b49b6b88f17b]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:28:36 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8394cd5-ac48-4b50-9f69-da5d661ceb97 tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 15 10:28:36 user nova-compute[75122]:  {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 10:28:36 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8394cd5-ac48-4b50-9f69-da5d661ceb97 tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 15 10:28:36 user nova-compute[75122]:  {{(pid=75122) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 10:28:36 user nova-compute[75122]: WARNING os_brick.initiator.connectors.iscsi [None req-e8394cd5-ac48-4b50-9f69-da5d661ceb97 tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 15 10:28:36 user nova-compute[75122]: 
Nov 15 10:28:36 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c1fd083-d30e-4e6d-b2e3-adf03f9891bf -p 172.16.0.220:3260 --login {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:28:36 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c1fd083-d30e-4e6d-b2e3-adf03f9891bf -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:28:36 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[1550308b-297f-4ff8-b698-9546b54053d1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3c1fd083-d30e-4e6d-b2e3-adf03f9891bf, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3c1fd083-d30e-4e6d-b2e3-adf03f9891bf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:28:36 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8394cd5-ac48-4b50-9f69-da5d661ceb97 tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3c1fd083-d30e-4e6d-b2e3-adf03f9891bf, portal: 172.16.0.220,3260]
Nov 15 10:28:36 user nova-compute[75122]: Login to [iface: default, target: iqn.2010-10.org.openstack:3c1fd083-d30e-4e6d-b2e3-adf03f9891bf, portal: 172.16.0.220,3260] successful.
Nov 15 10:28:36 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 10:28:36 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c1fd083-d30e-4e6d-b2e3-adf03f9891bf -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:28:36 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c1fd083-d30e-4e6d-b2e3-adf03f9891bf -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:28:36 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[755892ea-2a64-47fe-8835-12dfbe7e8653]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:28:36 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8394cd5-ac48-4b50-9f69-da5d661ceb97 tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 10:28:36 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:28:36 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:28:36 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[756e9f5d-608c-4f11-9bb1-ac4f7665b9e5]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c1fd083-d30e-4e6d-b2e3-adf03f9891bf (non-flash)\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:28:36 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8394cd5-ac48-4b50-9f69-da5d661ceb97 tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c1fd083-d30e-4e6d-b2e3-adf03f9891bf (non-flash)
Nov 15 10:28:36 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 10:28:36 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8394cd5-ac48-4b50-9f69-da5d661ceb97 tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c1fd083-d30e-4e6d-b2e3-adf03f9891bf (non-flash)
Nov 15 10:28:36 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 10:28:36 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-e8394cd5-ac48-4b50-9f69-da5d661ceb97 tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3c1fd083-d30e-4e6d-b2e3-adf03f9891bf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.236s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 10:28:36 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8394cd5-ac48-4b50-9f69-da5d661ceb97 tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Connected to 172.16.0.220:3260 {{(pid=75122) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 10:28:36 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-e8394cd5-ac48-4b50-9f69-da5d661ceb97 tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] HCTL ('33', '-', '-', 0) found on session 69 with lun 0 {{(pid=75122) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 10:28:36 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-e8394cd5-ac48-4b50-9f69-da5d661ceb97 tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75122) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 10:28:36 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:28:36 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:28:36 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[23ac79c5-1e35-4a71-b93b-85b8424bffa5]: (4, ('- - 0', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:28:36 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-e8394cd5-ac48-4b50-9f69-da5d661ceb97 tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Searching for a device in session 69 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75122) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 10:28:36 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8394cd5-ac48-4b50-9f69-da5d661ceb97 tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:3c1fd083-d30e-4e6d-b2e3-adf03f9891bf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TsmBvqgn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75122) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 10:28:37 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-e8394cd5-ac48-4b50-9f69-da5d661ceb97 tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.263s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 10:28:37 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-e8394cd5-ac48-4b50-9f69-da5d661ceb97 tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] <== connect_volume: return (1265ms) {'type': 'block', 'scsi_wwn': '26463333239303163', 'path': '/dev/sdb'} {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 10:28:37 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e8394cd5-ac48-4b50-9f69-da5d661ceb97 tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] [instance: 2a337f4a-327c-4f68-b57b-ced92c9f0785] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26463333239303163', 'path': '/dev/sdb'} {{(pid=75122) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 10:28:37 user nova-compute[75122]: DEBUG nova.objects.instance [None req-e8394cd5-ac48-4b50-9f69-da5d661ceb97 tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Lazy-loading 'flavor' on Instance uuid 2a337f4a-327c-4f68-b57b-ced92c9f0785 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 10:28:38 user nova-compute[75122]: DEBUG nova.virt.libvirt.guest [None req-e8394cd5-ac48-4b50-9f69-da5d661ceb97 tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 10:28:38 user nova-compute[75122]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 10:28:38 user nova-compute[75122]:   <source dev="/dev/sdb"/>
Nov 15 10:28:38 user nova-compute[75122]:   <target dev="vdb" bus="virtio"/>
Nov 15 10:28:38 user nova-compute[75122]:   <serial>3c1fd083-d30e-4e6d-b2e3-adf03f9891bf</serial>
Nov 15 10:28:38 user nova-compute[75122]: </disk>
Nov 15 10:28:38 user nova-compute[75122]:  {{(pid=75122) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 10:28:38 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-e8394cd5-ac48-4b50-9f69-da5d661ceb97 tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] No BDM found with device name vda, not building metadata. {{(pid=75122) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 10:28:38 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-e8394cd5-ac48-4b50-9f69-da5d661ceb97 tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75122) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 10:28:38 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-e8394cd5-ac48-4b50-9f69-da5d661ceb97 tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] No VIF found with MAC fa:16:3e:c5:79:7a, not building metadata {{(pid=75122) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 10:28:38 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-e8394cd5-ac48-4b50-9f69-da5d661ceb97 tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Lock "2a337f4a-327c-4f68-b57b-ced92c9f0785" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.836s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:28:40 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:28:40 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-d50480a0-afa1-4649-a379-38fc0ba9ce9e tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Acquiring lock "2a337f4a-327c-4f68-b57b-ced92c9f0785" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:28:40 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-d50480a0-afa1-4649-a379-38fc0ba9ce9e tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Lock "2a337f4a-327c-4f68-b57b-ced92c9f0785" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:28:41 user nova-compute[75122]: INFO nova.compute.manager [None req-d50480a0-afa1-4649-a379-38fc0ba9ce9e tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] [instance: 2a337f4a-327c-4f68-b57b-ced92c9f0785] Detaching volume 3c1fd083-d30e-4e6d-b2e3-adf03f9891bf
Nov 15 10:28:41 user nova-compute[75122]: INFO nova.virt.block_device [None req-d50480a0-afa1-4649-a379-38fc0ba9ce9e tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] [instance: 2a337f4a-327c-4f68-b57b-ced92c9f0785] Attempting to driver detach volume 3c1fd083-d30e-4e6d-b2e3-adf03f9891bf from mountpoint /dev/vdb
Nov 15 10:28:41 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-d50480a0-afa1-4649-a379-38fc0ba9ce9e tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Attempting to detach device vdb from instance 2a337f4a-327c-4f68-b57b-ced92c9f0785 from the persistent domain config. {{(pid=75122) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 10:28:41 user nova-compute[75122]: DEBUG nova.virt.libvirt.guest [None req-d50480a0-afa1-4649-a379-38fc0ba9ce9e tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 10:28:41 user nova-compute[75122]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 10:28:41 user nova-compute[75122]:   <source dev="/dev/sdb"/>
Nov 15 10:28:41 user nova-compute[75122]:   <target dev="vdb" bus="virtio"/>
Nov 15 10:28:41 user nova-compute[75122]:   <serial>3c1fd083-d30e-4e6d-b2e3-adf03f9891bf</serial>
Nov 15 10:28:41 user nova-compute[75122]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 10:28:41 user nova-compute[75122]: </disk>
Nov 15 10:28:41 user nova-compute[75122]:  {{(pid=75122) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 10:28:41 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-d50480a0-afa1-4649-a379-38fc0ba9ce9e tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Successfully detached device vdb from instance 2a337f4a-327c-4f68-b57b-ced92c9f0785 from the persistent domain config.
Nov 15 10:28:41 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-d50480a0-afa1-4649-a379-38fc0ba9ce9e tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2a337f4a-327c-4f68-b57b-ced92c9f0785 from the live domain config. {{(pid=75122) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 10:28:41 user nova-compute[75122]: DEBUG nova.virt.libvirt.guest [None req-d50480a0-afa1-4649-a379-38fc0ba9ce9e tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 10:28:41 user nova-compute[75122]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 10:28:41 user nova-compute[75122]:   <source dev="/dev/sdb"/>
Nov 15 10:28:41 user nova-compute[75122]:   <target dev="vdb" bus="virtio"/>
Nov 15 10:28:41 user nova-compute[75122]:   <serial>3c1fd083-d30e-4e6d-b2e3-adf03f9891bf</serial>
Nov 15 10:28:41 user nova-compute[75122]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 10:28:41 user nova-compute[75122]: </disk>
Nov 15 10:28:41 user nova-compute[75122]:  {{(pid=75122) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 10:28:41 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-d50480a0-afa1-4649-a379-38fc0ba9ce9e tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2a337f4a-327c-4f68-b57b-ced92c9f0785 {{(pid=75122) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 10:28:42 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:28:45 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:28:50 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:28:50 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:28:50 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75122) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 10:28:50 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75122) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 10:28:50 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75122) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 10:28:50 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:28:55 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:28:55 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:29:00 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:29:01 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:29:01 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:29:01 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-d50480a0-afa1-4649-a379-38fc0ba9ce9e tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 2a337f4a-327c-4f68-b57b-ced92c9f0785 is timed out.
Nov 15 10:29:01 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-d50480a0-afa1-4649-a379-38fc0ba9ce9e tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Successfully detached device vdb from instance 2a337f4a-327c-4f68-b57b-ced92c9f0785 from the live domain config.
Nov 15 10:29:01 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d50480a0-afa1-4649-a379-38fc0ba9ce9e tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] [instance: 2a337f4a-327c-4f68-b57b-ced92c9f0785] calling os-brick to detach iSCSI Volume {{(pid=75122) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 10:29:01 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-d50480a0-afa1-4649-a379-38fc0ba9ce9e tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffa04060b80>, {'target_iqn': 'iqn.2010-10.org.openstack:3c1fd083-d30e-4e6d-b2e3-adf03f9891bf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TsmBvqgn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 10:29:01 user nova-compute[75122]: WARNING os_brick.initiator.connectors.base [None req-d50480a0-afa1-4649-a379-38fc0ba9ce9e tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 10:29:01 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-d50480a0-afa1-4649-a379-38fc0ba9ce9e tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 10:29:01 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-d50480a0-afa1-4649-a379-38fc0ba9ce9e tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 10:29:01 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:29:01 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:29:01 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[da0695ec-5824-478b-85e9-981c0bcd72fd]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3c1fd083-d30e-4e6d-b2e3-adf03f9891bf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:29:01 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-d50480a0-afa1-4649-a379-38fc0ba9ce9e tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 10:29:01 user nova-compute[75122]: No targets found.
Nov 15 10:29:01 user nova-compute[75122]: iSNS:
Nov 15 10:29:01 user nova-compute[75122]: No targets found.
Nov 15 10:29:01 user nova-compute[75122]: STATIC:
Nov 15 10:29:01 user nova-compute[75122]: Target: iqn.2010-10.org.openstack:3c1fd083-d30e-4e6d-b2e3-adf03f9891bf
Nov 15 10:29:01 user nova-compute[75122]:         Portal: 172.16.0.220:3260,-1
Nov 15 10:29:01 user nova-compute[75122]:                 Iface Name: default
Nov 15 10:29:01 user nova-compute[75122]: FIRMWARE:
Nov 15 10:29:01 user nova-compute[75122]: No targets found.
Nov 15 10:29:01 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 10:29:01 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-d50480a0-afa1-4649-a379-38fc0ba9ce9e tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 10:29:01 user nova-compute[75122]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 10:29:01 user nova-compute[75122]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75122) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 10:29:01 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-d50480a0-afa1-4649-a379-38fc0ba9ce9e tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3c1fd083-d30e-4e6d-b2e3-adf03f9891bf', 0)] {{(pid=75122) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 10:29:01 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:29:01 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:29:01 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf86e823-609c-4808-a1c1-48a709cea381]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3c1fd083-d30e-4e6d-b2e3-adf03f9891bf\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:29:01 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:29:01 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:29:01 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ad5df61-b660-436d-96cf-179aafe1b117]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c1fd083-d30e-4e6d-b2e3-adf03f9891bf (non-flash)\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:29:01 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-d50480a0-afa1-4649-a379-38fc0ba9ce9e tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c1fd083-d30e-4e6d-b2e3-adf03f9891bf (non-flash)
Nov 15 10:29:01 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 10:29:01 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-d50480a0-afa1-4649-a379-38fc0ba9ce9e tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c1fd083-d30e-4e6d-b2e3-adf03f9891bf (non-flash)
Nov 15 10:29:01 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 10:29:01 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-d50480a0-afa1-4649-a379-38fc0ba9ce9e tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff9fc386950>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3c1fd083-d30e-4e6d-b2e3-adf03f9891bf'): ({'sdb'}, set())}) {{(pid=75122) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 10:29:01 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-d50480a0-afa1-4649-a379-38fc0ba9ce9e tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Removing single pathed devices sdb {{(pid=75122) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 10:29:01 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:29:01 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:29:01 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[1261e031-c658-4040-a327-530f19e9c3b1]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:29:01 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:29:01 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:29:01 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[e901190f-14fe-4ee3-83a9-7c115a210e7a]: (4, ('ok\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:29:01 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-d50480a0-afa1-4649-a379-38fc0ba9ce9e tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Flushing IO for device /dev/sdb {{(pid=75122) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 10:29:01 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:29:01 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:29:01 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[63466256-b994-421d-a7b3-af8c8f19200a]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:29:01 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-d50480a0-afa1-4649-a379-38fc0ba9ce9e tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75122) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 10:29:01 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:29:01 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:29:01 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[64c03a09-eb56-4f2b-8542-64c9090d687f]: (4, ('1', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:29:01 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-d50480a0-afa1-4649-a379-38fc0ba9ce9e tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75122) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 10:29:01 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-d50480a0-afa1-4649-a379-38fc0ba9ce9e tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] SCSI volumes sdb have been removed. {{(pid=75122) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 10:29:01 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-d50480a0-afa1-4649-a379-38fc0ba9ce9e tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3c1fd083-d30e-4e6d-b2e3-adf03f9891bf')] {{(pid=75122) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 10:29:01 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c1fd083-d30e-4e6d-b2e3-adf03f9891bf -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:29:01 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c1fd083-d30e-4e6d-b2e3-adf03f9891bf -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:29:01 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[32e1a50b-dfe1-4598-8758-9395952e2b5b]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:29:01 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-d50480a0-afa1-4649-a379-38fc0ba9ce9e tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 10:29:01 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c1fd083-d30e-4e6d-b2e3-adf03f9891bf -p 172.16.0.220:3260 --logout {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:29:01 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c1fd083-d30e-4e6d-b2e3-adf03f9891bf -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:29:01 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f9e297d-702c-4e6d-839a-5d90ac78f674]: (4, ('Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:3c1fd083-d30e-4e6d-b2e3-adf03f9891bf, portal: 172.16.0.220,3260]\nLogout of [sid: 69, target: iqn.2010-10.org.openstack:3c1fd083-d30e-4e6d-b2e3-adf03f9891bf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:29:01 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-d50480a0-afa1-4649-a379-38fc0ba9ce9e tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:3c1fd083-d30e-4e6d-b2e3-adf03f9891bf, portal: 172.16.0.220,3260]
Nov 15 10:29:01 user nova-compute[75122]: Logout of [sid: 69, target: iqn.2010-10.org.openstack:3c1fd083-d30e-4e6d-b2e3-adf03f9891bf, portal: 172.16.0.220,3260] successful.
Nov 15 10:29:01 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 10:29:01 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c1fd083-d30e-4e6d-b2e3-adf03f9891bf -p 172.16.0.220:3260 --op delete {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:29:01 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c1fd083-d30e-4e6d-b2e3-adf03f9891bf -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:29:01 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef5e01df-7ef7-41ac-a2c1-93b7407fa92d]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:29:01 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-d50480a0-afa1-4649-a379-38fc0ba9ce9e tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 10:29:01 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-d50480a0-afa1-4649-a379-38fc0ba9ce9e tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.290s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 10:29:01 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-d50480a0-afa1-4649-a379-38fc0ba9ce9e tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] <== disconnect_volume: return (292ms) None {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 10:29:01 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d50480a0-afa1-4649-a379-38fc0ba9ce9e tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] [instance: 2a337f4a-327c-4f68-b57b-ced92c9f0785] Disconnected iSCSI Volume {{(pid=75122) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 10:29:02 user nova-compute[75122]: DEBUG nova.objects.instance [None req-d50480a0-afa1-4649-a379-38fc0ba9ce9e tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Lazy-loading 'flavor' on Instance uuid 2a337f4a-327c-4f68-b57b-ced92c9f0785 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 10:29:02 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-d50480a0-afa1-4649-a379-38fc0ba9ce9e tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Lock "2a337f4a-327c-4f68-b57b-ced92c9f0785" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.639s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:29:03 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:29:04 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:29:04 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:29:04 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:29:04 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:29:04 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75122) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 10:29:04 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a337f4a-327c-4f68-b57b-ced92c9f0785/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:29:04 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a337f4a-327c-4f68-b57b-ced92c9f0785/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:29:04 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a337f4a-327c-4f68-b57b-ced92c9f0785/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:29:04 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a337f4a-327c-4f68-b57b-ced92c9f0785/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:29:04 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 10:29:04 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 10:29:04 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Hypervisor/Node resource view: name=user free_ram=8995MB free_disk=25.02558135986328GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75122) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 10:29:04 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:29:04 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:29:05 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance 2a337f4a-327c-4f68-b57b-ced92c9f0785 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 10:29:05 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75122) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 10:29:05 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75122) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 10:29:05 user nova-compute[75122]: DEBUG nova.compute.provider_tree [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Inventory has not changed in ProviderTree for provider: 69a3da65-47be-44c6-b67c-c692b58284ef {{(pid=75122) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 10:29:05 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Inventory has not changed for provider 69a3da65-47be-44c6-b67c-c692b58284ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 10:29:05 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Compute_service record updated for user:user {{(pid=75122) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 10:29:05 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.161s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:29:05 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:29:08 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:29:09 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:29:09 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Starting heal instance info cache {{(pid=75122) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 10:29:09 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Rebuilding the list of instances to heal {{(pid=75122) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 10:29:09 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "refresh_cache-2a337f4a-327c-4f68-b57b-ced92c9f0785" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 10:29:09 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquired lock "refresh_cache-2a337f4a-327c-4f68-b57b-ced92c9f0785" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 10:29:09 user nova-compute[75122]: DEBUG nova.network.neutron [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] [instance: 2a337f4a-327c-4f68-b57b-ced92c9f0785] Forcefully refreshing network info cache for instance {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 10:29:09 user nova-compute[75122]: DEBUG nova.objects.instance [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lazy-loading 'info_cache' on Instance uuid 2a337f4a-327c-4f68-b57b-ced92c9f0785 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 10:29:10 user nova-compute[75122]: DEBUG nova.network.neutron [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] [instance: 2a337f4a-327c-4f68-b57b-ced92c9f0785] Updating instance_info_cache with network_info: [{"id": "e85cb1cf-cfb8-41cb-8337-52586061c47c", "address": "fa:16:3e:c5:79:7a", "network": {"id": "1c3d3d85-5e15-4b5a-9671-acca5de739d8", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-413087253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dc6ab7d6975429083681f5807a78f08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape85cb1cf-cf", "ovs_interfaceid": "e85cb1cf-cfb8-41cb-8337-52586061c47c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 10:29:10 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Releasing lock "refresh_cache-2a337f4a-327c-4f68-b57b-ced92c9f0785" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 10:29:10 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] [instance: 2a337f4a-327c-4f68-b57b-ced92c9f0785] Updated the network info_cache for instance {{(pid=75122) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 10:29:10 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:29:12 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:29:15 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:29:15 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75122) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 10:29:15 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:29:15 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:29:15 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75122) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 10:29:15 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75122) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 10:29:15 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75122) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 10:29:15 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:29:20 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:29:25 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:29:26 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:29:30 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:29:33 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-80a5a21c-29d5-489c-bcf4-4befb37a93de tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Acquiring lock "2a337f4a-327c-4f68-b57b-ced92c9f0785" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:29:33 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-80a5a21c-29d5-489c-bcf4-4befb37a93de tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Lock "2a337f4a-327c-4f68-b57b-ced92c9f0785" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:29:33 user nova-compute[75122]: DEBUG nova.objects.instance [None req-80a5a21c-29d5-489c-bcf4-4befb37a93de tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Lazy-loading 'flavor' on Instance uuid 2a337f4a-327c-4f68-b57b-ced92c9f0785 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 10:29:33 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-80a5a21c-29d5-489c-bcf4-4befb37a93de tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Lock "2a337f4a-327c-4f68-b57b-ced92c9f0785" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:29:33 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-80a5a21c-29d5-489c-bcf4-4befb37a93de tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Acquiring lock "2a337f4a-327c-4f68-b57b-ced92c9f0785" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:29:33 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-80a5a21c-29d5-489c-bcf4-4befb37a93de tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Lock "2a337f4a-327c-4f68-b57b-ced92c9f0785" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:29:33 user nova-compute[75122]: INFO nova.compute.manager [None req-80a5a21c-29d5-489c-bcf4-4befb37a93de tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] [instance: 2a337f4a-327c-4f68-b57b-ced92c9f0785] Attaching volume aebb0bf3-2d0c-466a-9287-a602da835868 to /dev/vdb
Nov 15 10:29:33 user nova-compute[75122]: DEBUG os_brick.utils [None req-80a5a21c-29d5-489c-bcf4-4befb37a93de tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 10:29:33 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:29:33 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:29:33 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[49252559-c64a-40bf-8796-7f6c3509dab2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:742fb64b3587\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:29:33 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:29:33 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:29:33 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d614cae-134f-4f98-beb5-ca733fbe5fac]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:29:33 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:29:33 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:29:33 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f8c71dc-37b9-46a3-a894-657add2415c9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:29:33 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[96178776-3794-48a0-88fa-48357722e1e6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:29:33 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-80a5a21c-29d5-489c-bcf4-4befb37a93de tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Running cmd (subprocess): nvme version {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:29:33 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-80a5a21c-29d5-489c-bcf4-4befb37a93de tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] 'nvme version' failed. Not Retrying. {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 10:29:33 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.nvmeof [None req-80a5a21c-29d5-489c-bcf4-4befb37a93de tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] nvme not present on system {{(pid=75122) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 10:29:33 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:29:33 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 10:29:33 user nova-compute[75122]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 10:29:33 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[47b7d83e-9f45-4145-8301-a6e518039df6]: (4, '') {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:29:33 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.lightos [None req-80a5a21c-29d5-489c-bcf4-4befb37a93de tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75122) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 10:29:33 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.lightos [None req-80a5a21c-29d5-489c-bcf4-4befb37a93de tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75122) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 10:29:33 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.lightos [None req-80a5a21c-29d5-489c-bcf4-4befb37a93de tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] LIGHTOS: no hostnqn found. {{(pid=75122) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 10:29:33 user nova-compute[75122]: DEBUG os_brick.utils [None req-80a5a21c-29d5-489c-bcf4-4befb37a93de tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:742fb64b3587', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 10:29:33 user nova-compute[75122]: DEBUG nova.virt.block_device [None req-80a5a21c-29d5-489c-bcf4-4befb37a93de tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] [instance: 2a337f4a-327c-4f68-b57b-ced92c9f0785] Updating existing volume attachment record: 01e169d3-f2c6-4666-a043-897fb9a99397 {{(pid=75122) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 10:29:35 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:29:37 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:29:38 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-80a5a21c-29d5-489c-bcf4-4befb37a93de tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] [instance: 2a337f4a-327c-4f68-b57b-ced92c9f0785] Calling os-brick to attach iSCSI Volume {{(pid=75122) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 10:29:38 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-80a5a21c-29d5-489c-bcf4-4befb37a93de tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffa04060b80>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:aebb0bf3-2d0c-466a-9287-a602da835868', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vIKpRLtr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 10:29:38 user nova-compute[75122]: WARNING os_brick.initiator.connectors.base [None req-80a5a21c-29d5-489c-bcf4-4befb37a93de tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 10:29:38 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-80a5a21c-29d5-489c-bcf4-4befb37a93de tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 10:29:38 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-80a5a21c-29d5-489c-bcf4-4befb37a93de tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 10:29:38 user nova-compute[75122]: WARNING os_brick.initiator.connectors.base [None req-80a5a21c-29d5-489c-bcf4-4befb37a93de tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 10:29:38 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-80a5a21c-29d5-489c-bcf4-4befb37a93de tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aebb0bf3-2d0c-466a-9287-a602da835868" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 10:29:38 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-80a5a21c-29d5-489c-bcf4-4befb37a93de tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aebb0bf3-2d0c-466a-9287-a602da835868" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 10:29:38 user nova-compute[75122]: INFO os_brick.initiator.connectors.iscsi [None req-80a5a21c-29d5-489c-bcf4-4befb37a93de tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 10:29:38 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aebb0bf3-2d0c-466a-9287-a602da835868 -p 172.16.0.220:3260 {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:29:38 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aebb0bf3-2d0c-466a-9287-a602da835868 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:29:38 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[5967fa7a-464c-4884-acf2-8c57b23e6b3c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:29:38 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-80a5a21c-29d5-489c-bcf4-4befb37a93de tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 10:29:38 user nova-compute[75122]:  {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 10:29:38 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aebb0bf3-2d0c-466a-9287-a602da835868 -p 172.16.0.220:3260 --interface default --op new {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:29:38 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aebb0bf3-2d0c-466a-9287-a602da835868 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:29:38 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b0b984a-3f0f-4624-a5fc-67d7a47dcda9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:aebb0bf3-2d0c-466a-9287-a602da835868] added\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:29:38 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-80a5a21c-29d5-489c-bcf4-4befb37a93de tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:aebb0bf3-2d0c-466a-9287-a602da835868] added
Nov 15 10:29:38 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 10:29:38 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aebb0bf3-2d0c-466a-9287-a602da835868 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:29:38 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aebb0bf3-2d0c-466a-9287-a602da835868 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:29:38 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[c65262a2-642f-402a-97f9-91f9e2df1867]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:29:38 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-80a5a21c-29d5-489c-bcf4-4befb37a93de tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 10:29:38 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aebb0bf3-2d0c-466a-9287-a602da835868 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:29:38 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aebb0bf3-2d0c-466a-9287-a602da835868 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:29:38 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc6f0bc6-7090-4219-bbf7-ffb61c6e462a]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:29:38 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-80a5a21c-29d5-489c-bcf4-4befb37a93de tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 10:29:38 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aebb0bf3-2d0c-466a-9287-a602da835868 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vIKpRLtr {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:29:38 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aebb0bf3-2d0c-466a-9287-a602da835868 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vIKpRLtr" returned: 0 in 0.017s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:29:38 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1fc038b-458b-4dfa-a452-0b59e02ab040]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:29:38 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-80a5a21c-29d5-489c-bcf4-4befb37a93de tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vIKpRLtr'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 10:29:38 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aebb0bf3-2d0c-466a-9287-a602da835868 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:29:38 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aebb0bf3-2d0c-466a-9287-a602da835868 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:29:38 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd240fc9-717d-4158-aad1-e790ed79bfcc]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:29:38 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-80a5a21c-29d5-489c-bcf4-4befb37a93de tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 10:29:38 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:29:38 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:29:38 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[83b5d472-d1a7-4688-b464-1743a2b475cb]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:29:38 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-80a5a21c-29d5-489c-bcf4-4befb37a93de tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 15 10:29:38 user nova-compute[75122]:  {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 10:29:38 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-80a5a21c-29d5-489c-bcf4-4befb37a93de tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 15 10:29:38 user nova-compute[75122]:  {{(pid=75122) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 10:29:38 user nova-compute[75122]: WARNING os_brick.initiator.connectors.iscsi [None req-80a5a21c-29d5-489c-bcf4-4befb37a93de tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 15 10:29:38 user nova-compute[75122]: 
Nov 15 10:29:38 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aebb0bf3-2d0c-466a-9287-a602da835868 -p 172.16.0.220:3260 --login {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:29:38 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aebb0bf3-2d0c-466a-9287-a602da835868 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:29:38 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[00d2f40a-f357-4faf-829d-4437b036bb35]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:aebb0bf3-2d0c-466a-9287-a602da835868, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:aebb0bf3-2d0c-466a-9287-a602da835868, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:29:38 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-80a5a21c-29d5-489c-bcf4-4befb37a93de tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:aebb0bf3-2d0c-466a-9287-a602da835868, portal: 172.16.0.220,3260]
Nov 15 10:29:38 user nova-compute[75122]: Login to [iface: default, target: iqn.2010-10.org.openstack:aebb0bf3-2d0c-466a-9287-a602da835868, portal: 172.16.0.220,3260] successful.
Nov 15 10:29:38 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 10:29:38 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aebb0bf3-2d0c-466a-9287-a602da835868 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:29:38 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aebb0bf3-2d0c-466a-9287-a602da835868 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:29:38 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[79d1eee8-0eba-42d2-a34d-f6d6afa734b7]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:29:38 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-80a5a21c-29d5-489c-bcf4-4befb37a93de tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 10:29:38 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:29:38 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:29:38 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[d705b9d2-170d-4910-94a2-cb4b250f1939]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aebb0bf3-2d0c-466a-9287-a602da835868 (non-flash)\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:29:38 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-80a5a21c-29d5-489c-bcf4-4befb37a93de tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aebb0bf3-2d0c-466a-9287-a602da835868 (non-flash)
Nov 15 10:29:38 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 10:29:38 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-80a5a21c-29d5-489c-bcf4-4befb37a93de tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aebb0bf3-2d0c-466a-9287-a602da835868 (non-flash)
Nov 15 10:29:38 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 10:29:38 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-80a5a21c-29d5-489c-bcf4-4befb37a93de tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aebb0bf3-2d0c-466a-9287-a602da835868" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.255s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 10:29:38 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-80a5a21c-29d5-489c-bcf4-4befb37a93de tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Connected to 172.16.0.220:3260 {{(pid=75122) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 10:29:38 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-80a5a21c-29d5-489c-bcf4-4befb37a93de tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] HCTL ('33', '-', '-', 0) found on session 70 with lun 0 {{(pid=75122) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 10:29:38 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-80a5a21c-29d5-489c-bcf4-4befb37a93de tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75122) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 10:29:38 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:29:38 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:29:38 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[89111153-a84d-4f0b-8ff5-cec13bca3830]: (4, ('- - 0', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:29:38 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-80a5a21c-29d5-489c-bcf4-4befb37a93de tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Searching for a device in session 70 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75122) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 10:29:38 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-80a5a21c-29d5-489c-bcf4-4befb37a93de tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:aebb0bf3-2d0c-466a-9287-a602da835868', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vIKpRLtr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75122) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 10:29:39 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-80a5a21c-29d5-489c-bcf4-4befb37a93de tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.286s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 10:29:39 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-80a5a21c-29d5-489c-bcf4-4befb37a93de tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] <== connect_volume: return (1288ms) {'type': 'block', 'scsi_wwn': '23562376664633039', 'path': '/dev/sdb'} {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 10:29:39 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-80a5a21c-29d5-489c-bcf4-4befb37a93de tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] [instance: 2a337f4a-327c-4f68-b57b-ced92c9f0785] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23562376664633039', 'path': '/dev/sdb'} {{(pid=75122) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 10:29:39 user nova-compute[75122]: DEBUG nova.objects.instance [None req-80a5a21c-29d5-489c-bcf4-4befb37a93de tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Lazy-loading 'flavor' on Instance uuid 2a337f4a-327c-4f68-b57b-ced92c9f0785 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 10:29:39 user nova-compute[75122]: DEBUG nova.virt.libvirt.guest [None req-80a5a21c-29d5-489c-bcf4-4befb37a93de tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 10:29:39 user nova-compute[75122]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 10:29:39 user nova-compute[75122]:   <source dev="/dev/sdb"/>
Nov 15 10:29:39 user nova-compute[75122]:   <target dev="vdb" bus="virtio"/>
Nov 15 10:29:39 user nova-compute[75122]:   <serial>aebb0bf3-2d0c-466a-9287-a602da835868</serial>
Nov 15 10:29:39 user nova-compute[75122]: </disk>
Nov 15 10:29:39 user nova-compute[75122]:  {{(pid=75122) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 10:29:39 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-80a5a21c-29d5-489c-bcf4-4befb37a93de tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] No BDM found with device name vda, not building metadata. {{(pid=75122) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 10:29:39 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-80a5a21c-29d5-489c-bcf4-4befb37a93de tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75122) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 10:29:39 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-80a5a21c-29d5-489c-bcf4-4befb37a93de tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] No VIF found with MAC fa:16:3e:c5:79:7a, not building metadata {{(pid=75122) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 10:29:40 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-80a5a21c-29d5-489c-bcf4-4befb37a93de tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Lock "2a337f4a-327c-4f68-b57b-ced92c9f0785" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.430s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:29:40 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:29:42 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:29:42 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-a9ff8bcb-926a-45c8-90f1-16529beaaed0 tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Acquiring lock "2a337f4a-327c-4f68-b57b-ced92c9f0785" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:29:42 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-a9ff8bcb-926a-45c8-90f1-16529beaaed0 tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Lock "2a337f4a-327c-4f68-b57b-ced92c9f0785" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:29:42 user nova-compute[75122]: INFO nova.compute.manager [None req-a9ff8bcb-926a-45c8-90f1-16529beaaed0 tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] [instance: 2a337f4a-327c-4f68-b57b-ced92c9f0785] Detaching volume aebb0bf3-2d0c-466a-9287-a602da835868
Nov 15 10:29:42 user nova-compute[75122]: INFO nova.virt.block_device [None req-a9ff8bcb-926a-45c8-90f1-16529beaaed0 tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] [instance: 2a337f4a-327c-4f68-b57b-ced92c9f0785] Attempting to driver detach volume aebb0bf3-2d0c-466a-9287-a602da835868 from mountpoint /dev/vdb
Nov 15 10:29:42 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-a9ff8bcb-926a-45c8-90f1-16529beaaed0 tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Attempting to detach device vdb from instance 2a337f4a-327c-4f68-b57b-ced92c9f0785 from the persistent domain config. {{(pid=75122) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 10:29:42 user nova-compute[75122]: DEBUG nova.virt.libvirt.guest [None req-a9ff8bcb-926a-45c8-90f1-16529beaaed0 tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 10:29:42 user nova-compute[75122]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 10:29:42 user nova-compute[75122]:   <source dev="/dev/sdb"/>
Nov 15 10:29:42 user nova-compute[75122]:   <target dev="vdb" bus="virtio"/>
Nov 15 10:29:42 user nova-compute[75122]:   <serial>aebb0bf3-2d0c-466a-9287-a602da835868</serial>
Nov 15 10:29:42 user nova-compute[75122]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 10:29:42 user nova-compute[75122]: </disk>
Nov 15 10:29:42 user nova-compute[75122]:  {{(pid=75122) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 10:29:42 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-a9ff8bcb-926a-45c8-90f1-16529beaaed0 tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Successfully detached device vdb from instance 2a337f4a-327c-4f68-b57b-ced92c9f0785 from the persistent domain config.
Nov 15 10:29:42 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-a9ff8bcb-926a-45c8-90f1-16529beaaed0 tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2a337f4a-327c-4f68-b57b-ced92c9f0785 from the live domain config. {{(pid=75122) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 10:29:42 user nova-compute[75122]: DEBUG nova.virt.libvirt.guest [None req-a9ff8bcb-926a-45c8-90f1-16529beaaed0 tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 10:29:42 user nova-compute[75122]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 10:29:42 user nova-compute[75122]:   <source dev="/dev/sdb"/>
Nov 15 10:29:42 user nova-compute[75122]:   <target dev="vdb" bus="virtio"/>
Nov 15 10:29:42 user nova-compute[75122]:   <serial>aebb0bf3-2d0c-466a-9287-a602da835868</serial>
Nov 15 10:29:42 user nova-compute[75122]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 10:29:42 user nova-compute[75122]: </disk>
Nov 15 10:29:42 user nova-compute[75122]:  {{(pid=75122) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 10:29:43 user nova-compute[75122]: DEBUG nova.virt.libvirt.driver [None req-a9ff8bcb-926a-45c8-90f1-16529beaaed0 tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2a337f4a-327c-4f68-b57b-ced92c9f0785 {{(pid=75122) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 10:29:45 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:29:47 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:29:50 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:29:55 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:29:56 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:30:00 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:30:01 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:30:02 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:30:03 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:30:03 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-a9ff8bcb-926a-45c8-90f1-16529beaaed0 tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 2a337f4a-327c-4f68-b57b-ced92c9f0785 is timed out.
Nov 15 10:30:03 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-a9ff8bcb-926a-45c8-90f1-16529beaaed0 tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Successfully detached device vdb from instance 2a337f4a-327c-4f68-b57b-ced92c9f0785 from the live domain config.
Nov 15 10:30:03 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a9ff8bcb-926a-45c8-90f1-16529beaaed0 tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] [instance: 2a337f4a-327c-4f68-b57b-ced92c9f0785] calling os-brick to detach iSCSI Volume {{(pid=75122) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 10:30:03 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9ff8bcb-926a-45c8-90f1-16529beaaed0 tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ffa04060b80>, {'target_iqn': 'iqn.2010-10.org.openstack:aebb0bf3-2d0c-466a-9287-a602da835868', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vIKpRLtr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 10:30:03 user nova-compute[75122]: WARNING os_brick.initiator.connectors.base [None req-a9ff8bcb-926a-45c8-90f1-16529beaaed0 tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 10:30:03 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-a9ff8bcb-926a-45c8-90f1-16529beaaed0 tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 10:30:03 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-a9ff8bcb-926a-45c8-90f1-16529beaaed0 tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 10:30:03 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:30:03 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:30:03 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f957b51-c0bb-499c-b63f-c345adc0c823]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:aebb0bf3-2d0c-466a-9287-a602da835868\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:30:03 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9ff8bcb-926a-45c8-90f1-16529beaaed0 tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 10:30:03 user nova-compute[75122]: No targets found.
Nov 15 10:30:03 user nova-compute[75122]: iSNS:
Nov 15 10:30:03 user nova-compute[75122]: No targets found.
Nov 15 10:30:03 user nova-compute[75122]: STATIC:
Nov 15 10:30:03 user nova-compute[75122]: Target: iqn.2010-10.org.openstack:aebb0bf3-2d0c-466a-9287-a602da835868
Nov 15 10:30:03 user nova-compute[75122]:         Portal: 172.16.0.220:3260,-1
Nov 15 10:30:03 user nova-compute[75122]:                 Iface Name: default
Nov 15 10:30:03 user nova-compute[75122]: FIRMWARE:
Nov 15 10:30:03 user nova-compute[75122]: No targets found.
Nov 15 10:30:03 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 10:30:03 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9ff8bcb-926a-45c8-90f1-16529beaaed0 tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 10:30:03 user nova-compute[75122]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 10:30:03 user nova-compute[75122]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75122) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 10:30:03 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9ff8bcb-926a-45c8-90f1-16529beaaed0 tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aebb0bf3-2d0c-466a-9287-a602da835868', 0)] {{(pid=75122) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 10:30:03 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:30:03 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:30:03 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[99add241-2a61-45d9-b7e1-4179fab30e68]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aebb0bf3-2d0c-466a-9287-a602da835868\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:30:03 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:30:03 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:30:03 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[aca02d8a-59e5-4f22-8204-59503865097d]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aebb0bf3-2d0c-466a-9287-a602da835868 (non-flash)\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:30:03 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9ff8bcb-926a-45c8-90f1-16529beaaed0 tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aebb0bf3-2d0c-466a-9287-a602da835868 (non-flash)
Nov 15 10:30:03 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 10:30:03 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9ff8bcb-926a-45c8-90f1-16529beaaed0 tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aebb0bf3-2d0c-466a-9287-a602da835868 (non-flash)
Nov 15 10:30:03 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 10:30:03 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9ff8bcb-926a-45c8-90f1-16529beaaed0 tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff9e4216710>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aebb0bf3-2d0c-466a-9287-a602da835868'): ({'sdb'}, set())}) {{(pid=75122) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 10:30:03 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-a9ff8bcb-926a-45c8-90f1-16529beaaed0 tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Removing single pathed devices sdb {{(pid=75122) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 10:30:03 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:30:03 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:30:03 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e79ebbe-cf69-45f5-bf8e-2704b34131ac]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:30:03 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:30:03 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:30:03 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c03f109-d7a7-488b-ad53-368f0cdf14e9]: (4, ('ok\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:30:03 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-a9ff8bcb-926a-45c8-90f1-16529beaaed0 tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Flushing IO for device /dev/sdb {{(pid=75122) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 10:30:03 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:30:03 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:30:03 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[873a9d93-34c5-47ae-a9b1-3f06274da8bd]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:30:03 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-a9ff8bcb-926a-45c8-90f1-16529beaaed0 tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75122) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 10:30:03 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:30:03 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:30:03 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[619a243a-7ca9-4585-ac80-6c8fa105dc64]: (4, ('1', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:30:03 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-a9ff8bcb-926a-45c8-90f1-16529beaaed0 tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75122) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 10:30:03 user nova-compute[75122]: DEBUG os_brick.initiator.linuxscsi [None req-a9ff8bcb-926a-45c8-90f1-16529beaaed0 tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] SCSI volumes sdb have been removed. {{(pid=75122) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 10:30:03 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9ff8bcb-926a-45c8-90f1-16529beaaed0 tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aebb0bf3-2d0c-466a-9287-a602da835868')] {{(pid=75122) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 10:30:03 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aebb0bf3-2d0c-466a-9287-a602da835868 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:30:03 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aebb0bf3-2d0c-466a-9287-a602da835868 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:30:03 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[09234d0a-3218-4183-bd9c-64b28c1a84e7]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:30:03 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9ff8bcb-926a-45c8-90f1-16529beaaed0 tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 10:30:03 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aebb0bf3-2d0c-466a-9287-a602da835868 -p 172.16.0.220:3260 --logout {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:30:03 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aebb0bf3-2d0c-466a-9287-a602da835868 -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:30:03 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c5dcbc1-26ef-4a13-ab94-6e50fc7047d6]: (4, ('Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:aebb0bf3-2d0c-466a-9287-a602da835868, portal: 172.16.0.220,3260]\nLogout of [sid: 70, target: iqn.2010-10.org.openstack:aebb0bf3-2d0c-466a-9287-a602da835868, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:30:03 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9ff8bcb-926a-45c8-90f1-16529beaaed0 tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:aebb0bf3-2d0c-466a-9287-a602da835868, portal: 172.16.0.220,3260]
Nov 15 10:30:03 user nova-compute[75122]: Logout of [sid: 70, target: iqn.2010-10.org.openstack:aebb0bf3-2d0c-466a-9287-a602da835868, portal: 172.16.0.220,3260] successful.
Nov 15 10:30:03 user nova-compute[75122]:  stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 10:30:03 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aebb0bf3-2d0c-466a-9287-a602da835868 -p 172.16.0.220:3260 --op delete {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:30:03 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aebb0bf3-2d0c-466a-9287-a602da835868 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=85998) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:30:03 user nova-compute[75122]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f04009f-d485-4d41-b32a-f71cb4854604]: (4, ('', '')) {{(pid=85998) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 10:30:03 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9ff8bcb-926a-45c8-90f1-16529beaaed0 tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75122) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 10:30:03 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.base [None req-a9ff8bcb-926a-45c8-90f1-16529beaaed0 tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.293s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 10:30:03 user nova-compute[75122]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9ff8bcb-926a-45c8-90f1-16529beaaed0 tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] <== disconnect_volume: return (294ms) None {{(pid=75122) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 10:30:03 user nova-compute[75122]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a9ff8bcb-926a-45c8-90f1-16529beaaed0 tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] [instance: 2a337f4a-327c-4f68-b57b-ced92c9f0785] Disconnected iSCSI Volume {{(pid=75122) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 10:30:04 user nova-compute[75122]: DEBUG nova.objects.instance [None req-a9ff8bcb-926a-45c8-90f1-16529beaaed0 tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Lazy-loading 'flavor' on Instance uuid 2a337f4a-327c-4f68-b57b-ced92c9f0785 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 10:30:04 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-a9ff8bcb-926a-45c8-90f1-16529beaaed0 tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Lock "2a337f4a-327c-4f68-b57b-ced92c9f0785" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.602s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:30:05 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:30:06 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:30:06 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:30:06 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:30:06 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:30:06 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75122) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 10:30:06 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a337f4a-327c-4f68-b57b-ced92c9f0785/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:30:06 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a337f4a-327c-4f68-b57b-ced92c9f0785/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:30:06 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a337f4a-327c-4f68-b57b-ced92c9f0785/disk --force-share --output=json {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 10:30:06 user nova-compute[75122]: DEBUG oslo_concurrency.processutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2a337f4a-327c-4f68-b57b-ced92c9f0785/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75122) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 10:30:06 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 10:30:06 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 10:30:07 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Hypervisor/Node resource view: name=user free_ram=8965MB free_disk=25.02460479736328GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75122) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 10:30:07 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:30:07 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:30:07 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Instance 2a337f4a-327c-4f68-b57b-ced92c9f0785 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75122) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 10:30:07 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75122) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 10:30:07 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75122) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 10:30:07 user nova-compute[75122]: DEBUG nova.compute.provider_tree [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Inventory has not changed in ProviderTree for provider: 69a3da65-47be-44c6-b67c-c692b58284ef {{(pid=75122) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 10:30:07 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Inventory has not changed for provider 69a3da65-47be-44c6-b67c-c692b58284ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 10:30:07 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Compute_service record updated for user:user {{(pid=75122) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 10:30:07 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.348s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:30:10 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:30:10 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:30:10 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Starting heal instance info cache {{(pid=75122) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 10:30:10 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Rebuilding the list of instances to heal {{(pid=75122) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 10:30:10 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "refresh_cache-2a337f4a-327c-4f68-b57b-ced92c9f0785" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 10:30:10 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquired lock "refresh_cache-2a337f4a-327c-4f68-b57b-ced92c9f0785" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 10:30:10 user nova-compute[75122]: DEBUG nova.network.neutron [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] [instance: 2a337f4a-327c-4f68-b57b-ced92c9f0785] Forcefully refreshing network info cache for instance {{(pid=75122) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 10:30:10 user nova-compute[75122]: DEBUG nova.objects.instance [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lazy-loading 'info_cache' on Instance uuid 2a337f4a-327c-4f68-b57b-ced92c9f0785 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 10:30:10 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:30:10 user nova-compute[75122]: DEBUG nova.network.neutron [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] [instance: 2a337f4a-327c-4f68-b57b-ced92c9f0785] Updating instance_info_cache with network_info: [{"id": "e85cb1cf-cfb8-41cb-8337-52586061c47c", "address": "fa:16:3e:c5:79:7a", "network": {"id": "1c3d3d85-5e15-4b5a-9671-acca5de739d8", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-413087253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dc6ab7d6975429083681f5807a78f08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape85cb1cf-cf", "ovs_interfaceid": "e85cb1cf-cfb8-41cb-8337-52586061c47c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 10:30:10 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Releasing lock "refresh_cache-2a337f4a-327c-4f68-b57b-ced92c9f0785" {{(pid=75122) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 10:30:10 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] [instance: 2a337f4a-327c-4f68-b57b-ced92c9f0785] Updated the network info_cache for instance {{(pid=75122) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 10:30:13 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:30:15 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:30:17 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:30:17 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75122) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 10:30:20 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:30:25 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:30:25 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:30:25 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75122) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 10:30:25 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75122) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 10:30:25 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75122) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 10:30:25 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:30:30 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:30:35 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:30:40 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:30:45 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:30:46 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-dc2cfd4a-1dd9-4229-bb01-88198cf308ef tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Acquiring lock "2a337f4a-327c-4f68-b57b-ced92c9f0785" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:30:46 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-dc2cfd4a-1dd9-4229-bb01-88198cf308ef tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Lock "2a337f4a-327c-4f68-b57b-ced92c9f0785" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:30:46 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-dc2cfd4a-1dd9-4229-bb01-88198cf308ef tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Acquiring lock "2a337f4a-327c-4f68-b57b-ced92c9f0785-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:30:46 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-dc2cfd4a-1dd9-4229-bb01-88198cf308ef tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Lock "2a337f4a-327c-4f68-b57b-ced92c9f0785-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:30:46 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-dc2cfd4a-1dd9-4229-bb01-88198cf308ef tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Lock "2a337f4a-327c-4f68-b57b-ced92c9f0785-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:30:46 user nova-compute[75122]: INFO nova.compute.manager [None req-dc2cfd4a-1dd9-4229-bb01-88198cf308ef tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] [instance: 2a337f4a-327c-4f68-b57b-ced92c9f0785] Terminating instance
Nov 15 10:30:46 user nova-compute[75122]: DEBUG nova.compute.manager [None req-dc2cfd4a-1dd9-4229-bb01-88198cf308ef tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] [instance: 2a337f4a-327c-4f68-b57b-ced92c9f0785] Start destroying the instance on the hypervisor. {{(pid=75122) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 10:30:46 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:30:46 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:30:46 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:30:46 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:30:46 user nova-compute[75122]: DEBUG nova.compute.manager [req-cd73b216-8dbe-4181-9d81-6d897c5eddb8 req-7705c678-d636-4679-97e3-1afbdb444c90 service nova] [instance: 2a337f4a-327c-4f68-b57b-ced92c9f0785] Received event network-vif-unplugged-e85cb1cf-cfb8-41cb-8337-52586061c47c {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 10:30:46 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-cd73b216-8dbe-4181-9d81-6d897c5eddb8 req-7705c678-d636-4679-97e3-1afbdb444c90 service nova] Acquiring lock "2a337f4a-327c-4f68-b57b-ced92c9f0785-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:30:46 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-cd73b216-8dbe-4181-9d81-6d897c5eddb8 req-7705c678-d636-4679-97e3-1afbdb444c90 service nova] Lock "2a337f4a-327c-4f68-b57b-ced92c9f0785-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:30:46 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-cd73b216-8dbe-4181-9d81-6d897c5eddb8 req-7705c678-d636-4679-97e3-1afbdb444c90 service nova] Lock "2a337f4a-327c-4f68-b57b-ced92c9f0785-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:30:46 user nova-compute[75122]: DEBUG nova.compute.manager [req-cd73b216-8dbe-4181-9d81-6d897c5eddb8 req-7705c678-d636-4679-97e3-1afbdb444c90 service nova] [instance: 2a337f4a-327c-4f68-b57b-ced92c9f0785] No waiting events found dispatching network-vif-unplugged-e85cb1cf-cfb8-41cb-8337-52586061c47c {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 10:30:46 user nova-compute[75122]: DEBUG nova.compute.manager [req-cd73b216-8dbe-4181-9d81-6d897c5eddb8 req-7705c678-d636-4679-97e3-1afbdb444c90 service nova] [instance: 2a337f4a-327c-4f68-b57b-ced92c9f0785] Received event network-vif-unplugged-e85cb1cf-cfb8-41cb-8337-52586061c47c for instance with task_state deleting. {{(pid=75122) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 10:30:46 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:30:46 user nova-compute[75122]: INFO nova.virt.libvirt.driver [-] [instance: 2a337f4a-327c-4f68-b57b-ced92c9f0785] Instance destroyed successfully.
Nov 15 10:30:46 user nova-compute[75122]: DEBUG nova.objects.instance [None req-dc2cfd4a-1dd9-4229-bb01-88198cf308ef tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Lazy-loading 'resources' on Instance uuid 2a337f4a-327c-4f68-b57b-ced92c9f0785 {{(pid=75122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 10:30:46 user nova-compute[75122]: DEBUG nova.virt.libvirt.vif [None req-dc2cfd4a-1dd9-4229-bb01-88198cf308ef tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T10:24:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-2014063672',display_name='tempest-SnapshotDataIntegrityTests-server-2014063672',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-2014063672',id=53,image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJUtfyo0aLhuo4kTNVogxz3oqC4DtLpQf9Yh4q8xNV4S98WK3o0ZK7/uQXV0GwTuddBKbuB/gYU8ewzEyv6yxd6mY53lC8c8l/biLd0FtLPnUBzalGGss/Sra5vvFs0/lw==',key_name='tempest-keypair-1856492247',keypairs=<?>,launch_index=0,launched_at=2023-11-15T10:24:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9dc6ab7d6975429083681f5807a78f08',ramdisk_id='',reservation_id='r-fc2lkv4x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5e862cfe-47b8-4725-8292-65761ee6d0f5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1201504109',owner_user_name='tempest-SnapshotDataIntegrityTests-1201504109-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T10:24:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8e22523c23164b828594d1c514ac3e7a',uuid=2a337f4a-327c-4f68-b57b-ced92c9f0785,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e85cb1cf-cfb8-41cb-8337-52586061c47c", "address": "fa:16:3e:c5:79:7a", "network": {"id": "1c3d3d85-5e15-4b5a-9671-acca5de739d8", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-413087253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dc6ab7d6975429083681f5807a78f08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape85cb1cf-cf", "ovs_interfaceid": "e85cb1cf-cfb8-41cb-8337-52586061c47c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 10:30:46 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-dc2cfd4a-1dd9-4229-bb01-88198cf308ef tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Converting VIF {"id": "e85cb1cf-cfb8-41cb-8337-52586061c47c", "address": "fa:16:3e:c5:79:7a", "network": {"id": "1c3d3d85-5e15-4b5a-9671-acca5de739d8", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-413087253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9dc6ab7d6975429083681f5807a78f08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape85cb1cf-cf", "ovs_interfaceid": "e85cb1cf-cfb8-41cb-8337-52586061c47c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 10:30:46 user nova-compute[75122]: DEBUG nova.network.os_vif_util [None req-dc2cfd4a-1dd9-4229-bb01-88198cf308ef tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c5:79:7a,bridge_name='br-int',has_traffic_filtering=True,id=e85cb1cf-cfb8-41cb-8337-52586061c47c,network=Network(1c3d3d85-5e15-4b5a-9671-acca5de739d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape85cb1cf-cf') {{(pid=75122) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 10:30:46 user nova-compute[75122]: DEBUG os_vif [None req-dc2cfd4a-1dd9-4229-bb01-88198cf308ef tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c5:79:7a,bridge_name='br-int',has_traffic_filtering=True,id=e85cb1cf-cfb8-41cb-8337-52586061c47c,network=Network(1c3d3d85-5e15-4b5a-9671-acca5de739d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape85cb1cf-cf') {{(pid=75122) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 10:30:47 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:30:47 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape85cb1cf-cf, bridge=br-int, if_exists=True) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 10:30:47 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:30:47 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:30:47 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:30:47 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=71dd949e-43c4-4f87-957a-53053e31e716) {{(pid=75122) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 10:30:47 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:30:47 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:30:47 user nova-compute[75122]: INFO os_vif [None req-dc2cfd4a-1dd9-4229-bb01-88198cf308ef tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c5:79:7a,bridge_name='br-int',has_traffic_filtering=True,id=e85cb1cf-cfb8-41cb-8337-52586061c47c,network=Network(1c3d3d85-5e15-4b5a-9671-acca5de739d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape85cb1cf-cf')
Nov 15 10:30:47 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-dc2cfd4a-1dd9-4229-bb01-88198cf308ef tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] [instance: 2a337f4a-327c-4f68-b57b-ced92c9f0785] Deleting instance files /opt/stack/data/nova/instances/2a337f4a-327c-4f68-b57b-ced92c9f0785_del
Nov 15 10:30:47 user nova-compute[75122]: INFO nova.virt.libvirt.driver [None req-dc2cfd4a-1dd9-4229-bb01-88198cf308ef tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] [instance: 2a337f4a-327c-4f68-b57b-ced92c9f0785] Deletion of /opt/stack/data/nova/instances/2a337f4a-327c-4f68-b57b-ced92c9f0785_del complete
Nov 15 10:30:47 user nova-compute[75122]: INFO nova.compute.manager [None req-dc2cfd4a-1dd9-4229-bb01-88198cf308ef tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] [instance: 2a337f4a-327c-4f68-b57b-ced92c9f0785] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 15 10:30:47 user nova-compute[75122]: DEBUG oslo.service.loopingcall [None req-dc2cfd4a-1dd9-4229-bb01-88198cf308ef tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75122) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 10:30:47 user nova-compute[75122]: DEBUG nova.compute.manager [-] [instance: 2a337f4a-327c-4f68-b57b-ced92c9f0785] Deallocating network for instance {{(pid=75122) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 10:30:47 user nova-compute[75122]: DEBUG nova.network.neutron [-] [instance: 2a337f4a-327c-4f68-b57b-ced92c9f0785] deallocate_for_instance() {{(pid=75122) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 10:30:47 user nova-compute[75122]: DEBUG nova.network.neutron [-] [instance: 2a337f4a-327c-4f68-b57b-ced92c9f0785] Updating instance_info_cache with network_info: [] {{(pid=75122) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 10:30:47 user nova-compute[75122]: INFO nova.compute.manager [-] [instance: 2a337f4a-327c-4f68-b57b-ced92c9f0785] Took 0.82 seconds to deallocate network for instance.
Nov 15 10:30:47 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-dc2cfd4a-1dd9-4229-bb01-88198cf308ef tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:30:47 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-dc2cfd4a-1dd9-4229-bb01-88198cf308ef tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:30:48 user nova-compute[75122]: DEBUG nova.compute.manager [req-ad1d90ba-39a9-45be-bcfc-3fa2fefab435 req-1631e751-c3de-4779-aa20-3f7611cf8177 service nova] [instance: 2a337f4a-327c-4f68-b57b-ced92c9f0785] Received event network-vif-deleted-e85cb1cf-cfb8-41cb-8337-52586061c47c {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 10:30:48 user nova-compute[75122]: DEBUG nova.compute.provider_tree [None req-dc2cfd4a-1dd9-4229-bb01-88198cf308ef tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Inventory has not changed in ProviderTree for provider: 69a3da65-47be-44c6-b67c-c692b58284ef {{(pid=75122) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 10:30:48 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-dc2cfd4a-1dd9-4229-bb01-88198cf308ef tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Inventory has not changed for provider 69a3da65-47be-44c6-b67c-c692b58284ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 10:30:48 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-dc2cfd4a-1dd9-4229-bb01-88198cf308ef tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.114s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:30:48 user nova-compute[75122]: INFO nova.scheduler.client.report [None req-dc2cfd4a-1dd9-4229-bb01-88198cf308ef tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Deleted allocations for instance 2a337f4a-327c-4f68-b57b-ced92c9f0785
Nov 15 10:30:48 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-dc2cfd4a-1dd9-4229-bb01-88198cf308ef tempest-SnapshotDataIntegrityTests-1201504109 tempest-SnapshotDataIntegrityTests-1201504109-project-member] Lock "2a337f4a-327c-4f68-b57b-ced92c9f0785" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.989s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:30:48 user nova-compute[75122]: DEBUG nova.compute.manager [req-9a1c9f79-1063-4032-81fb-77ef95067d53 req-60a8b6f3-6c2d-420c-91af-f0377443dafd service nova] [instance: 2a337f4a-327c-4f68-b57b-ced92c9f0785] Received event network-vif-plugged-e85cb1cf-cfb8-41cb-8337-52586061c47c {{(pid=75122) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 10:30:48 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-9a1c9f79-1063-4032-81fb-77ef95067d53 req-60a8b6f3-6c2d-420c-91af-f0377443dafd service nova] Acquiring lock "2a337f4a-327c-4f68-b57b-ced92c9f0785-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:30:48 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-9a1c9f79-1063-4032-81fb-77ef95067d53 req-60a8b6f3-6c2d-420c-91af-f0377443dafd service nova] Lock "2a337f4a-327c-4f68-b57b-ced92c9f0785-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:30:48 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [req-9a1c9f79-1063-4032-81fb-77ef95067d53 req-60a8b6f3-6c2d-420c-91af-f0377443dafd service nova] Lock "2a337f4a-327c-4f68-b57b-ced92c9f0785-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:30:48 user nova-compute[75122]: DEBUG nova.compute.manager [req-9a1c9f79-1063-4032-81fb-77ef95067d53 req-60a8b6f3-6c2d-420c-91af-f0377443dafd service nova] [instance: 2a337f4a-327c-4f68-b57b-ced92c9f0785] No waiting events found dispatching network-vif-plugged-e85cb1cf-cfb8-41cb-8337-52586061c47c {{(pid=75122) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 10:30:48 user nova-compute[75122]: WARNING nova.compute.manager [req-9a1c9f79-1063-4032-81fb-77ef95067d53 req-60a8b6f3-6c2d-420c-91af-f0377443dafd service nova] [instance: 2a337f4a-327c-4f68-b57b-ced92c9f0785] Received unexpected event network-vif-plugged-e85cb1cf-cfb8-41cb-8337-52586061c47c for instance with vm_state deleted and task_state None.
Nov 15 10:30:52 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:30:57 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:30:57 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:31:01 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:31:02 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:31:02 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:31:04 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:31:06 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:31:06 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:31:06 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:31:06 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:31:06 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Auditing locally available compute resources for user (node: user) {{(pid=75122) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 10:31:06 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 10:31:06 user nova-compute[75122]: WARNING nova.virt.libvirt.driver [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 10:31:06 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Hypervisor/Node resource view: name=user free_ram=9107MB free_disk=25.051715850830078GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75122) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 10:31:06 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 10:31:06 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 10:31:06 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75122) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 10:31:06 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75122) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 10:31:06 user nova-compute[75122]: DEBUG nova.compute.provider_tree [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Inventory has not changed in ProviderTree for provider: 69a3da65-47be-44c6-b67c-c692b58284ef {{(pid=75122) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 10:31:06 user nova-compute[75122]: DEBUG nova.scheduler.client.report [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Inventory has not changed for provider 69a3da65-47be-44c6-b67c-c692b58284ef based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75122) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 10:31:06 user nova-compute[75122]: DEBUG nova.compute.resource_tracker [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Compute_service record updated for user:user {{(pid=75122) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 10:31:06 user nova-compute[75122]: DEBUG oslo_concurrency.lockutils [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.137s {{(pid=75122) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 10:31:07 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:31:10 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:31:11 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:31:11 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Starting heal instance info cache {{(pid=75122) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 10:31:11 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Rebuilding the list of instances to heal {{(pid=75122) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 10:31:11 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Didn't find any instances for network info cache update. {{(pid=75122) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 15 10:31:12 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:31:13 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:31:17 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:31:18 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:31:18 user nova-compute[75122]: DEBUG nova.compute.manager [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75122) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 10:31:22 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:31:27 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:31:28 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:31:32 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:31:37 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:31:39 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:31:42 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:31:42 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:31:47 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:31:52 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:31:57 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 10:31:58 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:32:02 user nova-compute[75122]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75122) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 10:32:02 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 10:32:03 user nova-compute[75122]: DEBUG oslo_service.periodic_task [None req-0bad9f60-eda4-416e-9e4e-16cb6fd42dc2 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75122) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}